Apify Scrapers

Web scraping platform for extracting structured content from social media and websites using pre-built actor templates.

Supported Platforms

• Instagram — posts, profiles, hashtags, and comments
• TikTok — videos, profiles, hashtags, and trending content
• YouTube — videos, channels, playlists, and comments
• Twitter/X — tweets, profiles, and search results
• Threads — posts and profiles

Integration Patterns

Actor Input

Each platform actor has a specific input schema defining what to scrape (URLs, hashtags, profiles), how many results to return, and what data to include.

Output Normalization

Raw actor output varies by platform. Normalize into a consistent schema for your application: title, content, media URLs, engagement metrics, and metadata.

Webhook Integration

Configure actors to POST results to your webhook endpoint on completion. Process and store results asynchronously.

Best Practices

• Set appropriate result limits to control costs
• Use proxy rotation for reliability
• Normalize platform-specific fields into a common schema
• Handle rate limits and temporary failures gracefully