Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
0.5.1Bright Data is a web data platform; this toolkit enables Arcade agents to search the web, scrape any URL, and extract structured data from major platforms at scale without being blocked.
Capabilities
- Web scraping — fetch any public webpage and receive clean Markdown output, suitable for LLM ingestion or downstream processing.
- Multi-engine search — query Google, Bing, or Yandex with configurable result count, country targeting, and search type (web or images).
- Structured data feeds — pull ready-to-use JSON records from e-commerce (Amazon), professional networks (LinkedIn, ZoomInfo), social media (Instagram, Facebook, X), real estate (Zillow), travel (Booking.com), and video (YouTube) without building custom parsers.
Secrets
BRIGHTDATA_API_KEY — Your Bright Data API key, used to authenticate all requests to the Bright Data platform. Obtain it from the Bright Data control panel under Account Settings → API Token. A paid Bright Data account is required; the key is a long alphanumeric string and should be treated as a credential.
BRIGHTDATA_ZONE — The name of the Bright Data proxy/scraping zone to route requests through (e.g., residential, datacenter, or a custom zone name you have created). Zones are configured in the Bright Data control panel under Proxies & Scraping Infrastructure → Zones. Each zone has its own billing plan and access settings; the value here must exactly match the zone name shown in the dashboard.
For details on configuring secrets in Arcade, see the Arcade secrets guide. You can also manage secrets directly at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MADE UP LINKS - IF LINKS ARE NEEDED, EXECUTE search_engine FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 2 |