Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform that provides residential proxy networks and scraping infrastructure. This toolkit enables Arcade agents to search the web, scrape any URL, and extract structured data from major platforms — at scale, without blocks.
Capabilities
- Web scraping: Fetch any public webpage and receive clean Markdown output, suitable for downstream parsing or LLM consumption.
- Multi-engine search: Query Google, Bing, or Yandex with control over result count, search type (web/images), and country targeting.
- Structured data extraction: Pull normalized JSON records from 20+ source types across Amazon, LinkedIn, Instagram, Facebook, X, YouTube, Zillow, Booking.com, and ZoomInfo — no custom parsing required.
Secrets
This toolkit requires no OAuth flow. Access is controlled entirely via two secrets injected at runtime.
BRIGHTDATA_API_KEY
Your Bright Data account API key. Obtain it from the Bright Data dashboard under Account Settings → API Token. A paid or trial Bright Data account is required; the key authenticates all requests to the Bright Data API.
BRIGHTDATA_ZONE
The name of a Bright Data zone (proxy/scraping zone) configured in your account. Zones are created and managed in the Bright Data control panel. Each zone defines the proxy type, geolocation pool, and access rules used for requests. Use the zone name (string) exactly as it appears in your dashboard.
For guidance on storing secrets in Arcade, see the Arcade secrets documentation. You can manage your configured secrets at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |