Purpose: Perform web searches and retrieve full content from results.
Overview
The Search function combines web search capabilities with content extraction. It performs a search query, retrieves results, and can automatically scrape the full content from those results in a single operation.
When to Use
- Finding information across the entire web
- Searching for specific topics or keywords
- Gathering content from multiple search results
- Performing research across multiple websites
- Extracting content from search results without manual visits
- Location-specific or time-sensitive searches
Key Features
- Web Search Integration: Performs searches across the internet
- Content Retrieval: Gets full page content from search results
- Location Control: Customize search location/region
- Time Filtering: Filter results by time period
- Language Selection: Search in specific languages
- One-Step Operation: Search and scrape in a single action
Limitations
- Max Search Limit: 10 pages maximum per search operation
- Results per Query: Limited to top results matching your criteria
- Rate Limiting: Respects search engine guidelines
Input Requirements
- Search Query: The keywords or phrase to search for
- Location (Optional): Geographic region for location-specific results
- Time Period (Optional): Filter results by recency (last day, week, month, etc.)
- Language (Optional): Preferred language for results
Output
- Search Results: List of matching pages with metadata
- Full Content: Complete text content from selected results
- Metadata: URLs, titles, descriptions, and relevance information
- Structured Format: Organized data ready for analysis
Example Use Cases
- Researching a topic and gathering information from multiple sources
- Finding and extracting competitor information
- Collecting news articles on a specific topic
- Gathering location-specific business information
- Researching market trends across multiple sources
- Finding expert opinions or reviews on a product