Web Search & Research Tools
6 AI-powered tools for intelligent web search, research discovery, and content extraction.
MCP Endpoint: POST /hive_web_search/mcp
Data Source: Exa AI (Neural Search)
Overview
The Web Search category provides neural AI-powered search capabilities that go beyond traditional keyword matching. Exa's semantic search understands context and meaning, delivering highly relevant results for:
- Crypto News: Real-time news from trusted sources (CoinDesk, Cointelegraph, The Block, Decrypt)
- Research Papers: Academic papers from arXiv, ResearchGate, and Google Scholar
- Social Sentiment: Twitter/X posts and social media discussions
- General Web: Any web content with domain filtering
Crypto News Search
exa_search_crypto_news
Search for cryptocurrency news from trusted, authoritative sources.
| Parameter | Type | Required | Description |
|---|---|---|---|
| query | string | Yes | Search query (e.g., "Bitcoin ETF approval", "Ethereum upgrade") |
| num_results | number | No | Number of results to return (default: 10, max: 100) |
| start_published_date | string | No | Filter by publish date (ISO format: "2024-01-01") |
| end_published_date | string | No | End date filter |
Trusted Sources:
- CoinDesk
- Cointelegraph
- The Block
- Decrypt
- Bitcoin Magazine
- CryptoSlate
Example:
curl -X POST https://api.hiveintelligence.xyz/api/execute \
-H "Content-Type: application/json" \
-d '{
"toolName": "exa_search_crypto_news",
"arguments": {
"query": "Bitcoin ETF institutional adoption",
"num_results": 10,
"start_published_date": "2024-01-01"
}
}'
Response includes:
- Article title and URL
- Publication source
- Published date
- Content snippet
- Relevance score
Research & Academic Search
exa_search_research
Search academic papers, research publications, and technical documentation.
| Parameter | Type | Required | Description |
|---|---|---|---|
| query | string | Yes | Research topic (e.g., "zero knowledge proofs", "DeFi security") |
| num_results | number | No | Number of results (default: 10) |
| start_published_date | string | No | Filter by publication date |
Sources:
- arXiv (preprints)
- ResearchGate
- Google Scholar
- Academic institutions
- Technical whitepapers
Example:
curl -X POST https://api.hiveintelligence.xyz/api/execute \
-H "Content-Type: application/json" \
-d '{
"toolName": "exa_search_research",
"arguments": {
"query": "MEV extraction Ethereum research",
"num_results": 15
}
}'
Use Cases:
- Finding technical papers on blockchain protocols
- Researching DeFi security vulnerabilities
- Discovering academic analysis of tokenomics
- Finding whitepapers for new protocols
Social Media Search
exa_search_social
Search social media platforms for sentiment and discussions.
| Parameter | Type | Required | Description |
|---|---|---|---|
| query | string | Yes | Search query for social content |
| num_results | number | No | Number of results (default: 10) |
| start_published_date | string | No | Filter by date |
Platforms:
- Twitter/X
- Reddit (crypto subreddits)
- Discord (public servers)
- Telegram (public channels)
Example:
curl -X POST https://api.hiveintelligence.xyz/api/execute \
-H "Content-Type: application/json" \
-d '{
"toolName": "exa_search_social",
"arguments": {
"query": "Solana network outage community reaction",
"num_results": 20
}
}'
Use Cases:
- Monitoring community sentiment
- Tracking influencer discussions
- Detecting emerging narratives
- Crisis monitoring
General Web Search
exa_search_general
Perform general web searches with optional domain filtering.
| Parameter | Type | Required | Description |
|---|---|---|---|
| query | string | Yes | Search query |
| num_results | number | No | Number of results (default: 10) |
| include_domains | array | No | Only search these domains |
| exclude_domains | array | No | Exclude these domains |
| start_published_date | string | No | Filter by date |
Example:
curl -X POST https://api.hiveintelligence.xyz/api/execute \
-H "Content-Type: application/json" \
-d '{
"toolName": "exa_search_general",
"arguments": {
"query": "Uniswap v4 hooks tutorial",
"num_results": 10,
"include_domains": ["uniswap.org", "docs.uniswap.org", "github.com"]
}
}'
Features:
- Domain whitelisting/blacklisting
- Date range filtering
- Semantic understanding of queries
- High relevance ranking
Content Extraction
exa_get_page_content
Extract and parse content from specific URLs.
| Parameter | Type | Required | Description |
|---|---|---|---|
| urls | array | Yes | Array of URLs to extract content from |
| include_html | boolean | No | Include raw HTML (default: false) |
Example:
curl -X POST https://api.hiveintelligence.xyz/api/execute \
-H "Content-Type: application/json" \
-d '{
"toolName": "exa_get_page_content",
"arguments": {
"urls": [
"https://ethereum.org/en/roadmap/",
"https://docs.uniswap.org/concepts/overview"
]
}
}'
Returns:
- Clean extracted text
- Page title
- Meta description
- Publication date (if available)
- Author (if available)
Use Cases:
- Extracting documentation content
- Parsing blog posts for analysis
- Aggregating information from multiple sources
- Building research summaries
Similar Content Discovery
exa_find_similar
Find content similar to a given URL.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | Reference URL to find similar content |
| num_results | number | No | Number of similar results (default: 10) |
| include_domains | array | No | Limit to specific domains |
| exclude_domains | array | No | Exclude specific domains |
Example:
curl -X POST https://api.hiveintelligence.xyz/api/execute \
-H "Content-Type: application/json" \
-d '{
"toolName": "exa_find_similar",
"arguments": {
"url": "https://vitalik.eth.limo/general/2024/05/09/daos.html",
"num_results": 10
}
}'
Use Cases:
- Finding alternative sources on a topic
- Discovering related research
- Expanding reading lists
- Competitive analysis
Integration Examples
Python - News Monitoring
import requests
def search_crypto_news(query, days_back=7):
from datetime import datetime, timedelta
start_date = (datetime.now() - timedelta(days=days_back)).strftime("%Y-%m-%d")
response = requests.post(
"https://api.hiveintelligence.xyz/api/execute",
json={
"toolName": "exa_search_crypto_news",
"arguments": {
"query": query,
"num_results": 20,
"start_published_date": start_date
}
}
)
return response.json()
# Monitor Bitcoin ETF news
news = search_crypto_news("Bitcoin ETF flows institutional")
for article in news.get("results", []):
print(f"- {article['title']} ({article['source']})")
JavaScript - Research Aggregator
async function aggregateResearch(topic) {
const response = await fetch('https://api.hiveintelligence.xyz/api/execute', {
method: 'POST',
headers: { 'Content-Type': 'application/json' },
body: JSON.stringify({
toolName: 'exa_search_research',
arguments: {
query: topic,
num_results: 25
}
})
});
const data = await response.json();
return data.results?.map(paper => ({
title: paper.title,
url: paper.url,
summary: paper.snippet
}));
}
// Find DeFi security research
const papers = await aggregateResearch('DeFi smart contract vulnerabilities');
MCP Integration
{
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"name": "exa_search_crypto_news",
"arguments": {
"query": "Layer 2 scaling solutions comparison",
"num_results": 15
}
},
"id": 1
}
Best Practices
Query Optimization
- Be specific: "Ethereum gas optimization techniques" > "Ethereum gas"
- Use context: Include relevant terms like "DeFi", "NFT", "Layer 2"
- Date filtering: Use date ranges for time-sensitive queries
- Domain filtering: Limit to authoritative sources when accuracy matters
Rate Limits
| Tier | Requests/Minute | Results/Request |
|---|---|---|
| Free | 30 | 10 |
| Pro | 100 | 100 |
| Enterprise | Unlimited | 100 |
Error Handling
Common errors and solutions:
| Error | Cause | Solution |
|---|---|---|
rate_limit_exceeded | Too many requests | Implement backoff |
invalid_query | Empty or malformed query | Validate input |
domain_not_accessible | Domain blocked/unavailable | Try alternative sources |
Quick Reference
| Tool | Description |
|---|---|
| exa_search_crypto_news | Search crypto news from trusted sources |
| exa_search_research | Search academic papers and research |
| exa_search_social | Search social media for sentiment |
| exa_search_general | General web search with domain filtering |
| exa_get_page_content | Extract content from URLs |
| exa_find_similar | Find similar content to a URL |