{ "name": "web-search-and-fetch", "description": "How to search the web and fetch URL content using the WebX11 proxy API", "tags": [ "search", "fetch", "web", "proxy", "api" ], "category": "research", "created": "2026-06-08T16:31:55.507Z", "updated": "2026-06-08T19:49:09.059Z", "content": "---\nname: web-search-and-fetch\ndescription: How to search the web and fetch URL content using the WebX11 proxy API\ntags: [search, fetch, web, proxy, api]\ncategory: research\n---\n## Steps\n1. **Search the web:**\n - Use search or web_search(query) — uses /api/search which queries SearXNG + DDG fallback\n - Results include: title, url, content snippet, source engine\n - Always available (same-origin, no CORS issues)\n - 5-minute server-side cache for repeated queries\n - Alternative: use ddg or duck for DuckDuckGo direct, or s as alias\n\n2. **Fetch URL content:**\n - Use fetch or web_fetch(url) — uses /api/extract which strips HTML, extracts clean text\n - Returns: title, content (up to 4000 chars), word_count, extraction method\n - SSRF protection blocks internal network addresses\n - 15-minute server-side cache\n\n3. **Search flags (via terminal search command):**\n - search --summarize — adds AI-generated overview via Ollama\n - search --fetch — fetches content snippets for top 3 results\n\n4. **When to use:**\n - User asks about current events, facts, research → use search \n - User says \"read this article\" or provides a URL → use fetch \n - For in-depth analysis: search first, then fetch top results" }