Olostep

Olostep

Search, scrape and crawl content from web. Real-time results in clean markdown.

2
Stars
4
Forks
0
Releases

Overview

The Olostep MCP Server is a Model Context Protocol (MCP) server that integrates Olostep's web scraping, content extraction, and search capabilities into a single service. It requires an Olostep API key to operate, which you obtain by signing up on the Olostep website. The server exposes tools for extracting webpage content as clean Markdown, discovering and mapping website URLs, and retrieving structured data from Google search results. It supports country-specific request routing for geo-targeted content and configurable wait times to accommodate JavaScript-heavy sites. It features robust error handling and reporting, and a straightforward API key configuration. Deployment and runtime options include running via npx, and configuration across various environments (Claude Desktop, Windsurf, Cursor, Metorial) with optional Orbit routing via ORBIT_KEY. The available tools include get_webpage_content, get_website_urls, and google_search, each with parameters for URL, query, and country to tailor results.

Details

Owner
olostep
Language
TypeScript
License
MIT License
Updated
2025-12-07

Features

Webpage content extraction (markdown formatting)

Retrieves webpage content in clean Markdown, with optional JavaScript rendering.

Google search results with structured data

Retrieves structured data from Google search results, including titles, links, and snippets.

Website URL discovery and mapping

Searches a website to map and discover relevant URLs, sorted by relevance.

Country-specific request routing

Supports geo-targeted content by routing requests from a designated country.

Configurable wait times for JavaScript-heavy sites

Allows configuring wait_before_scraping to accommodate dynamic pages.

Comprehensive error handling and reporting

Provides detailed error messages for API issues, network errors, authentication failures, and rate limits.

Simple API key configuration

Requires an Olostep API key (OLOSTEP_API_KEY) to authenticate requests.

Tags

web scrapingcontent extractionmarkdowngoogle_searchURL discoverygeo routingMCPAPI keyJavaScript renderingerror handling