Olostep × LangChain
Build AI agents with live web data
What you can do
Olostep adds these capabilities to LangChain out of the box.
Scrape & crawl any website
Extract clean markdown, HTML, or JSON from single URLs or autonomously crawl entire domains — with JS rendering and residential IPs included.
Batch-process thousands of URLs
Submit up to 10,000 URLs in a single batch job. Results complete in 5–8 minutes, perfect for large-scale RAG ingestion.
AI-powered web search
Let your agent search the web and get structured answers with cited sources using the answer_question tool.
Getting started
Connect Olostep to LangChain in minutes.
pip install langchain-olostep
# Then set your API key
export OLOSTEP_API_KEY="your_olostep_api_key_here"Get your API key from the Olostep dashboard. Free tier includes 500 requests — no credit card required.
What teams build with it
Real-world use cases for Olostep + LangChain.
RAG pipeline data ingestion
Crawl documentation sites, blogs, or knowledge bases and ingest the results into your vector store for retrieval-augmented generation.
Company data enrichment
Build agents that look up companies, extract structured data from their websites, and enrich your CRM or spreadsheet automatically.
Autonomous research agents
Combine extract_urls, scrape_batch, and answer_question into a LangGraph workflow that researches any topic end-to-end.
Frequently asked questions
Common questions about using Olostep with LangChain.
How do I use Olostep with LangChain?
Install langchain-olostep via pip, set your OLOSTEP_API_KEY environment variable, and import the tools (scrape_website, answer_question, extract_urls, scrape_batch, crawl_website). Pass them to any LangChain agent or LangGraph workflow using the standard tools interface.
Does langchain-olostep work with LangGraph?
Yes. All Olostep LangChain tools are fully compatible with LangGraph. You can use them as nodes in a StateGraph workflow — for example, a discover → scrape → analyze pipeline that autonomously researches any topic.
What output formats does the LangChain integration support?
The scrape_website and scrape_batch tools support markdown, html, json, and text output formats. Markdown is recommended for LLM consumption, while JSON is useful for structured extraction pipelines.
Can I use Olostep tools with OpenAI function calling through LangChain?
Yes. Olostep tools are standard LangChain tool objects and work with any LangChain-compatible LLM, including OpenAI models that support function calling or tool use.
Start using Olostep with LangChain
500 free credits to get started — no credit card required. Full documentation available in the Olostep docs.
← Back to all integrations