crawlee-python (Agent Skills)

GitHub

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

9,429 stars Python 0 Rule Files Full Docs MCP View JSON API #apify#automation#beautifulsoup#crawler
Documentation Agent Skills & Rules MCP Server API Specification

No Explicit Rule Files Found

This repository does not currently contain dedicated AI agent rule files (.cursorrules, CLAUDE.md, AGENTS.md).

Read Full Technical Documentation

Explore Related Technologies & Topics

View All 9,111+ Repositories →

Discover similar high-velocity repositories, agent skills, and OpenAPI specifications across the ecosystem.

#apify Browse apify catalog → #automation Browse automation catalog → #beautifulsoup Browse beautifulsoup catalog → #crawler Browse crawler catalog → #crawling Browse crawling catalog → #headless Browse headless catalog → 🧠 Agent Skills Prompt & rule files → ⚡ MCP Servers Model Context Protocol → 🔌 OpenAPI Specs REST & Swagger schemas → ⚖️ Benchmark YakaAI vs Alternatives →