AIbase
Product LibraryTool Navigation

eGet-Crawler-for-ai

Public

Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.

Creat2024-11-15T11:08:54
Update2025-02-26T13:32:49
42
Stars
0
Stars Increase

Related projects