Popular GitHub Repositories for Webscraper

An AI assistant tool that integrates coding, writing, and reading functions. For better alternatives see https://monica.im/desktop

Lego AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.

Financial Web Scraper & Sentiment Classifier

The spider crawls moneycontrol.com and economictimes.com to fetch news of input companies and also scores and classifies the companies to raise an early warning signal

The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. Utilizing advanced AI models and custom extraction strategies, this toolkit helps users efficiently gather data like titles, descriptions, and keywords, which are crucial for SEO and content strategy.

Applied Machine Learning and Natural Language Processing to build a Random Forest Classifier that filters malicious bots with 97% of accuracy.

Effortless Data Extraction, Powered by : Generative AI

A Python web scraper for BBC News using Selenium and BeautifulSoup4, powered by AI prompt engineering with ChatGPT. It extracts article data like URLs, headlines, and images, handles dynamic content, and outputs clean JSON. Includes Docker support for easy deployment.

(In-progress) Finetuning OpenAI's GPT-3.5-Turbo as a base model on open-source data about the Tampa Bay region to create a chatbot specializing in information on the area!

WebScraper que usa a API do Google Gemini para analisar e catalogar professores da UFABC conforme formação e área de interesse