AI Tools Radar › Categories › Data & datasets
AI data tools, datasets, scraping & document parsing
Datasets, scraping and crawling for AI, document and PDF parsing, OCR, databases, data analysis and text-to-SQL. 30 items in today's radar (data fetched 21 Oct 2026, 14:13 (Berlin time)). Categories are assigned by fixed keyword rules on GitHub topics, repo names, descriptions and Show HN titles; an item can be in several categories. How categories work.
All 393Agents & automation 196Coding assistants & dev tools 168Chat apps & assistants 28LLM inference & serving 36RAG & search 28Training & fine-tuning 11Models & research 36Image, video & audio generation 52Voice & speech 21Computer vision 8MCP, skills & plugins 146Evaluation & observability 22Data & datasets 30Local / on-device AI 45Security & sandboxing 33Learning & resources 48Other 16
Trending on GitHub today (9)
| Repository | Stars today | Total stars | Language | License | Created |
|---|---|---|---|---|---|
| 1. xerj-org/xerj Local-first search engine and MCP server for AI agents. One Rust binary indexes code, docs, logs, JSONL/CSV and PDFs for BM25 full-text, vector and hybrid search, code search without grep, agent memory and RAG. Elasticsearch-compatible API; Corpus Hub serves hundreds of reference memory corpora. | 2,660 | 12,608 | Rust | Apache-2.0 | 2026-06-30 |
| 2. Graphify-Labs/graphify Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store. | 802 | 130,921 | Python | Apache-2.0 | 2026-04-03 |
| 3. supabase/supabase The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications. | 509 | 112,618 | TypeScript | Apache-2.0 | 2019-10-12 |
| 4. strelov1/freehire freehire — the open-source search engine for job seekers | 405 | 2,017 | Go | MIT | 2026-06-07 |
| 5. ModernRelay/omnigraph Object-storage native graph database with branching and typed ontology | 190 | 1,571 | Rust | MIT | 2026-04-10 |
| 6. twentyhq/twenty The open alternative to Salesforce, designed for AI. | 105 | 58,801 | TypeScript | Other | 2022-12-01 |
| 7. mrdbourke/zero-to-mastery-ml All course materials for the Zero to Mastery Machine Learning and Data Science course. | 54 | 7,248 | Jupyter Notebook | none found | 2019-09-23 |
| 8. ys-ll/uniterm All-in-one terminal covering 30+ protocols — SSH, RDP, SFTP, databases, Kubernetes and more. With a built-in AI Agent that runs multi-turn shell commands autonomously. | 7 | 877 | Go | Apache-2.0 | 2026-05-11 |
| 9. oracle-devrel/oracle-ai-developer-hub Technical resources for AI developers to build applications, agents, and systems using Oracle AI Database and OCI services | 5 | 4,444 | Jupyter Notebook | none found | 2024-01-16 |
Trending on GitHub this week (6)
| Repository | Stars this week | Total stars | Language | License | Created |
|---|---|---|---|---|---|
| 1. xerj-org/xerj Local-first search engine and MCP server for AI agents. One Rust binary indexes code, docs, logs, JSONL/CSV and PDFs for BM25 full-text, vector and hybrid search, code search without grep, agent memory and RAG. Elasticsearch-compatible API; Corpus Hub serves hundreds of reference memory corpora. | 8,074 | 12,608 | Rust | Apache-2.0 | 2026-06-30 |
| 2. K-Dense-AI/scientific-agent-skills Turn any AI agent into an AI Scientist. The #1 Agent Skills library for science, used by 250,000+ scientists worldwide. 177 ready-to-use validated skills plus 100+ scientific databases covering biology, chemistry, medicine, and drug discovery. Compatible with Cursor, Claude Code, Codex, Pi, Antigravity, and the open Agent Skills standard. | 4,549 | 53,453 | Python | MIT | 2025-10-19 |
| 3. Gentleman-Programming/engram Persistent memory system for AI coding agents. Agent-agnostic Go binary with SQLite + FTS5, MCP server, HTTP API, CLI, and TUI. | 330 | 7,501 | Go | MIT | 2026-02-16 |
| 4. ModernRelay/omnigraph Object-storage native graph database with branching and typed ontology | 254 | 1,571 | Rust | MIT | 2026-04-10 |
| 5. mrdbourke/zero-to-mastery-ml All course materials for the Zero to Mastery Machine Learning and Data Science course. | 125 | 7,248 | Jupyter Notebook | none found | 2019-09-23 |
| 6. NVIDIA-NeMo/Nemotron Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models | 37 | 2,190 | Jupyter Notebook | Apache-2.0 | 2025-10-03 |
New repos of the last 30 days (14)
| Repository | Age | Total stars | Language | License | Created |
|---|---|---|---|---|---|
| 1. KKKKhazix/AIHOT 一个自己找热点、自己写日报的网站框架。把信源和精选标准换成你的，它就是你的行业热点站。 | 22 d | 8,323 | TypeScript | MIT | 2026-09-28 |
| 2. ARahim3/DigUp Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2. | 12 d | 5,295 | Swift | MIT | 2026-10-08 |
| 3. mikehasa/golive-skill Take your agent-built product live: hosting, database, domain, email, payments — on your own accounts. Open-source Agent Skill + zero-dependency Node CLI: detect → plan → approve → apply → verify. No GoLive account, backend or telemetry. | 27 d | 1,307 | TypeScript | MIT | 2026-09-23 |
| 4. Edwardxlai/easyread 把英文论文读成舒服的中文：本地 PDF 论文翻译、原文对照、边读边问 AI、文献管理。Read English papers in comfortable Chinese. | 20 d | 997 | Python | MIT | 2026-09-30 |
| 5. feder-cr/invisible_playwright_mcp Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser automation, scraping, computer use. | 21 d | 881 | Python | MIT | 2026-09-29 |
| 6. datalab-to/indra Fast CPU OCR: line detection, CTC recognition, reading order, markdown | 8 d | 873 | Python | Apache-2.0 | 2026-10-13 |
| 7. jev-chat/jev-chat-windows JevChat-Windows：聊天窗口旁挂的回复辅助。窗口截图 + 本地离线 OCR 读对方消息 → Jev 判断意图 → 3 条候选一键填入，发送永远手动 | 29 d | 830 | Python | Other | 2026-09-21 |
| 8. jatechan/ai-data-extractor Free open-source extractor for AI coding assistant chat histories. Supports Claude Code, Cursor, Windsurf, Aider, Cline/Roo Code and more | 9 d | 526 | Python | MIT | 2026-10-11 |
| 9. cv-cat/catbus 一个命令操作小红书、抖音、TikTok、B 站、快手、微博、闲鱼、淘宝、京东、X：统一的命令与 JSON 输出，给人和 AI Agent 用 | 23 d | 487 | TypeScript | MIT | 2026-09-27 |
| 10. LingCore/WinShun Win顺：免费开源的 Windows 快速搜索启动器。双击 Ctrl，拼音秒搜文件、全文搜索 Word/Excel/PDF、剪贴板历史（代替 Win+V）、对话框搜索、任务栏搜索、插件、AI 助手 MCP。Free Windows search launcher: pinyin file search, full-text search, clipboard history, MCP server. Everything/Listary alternative. | 13 d | 475 | C++ | MIT | 2026-10-08 |
| 11. FengZhenfei/carrel Ontology-Augmented Generation for AI agents. | 23 d | 322 | Python | MIT | 2026-09-28 |
| 12. AienTech/dossier A self-hosted job search app that writes tailored resumes and cover letters from your profile. | 17 d | 302 | TypeScript | AGPL-3.0 | 2026-10-03 |
| 13. Sheltercosmo/jev4pg Established strong JEV based natural language to SQL performance and well-covered semantic operators for PostgreSQL(PG) with optimized cost and latency. Reusable evidence, with native execution, parallel plans and explainable embeddings in development preview. | 28 d | 279 | Python | Apache-2.0 | 2026-09-23 |
| 14. jddevtime/open-lakehouse-compute-fabric Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension. | 9 d | 276 | Python | Apache-2.0 | 2026-10-12 |
AI launches on Show HN (4)
| Show HN post | Points | Comments | Posted |
|---|---|---|---|
| 1. Show HN: Graphene – Data analysis toolkit for your coding agent HN discussion · by kcmarr | 32 | 12 | 2026-10-01 |
| 2. Show HN: Strata – an expressive semantic layer that can say no to your LLM HN discussion · by ajoski9 | 25 | 18 | 2026-09-30 |
| 3. Show HN: Jevcrawl – A web crawler for AI agents with no LLM in the crawl loop HN discussion · by rayenmlayeh | 21 | 3 | 2026-10-13 |
| 4. Show HN: Google Maps Scraper MCP HN discussion · by qwikhost | 10 | 5 | 2026-10-03 |