Datasets for RAG, fine-tuning and training built from public sources
AI study and research assistant for students and researchers
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Paid
Free
Pricing
Web Corpus: starter sets from $49 (250,000-500,000 documents); shelf corpora from $99-$199 per shelf (one-time license); Everything (full crawl) $3,000 one-time; Whole Library (all builds for one year) $5,000 per year. Reference Collections: Encyclopedia $1,200 commercial or $349 research (one-time)
Not given
Key features
Web corpus with 100.7M documents and 105B tokens from Common Crawl
Documents scored with Bear Rank and shelved by subject
15 million encyclopedia entries with sources and model attribution
200 million synthetic Q&A records with metadata
Delivered as JSONL and Parquet formats
Free samples available on Hugging Face
Command-line client with resumable downloads and SHA-256 verification
Statistics collection with 7,000 topics and 140,000 figures
Glossaries for 10,000 topics with one million definitions
Book Q&A dataset with 8,000 titles for reading comprehension
Precise source linking with full context
Knowledge base builder with automatic connection mapping
Literature pattern recognition and automated data extraction
Research assistant with comprehensive literature search
Research gap detection
Citation generator for multiple citation styles
What makes it different
All datasets built only from public sources with full provenance tracking
Every record includes source attribution and licensing information
Eight curated subject shelves for targeted corpus selection
Flexible purchasing: buy individual shelves, slices, or entire library
Over 4 TB of clean, deduplicated text ready for machine learning
Links every insight directly to its source to avoid AI hallucinations
Read 50 papers in 10 minutes instead of weeks
Deliver a literature review in 1 hour
Automatically maps connections and extracts key information from multiple documents
SumiNote