Datasets for RAG, fine-tuning and training built from public sources
Set your Content on Autopilot
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
US
Pricing model
Paid
Paid
Pricing
Web Corpus: starter sets from $49 (250,000-500,000 documents); shelf corpora from $99-$199 per shelf (one-time license); Everything (full crawl) $3,000 one-time; Whole Library (all builds for one year) $5,000 per year. Reference Collections: Encyclopedia $1,200 commercial or $349 research (one-time)
Plans available for 20, 50, 120, 250, or 500 articles per month. Pricing varies by article volume; customers pay a price per article included in their selected tier.
Key features
Web corpus with 100.7M documents and 105B tokens from Common Crawl
Documents scored with Bear Rank and shelved by subject
15 million encyclopedia entries with sources and model attribution
200 million synthetic Q&A records with metadata
Delivered as JSONL and Parquet formats
Free samples available on Hugging Face
Command-line client with resumable downloads and SHA-256 verification
Statistics collection with 7,000 topics and 140,000 figures
Glossaries for 10,000 topics with one million definitions
Book Q&A dataset with 8,000 titles for reading comprehension
AI content generation tailored to brand voice
SEO optimization with keywords and meta tags
Bulk publishing to 50+ platforms
AI image generation with DALL-E and Flux
Stock image integration from Unsplash and Pexels
Automated scheduling
Hosted blog with custom themes
YouTube video integration
Webhook API for custom integrations
Real-time data integration from search results
What makes it different
All datasets built only from public sources with full provenance tracking
Every record includes source attribution and licensing information
Eight curated subject shelves for targeted corpus selection
Flexible purchasing: buy individual shelves, slices, or entire library
Over 4 TB of clean, deduplicated text ready for machine learning
AI learns from your existing content for perfect brand consistency
Publish unlimited content across multiple websites simultaneously
Fully managed hosted blog with no technical setup required
Built-in SEO optimization ensures content ranks in search engines