Super-fast web crawling for LLM development
This is a zero-latency web crawler especially designed for retrieval-based LLM development