Writing

Essays and technical notes on LLM systems, data engineering, retrieval, agents, and evaluation.

  1. 中文预训练语料去重:从 MinHash 到段落级指纹

    整理一次中文网页语料去重的实践:为什么文档级 MinHash 不够用,段落级指纹怎么做,以及如何验证去重没有误伤高质量内容。

    Tags 预训练, data-quality, 去重

  2. A Retrieval Eval That Survives Index Changes

    Notes on building a small, fixed question set for a RAG system so it measures correctness instead of quietly agreeing with whatever the current index returns.

    Tags rag, evaluation, retrieval, data-quality

  3. Evidence-First LLM Systems

    A working note on the question this site keeps returning to: what evidence should technical work leave behind, and how to design pipelines so the evidence is a byproduct, not a chore.

    Tags methodology, evaluation, data-quality, rag