From PCA to Barlow Twins: A Statistical View of Redundancy Reduction in Self-Supervised Learning
Barlow Twins looks statistical on paper but doesn't behave like PCA in practice. A statistical view of redundancy reduction explains why.
Posts / 9 records
Searchable archive. For the latest feed with pagination, start on the home page.
A chronological index of field notes on research, engineering, markets, and protocols.
Barlow Twins looks statistical on paper but doesn't behave like PCA in practice. A statistical view of redundancy reduction explains why.
A hands-on tutorial for kb-bridge, the MCP server behind the context-aware retriever, for knowledge-base search.
Part 3: evaluating whether the context-aware retriever actually improves RAG answer quality.
Part 2: implementing the context-aware retriever, from design to working retrieval for knowledge-base question answering.
Part 1: why and how I designed a context-aware retriever to improve RAG answers for knowledge-base question answering.
Training an agent to play Hangman with DQN and Transformers.
A deep-learning proof of concept for GMV forecasting with xDeepFM, with an emphasis on clean, reproducible code.
A summary of LoRA: how low-rank adaptation fine-tunes large language models by training small update matrices instead of the full weights.
A hands-on comparison of sequence-to-sequence decoders with and without attention, going beyond a standard code walkthrough.