Month: August 2025

From Polling to QUIC: How Modern Web Communication Works

Today, I’m revisiting client-server communication mechanisms. The main methods are outlined in the table below for easier understanding.MechanismBased onDirectionProsConsTypical Use CasesPollingHTTP/1.xClient → Server• Very simple to implement• Works everywhere• High latency (depends on interval)• High overhead (many HTTP headers & TCP handshakes)• Wastes resourcesPeriodic updates, legacy apps... Read More

[Learning Notes] Course: How Transformer LLMs Work

Course Link: How Transformer LLMs Wor2025-08-1chapter: understanding language models: language as a Bag-of-Wordnon-transformer, encoder-only, decoder-only, encoder-decodedecoder-only: such GPtokenization -> tokens -> vocabulary -> vector embeddingchapter: understanding language models: (word) embeddingword2vec, the way to express the natural meaning is an array of floatsuch as cats [.91, -... Read More