Byte Musings

 This page is my reading list of various articles on AI and Cloud and some random notes. # Tools, Libraries, Frameworks ##  Omnigent [Omnigent AI Harness](https://omnigent.ai/) Omnigent is being used by DataBricks. Its a harness layer, which allows to multiplex models, agents. [Coding agent from scratch](https://github.com/Camrahd/claud_code) ## Graphs and Context: (https://adam-slack.medium.com/designing-context-graphs-around-how-organisations-work-part-1-79067ebbb27a) (https://adam-slack.medium.com/copying-data-into-context-graphs-part-2-27aaa5710a95) (https://adam-slack.medium.com/context-graphs-knowledge-graphs-and-agent-memory-part-0-948adfacf74b) Why does the first token from an LLM take longer than the rest? Every autoregressive LLM response has two distinct phases: 𝗣𝗿𝗲𝗳𝗶𝗹𝗹 The model processes your entire prompt in one parallel pass, building the KV cache for every input token. This is compute-heavy — attention scales with the square of sequence length, so longer...