-
Semantic collapse in RAGs by Stanford
Semantic collapse in RAGs by Stanford provides a way to keep on those MCP servers alive. After all … how do you know that you’re actually learning more, and not forgetting even more than you learn?You test ? 🙂 Will be the first one when i see an MCP server tested around the clock for proper, deterministic return values. Stanfors is the best -> dho.stanford.edu/wp-content/uploads/Legal_RAG_Hallucinations.pdf Semantics asks what an expression means. Logic asks whether an argument is valid or whether a statement follows from other statements. A sentence can be semantically meaningful but still logically false. All birds can fly. Penguins are birds. ∴ Penguins can fly. Formally valid, but…
-
Tokenization and embedding of song lyrics “We will, we will…”
Tokenization and embedding of song lyrics “We will, we will…” i know you know how it ends. but have You wondered what would an LLM say ? Let us find out. I want to ask the Clause Sonnet 4.5 about the embeddings, tokenizations and probability of figuring out the lyrics for “We will, we will…” prompt 🙂 Can you show me the tokenization, embeddings, emtadata and probabilities for “We will, we will …” Tokenization Any kind of machine learning uses numbers in the back stage. The text is split into tokens, each mapped to an ID ( example values ) : Token ID Token Text Type Position Length 1234 We…
