DEPTH-AWARE GLOSSARY
Words worth
testing, not memorizing.
- 01Pattern
A useful relationship found in examples.
Concept: Patterns- 02Prediction
A ranked guess about an output.
Concept: Patterns- 03Token
A piece of text represented by an ID.
Concept: Tokens- 04Context window
The limited token space available for a request.
Concept: Tokens- 05Probability
A number describing uncertainty among choices.
Concept: Probability- 06Temperature
A control that changes how peaked a token race is.
Concept: Probability- 07Top-p
A cutoff that keeps a small set of likely choices.
Concept: Probability- 08Embedding
A list of numbers representing a learned item.
Concept: Embeddings- 09Vector
An ordered list of numbers.
Concept: Embeddings- 10Projection
A smaller view of a larger-dimensional space.
Concept: Embeddings- 11Attention
A weighted way to mix information from token positions.
Concept: Attention- 12Query
What a token position is looking for.
Concept: Attention- 13Key
What a token position offers for matching.
Concept: Attention- 14Value
The information mixed after a match.
Concept: Attention- 15Hallucination
Fluent output that lacks reliable support.
Concept: Verification- 16Verification
Checking an exact claim against suitable evidence.
Concept: Verification- 17Grounding
Connecting an answer to provided evidence.
Concept: Verification