AI Fundamentals | AI, DX & Security Glossary
Glossary terms in "AI Fundamentals" — practical definitions on AI, DX, and security for executives and IT teams, with diagrams.
Context Window
A context window refers to the maximum number of tokens an LLM can process at one time, indicating t
Fine-tuning
Fine-tuning refers to the process of providing additional training data to a pre-trained machine lea
Generative AI (Generative AI)
Generative AI is a collective term for AI models capable of autonomously generating content such as
LoRA
LoRA (Low-Rank Adaptation) is a technique that inserts low-rank delta matrices into the weight matri
Multilingual NLP (Multilingual Natural Language Processing)
Multilingual NLP is a natural language processing technology capable of analyzing and generating tex
Multimodal AI (Multimodal AI)
Multimodal AI refers to an AI system capable of integrating, processing, understanding, and generati
PEFT
PEFT (Parameter-Efficient Fine-Tuning) is a collective term for fine-tuning methods that adapt a lar
QLoRA
QLoRA (Quantized LoRA) is a method that combines LoRA with 4-bit quantization, enabling fine-tuning
RLHF
RLHF is a reinforcement learning method that uses human feedback as a reward, while RLVR is a reinfo
SLM (Small Language Model)
SLM (Small Language Model) is a general term for language models with a parameter count limited to a
MoE (Mixture of Experts)
MoE (Mixture of Experts) is an architecture that contains multiple "expert" subnetworks within a mod
LLM (Large Language Model)
LLM (Large Language Model) is a general term for neural network models pre-trained on massive amount
25items of 1of3