AI Fundamentals | AI, DX & Security Glossary
Glossary terms in "AI Fundamentals" — practical definitions on AI, DX, and security for executives and IT teams, with diagrams.
Multimodal AI (Multimodal AI)
Multimodal AI refers to an AI system capable of integrating, processing, understanding, and generati
PEFT
PEFT (Parameter-Efficient Fine-Tuning) is a collective term for fine-tuning methods that adapt a lar
QLoRA
QLoRA (Quantized LoRA) is a method that combines LoRA with 4-bit quantization, enabling fine-tuning
Sora (OpenAI)
Sora was OpenAI's AI for generating video from text or images. The app and website were shut down in
RLHF
RLHF is a reinforcement learning method that uses human feedback as a reward, while RLVR is a reinfo
SLM (Small Language Model)
SLM (Small Language Model) is a general term for language models with a parameter count limited to a
MoE (Mixture of Experts)
MoE (Mixture of Experts) is an architecture that contains multiple "expert" subnetworks within a mod
LLM (Large Language Model)
LLM (Large Language Model) is a general term for neural network models pre-trained on massive amount
Open-weight model
An open-weight model is a language model whose trained weights (parameters) are publicly released an
Inference-time Scaling (Test-time Compute)
Inference-time scaling is a technique that dynamically increases or decreases the amount of computat
Reasoning Model
A type of large language model that generates an explicit chain of thought before responding, solvin
Sparse Model
A Sparse Model is a general term for neural network architectures that activate only a subset of the
33items of 2of3