model training
The process that sets a model's weights by adjusting them, over many examples, until its predictions fit the data.
In more detail
A language model is pre-trained to predict the next token on a large text corpus, then post-trained, for example with human feedback, to follow instructions. Training happens once at the provider; an AI engineer mostly works with the finished model at inference time, steering it with context rather than retraining it.
Related terms
- inference — Running a trained model to produce output for new input, as opposed to training it.
- fine-tuning — Further training an existing model on your own examples to change its behaviour, style or format.
Taught in
- What An AI Engineer Does — AI Engineering: LLM Apps, RAG & Agents
- Tokens And The Context Window — AI Engineering: LLM Apps, RAG & Agents
- Zero-Shot And Few-Shot — AI Engineering: LLM Apps, RAG & Agents
- Reasoning Techniques — AI Engineering: LLM Apps, RAG & Agents
- From Prompts To Context — AI Engineering: LLM Apps, RAG & Agents
- What An Embedding Is — AI Engineering: LLM Apps, RAG & Agents
- Embedding Models — AI Engineering: LLM Apps, RAG & Agents
- Keyword And Hybrid Search — AI Engineering: LLM Apps, RAG & Agents
- How RAG Works And When To Use It — AI Engineering: LLM Apps, RAG & Agents
- Retrieval That Finds The Right Thing — AI Engineering: LLM Apps, RAG & Agents
- Prompt Injection — AI Engineering: LLM Apps, RAG & Agents
- Guardrails, Privacy And Governance — AI Engineering: LLM Apps, RAG & Agents
References
- Google for Developers: Rules of Machine Learning
- Brown et al. (2020): Language Models are Few-Shot Learners