30 terms
Models & Behavior
Kinds of models, what they can take in and produce, and the settings that shape their answers.
- AI assistantnounan AI product that helps a person with everyday tasks such as answering questions, writing, planning, or searching, usually…
- base modelnouna language model that has only been pre-trained, not yet tuned to follow instructions or chat; it continues text rather than…
- chatbotnouna computer program that holds a conversation with people through text or voice
- context windownountrendingthe maximum amount of text, measured in tokens, that a model can consider at one time, including the conversation so far and its…
- diffusion modelnouna generative model that creates images (or audio or video) by starting from random noise and removing it step by step until a…
- foundation modelnouna large model trained on broad data that can be adapted to many different tasks, serving as the base on which many products are…
- frontier modelnountrendingone of the most capable AI models available at a given time, typically the newest and most expensive to build
- GPTnounshort for generative pre-trained transformer: a language model that is first pre-trained on large amounts of text and then…
- hallucinationnountrendinga confident but false or made-up statement produced by an AI model, such as an invented fact, quote, citation, or source
- knowledge cutoffnounthe date after which a model has no information from its training data
- large language modelnountrendinga very large neural network trained on huge amounts of text to predict the next token, which as a result can answer questions…
- latencynounthe delay between sending a request to a model and getting a response, often measured as time to the first token
- mixture of expertsnouna model design in which many smaller sub-networks ("experts") exist, but only a few are switched on for each token, making large…
- multimodaladjectivetrendingable to understand or produce more than one type of data, such as text, images, audio, and video
- open weightsadjectivetrendingdescribing a model whose trained weights are published so anyone can download, run, and modify it, even if the training data and…
- open-source modelnouna model released with its weights, code and, ideally, enough information about its training data that others can study…
- reasoningnounin AI, a model's ability to solve problems that need several steps, such as math, planning, or debugging, often by working…
- reasoning modelnountrendinga language model trained to work through a problem step by step before giving its final answer, trading extra time and tokens for…
- samplingnounthe way a model picks each next token from its list of possible choices, which decides how predictable or varied the text is
- small language modelnouna compact language model, usually with a few billion parameters or fewer, designed to run cheaply or directly on a phone or laptop
- speech-to-textnountechnology that converts spoken words into written text
- temperaturenouna setting that controls how random a model's output is: low temperature gives safer, more predictable text, high temperature…
- text-to-imageadjectivedescribing AI that creates pictures from a written description
- text-to-speechnountechnology that turns written text into spoken audio, now often in highly natural or cloned voices
- text-to-videoadjectivedescribing AI that generates video clips from a written description
- throughputnounhow much work an AI system can handle in a given time, often measured in tokens per second
- top-pnouna sampling setting that lets a model choose only from the most likely next tokens whose combined probability adds up to a chosen…
- vision language modelnouna model that takes both images and text as input and can describe, answer questions about, or reason over what it sees
- voice cloningnounusing AI to copy a specific person's voice from a short recording so it can say new things
- world modelnountrendingan AI system that learns how the physical world behaves, such as how objects move and react, so it can predict or simulate what…
Advertisement