Pre-Training
P
Pre-Training
Definition
The initial phase of training a foundation model on a large, general-purpose dataset to learn broad representations of language, vision, or other data types. Pre-training captures general knowledge that can later be specialized through fine-tuning for downstream tasks.