OptionalThe wider landscape
Hiding part of the data and learning to fill it in, so the data labels itself. How LLMs are pre-trained.
Example'The patient missed the ___ because of rain' teaches the model 'appointment' with no human labelling.
Hiding part of the data and learning to fill it in, so the data labels itself. How LLMs are pre-trained.
Example'The patient missed the ___ because of rain' teaches the model 'appointment' with no human labelling.