Which of the following statements with regard to Large Language Models (LLMs) used in machine learning is/are correct ? 1. LLMs assign probabilities to the next possible words and then pick the one with the highest probability. 2. LLMs process data through mathematical optimization to minimise prediction errors. 3. LLMs produce unbiased outputs. Select the answer using the code given below :
A
1 only
B
1 and 2 only
Correct answer
C
2 and 3 only
D
1, 2 and 3
Explanation
An LLM generates text by computing a probability distribution over possible next tokens and choosing one (the most likely one under greedy decoding). It is trained by mathematical optimisation (gradient descent) to minimise prediction error. LLMs are not unbiased: they absorb and can amplify biases present in their training data, so statement 3 is wrong.
IT & ComputersArtificial intelligence: large language modelsLarge Language ModelsNext-token predictionLoss minimisationAI biasMachine learning