diff --git a/presentation/assets/llm/llm-basic.svg b/presentation/assets/llm/llm-basic.svg new file mode 100644 index 0000000..1e77767 --- /dev/null +++ b/presentation/assets/llm/llm-basic.svg @@ -0,0 +1,123 @@ + + + + + + + + + + + + + + + How an LLM generates text (autoregressive) + + + Each predicted token is appended to the input, then fed back into the LLM + + + ITERATION 1 / 7 + ITERATION 2 / 7 + ITERATION 3 / 7 + ITERATION 4 / 7 + ITERATION 5 / 7 + ITERATION 6 / 7 + ITERATION 7 / 7 + + + INPUT (CONTEXT) + + + Original prompt + What + is + the + capital + of + Japan + ? + + Generated tokens (autoregressive) + The + capital + of + Japan + is + Tokyo + . + + + + + + + + LLM + (black box) + + + + + + + + + + + + + + + + + + + + + + + + + + + + + PREDICTED NEXT TOKEN + + argmax P(next token | input) + The + capital + of + Japan + is + Tokyo + . + + + + + + + predicted token appended to input → next iteration + +