diff --git a/presentation/assets/llm/llm-basic.svg b/presentation/assets/llm/llm-basic.svg index 1e77767..31a058d 100644 --- a/presentation/assets/llm/llm-basic.svg +++ b/presentation/assets/llm/llm-basic.svg @@ -1,5 +1,5 @@ - - + - - How an LLM generates text (autoregressive) - - - Each predicted token is appended to the input, then fed back into the LLM - - - ITERATION 1 / 7 - ITERATION 2 / 7 - ITERATION 3 / 7 - ITERATION 4 / 7 - ITERATION 5 / 7 - ITERATION 6 / 7 - ITERATION 7 / 7 + ITERATION 1 / 7 + ITERATION 2 / 7 + ITERATION 3 / 7 + ITERATION 4 / 7 + ITERATION 5 / 7 + ITERATION 6 / 7 + ITERATION 7 / 7 - INPUT (CONTEXT) - - Original prompt - What - is - the - capital - of - Japan - ? + What + is + the + capital + of + Japan + ? - Generated tokens (autoregressive) - The - capital - of - Japan - is - Tokyo - . + The + capital + of + Japan + is + Tokyo + . - - + - - + LLM - (black box) - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - - + - PREDICTED NEXT TOKEN - - argmax P(next token | input) - The - capital - of - Japan - is - Tokyo - . + The + capital + of + Japan + is + Tokyo + . - - predicted token appended to input → next iteration