Hi! I'm Ahmed Kachkach
I spent the last decade building cool machine learning systems used by millions of people every day.
WorkSenior Staff Software Engineer at Google, Zürich
FocusLarge Language Models & Information Retrieval (retrieval, ranking and everything in between)
PreviouslySpotify, Mozilla, iZettle, Detectify
DegreesMSc Machine Learning (KTH) · MSc Software Engineering (INSA Lyon)
Blog
Sampling from LLMs: art & science
How we pull a sequence of tokens from an LLM is far from trivial.
Generating one token at a time is a blessing in disguise
Autoregression is a pain for inference, but unlocked a lot of the 'magic' LLMs are known for.
➜ Reach out if you have any questions: ahmed@kachkach.com