Simple Thoughts
All Posts
Tags
Categories
About
Simple Thoughts
Cancel
All Posts
Tags
Categories
About
Openai
2023
Knowing Enough About MoE to Explain Dropped Tokens in GPT-4
August 9, 2023
Non-determinism in GPT-4 is caused by Sparse MoE
August 5, 2023