Liquid AI reveals 8B-A1B MoE trained on 38T 2 months ago
Many such cases. Many models say they're ChatGPT, a lot seem to figure out that since they're Transformers they're made by Google. Doesn't really tell you a lot. Perhaps a pretraining / midtraining artifact.