alexsubq

That makes sense! We are working on that.

Thanks!

Model: - making sure it has been properly red-teamed, meets user preferences, etc. - it depends on what folks want in the model. Our original papers was mostly the technical blog post, but we decided to wait a little longer to see what else folks wanted and share more benchmarks

Yeah, tokens are excluded, only pairwise relationships between tokens. Coding is something we are looking at carefully!

What do you want in a whitepaper that was not in our blog post? There is time to add more before the whitepaper is released.

We will have a few rollouts in the next two months.

The chart crime was not intentional! We will not make you wait two years. We are O(n), not O(1). O(1) would unfortunately be an impossibility. We may as well do infinite context at that point!

I do, for sure! Yes, we have a few product rollouts lined up. The differentials for latency are posted in our blog post, so that should provide an idea of where the scaling law differentials kick in.

We are SOTA in some ways and not in others, continuously working to make it better! We need a little more time to scale, as we are working on things like disaggregated prefill, etc., the norms of large-scale model infra.

I am happy to answer any questions!