Launch HN: General Instinct (YC P26) – Frontier models on edge devices 2 months ago
Sorry if this is somewhat off-topic:
Through my estimations, based on Bonsai's parameters/GB ratio, if one model were to have this ratio and Gemma4:12b's size, it would have the nice number of 54.125b parameters (that could run on 16GB of RAM). Is there any organization attempting something of this kind?