HNGlance

Top Best New Show

Pharia-1-LLM: transparent and compliant

https://aleph-alpha.com/de/introducing-pharia-1-llm-transparent-and-compliant/

by jamesblonde • 2 years ago

5 2 2 years ago

AL

aleph-alpha.com

Related Stories

Loading related stories...

Comments

2

haensi• 2 years ago

Very interesting to see an LLM with weights and the code base. They also talk about tokenizer fertility in the HF model card [1]

[1] https://huggingface.co/Aleph-Alpha/Pharia-1-LLM-7B-control

jamesblonde• 2 years ago

"Tokenizer fertility is a metric used to evaluate tokenizer performance and measures a tokenizer’s ability to represent text, calculated by dividing the number of tokens in a text (after tokenizing) by the number of words in that same text"

Source preview

aleph-alpha.com

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms