HN user

julien_c

1,966 karma

julien a/ huggingface.co

Posts122
Comments271
View on HN
twitter.com 1mo ago

Llama.cpp now has an official website: llama.app

julien_c
17pts4
huggingface.co 1y ago

Tiny Agent: a MCP-powered agent in 50 lines of code

julien_c
3pts0
huggingface.co 1y ago

Hugging Face Acquires XetHub

julien_c
10pts1
about.xethub.com 2y ago

Benchmarking Versioning Tools for ML: S3, DVC, Git LFS, and XetHub

julien_c
1pts1
www.coreweave.com 2y ago

CoreWeave (AI Hyperscaler) raises $7.5B in debt

julien_c
4pts0
huggingface.co 2y ago

HuggingChat Assistant plugged on the HN front page

julien_c
1pts0
www.redditinc.com 4y ago

Reddit acquires ML startup Spell

julien_c
55pts81
huggingface.co 4y ago

Hugging Face introduces Pull Requests and Discussions

julien_c
6pts0
huggingface.co 4y ago

T0* – Series of encoder-decoder models trained on a large set of different tasks

julien_c
218pts153
github.com 5y ago

HuggingPics: Easily train and deploy image classifiers for anything

julien_c
3pts0
www.php.net 5y ago

PHP Releases on Hold

julien_c
6pts0
beta.openai.com 5y ago

OpenAI API: preliminary beta pricing announced

julien_c
2pts0
www.php.net 5y ago

PHP 8.0.0 beta 2

julien_c
77pts99
www.fast.ai 5y ago

'Deep Learning for Coders' Book's Foreword by Soumith Chintala

julien_c
2pts0
github.com 6y ago

NLP: A new datasets and metrics library from Hugging Face

julien_c
19pts0
blog.einstein.ai 6y ago

Benchmarking Triton (TensorRT) Inference Server for Transformer Models

julien_c
3pts0
huggingface.co 6y ago

Hugging Face: How to train a new language model from scratch

julien_c
4pts0
github.com 6y ago

Show HN: HuggingFace – Fast tokenization library for deep-learning NLP pipelines

julien_c
168pts42
azure.microsoft.com 6y ago

Bing Deploys Bert to Production Using Azure GPUs

julien_c
4pts0
github.com 6y ago

Transformers 2.0: Deep interoperability between TensorFlow 2.0 and PyTorch

julien_c
103pts3
twitter.com 6y ago

Apple downloads ~45 TB of models per day from our S3 bucket

julien_c
553pts225
transformer.huggingface.co 6y ago

Show HN: Write with Transformer (Trained on ArXiv NLP)

julien_c
1pts0
medium.com 6y ago

DistilBERT, a Distilled Version of Bert

julien_c
4pts0
stanfordnlp.github.io 7y ago

StanfordNLP – Python NLP Library for Many Human Languages

julien_c
22pts0
www.youtube.com 7y ago

SpaCy IRL Conference Videos

julien_c
3pts0
transformer.huggingface.co 7y ago

Show HN: Write with Transformer (GPT-2 Model)

julien_c
11pts1
medium.com 7y ago

And Most Current of Modern Natural Language Processing

julien_c
2pts0
www.magicleap.com 7y ago

Mimesys Joins the Magic Leap Family

julien_c
3pts0
convai.huggingface.co 7y ago

Show HN: State-of-the-Art Conversational AI

julien_c
7pts0
www.theverge.com 7y ago

Privacy Assistant Jumbo Launches

julien_c
2pts0

Ollama eventually added ollama run hf.co/{repo}:{quant} to pull directly from Hugging Face, which partially addresses the availability problem.

uh actually, _we_ did (generates a Docker-style manifest on the fly)

OpenAI API 6 years ago

Not really on unsupervised/self-supervised data though, right?

(nor on the same scale of corpora, as far as I can tell)

TL;DR: Hugging Face, the NLP research company known for its transformers library (DISCLAIMER: I work at Hugging Face), has just released a new open-source library for ultra-fast & versatile tokenization for NLP neural net models (i.e. converting strings in model input tensors).

Main features: - Encode 1GB in 20sec - Provide BPE/Byte-Level-BPE/WordPiece/SentencePiece... - Compute exhaustive set of outputs (offset mappings, attention masks, special token masks...) - Written in Rust with bindings for Python and node.js

Github repository and doc: https://github.com/huggingface/tokenizers/tree/master/tokeni...

To install: - Rust: https://crates.io/crates/tokenizers - Python: pip install tokenizers - Node: npm install tokenizers

TypeScript 3.6 7 years ago

Yes, Python's type system is nowhere near Typescript, and are closer to docblock annotations.

The `nn.BatchNorm` CPU inference speedup is a Big Deal™ to us.

Thanks for the contributions everyone, and glad to have bet on PyTorch a few years back.