HN user

jmayes

10 karma

Web AI Lead @ Google (machine learning in the browser, client side).

Connect with me on LinkedIn if you have questions: https://www.linkedin.com/in/WebAI

Or take my free YouTube course on Google Developers to learn more: https://goo.gle/Learn-WebML

Or just get inspired by folk just like you who are already using Web ML: https://goo.gle/made-with-tfjs

Posts0
Comments3
View on HN
No posts found.
Web AI Model Testing: WebGPU, WebGL, and Headless Chrome 3 years ago

For this blog post we are using Chrome for the testing environment which has WebGPU turned on by default now and other common browsers should hopefully follow suit, but given we are using Chrome here we know WebGPU will be available if the WebAI is using that (which many people are turning to for diffusion models and LLMs as its so much faster to run those types of models).

But yes, I am all for better support on all the things too, we have many WASM users too, and when anything new comes out there, this set of instructions can still be used to leverage testing that too as its just Chrome running on Linux essentially with the right flags set.

0ThreadHN
Web AI Model Testing: WebGPU, WebGL, and Headless Chrome 3 years ago

Hello there, I am one of the authors of the piece. Fun fact just for the lols we have tried running a 1.3B parameter unoptimized TensorFlow.js model in this system just to see if it would work (could be much more memory efficient with tweaks), and it does. It uses about 6GB RAM and 14GB VRAM when using V100 GPU on Colab (15GB VRAM limit) but runs pretty fast otherwise once the initial load is complete! Obviously plenty of room to make this use much less memory in the future - we just wanted to check we could run such things as a test for now.

0ThreadHN