AlphaTensor explained – Motivation, method, and assessment

https://www.assemblyai.com/blog/deepminds-alphatensor-explained/

by mr-ai • 4 years ago

5 3 4 years ago

mr-ai2• 4 years ago

AlphaTensor (from DeepMind) discovers mathematical algorithms with Reinforcement Learning. While much of the attention has been on AlphaTensor's results, its successes more truly lie in the novel approach it uses rather than the results themselves.

In DeepMind's AlphaTensor Explained, I outline the details of the model and its key ideas. An objective assessment of the results obtained by AlphaTensor for matrix multiplication algorithms is also given at the end.

SleekEagle• 4 years ago

You highlight that AlphaTensor can be used to optimize for a variety of distance metrics (speed, memory, numerical stability, energy usage, etc.). Would the distance metrics be what changed if you were using AlphaTensor to find better matrix multiplication algorithms for sparse matrices? What would this distance metric look like, if so

mr-ai2• 4 years ago

Hi, I mentioned "distinct" metrics. Just like the ones you mention. In order to apply AlphaTensor to sparse matrices, one would only need to change the dataset of randomly generated synthetic data (to contain only examples of sparse matrices). Then one could optimize for any metric of choice.

AlphaTensor explained – Motivation, method, and assessment

Related Stories