Toolformer: Language models can teach themselves to use tools

https://arxiv.org/abs/2302.04761

by azhenley • 3 years ago

155 16 3 years ago

arxiv.org

meghan_rain• 3 years ago

cute

nadermx• 3 years ago

I think this is probably the sort of way AGI will work.

valine• 3 years ago

A multimodal LLM using tools definitely feels like the closest we’ve ever been to AGI.

oliverbennett• 3 years ago

If we’re at a place a LLM can make and use tools I’m excited about the limits of its ability to create tools... specifically to create new tools.

For me that kind of entailment is one of the more exciting pillars of general intelligence and unique among humans (I think?).

FleurBouquet• 3 years ago

To me what we are seeing is what a failure the field of the philosophy of artificial intelligence has been to prepare us linguistically to have discussions about all this.

Even when we have real AGI, some people will argue we don't because it can't cook a hamburger. Then even if we make a robot AI arm to cook a hamburger, people will complain the arm can't play the guitar.

frozencell• 3 years ago

What will the people complain about at the end?

est• 3 years ago

see https://news.ycombinator.com/item?id=34757265

azhenley• 3 years ago

Thanks. I submitted this two days ago so it must have been put in the second chance queue.

amrb• 3 years ago

You can build stuff like this today, there is also the ability to use bash, python and requests lib under docs for utility. https://langchain.readthedocs.io/en/latest/modules/agents/ge...

gandalfgeek• 3 years ago

What they're describing in the paper goes much further than LangChain. Toolformer is integrating API calls into the training and inference of an LLM.

Short video explainer here: https://youtu.be/ZCdqfIuT81A

lovelearning• 3 years ago

They used GPT-J, an open-source LLM, for this. Anyone can use this technique privately to integrate with their proprietary / private APIs too.

flangola7• 3 years ago

Could this be applied to physical tools, such as audio sensors or motorized manipulater arms?

PaulHoule• 3 years ago

I think of those cases where people ask GPT-3 to write a Python program. For instance one person had the problem that they'd ask GPT-3 to answer a question like "How many prime numbers are there between 14 and 321?" and get an almost right answer. A better route to a right answer in that case is to have it write a Python program and run it because the only way to answer that right is to count them all and Python is good for that.

simonh• 3 years ago

Current LLMs can’t reason like that. If their training text contained a question and response similar to the one they are asked, those will have been encoded in their network weightings, and they will produce an answer of a similar form but randomly varying in the details.

This is why they produced answers to maths questions in the right form, but wrong in detail. It’s why when asked when and where a famous person was born, they will often respond with an answer that looks highly plausible, but wrong in the details.

What this mechanism might do though is enable it to identify this as a question best answered by one of it’s available APIs. That API might be to an LLM trained to write code to solve maths problems, so that will write the code, run it and generate a response, then pass that back through the API.

So this way you could build a hierarchy of problem solvers, some of them procedural, some of them domain specific LLMs, or problem solvers that themselves use LLMs as components to help solve that problem domain.

Interesting times.

euroderf• 3 years ago

If cats had opposable thumbs, we'd all be dead. Toolformer is in that vein.

Toolformer: Language models can teach themselves to use tools

Related Stories