Ask HN: Has anyone tried to make LLMs drive a car?

Seems like LLMs are very good at generalizing to random tasks that they're not necessarily trained for. I wonder how GPT-4 would do at responding to inputs from LIDAR sensors on an autonomous vehicle.