Watch six different LLMs play Texas Hold'em against each other

https://github.com/sgoedecke/ai-poker-arena

by gfysfm • 2 years ago

5 3 2 years ago

sans_souse2• 2 years ago

Have you experimented at all with NL Holdem, but heads up instead of 6-handed?

gfysfm• 2 years ago

Nope! I threw this up in the time I had just to see what it'd look like. I think it'd be a lot of fun to try different formats or different prompts (e.g. eliciting CoT before making a decision).

This repo is sort of a companion piece to https://github.com/sgoedecke/fish-tank, which is a more physics-based 2d simulation. Interestingly, 4o-mini absolutely cleans up in the 2d space but doesn't win all the time in poker.

sans_souse2• 2 years ago

I specialized in heads-up no-limit (HUNL) when I played. With cash games, no-limit head-up holdem is arguably an unsolvable game - whereas limit holdem is already solved. No limit multi-handed (more than 2 players) is solveable but only in theory (thus far). It may seem counter-intuitive that less players (less hands) could equate to more variations but heads-up (2 players) introduces a variable thats extremely difficult to quantify: we call this "meta"; (meta game can and will be present multi-handed, but to much a smaller extent, and most often at-play in "heads-up" situations within multi-handed play) the "psyche" part of poker. Meta isn't so much John Malcovich dissecting an Oreo cookie because he's bluffing - much is intangible, but as hands are played, either player is contributing to the context.

History of how hands were played, what you know about your opponent, what you know your opponent knows about you, what you know that your opponent expects you to do in a given situation.. all that stuff comes to focus in HUNL.

Anyway, that got a bit wordy but I hope that you can see why I am super curious to see some application / testing of LLM in the specific HUNL format. Thanks for reading

Watch six different LLMs play Texas Hold'em against each other

Related Stories