How to Catch a Chess Cheater

http://www.uschess.org/content/view/12677/763/

by dfan • 12 years ago

69 20 12 years ago

dj-wonk• 12 years ago

Because the proper construction of statistical evidence against alleged cheaters requires such technical expertise, Regan believes that it’s necessary to establish a centralized authority responsible for the administration of anti-cheating protocol.
Regan also believes that a centralized authority can best fix public confusion about what constitutes scientific versus unscientific procedure. It’s too easy for people with a poor methodology to spread rumors online.

Ok, this seems reasonable.

Eventually he would like to oversee the conversion of his 35,000 lines of C++ code into a Windows-driven program or portable app. “I see other people using my methods but not necessarily using my program,” he says.

35,000 lines! After skimming the article, I'd hope it could be done much more compactly in a high-level language, say, Julia, Clojure, or Python.

rmrfrmrf• 12 years ago

Maybe it was a typo. I also noticed that the article says "...the number of possible unique chess positions [is] roughly 1043," which is a typo. 1043 should be 10^43.

CountHackulus• 12 years ago

Not to mention their error in claiming that NP problems were unsolvable.

dfan• 12 years ago

It's not clear to me whether that includes the evaluation engine or whether he's communicating with an external process. If it's the latter then I agree that it seems like a lot.

tragomaskhalos• 12 years ago

.. or C++. He's obviously a very bright guy but not necessarily a coder; there might be a lot of cut and paste in there, code for things that already exist in std, etc etc.

vertis• 12 years ago

The clearest give away was insisting on wearing Google Glass ^_^

wamatt• 12 years ago

After that teaser intro, was hoping the article would've shed a statistical beam on the 2006 cheating allegations against Kramnik.

darkmighty• 12 years ago

This is one of those asymptotically unsolvable problems (like captcha) -- he just created a new game. It's called beat the cheating detector. If you have access to the detector, it becomes trivial even: no matter how advanced the detector, using a chess engine to generate a set of moves and picking the best ones which go undetected works.

It's one thing that bother me about many online games (like counter strike). Unless they make a completely locked up computer, fighting cheats (server-side) is a losing battle. The bright side is that when they become really indistinguishable from good players, we can rest easy that the play isn't being degraded at all (expect for the cheaters themselves) :)

danielbarla2• 12 years ago

... It's called beat the cheating detector. If you have access to the detector, it becomes trivial even: no matter how advanced the detector, using a chess engine to generate a set of moves and picking the best ones which go undetected works.

Except that you have to beat all future detectors as well, which is a lot harder to get access to. E.g. this is how athletes sometimes get caught out doping; they use methods which are undetectable today, but fail in a year or two.

I don't really want to press this comparison too far though, not only are the prevalent levels completely different, but doping is also a lot less clear cut than cheating in chess / counter strike. It's pretty obvious when you're cheating in the one, whereas you could argue that using as-yet not banned substances is fair game. Mind you, we have had players type in recoil-resetting scripts at competitions, and argue that it's just a configuration, so perhaps it's not as clear cut as I make it sound.

eloisant• 12 years ago

That's why you don't "win" the game, but it's an endless competition between cheats and cheat detectors.

You will find neither the ultimate cheat, nor the ultimate cheat detector.

A1kmm2• 12 years ago

As long as the detectors don't directly detect cheating, but instead improvement at a rate that is too high (like in the article), then if you limit your rate of improvement to a rate and distribution similar to human improvement, it is unlikely that any future program will be able to detect this.

Detecting performance enhancement solely by looking at performance is a losing battle for the detecting side.

drdaeman2• 12 years ago

As for computer games, I believe there are two ways to effectively combat any "cheating":

1. Restrict what clients see and do, server-side. Many cheats rely on the fact, client game software internally has much more information that it presents to the player (wallhacks, radars/ESPs, etc), and server trusts client-originating data more than it should (speedhacks, norecoils, spawners, etc).

I know, those're due to attempts to reduce network-induced lags and lowering server loads, but having a more powerful server-side (and have an occasional desync if network lags badly) doesn't sound like an unacceptable trade-off to not have players upset by cheaters.

2. Embrace cheats as features and raise everyone abilities to best cheater's ones. There's no need to, say, have an aimbot if you have an "official" in-game ability to have autoaim.

Maybe then we'll finally have scriptable/hackable games, where one could "legally" automate routine tasks and be on a "good" side. Oh, and that MMO grinding/farming phenomena would finally die for good.

ap22213• 12 years ago

One can still cheat even in an environment where data is restricted. The 'cheating' part comes from being able to use the CPU to help the player make better or faster decisions. It doesn't have to be perfect - only enough to help the player gain an edge.

I haven't tried it in probably 15 years (and, I'm sure technique has improved exponentially, since then) but as long as you can access and reverse-engineer the data protocol (which you almost always can), you can add code logic to gain an edge.

Eye_of_Mordor• 12 years ago

The undetected move is the one within your track record, so cheating doesn't help much, unless you're cheating every move in every tournament. Would performance enhancing drugs be a better fit to this scenario?

A1kmm2• 12 years ago

To paraphrase the article, Ken Regan thinks that someone's chess skill improving too fast is conclusive proof that they are cheating.

I'm not sure this is really a true analogy to the examples of catching users of performance enhancing drugs; it would be more like saying 'your time on the track has improved by too much for us to believe, so you must have cheated, and therefore you are disqualified'.

Perhaps it would be better to use his software to target people for higher scrutiny, rather than as categorical proof of cheating. Cheaters, however, could just make sure that they always cheat, and ratchet up the search depth at a rate below the maximum permissible improvement rate.

annnnd• 12 years ago

Just curious: why don't they play in shielded rooms instead? I'm quite sure they are not cheap, but they would be far more reliable.

This method will work only until cheaters up their game (pun intended).

a3_nm• 12 years ago

Yeah, the article doesn't mention it but it is likely that you could run Stockfish on a smartphone or so to get good moves without any form of connectivity. (The main problem, I suppose, would be that you would have to feed it the other player's moves somehow, whereas with connected devices someone else can do it for you.)

How to Catch a Chess Cheater

Related Stories