Reading QR codes without a computer

https://qr.blinry.org/

by input_sh • 3 years ago

655 87 3 years ago

qr.blinry.org

DerCommodore• 3 years ago

Fun article

ThePowerOfFuet• 3 years ago

This kinda comment is best on reddit, not here. Just use the upvote button and keep the SNR high!

subtra3t2• 2 years ago

I like how you were polite instead of lashing out at them and/or flagging the comment.

Aachen2• 3 years ago

I tried reading them manually about ten years ago, but gave up because of the mask. The mask pattern needs to be applied (xor) before you can even tell as much as the data type...

Does anyone know how much it actually helps QR code readers to have this mask pattern applied?

Last month, I tried to find out what the optimal error correction setting is (answer: none, if the matrix isn't damaged, like in my use-case where it's shown on a screen), which wasn't easy to find. I didn't find anyone who actually went out into the real world and tried out different settings and different scanning implementations to see what the effect is of choosing a good mask or choosing a good error correction value. In the end, a theoretical answer was enough for my application because I can assume the QRs to be pristine, but in a perfect world we also wouldn't need a mask setting. I then tried to do some research of my own by reading a small QR off my screen with different error correction levels and an intentionally shaking camera to simulate read issues when someone points a smartphone, but found no significant difference between any of the settings. With there being at least four alignment markers, a huge quiet area, and a "timing pattern", does it really matter if there are white blobs due to not having a mask?

(The secondary reason why I gave up trying to read QRs visually is because I noticed they always have the URL written below as fallback anyway. Since then, I did see a few times where there was no fallback, but it's very rare)

Retr0id5• 3 years ago

The error correction is funny. If you don't use it, your message takes up less space, and the QR is smaller. If you have a fixed space to fit it in (e.g. printing to a sticker), that means your pixels can be physically bigger. For reliable reading, I found that physically bigger pixels helped more than the error correction itself.

Depending on the length of your message, sometimes you can turn up the error correction level without impacting the final QR dimensions, and in those cases it's a win/win.

londons_explore3• 3 years ago

This is actually "cameras can't focus close, and QR scanners aren't good at seeing a code which is tiny in the frame".

By making the pixels of the code bigger, the camera can be a bit blurry to get the code big enough, and then it'll read.

komlan2• 2 years ago

Physically bigger pixels help a lot indeed. The encoding mode also helps make pixels bigger.

This is very convenient when you control the QR reader and need to represent long numeric identifiers like UUIDs.

For example:

  9728983f-7d7d-4189-b624-f92781e36650 (lowercase UUID):
    => length=36, 15 pixels between markers
  JWM9GFVXFN0RKDH4Z4KR3RV6A0 (base32 UUID):
    => length=26, 11 pixels between markers
  9728983F-7D7D-4189-B624-F92781E36650 (uppercase UUID):
    => length=36, 11 pixels between markers
  200924207194334734815443970355691218512 (decimal UUID):
    => length=39, 7 pixels between markers

The uppercase UUID has bigger pixels because it used a different encoding, and gets the same results as the shorter base32 uuid.

The decimal UUID is a longer string, but results in much bigger pixels because it can use numeric encoding.

I have a QR code base attendance tracker [1], where attendees show the code [2] on their phones (glares, etc.), in bad lighting conditions, etc. Bigger pixels means scanning stays quick. Same with parcel tracking [3] where field agents might need to scan QR codes in barely-lit hallways, etc.

[1] https://workspace.google.com/marketplace/app/qr_code_pass_fo...

[2] https://share.darkaa.com/!qntvtzNPWJ

[3] https://admin.trak.codes/

RugnirViking2• 3 years ago

Last year I did some experimentation along these lines and I also found that no error correction was best, at least when 3d printing QR codes. I was trying to find how small I could print it and still have it be detectable. Like the sibling comment, I suspect it is because of individually larger pixels.

Aachen2• 2 years ago

The problem with that, as I understand it, is that your 3d print (or any print or screen) cannot get damaged at all. The pixels being bigger makes it easier to scan ...when it's fully in view and fully intact. Any pixel fails, and you can never recover the original data (besides some guesses, e.g. if the protocol identifier gets damaged a la htwps://)

Error correction doesn't seem to be for easier scanning, but for errors that might occur

(... and stupid logo overlays)

but this information is annoyingly hard to find. Hence my question about the mask xor overlay: does that actually help? Did anyone try it, or did it just sound like a good idea?

basil-rash2• 2 years ago

The error correction isn't meant for folks like us who think about things like "how can I make this message smaller to increase the readability of the QR code", it's for the people that take their entire tracking parameter-infected URL and dump it into a version 25 (117x117) code and plaster it onto a huge sign out front where a bird promptly shits on it and a teenager slaps a sticker on it and somehow the data remains.

aftoprokrustes• 2 years ago

I also have the impression that a common use of error correction is the "QR Code with a logo in the middle" style. With an appropriate level of error correction, you can carve an empty patch in the middle of the logo and slap a logo/icon there, and the QR code remains readable.

At least this is the way I did it years ago when I thought it would be fancy to have my contact data as a QR Code on my visit card.

cyco1302• 3 years ago

Slightly off topic: One day in the late 90s or early 2000s, I wanted to transfer the contents of my Atari 8-bit disks to my PC. I did know about SIO2PC, a cable that converts between Atari's SIO port and the PC's serial port and a piece of software to go with it. But I didn't have the electronics skills to build one (even though it is actually very easy).

So I ended up writing a Basic program on the Atari to read data from the disk sector by sector and paint it on the screen (with the large 4-color pixels of graphics mode 3). The Atari was connected to the TV card of my PC and a Delphi program I wrote was running on the PC that kept taking screen shots and trying to decode the data from there. I quickly learned that empty sectors threw off my pixel position calibration so I added a mask pattern and a checksum. The sector address was also included. With that, I was able to transfer all my disk contents to my PC. To this day I consider it my greatest engineering achievement :)

Some ten years later, I went on to build an SIO2PC program called AspeQt. A more up-to-date community fork called RespeQt is still the most popular tool in that category used by the community. It even has its own subforum on AtariAge[1].

[1] https://forums.atariage.com/forum/184-respeqt-sio2pc-softwar...

efdee• 2 years ago

Just wanted to say this sounds like a fun project and you must have been pretty happy when it ended up working out!

cyco1302• 2 years ago

I was so happy that I'm still boasting about it some 25 years later!

xnx• 2 years ago

I think there's definitely a future for this type of data exfiltration via display as otherwise locked-down systems become more common.

spiritplumber• 2 years ago

https://www.robots-everywhere.com/re_wiki/pmwiki.php?n=Main.... I gotta fix my wiki.... https://www.robots-everywhere.com/re_wiki/images/Derpserial....

blakesmith• 2 years ago

Reminds me of how the first generation iPod firmware and keys were reverse engineered. They blinked out bit patterns on the LCD backlight and used a camera to read the data in! https://mastodon.social/@bagder/111538350617290554

nayuki4• 2 years ago

Citation needed, but I think I read that hackers dumped the firmware of Canon cameras by blinking the single red LED on the camera (and foregoing the main graphical LCD). See the CHDK and Magic Lantern projects.

aksss• 2 years ago

That's definitely worthy of praise. Excellent work. How old were you at the time?

NeoTar2• 3 years ago

Stupid 'trivia' question, but could someone generate the 'darkest' (most black pixels) and 'brightest (most white pixels) QR codes possible?

lekevicius• 3 years ago

It’s of course possible, but the spec is trying to avoid this. There are multiple “masking patterns”, and the algorithm should choose one that gives fewest “penalty points”. Large single color areas are a lot of penalty points, so QR algorithm is trying to avoid them.

NeoTar2• 3 years ago

Yes - I think it would be interesting to see them actually produced. Could we get to 60% white pixels? Or 75%?

There could maybe be two solutions:

* Darkest/Brightest allowed by the QR algorithm,

* Darkest/Brightest technically valid, which would would not be chosen by the algorithm (i.e. if one manually chooses the masking pattern.

Perhaps also more solutions - 'Darkest/Brightest recognized by software X/Y/Z'

Retr0id5• 3 years ago

An encoder should try to avoid them, but in theory it doesn't have to, right?

creole_wither• 2 years ago

Like this HDR QR Code that works on Apple devices?

https://notes.dt.in.th/HDRQRCode

nayuki4• 2 years ago

I made an attempt on https://www.nayuki.io/page/creating-a-qr-code-step-by-step - use the examples "Force light area" and "Force dark area".

ajsnigrutin• 3 years ago

So is the rest all content? Not quite! There is also error correction, which is used to make sure that the QR code can still be read even if some parts are damaged, blurry, or missing. The error correction is generated by some fancy math, and we don't care about it here for the purpose of reading it by hand.

This should be explained better... I mean sure, the math can be hard.. but is the error correction appended at the end? After every byte? In the middle? Can we still read a qr code by hand if it has error correction (assuming it's not damaged, and we can skip the math part?)?

vrighter• 3 years ago

the data in the code is encoded as a bitstream using possibly different alphabets, byte is just one of them.

Then, depending on the size and error correction level (not covered in the article where this is decoded from) the bitstream is split up into blocks, ecc data is calculated for both, and then the blocks are interleaved.

So this method will fail for any qr version above 5 for any level of ecc, and 3-5 with high levels of ecc.

andirk2• 3 years ago

Barcodes use the last digit as a checksum. The checksum is some adding up the numbers and multiplying or something, then % 10 (only 0-9 possible values). As you can see with this math, the error checking has a 1/10 of a chance of coincidentally showing a correct checksum in cases where the data is incorrect. Either way, that last digit on barcodes is insignificant to the actual product's unique barcode ID.

Fun story: The barcode was ripped and the checksum # was frayed off of an item I was returning to Home Depot. I frantically tried to do the math quicker that the checker could manually look it up. But they won and I'll never forget it.

https://www.gs1.org/services/how-calculate-check-digit-manua...

https://www.simplybarcodes.com/barcode_check_digit_calculato...

epcoa• 2 years ago

A few common barcodes including UPC work this way but mostly this is the exception. The 2D ones being discussed here like QR and Aztec use actual error correcting codes, so none of them. In the linear space Codabar (libraries) is a widely used example that doesn’t. GS-128 doesn’t, etc.

js2• 2 years ago

Feynman could've done it, with a little luck anyway. :-)

https://www.ecb.torontomu.ca/~elf/abacus/feynman.html

greengrocer4567• 2 years ago

When I worked at a grocery store in the 2000s, you didn't need the checksum digit when keying in a barcode by hand. In fact, manually entering the checksum digit would result in a "product not found" error.

So I wonder if the checker had to manually look anything up, assuming it was only the checksum digit that was frayed off.

Perhaps some POS systems do require the checksum digit for manually-entered barcodes, though.

amenghra• 2 years ago

An Artisanal QR Code [1] shows how to compute the checksum by hand using arithmetic similar to a long division. There are actually two slightly different codes (Reed-Solomon and BCH) for different pieces of information.

[1] https://www.quaxio.com/an_artisanal_qr_code.html

SushiHippie• 3 years ago

Related submissions:

Decoding small QR codes by hand (2012) - https://news.ycombinator.com/item?id=36173441 - Jun 2023 (69 comments)

How a QR code works - https://news.ycombinator.com/item?id=32837565 - Sep 2022 (114 comments)

Creating a QR Code step by step - https://news.ycombinator.com/item?id=24119124 - Aug 2020 (41 comments)

Creating a QR Code step by step - https://news.ycombinator.com/item?id=18360847 - Nov 2018 (34 comments)

yreg2• 3 years ago

My friends often joke that a person who is checking our tickets is able to do precisely this mentally in their head – when that person is satisfied by seeing a QR code rather than scanning it.

It became very popular over here with the Green Passes (EU Digital Covid Vaccination Certificates). Waiters, etc. were supposed to check whether the guests are vaccinated, but 99% of them just demanded any random QR code to be shown to them, took a look at it and considered it done.

Unless we are a country of hidden math geniuses :)

bluGill2• 2 years ago

It would probably only take a week of training/practice for someone to get good enough to read them manually. Particularity if the vaccination codes have a common pattern - the same mask, format information and the like. I would expect you can look at a few areas to see if the person is vaccinated (though this wouldn't pick up on someone else's vaccinated status)

mr_mitm• 2 years ago

There is a digital signature embedded in the QR code. No one can verify that in their head.

tln• 2 years ago

LOL, the EU's vaccination QR codes are 90+ modules wide, BASE 45 encoded and compressed.

tamarlikesdata• 2 years ago

How do you distinguish different encoding modes (numeric, alphanumeric, byte, etc.) within the data region, especially when dealing with a QR code that uses multiple encoding modes?

nayuki4• 2 years ago

Each segment starts with a header that consists of a 4-bit type (numeric, alphanumeric, byte, etc.) and an n-bit character count.

ao98• 2 years ago

Wonderful write up, thank you! One question I’ve been trying to answer: I’ve been seeing more QR codes in the wild using dots instead of squares, and rounded edges instead of hard corners.

All my research suggests these are reader implementation specific and not guaranteed to work per the official spec.

But I find it hard to believe these codes are becoming more prevalent if they aren’t guaranteed to read.

Anyone have more info on this?

kqr2• 2 years ago

You'd be surprised how incompetent most adults are at what they do. I'm sure some less technical person assumed QR reading works the same way everywhere, tested it with their device and went "Yess it works! Ship it!"

I also sometimes see QR codes that are inverted. Not all readers detect them but many enough do that they end up in print.

TonyTrapp• 2 years ago

That being said, the QR code readers most people have in their pockets already have to be able to deal with all sorts of problems (blurry pictures, dust on lens, and many more scenarios) that rounded corners are unlikely to have an affect on any of them.

lights0123• 2 years ago

In reality,

- Apple's barcode reader

- Google's ML Kit

- and ZXing, probably behind most third party QR code scanning apps

covers most QR code readers that users will actually use, so testing them is fairly easy.

Isamu• 2 years ago

Rounded corners is handled similarly to blurry images, one of the main ideas is readers to be forgiving in what they accept, and rely on the error detection bits to tell if it is way off. With error correction you can tolerate stylistic mangling.

jillesvangurp• 2 years ago

The qr code scanning algorithm works based on contrast and is designed to work with poor cameras under poor light conditions. Whatever shapes, colors and shades are used are interpreted as either black or white squares.

The process starts by scanning for the 3 markers on the corners. That give you the square containing the qr content and it's orientation. The next jobs are figuring out the resolution of the square and the version of the qr code used. Eventually you end up knowing the grid dimensions. And then you simply scan the grid as the article outlines by simply averaging the pixels in each grid square to be "white" or "black". As long as you have enough contrast, most grid squares will scan correctly.

You can abuse this quite a bit before it starts breaking. There are some interesting QR codes out there that are barely recognizable as QR codes for people. But if you open them in an image editor and play with the levels and contrast a bit, they are obviously qr codes. And there's error correction too so it's OK if some of the qr code is scanned incorrectly.

DeathArrow• 2 years ago

Looking on Wikipedia I see that QR code was invented in 1994 by a Japanese automotive components manufacturer to label car parts.

I wonder if QR code was invented today, could it be improved? Maybe for compactness? Ease of read?

arccy• 2 years ago

they would be hexagons

yreg2• 2 years ago

There's nothing stopping a new sufficiently better design. Bar codes were already ubiquitous in 94 and they didn't prevent QR codes taking off.

Maybe there's not that much left to improve. (unless changing the concept drastically, e.g. NFC)

jr19mi• 2 years ago

Great explanation of how to read QR codes, thanks for the write up! Here's a nice one about 1D codes and how to decode your average UPC codes you find on products in (American) supermarkets:

https://scanbot.io/blog/how-do-barcodes-work/

nayuki4• 2 years ago

Someone's video on decoding from a decade ago: https://www.youtube.com/watch?v=KA8hDldvfv0 (20 min)

My interactive web page on creating a QR code step by step (so basically the inverse process): https://www.nayuki.io/page/creating-a-qr-code-step-by-step

algem• 2 years ago

pretty cool article

cybrox• 2 years ago

Everyone praises the writeup itself but the fact that the article dynamically generates all the graphics based on your input is even more awesome!

Crypt0nomicon• 2 years ago

You’ve got to watch out reading those QR codes with your mind as you might contract a lethal mind-virus!

tylervigen• 2 years ago

This made me very curious about the error correction. Apparently you can design the codes to be variably durable from 7% to 30% recoverable.[0] Neat!

[0] https://docs.beaconstac.com/en/articles/6018654-what-is-erro...

kqr2• 2 years ago

Error correction is a fascinating topic. Shannon discovered in the mid-20th century what the theoretical limit was, yet nobody knew how to achieve it. When we suddenly got close in the 1990s with the patent of turbocodes the community reacted with disbelief!

Of course, that's what's enabled things like fast and reliable mobile networks.

83457• 2 years ago

My son, a freshman in high school, had an Apple Watch as his first and only device for a while. One big annoyance for him was not being able to scan QR codes that are common in high school where we live. It is an affluent area and the assumption by many, including teachers, is that all of the kids have phones. Not required and they have computers, just comes up regularly.

I was considering doing a project with low quality camera to scan QR codes. We got him a phone before I started down that path.

platzhirsch• 2 years ago

This is useful. I tried to scan a QR code with my analog camera and it didn't work. Now I can apply this algorithm to the developed photo myself.

chipsrafferty• 2 years ago

I would love a game where you learn to actually read QR codes by eyesight - and quickly. Would be quite fun to have an impressive and not very useful skill

poyu• 2 years ago

Not sure if it's possible to be honest, it might be if you can sit down with a pen a paper. But again we've seen human perform seemingly impossible tasks before, so who knows.

Sohcahtoa82• 2 years ago

I've always wanted to see someone encode/decode Base64 in their head.

At best, I've learned to recognize a base64 string that begins with "eyJ" is likely JSON.

Also, if you asked me what the base64 encoding of "password" is, but if you showed me "cGFzc3dvcmQ=" and asked me what the decoded value is, I'd recognize it as "password". Though you could probably change a few digits and fool me.

ehsankia• 2 years ago

Semi-related, there was a recent puzzle (part of an offshoot of the 2023 Mystery Hunt), which required you to decipher a really broken QR code by hand (too far for error correction to work). We ended up looking at all the guides listed in this comment section, and while they were useful, none were super great. It's always nice to have more detailed articles like this, and this one definitely seems very polished!

Here's the puzzle for anyone curious, though the QR code deciphering comes in the 2nd half: https://puzzles.mit.edu/2023/abcde.puzzlefactory.place/puzzl...

SoftMachine• 2 years ago

Can not read website without Javascript

grishka• 2 years ago

It's an interactive article, it does legit need JS

snvzz2• 2 years ago

Great article, loved it.

For the ASCII encoding mode

What's this encoding mode? There's no mention of an ASCII "encoding mode" in the rest of the article. wtf? Did you mean "bytes"?

bytes case

Suppose it's not bytes, but any of the other modes. How do we read these?

The error correction is generated by some fancy math, and we don't care about it

Please include error correction. Even if reading by hand, I want to know if I read properly! For that, I need to calculate the error correction.

Even just saying "there's a CRC-32/ISO-HDLC here" is better than saying nothing. I understand CRC is outside the scope of the article.

wolverine8762• 2 years ago

The modes are discussed in the article.

snvzz2• 2 years ago

The modes are discussed in the article.

Yes, and it lists encoding modes Numeric, Alphanumeric, Byte, ECI, and Kanji. It then proceeds to focus on Byte.

Article does notably not list an "encoding mode" called ASCII.

Thus, there's an issue in the article.

wolverine8762• 2 years ago

How could two-dimensional codes have been designed to be human-readable?

I was hoping to learn from the article how to manually read QR codes, but that format, at least, is much too complex to do with any efficiency.

At the end of the day, it's bits. Simplist case: 7-bit ASCII; eliminate masks (is that really so difficult for modern software to read sans the masks?); put error correction, length etc. in some corner where humans can ignore them ...

jokethrowaway• 2 years ago

This would have been useful a few weeks back, especially the error correction part!

I was visiting an unmanned business (no-one around) and my phone was dead. I wanted to connect to the wireless but the WiFi sign had only a QR code and no plain text password. I didn't have a QR code scanner on my computer. One of my services uses a QR scanner on the web but I didn't have that project cloned on my MacBook.

Regardless I scanned dependencies of dependencies hoping that some useless NPM dependency or some python package would have a QR code scanner but to no avail.

In my search at least I found (several) parsers which knew how to scan the QR code (exactly what the article is describing) from a picture but no code to go from an image to the binary data. I didn't have OpenCV or any other library I'm familiar with to process images and I deemed it hard to do something without documentation - so I took a photo with PhotoBooth and started converting the picture manually square by square into 0 or 1.

A few minutes later (and plenty of double checking) I had the data and I piped it into one of the parsers et voilà, I had internet.

fruit2020• 2 years ago

How does one detect the finder patterns when they are not squares?

daveslash• 2 years ago

Not sure. But I'm guessing that the finder patters represent a pattern that is not possible in the data encoding. That is, according the the encoding scheme you couldn't have data that, just by chance looked like a finder pattern.

Also: A more fun and technical sounding term for "finder pattern" is "Fiducial" https://en.wikipedia.org/wiki/Fiducial_marker

Reading QR codes without a computer

Related Stories