My 8 hour journey to a single character

http://lbrandy.com/blog/2009/11/the-8-hour-journey-to-a-single-character/

by lbrandy • 17 years ago

176 40 17 years ago

stuff4ben• 17 years ago

I love stories from the trenches like this! I'm currently diving into the shallow end of Lucene trying to accommodate ridiculous customer requirements. I'm sure in a couple hours there will be a "hidden flag" story somewhere in here.

delano• 17 years ago

The part of my code soul that dealt with search requirements goes out to you.

staunch• 17 years ago

The real lesson here is the power of asking the experts. Over the years there are countless times when I've replaced a huge or messy work-around with a tiny fix someone on IRC or a mailing list suggested.

Googling is great, but it only helps when you know what you're looking for. Telling expert humans what you're trying to achieve is far more useful.

DarkShikari4• 17 years ago

Telling expert humans what you're trying to achieve

This is critical. All sorts of "dumb questions" turn out to have been created by faulty assumptions or bad solutions to a larger problem. Often it's like traveling to the top of a mountain to boil water instead of fixing the broken stove. When asking for help, users should always ask the big picture question ("I need help setting up a server to do X, I'm getting error message Y when doing Z" rather than just the specific problem "I'm getting error message Y when doing Z").

sophacles• 17 years ago

As a corollary: when providing help, always demand the big picture. Frequently you will catch flak for this, in the form of "I am the expert in X, I know what I'm doing just fix the miniscule thing", but it is always great to see the look on someone's face when you say "Oh, dept. Y already does that and makes the result available at foo, it should save you a few hours of work".

steveklabnik• 17 years ago

Sounds like a classic: How to Ask Questions the Smart Way

http://catb.org/~esr/faqs/smart-questions.html

trafficlight• 17 years ago

An excuse to share my favorite bash.org quote:

<glyph> For example - if you came in here asking "how do I use a jackhammer" we might ask "why do you need to use a jackhammer" <glyph> If the answer to the latter question is "to knock my grandmother's head off to let out the evil spirits that gave her cancer", then maybe the problem is actually unrelated to jackhammers

http://bash.org/?866112

Periodic• 17 years ago

I can personally attest that in the past I have spent an hour googling on a problem to figure out what to google to get a solution.

jon_dahl• 17 years ago

Good point. This is why in Extreme Programming (and Cucumber), user stories are supposed to include a "Why?".

"As a user, I should be able to mark my favorite posts, so that I can find them again." It may turn out that users don't need to find old posts, or would prefer to search instead of looking through an old list.

DanielStraight• 17 years ago

Exactly. I think all the people replying with their stories of missing braces or semicolons or typos are missing the point. This wasn't an issue that could've been solved by careful (character by character) reading. It was one that required a ton of research. Tracking down a missing brace doesn't teach you anything. Tracking down an issue like this does.

DLWormwood• 17 years ago

> Telling expert humans what you're trying to achieve is far more useful.

Tiny little problem. You may not be able to.

Having worked in commercial, academic and government contexts, I can tell you that real life projects will always, always have some kind of hurdle to prevent you from divulging "what you're trying to do."

You might be working from a spec that only tells you what your superiors what you to know, there might be some legal or "market positioning" reason that requires you to preserve secrecy, or there might be department politics that will cause fur to fly if somebody outside your team finds out what you are really doing...

I sure hope my current stab at self-employment works out; I'd really had to go back...

gchpaco• 17 years ago

It can sometimes be really hard to even communicate assuming you do have the ability to tell them everything they need to know about. I'm not sure the original poster would have been able to figure out what he should have done had he not gone down all these rabbit holes; you need to understand the true screwed-ness of visual formats to really grok it.

jrockway3• 17 years ago

Any question I've ever needed to ask about $WORK_CODE has been abstract enough to ask without revealing any internal information.

rapind• 17 years ago

Agreed. I'll add that all the time he spent hunting down the bug put him into a position to really understand the question he was asking the expert.

As frustrating as these little problems can be, really digging in and taking the time to understand it is what experience is all about.

Confusion• 17 years ago

On the other hand, one may argue that lbrandy is now an expert on color space conversions. He already had enough expertise to solve the problem and he now knows even more. Asking an expert wouldn't have helped him in achieving that.

bmunro• 17 years ago

But he did ask a (relatively) expert - his video developer friend.`

jrockway3• 17 years ago

One character. One friggin’ “J”. 8 hours. I hope no one is keeping track of “lines of code per hour”.

Sounds like he / you acquired some essential domain knowledge in those eight hours. Your code is more efficient, and you understand the problem space. That is what programming is about, not how many lines of code you write.

(When working on a large existing code-base, my goal is to remove lines of code from the project. Writing code means you are writing bugs. Removing code means you are removing bugs :)

req23• 17 years ago

Whoosh.

spatulon• 17 years ago

Can you explain what apparently obvious point you think jrockway has missed?

arad• 17 years ago

A little off-topic, but I was under the impression that using the ffmpeg commercially was problematic, did you find you had to address that issue at all?

DarkShikari4• 17 years ago

ffmpeg is LGPL; it is used by hundreds of commercial applications around the world. For that matter, it has no commercial competitors for many of its use-cases.

Even On2, a competing encoder company, includes instructions with its encoder on how to set up mplayer (which uses ffmpeg) for decoding input videos.

NikkiA• 17 years ago

Besides which, it sounds like they're only using it in-house for processing, not distributing anything based on it. So even if they're not compiling it in LGPL mode, they're probably perfectly OK.

jermy• 17 years ago

The main 'problem' is that you'll still require an MPEG licence for encoding and decoding. Once you've bought one and abide by the usual LGPL rules (don't claim ownership, make source & changes available if distributing) then there shouldn't be any more commercial issues than, say, using Linux.

mquander• 17 years ago

I had the pleasure once of debugging an issue in C# that boiled down to the difference between a property "Percent" which was represented as e.g. 45.6, and a field "percent" which was measured as a fraction, e.g. 0.456. After correcting a reference to the field to be a reference to the property, I was proud to claim that my fix was a fix of a single bit - the difference between ASCII 'P' and ASCII 'p'.

Can't get smaller than that!

DougBTX• 17 years ago

I was at a pompously titled Software Craftsmanship conference, and one of the questions going around was: "what is the minimum commit size?"

My first guess was one character, since you can fix a bug by changing one character. But in the 'P' vs 'p' case, minimum size could be larger - fixing the calling code is fine, but is there a change that can be made to stop this bug appearing in other calling code? Eg, simplify the interface so that one of the 'p's is protected, so that the wrong Percent can't be set by accident.

DarkShikari4• 17 years ago

I had a similar case; a regression that lasted 3 weeks and took half a day of grovelling through code to fix... and turned out to be two one-character typos in a #define name:

http://git.videolan.org/?p=x264.git;a=commitdiff;h=2389de25f...

chipsy2• 17 years ago

I just fixed a "should be || was &&" logic error that manifested itself fairly mysteriously in a one-dimensional partitioning data structure I had made(meant for indexing things like collision rectangles that have a "canonical value" and a "represented value" which need to be synchronized).

When it removed elements, it was matching both the represented value(an integer) and the node(an object reference). Using && meant that it removed too greedily. Because updates always went "remove then add," this error went undetected until I hit the case where two or more objects shared an identical reprval. Then it removed all of the shared objects, leaving only one behind when I went to query the partition. After going through "Does my query function work right, does my list implementation work right, " I finally narrowed it down to the add/delete functions.

mleonhard• 17 years ago

That sounds like an error that would have been detected by a unit test.

holygoat• 17 years ago

Being a little snide... that sounds like a unit test that occurs to you after encountering that bug.

hxa72412• 17 years ago

I would think there would be another cause of different results: chrominance being encoded at lower resolution, dynamically and spatially. So converting to RGB then to gray would make it more quantised and blurrier . . . well, I haven't thought this through in detail, so I am not certain, but it seems a possible consideration . . .

(since each channel of RGB is a weighted combination of all three YUV, each of RGB must be somewhat lower resolution, and that can't be recovered, so when converted to gray, that lower resolution must remain . . . so it seems it would be a deficiency . . . )

DarkShikari4• 17 years ago

That's not lower resolution, that's lower precision. It's the difference between the number of samples and the accuracy of those samples.

This has nothing to do with luminance range though. Even if the output samples only had 4-bit precision, it wouldn't make black into gray.

hxa72412• 17 years ago

I understand the difference, which is why I said 'lower resolution, spatially and dynamically'.

Are you saying definitively that chrominance is not encoded at lower spatial resolution?

I also said it might be another cause of difference, not the cause.

Anyone might want to look at http://en.wikipedia.org/wiki/4:2:2 before simply assuming I am talking nonsense.

mhartl• 17 years ago

Something like this happened to me today. I noticed a floating menu that worked fine in Firefox and Safari didn't work in (wait for it) IE. After about three hours, I discovered that the JavaScript for the menu needed a CSS top attribute to work with; FF/Safari set it to 0 by default, but IE apparently needs an explicit value. Three hours, one line:

  #navtool {
    top: 0;
  }

But it works, and that's what really matters.

apgwoz• 17 years ago

I now realize why people don't always share their failures in the way Feynman said we should in "Cargo Cult Science."

Comments like this:

> wow, you are an idiot. i feel bad for you. you work on image processing for a living?

My 8 hour journey to a single character

Related Stories