Coder's High – The Intense Feeling of Absorption

http://www.slate.com/articles/technology/technology/2014/06/coder_s_high_the_intense_feeling_of_absorption_exclusive_to_programmers.html?

by chippy • 12 years ago

191 48 12 years ago

slate.com

aaron-lebo• 12 years ago

I suspect that you get this kind of high doing a lot of things other than programming; programmers are not unique in this regard.

I'm insanely jealous of people who can do stuff like this. I hear stories of people like John Carmack locking themselves away in a room and finishing an entire project or implementing an entire feature in a night or over a weekend. In contrast it takes me days to finish anything, I just don't have the ability to concentrate or care about something that intensely.

Now I understand some stories are embellishments and someone like Carmack just thinks on a different level than most people, but is there a way to teach yourself to be able to engage in these marathon creative sessions or is it something you must be born with?

wslh• 12 years ago

You can feel the "programmers high" without being John Carmack. John Carmack has a surplus in other aspects of the craftwork but the feeling of immersion is more related to your concentration capabilities.

jliechti1• 12 years ago

> but is there a way to teach yourself to be able to engage in these marathon creative sessions or is it something you must be born with?

Anecdotally, I think the answer is yes. Concentration is a skill you can develop like anything else. The kind of high with programming for me is similar to that experienced when rehearsing/performing music.

I used to perform on a competitive drumline and we would have 8-10 hour rehearsals on the weekends (usually in 3 hour blocks). One of the main ideas expressed was that if you want to perform at a very high level, and do it consistently, you must always rehearse at performance levels and be hyper attentive to details. These rehearsals were mentally exhausting. But over a few months, my ability to concentrate and to quickly jump into a flow state improved dramatically.

One thing that surprised me - after rehearsing with a metronome for that many hours a day and usually at the same speed, say 120 BPM (beats per minute). When we would change speeds, faster or slower, even a 2 BPM different (118 BPM or 122 BPM) felt noticeably different than 120 BPM.

After I stopped performing that group, my ability to distinguish these small difference in tempo regressed. I can't do it anymore. A wide gap like 110 and 120 is noticeable (probably even to non-musicians), but not only a 2 beats difference.

If you want to try this yourself, get someone around you to go to http://www.webmetronome.com/ and set it to 120 BPM and 122 BPM and see if you can correctly guess which one they set it to.

thegeomaster• 12 years ago

I can confirm this. I'm (self-)learning to play drums, and since I'm still a noob, my synchronization of foot and hand is a little off. When I'm just fooling around on the kit, I don't notice these imprecisions. But once I get "in the zone" with a metronome and all, I can tell exactly every time I hit the bass drum a fraction of a second earlier/later than the hi-hat, and the feeling that follows immediately is a slightly unpleasant one, like when you commit a social faux pas. It's a curious shift of perspective, and such hypersensitivity happens to me when I get immersed in code too, so I guess it relates to concentration itself.

bluedino• 12 years ago

Carmack would actually pack a powerful laptop and go stay in a hotel (in a town where he didn't know anyone) for a week at times, it was the only way he could get away from it all.

Cthulhu_• 12 years ago

Actually this may be an important factor as to why a lot of people don't experience flow as much as described in the article or by people like Carmack; they have day jobs, family life, 9-5 jobs, that kinda thing. Those things will pull you out of the zone; lunch breaks, stopping for dinner, other people distracting you, etc.

I think Carmack (and people like him) grew up in the proverbial basement, where they could spend hours and hours on end with their hobbies without any social obligations; this is where they developed that concentration, and that state of mind and environment is where they return to if they need to work on a big or complicated task.

pearkes• 12 years ago

In my personal experience, and from watching others, the lock-in and absorption in your work comes with a succession of tasks and exertion, towards a meditation of sorts. You don't simply "fall in" to this state, but rather makes a concerted effort in reaching it.

is it something you must be born with?

A motivation to reach this state, to keep trying and pursuing it, may be a fact of your nature. Or, it is an understanding of what your work will create. Fame, money, fulfillment – extrinsic motivators that drive you towards a definitive conclusion.

To meditate in your work might just require you to find your motivator.

jmatthews• 12 years ago

To paraphrase the Bhagavad_Gita "you are not guaranteed the fruits of your labor, but you are guaranteed your labor."

For me flow is achieved most effortlessly when the problem is interesting and I have the tools necessary to attack it.

Extrinsic motivation is simply a non - factor in this case. To the degree that it may or may not exist and is immaterial to the labor at hand.

On the purpose of a tight feedback loop. The magic of the repl is a perfect implementation of a flow like feedback loop. Unfortunately my language of choice doesn't utilize it.

ChuckMcM• 12 years ago

My challenge is that in my lab there are so many things that are 'calling' that staying focused is a serious challenge and I end up 'puttering' as my wife calls it. For pure software projects taking just enough to get your programming done to an otherwise pristine environment does wonders (I take a notebook with me camping where I am not distracted).

Hiding things also helps, things in the visual field that you have to work on or are interesting are literal distractions.

lilsunnybee• 12 years ago

I've never been able to get into such a state either, with coding or any other such activity. For me the main impediment is almost definitely health-related (narcolepsy), but i wouldn't be surprised if there are quite a few other genetic configurations and circumstances without noticeable health consequences that make such intense levels of concentration next to impossible.

Double_Cast• 12 years ago

Miyamoto Musashi:

The primary thing when you take a sword in your hands is your intention to cut the enemy, whatever the means. Whenever you parry, hit, spring, strike or touch the enemy's cutting sword, you must cut the enemy in the same movement. It is essential to attain this. If you think only of hitting, springing, striking or touching the enemy, you will not be able actually to cut him. More than anything, you must be thinking of carrying your movement through to cutting him. You must thoroughly research this. [1]

I've been able to experience the flow for as far as I can remember. It was years before anyone even told me it even had a name. I've read the wikipedia article [2], but not the actual book. So I'm not an expert. But as far as I can tell, reaching the flow involves knowing your goal, closing the feedback loop, and pouring all your attention toward the goal.

For example, consider reading a novel (written in English). Someone who can't read English obviously won't be able to read it. But for someone who speaks English as a 2nd language, sure, they'll be able to read it. But more slowly since they have to think about things which are non-central to reading. Things like syntax, spelling, idiomatic expressions, irregular verbs, conjugations, etc. I.e. the implementation details; the cruft. The non-central things get in the way of the important things, which include semantics, plot, character development, irony, point of view, theme, tone, mood, etc.

Personally, I see novels (and sometimes non-fiction) as a gateway. As in a gateway into another universe. Because for one reason or another, I don't struggle at all with piercing through the syntax or get the slightest bit fatigued (though technical documents are different, those take effort for me). But I think that for some people (even for whom English is their primary language), text represents a barrier. "Why not just watch the movie?" Rather than using the semantics to simulate this alternate universe, they get bottle-necked into trying to translate the glyphs. So where I see as an epic space battle, others see an intimidating bulwark of text.

Because some people have this mental image, guys like Chris Granger have been trying to figure out how to translate a wall of text like a C source file into a novel's equivalent of a movie. We've gotten a lot of cruft out of the way with higher level languages, but it's not enough because programming still text based. I don't know if it'll work out, but that's the ideal.

The second thing is the feedback loop. Feedback has to be immediate. The feedback also has to be exact. I.e. you've got to know your craft better than the back of your hand. A musician will know in real time how well they are performing. They don't just notice the obvious mistakes, but even the minutia like jliechti1 was discussing. And they have to be confident about knowing that they indeed made a mistake so they can immediately act to correct it. The reason feedback comes second is because if you're still bushwhacking through a jungle of cruft, the feedback loop won't ever feel instantaneous.

Another analogy is being able to unwind the recursion without having to plug and chug each step. There's simply no effort expended. You can model the function well enough that you can visualize the path it takes, like the chess master could in the article. You simply cut through to the base case.

I like the Musashi quote because it perfectly embodies the first two items. The goal is to win the fight. But some people get caught up in thinking too much about the techniques. E.g. parrying is useful. But if you don't understand how to take advantage of it, it's mental cruft [3]. Additionally, if you're not confident, you'll hesitate and probably die. The stakes aren't as high in programming, but the same idea applies: perfect mastery is only a prerequisite to achieving the flow.

Third is the focusing of attention. It involves a state of mind where you're naturally able to block out all distractions, and focus everything on the task at hand. This part is a little like falling in love: you can't force it, you have to set the right conditions and pray things simply work out. This part is really frustrating compared to the first two items. You can always review your specs to better understand the goal and constraints, and maybe philosophize a bit. You can always practice and acquire skill in order to better fine-tune the feedback loop. But when it comes to focusing attention, all you can do is remove distractions. Which sounds ironic since "why would I want to block out distractions if I've removed them already?" I don't know how to explain it better, but that's how it works for me.

Interruptions are the worst. If you go out to lunch for an hour but you're still pondering the problem, then flow won't necessarily break. But if someone asks you to help them move furniture for 3 minutes, that forces a context switch and everything collapses like a house of cards.

Cthulu below mentions something about growing up in the proverbial basement. I think there's a lot of truth to that. Basements = zero distractions. Maybe childhood better conditions some people for the flow than others. But I did notice that once I heard the name "flow" and realized I already experience the emotion on a common basis, I was able to (try to) actively graft it into other activities. I think being able to actively seek it out helps. So I think it's at least somewhat trainable.

So here's a recap. In order to achieve the flow: master your craft; tighten the loop; avoid distractions.

[1] http://www.uvm.edu/~asnider/IDAS_2011_CD/Teachers/Steve%20Ll...

[2] http://en.wikipedia.org/wiki/Flow_(psychology)

[3] http://starwars.wikia.com/wiki/Form_III:_Soresu

therealidiot• 12 years ago

I wish I was able to just 'lock myself away' and finish a task... I just can't seem to go 5 minutes without someone disturbing me with some weird issue, or something that they could simply have searched online and had an answer instantly

headphones just don't seem to be a strong enough do-not-disturb indicator

icebraining2• 12 years ago

Agreed, as a go-to guy in the office, I often feel the same way.

One thing I've noticed is that even if people don't actually interrupt me, the expectation that they might at any minute prevents me from fully concentrating on the task. Having some sign to indicate that for the next, say, 30m I should not be interrupted, and having people respect that, would probably help significantly.

On the other hand, the fact that people are constantly needing me is partially my fault, since there's stuff I could empower them to do by themselves with a little automation.

wicker• 12 years ago

I was having trouble with the headphones not being a clear enough signal so I took a 3'x4' black foam posterboard and made a cubicle door. It caused a stir but mostly just in the people who liked to come by and ask me if I'd opened the cat gif they'd just emailed. Having the door closed is a nice clear signal and so far it's worked fine, for exactly your reasons. I can now trust that I won't be interrupted and I can relax to focus.

philmcc• 12 years ago

I recently had a variation of this experience with my phone. I was forced to be without it for 48 hours, and after a day there was a distinct mental distinction when I felt a sort of lightness that I can only associate with not only -not checking my phone- but -not thinking whether or not I should check my phone-. if that makes sense...

andersthue• 12 years ago

The sound and tactile feedback from my model-m and my instant flow CD (the lne I always listen to) is combined into a unbelivable nice feeling when I lift my fingers from the keybord after 45 minutes of coding.

The ahhhhh is like no else.

XorNot• 12 years ago

Recently I discovered Progressive House Mixes on YouTube, and suddenly found my xen coding music. It's exactly the right level of intensity to keep me focused, and bland enough to not distract me with tracks I don't like.

malanj• 12 years ago

I stopped coding for a few years, and recently started spending significant hours a week on coding again. The feeling is quite incredible. I had forgotten how good that high is.

I do think that the author doesn't understand Flow fully. The ideal state of Flow is when there is a concrete challenge with immediate feedback, which coding is great at providing. The other activities he compares coding to don't have such strong feedback or concrete challenge.

The only activity that compares with coding for me is rock climbing. While it is a physical activity, it has the same kind of concrete challenge and immediate feedback. It is totally immersive.

collyw3• 12 years ago

His headline of "one hit and you are hooked" suggests he hasn't had much experience with drugs either.

philers• 12 years ago

I think that off-piste skiing shares the same immersive flow-like experience whilst also being a physical activity.

It's the combination of feedback, decision making and then successful completion of the challenge that really combines to create the feeling.

Thinking of the problem, planning your response, and then executing in quick succession repeatedly.

comrade1• 12 years ago

This is surprisingly close. I'd never thought of it like this but it's immediately clear what you mean.

Especially if it's off-piste but an area that you're familiar with. You plan out your run multiple steps before you start, and once you're on the hill you have to be flexible enough to change course and replan on the fly for another multiple steps ahead, all while you're barreling down a hill.

And then there's the moments of sheer terror when you see snow sliding past you, or when you come up on a recent avalanche 1) have to avoid the packed ice and 2) look out for what caused the avalanche.

You're absolutely right - I get a kind of rush from coding that's similar to skiing off-piste. Not quite the same but not as different as one would think.

sanityinc• 12 years ago

Yes. Climbing, too. And there seem to be a surprising number of climbers who are also programmers, so it seems to me there's something similar in the nature of the two activities.

zaphar• 12 years ago

Swimming is my physical activity that induces flow for me. Our local Fitness Center has a pool with lanes half the length of an olympic pool. It's the perfect length for me to get that immediate feedback with a new challenge immediately following. It also reduces all other distractions. It's hard to hear anything else when your doing a front crawl and you really only see the line on the bottom of the pool. It's the perfect flow inducing exercise for me.

bicx• 12 years ago

I've noticed that this really doesn't happen to me unless I've got some outside motivation to make coding my number-one priority. Otherwise, my brain always kicks in with a nagging feeling that I need to better moderate how to spend my time. Or I just get bored. Basically, I need a reason to focus. It takes me a good few hours before the "flow" really kicks in, which is beyond the point when I normally take a break to clear my head.

(Also, am I the only one who gets slightly annoyed with the word "coding"? It seems to ignore the fact that most problems we sit around solving revolve around systems, integration, framework intricacies, logistical/timing issues, and stuff like that. The code is just the instruction set. Then again, maybe I just want my job to sound more fancy and shit.)

blaedj• 12 years ago

I'm with you on the coding comment especially when non-coding people use it to describe programming/coding as a menial, mindless task. I've also had the same thought that maybe I just want my job to sound cooler...

dep_b• 12 years ago

Employers have absolutely no idea how productive one programmer solving one problem on his own without interruption or distraction can be. Because yes I know the feeling really well but no this barely ever happens in my day job.

RogerL• 12 years ago

I'm working today (Sunday) so I can accomplish something for work. Most of my work occurs on the weekend, before I go to work, or after I get home. Yet I am at the office >40hrs/week. It's a madness that I cannot sustain. But yay, we are moving to a new facility with cubicles (I have an office now). I just don't expect any productivity to be possible anymore.

henrik_w• 12 years ago

I can really relate to this. There are many aspects of programming that contribute, I think: you are creating something, ususally something useful to others, which you are (often) in complete control of, and (in the words of Fred Brooks):

"The delight of working in such a tractable medium. The programmer, like the poet, works only slightly removed from pure thought-stuff. He builds his castles in the air, from air, creating by exertion of imagination."

I love that quote! More here: http://henrikwarne.com/2012/06/02/why-i-love-coding/

Tycho• 12 years ago

It's kind of the ultimate Randian ideal. The producer, exercising his/her power of thought, to the maximum, creating untold value. Ultimate mind over matter.

presidentender• 12 years ago

When I'm able to achieve flow, I'm supremely happy. You all understand.

A few tasks, though, have been serious blockers. When I don't understand my tools, and they fail in undocumented ways, and the relationships between presentation and business logic aren't clear, it actually hurts my feelings. It's as if the machine itself is judging me and reminding me that I'm not good enough.

1___1• 12 years ago

Does anyone have tips to overcome these "blockers"? Stalling after encountering blockers is more detrimental to me than plodding along without achieving flow.

collyw3• 12 years ago

For me the two are kind of related. I have been working on a side project for the last two or three months. Got going really well for a couple of weeks, and coded quite a lot. Then I got busy with other stuff in my life, so had to leave it for a while. It seems a lot more difficult to get into the state when I haven't been there for a while, while during the good two weeks, I came home from work and managed to get into the state very easily. Enthusiasm for an interesting problem also seems to help me.

SchizoDuckie• 12 years ago

Whenever this happens (and it's happened a lot in my life, to such a point where I can now self-induce myself into it) I feel that I need the right music in the background, either in my headphones or on speakers.

I couldn't do an all-nighter of that awesome zen-matrix-coding-until-the-birds-start-tweeting without it, but for noisy work situations it also helps to get into that mode.

Lock in the headphones, put on some tunes and 'focus mode' and someone can stand next to you for 5 minutes until they realize you zoned out and they need to tap your shoulder to get your attention.

I haven't found the perfect key to good coding music, but these are my 2 favorites:

* http://soundcloud.com/crussen/crussen-monday-funk-session (a 4.5 hour mix)

* The Fugees - The Score (full album)

drak0n1c• 12 years ago

I too need melodic/funk/trance music to get started, but sometime after entering flow I realize that whatever playlist I started with ended a long time ago and I've been coding to silence ever since. If there are a lot of noises nearby it reminds me to put music back on.

I recommend Anjunabeats and Above & Beyond if you are looking for melodic/uplifting electronic music that avoids potentially distracting lyrics and jarring sounds.

orasis• 12 years ago

The are other amazing levels of absorption available through concentration called "jhana". They can be immensely pleasurable and even sometimes produce life changing insights into consciousness and attention.

Check out this guided tour of the 13 jhanas - https://www.youtube.com/watch?v=PRdiOoTZC3A

ryanmarsh• 12 years ago

Mihaly Csikszentmihalyi's seminal book on this subject "Flow: The Psychology of Optimal Experience" is worth a read. The article didn't mention it and neither have any of the comments thus far so I thought it fair to name. If you would like to understand what "flow" is and how you can achieve it on a regular basis I encourage you to read it. This applies to individuals, groups, work and leisure.

The productivity gains seen from things such as Kanban, TDD, and CI/CD can be easily explained by the science of flow. I've given several conference talks on this and they've been well received (asked for encore presentations).

As a quick teaser, think about how CI or fast tests contribute to flow when in order to achieve flow these three criteria must be met:

1. The goal must be clear 2. Feedback must be immediate 3. There must be a feeling that our capability is balanced to the challenge at hand

Argorak• 12 years ago

A lot of what he describes sounds a bit like Hyperfocus, which is not always a good thing: http://en.wikipedia.org/wiki/Hyperfocus

392c91e8165b3• 12 years ago

In my late teens and my twenties, I spent 10s of 1000s of hours in a state of intense absorption on programming tasks. (I am in my 50s now.)

Am I the only one who believes that it is bad for me to spend more than 20 hours -- and perhaps as little as 15 hours -- a week in the state?

Just because an activity feels really good does not mean it is good for you.

I guess I should explain a little how I came to believe that that too much intense absorption is bad for me. Let me start by quoting a passage (which I agree with) from another comment here:

in order to achieve flow these three criteria must be met: 1. The goal must be clear 2. Feedback must be immediate 3. There must be a feeling that our capability is balanced to the challenge at hand.

The most important things for me to have made progress on in my life are things where it was not clear what my short-term goals should have been (although of course it was important for me to choose some short-term goals to work towards), where feedback was slow and rare and where I felt that the challenges I needed to surmount exceeded my capability. (I would guess that there are problems or concerns like in most people's lives.) In my past, I spent a great deal of time using the pleasures of intense absorption to distract myself from more important things.

Even after I realized that I was using programming and related activities like math and "programming-languages geekery" to distract myself from more important (but less enjoyable and messier) things, I did not know how to stop the distracting activities. In other words, I was addicted to the pleasures of intense absorption, and it took me many, many years to figure out how to extricate myself from that addiction.

If there are a lot of things in your life that are pleasurable -- hanging out with friends, sex or romance, physical exercise -- then maybe you do not have to worry about falling into the same trap as I did. I think that probably what really tripped me up when I was a teenager and a young man was that intense absorption was my only reliable or regular source of significant amounts of pleasure. Well, to be more accurate, satisfying my curiosity, a.k.a., learning, and intense focus on programming and related things were my only reliable sources of pleasure. (I have read that this pattern of only being able to take pleasure in one or 2 things and the consequent problem of addiction to those things is often a trap fallen into by people who were abused as children. I was abused as a child. Perhaps people who had happy childhoods are immune to the negative effects of spending one's days intensely focused.)

I still program for a few hours every week: I write Emacs Lisp code whose only user is me, which I do not get paid to write, and I am convinced it is not harmful to me. It makes me happy when I notice that one of my problems can be solved with code because coding is an efficient way to solve a problem. But if I ever take a job that involves programming full-time, I'll keep a sharp eye out for signs of a recurrence of my previous destructive / addictive relationship with the pleasure that comes from intensely focusing or concentrating. A big warning sign would be if I were to start again to neglect things that clearly should not be neglected like appointments at the dentist and such. Another (more ambiguous) warning sign would be a cessation of the process which has been going on for over 10 years now of my slowing increasing the range or variety of things I am able to enjoy or take pleasure in.

I decided to write this because in online conversations among programmers, we almost never hear (or read) about any negative effects of the "flow state". For me, there were significant negative effects: namely, I would have learned to deal with messy, low-feedback difficult situations at a younger age if I had not spent as much time in the "flow state". In other words, I got into the bad habit of using the flow state to avoid what I really needed to learn: how to make progress in messy "non-flow" situations.

rmcpherson• 12 years ago

Thanks for writing this. It's important to recognize the downsides of what is often considered only positive. It rings true for me especially.

Snhr• 12 years ago

I didnt realize how much I typed so I put it in pastebin. I've never commented here and your comment gave me hope that someone understands me (I'm sure there are a lot of people who do, its likely a miscommunication on my end) This is also an example of my writing when I'm not focused.. really tired right now but this is important so im half there so hopefully its half readable enough to give me maybe a half answer even though I want the full one I will accept any piece of information that makes me a little more closer to being successful in life)

tldr You made me realize stuff from your post and how do you live without flow and also this is more or less for me trying to figure what the hell my problem is and why I'm not good at a lot of aspects that make a successful person, also you don't have to read it because its probably an unrelated issue that sounds like mine but its worth mentioning just in case it is and I rarely find anyone that I can relate to with this sort of stuff so forgive me.. just trying to learn more about myself.

http://pastebin.com/eBNFJaSH

collyw3• 12 years ago

Reading your post you sound like me at "unmotivated" times in my life. (I would say I go through cycles, but nowhere near as extreme as your description).

When I start getting to the stage you are at, I make a point of doing some outdoor sports (a few people mentioned climbing. My personal preference is whitewater kayaking, or mountain biking - something that requires full focus and involves a bit of adrenaline).

I used to do a lot of outdoor, sports (worked as a river guide for a few years, and kayaked nearly every day). Now I have an office job, and see the difference. Something that gives you a bit of adrenaline helps you achieve the same feeling, as others have described with climbing, but not associated with coding.I think this helps you bring more balance to your life. If you don't do a lot of exercise, just getting fit will make a big difference as well.

At first it might be difficult to motivate yourself, but once you get into a habit you will find it easy, and you may even get annoyed the days you don't get to do your sport.

Anyway, that's what I find helps me. (Promising myself to start riding my bike on the trails on my way home from, now the weather is getting better).

lingoberry• 12 years ago

Interesting... I would also like to add that even if you're in a state of flow you are still more likely than not working on the wrong thing/problem or taking the wrong approach. Prolonged flow without any reflection on what you're doing will likely take you very far down a path to nowhere. I've observed this in myself many times.

yomritoyj• 12 years ago

This is very much my experience too. Binge programming can give you a false satisfaction of having done intellectual work without too great an intellectual effort. I find myself itching to write up some code precisely at those times when I am feeling frustrated that I am not working on something “deep” but when the really “deep” things seem too hard and their rewards too far away in the future.

392c91e8165b3• 12 years ago

Yes. When my main motivation for programming was to get the high that comes from long stretches of time spent in intense absorption, my programming time seemed to be less productive than it is now.

392c91e8165b3• 12 years ago

Replying to myself and quoting myself: "Am I the only one who believes that it is bad for me to spend more than 20 hours . . . a week in the state?"

That is misleading because it gives the impression that I spend a non-negligible fraction of my time in the flow state. I do not. I spend at most 15 to 20 hours a week programming. These years, very little of that time is spent in the flow state.

extempore• 12 years ago

I gave a talk recently which has a premise the importance of flow state. Linking into the middle of it: http://www.slideshare.net/extempore/keynote-lambdaconf2014/1...

I take the position that a slow compiler exacts a cost far beyond the obvious, because it inhibits flow state.

Coder's High – The Intense Feeling of Absorption

Related Stories