The Law of Conservation of Complexity

http://nomodes.com/Larry_Tesler_Consulting/Complexity_Law.html

by angrygoat • 6 years ago

102 45 6 years ago

msla2• 6 years ago

A good tonic for everyone who wants to simplify the solution by cutting bits off the problem, making a solution which is simple, easy-to-understand, and incomplete. If your program stops doing something, some other program has to do it, and that complexity must be considered as well.

jerf2• 6 years ago

Complexity is not conserved. It is a bound. A solution can not be simpler than the problem, when both are viewed holistically and complexity is properly understood. (Yeah, I'm handwaving, but at least I acknowledge it. I don't want to write twelve paragraphs defining "complexity" right now, because my real point is....)

But the solution sure can be more complicated than the problem.

tacon• 6 years ago

Fred Brooks wrote a book about complexity, accidental and essential. Essential complexity is the lower bound to which you refer, and the hard limit that prevents major advances in programmer productivity.

https://en.wikipedia.org/wiki/No_Silver_Bullet

jfengel2• 6 years ago

That is more or less what TFA says: "Every application has an inherent amount of irreducible complexity." "Irreducible" means a bound, but it does not mean a constant.

The name is misleading to a scientist, who has a specific understanding of what "conservation" means. And in particular, a very specific notion of what a "conservation law" is. Which this does not follow.

Getting past the name, it's a useful adage. But the name adds unneeded complexity, placing a burden on people who are forced to learn a different intention for a well-understood term.

contextfree2• 6 years ago

If the complexity is truly irreducible, is it possible to truly hide it from the user either?

goto115• 6 years ago

Isn't that the distinction between accidental and essential complexity? A solution cannot be simpler than the essential complexity of the problem, but it can surely be more complex by adding accidental complexity.

jayd16• 6 years ago

This is kind of a word game though. As soon as you find a way to lower complexity it becomes the new essential complexity until someone lowers it again.

crimsonalucard5• 6 years ago

A solution can not be simpler than the problem.

Problem: (4 primitives)

  1 + 1 + 1 + 1

Solution (one primitive):

If amount of primitives defines complexity you are wrong.

What's going on here is that you are using a different definition of complexity to construct your statement above. Most humans intuitively recognize your statement along with mine.

The issue here is that before we can even talk about complexity we have to come up with a formal definition that fits all forms of our intuition about what complexity actually is. Otherwise all arguments can become circular and pointless as everyone is talking about different things.

What is the formal definition of complexity? What is the thing that is being preserved here?

BoiledCabbage2• 6 years ago

I disagree with the above.

If you're listing 1 + 1 + 1 + 1 as 4 primitives (I think it's actually more once you include the primitive of addition), I don't think that 4 is the solution. The solution is a written up program that works on any integer that when run this particular sequence produces the value 4. And that solution/program is significantly more complex than 1+1+1+1.

Or alternatively if you say the program can't run on any other values, just that specific one so you can hardcode the result of the program to be "4", then I'd argue there initially aren't 4 primitives. there is one single primitive the entire entity "1+1+1+1" which is equivalent in inherent complexity to the primitive "4". Regardless of how complex we choose to represent it (ie with more characters or fewer), conceptually it's a single "primite" value input and it produces a single primitive value output.

jessermeyer• 6 years ago

What you call the problem is actually the specification of the solution, which is the point. What you call the solution is another representation of the solution, but lacks the specification, so you _cannot_ use it to show that it _is_ a solution.

carapace2• 6 years ago

What is the formal definition of complexity?

In re: that question I found "Introduction to Cybernetics" by Ashby to be very stimulating. (PDF freely available from here: http://pespmc1.vub.ac.be/ASHBBOOK.html )

__s• 6 years ago

Doesn't P=NP say otherwise? Given the solution, the problem becomes polynomial time to verify. Hindsight 2020

thedirt0115• 6 years ago

I think the comment was a little tongue-in-cheek -- like FizzBuzz is a problem without much inherent complexity, but you can certainly you make an overly complex solution: https://github.com/EnterpriseQualityCoding/FizzBuzzEnterpris...

thrower123• 6 years ago

The solution can sometimes be simpler than the problem, if the problem is redefined so that it isn't as complex. Quite often this is the case when tunnel-visioned on a particular process and focusing on how to do that thing. Stepping back and thinking about why or what the end goal actually is, and then doing something else, is often the only real way to meaningfully reduce complexity.

gumby• 6 years ago

Understanding this is the essence of abstraction.

thinkingkong• 6 years ago

I think there is another kind of conservation that occurs in our desire for complexity. Something about human natures forces lots of people to feel uncomfortable with giving up control, so we strive to exercise it in other places. Successful platforms, whether they be convenience systems like Netflix or Amazon, or software paradigms have always traded some new interface for unstated (and probably unknown) complexity elsewhere. I think the most apt example these days is probably Docker & K8s and the deluge of systems and tools required to make that all work well in a team setting.

There are other good adages that are worth reading about such as "Ashby's Law of Requisite Variety"[1], and the "Complexity Paradox"[2] which I think can apply generally here, if you synthesize the themes out.

[1] https://www.edge.org/response-detail/27150

[2] https://www.asktog.com/columns/011complexity.html

cestith2• 6 years ago

Having non-modal interfaces seems simpler for the user in a simple application, sure. But when I consider all the power in the classic example of vi/vim command mode I'm unconvinced.

If you want that flexibility and power, the options must live somewhere. Dividing that into two mutually exclusive modes breaks up the complexity of the main interface. I need to know a handful of key combinations like ESC, i, r, h, j, k, l (or arrow keys on modern systems), :, w, q, s, d, g, G, v, V, /, ?, !, % to get a vast majority of daily tasks done. How many nested drop-down menus would I need to navigate or multi-modifier hotkeys must I remember to do the same thing just so I don't have to remember one bit (which mode I'm in) before hitting a key?

The human mind is actually very comfortable with modes. Work, home, visiting family, visiting friends. Cooking at home vs dining out vs ordering in vs baking vs grilling vs cooking a holiday feast vs catering in vs party snacks and drinks vs road trip snacks. Driving vs taxi vs riding a bike vs walking. Retail vs garage sales vs in-person auctions vs online auctions vs online fixed-price shopping. Lending libraries vs bookstores vs reading rooms vs newsstands vs books we own vs ebooks. Math vs prose vs poetry vs visual communication vs music. We pay attention to different things and follow different sets of rules in different circumstances all the time. Is it easier to remember all the rules for all scenarios at once or to switch contexts?

msla2• 6 years ago

Developing muscle memory for Emacs is no harder than developing it for Vim, and since both involve rebinding annoying keys on the keyboard (mostly about whether Caps Lock becomes Esc or Ctrl) I prefer the editor with the more mature extension language.

ashton314• 6 years ago

Make Caps Lock both! I've got mine bound to be Esc on tap, Ctrl on a longer hold. Best thing I ever did for my pinky. (I'm an Emacs user, though I'm sure Vim users would benefit greatly as well.)

cestith2• 6 years ago

See, that's a reasoned argument of pros and cons. You didn't outright dismiss modes or dismiss a tool because it uses them. There's not a problem at all preferring a tool that's modal or one that's amodal. It seems a weird sort of zealotry to dismiss one or the other for that reason alone.

If you're looking to extend your editor a bunch then Emacs is great for that. Personally I primarily use a keyboard with no Caps Lock key so I don't worry about remapping it.

harperlee• 6 years ago

Alt+tab is mode change to an extent.

agumonkey• 6 years ago

Mode and modeless are both sides of the same coin.

contextfree2• 6 years ago

Which is why Jef Raskin in his system and interface designs tried to avoid having the concept of separate applications at all (instead of installing different applications, you'd install commands, which could be used from anywhere in the system): https://en.wikipedia.org/wiki/Archy#Commands

kazinator• 6 years ago

There is a formal theory of modes, so to speak: Hierarchical State Machines (HSMs).

A HSM has, or can have, a considerably simpler description that the equivalent FSM, because the equivalent FSM will have to duplicate all the states that are hierarchically shared in the HSM.

Some info here: https://en.wikipedia.org/wiki/UML_state_machine#Hierarchical...

crimsonalucard5• 6 years ago

First define complexity formally before attaching the word "Law" to a fuzzy concept.

A more accurate way to frame this is, complexity tends to be conserved. There is no proof or scientific evidence that states that this is a law.

jxy• 6 years ago

For people who don't know it, please look up "Kolmogorov complexity".

gitgud• 6 years ago

“Every application has an inherent amount of irreducible complexity. The only question is: Who will have to deal with it—the user, the application developer, or the platform developer?”

The JavaScript ecosystem is a good/bad example of this. Seemingly simple applications are pushing complexity to thousands of simple npm libraries.

The applications become simpler but the linking and composition of 3rd party libraries gets out of control.

At the core of it; abstractions reduce complexity, but only to a point...

zmmmmm• 6 years ago

Seems to overlook the concept of essential vs incidental complexity. Most processes I have seen in practice have huge amounts of incidental complexity.

I prefer to think about it from a different point of view: processes always grow in complexity until reasonably intelligent people can't understand them any more. It takes incredible discipline for anything to be maintained in a "simple" state below that threshold because reasonable people will all agree that adding some more complexity at that point has a low cost compared to the value generated. For this reason, most things in the world sit at that threshold of complexity where they are just comprehensible but still annoying complex when you first encounter them.

tobr• 6 years ago

The “Original Formulation” uses “irreducible complexity”. Isn’t that the same thing?

carapace2• 6 years ago

It seems to me that the irreducible complexity of a task is just what the user has to deal with to do it. If the application or platform could deal with that complexity for the user then it was reducible by definition.

lincpa3• 6 years ago

Simplicity is the ultimate sophistication.-- leonardo da vinci

The idea of simplicity and unity is an important guiding ideology of scientific research. It can be found from the knowledge of various disciplines: the more universally applicable a unified theory, the simpler it is, and the more basic it is, the greater it is.

[The Pure Function Pipeline Data Flow v3.0 with Warehouse / Workshop Model ](https://github.com/linpengcheng/PurefunctionPipelineDataflow), based on the philosophy of Taoism and the Great Unification Theory, In the computer field, for the first time, it was realized that the unification of hardware engineering and software engineering on the logical model. It has been extended from Lisp language-level code and data unification to system engineering-level software and hardware unification. Whether it is the appearance of the code or the runtime mechanism, it is highly consistent with the integrated circuit system. It has also been widely unified with other disciplines (such as management, large industrial assembly lines, water conservancy projects, power engineering, etc.). It's also very simple and clear, and the support for concurrency, parallelism, and distribution is simple and natural.

There are only five basic components:

1. Pipeline (pure function)

2. Branch

3. Reflow (feedback, whirlpool, recursion)

4. Shunt (concurrent, parallel)

5. Confluence.

The whole system consists of five basic components. It perfectly achieves unity and simplicity. It must be the ultimate programming methodology.

In addition, the IT industry is still a very young and immature discipline. The current software engineering is still at the level of manual workshops. Pure function pipeline data flow brings large industrial production theory and methods to software engineering. It incorporates IT industry into modern large industrial production systems, This is an epoch-making innovative theory and method.

The modern society is an information society, IT controls everything, penetrates everything. In my opinion, the development of IT is exactly the same as the development of modern large-scale industrial production systems. With the development of the IT industry, With the development of the IT industry, data standard systems will be widely established, improved and interconnected at the international, national, industrial and enterprise levels, It will be precisely standardized to every smallest part. pure function pipeline data flow will become the basic theory and Methods have become increasingly important, and have become the ultimate standard method for entering textbooks and industry.

The key to the industrialization of the IT industry is to establish a complete standard system like the traditional industry. software is the pipeline for producing products (data), which is no different from traditional industrial production lines. Therefore, the software production method will adopt enterprise management ideas, develop software into something similar to a traditional industrial assembly line, input standardized raw materials (data), output standardized products (data), and store them in a warehouse (database).

From the perspective of large industrial production theory, standardizing the input raw materials (data) and output products (data) has the following advantages:

- Fairness

- Neutrality

- Fungibility

- Standard, Data standards (data interfaces, data specifications) are better than code interfaces.

- Interconnectedness

- Combination, Data combination is better than code (function) combination.

- Simplicity

- Predictability, because the system architecture and set-up methods are simple and uniform, very clear, so its evolution and direction of development are predictable.

- Reliability

- Unity

- Easy to expand

- Easy to parallel, Can linearly scale up production (performance).

- Observable, easy to debug, and verifiable.

- Clarity, non-IT practitioners can understand.

It can refer to the theory of integrated circuits, business management and other disciplines. The role of the standard system can be seen from the great progress of social productivity after the traditional industry has entered the era of large industrial production from the era of manual workshops.

This method has been applied to 100,000 lines of code-level pure clojure project, which can prove the practicability of this method.

goto115• 6 years ago

Simplicity is the ultimate sophistication.-- leonardo da vinci

Doesn't sound like da Vinci. In what context did he state that?

lincpa3• 6 years ago

modify:

Fools ignore complexity. Pragmatists suffer it. Some can avoid it. Geniuses remove it.

      ---- Alan Perlis, Epigrams in Programming.

           the first recipient of the Turing Award (1966)

           A founding father of Computer Science as a separate discipline

When the solution is simple, God is answering.

Everything should be as simple as possible, but not simpler.

Most of the fundamental ideas of science are essentially simple, and may, as a rule, be expressed in a language comprehensible to everyone.

If you can't explain it simply, you don't understand it well enough.

Any intelligent fool can make things bigger, more complex, and more violent. It takes a touch of genius -- and a lot of courage -- to move in the opposite direction.

      ---- Albert Einstein

           The greatest folk scientist in history :-)

           A professional clerk in the patent office
 
           An amateur physicist

sergius• 6 years ago

No mentioning of the classic from the 70's: Systemantics :-)

https://en.wikipedia.org/wiki/Systemantics

The Law of Conservation of Complexity

Related Stories