HN user

EliasY

32 karma

cartesian.app

Posts2
Comments16
View on HN

I believe "the society of mind" contains a bunch of really good but unorganized ideas for building intelligent models, but was written in such a way that it remained virtually impossible to implement them into a working program. Minsky's last book called "The Emotion Machine" tries to reorganize these ideas into one giant architecture composed of at least five interconnected macrolevels of cognitive processes built from specialized agents. Having said that, "The Society of Mind" is one of the most difficult books I've read.

I believe before claiming AGI is possible or impossible, one would need to define the operational features as well as the properties of what an AGI system is or can do. The primary problem with modern day ML research is that all of the folks that do the research including the major labs think that using one or two primary algorithms is enough to simulate general intelligence. But to think that an algorithm or two can have the ability to solve the hundreds of operational requirements needed to fully emulate intelligent behavior is misguided. What are these requirements, you say? Let's start with language. To substantially solve language understanding, you would need: physical world models, quantitative processing, long term memory, working memory, theory of mind, a discrete situational simulator, plan understanding, detection and generation, language grounding, functional and behavioral models of physical objects, temporal representations of events, affect and emotional processing, reflective understanding models and so many others.

While I agree with Prof.Marcus' ideas on the limitations of deep learning, I still don't think neurosymbolic approaches are sufficient for a generalized AI agent. I think a unified cognitive architecture might be necessary based on neuroscience and psychological observations similar to the work done during the 70s and early 80s.

Minsky's subsequent book called "the emotion machine" probably has some of the most complete treatments of topics like intelligence, understanding and consciousness.

As a former structural engineer, I completely agree with this sentiment. For every engineering project I was involved in, the automated components were at most 2 to 5% of the rest of the work.

I had it in August, just two days after getting vaccinated. Headaches, fever and body aches continued for three days after which I had complete loss of taste and smell for about a month. I don't know about you guys, but not being able to taste the food you eat was a big fucking deal for me. Lost a lot of weight that month. I wouldn't recommend getting any variant of this virus, especially if you live with a compromised loved one. However, compared to something like bacterial pneumonia, which I've also had in the past, COVID was very very mild.

With regards to fallacy #2 in fact, it is the other way around, I. E. "Easy things are hard" also known as Moravec's paradox. The symbolic AI generation always assumed that really hard problems like language understanding could be solved entirely through easy symbolic manipulation techniques. At the same time, current generation of AI researchers also claim that neural networks and gradient descent are all you need to solve such problems. But both groups seem to forget that the such problems are barely touchable using a single approach and encompass a large variety of different subproblems that may need wildly different methodologies inorder to solve them.

This theory reminds me of Marvin Minsky's "society of mind" theory where multiple agents/parts of a certain brain center encode the same object/concept in different ways and have a vote/suppress mechanism for processing different inputs in a heterarchial manner. But his model was far more theoretical than what I see here.

HAL from 2001 seems to be the most grounded in reality, as you could actually sense some how some of its advanced capabilities might be implemented even today, not to mention Marvin Minsky and IBM were advisors to Kubrick. While I really liked TARS and CASE from interstellar for their "settings" feature and for being non anthropomorphic in form.

AI Nationalism 8 years ago

Yes. But I don't think we've millions of years to make that happen nor do we have the capabilities or the knowledge to create the environmental situations that could potentially reinforce these mutations.

AI Nationalism 8 years ago

Adding to the fact that thousands of tricks are involved in the resourcefulness of the human brain and that each trick has multiple ways to interact with other tricks or modify itself . Duplicating this feat into machines isn't a simple matter. AGI isn't going to be some miracle of ML or any one technique. It requires simulating several different self selective learning models and their managers including a way to learn and debug better ways of learning, combining at least 10 different realms of knowledge and process representation including language abstractions, several tools for selecting which method for learning/remembering/acting is appropriate, several strategies for goal creation, selection, planning, execution and evaluation, a robust and scalable memory architecture, a dependable way to interact with the environment, programs for self evaluation and debugging.... the list goes on..... Bottom line is that nobody can get all this functionality from a few optimization algorithms...

I wonder if it was possible to use Hinton's idea of local features (where a 3 is recognized as an E in a 180 rotation map and a W in 90 deg. rotation map) to make the recognition partially rotation invariant....