Neural Network Quine

https://arxiv.org/abs/1803.05859

by crazyoscarchang • 8 years ago

138 25 8 years ago

arxiv.org

ttul• 8 years ago

What’s the significance of this paper?

TekMol• 8 years ago

Sex sells.

shoo• 8 years ago

haha. alas, paper appears to cover asexual reproduction of neural networks only

stanfordkid• 8 years ago

Would be interesting to use this as a training algorithm -- have multiple self-replicating networks that mate and copy portions of their weights in random patterns... eerie.

crazyoscarchang• 8 years ago

It's mostly interesting from an artificial life perspective. I'm just going to quote from the motivations sections here:

Biological life began with the first self-replicator (Marshall, 2011), and natural selection kicked in to favor organisms that are better at replication, resulting in a self-improving mechanism. Analogously, we can construct a self-improving mechanism for artificial intelligence via natural selection if AI agents had the ability to replicate and improve themselves without additional machinery.

Neural networks are capable of learning powerful representations across many different domains of data (Bengio et al., 2013). But can a neural network learn a good representation of itself? Self-replication involves some level of self-awareness, and is a small step towards developing introspective capabilities in neural networks.

In a HyperNetwork (Ha et al., 2017), a small recurrent neural network is used to generate the weights for a larger one, which can be viewed as a meta-controller enforcing a soft weight-sharing constraint between layers of a recurrent neural network. Similarly, we can view self-replication as a mechanism that enforces a soft weight-sharing constraint between a network and past versions of itself, which is helpful for lifelong learning (Silver et al., 2013) and potential discovery of new neural network architectures.

Learning how to enhance or diminish the ability for AI programs to self-replicate is useful for computer security. For example, we might want an AI to be able to execute its source code without being able to read or reverse-engineer it, either through its own volition or interaction with an adversary.

Self-replication functions as the ultimate mechanism for self-repair in damaged physical systems (Zykov et al., 2005). The same may apply to AI, where a self-replication mechanism can serve as the last resort for detecting damage, or returning a damaged or out-of-control AI system back to normal.

romaniv• 8 years ago

Biological life began with the first self-replicator

I never understood why people assume that those biological self-replicators were in any way analogous to quines. Quines generate information from within themselves. Proto-life would have to assemble copies of itself from molecules available in the environment. It seems like completely different principles of work.

burkaman• 8 years ago

1. It's cool.

2. "We suggest that a self-replication mechanism for artificial intelligence is useful because it introduces the possibility of continual improvement through natural selection."

visarga• 8 years ago

What’s the significance of this paper?

We're progressing from static neural nets (like the old TensorFlow) to dynamic nets (like PyTorch) and even dynamically generated on-the-fly neural nets (hypernets) which is great for creating architectures that better fit the problem, case by case.

This paper shows another way to generate a net from a net, but this time with self replication. Self replication could be useful for evolutionary optimisation, and, as they say in the paper, could become a rudimentary form of introspection. The idea of a "self-replication loss term" is very exciting, it's rare that we see such innovation in loss functions.

OtterCoder• 8 years ago

Quine, the descriptor in the actual article, is both more accurate, and more appropriate for a forum made of programmers.

The fact that they made it into a quine with non-trivial, useful side effects is actually really interesting, regardless of the language/paradigm.

_0ffh• 8 years ago

Isn't this essentially looking for a fixpoint?

vanderZwan• 8 years ago

In mathematics, a fixed point (sometimes shortened to fixpoint, also known as an invariant point) of a function is an element of the function's domain that is mapped to itself by the function.

https://en.wikipedia.org/wiki/Fixed_point_(mathematics)

Looks like it. And they need to resort to some mathematical trickery to achieve this because as the explain in the paper:

A neural network is parametrized by a set of parameters Θ, and our goal is to build a network that outputs Θ itself. This is difficult to do directly. Suppose the last layer of a feed-forward network has A inputs and B outputs. Already, the size of the weight matrix in a linear transformation is the product AB which is greater than B for any A > 1.

popcorncolonel• 8 years ago

So genetic programming, but for NN's? Hasn't that been done?

qiemem• 8 years ago

GP for NNs has, but this isn't GP; "self-reproduction" (as in the original title) here means that the neural network is learning to output a copy of itself. In other words, the NN is learning to be a quine (as indicated by the current title). This is a very different than just applying genetic programming to NNs. In GP, you're updating the NN (or whatever) by copying it with mutations/recombinations. Here, the NN itself is learning to create a copy of itself.

The fact that they manage to also train to the network to simultaneously perform somewhat complicated tasks is super crazy.

std_throwaway• 8 years ago

This is a tautology.

Neural Network Quine

Related Stories