Ask HN: New Neural Network Primitives?

Hey Hackernews,

I’m completing my ms in cs and also am doing some ml research, and somebody recently told me an investigation into neural network primitives, I.e different cell types like LSTM cells, would be an interesting PhD dissertation.

What are some seminal papers and work done in examining different neural network primitives and cell types? Also has there been any work in treating neural networks as hypergraphs?