Algorithmic Optimization Quotes

The purest case of an intelligence explosion would be an Artificial Intelligence rewriting its own source code. The key idea is that if you can improve intelligence even a little, the process accelerates. It's a tipping point. Like trying to balance a pen on one end - as soon as it tilts even a little, it quickly falls the rest of the way.

Search is an unsolved problem.

Networks love data. They love to be able to look at numbers and try to predict what they think will work.

I remember that mathematicians were telling me in the 1960s that they would recognize computer science as a mature discipline when it had 1,000 deep algorithms. I think we've probably reached 500.

Where folks like Google have fallen down is in just putting a little review box up, then closing their eyes and letting the algorithm take care of itself. Yelp is a technology company, but also a company that understands how people want to connect with one another.

A smart model is a good model.

The question is, can we make neural networks that are 1,000 times bigger? And how can we do that with existing computation?

It's interesting that the greatest minds of computer science, the founding fathers, like Alan Turing and Claude Shannon and Norbert Wiener, they all looked at chess as the ultimate test. So they thought, "Oh, if a machine can play chess, and beat strong players, set aside a world champion, that would be the sign of a dawn of the AI era." With all due respect, they were wrong.