OpenAI's Chief Scientist, Ilya, gave an in-depth interview on the eve of the GPT-3 release, discussing the development of neural networks and their comparison to the human brain. He is full of confidence in the progress and future of deep learning, believing that there are still many beautiful and mysterious properties of deep learning yet to be discovered. However, making further advancements requires significant computational resources and continuous effort. This interview provides valuable insights into the latest developments in the AI field.