This book covers the details of concepts, the methods and the challenges of evolutionary deep neural networks design. The authors begin by providing a brief introduction to deep neural networks, evolutionary computation. They also include some representative examples of both. Then they move on to describing the scope of evolutionary deep neural network design, and the fundamental methods of evolutionary deep neural network architecture design. Finally, they highlight the main challenges and some potential research directions in this emerging topic.