{"id":279,"date":"2016-05-07T21:47:53","date_gmt":"2016-05-07T21:47:53","guid":{"rendered":"http:\/\/blogs.softwareclue.com\/?p=279"},"modified":"2016-05-07T21:47:53","modified_gmt":"2016-05-07T21:47:53","slug":"free-resources-for-beginners-on-deep-learning-and-neural-network","status":"publish","type":"post","link":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network","title":{"rendered":"Free Resources for Beginners on Deep Learning and Neural Network"},"content":{"rendered":"<p>By <span class=\"entry-author\">Manish Saraswat<\/span><\/p>\n<p>Source: <a href=\"http:\/\/www.analyticsvidhya.com\/blog\/2015\/11\/free-resources-beginners-deep-learning-neural-network\/\" target=\"_blank\">http:\/\/www.analyticsvidhya.com\/blog\/2015\/11\/free-resources-beginners-deep-learning-neural-network\/<\/a><\/p>\n<h2>Introduction<\/h2>\n<p>Machines have already started their march towards artificial intelligence. Deep\u00a0Learning and Neural Networks are probably the hottest topics in machine learning research today. Companies like Google, Facebook and Baidu are heavily investing into this field of research.<\/p>\n<p>Researchers believe\u00a0that machine learning\u00a0will highly influence\u00a0human life in near future. Human tasks will be automated\u00a0using robots with negligible margin of error. I\u2019m sure many of us would never have imagined such gigantic power of machine learning.<\/p>\n<p>To ignite your desire, I\u2019ve listed the best tutorials on Deep Learning and Neural Networks available on internet today. I\u2019m sure this would be of your help! Take your first step today.<\/p>\n<p>Time for some motivation here. You \u2018must\u2019 watch this before scrolling further. This ~3min video was released yesterday by Google. Enjoy!<\/p>\n<p><span class=\"embed-youtube\"><iframe loading=\"lazy\" class=\"youtube-player\" src=\"http:\/\/www.youtube.com\/embed\/l95h4alXfAA?version=3&amp;rel=1&amp;fs=1&amp;autohide=2&amp;showsearch=0&amp;showinfo=1&amp;iv_load_policy=1&amp;wmode=transparent\" width=\"640\" height=\"390\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/span><\/p>\n<p>&nbsp;<\/p>\n<p>Time for proceed further. Firstly, let\u2019s understand\u00a0Deep Learning and Neural Network\u00a0in simple terms.<\/p>\n<p>&nbsp;<\/p>\n<h2>What is Neural Network?<\/h2>\n<p>The concept of Neural Network began way back in 1980s. But, has gained re-ignited interest in recent times. Neural network is originally a biological phenomenon. Neural network is a \u2018network\u2019 of interconnected neurons which maintain a high level of coordination to receive and transmit messages to brain &amp; spinal cord.\u00a0In machine learning, we refer Neural Network as \u2018Artificial Neural Network\u2019.<\/p>\n<p>Artificial Neural Network, as the name suggests, is a network (layer) of artificially created \u2018neurons\u2019 which are then taught to adapt cognitive skills to function like human brain. Image Recognition, Voice Recognition, Soft Sensors, Anomaly detection, Time Series Predictions etc are all applications of ANN.<\/p>\n<p>&nbsp;<\/p>\n<h2>What is Deep Learning?<\/h2>\n<p>In simple words, Deep Learning can be understood as an algorithm which is composed of hidden layers of multiple neural networks. It works on unsupervised data and is known to provide accurate results than traditional ML algorithms.<\/p>\n<p>Input data is passed through this algorithm, which is then passed through several non-linearities before delivering output. This algorithm allows us to go \u2018deeper\u2019 (higher level of abstraction) in the network without ending up writing lot of duplicated code, unlike \u2018shallow\u2019 algorithms. As it goes deeper and deeper,\u00a0it filter the complex features and combines with those of previous layer, thus better results.<\/p>\n<p>Algorithms like Decision Trees,\u00a0SVM, Naive Bayes are \u2018shallow\u2019 algorithm.\u00a0These involves writing lot of duplicated code and cause trouble reusing previous computations.<\/p>\n<p>Deep Learning through\u00a0Neural Network and takes us a step closer to Artificial Intelligence.<\/p>\n<p>&nbsp;<\/p>\n<h2>What do Experts have to say?<\/h2>\n<p>Early this years, AMAs\u00a0took place on Reddit with the masters of Deep Learning and Neural Network. Considering my ever rising craze to dig latest information about this field, I got the chance to attend their AMA session. Let\u2019s see what they have to said about the existence and future of this field:<\/p>\n<p><a href=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-21239 alignleft\" src=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png?resize=115%2C122\" alt=\"1\" width=\"115\" height=\"122\" \/><\/a><\/p>\n<p><a href=\"https:\/\/www.reddit.com\/r\/MachineLearning\/comments\/2lmo0l\/ama_geoffrey_hinton\/\" target=\"_blank\" rel=\"nofollow\">Geoffrey Hinton<\/a> said, \u2018The brain has about 10<sup>14<\/sup> synapses and we only live for about 10<sup>9<\/sup> seconds. So we have a lot more parameters than data. This motivates the idea that we must do a lot of unsupervised learning since the perceptual input (including proprioception) is the only place we can get 10<sup>5<\/sup> dimensions of constraint per second.\u2019<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/21.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-21240 size-thumbnail alignleft\" src=\"http:\/\/i0.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/21.png?resize=150%2C150\" sizes=\"(max-width: 150px) 100vw, 150px\" srcset=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/21.png?resize=150%2C150 150w, http:\/\/i0.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/21.png?resize=83%2C83 83w, http:\/\/i1.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/21.png?resize=200%2C200 200w\" alt=\"2\" width=\"150\" height=\"150\" \/><\/a><\/p>\n<p><a href=\"https:\/\/www.reddit.com\/r\/MachineLearning\/comments\/25lnbt\/ama_yann_lecun\/\" target=\"_blank\" rel=\"nofollow\">Yann LeCunn<\/a>, on emotions in robot, said, \u2018Emotions do not necessarily lead to irrational behavior. They sometimes do, but they also often save our lives.\u00a0If emotions are anticipations of outcome (like fear is the anticipation of impending disasters or elation is the anticipation of pleasure), or if emotions are drives to satisfy basic ground rules for survival (like hunger, desire to reproduce), then intelligent agent will have to have emotions\u2019<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/31.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-21241 size-thumbnail alignleft\" src=\"http:\/\/i0.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/31.png?resize=150%2C150\" sizes=\"(max-width: 150px) 100vw, 150px\" srcset=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/31.png?resize=150%2C150 150w, http:\/\/i1.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/31.png?resize=83%2C83 83w\" alt=\"3\" width=\"150\" height=\"150\" \/><\/a><\/p>\n<p><a href=\"https:\/\/www.reddit.com\/r\/MachineLearning\/comments\/1ysry1\/ama_yoshua_bengio\/\" target=\"_blank\" rel=\"nofollow\">Yoshua Bengio<\/a> said, \u2018Recurrent or recursive nets are really useful tools for modelling all kinds of dependency structures on variable-sized objects. We have made progress on ways to train them and it is one of the important areas of current research in the deep learning community. Examples of applications: speech recognition (especially the language part), machine translation, sentiment analysis, speech synthesis, handwriting synthesis and recognition, etc.\u2019<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/4.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-21242 size-thumbnail alignleft\" src=\"http:\/\/i1.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/4.png?resize=150%2C150\" sizes=\"(max-width: 150px) 100vw, 150px\" srcset=\"http:\/\/i1.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/4.png?resize=150%2C150 150w, http:\/\/i1.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/4.png?resize=83%2C83 83w\" alt=\"4\" width=\"150\" height=\"150\" \/><\/a><\/p>\n<p><a href=\"https:\/\/www.reddit.com\/r\/MachineLearning\/comments\/2xcyrl\/i_am_j%C3%BCrgen_schmidhuber_ama\/\" target=\"_blank\" rel=\"nofollow\">Jurgen Schmidhuber<\/a> says, \u201920 years from now we\u2019ll have 10,000 times faster computers for the same price, plus lots of additional medical data to train them. I assume that even the <a href=\"http:\/\/people.idsia.ch\/%7Ejuergen\/deeplearning.html\" target=\"_blank\" rel=\"nofollow\">already existing neural network algorithms<\/a> will greatly outperform human experts in most if not all domains of medical diagnosis, from melanoma detection to plaque detection in arteries, and innumerable other applications.\u2019<\/p>\n<p>&nbsp;<\/p>\n<p><strong>P.S.<\/strong> <em>I am by no means an expert on Neural Networks. In fact, I have just started my journey in this fascinating world. If you think, there are other free good resources which I have not shared below, please feel free to provide the suggestions<\/em><\/p>\n<p>&nbsp;<\/p>\n<p>Below is the list of free resources useful to master these useful concepts:<\/p>\n<p>&nbsp;<\/p>\n<h2>Courses<\/h2>\n<p><a href=\"https:\/\/www.coursera.org\/learn\/machine-learning\" target=\"_blank\" rel=\"nofollow\">Machine Learning by Andrew Ng<\/a>: If you are a complete beginner to machine learning and neural networks, this course is the best place to start. Enrollments for the current batch ends on Nov 7, 2015. This course provides a broad introduction to machine learning, deep learning, data mining, neural networks using some useful case studies. You\u2019ll also learn about the best practices of these algorithms and where are we heading with them<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/www.coursera.org\/course\/neuralnets\" target=\"_blank\" rel=\"nofollow\">Neural Network Course on Coursera<\/a>: Who could teach Neural Network better than Hinton himself? This is a highly recommended course\u00a0on Neural Network. Though, it is archived now, you can still access the course material. It\u2019s a 8 week long course and would require you to dedicate atleast 7-9 hours\/week. \u00a0This course expects prior knowledge of Python \/ Octave \/ Matlab and good hold on mathematical concepts (vector, calculus, algebra).<\/p>\n<p>&nbsp;<\/p>\n<p>In addition to the course above, I found useful slides and lecture notes of Deep Learning programs from a few top universities of the world:<\/p>\n<p><a href=\"http:\/\/deeplearning.cs.cmu.edu\/\" target=\"_blank\" rel=\"nofollow\">Carnegie Mellon University \u2013 Deep Learning<\/a>\u00a0: This course ended on 21st October 2015. It is archived now. But, you can still access the slides shared during this course. Learning from slide is an amazing way to understand concepts quickly. These slides cover all the aspects of deep learning to a certain point. I wouldn\u2019t recommend this study material for beginners but to intermediates and above in this domain.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/nlp.stanford.edu\/courses\/NAACL2013\/\" target=\"_blank\" rel=\"nofollow\">Deep Learning for NLP<\/a>\u00a0\u2013 This conference happened in 2013 on Human Language Technologies. The best part was, the knowledge which got shared. The slides and videos and well accessible and comprises of simple explanation of complex concepts. Beginners will find it worth watching these videos as the instructor begins the session from Logistic Regression and dives deeper into the use of machine learning algorithms.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/llcao.net\/cu-deeplearning15\/index.html\" target=\"_blank\" rel=\"nofollow\">Deep Learning for Computer Vision<\/a>\u00a0\u2013 This course was commenced at the starting of year 2015 by Columbia University. It focuses on deep learning techniques for vision and natural language processing problems. This\u00a0course embraces theano as the programming tool. This course requires prior knowledge in Python and NumPy programming, NLP and Machine Learning.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/cilvr.cs.nyu.edu\/doku.php?id=courses:deeplearning2014:start\" target=\"_blank\" rel=\"nofollow\">Deep Learning<\/a>: This is an archived course. It happened in Spring 2014. It was instructed by Yann LeCunn. This is a graduate course on Deep Learning. The precious slides and videos are accessible. I\u2019d highly recommend this course to beginners. You\u2019d amazed by the way LeCunn explains. Very simple and apt. To get best out of this course, I\u2019d suggest you to work on assignments too, for your self evaluation.<\/p>\n<p>&nbsp;<\/p>\n<h2>Books<\/h2>\n<p><a href=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/10\/6.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-21021 alignleft\" src=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/10\/6.png?resize=151%2C226\" alt=\"6\" width=\"151\" height=\"226\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p>This book is written by Christopher M Bishop. This book serves as a excellent reference\u00a0for students keen to understand the use of statistical techniques in machine learning and pattern recognition. This books assumes the knowledge of linear algebra and multivariate calculus. It provides a comprehensive\u00a0introduction to statistical pattern recognition techniques using practice exercises.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>Because of the rapid development and active research in the field, there aren\u2019t many printed and accessible books available on Deep Learning. However, I found that Yoshua Bengio, along with Ian Goodfellow and Aaron Courville is\u00a0working on a book.\u00a0You can check its\u00a0recent developments <a href=\"http:\/\/goodfeli.github.io\/dlbook\/\" target=\"_blank\" rel=\"nofollow\">here<\/a>.<\/p>\n<p><a href=\"http:\/\/neuralnetworksanddeeplearning.com\/about.html\" target=\"_blank\" rel=\"nofollow\">Neural Networks and Deep Learning<\/a>: This book is written by Michael Neilson. It is available FREE online. If you are good at learning things at your own pace, I\u2019d suggest you to read this book. There are just 6 Chapters. Every chapters goes in great detail of concepts related to deep learning\u00a0using really nice illustrations.<\/p>\n<p>&nbsp;<\/p>\n<h2>Blogs<\/h2>\n<p>Here are some of the best bet I have come across:<\/p>\n<p><strong>Beginners<\/strong><\/p>\n<p><a href=\"http:\/\/natureofcode.com\/book\/chapter-10-neural-networks\/\" target=\"_blank\" rel=\"nofollow\">Introduction to Neural Networks<\/a>\u00a0: This is Chapter 10 of Book, \u2018The Nature of Code\u2019. You\u2019ll find the reading style simple and easy to comprehend. The author has explained neural network from scratch. Along with theory, you\u2019ll also find codes(in python) to practice and apply them at your them. This not only would give you confidence to learn these concept, but would also allow you to experience their impact.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/karpathy.github.io\/neuralnets\/\" target=\"_blank\" rel=\"nofollow\">Hacker\u2019s Guide to Neural Networks<\/a>\u00a0: Though, the codes in this blog are written in Javascript which you might not know. I\u2019d still suggest you to refer it for the simplicity of theoretical concepts. This tutorial has very little math, but you\u2019ll need lots of logic to comprehend and understand the following parts.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Intermediates<\/strong><\/p>\n<p><a href=\"http:\/\/www.wildml.com\/2015\/09\/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns\/\" target=\"_blank\" rel=\"nofollow\">Recurrent Neural Network Part 1<\/a>, <a href=\"http:\/\/www.wildml.com\/2015\/09\/recurrent-neural-networks-tutorial-part-2-implementing-a-language-model-rnn-with-python-numpy-and-theano\/\" target=\"_blank\" rel=\"nofollow\">Part 2<\/a>, <a href=\"http:\/\/www.wildml.com\/2015\/10\/recurrent-neural-networks-tutorial-part-3-backpropagation-through-time-and-vanishing-gradients\/\" target=\"_blank\" rel=\"nofollow\">Part 3<\/a>, <a href=\"http:\/\/www.wildml.com\/2015\/10\/recurrent-neural-network-tutorial-part-4-implementing-a-grulstm-rnn-with-python-and-theano\/\" target=\"_blank\" rel=\"nofollow\">Part 4<\/a>\u00a0: After you are comfortable with basics of neural nets, it\u2019s time to move\u00a0to the next level. This is probably the best guide you would need to master RNN. RNN\u00a0is a form of artificial neural network whose neurons send feedback signals to each other. I\u2019d suggest you to follow the 4 parts religiously. It begins RNN from basics, followed by\u00a0back propagation and its implementation.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/karpathy.github.io\/2015\/05\/21\/rnn-effectiveness\/\" target=\"_blank\" rel=\"nofollow\">Unreasonable Effectiveness of RNN<\/a>: Consider this as an additional resource on RNN. If you are fond of seeking options, you might like to check this blog. It start with basic definition of RNN and goes all the way deep into building character models. This should help you give more hands on experience on implementing neural networks in various situations.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/www.codeproject.com\/Articles\/14342\/Designing-And-Implementing-A-Neural-Network-Librar\" target=\"_blank\" rel=\"nofollow\">Backward Propogation Neural Network<\/a>: Here you\u2019ll find a simple explanation on the method of implementing backward propagation neural network. I\u2019d suggest beginners to follow this blog and learn more about this concept. It will provide you a step by step approach for understanding neural networks deeply.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/deeplearning.stanford.edu\/wiki\/index.php\/UFLDL_Tutorial\" target=\"_blank\" rel=\"nofollow\">Deep Learning Tutorial by Stanford<\/a>: This is by far the best tutorial\/blog available on deep learning on internet. Having been recommended by many, it explains the complete science and mathematics behind every algorithm using easy to understand illustrations. This tutorial assumes basic knowledge of machine learning. Therefore, I\u2019d suggest you to start with this tutorial after finishing Machine Learning course by Andrew Ng.<\/p>\n<p>&nbsp;<\/p>\n<h2>Videos<\/h2>\n<p><a href=\"https:\/\/www.youtube.com\/watch?list=PL6Xpj9I5qXYEcOhn7TqghAJ6NAPrNmUBH&amp;v=SGZ6BttHMPw\" target=\"_blank\" rel=\"nofollow\">Complete Tutorial on Neural Networks<\/a>\u00a0: This complete playlist of neural network tutorials should suffice your learning appetite. There were numerous videos I found, but offered a comprehensive learning like this one.<\/p>\n<p><span class=\"embed-youtube\"><iframe loading=\"lazy\" class=\"youtube-player\" src=\"http:\/\/www.youtube.com\/embed\/videoseries?list=PL6Xpj9I5qXYEcOhn7TqghAJ6NAPrNmUBH&amp;hl=en_US\" width=\"640\" height=\"390\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/span><\/p>\n<p>&nbsp;<\/p>\n<p><strong>Note:<\/strong> In order to quickly get started, I\u2019d recommend you to participate in <a href=\"https:\/\/inclass.kaggle.com\/c\/facial-keypoint-detection\" target=\"_blank\" rel=\"nofollow\">Facial keypoint Detection<\/a> Kaggle competition. Though, this competition ended long time back, you can still participate and practice. Moreover, you\u2019ll also find benchmark solution for this competition. Here is the solution:\u00a0<a href=\"http:\/\/danielnouri.org\/notes\/2014\/12\/17\/using-convolutional-neural-nets-to-detect-facial-keypoints-tutorial\/\" target=\"_blank\" rel=\"nofollow\">Practice \u2013 Neural Nets<\/a>. Get Going!<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/www.youtube.com\/watch?v=PlhFWT7vAEw&amp;index=16&amp;list=PLE6Wd9FR--EfW8dtjAuPoTuPcqmOV53Fu\" target=\"_blank\" rel=\"nofollow\">Deep Learning Lectures<\/a>: Here is a complete series of lectures on Deep Learning from University of Oxford 2015. The instructor is Nando de Freitas. This tutorials covers a wide range of topics from linear models, logistic regression, regularization to recurrent neural nets. Instead of rushing through these videos, I\u2019d suggest you to devote good amount of time and develop concrete understanding of these concepts. Start from Lecture 1.<\/p>\n<p><span class=\"embed-youtube\"><iframe loading=\"lazy\" class=\"youtube-player\" src=\"http:\/\/www.youtube.com\/embed\/videoseries?list=PLE6Wd9FR--EfW8dtjAuPoTuPcqmOV53Fu&amp;hl=en_US\" width=\"640\" height=\"390\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/span><\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/www.youtube.com\/watch?v=S75EdAcXHKk\" target=\"_blank\" rel=\"nofollow\">Introduction to Deep Learning with Python<\/a>: After learning the theoretical aspects of these algorithm, it\u2019s now time to practice them using Python. This ~1 hour video is highly recommended to practice deep learning in python using theano.<\/p>\n<p><span class=\"embed-youtube\"><iframe loading=\"lazy\" class=\"youtube-player\" src=\"http:\/\/www.youtube.com\/embed\/S75EdAcXHKk?version=3&amp;rel=1&amp;fs=1&amp;autohide=2&amp;showsearch=0&amp;showinfo=1&amp;iv_load_policy=1&amp;wmode=transparent\" width=\"640\" height=\"390\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/span><\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/videolectures.net\/deeplearning2015_montreal\/\" target=\"_blank\" rel=\"nofollow\">Deep Learning Summer School, Montreal 2015<\/a>: Here are the videos from Deep Learning Summer School, Montreal 2015. These videos covers advanced topics in Deep Learning. Hence, I wouldn\u2019t recommend them to beginners. However, people with knowledge of machine learning must watch them. These videos will take your deep learning intellect to a new level. Needless to say, they are FREE to access.<\/p>\n<p>&nbsp;<\/p>\n<p>Also See: <a href=\"http:\/\/www.analyticsvidhya.com\/blog\/2015\/07\/top-youtube-videos-machine-learning-neural-network-deep-learning\/\" target=\"_blank\" rel=\"nofollow\">Top Youtube Videos on Machine Learning, Deep Learning and Neural Networks<\/a><\/p>\n<p>&nbsp;<\/p>\n<h2>Research Papers<\/h2>\n<p>I could list here numerous paper published on Deep Learning, but that would have defeated the purpose.\u00a0Hence, to highlight the best resources, I\u2019ve listed some of the seminal papers in this field:<\/p>\n<p><a href=\"http:\/\/arxiv.org\/pdf\/1404.7828.pdf\" target=\"_blank\" rel=\"nofollow\">Deep Learning in Neural Networks<\/a><\/p>\n<p><a href=\"http:\/\/www.nature.com\/articles\/nature14539.epdf?referrer_access_token=K4awZz78b5Yn2_AoPV_4Y9RgN0jAjWel9jnR3ZoTv0PU8PImtLRceRBJ32CtadUBVOwHuxbf2QgphMCsA6eTOw64kccq9ihWSKdxZpGPn2fn3B_8bxaYh0svGFqgRLgaiyW6CBFAb3Fpm6GbL8a_TtQQDWKuhD1XKh_wxLReRpGbR_NdccoaiKP5xvzbV-x7b_7Y64ZSpqG6kmfwS6Q1rw%3D%3D&amp;tracking_referrer=www.nature.com\" target=\"_blank\" rel=\"nofollow\">Introduction to Deep Learning<\/a><\/p>\n<p><a href=\"http:\/\/www.utstat.toronto.edu\/%7Ersalakhu\/papers\/dbm.pdf\" target=\"_blank\" rel=\"nofollow\">Deep Boltzmann Machines<\/a><\/p>\n<p><a href=\"http:\/\/www.iro.umontreal.ca\/%7Elisa\/publications2\/index.php\/publications\/show\/239\" target=\"_blank\" rel=\"nofollow\">Learning Deep Architectures for AI<\/a><\/p>\n<p><a href=\"http:\/\/arxiv.org\/abs\/1305.0445\" target=\"_blank\" rel=\"nofollow\">Deep Learning of Representations: Looking Forward<\/a><\/p>\n<p><a href=\"http:\/\/arxiv.org\/abs\/1206.5533\" target=\"_blank\" rel=\"nofollow\">Gradient based training for Deep Architechture<\/a><\/p>\n<p>&nbsp;<\/p>\n<h2>End Notes<\/h2>\n<p>By now, I\u2019m sure you have a lot of work carved out for yourself. I found them intimidating initially, but these videos and blogs totally helped me to regain my confidence. As said above, these are free resources and can be accessible from anywhere. If you are a beginner, I\u2019d recommend you to start with Machine Learning course by Andrew Ng and read through\u00a0blogs too.<\/p>\n<p>I\u2019ve tried to provide the best possible resources available on these topics at present. As mentioned before, I am not an expert on neural networks and machine learning (yet)! So it is quite possible that I missed out on some useful resource.\u00a0Did I miss out any useful resource? May be! Please share your views \/ suggestions in the comments section below.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>By Manish Saraswat Source: http:\/\/www.analyticsvidhya.c &hellip; <a href=\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network\" class=\"more-link\">\u7ee7\u7eed\u9605\u8bfb<span class=\"screen-reader-text\">\u201cFree Resources for Beginners on Deep Learning and Neural Network\u201d<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[3],"tags":[55,77,56],"translation":{"provider":"WPGlobus","version":"2.12.2","language":"zh","enabled_languages":["en","zh"],"languages":{"en":{"title":true,"content":true,"excerpt":false},"zh":{"title":true,"content":false,"excerpt":false}}},"jetpack_publicize_connections":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Free Resources for Beginners on Deep Learning and Neural Network - \u8f6f\u4ef6\u542f\u793a\u5f55<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Free Resources for Beginners on Deep Learning and Neural Network - \u8f6f\u4ef6\u542f\u793a\u5f55\" \/>\n<meta property=\"og:url\" content=\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network\" \/>\n<meta property=\"og:site_name\" content=\"\u8f6f\u4ef6\u542f\u793a\u5f55\" \/>\n<meta property=\"article:published_time\" content=\"2016-05-07T21:47:53+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png?resize=115%2C122\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"11 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network\",\"url\":\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network\",\"name\":\"Free Resources for Beginners on Deep Learning and Neural Network - \u8f6f\u4ef6\u542f\u793a\u5f55\",\"isPartOf\":{\"@id\":\"http:\/\/blog.softwareclues.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#primaryimage\"},\"image\":{\"@id\":\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#primaryimage\"},\"thumbnailUrl\":\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png?resize=115%2C122\",\"datePublished\":\"2016-05-07T21:47:53+00:00\",\"dateModified\":\"2016-05-07T21:47:53+00:00\",\"author\":{\"@id\":\"http:\/\/blog.softwareclues.com\/#\/schema\/person\/4c47e4e97a658930b6c0e90f4a4eda82\"},\"breadcrumb\":{\"@id\":\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#primaryimage\",\"url\":\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png?resize=115%2C122\",\"contentUrl\":\"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png?resize=115%2C122\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"http:\/\/blog.softwareclues.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Free Resources for Beginners on Deep Learning and Neural Network\"}]},{\"@type\":\"WebSite\",\"@id\":\"http:\/\/blog.softwareclues.com\/#website\",\"url\":\"http:\/\/blog.softwareclues.com\/\",\"name\":\"\u8f6f\u4ef6\u542f\u793a\u5f55\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"http:\/\/blog.softwareclues.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"http:\/\/blog.softwareclues.com\/#\/schema\/person\/4c47e4e97a658930b6c0e90f4a4eda82\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"http:\/\/blog.softwareclues.com\/#\/schema\/person\/image\/\",\"url\":\"http:\/\/2.gravatar.com\/avatar\/e4fb391d9f5bb29583ed9579324a5e17?s=96&d=mystery&r=g\",\"contentUrl\":\"http:\/\/2.gravatar.com\/avatar\/e4fb391d9f5bb29583ed9579324a5e17?s=96&d=mystery&r=g\",\"caption\":\"Editorial Team\"},\"url\":\"http:\/\/blog.softwareclues.com\/zh\/author\/admin\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Free Resources for Beginners on Deep Learning and Neural Network - \u8f6f\u4ef6\u542f\u793a\u5f55","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network","og_locale":"zh_CN","og_type":"article","og_title":"Free Resources for Beginners on Deep Learning and Neural Network - \u8f6f\u4ef6\u542f\u793a\u5f55","og_url":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network","og_site_name":"\u8f6f\u4ef6\u542f\u793a\u5f55","article_published_time":"2016-05-07T21:47:53+00:00","og_image":[{"url":"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png?resize=115%2C122"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"Editorial Team","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"11 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network","url":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network","name":"Free Resources for Beginners on Deep Learning and Neural Network - \u8f6f\u4ef6\u542f\u793a\u5f55","isPartOf":{"@id":"http:\/\/blog.softwareclues.com\/#website"},"primaryImageOfPage":{"@id":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#primaryimage"},"image":{"@id":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#primaryimage"},"thumbnailUrl":"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png?resize=115%2C122","datePublished":"2016-05-07T21:47:53+00:00","dateModified":"2016-05-07T21:47:53+00:00","author":{"@id":"http:\/\/blog.softwareclues.com\/#\/schema\/person\/4c47e4e97a658930b6c0e90f4a4eda82"},"breadcrumb":{"@id":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network"]}]},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#primaryimage","url":"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png?resize=115%2C122","contentUrl":"http:\/\/i2.wp.com\/www.analyticsvidhya.com\/wp-content\/uploads\/2015\/11\/11.png?resize=115%2C122"},{"@type":"BreadcrumbList","@id":"http:\/\/blog.softwareclues.com\/zh\/free-resources-for-beginners-on-deep-learning-and-neural-network#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"http:\/\/blog.softwareclues.com\/"},{"@type":"ListItem","position":2,"name":"Free Resources for Beginners on Deep Learning and Neural Network"}]},{"@type":"WebSite","@id":"http:\/\/blog.softwareclues.com\/#website","url":"http:\/\/blog.softwareclues.com\/","name":"\u8f6f\u4ef6\u542f\u793a\u5f55","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http:\/\/blog.softwareclues.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"zh-Hans"},{"@type":"Person","@id":"http:\/\/blog.softwareclues.com\/#\/schema\/person\/4c47e4e97a658930b6c0e90f4a4eda82","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"http:\/\/blog.softwareclues.com\/#\/schema\/person\/image\/","url":"http:\/\/2.gravatar.com\/avatar\/e4fb391d9f5bb29583ed9579324a5e17?s=96&d=mystery&r=g","contentUrl":"http:\/\/2.gravatar.com\/avatar\/e4fb391d9f5bb29583ed9579324a5e17?s=96&d=mystery&r=g","caption":"Editorial Team"},"url":"http:\/\/blog.softwareclues.com\/zh\/author\/admin"}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/paLJfj-4v","jetpack-related-posts":[],"_links":{"self":[{"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/posts\/279"}],"collection":[{"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/comments?post=279"}],"version-history":[{"count":2,"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/posts\/279\/revisions"}],"predecessor-version":[{"id":281,"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/posts\/279\/revisions\/281"}],"wp:attachment":[{"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/media?parent=279"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/categories?post=279"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/blog.softwareclues.com\/zh\/wp-json\/wp\/v2\/tags?post=279"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}