{"id":102,"date":"2017-06-01T08:21:54","date_gmt":"2017-06-01T08:21:54","guid":{"rendered":"http:\/\/bskog.com\/ai\/?p=102"},"modified":"2017-06-01T08:21:54","modified_gmt":"2017-06-01T08:21:54","slug":"deep-learning-school","status":"publish","type":"post","link":"http:\/\/bskog.com\/ai\/2017\/06\/01\/deep-learning-school\/","title":{"rendered":"Deep Learning School"},"content":{"rendered":"<p>Here you can watch lectures from the <a href=\"http:\/\/videolectures.net\/deeplearning2016_montreal\/\" target=\"_blank\" rel=\"noopener noreferrer\">2016 Deep Learning Summer School<\/a>\u00a0in Montreal.<\/p>\n<p>Course excerpt:<\/p>\n<p>Deep neural networks that learn to represent data in multiple layers of increasing abstraction have dramatically improved the state-of-the-art for speech recognition, object recognition, object detection, predicting the activity of drug molecules, and many other tasks. Deep learning discovers intricate structure in large datasets by building distributed representations, either via supervised, unsupervised or reinforcement learning.<\/p>\n<p><a href=\"https:\/\/sites.google.com\/site\/deeplearningsummerschool2016\/home\" target=\"_blank\" rel=\"noopener noreferrer\">The Deep Learning Summer School 2016<\/a> is aimed at graduate students and industrial engineers and researchers who already have some basic knowledge of machine learning (and possibly but not necessarily of deep learning) and wish to learn more about this rapidly growing field of research.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/sites.google.com\/site\/deeplearningsummerschool2016\/schedule\" target=\"_blank\" rel=\"noopener noreferrer\">Here<\/a> is the schedule in which you could view the presentations<\/p>\n<p>table.schedule td {<br \/>  vertical-align: top;<br \/>  padding: 10px;<br \/>}<\/p>\n<table class=\"schedule\" border=\"1\" cellspacing=\"0\">\n<tbody>\n<tr>\n<td>\u00a001\/08\/2016<\/td>\n<td>\u00a002\/08\/2016<\/td>\n<td>\u00a003\/08\/2016<\/td>\n<td>\u00a004\/08\/2016<\/td>\n<td>\u00a005\/08\/2016<\/td>\n<td>\u00a006\/08\/2016<\/td>\n<td>\u00a007\/08\/2016<\/td>\n<\/tr>\n<tr>\n<td>9:00<br \/>\n10:30<\/td>\n<td>\n<div><strong>Doina<br \/>\nPrecup<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_precup_machine_learning\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Machine Learning<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Rob<\/strong><\/div>\n<div><strong>Fergus<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_fergus_neural_networks\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Introduction<br \/>\nto CNNs<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Yoshua<\/strong><\/div>\n<div><strong>Bengio<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_bengio_neural_networks\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>RNNs<\/em><\/a><\/div>\n<\/td>\n<td><strong>Kyunghyun<\/strong><\/p>\n<div><strong>Cho<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_cho_language_understanding\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Natural<br \/>\nLanguage<br \/>\nUnderstanding<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Joelle<\/strong><\/div>\n<div><strong>Pineau<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_pineau_reinforcement_learning\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Reinforcement<br \/>\nLearning<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Ruslan<\/strong><\/div>\n<div><strong>Salakhutdinov<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_salakhutdinov_generative_models\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Deep Generative<br \/>\nModels I<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Bruno<\/strong><\/div>\n<div><strong>Olshausen<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_olshausen_beyond_inspiration\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Comp.<\/em><\/a><\/div>\n<div><em>Neuro I<\/em><\/div>\n<\/td>\n<\/tr>\n<tr>\n<td>10:30<br \/>\n11:00<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<\/tr>\n<tr>\n<td>11:00<br \/>\n12:30<\/td>\n<td>\n<div><strong>Hugo Larochelle<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_larochelle_neural_networks\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Neural Networks I<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Antonio Torralba<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_torralba_learning_see\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Learning<br \/>\nto See<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Sumit<br \/>\nChopra<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_chopra_attention_memory\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Attention<br \/>\nand Memory<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Edward Grefenstette<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_grefenstette_augmented_rnn\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Beyond Seq2Seq<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Pieter<br \/>\nAbbeel<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_abbeel_deep_reinforcement\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Deep RL<\/em><\/a><\/div>\n<\/td>\n<td>\n<div><strong>Shakir<br \/>\nMohamed<\/strong><\/div>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_mohamed_generative_models\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Building Machines that Imagine and Reason<\/em><\/a><\/div>\n<\/td>\n<td><strong>Surya<br \/>\nGanguli<\/strong><\/p>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_ganguli_theoretical_neuroscience\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Comp.\u00a0Neuro II<\/em><\/a><\/div>\n<div>and Deep Learning Theory<\/div>\n<\/td>\n<\/tr>\n<tr>\n<td>12:30<br \/>\n14:30<\/td>\n<td>Lunch<\/td>\n<td>Lunch<\/td>\n<td>Lunch<a href=\"https:\/\/www.facebook.com\/events\/646599912174028\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">WiDL event<\/a><\/td>\n<td>Lunch<\/td>\n<td>Lunch<\/td>\n<td>Lunch<\/td>\n<td>Lunch<\/td>\n<\/tr>\n<tr>\n<td>14:30<br \/>\n16:00<\/td>\n<td>\n<div><strong>Hugo Larochelle<\/strong><\/div>\n<div><\/div>\n<p><em><a href=\"http:\/\/videolectures.net\/deeplearning2016_larochelle_neural_networks\/\" target=\"_blank\" rel=\"noopener noreferrer\">Neural Networks II<\/a>\u00a0(click on part II)<\/em><\/td>\n<td><strong>Alex Wiltschko<\/strong><br \/>\n<a href=\"http:\/\/videolectures.net\/deeplearning2016_wiltschko_torch\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Torch I<\/em><\/a><\/td>\n<td>\n<div><strong>Jeff<br \/>\nDean<\/strong><\/div>\n<div>\n<p><a href=\"http:\/\/videolectures.net\/deeplearning2016_dean_deep_learning\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Large Scale Deep Learning\u00a0<\/em><\/a><\/p>\n<\/div>\n<p><a href=\"http:\/\/videolectures.net\/deeplearning2016_dean_deep_learning\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>&amp; TensorFlow<\/em><\/a><\/td>\n<td><strong>Julie Bernauer<br \/>\n(NVIDIA)<br \/>\n<\/strong><a href=\"http:\/\/videolectures.net\/deeplearning2016_bernauer_olson_deep_learning\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>GPU programming with CUDA<\/em><\/a><\/td>\n<td><strong>Joelle, Pieter &amp; Doina<br \/>\n<\/strong><a href=\"http:\/\/videolectures.net\/deeplearning2016_pineau_advanced_topics\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Advanced Topics in RL<\/em><\/a><\/td>\n<td><strong>Contributed<br \/>\ntalks<\/strong><br \/>\nSession 4<\/td>\n<td><strong>Contributed<br \/>\ntalks<\/strong><br \/>\nSession 4<\/td>\n<\/tr>\n<tr>\n<td>16:00<br \/>\n16:30<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<td>Coffee<br \/>\nBreak<\/td>\n<\/tr>\n<tr>\n<td>16:30<br \/>\n18:00<\/td>\n<td><strong>Pascal<br \/>\nLamblin<\/strong><\/p>\n<div><a href=\"http:\/\/videolectures.net\/deeplearning2016_lamblin_theano\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Theano I<\/em><\/a><\/div>\n<\/td>\n<td><strong>Practical<br \/>\nSession<br \/>\n<\/strong>\u00a0<strong>Alex Wiltschko<br \/>\n<\/strong><em>(Torch)<\/em><strong><br \/>\n<\/strong><\/p>\n<div><\/div>\n<p><strong>Fr\u00e9d\u00e9ric Bastien<\/strong><br \/>\n<em>(Theano)<\/em><\/td>\n<td><strong>Jeff<br \/>\nDean<\/strong><\/p>\n<div>\n<div>\n<p><a href=\"http:\/\/videolectures.net\/deeplearning2016_dean_deep_learning\/\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Large Scale Deep Learning\u00a0<\/em><\/a><\/p>\n<p>&nbsp;<\/p>\n<\/div>\n<p><em><a href=\"http:\/\/videolectures.net\/deeplearning2016_dean_deep_learning\/\" target=\"_blank\" rel=\"noopener noreferrer\">&amp; TensorFlow<\/a>\u00a0(click on part II)<\/em><\/p>\n<\/div>\n<\/td>\n<td><strong>Contributed<br \/>\ntalks<\/strong><br \/>\nSession 1<\/td>\n<td><strong>Contributed<br \/>\ntalks<\/strong><br \/>\nSession 2<\/td>\n<td><strong>Contributed<br \/>\nPosters<\/strong><br \/>\nSession 1<\/td>\n<td><strong>Contributed<br \/>\nPosters<\/strong><br \/>\nSession 2<\/td>\n<\/tr>\n<tr>\n<td>\u00a0Evening<\/td>\n<td><a href=\"https:\/\/sites.google.com\/site\/deeplearningsummerschool2016\/opening-reception\" target=\"_blank\" rel=\"noopener noreferrer\">Opening Reception<\/a><br \/>\n(18:00-20:30)<br \/>\n<em>&#8212; by &#8212;<br \/>\n<a href=\"http:\/\/imagia.com\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Imagia<\/a><\/em><\/td>\n<td>\u00a0<a href=\"https:\/\/sites.google.com\/site\/deeplearningsummerschool2016\/maluuba-happy-hour\" target=\"_blank\" rel=\"noopener noreferrer\">Happy Hour<\/a><br \/>\n(18:45-22:30)<br \/>\nbuses at 18:30<br \/>\n<em>&#8212; by &#8212;<br \/>\n<a href=\"http:\/\/www.maluuba.com\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Maluuba<\/a><\/em><\/td>\n<td><a href=\"https:\/\/sites.google.com\/site\/deeplearningsummerschool2016\/cdl-happy-hour\" target=\"_blank\" rel=\"noopener noreferrer\">Happy Hour<\/a><br \/>\n(18:30-20:30)<br \/>\n<em>&#8212; by &#8212;<br \/>\n<a href=\"http:\/\/www.creativedestructionlab.com\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Creative Destruction Lab<\/a> <\/em><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<hr \/>\n<p>(or you can just follow them in consecutive order at <a href=\"http:\/\/videolectures.net\/deeplearning2016_montreal\/\">http:\/\/videolectures.net\/deeplearning2016_montreal\/<\/a> since they seem to be in the order they were presented.)<\/p>\n<h3>Contributed talks:<\/h3>\n<p>12:55 <a href=\"http:\/\/videolectures.net\/deeplearning2016_das_neural_networks\/\" target=\"_blank\" rel=\"noopener noreferrer\">Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks<\/a><br \/>\nRajarshi Das<\/p>\n<p>14:29 <a href=\"http:\/\/videolectures.net\/deeplearning2016_goyal_new_algorithm\/\" target=\"_blank\" rel=\"noopener noreferrer\">Professor Forcing: A New Algorithm for Training Recurrent Networks<\/a><br \/>\nAnirudh Goyal<\/p>\n<p>10:59 <a href=\"http:\/\/videolectures.net\/deeplearning2016_maharaj_zoneout\/\" target=\"_blank\" rel=\"noopener noreferrer\">Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations<\/a><br \/>\nTegan Maharaj<\/p>\n<p>18:58 <a href=\"http:\/\/videolectures.net\/deeplearning2016_wehbe_deep_multiview\/\" target=\"_blank\" rel=\"noopener noreferrer\">Deep multi-view representation learning of brain responses to natural stimuli<\/a><br \/>\nLeila Wehbe<\/p>\n<p>14:49 <a href=\"http:\/\/videolectures.net\/deeplearning2016_foerster_learning_communicate\/\" target=\"_blank\" rel=\"noopener noreferrer\">Learning to Communicate with Deep Multi\u00ad-Agent Reinforcement Learning<\/a><br \/>\nJakob Foerster<\/p>\n<p>13:57 <a href=\"http:\/\/videolectures.net\/deeplearning2016_abdolmaleki_relative_entropy\/\" target=\"_blank\" rel=\"noopener noreferrer\">Model-Based Relative Entropy Stochastic Search<\/a><br \/>\nAbbas Abdolmaleki<\/p>\n<p>16:33 <a href=\"http:\/\/videolectures.net\/deeplearning2016_perolat_learning_nash\/\" target=\"_blank\" rel=\"noopener noreferrer\">Learning Nash Equilibrium for General-Sum Markov Games from Batch Dat<\/a><br \/>\nJulien Pe\u0301rolat<\/p>\n<p>20:30 <a href=\"http:\/\/videolectures.net\/deeplearning2016_wen_network_based\/\" target=\"_blank\" rel=\"noopener noreferrer\">A Network-based End-to-End Trainable Task-oriented Dialogue System<\/a><br \/>\nTsung-Hsien Wen<\/p>\n<p>15:28<a href=\"http:\/\/videolectures.net\/deeplearning2016_putzky_inference_learning\/\" target=\"_blank\" rel=\"noopener noreferrer\"> Inference Learning<\/a><br \/>\nPatrick Putzky<\/p>\n<p>16:45 <a href=\"http:\/\/videolectures.net\/deeplearning2016_gulrajani_pixel_cnn\/\" target=\"_blank\" rel=\"noopener noreferrer\">Variational Autoencoders with PixelCNN Decoders<\/a><br \/>\nIshaan Gulrajani<\/p>\n<p>13:33<a href=\"http:\/\/videolectures.net\/deeplearning2016_cote_boltzmann_machine\/\" target=\"_blank\" rel=\"noopener noreferrer\"> An Infinite Restricted Boltzmann Machine<\/a><br \/>\nMarc-Alexandre C\u00f4t\u00e9<\/p>\n<p>15:15 <a href=\"http:\/\/videolectures.net\/deeplearning2016_chicco_neural_network\/\" target=\"_blank\" rel=\"noopener noreferrer\">Deep siamese neural network for prediction of long-range interactions in chromatin<\/a><br \/>\nDavide Chicco<\/p>\n<p>14:09 <a href=\"http:\/\/videolectures.net\/deeplearning2016_sun_beam_search\/\" target=\"_blank\" rel=\"noopener noreferrer\">Beam Search Message Passing in Bidirectional RNNs: Applications to Fill-in-the-Blank Image Captioning<\/a><br \/>\nQing Sun<\/p>\n<p>18:40 <a href=\"http:\/\/videolectures.net\/deeplearning2016_agrawal_answering_models\/\" target=\"_blank\" rel=\"noopener noreferrer\">Analyzing the Behavior of Deep Visual Question Answering Models<\/a><br \/>\nAishwarya Agrawal<\/p>\n<p>13:55 <a href=\"http:\/\/videolectures.net\/deeplearning2016_honari_recombinator_networks\/\" target=\"_blank\" rel=\"noopener noreferrer\">Recombinator Networks: Learning Coarse-to-Fine Feature Aggregation<\/a><br \/>\nSina Honari<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Here you can watch lectures from the 2016 Deep Learning Summer School\u00a0in Montreal. Course excerpt: Deep neural networks that learn to represent data in multiple layers of increasing abstraction have dramatically improved the state-of-the-art for speech recognition, object recognition, object detection, predicting the activity of drug molecules, and many other tasks. Deep learning discovers intricate &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/bskog.com\/ai\/2017\/06\/01\/deep-learning-school\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Deep Learning School&#8221;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9,11,16],"tags":[],"class_list":["post-102","post","type-post","status-publish","format-standard","hentry","category-courses","category-deep-learning","category-learning-material"],"_links":{"self":[{"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/posts\/102","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/comments?post=102"}],"version-history":[{"count":0,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/posts\/102\/revisions"}],"wp:attachment":[{"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/media?parent=102"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/categories?post=102"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/tags?post=102"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}