{"id":490,"date":"2018-08-23T17:57:40","date_gmt":"2018-08-23T17:57:40","guid":{"rendered":"http:\/\/bskog.com\/ai\/?p=490"},"modified":"2018-08-23T17:57:40","modified_gmt":"2018-08-23T17:57:40","slug":"train-imagenet-18-minutes","status":"publish","type":"post","link":"http:\/\/bskog.com\/ai\/2018\/08\/23\/train-imagenet-18-minutes\/","title":{"rendered":"Train Imagenet in 18 minutes"},"content":{"rendered":"<p>Jeremy Howard et al, at fast.ai has done what one might consider a huge breakthrough in regards to training deep learning models quickly.<\/p>\n<p>They managed to train Imagenet in 18 minutes using publicly available resources that only cost them $40 to run!<\/p>\n<p>this was their method:<\/p>\n<ul>\n<li>fast.ai\u2019s progressive resizing for classification, and rectangular image validation<\/li>\n<li>NVIDIA\u2019s NCCL with PyTorch\u2019s all-reduce<\/li>\n<li>Tencent\u2019s weight decay tuning; a variant of Google Brain\u2019s dynamic batch sizes, gradual learning rate warm-up (Goyal et al 2018, and Leslie Smith 2018).<\/li>\n<li>ResNet-50 architecture<\/li>\n<li>SGD with momentum.<\/li>\n<\/ul>\n<p><a href=\"http:\/\/www.fast.ai\/2018\/08\/10\/fastai-diu-imagenet\/\">http:\/\/www.fast.ai\/2018\/08\/10\/fastai-diu-imagenet\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Jeremy Howard et al, at fast.ai has done what one might consider a huge breakthrough in regards to training deep learning models quickly. They managed to train Imagenet in 18 minutes using publicly available resources that only cost them $40 to run! this was their method: fast.ai\u2019s progressive resizing for classification, and rectangular image validation &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/bskog.com\/ai\/2018\/08\/23\/train-imagenet-18-minutes\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Train Imagenet in 18 minutes&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-490","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/posts\/490","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/comments?post=490"}],"version-history":[{"count":1,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/posts\/490\/revisions"}],"predecessor-version":[{"id":491,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/posts\/490\/revisions\/491"}],"wp:attachment":[{"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/media?parent=490"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/categories?post=490"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bskog.com\/ai\/wp-json\/wp\/v2\/tags?post=490"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}