As far as I understand there is no quick magic algorithm to find them: you train... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

iXce on May 21, 2019 | parent | context | favorite | on: Notes on Weight Initialization for Deep Neural Net...

As far as I understand there is no quick magic algorithm to find them: you train the full architecture as usual the long and hard way, then you identify the right subnetwork and you can retrain faster from the architecture and initialization of just this subnetwork

L2R on May 22, 2019 [–]

Based off of the results, you have to train a larger number of architectures to identify the right subnetwork.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact