Building from Scratch vs Transfer Learning

The first strategic decision after choosing deep learning: train a new network from zero or stand on the shoulders of pretrained giants.