Improved Model Design And Training Techniques For Efficient Dnn Inference