End-To-End Inference Optimization For Deep Learning-Based Image Upsampling Networks