An Integrated Neural Network And Optimization Framework For The Inverse Design Of Optical Devices