Hybrid Modeling Framework For Systems With Unmeasured Time-Varying Disturbances: An Application To Buildings