Inference From Limited Observations In Statistical, Dynamical, And Functional Problems