On Optimizing for Optimal Optimization