Ref: https://www.jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf This paper shows empirically and theoretically that randomly chosen trials are more efficient for hyper-parameter optimization than trials on a grid.