Do not allow infinity and nans as hyper-parameter bounds