Compre with tf.models

https://github.com/tensorflow/models/blob/master/research/pcl_rl/replay_buffer.py