Compare with OpenAI Baselines

OpenAI baselines (https://github.com/openai/baselines)

• https://github.com/openai/baselines/blob/master/baselines/deepq/replay_buffer.py
• https://github.com/openai/baselines/blob/master/baselines/her/replay_buffer.py