Compare with RLlib: Prioritized Replay Buffer sample

Job #472223818 failed for a10638d6:

The reported issue has already been fixed by another PR.

Waiting new release (probably, 0.8.3)