Keras-RL can be installed by pip. However, I recommend installing it from the project GitHub repo, as the code might be slightly newer. To do so, simply clone the repo and run python setup.py install as follows:

git clone https://github.com/matthiasplappert/keras-rl.git
cd keras-rl
python setup.py install