Get the neural network weights out of a Tensorflow `Graph` Question: I’m using RLlib to train a reinforcement learning policy (PPO algorithm). I want to see the weights in the neural network underlying the policy. After digging through RLlib’s PPO object, I found the TensorFlow Graph object. I thought that I would find the weights …
Ray monitoring fails when binding to empty address Question: I’m learning to use RLlib. I’ve been running it in my debugger on an example script, and it works, but for some reason I get an error message about the monitoring service failing. This is the traceback: File "/home/ramrachum/.venvs/ray_env/lib/python3.10/site-packages/ray/autoscaler/_private/monitor.py", line 600, in <module> monitor = Monitor( …
Printing model summaries for rllib models Question: I have not seen anything in the rllib documentation that would allow me to print a quick summary of the model like print(model.summary()) in keras. I tried using tf-slim and variables = tf.compat.v1.model_variables() slim.model_analyzer.analyze_vars(variables, print_info=True) to get a rough idea for tensorflow models, but this found no variables …
