Code outline:
main.pysets up the options and the top-level call to TRPO.trpo.pycontains the TRPO agent, describing how it gets paths, computes advantages, etc.utils_trpo.pycontains two particular utils ...fxn_approx.pycontains linear and neural network value functions.