Skip to content

Commit 50c84c3

Browse files
Updated code
1 parent 6042271 commit 50c84c3

File tree

2 files changed

+4
-365
lines changed

2 files changed

+4
-365
lines changed

β€Žsrc/ppo_with_pytorch.pyβ€Ž

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -180,12 +180,12 @@ def loss(self, td: Dict[str, torch.Tensor]):
180180

181181
return policy_loss + v_loss + entropy_loss
182182

183-
StepData = collections.namedtuple(
184-
'StepData',
185-
('observation', 'logits', 'action', 'reward', 'done', 'truncation'))
183+
StepData = collections.namedtuple('StepData', ('observation', 'logits', 'action', 'reward', 'done', 'truncation'))
186184

187185
def sd_map(f: Callable[..., torch.Tensor], *sds) -> StepData:
188-
"""Map a function over each field in StepData."""
186+
"""
187+
Map a function over each field in StepData.
188+
"""
189189
items = {}
190190
keys = sds[0]._asdict().keys()
191191
for k in keys:

β€Žsrc/ppo_with_pytorch.py.679c1aacd60231d3857b1eb635902638.tmpβ€Ž

Lines changed: 0 additions & 361 deletions
This file was deleted.

0 commit comments

Comments
Β (0)