fix(ppo): 修正日志概率维度与状态张量格式

Browse Source

修复 replay buffer 中 log_probs 的维度错误，从 (buffer_size, action_dim) 改为 buffer_size
修正训练时状态张量格式，从 (N, H, W, C) 转换为 (N, C, H, W)
更新 collect_rollout 返回观测值并修正 log_prob 计算
添加项目配置文件和训练曲线生成脚本

...

This commit is contained in:

刘航宇

2026-04-30 20:30:40 +08:00

parent d353133b31

commit b32490ae03

19 changed files with 185 additions and 22 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

强化学习个人项目报告/training_curves.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 127 KiB