Issues

• [Bug] gSDE+tanh reconstruction changes PPO replay gradients despite a unit initial ratio

  LLM generated
  DLR-RM/stable-baselines3#2285 · Filter by author Ibrahimkhan4real opened on Sep 10, 2026
  2

• [Bug]: Monitor with override_existing=False writes no header when the file is new

  DLR-RM/stable-baselines3#2282 · Filter by author yurekami opened on Sep 4, 2026
  1

• [Question] Why does VecNormalize normalize rewards by returns instead of rewards?

  duplicatequestion
  DLR-RM/stable-baselines3#2279 · Filter by author pstahlhofen opened on Aug 25, 2026

• [Bug]: VecEnv sub-environment seeds (seed + i) overlap across runs with adjacent base seeds

  bug
  DLR-RM/stable-baselines3#2268 · Filter by author abaisero opened on Jul 17, 2026
  3

• [Question] why self.env.reset doesn't return an obs variable in FireResetEnv wrapper reset function, while it does in EpisodicLifeEnv and NoopResetEnv wrapper reset function

  question
  DLR-RM/stable-baselines3#2256 · Filter by author RongpingZhou opened on May 15, 2026

• [Bug]: Render Tests Failure (SDL_RumbleMotor Deps Duplicate)

  bug
  DLR-RM/stable-baselines3#2255 · Filter by author jvoids opened on May 12, 2026
  1

• [Bug]: Left navigation moves when right content scrolls.

  documentation
  DLR-RM/stable-baselines3#2245 · Filter by author dvcodebase opened on Apr 19, 2026
  3

• [Question] question title

  question
  DLR-RM/stable-baselines3#2238 · Filter by author jvoids opened on Apr 7, 2026
  2

• [Feature Request] Allow subclassing ReplayBufferSamples and RolloutBufferSamples

  enhancement
  DLR-RM/stable-baselines3#2202 · Filter by author franco-ruggeri opened on Dec 10, 2025
  3

• [Feature Request] Natively support training and inference on different PyTorch devices

  documentationenhancement
  DLR-RM/stable-baselines3#2194 · Filter by author ogiarch opened on Nov 23, 2025
  3

• [Bug]: ReplayBuffer cannot detect the real memory constraints in Kubernetes.

  check the checklistdocumentation
  DLR-RM/stable-baselines3#2185 · Filter by author LarryLiZimo opened on Nov 1, 2025
  7

• Question about multiple FlattenExtractor components in ActorCriticPolicy

  documentationquestion
  DLR-RM/stable-baselines3#2165 · Filter by author yeknafar opened on Aug 4, 2025
  3

• [Question] why SAC train method updates the target every steps?

  question
  DLR-RM/stable-baselines3#2158 · Filter by author angel-ayala opened on Jul 23, 2025
  2

• [question] current_rewards in evaluations.py

  question
  DLR-RM/stable-baselines3#2145 · Filter by author annimukherjee opened on Jun 10, 2025
  1

• BetaDistribution policy for bounded continuous action spaces to avoid Gaussian clipping bias and improve training stability

  enhancement
  DLR-RM/stable-baselines3#2142 · Filter by author lukaskiss222 opened on May 26, 2025
  4

• [Question] DQN save model taking up large hard disk space

  custom gym envmore information neededquestion
  DLR-RM/stable-baselines3#2141 · Filter by author WreckItTim opened on May 20, 2025
  2

• [Bug]: CUDA memory explodes until full

  custom gym env
  DLR-RM/stable-baselines3#2135 · Filter by author jingyang-huang opened on May 11, 2025
  1

• [Bug]: VecVideoRecorder RAM USAGE

  question
  DLR-RM/stable-baselines3#2134 · Filter by author vicbentuupc opened on May 10, 2025
  1

• [Feature Request] request title

  enhancement
  DLR-RM/stable-baselines3#2131 · Filter by author Mahsarnzh opened on May 6, 2025

• [Bug]: SubprocVecEnv ignores specified CUDA device and uses GPU 0

  custom gym envopenai gym
  DLR-RM/stable-baselines3#2116 · Filter by author tutututudodo opened on Apr 8, 2025
  1

• [Bug]: is_image_space works poorly with Gymnasium's FrameStackObservation

  bugdocumentationhelp wanted
  DLR-RM/stable-baselines3#2090 · Filter by author fracapuano opened on Feb 25, 2025
  6

• [Bug]: Video upload to wandb broken since 2.4.0

  bugmore information needed
  DLR-RM/stable-baselines3#2055 · Filter by author OliverUrbann opened on Dec 13, 2024
  9

• [Feature Request] add_scalars to wirte func in TensorBoardOutputFormat in logger

  enhancement
  DLR-RM/stable-baselines3#1994 · Filter by author shimonShouei opened on Aug 19, 2024
  2

• [Bug]: Higher memory usage on sequential training runs

  bug
  DLR-RM/stable-baselines3#1966 · Filter by author NickLucche opened on Jul 9, 2024
  6

• [Bug]: RunningMeanStd overflowing

  bugcheck the checklist
  DLR-RM/stable-baselines3#1953 · Filter by author spiglerg opened on Jun 29, 2024
  1