Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request] Better support for action masking for vectorized environments #68

Closed
BolunDai0216 opened this issue Apr 15, 2022 · 3 comments
Closed

[Feature Request] Better support for action masking for vectorized environments #68

BolunDai0216 opened this issue Apr 15, 2022 · 3 comments
Labels
duplicate This issue or pull request already exists enhancement New feature or request help wanted Help from contributors is needed

Comments

@BolunDai0216
Copy link

Motivation
Stable-baselines3 (SB3) has introduced support for action masking (see here), which is a great feature. However, this API requires the user to provide an ActionMasker wrapper. The issue is that some environments (e.g., gym-microrts, pettingzoo) directly provides a vectorized interface, so there is no chance to apply this ActionMasker.

Feature
Extending MaskablePPO to work with vectorized environments natively. With this extension, SB3 + PPO + Mask can work in gym-microrts and pettingzoo.
@BolunDai0216
Copy link
Author

@vwxyzjn

@araffin
Copy link
Member

araffin commented Apr 16, 2022

Hello,
this is a duplicate of #49 (comment)

we would apppreciate a PR that solves this issue ;)

@araffin araffin added duplicate This issue or pull request already exists help wanted Help from contributors is needed enhancement New feature or request labels Aug 25, 2023
@araffin
Copy link
Member

araffin commented Mar 31, 2025

closing in favor of #279

@araffin araffin closed this as completed Mar 31, 2025
@araffin araffin mentioned this issue Mar 31, 2025
Open
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
duplicate This issue or pull request already exists enhancement New feature or request help wanted Help from contributors is needed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@araffin @BolunDai0216