Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

publish event for resource quota increased for namespace #6226

Open
nikp1172 opened this issue Feb 6, 2025 · 1 comment
Open

publish event for resource quota increased for namespace #6226

nikp1172 opened this issue Feb 6, 2025 · 1 comment
Assignees

Comments

@nikp1172
Copy link

nikp1172 commented Feb 6, 2025

If I deploy a map task (or any task) in a namespace with resource quota enabled. Some pods may cease to becreated (which is fine). But I dont have visibility on why a pod is not getting created. This can be seen in the propeller logs as shown below.

{"json":{"exec_id":"alvhh9jt9s6mr6hk67dx","node":"n0/n5","ns":"nikp-limit-ws","res_ver":"320707768","routine":"worker-2","tasktype":"python-task","wf":"<>:<>:map_task_example.my_map_workflow"},"level":"warning","msg":"Failed to launch job, resource quota exceeded. err: [BackOffError] The operation was attempted but failed, caused by: pods \"alvhh9jt9s6mr6hk67dx-n0-0-n5-3\" is forbidden: exceeded quota: memory-cpu-quota, requested: requests.memory=1500M, used: requests.memory=7500M, limited: requests.memory=8Gi","ts":"2025-02-06T06:49:00Z"}

Would it be possible to publish a k8s event for this?

Copy link

welcome bot commented Feb 6, 2025

Thank you for opening your first issue here! 🛠

@pvditt pvditt self-assigned this Feb 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants