You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I observed that the schedule_all function loads the pipeline every time from YAML. This causes a fair amount of CPU misuse. The option makes sense in development as new changes in yaml can be instantly picked up. But we should cache the results in production as there won't be any yaml changes. New changes will come via redeployment only
We can add a LRU Cache on the function which is loading the file and parsing into yaml. We can let users configure the cache size. We can also keep the max as the number of pipelines in the project