Contact Details

No response

Is your proposal related to a problem?

while prototyping, it is crucial to get an idea of memory consumption of your program and its components.

• max. GPU memory allocated
• current GPU memory allocated

Describe the solution you'd like

Write a minimal example, showing pytorchs provided methods to get current and maximum allocated GPU memory and how to use them in your to identify which substep is the bottleneck.

Describe alternatives you've considered

This is an alternative.

Additional context

This is additional context.