Skip to content

Group statistics aren't being calculatedΒ #3308

@ADH-LukeBollam

Description

@ADH-LukeBollam

πŸ› Bug

I record some final statistics into aim so I could compare results across experiments. These stats are measured outside training, so simply have a value at step 0 for each model. The charts look like this:

Image

Even though the charts have multiple values, I'm not getting any group stats

Image

To reproduce

This is how I'm logging these final stats:

    aim_logger.track(tp, name=f'{args.metric} True Positive', context={"subset": "test"})
    aim_logger.track(tn, name=f'{args.metric} True Negative', context={"subset": "test"})
    aim_logger.track(fp, name=f'{args.metric} False Positive', context={"subset": "test"})
    aim_logger.track(fn, name=f'{args.metric} False Negative', context={"subset": "test"})

    aim_logger.track(TotalErrors, name=f'{args.metric} TotalErrors', context={"subset": "test"})
    aim_logger.track(F1Score, name=f'{args.metric} F1Score', context={"subset": "test"})
    aim_logger.track(Precision, name=f'{args.metric} Precision', context={"subset": "test"})
    aim_logger.track(Recall, name=f'{args.metric} Recall', context={"subset": "test"})
    aim_logger.track(Specificity, name=f'{args.metric} Specificity', context={"subset": "test"})
    aim_logger.track(Accuracy, name=f'{args.metric} Accuracy', context={"subset": "test"})

Expected behavior

Environment

  • Aim Version 3.27.0
  • Python version 3.9
  • pip version
  • OS Ubuntu

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is neededtype / bugIssue type: something isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions