Skip to content

The initialization of Category Embedding #12

Description

@LyapunovStability

Hello:
This is excellent work! Thank you for sharing it. Can I confirm if the category embedding is randomly initialized and fully trainable during training? For zero-shot classification, I believe it is initialized and fixed for continuously incoming samples.

Additionally, have you experimented with irregular time series data? I think it is interesting to explore if UnitTS also performs well in MIMIC-III or Physionet2012 datasets.

Activity

  1. gasvn commented on Apr 23, 2024

    @gasvn
    Member

    Yes, in current version, the category embedding is randomly initialized. If you want to do zero-shot classifiction, you can gather a few sample from each class and get the everaged embedding as the category embedding.

    We haven't working on the irregular time series data. We will try it in our future work. Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions