Skip to content

Details about the code #4

Description

@Hon-Chen

Really solid work!
I noticed that the proportion of non-zero parameters was counted after quantization. What is the motivation for this?

quant_sequential(model, dataloader, device)
for n, p in model.named_parameters():
    print(n, torch.mean((p == 0).float()))
    if "fc2" in n:
        break

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions