[TMM2025] Tackling Ambiguity from Perspective of Uncertainty Inference and Affinity Diversification for Weakly Supervised Semantic Segmentation 
- Our UniA is accepted by TMM 2025.
- All Code, logs, and checkpoints are available now🔥🔥🔥
- If you have any questions, please feel free to leave issues or contact us by zwyang21@m.fudan.edu.cn.
wget http://host.robots.ox.ac.uk/pascal/VOC/voc2012/VOCtrainval_11-May-2012.tarThe augmented annotations are from SBD dataset. The download link of the augmented annotations at
DropBox. After downloading SegmentationClassAug.zip, you should unzip it and move it to VOCdevkit/VOC2012/.
VOCdevkit/
└── VOC2012
├── Annotations
├── ImageSets
├── JPEGImages
├── SegmentationClass
├── SegmentationClassAug
└── SegmentationObjectwget http://images.cocodataset.org/zips/train2014.zip
wget http://images.cocodataset.org/zips/val2014.zipTo generate VOC style segmentation labels for COCO, you could use the scripts provided at this repo, or just download the generated masks from Google Drive.
COCO/
├── JPEGImages
│ ├── train2014
│ └── val2014
└── SegmentationClass
├── train2014
└── val2014Please refer to the requirements.txt.
We incorporate a regularization loss for segmentation. Please refer to the instruction for this python extension.
### train voc
bash run_train.sh scripts/train_voc.py [gpu_number] [master_port] [gpu_device] train_voc
### train coco
bash run_train.sh scripts/train_coco.py [gpu_numbers] [master_port] [gpu_devices] train_coco### eval voc
bash run_evaluate_seg_voc.sh tools/infer_seg_voc.py [gpu_device] [checkpoint_path]
### eval coco
bash run_evaluate_seg_coco.sh tools/infer_seg_coco.py [gpu_number] [master_port] [gpu_device] [checkpoint_path]- Quantitative Results
Semantic performance on VOC and COCO. Logs are available now.
| Dataset | Backbone | Val | Test | Log | Weight |
|---|---|---|---|---|---|
| PASCAL VOC | ViT-B | 74.1 | 73.6 | log | checkpoints |
| MS COCO | ViT-B | 43.2 | - | log | checkpoints |
- Qualitative Results
Please cite our work if you find it helpful to your reseach. 💕
@article{yang2024tackling,
title={Tackling Ambiguity from Perspective of Uncertainty Inference and Affinity Diversification for Weakly Supervised Semantic Segmentation},
author={Yang, Zhiwei and Meng, Yucong and Fu, Kexue and Wang, Shuo and Song, Zhijian},
journal={arXiv preprint arXiv:2404.08195},
year={2024}
}