[Enchance] batch size information in readme by Harold-lkk · Pull Request #1778 · open-mmlab/mmocr

Harold-lkk · 2023-03-13T08:32:02Z

No description provided.

codecov · 2023-03-13T08:38:40Z

Codecov Report

Patch coverage: 59.66% and project coverage change: -0.25 ⚠️

Comparison is base (82f81ff) 90.13% compared to head (ca0a5ac) 89.89%.

❗ Current head ca0a5ac differs from pull request most recent head 9d342da. Consider uploading reports for the commit 9d342da to get more accurate results

Additional details and impacted files

@@             Coverage Diff             @@
##           dev-1.x    #1778      +/-   ##
===========================================
- Coverage    90.13%   89.89%   -0.25%     
===========================================
  Files          190      191       +1     
  Lines        11128    11197      +69     
  Branches      1567     1578      +11     
===========================================
+ Hits         10030    10065      +35     
- Misses         790      821      +31     
- Partials       308      311       +3

Flag	Coverage Δ
unittests	`89.89% <59.66%> (-0.25%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
mmocr/datasets/preparers/dumpers/lmdb_dumper.py	`21.33% <21.33%> (ø)`
mmocr/models/textdet/heads/drrg_head.py	`98.83% <33.33%> (-0.78%)`	⬇️
...r/models/textdet/module_losses/drrg_module_loss.py	`95.89% <33.33%> (-1.33%)`	⬇️
mmocr/datasets/preparers/config_generators/base.py	`75.00% <37.50%> (-7.50%)`	⬇️
mmocr/datasets/preparers/parsers/ctw1500_parser.py	`97.61% <97.61%> (ø)`
mmocr/apis/inferencers/base_mmocr_inferencer.py	`89.78% <100.00%> (ø)`
mmocr/apis/inferencers/mmocr_inferencer.py	`90.78% <100.00%> (-0.71%)`	⬇️
...rers/config_generators/textdet_config_generator.py	`95.00% <100.00%> (ø)`
...rs/config_generators/textrecog_config_generator.py	`100.00% <100.00%> (ø)`
...config_generators/textspotting_config_generator.py	`100.00% <100.00%> (ø)`
... and 24 more

... and 2 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

gaotongxiao

Missing SVTR

gaotongxiao · 2023-03-13T09:29:14Z

-| [DBNet_r18](/configs/textdet/dbnet/dbnet_resnet18_fpnc_100k_synthtext.py) | ResNet18 |  SynthText   | 100,000 | [model](https://download.openmmlab.com/mmocr/textdet/dbnet/dbnet_resnet18_fpnc_100k_synthtext/dbnet_resnet18_fpnc_100k_synthtext-2e9bf392.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/dbnet/dbnet_resnet18_fpnc_100k_synthtext/20221214_150351.log) |
+|                                  Method                                   | Backbone | Training set | #iters  |                                          Download                                          | Batch Size |
+| :-----------------------------------------------------------------------: | :------: | :----------: | :-----: | :----------------------------------------------------------------------------------------: | :--------: |
+| [DBNet_r18](/configs/textdet/dbnet/dbnet_resnet18_fpnc_100k_synthtext.py) | ResNet18 |  SynthText   | 100,000 | [model](https://download.openmmlab.com/mmocr/textdet/dbnet/dbnet_resnet18_fpnc_100k_synthtext/dbnet_resnet18_fpnc_100k_synthtext-2e9bf392.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/dbnet/dbnet_resnet18_fpnc_100k_synthtext/20221214_150351.log) |   1xb16    |


Need to change the batch size format to avoid confusion for beginners:
1xb16 -> 1 x 16.

Same for others.

gaotongxiao · 2023-03-13T09:36:24Z

-| [FCENet_r50](/configs/textdet/fcenet/fcenet_resnet50_fpn_1500e_totaltext.py) | ResNet50 |        -         | Totaltext Train | Totaltext Test |  1500   | (1280, 960) |  0.8485   | 0.7810 | 0.8134 | [model](https://download.openmmlab.com/mmocr/textdet/fcenet/fcenet_resnet50_fpn_1500e_totaltext/fcenet_resnet50_fpn_1500e_totaltext-91bd37af.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/fcenet/fcenet_resnet50_fpn_1500e_totaltext/20221219_201107.log) |
+|                      Method                      | Backbone | Pretrained Model |  Training set   |    Test set    | #epochs |  Test size  | Precision | Recall | Hmean  |                      Download                      | Batch Size |
+| :----------------------------------------------: | :------: | :--------------: | :-------------: | :------------: | :-----: | :---------: | :-------: | :----: | :----: | :------------------------------------------------: | :--------: |
+| [FCENet_r50](/configs/textdet/fcenet/fcenet_resnet50_fpn_1500e_totaltext.py) | ResNet50 |        -         | Totaltext Train | Totaltext Test |  1500   | (1280, 960) |  0.8485   | 0.7810 | 0.8134 | [model](https://download.openmmlab.com/mmocr/textdet/fcenet/fcenet_resnet50_fpn_1500e_totaltext/fcenet_resnet50_fpn_1500e_totaltext-91bd37af.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/fcenet/fcenet_resnet50_fpn_1500e_totaltext/20221219_201107.log) |    1xb8    |


gaotongxiao · 2023-03-13T09:37:31Z

-| [PANet](/configs/textdet/panet/panet_resnet18_fpem-ffm_600e_icdar2015.py) |     ImageNet     | ICDAR2015 Train | ICDAR2015 Test |   600   |    736    |  0.8455   | 0.7323 | 0.7848 | [model](https://download.openmmlab.com/mmocr/textdet/panet/panet_resnet18_fpem-ffm_600e_icdar2015/panet_resnet18_fpem-ffm_600e_icdar2015_20220826_144817-be2acdb4.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/panet/panet_resnet18_fpem-ffm_600e_icdar2015/20220826_144817.log) |
+|                        Method                         | Pretrained Model |  Training set   |    Test set    | #epochs | Test size | Precision | Recall | Hmean  |                        Download                         | Batch Size |
+| :---------------------------------------------------: | :--------------: | :-------------: | :------------: | :-----: | :-------: | :-------: | :----: | :----: | :-----------------------------------------------------: | :--------: |
+| [PANet](/configs/textdet/panet/panet_resnet18_fpem-ffm_600e_icdar2015.py) |     ImageNet     | ICDAR2015 Train | ICDAR2015 Test |   600   |    736    |  0.8455   | 0.7323 | 0.7848 | [model](https://download.openmmlab.com/mmocr/textdet/panet/panet_resnet18_fpem-ffm_600e_icdar2015/panet_resnet18_fpem-ffm_600e_icdar2015_20220826_144817-be2acdb4.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/panet/panet_resnet18_fpem-ffm_600e_icdar2015/20220826_144817.log) |   1xb16    |


gaotongxiao · 2023-03-13T09:38:22Z

+| [PSENet](/configs/textdet/psenet/psenet_resnet50_fpnf_600e_ctw1500.py) |                ResNet50                |        -         | CTW1500 Train | CTW1500 Test |   600   |   1280    |  0.7705   | 0.7883 | 0.7793 | [model](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50_fpnf_600e_ctw1500/psenet_resnet50_fpnf_600e_ctw1500_20220825_221459-7f974ac8.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50_fpnf_600e_ctw1500/20220825_221459.log) |   16xb16   |
+| [PSENet_r50-oclip](/configs/textdet/psenet/psenet_resnet50-oclip_fpnf_600e_ctw1500.py) | [ResNet50-oCLIP](https://download.openmmlab.com/mmocr/backbone/resnet50-oclip-7ba0c533.pth) |        -         | CTW1500 Train | CTW1500 Test |   600   |   1280    |  0.8483   | 0.7636 | 0.8037 | [model](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50-oclip_fpnf_600e_ctw1500/psenet_resnet50-oclip_fpnf_600e_ctw1500_20221101_140406-d431710d.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50-oclip_fpnf_600e_ctw1500/20221101_140406.log) |   16xb16   |


gaotongxiao · 2023-03-13T09:38:30Z

+| [PSENet](/configs/textdet/psenet/psenet_resnet50_fpnf_600e_icdar2015.py) |                ResNet50                 |        -         |  IC15 Train  | IC15 Test |   600   |   2240    |  0.8396   | 0.7636 | 0.7998 | [model](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50_fpnf_600e_icdar2015/psenet_resnet50_fpnf_600e_icdar2015_20220825_222709-b6741ec3.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50_fpnf_600e_icdar2015/20220825_222709.log) |   16xb16   |
+| [PSENet_r50-oclip](/configs/textdet/psenet/psenet_resnet50-oclip_fpnf_600e_icdar2015.py) | [ResNet50-oCLIP](https://download.openmmlab.com/mmocr/backbone/resnet50-oclip-7ba0c533.pth) |        -         |  IC15 Train  | IC15 Test |   600   |   2240    |  0.8895   | 0.8098 | 0.8478 | [model](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50-oclip_fpnf_600e_icdar2015/psenet_resnet50-oclip_fpnf_600e_icdar2015_20221101_131357-2bdca389.pth) \| [log](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50-oclip_fpnf_600e_icdar2015/20221101_131357.log) |   16xb16   |


gaotongxiao · 2023-03-13T09:40:19Z

+| :-----------------------------------------------------------: | :------: | :----: | :----------: | :-------: | :-: | :-------: | :------------: | :----: | :------------------------------------------------------------: | :--------: |
+|                                                               |          | IIIT5K |     SVT      | IC13-1015 |     | IC15-2077 |      SVTP      |  CT80  |                                                                |            |
+| [ASTER](/configs/textrecog/aster/aster_resnet45_6e_st_mj.py)  | ResNet45 | 0.9357 |    0.8949    |  0.9281   |     |  0.7665   |     0.8062     | 0.8507 | [model](https://download.openmmlab.com/mmocr/textrecog/aster/aster_resnet45_6e_st_mj/aster_resnet45_6e_st_mj-cc56eca4.pth) \| [log](https://download.openmmlab.com/mmocr/textrecog/aster/aster_resnet45_6e_st_mj/20221214_232605.log) |            |
+| [ASTER-TTA](/configs/textrecog/aster/aster_resnet45_6e_st_mj.py) | ResNet45 | 0.9337 |    0.8949    |  0.9251   |     |  0.7925   |     0.8109     | 0.8507 |                                                                |  1xb1024   |


4 x 1024; and it should be placed to [ASTER]

gaotongxiao · 2023-03-13T09:41:32Z

+| :--------------------------------------------------------: | :----: | :----------: | :-------: | :-: | :-------: | :------------: | :----: | :-----------------------------------------------------------------------: | :--------: |
+|                          methods                           | IIIT5K |     SVT      | IC13-1015 |     | IC15-2077 |      SVTP      |  CT80  |                                                                           |            |
+|   [CRNN](/configs/textrecog/crnn/crnn_mini-vgg_5e_mj.py)   | 0.8053 |    0.7991    |  0.8739   |     |  0.5571   |     0.6093     | 0.5694 | [model](https://download.openmmlab.com/mmocr/textrecog/crnn/crnn_mini-vgg_5e_mj/crnn_mini-vgg_5e_mj_20220826_224120-8afbedbb.pth) \| [log](https://download.openmmlab.com/mmocr/textrecog/crnn/crnn_mini-vgg_5e_mj/20220826_224120.log) |            |
+| [CRNN-TTA](/configs/textrecog/crnn/crnn_mini-vgg_5e_mj.py) | 0.8013 |    0.7975    |  0.8631   |     |  0.5763   |     0.6093     | 0.5764 | [model](https://download.openmmlab.com/mmocr/textrecog/crnn/crnn_mini-vgg_5e_mj/crnn_mini-vgg_5e_mj_20220826_224120-8afbedbb.pth) \| [log](https://download.openmmlab.com/mmocr/textrecog/crnn/crnn_mini-vgg_5e_mj/20220826_224120.log) |   4xb64    |


1 x 64, wrong place

gaotongxiao · 2023-03-13T09:41:56Z

+| :--------------------------------------------------------: | :-----------: | :----: | :----------: | :-------: | :-: | :-------: | :------------: | :----: | :----------------------------------------------------------: | :--------: |
+|                                                            |               | IIIT5K |     SVT      | IC13-1015 |     | IC15-2077 |      SVTP      |  CT80  |                                                              |            |
+| [MASTER](/configs/textrecog/master/master_resnet31_12e_st_mj_sa.py) | R31-GCAModule | 0.9490 |    0.8887    |  0.9517   |     |  0.7650   |     0.8465     | 0.8889 | [model](https://download.openmmlab.com/mmocr/textrecog/master/master_resnet31_12e_st_mj_sa/master_resnet31_12e_st_mj_sa_20220915_152443-f4a5cabc.pth) \| [log](https://download.openmmlab.com/mmocr/textrecog/master/master_resnet31_12e_st_mj_sa/20220915_152443.log) |            |
+| [MASTER-TTA](/configs/textrecog/master/master_resnet31_12e_st_mj_sa.py) | R31-GCAModule | 0.9450 |    0.8887    |  0.9478   |     |  0.7906   |     0.8481     | 0.8958 |                                                              |   4xb512   |


[Enchance] BS infor in readme

9d342da

mm-assistant Bot assigned gaotongxiao Mar 13, 2023

Harold-lkk requested a review from gaotongxiao March 13, 2023 08:32

gaotongxiao reviewed Mar 13, 2023

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Enchance] batch size information in readme#1778

[Enchance] batch size information in readme#1778
Harold-lkk wants to merge 1 commit into
open-mmlab:dev-1.xfrom
Harold-lkk:lkk/bs_readme

Harold-lkk commented Mar 13, 2023

Uh oh!

codecov Bot commented Mar 13, 2023

Uh oh!

gaotongxiao left a comment

Uh oh!

gaotongxiao Mar 13, 2023

Uh oh!

gaotongxiao Mar 13, 2023

Uh oh!

gaotongxiao Mar 13, 2023

Uh oh!

gaotongxiao Mar 13, 2023

Uh oh!

gaotongxiao Mar 13, 2023

Uh oh!

gaotongxiao Mar 13, 2023

Uh oh!

gaotongxiao Mar 13, 2023

Uh oh!

gaotongxiao Mar 13, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

		\| [PSENet](/configs/textdet/psenet/psenet_resnet50_fpnf_600e_ctw1500.py) \| ResNet50 \| - \| CTW1500 Train \| CTW1500 Test \| 600 \| 1280 \| 0.7705 \| 0.7883 \| 0.7793 \| [model](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50_fpnf_600e_ctw1500/psenet_resnet50_fpnf_600e_ctw1500_20220825_221459-7f974ac8.pth) \\| [log](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50_fpnf_600e_ctw1500/20220825_221459.log) \| 16xb16 \|
		\| [PSENet_r50-oclip](/configs/textdet/psenet/psenet_resnet50-oclip_fpnf_600e_ctw1500.py) \| [ResNet50-oCLIP](https://download.openmmlab.com/mmocr/backbone/resnet50-oclip-7ba0c533.pth) \| - \| CTW1500 Train \| CTW1500 Test \| 600 \| 1280 \| 0.8483 \| 0.7636 \| 0.8037 \| [model](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50-oclip_fpnf_600e_ctw1500/psenet_resnet50-oclip_fpnf_600e_ctw1500_20221101_140406-d431710d.pth) \\| [log](https://download.openmmlab.com/mmocr/textdet/psenet/psenet_resnet50-oclip_fpnf_600e_ctw1500/20221101_140406.log) \| 16xb16 \|

Conversation

Harold-lkk commented Mar 13, 2023

Uh oh!

codecov Bot commented Mar 13, 2023

Codecov Report

Uh oh!

gaotongxiao left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants