Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test result of COCO dataset #7

Open
dhgras opened this issue Oct 24, 2022 · 1 comment
Open

Test result of COCO dataset #7

dhgras opened this issue Oct 24, 2022 · 1 comment

Comments

@dhgras
Copy link

dhgras commented Oct 24, 2022

I tried to reproduce according to the steps in the README, and finally got the test results as shown in the figure.
I don't know whether this result is correct. If not, where did I go wrong? And what else do I need to do?
WechatIMG124
WechatIMG125

@Jaraxxus-Me
Copy link
Owner

  1. If you're testing with the ResNet101 backbone model, 3-shot setting, I think the result may be wrong. I remember the result on the first image is not like that.
  2. You will need to set a proper threshold for better visualization, I usually use 0.8~0.9 for the images displayed in the paper. For the calculation of AP scores, we follow a common setting as MaxDet=100.
  3. If you notice the scores of the models on COCO, the mAP is still less then 10, which means few-shot detection w/o fine-tuning is still super challenging in COCO (there are still many false postives). So it is common to find failure cases and we're looking forward to its future development.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants