Object Localization On Illusionvqa
评估指标
Accuracy
评测结果
各个模型在此基准测试上的表现结果
| Paper Title | Repository | ||
|---|---|---|---|
| GPT4-Vision 4-shot+CoT | 49.7 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| GPT4-Vision 4-shot | 46 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| Gemini-Pro | 43.5 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| Gemini-Pro 4-shot | 41.8 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| GPT4-Vision | 40 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| Gemini-Pro 4-shot+CoT | 33.9 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| CogVLM | 28 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| LLaVA-1.5-13B | 24.8 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| InstructBLIP-13B | 24.3 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models |
0 of 9 row(s) selected.