Skip to content

VLMEvalKit support for nanoVLM #89

Open
@MaoSong2022

Description

@MaoSong2022

I can help to integrate nanoVLM into VLMEvalKit.

the goal is to enable evaluating the model built upon nanoVLM with benchmarks supported by VLMEvalKit.

ideally, this leads to the following format:

# Load pretrained weights from Hub
from models.vision_language_model import VisionLanguageModel

model = VisionLanguageModel.from_pretrained("lusxvr/nanoVLM-222M")

# evalutation
cd path/to/VLMEvalKit/
python run.py --model lusxvr/nanoVLM-222M --data MME 

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions