Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Examples for Grounded Report Generation #1

Open
pangzss opened this issue Jan 12, 2025 · 0 comments
Open

Examples for Grounded Report Generation #1

pangzss opened this issue Jan 12, 2025 · 0 comments

Comments

@pangzss
Copy link

pangzss commented Jan 12, 2025

Thanks for contributing such great work.

In the provided demo data samples, there is no sample for grounded report generation.
I have tried the instructions provided in Fig.12 (both EN and CN), but they didn't work.

One example inference result for demo_04.jpg is like this:
[{"question": "你是一个医疗助手,你的任务是定位器官或病灶区域并生成对应的描述。区域用边界框的形式表示,[x1, y1, x2, y2],整数范围从0到999。这些值分别对应左上角的x,左上角的y,右下角的x和右下角的y。\n请定位并描述图像中的病变区域。", "question_id": 1, "pred_answer": "边界尚清,范围约15.3cm×7.5cm×7.5cm,双侧侧脑室受压变窄,中线结构向右侧移位,余脑实质未见异常信号灶,灰白质界限清楚,余脑室大小、形态正常,脑沟、脑裂、脑池未见增宽,颅骨未见异常信号。", "gt_answer": ""}]

As you can see, the model has not performed object detection.
Can you provide some examples for the grounded report generation task?

Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant