Description Guided Molecule Generation On

评估指标

wAcc

评测结果

各个模型在此基准测试上的表现结果

		Paper Title
Claude-3.5	35.92	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Gemini-1.5-pro	34.80	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
GPT-4-turbo	34.23	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
GPT-4o	32.29	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Claude-3	30.47	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Llama-3.1-8B (OpenMolIns-large)	27.22	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Galactica-125M (OpenMolIns-xlarge)	25.73	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Llama3-70B-Instruct (INT4)	23.93	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Galactica-125M (OpenMolIns-large)	23.42	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Galactica-125M (OpenMolIns-medium)	19.89	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
GPT-3.5-turbo	18.58	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Galactica-125M (OpenMolIns-small)	15.18	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Llama3.1-8B-Instruct	14.09	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Llama3-8B-Instruct	13.75	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
chatglm-9B	13.137	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Galactica-125M (OpenMolIns-light)	13.136	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Llama3.2-1B (OpenMolIns-large)	8.10	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
yi-1.5-9B	7.32	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
Mistral-7B-Instruct-v0.2	4.81	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation
BioT5-base	4.21	TOMG-Bench: Evaluating LLMs on Text-based Open Molecule Generation

0 of 25 row(s) selected.