Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3 larger CLAP models not able to load #153

Open
MultiTrickFox opened this issue Jun 19, 2024 · 1 comment
Open

3 larger CLAP models not able to load #153

MultiTrickFox opened this issue Jun 19, 2024 · 1 comment

Comments

@MultiTrickFox
Copy link

Hello, my approach is pretty straightforward; running the default code with just ckpts changed:

model = laion_clap.CLAP_Module(enable_fusion=False, amodel= 'HTSAT-base')
model.load_ckpt( 'music_audioset_epoch_15_esc_90.14.pt' )

But I get the error:

Error(s) in loading state_dict for CLAP:
	Unexpected key(s) in state_dict: "text_branch.embeddings.position_ids". 

This error is present in all the newly trained models;
For music: music_audioset_epoch_15_esc_90.14.pt
For music and speech: music_speech_epoch_15_esc_89.25.pt
For speech, music and general audio: music_speech_audioset_epoch_15_esc_89.98.pt

How can I correctly load these models? thanks..

@tbrouns
Copy link

tbrouns commented Oct 29, 2024

See: #127 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants