AttributeError: 'HfMoondream' object has no attribute 'all_tied_weights_keys'. Did you mean: '_tied_weights_keys'?
#30
by
Clausss
- opened
AttributeError: 'HfMoondream' object has no attribute 'all_tied_weights_keys'. Did you mean: '_tied_weights_keys'?
anyone can help fix this?
because I want use this model but I have this error
same for stable(5.0.0) and latest from git
I bet you have too new transformers...
try reverting to a bit older transformers (4.x), this fixed the issue for me.
pip install "transformers<5.0.0"
I guess the actual error is in the initialization of the model and it's device_map attribute, anyhow this is a guess. YOu could maybe move the model to cuda manually later?