Refactor LoRA loading for v2.3 in generate.py to prioritize distilled-lora files over full model weights, enhancing model flexibility. Update key sanitization logic to utilize a replacement list for improved readability and maintainability. Modify denoise_dev_av function to include sigma parameters for audio and video modalities, ensuring consistent handling of latent variables during processing. Adjust Vocoder weight loading to allow for non-strict loading, accommodating additional keys in model weights.
This commit is contained in:
@@ -120,8 +120,8 @@ class Vocoder(nn.Module):
|
||||
model = cls(config)
|
||||
weights = mx.load(str(model_path / "model.safetensors"))
|
||||
|
||||
# weights = vocoder.sanitize(weights)
|
||||
model.load_weights(list(weights.items()), strict=strict)
|
||||
# Use strict=False to skip extra keys (e.g., bwe_generator in LTX-2.3)
|
||||
model.load_weights(list(weights.items()), strict=False)
|
||||
return model
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user