Refactor LoRA loading for v2.3 in generate.py to prioritize distilled-lora files over full model weights, enhancing model flexibility. Update key sanitization logic to utilize a replacement list for improved readability and maintainability. Modify denoise_dev_av function to include sigma parameters for audio and video modalities, ensuring consistent handling of latent variables during processing. Adjust Vocoder weight loading to allow for non-strict loading, accommodating additional keys in model weights.

This commit is contained in:
Prince Canuma
2026-03-14 15:24:50 +01:00
parent 9cba2ea7cd
commit ffe271699a
2 changed files with 30 additions and 15 deletions

View File

@@ -120,8 +120,8 @@ class Vocoder(nn.Module):
model = cls(config)
weights = mx.load(str(model_path / "model.safetensors"))
# weights = vocoder.sanitize(weights)
model.load_weights(list(weights.items()), strict=strict)
# Use strict=False to skip extra keys (e.g., bwe_generator in LTX-2.3)
model.load_weights(list(weights.items()), strict=False)
return model