Prince Canuma 6f6105b715 Add audio to video conditioning

2026-03-16 01:42:11 +01:00

..

audio_vae

Add audio to video conditioning

2026-03-16 01:42:11 +01:00

prompts

Add prompt enhancement feature to video generation

2026-01-15 14:31:00 +01:00

video_vae

fix tiling, rope precision and weights

2026-03-15 22:58:55 +01:00

__init__.py

add audio

2026-01-16 01:15:22 +01:00

adaln.py

initial commit (LTX-2)

2026-01-11 23:48:33 +01:00

attention.py

Enhance README.md with new usage examples for STG and modality scale parameters in video generation. Update generate.py to support STG and modality guidance in the denoising process, allowing for improved audio-visual integration. Refactor attention mechanisms in the transformer to include options for skipping self-attention, facilitating STG perturbation and modality isolation. Update LTXModel and transformer block processing to accommodate new parameters for enhanced flexibility in model configurations.

2026-03-14 10:26:12 +01:00

config.py

Add audio to video conditioning

2026-03-16 01:42:11 +01:00

convert.py

Fix timestep_conditioning logic in infer_vae_decoder_config to ensure consistent behavior based on has_timestep flag.

2026-03-11 18:30:29 +01:00

feed_forward.py

initial commit (LTX-2)

2026-01-11 23:48:33 +01:00

ltx.py

Enhance README.md with new usage examples for STG and modality scale parameters in video generation. Update generate.py to support STG and modality guidance in the denoising process, allowing for improved audio-visual integration. Refactor attention mechanisms in the transformer to include options for skipping self-attention, facilitating STG perturbation and modality isolation. Update LTXModel and transformer block processing to accommodate new parameters for enhanced flexibility in model configurations.

2026-03-14 10:26:12 +01:00

rope.py

fix tiling, rope precision and weights

2026-03-15 22:58:55 +01:00

text_encoder.py

fix tiling, rope precision and weights

2026-03-15 22:58:55 +01:00

text_projection.py

- Refactor video generation script

2026-01-12 14:04:53 +01:00

transformer.py

Enhance README.md with new usage examples for STG and modality scale parameters in video generation. Update generate.py to support STG and modality guidance in the denoising process, allowing for improved audio-visual integration. Refactor attention mechanisms in the transformer to include options for skipping self-attention, facilitating STG perturbation and modality isolation. Update LTXModel and transformer block processing to accommodate new parameters for enhanced flexibility in model configurations.

2026-03-14 10:26:12 +01:00

upsampler.py

Add LTX-2.3 model architecture with prompt-conditioned adaptive layer normalization (adaln) support. Introduce gating mechanisms in attention modules and update transformer configurations to accommodate new parameters. Refactor video and audio processing to utilize adaptive normalization, improving model flexibility and performance. Update weight loading and initialization logic to support dynamic block structures in the decoder.

2026-03-10 16:47:36 +01:00