Inputs
Note: The
pose_video and pose_video_mask inputs are truncated together to the shorter of the two, and are processed only for the first length frames. If either input is shorter than or equal to video_frame_offset, it is ignored entirely. The pose_video is downscaled to half the resolution of the main video before encoding, and the encoded pose latent is multiplied by pose_strength and applied to the conditioning only between the pose_start and pose_end timestep steps. If pose_video_mask is provided, the colored mask video is downscaled to half resolution and converted into a 28-channel driving mask, which is added to both positive and negative conditioning.
Note: When reference_image is provided, each image in the batch is encoded individually into a latent and embedded into both positive and negative conditioning. The first image is the primary reference; additional images are used as additional views, each needing a matching reference_image_mask. reference_image_mask is only used when reference_image is also provided; when both are given, a 28-channel reference mask that binds the reference frames to identities is also built from the masks and added to the conditioning. In Replacement Mode (replacement_mode=True), the reference image is composited on a black background using the reference image mask as an alpha matte. When clip_vision_output is provided, it is applied to both positive and negative conditioning.
Note: When previous_frames is provided, only the last previous_frame_count frames are used as the extension anchor, and video_frame_offset is adjusted accordingly (reduced by the number of anchored frames, clamped at 0). The anchored frames are encoded and written into the beginning of the output latent, and a noise mask is included so those frames are kept unchanged during generation.
Outputs
This documentation was AI-generated. If you find any errors or have suggestions for improvement, please feel free to contribute! Edit on GitHub
Source fingerprint (SHA-256):
4a1a2201dfa94bd2f1330db02ec18a5e0a6aae9e9ac5ae97d456b7af1aa84b7b