Video Model Blocks
Soft Split and Soft Composition
Introduced by Liu et al. in FuseFormer: Fusing Fine-Grained Information in Transformers for Video InpaintingSoft Split and Soft Composition are video frame based operations used in the FuseFormer architecture, specifically the FuseFormer blocks. We softly split each frame into overlapped patches and then softly composite them back, by using an unfold and fold operator with patch size $k$ being greater than patch stride $s$. When compositing patches back to its original spatial shape, we add up feature values at each overlapping spatial location of neighboring patches.
Source: FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting
Papers
| Paper | Code | Results | Date | Stars |
|---|
Usage Over Time
Components
| Component | Type |
|
|---|---|---|
| 🤖 No Components Found | You can add them if they exist; e.g. Mask R-CNN uses RoIAlign |
