Search Results for author: Muyao Niu

Found 5 papers, 3 papers with code

CV-VAE: A Compatible Video VAE for Latent Generative Video Models

1 code implementation30 May 2024 Sijie Zhao, Yong Zhang, Xiaodong Cun, Shaoshu Yang, Muyao Niu, Xiaoyu Li, WenBo Hu, Ying Shan

Moreover, since current diffusion-based approaches are often implemented using pre-trained text-to-image (T2I) models, directly training a video VAE without considering the compatibility with existing T2I models will result in a latent space gap between them, which will take huge computational resources for training to bridge the gap even with the T2I models as initialization.

MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model

no code implementations30 May 2024 Muyao Niu, Xiaodong Cun, Xintao Wang, Yong Zhang, Ying Shan, Yinqiang Zheng

We present MOFA-Video, an advanced controllable image animation method that generates video from the given image using various additional controllable signals (such as human landmarks reference, manual trajectories, and another even provided video) or their combinations.

Visibility Constrained Wide-band Illumination Spectrum Design for Seeing-in-the-Dark

1 code implementation CVPR 2023 Muyao Niu, Zhuoxiao Li, Zhihang Zhong, Yinqiang Zheng

Seeing-in-the-dark is one of the most important and challenging computer vision tasks due to its wide applications and extreme complexities of in-the-wild scenarios.

Translation

NIR-assisted Video Enhancement via Unpaired 24-hour Data

1 code implementation ICCV 2023 Muyao Niu, Zhihang Zhong, Yinqiang Zheng

In this paper, we defend the feasibility and superiority of NIR-assisted low-light video enhancement results by using unpaired 24-hour data for the first time, which significantly eases data collection and improves generalization performance on in-the-wild data.

Video Enhancement

A Label Informative Wide \& Deep Classifier for Patents and Papers

no code implementations IJCNLP 2019 Muyao Niu, Jie Cai

In this paper, we provide a simple and effective baseline for classifying both patents and papers to the well-established Cooperative Patent Classification (CPC).

Cannot find the paper you are looking for? You can Submit a new open access paper.