Liya Ji

Liya Ji is a Postdoctoral Fellow at the Hong Kong University of Science and Technology (HKUST), supervised by Prof. Qifeng Chen. Liya Ji obtained a Ph.D degree from HKUST, supervised by Prof. Qifeng Chen and Prof. Qiang Yang. Liya Ji served as Manager, Machine Learning at Lenovo Group Limited from 2018 to 2021. Liya Ji obtained Master of Philosophy at the Department of Computer Science and Engineering from HKUST in 2015 and received her Bachelor of Engineering at the Department of Computer Science and Technology from Xi'an Jiaotong University in 2012. Her research interests include generative models, low-level vision, computational aesthetics, and unified multi-modal generation.

Email  /  CV  /  Bio  /  Scholar  

profile photo

Education/Experiences

Publications

(* indicates the equal contributions. + indicates the corresponding authors.)

Zero-shot Synthetic Video Realism Enhancement via Structure-aware Denoising
Yifan Wang*, Liya Ji*, Zhanghan Ke, Harry Yang, Ser-Nam Lim, Qifeng Chen+
Preprint, 2025
project page / paper

We enhance the realism of the synthetic videos from the simulator CARLA via using the World Foundation Model.

Instruction-based Image Editing with Planning, Reasoning, and Generation
Liya Ji, Chenyang Qi, Qifeng Chen+
ICCV, 2025
paper

We address the instruction-based image editing with Chain-of-Thought MLLMs reasoning, and diffusion generation

ModelGrow: Continual Text-to-Video Pre-training with Model Expansion and Language Understanding Enhancement
Zhefan Rao*, Liya Ji*, Yazhou Xing, Runtao Liu, Zhaoyang Liu, Jiaxin Xie, Ziqiao Peng, Yingqing He+, Qifeng Chen+
Preprint, 2024
project page / paper

We continually train a pre-trained T2V models via block expansion and LLMs conditioning.

A Diffusion Model with State Estimation for Degradation-Blind Inverse Imaging
Liya Ji*, Zhefan Rao*, Sinno Jialin Pan, Chenyang Lei+, Qifeng Chen+
AAAI, 2024
paper

We propose a pixel-wise control framework based on unconditional diffusion models for the degradation-blind inverse problems with the performance of semantic consistency and details preservation.

Neural Image Popularity Assessment with Retrieval-augmented Transformer
Liya Ji*, Chan Ho Park*, Zhefan Rao*, Qifeng Chen+
ACM MultiMedia, 2023
project page / paper

We propose an image assessment metric presenting human's like based on Instagram dataset.

LeapDetect: An Agile Platform for Inspecting Power Transmission Lines from Drones
Guangcan Mai, Renjie Gou, Liya Ji, Hua Wu, Fei Cao, Qifeng Chen, Jun Luo+
ICDM Workshop, 2019
paper

We propose an automatic framework enabling agile development of detection models and human-in-the-loop annoation.

Academic Services & Awards

Miscellanea

Github Project

VideoTuna: A Powerful Toolkit for Video Generation with Model Fine-Tuning and Post-Training

Teaching


Thanks Dr. JonBarron for sharing the source code.