Liya Ji

Liya Ji is a Postdoctoral Fellow at the Hong Kong University of Science and Technology (HKUST), supervised by Prof. Qifeng Chen. Liya Ji obtained a Ph.D degree from HKUST, supervised by Prof. Qifeng Chen and Prof. Qiang Yang. Liya Ji served as Manager, Machine Learning at Lenovo Group Limited from 2018 to 2021. Liya Ji obtained Master of Philosophy at the Department of Computer Science and Engineering from HKUST in 2015 and received her Bachelor of Engineering at the Department of Computer Science and Technology from Xi'an Jiaotong University in 2012. Her research interests include generative models, low-level vision, and multi-modal LLMs.

Email  /  CV  /  Bio  /  Scholar  

profile photo

Education/Experiences

Publications

(* indicates the equal contributions. + indicates the corresponding authors.)

ModelGrow: Continual Text-to-Video Pre-training with Model Expansion and Language Understanding Enhancement
Zhefan Rao*, Liya Ji*, Yazhou Xing, Runtao Liu, Zhaoyang Liu, Jiaxin Xie, Ziqiao Peng, Yingqing He+, Qifeng Chen+
Preprint, 2024
project page / paper

We continually train a pre-trained T2V models via block expansion and LLMs conditioning.

A Diffusion Model with State Estimation for Degradation-Blind Inverse Imaging
Liya Ji*, Zhefan Rao*, Sinno Jialin Pan, Chenyang Lei+, Qifeng Chen+
AAAI, 2024
paper

We propose a pixel-wise control framework based on unconditional diffusion models for the degradation-blind inverse problems with the performance of semantic consistency and details preservation.

Neural Image Popularity Assessment with Retrieval-augmented Transformer
Liya Ji*, Chan Ho Park*, Zhefan Rao*, Qifeng Chen+
ACM MultiMedia, 2023
project page / paper

We propose an image assessment metric presenting human's like based on Instagram dataset.

LeapDetect: An Agile Platform for Inspecting Power Transmission Lines from Drones
Guangcan Mai, Renjie Gou, Liya Ji, Hua Wu, Fei Cao, Qifeng Chen, Jun Luo+
ICDM Workshop, 2019
paper

We propose an automatic framework enabling agile development of detection models and human-in-the-loop annoation.

Academic Services & Awards

Miscellanea

Github Project

VideoTuna: A Powerful Toolkit for Video Generation with Model Fine-Tuning and Post-Training

Teaching


Thanks Dr. JonBarron for sharing the source code.