Li Jiang Assistant Professor Room 610, Teaching Complex C School of Data Science The Chinese University of Hong Kong (Shenzhen) Shenzhen, China Email: lijiangcse [at] gmail [dot] com or jiangli [at] cuhk [dot] edu [dot] cn

Biography

My research interest includes computer vision and deep learning, especially the 3D scene understanding, autonomous driving, efficient representation learning, unified model, and multi-modal learning.

Publications [Google Scholar]

* indicates equal contribution; † indicates corresponding author.
• GiT: Towards Generalist Vision Transformer through Universal Language Interface
  Haiyang Wang*, Hao Tang*, Li Jiang†, Shaoshuai Shi, Muhammad Ferjad Naeem, Hongsheng Li, Bernt Schiele, Liwei Wang†.
  European Conference on Computer Vision (ECCV), 2024.
  

  [Paper] [Code] [Bib]

• MTA-CLIP: Language-Guided Semantic Segmentation with Mask-Text Alignment
  Anurag Das, Xinting Hu, Li Jiang, Bernt Schiele.
  European Conference on Computer Vision (ECCV), 2024.
  

  [Paper] [Bib]

• MTR v3: 1st Place Solution for 2024 Waymo Open Dataset Challenge - Motion Prediction
  Chen Shi, Shaoshuai Shi, Li Jiang†.
  Waymo Motion Prediction Challenge at Workshop on Autonomous Driving of CVPR (CVPRW), 2024.
  Won the champion of Waymo Open Dataset Motion Prediction Challenge 2024 (June 2024).

  [Paper] [Bib]

• Point Transformer V3: Simpler, Faster, Stronger
  Xiaoyang Wu, Li Jiang, Peng-Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, Hengshuang Zhao.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  Oral Presentation (0.78% acceptance rate).
  

  [Paper] [Code] [Bib]

• GroupContrast: Semantic-aware Self-supervised Representation Learning for 3D Understanding
  Chengyao Wang, Li Jiang, Xiaoyang Wu, Zhuotao Tian, Bohao PENG, Hengshuang Zhao, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  

  [Paper] [Code] [Bib]

• Training Vision Transformers for Semi-Supervised Semantic Segmentation
  Xinting Hu, Li Jiang, Bernt Schiele.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  

  [Paper] [Bib]

• Omni-Adaptive Sparse CNNs for 3D Semantic Segmentation
  Bohao Peng, Xiaoyang Wu, Li Jiang†, Yukang Chen, Hengshuang Zhao, Zhuotao Tian†, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  

  [Paper] [Code] [Bib]

• Unified Language-driven Zero-shot Domain Adaptation
  Senqiao Yang, Zhuotao Tian, Li Jiang, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  

  [Paper] [Project] [Bib]

• FreePoint: Unsupervised Point Cloud Instance Segmentation
  Zhikai Zhang, Jian Ding, Li Jiang, Dengxin Dai, Gui-Song Xia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  

  [Paper] [Bib]

• Open-Vocabulary 3D Semantic Segmentation with Foundation Models
  Li Jiang, Shaoshuai Shi, Bernt Schiele.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  Highlight (2.8% acceptance rate).
  

  [Paper] [Bib]

• MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying
  Shaoshuai Shi*, Li Jiang*†, Dengxin Dai, Bernt Schiele.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), accepted, 2024.
  Won the champion of Waymo Open Dataset Motion Prediction Challenge 2023 (May 2023).
  

  [Paper] [Bib]

• Self-supervised Pre-training with Masked Shape Prediction for 3D Scene Understanding
  Li Jiang, Zetong Yang, Shaoshuai Shi, Vladislav Golyanik, Dengxin Dai, Bernt Schiele.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  

  [Paper] [Bib]

• Learning Context-aware Classifier for Semantic Segmentation
  Zhuotao Tian, Jiequan Cui, Li Jiang, Xiaojuan Qi, Xin Lai, Yixin Chen, Shu Liu, Jiaya Jia.
  AAAI Conference on Artificial Intelligence (AAAI), 2023.
  Oral Presentation.
  

  [Paper] [Code] [Bib]

• Point Transformer V2: Grouped Vector Attention and Partition-based Pooling
  Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao.
  Conference on Neural Information Processing Systems (NeurIPS), 2022.
  

  [Paper] [Code] [Bib]

• Motion Transformer with Global Intention Localization and Local Movement Refinement
  Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele.
  Conference on Neural Information Processing Systems (NeurIPS), 2022.
  Oral Presentation.
  Ranked 1st on Waymo motion prediction and interaction prediction two leaderboards (May 2022).
  

  [Paper] [Code] [Bib]

• MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge–Motion Prediction
  Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele.
  Waymo Motion Prediction Challenge at Workshop on Autonomous Driving of CVPR (CVPRW), 2022.
  Won the champion of Waymo Open Dataset Motion Prediction Challenge 2022 (June 2022).

  [Paper] [Code] [Bib]

• PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection
  Shaoshuai Shi, Li Jiang, Jiajun Deng, Zhe Wang, Chaoxu Guo, Jianping Shi, Xiaogang Wang, Hongsheng Li.
  International Journal of Computer Vision (IJCV), accepted, 2022.
  

  [Paper] [Code] [Bib]

• Boosting Single-Frame 3D Object Detection by Simulating Multi-Frame Point Clouds
  Wu Zheng, Li Jiang, Fanbin Lu, Yangyang Ye, Chi-Wing Fu.
  ACM International Conference on Multimedia (ACMMM), 2022.
  

  [Paper] [Bib]

• DODA: Data-oriented Sim-to-Real Domain Adaptation for 3D Semantic Segmentation
  Runyu Ding*, Jihan Yang*, Li Jiang, Xiaojuan Qi. (*: equal contribution)
  European Conference on Computer Vision (ECCV), 2022.
  

  [Paper] [Code] [Bib]

• A Unified Query-based Paradigm for Point Cloud Understanding
  Zetong Yang*, Li Jiang*, Yanan Sun, Bernt Schiele, Jiaya Jia. (*: equal contribution)
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  

  [Paper] [Code] [Bib]

• Boosting 3D Object Detection by Simulating Multimodality on Point Clouds
  Wu Zheng, Mingxuan Hong, Li Jiang, Chi-Wing Fu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  Oral Presentation.
  

  [Paper] [Bib]

• Generalized Few-Shot Semantic Segmentation
  Zhuotao Tian, Xin Lai, Li Jiang, Michelle Shu, Hengshuang Zhao, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  

  [Paper] [Code] [Bib]

• Stratified Transformer for 3D Point Cloud Segmentation
  Xin Lai*, Jianhui Liu*, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia. (*: equal contribution)
  Computer Vision and Pattern Recognition (CVPR), 2022.
  

  [Paper] [Code] [Bib]

• Adaptive Perspective Distillation for Semantic Segmentation
  Zhuotao Tian, Pengguang Chen, Xin Lai, Li Jiang, Shu Liu, Hengshuang Zhao, Bei Yu, Ming-Chang Yang, Jiaya Jia.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), accepted, 2022.
  

  [Paper] [Bib]

• Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation
  Li Jiang, Shaoshuai Shi, Zhuotao Tian, Xin Lai, Shu Liu, Chi-Wing Fu, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2021.
  

  [Paper] [Code] [Bib]

• Point Transformer
  Hengshuang Zhao, Li Jiang, Jiaya Jia, Philip Torr, Vladlen Koltun.
  IEEE International Conference on Computer Vision (ICCV), 2021.
  Oral Presentation (3.4% acceptance rate).
  

  [Paper] [Bib]

• Semi-supervised Semantic Segmentation with Directional Context-aware Consistency
  Xin Lai*, Zhuotao Tian*, Li Jiang, Shu Liu, Hengshuang Zhao, Liwei Wang, Jiaya Jia. (*: equal contribution)
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  

  [Paper] [Code] [Bib]

• Bidirectional Projection Network for Cross Dimension Scene Understanding
  Wenbo Hu*, Hengshuang Zhao*, Li Jiang, Jiaya Jia, Tien-Tsin Wong. (*: equal contribution)
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  Oral Presentation (4.3% acceptance rate).
  

  [Paper] [Code] [Bib]

• SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud
  Wu Zheng, Weiliang Tang, Li Jiang, Chi-Wing Fu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  Ranked 1st/2nd on KITTI BEV/3D object detection benchmark (Car, Nov 2020 - May 2021).
  

  [Paper] [Code] [Bib]

• CIA-SSD: Confident IoU-Aware Single-Stage Object Detector From Point Cloud
  Wu Zheng, Weiliang Tang, Sijin Chen, Li Jiang, Chi-Wing Fu.
  AAAI Conference on Artificial Intelligence (AAAI), 2021.
  

  [Paper] [Code] [Bib]

• PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation
  Li Jiang*, Hengshuang Zhao*, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia. (*: equal contribution)
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  Oral Presentation (5.7% acceptance rate).
  Ranked 1st on ScanNet 3D Semantic instance benchmark (Nov-16 2019).
  

  [Paper] [Code] [Bib]

• PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection
  Shaoshuai Shi, Chaoxu Guo, Li Jiang, Zhe Wang, Jianping Shi, Xiaogang Wang, Hongsheng Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  Ranked 1st on KITTI 3D object detection benchmark (Car, Nov 2019 - Aug 2020).
  

  [Paper] [Code] [Bib]

• Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation
  Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2019.
  

  [Paper] [Bib]

• Amodal Instance Segmentation through KINS Dataset
  Lu Qi, Li Jiang, Shu Liu, Xiaoyong Shen, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  

  [Paper] [Code] [Bib]

• PointWeb: Enhancing Local Neighborhood Features for Point Cloud Processing
  Li Jiang*, Hengshuang Zhao*, Chi-Wing Fu, Jiaya Jia. (*: equal contribution)
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  

  [Paper] [Code] [Video] [Bib]

• GAL: Geometric Adversarial Loss for Single-View 3D-Object Reconstruction
  Li Jiang, Shaoshuai Shi, Xiaojuan Qi, Jiaya Jia.
  European Conference on Computer Vision (ECCV), 2018.
  Oral Presentation (2.1% acceptance rate).
  

  [Paper] [Bib]

Experience

• Oxford University, Oxford, England
  Jan 2021 – Jul 2021
  
  Visitor (Remote)
  Advisor: Hengshuang Zhao and Philip Torr
  Topic: Hand Parsing and Reconstruction
  
• SmartMore, Shenzhen, China
  Feb 2020 – Jul 2021
  
  Computer Vision Research Intern
  Advisor: Shu Liu
  Topic: 3D Scene Understanding, Robotic Grasping
  
• Tencent YouTu Lab, Shenzhen, China
  Jul 2018 – Jan 2020
  
  Computer Vision Research Intern
  Advisor: Shu Liu and Xiaoyong Shen
  Topic: 3D Semantic Segmentation, Depth Prediction
  
• Australian National University (ANU), Canberra, Australia
  Jul 2016 - Dec 2016
  
  Exchange Student
  Topic: Document Analysis
  

Professional Activities

• Conference Reviewer:
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
    IEEE International Conference on Computer Vision (ICCV).
    European Conference on Computer Vision (ECCV).
    Neural Information Processing Systems (NeurIPS).
    International Conference on Learning Representations (ICLR).
    ACM Multimedia (ACM-MM).
    SIGGRAPH.
  
• Journal Reviewer:
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
    International Journal of Computer Vision (IJCV).
    IEEE Transactions on Image Processing (TIP).
  

Honors & Awards

Teaching

• Teaching:

  CSC3100 Data Structure

  Spring

  2023-2024

• Teaching Assistant:

  ENGG5104 Image Processing and Computer Vision	Spring	2020-2021
  ENGG1110 Problem Solving By Programming	Fall	2019-2020
  CSCI2100B Data Structure	Spring	2018-2019
  ENGG1110 Problem Solving By Programming	Fall	2018-2019
  ENGG1100 Introduction to Engineering Design	Spring	2017-2018
  CSCI1130 Introduction to Computing Using JAVA	Fall	2017-2018