Jialuo Li

I'm a junior undergraduate student majoring Computer Science and Technology at IIIS, Tsinghua University (a.k.a Yao Class, , directed by the Turing Award Laureate Andrew Chi-Chih Yao). Currently I am a research intern at NYU advised by Prof. Saining Xie. In addition, I am privileged to work with Prof. Li Yi.

Email  /  CV  /  Google Scholar  /  Twitter  /  Github

profile photo

Research

My research interests lie broadly in Computer Vision and Deep Learning, with a particular focus on Diffusion Models and Multimodal Large Language Models (MLLM). I am especially interested in advancing models capable of comprehending and generating visual content, enabling them to truly perceive and understand the world. Furthermore, I also possess some experience in 3D Vision.

Currently I am also open to exploring other fields of research. If you are interested in my research or have any questions, feel free to contact me!


News

  • 2024-09: I will join MSRA for an internship with Dr. Bin Li!
  • 2024-09: ✨ Our research project about reflection anomaly in generative model is now availiable!
  • 2024-07: ✨ Our paper CHOPS was accepted by COLM 2024!
  • 2024-02: I will start my internship in NYU Courant advised by Prof. Saining Xie. Looking forward to working with Saining in New York!
  • 2024-01: ✨ Our graphics course project is now available! Feel free to explore and try it out here.

  • Publications

    (* for equal contribution)
    PontTuset CHOPS: CHat with custOmer Profile Systems for Customer Service with LLMs
    Jingzhe Shi, Jialuo Li, Qinwei Ma, Zaiwen Yang, Huan Ma, Lei Li
    COLM 2024
    Project Page / arXiv

    We propose CHOPS, an LLM agent designed to efficiently access user information, interact with existing systems, and provide accurate, safe responses by leveraging a combination of small and large LLMs. Validated using the CPHOS-dataset, CHOPS demonstrates its potential to enhance or replace human customer service.

    Projects

    (* for equal contribution)
    PontTuset Advancing Diffusion Models for Enhanced Mirror and Reflection Synthesis: A Dual Approach Using Supervised FineTuning and Reinforcement Learning
    Jialuo Li*, Ziru Huang*
    Dataset / Report

    We proposes enhancing the realism of mirrors and reflections in diffusion models through supervised fine-tuning (SFT) on a curated dataset and reinforcement learning (RL) guided by a custom reward model. While SFT provides modest improvements, the RL approach significantly boosts the accuracy and realism of generated reflections.

    PontTuset Generative 3D Mesh Modeling with Text-to-Texture Generator
    Jialuo Li*, Ziru Huang*
    Project Page / Code / Presentation / Report

    Our project extends MeshDiffusion by incorporating class conditioning for 3D mesh generation and using a pre-trained 2D diffusion model to align textures with textual descriptions, effectively generates and textures category-specific 3D meshes.

    Experience


    Microsoft Research Lab - Asia
    2024.09 - Present
    Research Intern
    Research Advisor: Prof. Bin Li
    New York University
    2024.02 - Present
    Research Intern
    Research Advisor: Prof. Saining Xie
    Tsinghua University
    2021.09 - Present
    Undergraduate Student
    Research Advisor: Prof. Li Yi.

    Honors and Awards

  • 2023: Outstanding Scholarship in Social Work from Tsinghua University.
  • 2022: Mr. and Mrs. Wong Yi-Chung Award, Friends of Tsinghua University.
  • 2022: Outstanding Scholarship in Social Work from Tsinghua University.
  • 2021: Member of the Chinese team of the 21st Asian Physics Olympiad (APhO).
  • 2020: Gold Medalist 🏅 in the 37th Chinese Physics Olympiad (CPhO), ranking tenth nationwide.

  • This homepage is designed based on Jon Barron's homepage and deployed on GitHub Pages. Last updated: Sept 02, 2024.
    © 2024 Jialuo Li