Connect the modalities.
Audio, language and images — with alignment that preserves the details that matter.
MARS · IPMAFFECTIVE AI · MULTIMODAL INTELLIGENCE
I'm Junjie Xu. Ph.D. researcher at ECNU.
I connect sound, images and human experience through multimodal alignment, affective understanding and controllable generation.

A CONNECTED RESEARCH PATH
My work brings three capabilities together — from understanding a signal to building something meaningful with it.
Audio, language and images — with alignment that preserves the details that matter.
MARS · IPMBring affect, context and human feedback into how models interpret and generate.
ACM TALLIP · IJCNNLead projects from research questions to prototypes and human-centered applications.
2 funded projects ledSELECTED WORK / 01–03
First-author research in aspect-level sentiment analysis, with published work in ACM TALLIP and IJCNN.
Led the ECNU multimodal digital-support project, rated excellent at completion. Exploring how affective generation can support everyday experience.
WHAT'S NEXT
Prospective directions grounded in my current work. Open to conversations and research collaboration.
HUMAN–AI COLLABORATION
How can affective cues and human feedback support appropriate trust, oversight and long-term collaboration?
CONTROLLABLE GENERATION
Build on audio–image alignment toward multimodal generation shaped by emotional intent and human preferences.
HUMAN-CENTERED APPLICATIONS
Turn research into carefully evaluated experiences for digital well-being and educational support.
A new research chapter at NTU.CSC-funded visiting research with Prof. Eric Cambria, scheduled for November 2026–November 2027.
PUBLISHED RESEARCH
Co-inventor; public application numbers are listed for verification.
CN 118840378 A · 2024-10-25
CN 120298246 A · 2025-07-11
CN 118485681 A · 2024-08-13
CN 118916133 A · 2024-11-08
CN 117422962 A · 2024-01-19
CN 120198411 A · 2025-06-24
CN 120316301 A · 2025-07-15
CN 118524266 A · 2024-08-20
CN 120318634 A · 2025-07-15
CN 120319204 A · 2025-07-15
CN 118898549 A · 2024-11-05
CN 116127072 A · 2023-05-16
CN 114170477 A · 2022-03-11
CN 120298698 A · 2025-07-11
Higher-Education Main Track · Graduate Creative Group · Project Lead — national round in progress
ECNU School of Computer Science and Technology
Shanghai Municipal Education Commission
China Association for Science and Technology
ECNU School of Computer Science and Technology
LET'S CONNECT
For research, collaboration, or a shared question.
Get in touch jjxu_dr@stu.ecnu.edu.cn