Jiayuan Rao 饶珈源

🔎 About Me

I’m a 2nd-year PhD student at Shanghai Jiao Tong University and Shanghai AI Lab, researching on the topic of Multi-modal Learning and AI for Science (AI4Sports) supervised by Prof. Weidi Xie and Prof. Yanfeng Wang. I finished my undergraduate at 〽️ UMich-SJTU Joint Institute majoring in Electrical & Computer Engineering with Data Science minor degree.

I was dreaming of becoming an athlete or a sports journalist, luckily AI gave me another chance to dive into sports media industry. I believe sports is all about human’s body and mentality, hope my work can truly benefits atheletics performance and sports media in the future. Feel free to contact me if interest.

🔥 News

• [2024.12] Held a round table meeting around “AI Movie & Long-form Video Understanding”.
• [2024.12] Awarded the ‘50th Edition, 50 People’ Sports Talent of SJTU.
• [2024.12] Will attend CSIG @ Zhejiang University with poster presentation.
• [2024.11] Will attend EMNLP 2024 in person @ Miami with oral presentation.
• [2024.9] Invited talk about AI4Sports and VLM at NICE, after that I will serve as a committee there.
• [2024.9] One paper (MatchTime ⚽️) has been accepted by EMNLP2024 as oral presentation.
• [2023.12] Bronze medal 🥉 in the University Tennis Championships of Shanghai 🎾.
• [2023.9] Started PhD career in SJTU and Shanghai AI Lab.
• [2023.8] Graduate from JI and rewarded Shanghai Excellent Graduate 🎓.

📝 Research

Towards Universal Soccer Video Understanding
Jiayuan Rao*, Haoning Wu*, Hao Jiang, Ya Zhang, Yanfeng Wang, Weidi Xie
Technical Report (New)
[Paper] / [Webpage] / [Code] / [Demo(soon)]

MatchTime: Towards Automatic Soccer Game Commentary Generation
Jiayuan Rao*, Haoning Wu*, Chang Liu, Yanfeng Wang, Weidi Xie
In EMNLP 2024 (Oral Presentation)
[Paper]/ [Webpage] / [Code] / [Demo] / [WeChat]

🕰️ My Past

• Child from Lishui, Zhejiang 🏞️
• Fortunately from Hangzhou High School 🌸
• Exchanged to Madison, Wisconsin

Appreciate all the encounters during my life journey. This homepage is set up on 26/05/2023, I will share some research outcome and random thoughts here ;-)