Skip to ContentSkip to Navigation
Rijksuniversiteit Groningenfounded in 1614  -  top 100 university
Over ons Praktische zaken Waar vindt u ons X. (Xiyuan) Gao

Research interests

My research focuses on pragmatic language understanding in Human Machine Interaction, with an emphasis on how multimodal cues (e.g., textual, audio, and visual) can be utilized to unreveal meaning beyond literal content. Sarcasm serves as a central case study in my research. Drawing on linguistics, cognitive science, my work investigates how pragmatic cues like prosodic variation, semantic incongruity, and facial expressions can be systematically modeled using multimodal fusion strategies. The broader aim is to move beyond surface-level prompt-style language processing, and toward systems that understand language as it is used in real human interaction: emotionally charged, culturally embedded, and shaped by dynamic social context.

Key words: multimodal sarcasm detection, pragmatic computing, human-machine-interaction, affective computing.

 

 

Publicaties

Intra-modal Relation and Emotional Incongruity Learning using Graph Attention Networks for Multimodal Sarcasm Detection

A Functional Trade-off between Prosodic and Semantic Cues in Conveying Sarcasm

A Functional Trade-off between Prosodic and Semantic Cues in Conveying Sarcasm

AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation

Improving sarcasm detection from speech and text through attention-based fusion exploiting the interplay of emotions and sentiments

Spoken in jest, detected in earnest: A systematic review of sarcasm recognition — multimodal fusion, challenges, and future prospects

SarcasticSpeech: Speech Synthesis for Sarcasm in Low-Resource Scenarios

Deep CNN-based Inductive Transfer Learning for Sarcasm Detection in Speech

Pers/media

Researchers Have Built an AI-Powered Sarcasm Detector

Algoritam koji kuži sarkazam? Da, baš nam to treba

Algoritmos para detectar el sarcasmo

Scientists invent device to tell if person is being sarcastic

Building a better sarcasm detector

Could AI algorithms understand sarcasm?

Fast menschlich: Dieser Algorithmus versteht Sarkasmus

Ahora la IA puede detectar el sarcasmo. Genial...