M.L. (Matt) Coler, PhD

Associate Professor + Director of the MSc. Speech Technology

Campus Fryslân

Telephone:

+31 58 205 5103

E-mail:

m.coler rug.nl

Homepage ORCID Research Portal

Publications

AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation

Gao, X., Bansal, S., Gowda, K., Li, Z., Nayak, S., Kumar, N. & Coler, M., 2026, In: IEEE Transactions on Affective Computing. 17, 1, p. 900-912 13 p.

Research output: Contribution to journal › Article › Academic › peer-review

Improving low-resource ASR using bilingual fine-tuning with language identification: a cross-linguistic evaluation

Amooie, R., Hao, Y., de Vries, W., Dijkstra, J., Coler, M. & Wieling, M., 16-Jun-2026, (Submitted) arXiv.

Research output: Working paper › Preprint › Academic

SarcasmMiner: A Dual-Track Post-Training Framework for Robust Audio-Visual Sarcasm Reasoning

Li, Z., Chen, Y., Lai, H., Gao, X., Nayak, S. & Coler, M., 5-Mar-2026, (Submitted) arXiv, 5 p.

Research output: Working paper › Preprint › Academic

Switche, Harkje, Prate: Language Identity, Bilingual Speech, and Vitality in an A.I.-Mediated Future

Rose, D., Van de Velde, H. & Coler, M., 16-Jun-2026.

Research output: Contribution to conference › Paper › Academic

What Makes Synthetic Speech Sound Sarcastic?: A Prosody-Controlled Perception Study

Li, Z., Nayak, S. & Coler, M., 25-Sept-2026, Interspeech 2026. ISCA, p. 5905-5909 5 p. (Interspeech 2026).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

A Multimodal Chinese Dataset for Cross-lingual Sarcasm Detection

Gao, X., Wang, B. X., Zhang, M., Huang, S., Li, Z., Nayak, S. & Coler, M., 2025, Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. ISCA, p. 3968-3972 5 p. (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

Enhancing Standard and Dialectal Frisian ASR: Multilingual Fine-tuning and Language Identification for Improved Low-resource Performance

Amooie, R., De Vries, W., Hao, Y., Dijkstra, J., Coler, M. & Wieling, M., 2025, ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 5 p. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

Evaluating Multimodal Large Language Models on Spoken Sarcasm Understanding

Li, Z., Gao, X., Zhang, Y., Nayak, S. & Coler, M., 18-Sept-2025, (Submitted) arXiv, 5 p.

Research output: Working paper › Preprint › Academic

Integrating Feedback Loss from Bi-modal Sarcasm Detector for Sarcastic Speech Synthesis

Li, Z., Zhang, Y., Gao, X., Raghuvanshi, D., Kumar, N., Nayak, S. & Coler, M., 18-Aug-2025, (Submitted) arXiv, 7 p.

Research output: Working paper › Preprint › Academic

Intra-modal Relation and Emotional Incongruity Learning using Graph Attention Networks for Multimodal Sarcasm Detection

Raghuvanshi, D., Gao, X., Li, Z., Bansal, S., Coler, M., Kumar, N. & Nayak, S., 2025, 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2025 - Proceedings. Rao, B. D., Trancoso, I., Sharma, G. & Mehta, N. B. (eds.). IEEE, 5 p. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review