M.L. (Matt) Coler, PhD

UHD + Director, MSc. Speech Technology

Campus Fryslân

Telefoon:

058 205 5103

E-mail:

m.coler rug.nl

Homepage ORCID Research Portal

Publicaties

AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation

Gao, X., Bansal, S., Gowda, K., Li, Z., Nayak, S., Kumar, N. & Coler, M., 2026, In: IEEE Transactions on Affective Computing. 17, 1, blz. 900-912 13 blz.

Onderzoeksoutput › › peer review

Improving low-resource ASR using bilingual fine-tuning with language identification: a cross-linguistic evaluation

Amooie, R., Hao, Y., de Vries, W., Dijkstra, J., Coler, M. & Wieling, M., 16-jun-2026, (Submitted) arXiv.

Onderzoeksoutput: Voordruk ›

SarcasmMiner: A Dual-Track Post-Training Framework for Robust Audio-Visual Sarcasm Reasoning

Li, Z., Chen, Y., Lai, H., Gao, X., Nayak, S. & Coler, M., 5-mrt-2026, (Submitted) arXiv, 5 blz.

Onderzoeksoutput: Voordruk ›

Switche, Harkje, Prate: Language Identity, Bilingual Speech, and Vitality in an A.I.-Mediated Future

Rose, D., Van de Velde, H. & Coler, M., 16-jun-2026.

Onderzoeksoutput ›

What Makes Synthetic Speech Sound Sarcastic?: A Prosody-Controlled Perception Study

Li, Z., Nayak, S. & Coler, M., 25-sep-2026, Interspeech 2026. ISCA, blz. 5905-5909 5 blz. (Interspeech 2026).

Onderzoeksoutput › › peer review

A Multimodal Chinese Dataset for Cross-lingual Sarcasm Detection

Gao, X., Wang, B. X., Zhang, M., Huang, S., Li, Z., Nayak, S. & Coler, M., 2025, Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. ISCA, blz. 3968-3972 5 blz. (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH).

Onderzoeksoutput › › peer review

Enhancing Standard and Dialectal Frisian ASR: Multilingual Fine-tuning and Language Identification for Improved Low-resource Performance

Amooie, R., De Vries, W., Hao, Y., Dijkstra, J., Coler, M. & Wieling, M., 2025, ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 5 blz. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

Onderzoeksoutput › › peer review

Evaluating Multimodal Large Language Models on Spoken Sarcasm Understanding

Li, Z., Gao, X., Zhang, Y., Nayak, S. & Coler, M., 18-sep-2025, (Submitted) arXiv, 5 blz.

Onderzoeksoutput: Voordruk ›

Integrating Feedback Loss from Bi-modal Sarcasm Detector for Sarcastic Speech Synthesis

Li, Z., Zhang, Y., Gao, X., Raghuvanshi, D., Kumar, N., Nayak, S. & Coler, M., 18-aug-2025, (Submitted) arXiv, 7 blz.

Onderzoeksoutput: Voordruk ›

Intra-modal Relation and Emotional Incongruity Learning using Graph Attention Networks for Multimodal Sarcasm Detection

Raghuvanshi, D., Gao, X., Li, Z., Bansal, S., Coler, M., Kumar, N. & Nayak, S., 2025, 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2025 - Proceedings. Rao, B. D., Trancoso, I., Sharma, G. & Mehta, N. B. (reds.). IEEE, 5 blz. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

Onderzoeksoutput › › peer review