Instagram teaches AI to recognize rooms

Instagram teaches AI to recognize rooms

Computer scientist dr. Estefanía Talavera Martínez added a new data modality, audio/sound, to the teaching material that the AI system looks at. This resulted in a high success rate in recognizing indoor spaces, and in a new dataset of real-world videos to use in research.

Her work was published in the journal Neural Computing and Applications on 22 January 2022.

Science LinX wrote an interesting article about her work. In there you can read more about her previous work and the next step she took using video, for which she used real-world videos from Instagram to train her AI system.

Estefanía is a former PhD student within the Intelligent systems group of the Bernoulli Institute, she got her dr. degree in February 2020 with the thesis "Lifestyle understanding through the analysis of egocentric photo-streams". After that she was a teacher within the University of Groningen in Computer Science. She is now working at the University of Twente as an assistant Professor.