Publication

Fusion of deep learning architectures, multilayer feedforward networks and learning vector quantizers for deep classification learning

Villmann, T., Biehl, M., Villmann, A. & Saralajew, S. 31-Aug-2017 12th International Workshop on Self-Organizing Maps and Learning Vector Quantization, Clustering and Data Visualization (WSOM). IEEEXplore, p. 1-8 8 p.

Research output: Scientific - peer-reviewConference contribution

Documents

  • Fusion of Deep Learning Architectures, Multilayer

    Final publisher's version, 943 KB, PDF-document

DOI

  • T. Villmann
  • M. Biehl
  • A. Villmann
  • S. Saralajew
The advantage of prototype based learning vector quantizers are the intuitive and simple model adaptation as well as the easy interpretability of the prototypes as class representatives for the class distribution to be learned. Although they frequently yield competitive performance and show robust behavior nowadays powerful alternatives have increasing attraction. Particularly, deep architectures of multilayer networks achieve frequently very high accuracies and are, thanks to modern graphic processor units use for calculation, trainable in acceptable time. In this conceptual paper we show, how we can combine both network architectures to benefit from their advantages. For this purpose, we consider learning vector quantizers in terms of feedforward network architectures and explain how it can be combined effectively with multilayer or single-layer feedforward network architectures. This approach includes deep and flat architectures as well as the popular extreme learning machines. For the resulting networks, the multi-/single-layer networks act as adaptive filters like in signal processing while the interpretability of the prototype-based learning vector quantizers is kept for the resulting filtered feature space. In this way a powerful combination of two successful architectures is obtained.
Original languageEnglish
Title of host publication12th International Workshop on Self-Organizing Maps and Learning Vector Quantization, Clustering and Data Visualization (WSOM)
PublisherIEEEXplore
Pages1-8
Number of pages8
ISBN (Print)978-1-5090-6638-4
StatePublished - 31-Aug-2017
Event12th International Workshop on Self-Organizing Maps and Learning Vector Quantization, Clustering and Data Visualization (WSOM) - Nancy, France

Conference

Conference12th International Workshop on Self-Organizing Maps and Learning Vector Quantization, Clustering and Data Visualization (WSOM)
CountryFrance
CityNancy
Period28/06/201730/06/2017

Event

12th International Workshop on Self-Organizing Maps and Learning Vector Quantization, Clustering and Data Visualization (WSOM)

28/06/201730/06/2017

Nancy, France

Event: Conference

    Keywords

  • Computer architecture, Entropy, Feedforward neural networks, Kernel, Nonhomogeneous media, Prototypes, Training

View graph of relations

ID: 47348105