Publication

Unsupervised Keyphrase Extraction for Web Pages

Haarman, T., Zijlema, B. & Wiering, M., 31-Jul-2019, In : Multimodal Technologies and Interaction. 3, 3

Research output: Contribution to journalArticleAcademicpeer-review

Keyphrase extraction is an important part of natural language processing (NLP) research, although little research is done in the domain of web pages. The World Wide Web contains billions of pages that are potentially interesting for various NLP tasks, yet it remains largely untouched in scientific research. Current research is often only applied to clean corpora such as abstracts and articles from academic journals or sets of scraped texts from a single domain. However, textual data from web pages differ from normal text documents, as it is structured using HTML elements and often consists of many small fragments. These elements are furthermore used in a highly inconsistent manner and are likely to contain noise. We evaluated the keyphrases extracted by several state-of-the-art extraction methods and found that they did not transfer well to web pages. We therefore propose WebEmbedRank, an adaptation of a recently proposed extraction method that can make use of structural information in web pages in a robust manner. We compared this novel method to other baselines and state-of-the-art methods using a manually annotated dataset and found that WebEmbedRank achieved significant improvements over existing extraction methods on web pages.
Original languageEnglish
JournalMultimodal Technologies and Interaction
Volume3
Issue number3
Publication statusPublished - 31-Jul-2019

    Keywords

  • Natural Language Processing

View graph of relations

Download statistics

No data available

ID: 94315590