Publication

Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client

Jorritsma, W., Cnossen, F., Dierckx, R. A., Oudkerk, M. & van Ooijen, P. M. A., Jan-2016, In : International Journal of Medical Informatics. 85, 1, p. 36-42 7 p.

Research output: Contribution to journalArticleAcademicpeer-review

APA

Jorritsma, W., Cnossen, F., Dierckx, R. A., Oudkerk, M., & van Ooijen, P. M. A. (2016). Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client. International Journal of Medical Informatics, 85(1), 36-42. https://doi.org/10.1016/j.ijmedinf.2015.10.007

Author

Jorritsma, Wiard ; Cnossen, Fokie ; Dierckx, Rudi A. ; Oudkerk, Matthijs ; van Ooijen, Peter M. A. / Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client. In: International Journal of Medical Informatics. 2016 ; Vol. 85, No. 1. pp. 36-42.

Harvard

Jorritsma, W, Cnossen, F, Dierckx, RA, Oudkerk, M & van Ooijen, PMA 2016, 'Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client', International Journal of Medical Informatics, vol. 85, no. 1, pp. 36-42. https://doi.org/10.1016/j.ijmedinf.2015.10.007

Standard

Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client. / Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A.; Oudkerk, Matthijs; van Ooijen, Peter M. A.

In: International Journal of Medical Informatics, Vol. 85, No. 1, 01.2016, p. 36-42.

Research output: Contribution to journalArticleAcademicpeer-review

Vancouver

Jorritsma W, Cnossen F, Dierckx RA, Oudkerk M, van Ooijen PMA. Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client. International Journal of Medical Informatics. 2016 Jan;85(1):36-42. https://doi.org/10.1016/j.ijmedinf.2015.10.007


BibTeX

@article{37a4538186e14c7e97bb7a049c653dbe,
title = "Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client",
abstract = "Objectives: To perform a post-deployment usability evaluation of a radiology Picture Archiving and Communication System (PACS) client based on pattern mining of user interaction log data, and to assess the usefulness of this approach compared to a field study.Methods: All user actions performed on the PACS client were logged for four months. A data mining technique called closed sequential pattern mining was used to automatically extract frequently occurring interaction patterns from the log data. These patterns were used to identify usability issues with the PACS. The results of this evaluation were compared to the results of a field study based usability evaluation of the same PACS client.Results: The interaction patterns revealed four usability issues: (1) the display protocols do not function properly, (2) the line measurement tool stays active until another tool is selected, rather than being deactivated after one use, (3) the PACS's built-in 3D functionality does not allow users to effectively perform certain 3D-related tasks, (4) users underuse the PACS's customization possibilities. All usability issues identified based on the log data were also found in the field study, which identified 48 issues in total.Conclusions: Post-deployment usability evaluation based on pattern mining of user interaction log data provides useful insights into the way users interact with the radiology PACS client. However, it reveals few usability issues compared to a field study and should therefore not be used as the sole method of usability evaluation. (C) 2015 Elsevier Ireland Ltd. All rights reserved.",
keywords = "Usability, User-computer interface, User interaction log data, Data mining, Picture archiving and communication system, SEQUENTIAL PATTERNS, TOOL",
author = "Wiard Jorritsma and Fokie Cnossen and Dierckx, {Rudi A.} and Matthijs Oudkerk and {van Ooijen}, {Peter M. A.}",
note = "Copyright {\textcopyright} 2015 Elsevier Ireland Ltd. All rights reserved.",
year = "2016",
month = jan,
doi = "10.1016/j.ijmedinf.2015.10.007",
language = "English",
volume = "85",
pages = "36--42",
journal = "International Journal of Medical Informatics",
issn = "1386-5056",
publisher = "ELSEVIER IRELAND LTD",
number = "1",

}

RIS

TY - JOUR

T1 - Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client

AU - Jorritsma, Wiard

AU - Cnossen, Fokie

AU - Dierckx, Rudi A.

AU - Oudkerk, Matthijs

AU - van Ooijen, Peter M. A.

N1 - Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

PY - 2016/1

Y1 - 2016/1

N2 - Objectives: To perform a post-deployment usability evaluation of a radiology Picture Archiving and Communication System (PACS) client based on pattern mining of user interaction log data, and to assess the usefulness of this approach compared to a field study.Methods: All user actions performed on the PACS client were logged for four months. A data mining technique called closed sequential pattern mining was used to automatically extract frequently occurring interaction patterns from the log data. These patterns were used to identify usability issues with the PACS. The results of this evaluation were compared to the results of a field study based usability evaluation of the same PACS client.Results: The interaction patterns revealed four usability issues: (1) the display protocols do not function properly, (2) the line measurement tool stays active until another tool is selected, rather than being deactivated after one use, (3) the PACS's built-in 3D functionality does not allow users to effectively perform certain 3D-related tasks, (4) users underuse the PACS's customization possibilities. All usability issues identified based on the log data were also found in the field study, which identified 48 issues in total.Conclusions: Post-deployment usability evaluation based on pattern mining of user interaction log data provides useful insights into the way users interact with the radiology PACS client. However, it reveals few usability issues compared to a field study and should therefore not be used as the sole method of usability evaluation. (C) 2015 Elsevier Ireland Ltd. All rights reserved.

AB - Objectives: To perform a post-deployment usability evaluation of a radiology Picture Archiving and Communication System (PACS) client based on pattern mining of user interaction log data, and to assess the usefulness of this approach compared to a field study.Methods: All user actions performed on the PACS client were logged for four months. A data mining technique called closed sequential pattern mining was used to automatically extract frequently occurring interaction patterns from the log data. These patterns were used to identify usability issues with the PACS. The results of this evaluation were compared to the results of a field study based usability evaluation of the same PACS client.Results: The interaction patterns revealed four usability issues: (1) the display protocols do not function properly, (2) the line measurement tool stays active until another tool is selected, rather than being deactivated after one use, (3) the PACS's built-in 3D functionality does not allow users to effectively perform certain 3D-related tasks, (4) users underuse the PACS's customization possibilities. All usability issues identified based on the log data were also found in the field study, which identified 48 issues in total.Conclusions: Post-deployment usability evaluation based on pattern mining of user interaction log data provides useful insights into the way users interact with the radiology PACS client. However, it reveals few usability issues compared to a field study and should therefore not be used as the sole method of usability evaluation. (C) 2015 Elsevier Ireland Ltd. All rights reserved.

KW - Usability

KW - User-computer interface

KW - User interaction log data

KW - Data mining

KW - Picture archiving and communication system

KW - SEQUENTIAL PATTERNS

KW - TOOL

U2 - 10.1016/j.ijmedinf.2015.10.007

DO - 10.1016/j.ijmedinf.2015.10.007

M3 - Article

C2 - 26574241

VL - 85

SP - 36

EP - 42

JO - International Journal of Medical Informatics

JF - International Journal of Medical Informatics

SN - 1386-5056

IS - 1

ER -

ID: 26152744