Access the full text.
Sign up today, get DeepDyve free for 14 days.
A. Hurst, S. Hudson, Jennifer Mankoff, Shari Trewin (2013)
Distinguishing Users By Pointing Performance in Laboratory and Real-World TasksACM Trans. Access. Comput., 5
N. Walker, D. Meyer, J. Smelcer (1993)
Spatial and Temporal Characteristics of Rapid Cursor-Positioning Movements with Electromechanical Mice in Human-Computer InteractionHuman Factors: The Journal of Human Factors and Ergonomics Society, 35
S. Arora, V. Venkataraman, A. Zhan, S. Donohue, K. Biglan, E. Dorsey, Max Little (2015)
Detecting and monitoring the symptoms of Parkinson's disease using smartphones: A pilot study.Parkinsonism & related disorders, 21 6
J. Cooke, Susan Brown, D. Cunningham (1989)
Kinematics of arm movements in elderly humansNeurobiology of Aging, 10
[ (2020)
Input accessibility: A large dataset and summary analysis of age, motor ability and input performance22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’20). Virtual Event, 17
R. Griffiths, K. Kotschet, Sian Arfon, Z. Xu, William Johnson, J. Drago, A. Evans, P. Kempster, S. Raghav, M. Horne (2012)
Automated assessment of bradykinesia and dyskinesia in Parkinson's disease.Journal of Parkinson's disease, 2 1
Fraction of the main submovement spent accelerating
C. Rothblum-Oviatt, Jennifer Wright, M. Lefton-Greif, S. McGrath-Morrow, T. Crawford, H. Lederman (2016)
Ataxia telangiectasia: a reviewOrphanet Journal of Rare Diseases, 11
T. Koo, Mae Li (2016)
A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research.Journal of chiropractic medicine, 15 2
Ronnachai Jaroensri, Amy Zhao, Guha Balakrishnan, Derek Lo, J. Schmahmann, F. Durand, J. Guttag (2017)
A Video-Based Method for Automatically Rating Ataxia
E. Law, Ming Yin, Joslin Goh, Kevin Chen, Michael Terry, Krzysztof Gajos (2016)
Curiosity Killed the Cat, but Makes Crowdwork BetterProceedings of the 2016 CHI Conference on Human Factors in Computing Systems
Click duration. The time between mouse button press and release during the correct click on the target
S. Komarov, Katharina Reinecke, Krzysztof Gajos (2013)
Crowdsourcing performance evaluations of user interfacesProceedings of the SIGCHI Conference on Human Factors in Computing Systems
J. Wobbrock, Krzysztof Gajos, Shaun Kane, G. Vanderheiden (2018)
Ability-based designCommunications of the ACM, 61
A. Gopal, Wan-Yu Hsu, D. Allen, R. Bove (2022)
Remote Assessments of Hand Function in Neurological Disorders: Systematic ReviewJMIR Rehabilitation and Assistive Technologies, 9
A. Hurst, Jennifer Mankoff, S. Hudson (2008)
Understanding pointing problems in real world computing environments
Ne Khan, Vineet Pandey, K. Gajos, Anoopum Gupta (2021)
Free-Living Motor Activity Monitoring in Ataxia-TelangiectasiaCerebellum (London, England), 21
S. Keates, Shari Trewin (2005)
Effect of age and Parkinson's disease on cursor positioning using a mouse
R. Sakia (1992)
The Box-Cox transformation technique: a reviewThe Statistician, 41
Sachin Jain, Brian Powers, J. Hawkins, J. Brownstein (2015)
The digital phenotypeNature Biotechnology, 33
Peak acceleration. The maximum (smoothed) acceleration recorded during a movement
A. Shaikh, D. Zee, A. Mandir, H. Lederman, T. Crawford (2013)
Disorders of Upper Limb Movements in Ataxia-TelangiectasiaPLoS ONE, 8
Qisheng Li, Krzysztof Gajos, Katharina Reinecke (2018)
Volunteer-Based Online Studies With Older Adults and People with DisabilitiesProceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility
Yuenkeen Cheong, R. Shehab, Chen Ling (2013)
Effects of age and psychomotor ability on kinematics of mouse-mediated aiming movementErgonomics, 56
S. Gosling, S. Vazire, S. Srivastava, O. John (2004)
Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.The American psychologist, 59 2
Bernd Huber, Katharina Reinecke, Krzysztof Gajos (2017)
The Effect of Performance Feedback on Social Media Sharing at Volunteer-Based Online Experiment PlatformsProceedings of the 2017 CHI Conference on Human Factors in Computing Systems
A. Donker, P. Reitsma (2007)
Aiming and clicking in young children's use of the computer mouseComput. Hum. Behav., 23
A. Creagh, Cedric Simillion, Alf Scotland, F. Lipsmeier, C. Bernasconi, S. Belachew, J. Beek, Michael Baker, C. Gossens, M. Lindemann, M. Vos (2020)
Smartphone-based remote assessment of upper extremity function for multiple sclerosis using the Draw a Shape TestPhysiological Measurement, 41
Anoopum Gupta (2022)
Digital Phenotyping in Clinical NeurologySeminars in Neurology
J. Gerss, W. Köpcke (2010)
Clinical trials and rare diseases.Advances in experimental medicine and biology, 686
D. Meyer, R. Abrams, S. Kornblum, C. Wright, J. Smith (1988)
Optimality in human motor performance: ideal control of rapid aimed movements.Psychological review, 95 3
E. Warmerdam, Jeffrey Hausdorff, Arash Atrsaei, Yuhan Zhou, W. Maetzler (2020)
Long-term unsupervised mobility assessment in movement disordersThe Lancet Neurology, 19
C. Ketcham, R. Seidler, A. Gemmert, G. Stelmach (2002)
Age-related kinematic differences as influenced by task difficulty, target size, and movement amplitude.The journals of gerontology. Series B, Psychological sciences and social sciences, 57 1
G. Box, D. Cox (1964)
An Analysis of TransformationsJournal of the royal statistical society series b-methodological, 26
E. Rocco (1998)
Trust breaks down in electronic contexts but can be repaired by some initial face-to-face contactProceedings of the SIGCHI Conference on Human Factors in Computing Systems
[ (2003)
Clinical trials and rare diseasesNew England Journal of Medicine, 348
Target re-entries. The number of times the mouse pointer leaves the target and then re-enters it before the start of the click
Distance from target center at end of main submovement. The 2D distance from the mouse pointer location at the end of the main submovement to the target center
D. Ruppert (2004)
The Elements of Statistical Learning: Data Mining, Inference, and PredictionJournal of the American Statistical Association, 99
Krzysztof Gajos, A. Hurst, Leah Findlater (2012)
Personalized dynamic accessibilityInteractions, 19
(2004)
, Simine Vazire , Sanjay Srivastava , and Oliver P . John .
Leah Findlater, Lotus Zhang (2020)
Input Accessibility: A Large Dataset and Summary Analysis of Age, Motor Ability and Input PerformanceProceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility
A. Nissenkorn, B. Ben-Zeev (2015)
Ataxia telangiectasia.Handbook of clinical neurology, 132
J. Hourcade, B. Bederson, A. Druin, François Guimbretière (2004)
Differences in pointing task performance between preschool children and adults using miceACM Trans. Comput. Hum. Interact., 11
J. Onnela, S. Rauch (2016)
Harnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental HealthNeuropsychopharmacology, 41
Qisheng Li, Sung Joo, J. Yeatman, Katharina Reinecke (2020)
Controlling for Participants’ Viewing Distance in Large-Scale, Psychophysical Online Experiments Using a Virtual ChinrestScientific Reports, 10
E. Ziegel (2004)
Probability and Statistics for Engineering and the SciencesTechnometrics, 46
J. Schmahmann, Raquel Gardner, Jason Macmore, M. Vangel (2009)
Development of a brief ataxia rating scale (BARS) based on a modified form of the ICARSMovement Disorders, 24
Execution time variability. Coefficient of variation of execution times in a block of trials
Abigail Evans, J. Wobbrock (2012)
Taming wild behavior: the input observer for obtaining text entry and mouse pointing measures from everyday computer useProceedings of the SIGCHI Conference on Human Factors in Computing Systems
S. Keates, F. Hwang, P. Langdon, P. Clarkson, P. Robinson (2002)
Cursor measures for motion-impaired computer usersProceedings of the fifth international ACM conference on Assistive technologies
Anoopum Gupta, A. Luddy, Ne Khan, Sara Reiling, J. Thornton (2022)
Real-life Wrist Movement Patterns Capture Motor Impairment in Individuals with Ataxia-TelangiectasiaCerebellum (London, England), 22
Jeffrey Heer, M. Bostock (2010)
Crowdsourcing graphical perception: using mechanical turk to assess visualization designProceedings of the SIGCHI Conference on Human Factors in Computing Systems
M. Horne, S. McGregor, F. Bergquist (2015)
An Objective Fluctuation Score for Parkinson's DiseasePLoS ONE, 10
Maximum deviation from task axis. The maximum distance of the mouse pointer from the task axis during a movement
L. Germine, K. Nakayama, B. Duchaine, C. Chabris, Garga Chatterjee, J. Wilmer (2012)
Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experimentsPsychonomic Bulletin & Review, 19
I. MacKenzie, Tatu Kauppinen, Miika Silfverberg (2001)
Accuracy measures for evaluating computer pointing devicesProceedings of the SIGCHI Conference on Human Factors in Computing Systems
J. Wobbrock, Krzysztof Gajos (2008)
Goal Crossing with Mice and Trackballs for People with Motor Impairments: Performance, Submovements, and Design DirectionsACM Trans. Access. Comput., 1
Main submovement
Krzysztof Gajos, Katharina Reinecke, Charles Herrmann (2012)
Accurate measurements of pointing performance from in situ observationsProceedings of the SIGCHI Conference on Human Factors in Computing Systems
N. Walker, David Philbin, A. Fisk (1997)
Age-related differences in movement control: adjusting submovement structure to optimize performance.The journals of gerontology. Series B, Psychological sciences and social sciences, 52B 1
Hugo Nicolau, Kyle Montague, Tiago Guerreiro, André Rodrigues, Vicki Hanson (2017)
Investigating Laboratory and Everyday Typing Performance of Blind UsersACM Transactions on Accessible Computing (TACCESS), 10
) Movement time. Complete movement time from target onset to the end of the successful click on the target
M. Iosa, C. Verrelli, A. Gentile, M. Ruggieri, A. Polizzi (2022)
Gaming Technology for Pediatric Neurorehabilitation: A Systematic ReviewFrontiers in Pediatrics, 10
Verification time. The time interval between the end of a movement inside a target and the beginning of the click (i.e., the time when the mouse button was pressed)
Accuracy and Reliability of At-home Quantification of Motor Impairments
Number of pauses. Number of pauses of 100ms or longer
A. Hooyman, J. Talboom, Matthew DeBoth, L. Ryan, Matt Huentelman, S. Schaefer (2021)
Remote, unsupervised functional motor task evaluation in older adults across the United States using the MindCrowd electronic cohortmedRxiv
Time from the first to the last mouse movement (excluding any movement that occurred while the mouse button was pressed -see Click slip)
Noise-to-force ratio. The standard deviation (computed over all trials in a block) of the distance from the target center at the end of the first submovement divided by mean of peak accelerations
S. Balasubramanian, A. Melendez-Calderon, E. Burdet (2012)
A Robust and Sensitive Metric for Quantifying Movement SmoothnessIEEE Transactions on Biomedical Engineering, 59
R. Tibshirani (1996)
Regression Shrinkage and Selection via the LassoJournal of the royal statistical society series b-methodological, 58
A. Rakita, N. Nikolić, M. Mildner, J. Matiasek, A. Elbe-Bürger (2020)
Re-epithelialization and immune cell behaviour in an ex vivo human skin modelScientific Reports, 10
Maia Jacobs, Galina Gheihman, Krzysztof Gajos, Anoopum Gupta (2019)
I think we know more than our doctorsProceedings of the ACM on Human-Computer Interaction, 3
Leah Findlater, Joan Zhang, Jon Froehlich, Karyn Moffatt (2017)
Differences in Crowdsourced vs. Lab-based Mobile and Desktop Input Performance DataProceedings of the 2017 CHI Conference on Human Factors in Computing Systems
T. Crawford, R. Skolasky, R. Fernández, K. Rosquist, H. Lederman (2005)
Survival probability in ataxia telangiectasiaArchives of Disease in Childhood, 91
Katharina Reinecke, Krzysztof Gajos (2015)
LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated SamplesProceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing
Krzysztof Gajos, Katharina Reinecke, M. Donovan, C. Stephen, A. Hung, J. Schmahmann, Anoopum Gupta (2019)
Computer mouse use captures ataxia and parkinsonism, enabling accurate measurement and detectionMovement Disorders, 35
M. Matarazzo, T. Arroyo-Gallego, P. Montero, V. Puertas-Martín, I. Butterworth, C. Mendoza, M. Ledesma-Carbayo, M. Catalan, J. Molina, F. Bermejo-Pareja, J. Martínez-Castrillo, L. López‐Manzanares, A. Alonso-Canovas, Jaime Rodríguez, I. Obeso, P. Martínez-Martín, J. Martínez-Ávila, A. Cámara, M. Gray, J. Obeso, L. Giancardo, Á. Sánchez-Ferro (2019)
Remote Monitoring of Treatment Response in Parkinson's Disease: The Habit of Typing on a ComputerMovement Disorders, 34
Movement variability. The standard deviation of the distance of the actual path from the task axis
R. Adelman, L. Tmanova, Diana Delgado, Sarah Dion, M. Lachs (2014)
Caregiver burden: a clinical review.JAMA, 311 10
Execution time without pauses
Duration of the longest pause
[ (2010)
Crowdsourcing graphical perception: Using Mechanical Turk to assess visualization designProceedings of the 28th International Conference on Human Factors in Computing Systems (CHI’10). ACM
A. Hurst, S. Hudson, Jennifer Mankoff, Shari Trewin (2008)
Automatically detecting pointing performance
[ (2017)
Differences in crowdsourced vslab-based mobile and desktop input performance data. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI’17). ACM, 2017
N. Hogan, D. Sternad (2009)
Sensitivity of Smoothness Measures to Movement Duration, Amplitude, and ArrestsJournal of Motor Behavior, 41
R. Jagacinski, D. Repperger, Martin Moran, S. Ward, B. Glass (1980)
Fitts' law and the microstructure of rapid discrete movements.Journal of Experimental Psychology: Human Perception and Performance, 6
Krzysztof Gajos, Daniel Weld, J. Wobbrock (2010)
Automatically generating personalized user interfaces with SuppleArtif. Intell., 174
J. Westin, Samira Ghiamati, Mevludin Memedi, D. Nyholm, A. Johansson, M. Dougherty, T. Groth (2010)
A new computer method for assessing drawing impairment in Parkinson's diseaseJournal of Neuroscience Methods, 190
The fraction of the remaining distance along the task axis covered during the main submovement. The value of this measure can be greater than 1 if the person overshoots the target
A. Hooyman, J. Talboom, Matthew DeBoth, L. Ryan, M. Huentelman, S. Schaefer (2021)
Remote, Unsupervised Functional Motor Task Evaluation in Older Adults across the United States Using the MindCrowd Electronic CohortDevelopmental Neuropsychology, 46
(2022)
. 2019 . " I Think We Know More than Our Doctors " : How Primary Caregivers Manage Care Teams with Limited Disease - Related Expertise
Bernd Huber, Krzysztof Gajos (2020)
Conducting online virtual environment experiments with uncompensated, unsupervised samplesPLoS ONE, 15
[ (1998)
Ataxia telangiectasiaSeminars in Pediatric Neurology
Methods for obtaining accurate quantitative assessments of motor impairments are essential in accessibility research, design of adaptive ability-based assistive technologies, as well as in clinical care and medical research. Currently, such assessments are typically performed in controlled laboratory or clinical settings under professional supervision. Emerging approaches for collecting data in unsupervised settings have been shown to produce valid data when aggregated over large populations, but it is not yet established whether in unsupervised settings measures of research or clinical significance can be collected accurately and reliably for individuals. We conducted a study with 13 children with ataxia-telangiectasia and 9 healthy children to analyze the validity, test-retest reliability, and acceptability of at-home use of a recent active digital phenotyping system, called Hevelius. Hevelius produces 32 measures derived from the movement trajectories of the mouse cursor and then generates a quantitative estimate of motor impairment in the dominant arm using the dominant arm component of the Brief Ataxia Rating Scale (BARS). The severity score estimates generated by Hevelius from single at-home sessions deviated from clinician-assigned BARS scores more than the severity score estimates generated from single sessions conducted under researcher supervision. However, taking a median of as few as 2 consecutive sessions produced severity score estimates that were as accurate or better than the estimates produced from single supervised sessions. Further, aggregating as few as 2 consecutive sessions resulted in good test-retest reliability (ICC = 0.81 for A-T participants). This work demonstrated the feasibility of performing accurate and reliable quantitative assessments of individual motor impairments in the dominant arm through tasks performed at home without supervision by the researchers. Further work is needed, however, to assess how broadly these results generalize.
ACM Transactions on Accessible Computing (TACCESS) – Association for Computing Machinery
Published: Mar 28, 2023
Keywords: Active digital phenotyping
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.