Computer games have emerged in the past
decade as potential media beyond entertainment. Despite its popularity, game
accessibility remains a major concern of various researchers. Children
population with motor disabilities is a potential target for developing
entertainment or therapeutic support games due to their interest to play. This
paper presents: (1) a framework for mobile games for children with motor
disability using simple hand postures and (2) xgboost decision tree as a hand
posture recognizer (98.48 percent training accuracy and 96.76 percent testing
accuracy) as a prototype of hand posture-based commands as assistive technology
to interact with games.
[1]
Cambridge English Dictionary. Game. Cambridge English Dictionary Online,
accessed July 27, 2018.
https://dictionary.cambridge.org/dictionary/english/computer-game
[2]
Collins English Dictionary. Computer Game. Collins English Dictionary,
accessed July 27, 2018. https://www.collinsdictionary.com/dictionary/english/computer-game
[3]
Wen, T., Wang, L., Gu, J., & Huang, B. (2009, June). A 3-D
acceleration-based control algorithm for interactive gaming using a head-worn
wireless device. In Bioinformatics and Biomedical Engineering, 2009. ICBBE
2009. 3rd International Conference on (pp. 1-3). IEEE.
[4]
Kementrian Kesehatan RI, “Situasi Penyandang Disabilitas,” Bul. Jendela
Data Inf. Kesehat., vol. Semester 2, no. 1, pp. 1–5, 2014.
[5]
Song, Y., Luo, Y., & Lin, J. (2011, November). Detection of
movements of head and mouth to provide computer access for disabled. In 2011
Conference on Technologies and Applications of Artificial Intelligence (pp.
223-226). IEEE.
[6]
Alhargan, A., Cooke, N., & Binjammaz, T. (2017, October). Affect
recognition in an interactive gaming environment using eye tracking. In
Affective Computing and Intelligent Interaction (ACII), 2017 Seventh
International Conference on (pp. 285-291). IEEE.
[7]
K. Bierre, M. Hinn, T. Martin, and M. McIntosh, “Accessibility in Games:
Motivations and Approaches,” … Pap. Int. Game …, 2004.
[8]
B. Yuan, E. Folmer, and F. C. Harris, “Game accessibility: A survey,”
Univers. Access Inf. Soc., vol. 10, no. 1, pp. 81–100, 2011.
[9]
Palisano, R. J. (2006). A collaborative model of service delivery for children
with movement disorders: a framework for evidence-based decision making.
Physical Therapy, 86(9), 1295-1305.
[10]
Kumar, D., & Sharma, A. (2016, September). Electrooculogram-based
virtual reality game control using blink detection and gaze calibration. In
Advances in Computing, Communications and Informatics (ICACCI), 2016
International Conference on (pp. 2358-2362). IEEE.
[11]
Lu, F., Okabe, T., Sugano, Y., & Sato, Y. (2014). Learning gaze
biases with head motion for head pose-free gaze estimation. Image and Vision
Computing, 32(3), 169-179.
[12]
A. Gardner, J. Kanno, C. A. Duncan, and R. Selmic. 'Measuring distance
between unordered sets of different sizes,' in 2014 IEEE Conference on Computer
Vision and Pattern Recognition(CVPR), June 2014, pp. 137-143.
[13]
A. Gardner, C. A. Duncan, J. Kanno, and R. Selmic. '3D hand posture
recognition from small unlabeled point sets,' in 2014 IEEE International
Conference on Systems, Man and Cybernetics (SMC), Oct 2014, pp. 164-169.
[14]
Vickers, S., Istance, H., & Heron, M. J. (2013, April). Accessible
gaming for people with physical and cognitive disabilities: a framework for
dynamic adaptation. In CHI'13 Extended Abstracts on Human Factors in Computing
Systems (pp. 19-24). ACM.
[15]
Chen, T., & Guestrin, C. (2016, August). Xgboost: A scalable tree
boosting system. In Proceedings of the 22nd acm sigkdd international conference
on knowledge discovery and data mining (pp. 785-794). ACM.
[16]
V. Ghini, S. Ferretti, and F. Panzieri, “Mobile Games Through the Nets:
A Cross-layer Architecture for Seamless Playing,” Proc. 3rd Int. ICST Conf.
Simul. Tools Tech., p. 7:1--7:8, 2010.
[17]
M. Furini, “An architecture to easily produce adventure and movie games
for the mobile scenario,” Comput. Entertain., vol. 6, no. 2, p. 19:1--19:16,
2008.
[18]
Y. Francillette et al., “Development of an Exergame on Mobile Phones to
Increase Physical Activity for Adults with Severe Mental Illness,” Proc. 11th
PErvasive Technol. Relat. to Assist. Environ. Conf. - PETRA ’18, pp. 241–248, 2018.
[19]
K. M. Gerling, R. L. Mandryk, M. V. Birk, M. Miller, and R. Orji, “The
effects of embodied persuasive games on player attitudes toward people using
wheelchairs,” Proc. 32nd Annu. ACM Conf. Hum. factors Comput. Syst. - CHI ’14,
pp. 3413–3422, 2014.
[20]
E. Mena and C. Bobed, “Mobile Agents for Mobile Games,” Proc. 2nd Work.
Mob. Gaming - MobiGames ’15, pp. 37–42, 2015.
[21]
C. Wiberg, “Game-Inspired Architecture and Architecture-Inspired Games,”
pp. 68–70.
[22]
G. W. Tigwell, R. Menzies, and D. R. Flatla, “Designing for Situational
Visual Impairments,” Proc. 2018 Des. Interact. Syst. Conf. 2018 - DIS ’18, pp. 387–399, 2018.
[23]
A. Akkawi, S. Schaller, O. Wellnitz, and L. Wolf, “A mobile gaming
platform for the IMS,” Proc. ACM SIGCOMM 2004 Work. NetGames ’04 Netw. Syst.
Support games - SIGCOMM 2004 Work., p. 77, 2004.
[24]
S. Harper, C. Goble, and R. Stevens, “Prototype mobility tools
for visually impaired surfers,” Proc. twelfth ACM Conf. Hypertext Hypermedia HYPERTEXT
01, vol. 筑波大学, p. 33, 2001.
[25]
P. Service and L. Search, “No Title.”
[26]
R. Hamzah and M. I. M. Fadzil, “Voice4Blind: The talking braille
keyboard to assist the visual impaired users in text messaging,” Proc. - 2016
4th Int. Conf. User Sci. Eng. i-USEr 2016, pp. 265–270, 2017.
[27]
B. Lamont, “Deafblind UK expands operations in Northern Ireland to
further reduce isolation and enhance the lives of older deafblind people,”
Work. with Older People, vol. 17, no. 4, pp. 164–169, 2013.
[28]
D. Doughty and K. Doughty, “Journal of assistive technologies.,” J.
Assist. Technol., vol. 7, no. 4, pp. 228–234, 2013.
[29]
G. Papanastasiou, A. Drigas, C. Skianis, M. Lytras, and E.
Papanastasiou, “Patient-centric ICTs based healthcare for students with
learning, physical and/or sensory disabilities,” Telemat. Informatics, vol. 35,
no. 4, pp. 654–664, 2018.
[30]
O. Lahav, “Virtual reality as orientation and mobility aid for blind
people,” J. Assist. Technol., vol. 8, no. 2, pp. 95–107, 2014.
[31]
J. Meurer, M. Stein, D. Randall, and V. Wulf, “Designing for way-finding
as practices – A study of elderly people’s mobility,” Int. J. Hum. Comput.
Stud., vol. 115, pp. 40–51, 2018.
[32]
S. Holt and N. Yuill, “Tablets for two: How dual tablets can facilitate
other-awareness and communication in learning disabled children with autism,”
Int. J. Child-Computer Interact., vol. 11, pp. 72–82, 2017.
[33]
Á. Fernández-López, M. J. Rodríguez-Fórtiz, M. L. Rodríguez-Almendros,
and M. J. Martínez-Segura, “Mobile learning technology based on iOS devices to
support students with special education needs,” Comput. Educ., vol. 61, no. 1,
pp. 77–90, 2013.
[34]
B. J. Westphal, H. Lee, N.-M. Cheung, C. G. Teo, and W. K. Leong,
“Experience of designing and deploying a tablet game for people with dementia,”
Proc. 29th Aust. Conf. Comput. Interact.
- OZCHI ’17, pp. 31–40, 2017.
[35]
B. Leporini and M. Hersh, “Games for the rehabilitation of disabled
people,” Proc. 4th Work. ICTs Improv. Patients Rehabil. Res. Tech. - REHAB ’16,
pp. 109–112, 2016.
[36]
“P335-Gotfrid,” pp. 335–336.
[37]
R. M. Bottino, L. Freina, M. Ott, and F. Costa, “Cloud-mobile Assistive
Technologies for People with Intellectual Impairments,” Proc. 5th Int. Conf.
Digit. Heal. 2015 - DH ’15, pp. 103–104, 2015.
[38]
A. G. Szykman, J. P. Gois, and A. L. Brandão, “A Perspective of Games
for People with Physical Disabilities,” Proc. Annu. Meet. Aust. Spec. Interes.
Gr. Comput. Hum. Interact. - OzCHI ’15, pp. 274–283, 2015.
[39]
L. Salvador-Ullauri, A. Jaramillo-Alcázar, and S. Luján-Mora, “A Serious
Game Accessible to People with Visual Impairments,” Proc. 2017 9th Int. Conf.
Educ. Technol. Comput. - ICETC 2017,
vol. 2016, pp. 84–88, 2017.
[40]
A. Jaramillo-Alca and S. Luja N-Mora, “Mobile Serious Games: An
Accessibility Assessment for People with Visual Impairments,” ACM Ref., vol. 6,
pp. 1–6, 2017.
[41]
D. Miller, A. Parecki, and S. A. Douglas, “Finger dance: a sound game
for blind people,” Proc. 9th Int. ACM SIGACCESS Conf. Comput. Access., pp.
253–254, 2007.
[42]
S. B. Fajardo-Flores, L. S. Gaytán-Lugo, P. C. Santana-Mancilla, and M.
A. Rodríguez-Ortiz, “Mobile Accessibility for People with Combined Visual and
Motor Impairment,” Proc. 8th Lat. Am. Conf. Human-Computer Interact. - CLIHC ’17, pp. 1–4, 2017.
[43]
A. Jaramillo-Alcazar, S. Lujan-Mora, and L. Salvador-Ullauri,
“Accessibility Assessment of Mobile Serious Games for People with Cognitive
Impairments,” 2017 Int. Conf. Inf. Syst. Comput. Sci., pp. 323–328, 2017.
[44]
J. M. López, N. M. Medina, and R. P. de Lope, “Interaction in video
games for people with impaired visual function,” Proc. XVII Int. Conf. Hum.
Comput. Interact. - Interacción ’16, pp. 1–2, 2016.
[45]
B. Gallagher and H. Petrie, “Initial results from a critical review of
research on technology for older and disabled people,” Proc. 15th Int. ACM
SIGACCESS Conf. Comput. Access. - ASSETS ’13, pp. 1–2, 2013.
[46]
M. Poyade, G. Morris, I. Taylor, and V. Portela, “Using mobile virtual
reality to empower people with hidden disabilities to overcome their barriers,”
Proc. 19th ACM Int. Conf. Multimodal Interact.
- ICMI 2017, pp. 504–505, 2017.
[47]
M. I. H. R\’\ios, S. S. Silva, E. I. R. D\’\iaz, and N. T. Monterrosa,
“YAMI: Auxiliary Complement to Enable Visually Impaired People to Use Mobile
Devices,” Proc. 8th Lat. Am. Conf. Human-Computer Interact., p. 24:1--24:4,
2017.
[48]
A. M. Cook and J. M. Polgar, “Technologies that Assist People Who Have
Disabilities,” Assist. Technol., pp. 16–39, 2015.
[49]
J. Colman, J. Briggs, A. Good, and L. Turner, “Investigating
multi-player online video games for brain-injured people,” J. Assist. Technol.,
vol. 8, no. 3, pp. 124–137, 2014.
[50]
L. Chmiliar and C. Anton, “The iPad as a mobile assistive technology
device,” J. Assist. Technol., vol. 9, no. 3, pp. 127–135, 2015.
[51]
L. Rello, G. Kanvinde, and R. Baeza-Yates, “A mobile application for
displaying more accessible ebooks for people with dyslexia,” Procedia Comput.
Sci., vol. 14, no. Dsai, pp. 226–233, 2012.
[52]
N. Al-Mouh and H. S. Al-Khalifa, “The accessibility and usage of
smartphones by Arab-speaking visually impaired people,” Int. J. Pervasive
Comput. Commun., vol. 11, no. 4, pp. 418–435, 2015.
[53]
S. L. Maatta and L. J. Bonnici, “An evaluation of the functionality and
accessibility of e-readers for individuals with print disabilities,” Electron.
Libr., vol. 32, no. 4, pp. 493–507, 2014.
[54]
E. E. Abdallah and E. Fayyoumi, “Assistive Technology for Deaf People
Based on Android Platform,” Procedia Comput. Sci., vol. 94, no. Fnc, pp.
295–301, 2016.
[55]
H. Ahn et al., “DOWELL : Dwell-time Based Smartphone Control Solution
for People with Upper Limb Disabilities,” CHI EA ’15 Proc. 33rd Annu. ACM Conf.
Ext. Abstr. Hum. Factors Comput. Syst., pp. 887–892, 2015.
[56]
E. P. S. Nunes, A. R. Luz, E. M. Lemos, C. Maciel, A. M. Anjos, and L.
C. L. F. Borges, “Mobile Serious Game Proposal for Environmental Awareness of
Children,” 2016.
[57]
V. Real and C. Science, “State of the Art of Accessible Development for
Smart Devices.”
[58]
A. Lopez-Basterretxea, A. Mendez-Zorrilla, B. Garcia-Zapirain, A.
Madariaga-Ortuzar, and I. Lazcano-Quintana, “Serious games to promote
independent living for intellectually disabled people: Starting with shopping,”
Proc. CGAMES 2014 USA - 19th Int. Conf. Comput.