Access the full text.
Sign up today, get DeepDyve free for 14 days.
Nancy Cooke, S. Shope (2017)
Designing a Synthetic Task Environment
B. Kapralos, R. Shewaga, Gary Ng (2014)
Serious Games: Customizing the Audio-Visual Interface
Kevin Cheng, P. Cairns (2005)
Behaviour, realism and immersion in gamesCHI '05 Extended Abstracts on Human Factors in Computing Systems
Ladan Shams, Robyn Kim (2010)
Crossmodal influences on visual perception.Physics of life reviews, 7 3
D. Gopher (2006)
Emphasis Change as a Training Protocol for High-Demand Tasks
James Blascovich, J. Bailenson (2011)
Infinite Reality: Avatars, Eternal Life, New Worlds, and the Dawn of the Virtual Revolution
M. Slater, Pankaj Khanna, J. Mortensen, Insu Yu (2009)
Visual Realism Enhances Realistic Response in an Immersive Virtual EnvironmentIEEE Computer Graphics and Applications, 29
Cha Lee, G. Rincon, Greg Meyer, Tobias Höllerer, D. Bowman (2013)
The Effects of Visual Realism on Search Tasks in Mixed Reality SimulationIEEE Transactions on Visualization and Computer Graphics, 19
J. Gosen, John Washbush (2004)
A Review of Scholarship on Assessing Experiential Learning EffectivenessSimulation & Gaming, 35
J. Tashiro, David Dunlap (2007)
The impact of realism on learning engagement in educational games
R. Storms, M. Zyda (2000)
Interactions in Perceived Quality of Auditory-Visual DisplaysPresence: Teleoperators & Virtual Environments, 9
Nicolas Bonneel, C. Suied, I. Viaud-Delmon, G. Drettakis (2010)
Bimodal perception of audio-visual material properties for virtual environmentsACM Trans. Appl. Percept., 7
K. Squire, Henry Jenkins (2003)
HARNESSING THE POWER OF GAMES IN EDUCATION
Elizabeth Veinott, Brandon Perleman, Emily Polander, James Leonard, Gloria Berry, R. Catrambone, E. Whitaker, Brian Eby, S. Mayell, Kinneret Teodorescu, Taleri Hammack, L. Lemaster (2014)
Is more information better? Examining the effects of visual and cognitive fidelity on learning in a serious video game2014 IEEE Games Media Entertainment
Georgia Mastoropoulou, K. Debattista, A. Chalmers, T. Troscianko (2005)
The influence of sound effects on the perceived smoothness of rendered animations
Christina Avila, A. Furnham, A. McClelland (2012)
The influence of distracting familiar vocal music on cognitive performance of introverts and extravertsPsychology of Music, 40
W. McGaghie, S. Issenberg, E. Petrusa, Ross Scalese (2010)
A critical review of simulation‐based medical education research: 2003–2009Medical Education, 44
D. Godden, A. Baddeley (1975)
Context-dependent memory in two natural environments: on land and underwater.British Journal of Psychology, 66
Vedad Hulusic, Carlo Harvey, K. Debattista, N. Tsingos, Steve Walker, D. Howard, A. Chalmers (2012)
Acoustic Rendering and Auditory–Visual Cross‐Modal Perception and InteractionComputer Graphics Forum, 31
Vedad Hulusic, K. Debattista, Vibhor Aggarwal, A. Chalmers (2010)
Maintaining frame rate perception in interactive environments by exploiting audio-visual cross-modal interactionThe Visual Computer, 27
F. Paas, A. Renkl, J. Sweller (2003)
Cognitive Load Theory and Instructional Design: Recent DevelopmentsEducational Psychologist, 38
K. Becker, J. Parker (2011)
The Guide to Computer Simulations and Games
Ladan Shams, Robyn Kim (2010)
Bayesian priors and multisensory integration at multiple levels of visual processing Reply to comments on "Crossmodal influences on visual perception"Physics of Life Reviews, 7
R. Mayer, R. Moreno (2003)
Nine Ways to Reduce Cognitive Load in Multimedia LearningEducational Psychologist, 38
S. Ribaupierre, B. Kapralos, F. Haji, Eleni Stroulia, A. Dubrowski, R. Eagleson (2014)
Healthcare Training Enhancement Through Virtual Reality and Serious Games
R. Hays, M. Singer (1989)
Simulation Fidelity in Training System Design
M. Slater, S. Wilbur (1997)
A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual EnvironmentsPresence: Teleoperators & Virtual Environments, 6
A. Furnham, Lisa Strbac (2002)
Music is as distracting as noise: the differential distraction of background music and noise on the cognitive test performance of introverts and extravertsErgonomics, 45
B. Cowan, David Rojas, B. Kapralos, K. Collins, A. Dubrowski (2013)
Psychological and Physiological Acoustics Session 3 pPP : Multimodal Influences on Auditory Spatial Perception 3 pPP 1 . Spatial sound and its effect on visual quality perception and task performance within a virtual environment
Cheryl Campanella, Bracken Paul (2006)
Presence and video games: The impact of image quality and skill level
B. Cowan, B. Kapralos (2011)
GPU-based acoustical occlusion modeling with acoustical texture maps
P. Rademacher, Jed Lengyel, Edward Cutrell, T. Whitted (2001)
Measuring the Perception of Visual Realism in Images
David Rojas, B. Kapralos, Sayra Cristancho, K. Collins, A. Hogue, C. Conati, A. Dubrowski (2012)
Developing Effective Serious Games: The Effect of Background Sound on Visual Fidelity Perception with Varying Texture ResolutionStudies in health technology and informatics, 173
D. Cook, S. Hamstra, R. Brydges, B. Zendejas, Jason Szostek, Amy Wang, P. Erwin, R. Hatala (2013)
Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysisMedical Teacher, 35
G. Norman, K. Dore, L. Grierson (2012)
The minimal relationship between simulation fidelity and transfer of learningMedical Education, 46
A. Chalmers, K. Debattista (2009)
Level of Realism for Serious Games2009 Conference in Games and Virtual Worlds for Serious Applications
W. Isaranuwatchai, R. Brydges, H. Carnahan, D. Backstein, A. Dubrowski (2014)
Comparing the cost-effectiveness of simulation modalities: a case study of peripheral intravenous catheterization trainingAdvances in Health Sciences Education, 19
Daniel Wilcox-Netepczuk (2013)
Immersion and realism in video games - The confused moniker of video game engrossmentProceedings of CGAMES'2013 USA
David Rojas, B. Cowan, B. Kapralos, K. Collins, A. Dubrowski (2015)
The effect of sound on visual realism perception and task completion time in a cel-shaded serious gaming virtual environment2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX)
E. Anyanwu (2015)
Background music in the dissection laboratory: impact on stress associated with the dissection experience.Advances in physiology education, 39 2
A. Seitz, Robyn Kim, Virginie Wassenhove, Ladan Shams (2007)
Simultaneous and Independent Acquisition of Multisensory and Unisensory AssociationsPerception, 36
B. Cowan, David Rojas, B. Kapralos, Fuad Moussa, A. Dubrowski (2015)
Effects of sound on visual realism perception and task performanceThe Visual Computer, 31
Slava Kalyuga, Paul Ayres, Paul Chandler, J. Sweller (2003)
The Expertise Reversal EffectEducational Psychologist, 38
David Rojas, B. Kapralos, A. Hogue, K. Collins, L. Nacke, Sayra Cristancho, C. Conati, A. Dubrowski (2013)
The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-DIEEE Transactions on Cybernetics, 43
David Rojas, B. Cowan, B. Kapralos, K. Collins, A. Dubrowski (2014)
The Effect of Contextual Sound Cues on Visual Fidelity PerceptionStudies in health technology and informatics, 196
C. Morris, P. Hancock, E. Shirkey (2004)
Motivational Effects of Adding Context Relevant Stress in PC-Based Game TrainingMilitary Psychology, 16
J. Driskell, J. Johnston, E. Salas (2001)
Does Stress Training Generalize to Novel Settings?Human Factors: The Journal of Human Factors and Ergonomics Society, 43
C. Spencer, J. Travis (1985)
Learning a new area with and without the use of tactile maps: a comparative studyBritish Journal of Visual Impairment, 3
A. Treisman, Jenefer Riley (1969)
Is selective attention selective perception or selective response? A further test.Journal of experimental psychology, 79 1
[Often, designers and developers of serious games (and virtual simulations in general) strive for high fidelity (realism). However, real-time high-fidelity rendering of complex environments across sensory modalities such as vision, audition, and haptic (sense of touch) is still beyond our computational reach. Previous work has demonstrated that multimodal effects can be considerable, to the extent that a large amount of detail of one sense may be ignored or enhanced by the presence of other sensory inputs. Taking advantage of such multimodal effects, perceptual-based rendering—whereby the rendering parameters are adjusted based on the perceptual system—can be employed to limit computational processing. Motivated by the general lack of emphasis given to the understanding of audio rendering in virtual environments and games, we have started investigating multimodal (audiovisual) interactions within such virtual environments. Our work has shown that sound can directly affect visual fidelity perception and task performance within a virtual environment. These effects can be very individualized, whereby the influence of sound is dependent on various individual factors including musical listening preferences, suggesting the importance of individualizing the virtual environment to each user. This chapter begins with an overview of virtual environments and serious gaming’s open problems, with an emphasis on fidelity, and multimodal interactions, and the implications that these may have on performance and computational requirements. A detailed summary of our own prior work will be provided along with insight and suggestions that may guide designers and developers of serious games and virtual learning environments in general. Although the chapter is contextualized in the use of serious games in health professions education, the information provided is generalizable across a variety of domains.]
Published: Nov 1, 2016
Keywords: Serious gaming; Virtual simulation; Fidelity; Realism; Audiovisual cue interaction, multimodal interaction
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.