Natural User Interface for Education in Virtual Environments

• Authors: Stefan Stavrev
• Languages of publication: EN

Abstracts

EN

Education and self-improvement are key features of human behavior. However, learning in the physical world is not always desirable or achievable. That is how simulators came to be. There are domains where purely virtual simulators can be created in contrast to physical ones. In this research we present a novel environment for learning, using a natural user interface. We, humans, are not designed to operate and manipulate objects via keyboard, mouse or a controller. The natural way of interaction and communication is achieved through our actuators (hands and feet) and our sensors (hearing, vision, touch, smell and taste). That is the reason why it makes more sense to use sensors that can track our skeletal movements, are able to estimate our pose, and interpret our gestures. After acquiring and processing the desired – natural input, a system can analyze and translate those gestures into movement signals.

Keywords

EN

simulators; virtual environments; 3D environment; serious gaming; sensors; education with Kinect

• Publisher: Uniwersytet Łódzki. Wydawnictwo Uniwersytetu Łódzkiego
• Journal: Replay. The Polish Journal of Game Studies
• Year: 2016
• Volume: 3
• Issue: 1
• Pages: 67-80

Dates

published

2017-08-22

Contributors

author

Stefan Stavrev

• Plovdiv University Paisii Hilendarski

References

• Active Words. (2008, September 18). Retrieved March 10, 2016, from http://www.activeworlds.com
• Aebersold, M., Tschannen, D., & Bathish, M. (2012). Innovative Simulation Strategies in Education. Nursing Research and Practice, 2012, 1–7.
• Avancini, M. (2012). Using Kinect to emulate an Interactive Whiteboard (Unpublished master’s thesis). Universita Degli Studi Di Trento.
• Barbosa, H. (2014). Delivering 3D, Simulation and Serious Gaming For Education and Training. 3D Visualization World Magazine.
• Bhattacharya, A., Paul, P. S., & Goon, S. (2012). History and comparative study of modern game engines. IJAMS International Journal of Advanced Mathematical Sciences, 3(2), 245–249. Retrieved from ISSN.
• Bontchev, B., & Vassileva, D. (2006). Software architecture of a self-adaptive hypermedia e-learning system. In Proc. of 3rd Int. Conf. on Computer Science. Istanbul, Turkey.
• Bronack, S., Sanders, R., Cheney, A., Riedl, R., Tashner, J., & Matzen, N. (2008). Presence Pedagogy: Teaching and Learning in a 3D Virtual Immersive World. International Journal of Teaching and Learning in Higher Education, 20(1), 59–69.
• Dawley, L., & Dede, C. (2014). Situated learning in virtual worlds and immersive simulations. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), The Handbook of Research for Educational Communications and Technology (4th ed.). 723–734.
• Dimitropoulos, K., Manitsaris, A., & Mavridis, I. (2008). Building Virtual Reality Environments for Distance Education on the Web: a Case Study in Medical Education. International Journal Of Social Sciences, 2(1).
• Freitas, S. D., & Liarokapis, F. (2011). Serious Games: a New Paradigm for Education? Serious Games and Edutainment Applications, 9–23.
• Galland, S., Gaud, N., Demange, J., & Koukam, A. (2014). Multilevel Model of the 3D Virtual Environment for Crowd Simulation in Buildings. Procedia Computer Science, 32, 822–827.
• Gaming and simulations: Concepts, methodologies, tools and applications (2011). Hershey PA, NY: Information Science Reference.
• How to use 3D content in simulations for teaching and learning (n.d.). Retrieved September 23, 2014, from https://www.jisc.ac.uk/blog/3d-in-teaching-and-learning-23-sep-2014
• Johnson, M. H. (2005). Sensitive periods in functional brain development: Problems and prospects. Dev. Psychobiol. Developmental Psychobiology, 46(3), 287–292.
• Kinect – Windows app development (n.d.). Retrieved March 10, 2016, from https://www.microsoft.com/en-us/kinectforwindows/
• Knickmeyer, R. C., Gouttard, S., Kang, C., Evans, D., Wilber, K., Smith, J. K., Gilmore, J. H. (November 19, 2008). A Structural MRI Study of Human Brain Development from Birth to 2 Years. Journal of Neuroscience, 28(47), 12176–12182.
• National Research Council and Institute of Medicine (2000). From Neurons to Neighborhoods: The Science of Early Childhood Development. Washington, D.C.: National Academy Press.
• Sawyer, B., Rejeski D. (2002). Serious Games: Improving Public Policy through Game-Based Learning and Simulation. Washington, DC: Woodrow Wilson International Center for Scholars.
• Stavrev S., Terzieva T. (2015). Virtual environment simulator for educational safety crossing. Proceedings of the 11th Annual International Conference on Computer Science and Education in Computer Science (CSECS), June 4th to June 7th, 2015, Boston, MA, USA, pp. 92–98, ISSN 1313–8624.
• Wagner, R. (2012). Learning with Digital Games: a Practical Guide to Engaging Students in Higher Education – By Nicola Whitton. Teaching Theology & Religion, 15(1), 91–92.
• Whitton, N., & Moseley, A. (2012). Authentic contextual games for learning. In Whitton, N., & Moseley, A. (Eds.), Using games to enhance learning and teaching: a beginner’s guide, U.S.A.
• Zyda, M., Mayberry, A., Mccree, J., & Davis, M. (2005). From Viz-Sim to VR to Games: How We Built a Hit Game-Based Simulation. Organizational Simulation Rouse/Organizational, 553–590.
• Rockstar North (2013), GTA V (GOTY edition) [videogame][DVD-ROM][Microsoft Windows], Rockstar Games
• TRI Soft (2015), Virtual Platform for Safety Crossing [videogame][DVD-ROM][Microsoft Windows], Didasko Ltd.

Identifiers

DOI

10.18778/2391-8551.03.04