Focus

XR, Education Technology, Inclusve Design

Virtual reality (VR) provides immersive experiences to users by replicating interactive physical environments digitally, while Augmented Reality (AR) mixes live, real-world visual content with digital elements typically on mobile or wearable devices. Recent advances in creative and education technologies have even made mixed reality experiences possible using see-through head-mounted devices (HMD). Various extended reality (XR) technologies can now aid in knowledge-based demonstrations and educational experiences (Marsh and Costello, 2012; Domingo et al., 2018; Horst and Dorner, 2018; Dey et al., 2018), applicable to a wide range of non-gaming scenarios and simulations. VR applications have also been explored for use in various therapeutic and social good contexts. For instance, studies have shown that VR can help manage the well-being of dementia patients (Rose et al., 2018) in assisted scenarios. The study by Guillén et al. (2018) highlighted the possibilities and importance of customisable VR content for enhancing stress-management therapy, with very positive usability results and feedback from users. VR research focused on restorative and relaxation applications (Blum et al., 2019; Valtchanov et al., 2010; Roche et al., 2019) has shown useful and positive findings in improving mental wellness, especially in the context of physical illness or disability. Inclusive design is a human-centered or user-centered design methodology that provides a framework for understanding the needs, wants, and limitations of end users (Center for Inclusive Design, 2019). At the Inclusive XR Collaboratory, we are interested in XR for good, which aims to support people in improving their health, functioning, and well-being, and in making playable experiences and learning simulation technologies available to more people.

Special Issue Journal

Virtual Creativity

Welcome to the 11th volume of Virtual Creativity, a Special Issue edited by Zi Siang See, Benjamin Matthews and Denise Doyle. It presents research into the transformative effects of extended reality (XR) technologies, which have great potential to generate social good in a range of contexts including creative industries, connected health and well-being, psychology, medicine, remote collaboration, digital heritage, digital humanities, education and training - visit the publisher's website (Intellect Books) for more details.

Collaboration

On-going AR VR Research

We are proud to be connected with Virtual & Augmented Reality Research Network (VARRN, Asia Pacific), Centre for Inclusive Design (NSW, Australia) and SMARTlab Academy (Ireland) focused on research in Simulation Learning, Serious Games, and Extended Reality. This network aims to bring together leading AR and VR researchers to collaborate on multi-institutional projects. Our network includes concentrated research hubs at the Center for Research-Creation in Digital Media at Sunway University (Malaysia), Nanyang Technological University (Singapore), University College Dublin (Ireland), University of Newcastle (Australia), Charles Sturt University (Australia), Jakarta Institute of Arts (Indonesia), Taylor's University (Malaysia), Bangkok University (Thailand) and Heriot-Watt University (UK).

Featured Student Work

Playable Experiences

Supporting students and young researchers is our number one priority! Our research and practice are multidisciplinary and bring together the fields of education technologies, digital humanities and digital health. The student researchers incorporate decision-making and user interface (UI) design into their computer-based learning materials and solutions. Some of the laboratory activities include guiding students to work in the makers lab with fundamental 3D scanning and web creation techniques.

Featured Research

Sodeisha VR

This research presents the development of a virtual reality (VR) research project for the VR interaction and digitization of “Sodeisha Sculptural Ceramics”, a transmedia approach showcases photogrammetry scanned Japanese ceramic artworks in an educational and public VR exhibition setting. Newcastle Art Gallery holds one of the largest collections of Sodeisha ceramics (created by the innovative Japanese post-war artist group, known as ‘Sodeisha’) outside of Japan and recently featured the collection in a large-scale exhibition titled SODEISHA: connected to Australia (2019). Doi: https://doi.org/10.1145/3359997.3365741

Featured Research

This Land Augmented Reality

This demonstration presents a development of an Augmented Reality (AR) Indigenous music and sound installation, an extended reality and interactive audible experiential approach for augmenting audible elements in a public exhibition setting. It is a transmedia initiative as part of a music project, This Land. The project connected contributors and musicians, involving traditional to contemporary vocal and instrumental sounds. Doi: https://doi.org/10.1145/3359997.3365740

Research VLOG

VRCAI-SIGGRAPH and SA2019

Some of the research by us and our friends presented in 17th ACM SIGGRAPH Internation Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI-SIGGRAPH), and SIGGRAPH Asia 2019 (Brisbane, Australia)

International Collaboration

Zi Siang See, Manisha Amin, Lizbeth Goodman, Mark Billinghurst, Wooi Har Ooi (Haireena), Denise Doyle, Donovan Jones, Shanna Fealy, Susan Ledger, Marguerite Johnson, Simone O'Callaghan, Xia Sheng Lee (Bruce), Harold Thwaites, Matthew Sansom, Benjamin Matthews, Nikolas Orr, Andrew Burrell, Jamin Day, Divya Seengal, Jean-Luc Schmid, Kaitlyn Dierikx, Delas Santano, Human Esmaeili, Gillian Arrighi, Philip Matthias, Jamin Day, Craig Hight, Paul Egglestone, Michael Cuneo, Mohd Shahrizal Sunar, Arindam Dey, Yen Kaow Ng, Una Rey, Faye Neilson, Alexander Barnes-Keoghan, Luke O'Donnell, Sarah Johnson, Jack McGrath, Matthew Gidney, Chi How Fong, Kamarulzaman Ab Aziz, Adam Brimo, David Blundell, Simone O'Callaghan, Bernadette Drabsch, Shelly Soo, Vimalan Rengganaten, Mohd Faris Khamidi, ChangSaar Chai, Susan Marie Effenberger, Greg Oates, David Hicks, Cyndia Hilliger, Justin McErlain.



Partnership



Research Publications

Zi Siang See, Benjamin Matthews, Jamin Day, Nicole Carroll, Jack McGrath, Manisha Amin (2024) Inclusive Virtual Simulation Space: Digital Technologies and Design Thinking Process. Virtual Creativity, Volume 13, Issue 1, pp. 49-67, Intellect.
Research: https://doi.org/10.1386/vcr_00074_1

Divya Seengal, Simone O’Callaghan, Zi Siang See (2024) Design Beyond Screen: A Primer for Designing Mobile Augmented Reality Storytelling Application. Peer Review Proceedings of the Sixteenth International Conference on Design Principles & Practices. Common Ground Research Networks.
Research: https://cgscholar.com/bookstore/works/277236 / https://doi.org/10.18848/978-1-963049-18-3/CGP

Jean-Luc Schmid, Zi Siang See, Simone O’Callaghan (2024) 3D Scanned Nature-based Virtual Environment Design: A Hunter Valley (NSW, Australia) Case Study. Peer Review Proceedings of the Sixteenth International Conference on Design Principles & Practices. Common Ground Research Networks.
Research: https://cgscholar.com/bookstore/works/277236 / https://doi.org/10.18848/978-1-963049-18-3/CGP

Kaitlyn Dierikx, Zi Siang See, Luis Alexander Rojas Bonilla, Erin Conley (2024) Development of a Virtual Reality Prototype for Architectural Visualisation with the Integration of Dynamic Electroencephalogram in the Creative Thinking Process. Peer Review Proceedings of the Sixteenth International Conference on Design Principles & Practices. Common Ground Research Networks.
Research: https://cgscholar.com/bookstore/works/277236 / https://doi.org/10.18848/978-1-963049-18-3/CGP

Simon Weaving, Benjamin Matthews, Zi Siang See (2024) We’d Like to Give You some Presence: Cinematic VR narration and the sense of 'being there'. Peer Review Proceedings of the Sixteenth International Conference on Design Principles & Practices. Common Ground Research Networks.
Research: https://cgscholar.com/bookstore/works/277236 / https://doi.org/10.18848/978-1-963049-18-3/CGP

Matt Gidney, Jack McGrath, Zi Siang See (2024) The Dining Car: Experiments with Retinal Rivalry in Virtual Reality. Peer Review Proceedings of the Sixteenth International Conference on Design Principles & Practices. Common Ground Research Networks.
Research: https://cgscholar.com/bookstore/works/277236 / https://doi.org/10.18848/978-1-963049-18-3/CGP

Zi Siang See, Greg Oates, David Hicks, Cyndia Hilliger, Justin McErlain, Jean-Luc Schmid, Kaitlyn Dierikx (2023) Table Cape VR Education Technology Project: An Immersive Learning Experience of Walking with Giants. ACM SIGGRAPH Asia Educators Forum. Sydney, 12-15 December 2023.
Research: https://doi.org/10.1145/3610540.3627002

Shanna Fealy, Pauletta Irwin, Zeynep Tacgin, Zi Siang See, Donovan Jones (2023) Addressing challenges in nursing education in preparing work ready graduates: A discussion of extended reality (XR) innovation. Virtual Worlds (MDPI). Vol 2(3), pp. 218-230.
Research: https://doi.org/10.3390/virtualworlds2030013

Zi Siang See, Susan Ledger, Lizbeth L Goodman, Benjamin Matthews, Donovan Jones, Shanna Fealy, Wooi Har Ooi, Manisha Amin (2023) Playable Experiences Through Technologies: Opportunities and Challenges for Teaching Simulation Learning and Extended Reality Solution Creation. Journal of Information Technology Education: Innovations in Practice. Volume 22, pp. 067-090.
Research: https://doi.org/10.28945/5121

Simone O'Callaghan, Bernadette Drabsch, Zi Siang See (2023) Design Principles and Practices Editorial: Introduction to the Special Issue 2022. Design Principles and Practices: An International Journal - Annual Review. Common Ground Research Networks.
Research: https://doi.org/10.18848/1833-1874/CGP/v16i01/0-0

Donovan Jones, Darrell Evans, Michael Hazelton, Zi Siang See, Shanna Fealy (2022) The Development of the Compromised Neonate: A Virtual Reality Neonatal Resuscitation Program. pp. 89-108. Enhanced Learning Environments: Technology and Innovation. Cambridge Scholar Publishing.
Research: https://www.cambridgescholars.com/product/978-1-5275-8770-0

Nikolas Orr, Benjamin Matthews, Zi Siang See, Andrew Burrell, Jamin Day, Divya Seengal (2021) Transdisciplinarity in extended reality (XR) research design: Technological transformation and social good (co-creation session at XR + Creativity Symposium, University of Newcastle, 2020). Virtual Creativity, Volume 11, Number 1, pp. 163-179(17), Intellect.
Research: https://doi.org/10.1386/vcr_00048_1

Matthew Sansom, Zi Siang See (2021) Translating Performative Mediated Art into Virtual Reality: A Case Study. Virtual Creativity, Volume 11, Number 1, pp. 53-65(13), Intellect.
Research: https://doi.org/10.1386/vcr_00042_1

Benjamin Matthews, Zi Siang See, Denise Dolye (2021) XR and creativity: Transformative technologies for good. Virtual Creativity, Volume 11, Number 1, pp. 3-7(5), Intellect.
Research: https://doi.org/10.1386/vcr_00039_2

Donovan Jones, Michael Hazelton, Darrel Evans, Vendela Pento, Zi Siang See, Luka Van Leugenhaege, Shanna Fealy (2021) The Road to Birth: Using Digital Technology to Visualise Pregnancy Anatomy. Digital Anatomy, pp. 325-342, Human Computer Interaction Series, Springer International Publishing.
Research: https://doi.org/10.1007/978-3-030-61905-3_17

Gillian Arrighi, Zi Siang See, Donovan Jones (2021) Victoria Theatre Virtual Reality: A Digital Heritage Case Study and User Experience Design. Digital Applications in Archaeology and Cultural Heritage, Volume 21, e00176, Elsevier.
Research: https://doi.org/10.1016/j.daach.2021.e00176

Zi Siang See, Benjamin Matthews, Donovan Jones, Lizbeth Goodman, Craig Hight, Paul Egglestone, Manisha Amin, Wooi Har Ooi (2020) Extended Reality Interactive Wall: User Experience Design Research-Creation. Virtual Creativity, Volume 10, Number 2, pp. 163-174(12), Intellect.
Research: https://doi.org/10.1386/vcr_00030_1

Benjamin Matthews, Zi Siang See, Jamin Day (2020) Crisis and Extended Realities: remote presence in the time of COVID-19. Media International Australia, Volume 178, Issue 1, SAGE Publications.
Research: https://doi.org/10.1177/1329878X20967165

Zi Siang See, Lizbeth Goodman, Craig Hight, Mohd Shahrizal Sunar, Arindam Dey, Yen Kaow Ng, Mark Billinghurst (2019) Creating high fidelity 360º virtual reality with high dynamic range spherical panorama images. Virtual Creativity, Volume 9, Numbers 1-2, 1 December 2019, pp. 73-109(37), Intellect.
Research: zisiangsee_research_p005.pdf / https://doi.org/10.1386/vcr_00006_1

Philip Matthias, Mark Billinghurst and Zi Siang See (2019) This Land AR: an Australian Music and Sound XR Installation. In The 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI '19), 14-16 November 2019, Brisbane, Queensland, Australia.
Research: https://doi.org/10.1145/3359997.3365740

Zi Siang See, Una Rey, Faye Neilson, Michael Cuneo, Alexander Barnes-Keoghan, Luke O'Donnell, Donovan Jones, Lizbeth Goodman and Sarah Johnson (2019) Sodeisha Sculptural Ceramics: Digitalization and VR Interactions. In The 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI '19), 14-16 November 2019, Brisbane, Queensland, Australia.
Research: https://doi.org/10.1145/3359997.3365741

Donovan Jones, Zi Siang See, Mark Billinghurst, Lizbeth Goodman and Shanna Fealy (2019) Extended Reality for Midwifery Learning: MR VR Demonstration. In The 17th ACM SIGGRAPH 17th International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI '19), 14-16 November 2019, Brisbane, Queensland, Australia.
Research: https://doi.org/10.1145/3359997.3365739

Zi Siang See, Una Rey, Faye Neilson, Michael Cuneo, Alexander Barnes-Keoghan, Luke O'Donnell, Donovan Jones, Lizbeth Goodman and Sarah Johnson (2019) Sodeisha Avant-grade Ceramic: High Fidelity Digitization, Virtual Reality, and Interaction Design. 2019 Pacific Neighborhood Consortium Annual Conference and Joint Meetings, Electronic Cultural Atlas Initiative. Singapore, 15-18 October 2019.
Research: zisiangsee_et_al_research042_sodeisha_vr_ecai_20191002a.pdf / Electronic Cultural Atlas Initiative

Zi Siang See, Delas Santano, Matthew Sansom, Chi How Fong and Harold Thwaites (2018). Tomb of a Sultan: A VR Digital Heritage Approach. 2018 3rd Digital Heritage International Congress (DigitalHERITAGE) held jointly with 2018 24th International Conference on Virtual Systems & Multimedia (VSMM 2018). San Fransisco, USA, October 2018
Research: zisiangsee_collaboration_research_p024.pdf / https://doi.org/10.1109/DigitalHeritage.2018.8810083

Harold Thwaites, Delas Santano, Human Esmaeili, Zi Siang See (2019) A Malaysian cultural heritage digital compendium. Digital Applications in Archaeology and Cultural Heritage.
Research: https://doi.org/10.1016/j.daach.2019.e00116

Delas Santano, Zi Siang See, Chi How Fong, Harold Thwaites (2018) Up in the Air with VR360. Virtual Creativity. Vol 8 No. 1, pp. 59-73 (15).
Research: https://doi.org/10.1386/vcr.8.1.59_1

Zi Siang See, Mohd Shahrizal Sunar, Kamarulzaman Ab Aziz, Agus Kusnayat (2018) Interactive Panorama VR360 for Corporate Communications: An Industrial Scenario Case Study. International Journal of Integrated Engineering. Vol. 10 No. 6 (2018) pp. 169-177.
Research: http://penerbit.uthm.edu.my/ojs/index.php/ijie/article/view/2832

Zi Siang See, Xia Sheng Lee, Adam Brimo, Harold Thwaites, Lizbeth Goodman (2018) MOOC for AR VR Training. 2018 IEEE Games, Entertainment, Media Conference (GEM). Galway, Ireland.
Research: zisiangsee_collaboration_research_p023.pdf / IEEE

Zi Siang See, Mohd Shahrizal Sunar, Mark Billinghurst, Arindam Dey, Delas Santano, Human Esmaeili, Harold Thwaites (2017) Exhibition Approach Using an AR and VR Pillar. Siggraph Asia 2017 Mobile Graphics and Interactive Application.
Research: zisiangsee_research_p022.pdf / https://doi.org/10.1145/3132787.3132810
Extended content: video

Zi Siang See, Mohd Shahrizal Sunar, Mark Billinghurst, Arindam Dey, Delas Santano, Human Esmaeili, Harold Thwaites (2017) An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective Exploration. International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments, Australia.
Research: zisiangsee_research_p019.pdf / via Eutographics / http://dx.doi.org/10.2312/egve.20171342
Extended content: video

Zi Siang See, David Blundell, Harold Thwaites (2017) Virtual Reality 360 Content Preservation for Disaster Relief. Pacific Neighborhood Consortium 2017 (PNC 2017), Taiwan.
Research: zisiangsee_research_p017.pdf / IEEE

Delas Santano, Zi Siang See, Chi How Fong, Harold Thwaites (2017) Aerial Virtual Reality 360 Research-Creation. International Conference on Visual Systems & Multimedia. Dublin, Ireland.
Research: zisiangsee_research_p021.pdf / IEEE
Extended content: video

Zi Siang See, Mark Billinghurst, Vimalan Rengganaten, Shelly Soo (2016) Medical Learning Murmurs Simulation with Mobile Audible Augmented Reality. Siggraph Asia 2016 Mobile Graphics and Interactive Application, December 05-08, 2016.
Research: zisiangsee_research_p011.pdf / http://dx.doi.org/10.1145/2999508.2999527
Extended content: video

Zi Siang See, Mark Billinghurst, Vimalan Rengganaten, Shelly Soo (2016) Demo: Mobile Audible AR Experience for Medical Learning Murmurs Simulation. Siggraph Asia 2016 Mobile Graphics and Interactive Application, December 05-08, 2016.
Research: zisiangsee_research_p016.pdf / http://dx.doi.org/10.1145/2999508.2999513

Xia Sheng Lee, Zi Siang See, Mohd Faris Khamidi, Tim John Lees, ChangSaar Chai (2016) Augmented Reality for nDimensional Building Information Modelling - Contextualization, Customization and Curation. 22nd International Conference on Visual Systems & Multimedia (VSMM2016).
Research: researchgate / IEEE
Extended content: video

Chi How Fong, Mark Billinghurst, Zi Siang See, Human Esmaeili. (2016) Peppergram with Interactive Control. 22nd International Conference on Visual Systems & Multimedia (VSMM2016).
Research: researchgate / IEEE

Lee Xia Sheng, Chung Pui Yan and Zi Siang See (2016) Irregular Shaped Building Design Optimization with Building Information Modeling. Proceeding in 4th International Building Control Conference 2016, Universiti Malaya.
Research: via institutional repository

Zi Siang See, Mark Billinghurst, Adrian David Cheok (2015). Augmented Reality Using High Fidelity Spherical Panorama with HDRI. SIGGRAPH ASIA 2015 Mobile Graphics and Interactive Applications, November 02-06, 2015, Kobe, Japan.
Research: zisiangsee_research_p009.pdf / http://dx.doi.org/10.1145/2818427.2818445
Extended content: video

Zi Siang See, Mark Billinghurst, Adrian David Cheok (2015). Augmented Reality Using High Fidelity Spherical Panorama with HDRI: Demonstration. SIGGRAPH ASIA 2015 Mobile Graphics and Interactive Applications, November 02-06, 2015, Kobe, Japan.
Research: zisiangsee_research_p010.pdf / http://dx.doi.org/10.1145/2818427.2819696

Zi Siang See, Adrian David Cheok (2015) Virtual Reality 360 Interactive Panorama Reproduction Obstacle and Issue. Virtual Reality, Volume 19, Issue 2, pp 71-81, Springer.
Research: zisiangsee_research_p006.pdf / http://dx.doi.org/10.1007/s10055-014-0258-9

Lee Xia Sheng, Lee Ching Hua, Cheah Shyn Yi, Zi Siang See (2014) Architectural Transformation of a Night Market Stall. International Conference on Innovation and Technology for Sustainable Built Environment 2014. Universiti Teknologi Mara.
Research: via institutional repository

Zi Siang See, Khairul Hazrin Hashim, Harold Thwaites, Lee Xia Sheng, Ooi Wooi Har (2012). Retrieving Extended High Dynamic Range From Digital Negative Image - An Experiment On Architectural Photo Imaging. World Academy of Science, Engineering and Technology, Vol 6(8) August 2012, pp. 1833-1841.
Research: zisiangsee_research_p004.pdf / Research via institutional repository

Zi Siang See, Lee Xia Sheng (2011). Non-bias Architectural Image Archive using High Dynamic Range Approach. 2nd International Conference on Research and Innovation in Information Systems – 2011 (ICRIIS’11) [CD Proceedings], Kuala Lumpur, Malaysia.
Research: zisiangsee_research_p002.pdf / IEEE

Zi Siang See (2011). Non-bias Scientific Imaging Archive for Urban Morphology Research. Exchanging Views on How to Sustain Urban and Rural Environments in Aspects of Technology, Social and Ecology in Green Innovation Research Group (GIRG) [CD-ROM], Universiti Technologi Malaysia (UTM)
Research: zisiangsee_research_p001.pdf



Get in touch

Contact us at zisiang.see ( at ) utas.edu.au