Nomura Kogeisha joins Miraikan Accessibility Lab. Producing new content to support visually impaired people using mixed reality (MR) technology

1. About Miraikan Accessibility Lab
 

This is a consortium-type laboratory jointly promoted by Miraikan and specialized research institutes, and we are researching accessibility technology for visually impaired people by applying AI and robot technology. Miraikan has previously taken the unique initiative of establishing a research area for external research projects, but this is the first laboratory that Miraikan will directly operate.
In addition to an "AI suitcase" that automatically guides visually impaired people safely, we plan and produce models that use 3D printers to obtain scientific information from the sense of touch to provide museum experiences for visually impaired people. We are promoting research and development that enriches society.
With Waseda University's Faculty of Science and Engineering, we plan to work on technology development and joint demonstrations for smarter voice guidance tailored to users and situations using AI suitcases that use large-scale language models.

https://www.miraikan.jst.go.jp/research/AccessibilityLab/
 

<Participating institutions>
IBM Japan Corporation, Waseda University Faculty of Science and Engineering, Nomura Kogeisha Co., Ltd.
(As of November 29, 2023)

2. About this new content

■ About the MR (Mixed Reality) technology used and the roaming sound experience service "oto rea"
The MR technology used in this project is a system called "Auris," developed by GATARI. Using a VPS (Visual Positioning System), it can recognize the position and orientation of images from the user's smartphone and play pre-set sounds. The audio information can be positioned with centimeter-level precision, and it is characterized by its ability to create spatial and experiential elements that go beyond simple audio guides. "oto rea" is an audio experience service produced and directed by NOMURA Co.,Ltd., using "Auris" as its platform.
 

https://www.nomlog.nomurakougei.co.jp/article/detail/191/
 

■ About the content we created
This tour takes you through a portion of Zone 2, "Experiencing the Changing Earth," of the new permanent displays, "Planetary Crisis," which focuses on the global environment. You'll learn about the present and future of our changing planet by touching a large line graph to gauge the rise in the world's average temperature and by comparing wooden balls of different sizes and weights to experience the differences in carbon dioxide emissions by country and region. Finally, we'll introduce displays 's design and production techniques that prioritize the global environment.
The content includes sound effects tailored to the experience, such as the sound of waves and car engines, creating an audio experience that goes beyond simple displays explanations.