Nomura Kogeisha joins Miraikan Accessibility Lab. Producing new content to support visually impaired people using mixed reality (MR) technology

1. About Miraikan Accessibility Lab
 

This is a consortium-type laboratory jointly promoted by Miraikan and specialized research institutes, and we are researching accessibility technology for visually impaired people by applying AI and robot technology. Miraikan has previously taken the unique initiative of establishing a research area for external research projects, but this is the first laboratory that Miraikan will directly operate.
In addition to an "AI suitcase" that automatically guides visually impaired people safely, we plan and produce models that use 3D printers to obtain scientific information from the sense of touch to provide museum experiences for visually impaired people. We are promoting research and development that enriches society.
With Waseda University's Faculty of Science and Engineering, we plan to work on technology development and joint demonstrations for smarter voice guidance tailored to users and situations using AI suitcases that use large-scale language models.

https://www.miraikan.jst.go.jp/research/AccessibilityLab/
 

<Participating institutions>
IBM Japan Corporation, Waseda University Faculty of Science and Engineering, Nomura Kogeisha Co., Ltd.
(As of November 29, 2023)

2. About this new content

■About the MR (Mixed Reality) technology used and the mobile sound experience service “oto rea”
The MR technology used this time is a system called "Auris" developed by GATARI, which uses VPS (Visual Positioning System) to recognize the position and orientation of the smartphone from the image carried by the user, and then creates a preset sound. can be played. Audio information can be placed with centimeter precision, making it possible to create spaces and experiences that go beyond mere audio guidance. ``oto rea'' is an audio experience service produced and directed by NOMURA, using this ``Auris'' platform.
 

https://www.nomlog.nomurakougei.co.jp/article/detail/191/
 

■About the created content
This tour will take you through part of Zone 2, ``Experiencing the Changing Earth,'' part of the new permanent displays ``Planetary Crisis'' with the theme of the global environment. You can measure the rise in global average temperature over time by touching a large line graph, or you can experience the differences in carbon dioxide emissions by country or region by comparing wooden balls of different sizes and weights, and learn about the changing earth. Understand the present and the future. Finally, we will introduce ideas for creating displays that are environmentally friendly.
The content also includes sound effects tailored to the content of the experience, such as the sound of waves and the sound of car engines, creating a sound production that goes beyond simply explaining displays.