ÃÛÌÒÉçÇø

KALAMAZOO, Mich.—Lori Brown, associate professor of aviation at ÃÛÌÒÉçÇø Michigan University, has teamed up with Microsoft to transform aviation training through the use of Microsoft's HoloLens mixed reality technology, the first self-contained, holographic computer.

Brown, who is recognized internationally for her use of technology in aviation education, has been chosen by Microsoft for its Women in Mixed Reality Spotlight Partner Program for her transformative work in aviation training. She was featured during Microsoft's Mixed Reality Academy at Microsoft headquarters in Washington state late last fall and was recently awarded the ÃÛÌÒÉçÇø Extended University Programs Innovative Teaching award.

Learn more about Brown's JetXplore project and the work of other mixed reality pioneers.

Microsoft HoloLens enables users to engage with 3D holographic content mixed with the physical world, giving holograms real-world context and scale. With the technology, students in ÃÛÌÒÉçÇø's College of Aviation can be immersed, for instance, inside jet turbofan engines or interact with 3D cockpits to learn and practice real-world aviation scenarios and procedures.

"I wanted my students to be able to see inside and interact with aircraft components such as a turbofan engine," says Brown. "When I saw that the medical community was using HoloLens to allow students to see inside the human body, I realized that HoloLens could augment my lab. The ability to see inside an engine is similar to seeing the bones of a human body."

A first for aviation classrooms

Through Brown's HoloLens work, ÃÛÌÒÉçÇø has become the first aviation program in the nation to use augmented reality in the classroom. With the recent expansion of ÃÛÌÒÉçÇø's flight science program into Florida, marrying lab experiences with mixed reality allows larger numbers of students to have greater access to leading-edge innovation in higher education.

"Technologies like this bring forth a new medium for aviation training, a new paradigm of mixed reality, where for the first time, we have the ability to take the analog world and superimpose digital artifacts and create mixed reality aviation simulations," Brown says. "Unlike other advanced technologies, HoloLens is intuitive and offers a natural means of interaction. There's no mouse, wire or touch screen. All you need are simple gestures to create and alter holograms, your voice to communicate with apps, and your eyes to navigate and analyze content. With the HoloLens, students are able to see inside the jet engine while also interacting with the engine components and full flight deck. They're developing muscle memory, which increases retention."

Brown's research interests have included the use of virtual and augmented reality in technical training for years. She says that the incorporation of HoloLens into the classroom is a first for ÃÛÌÒÉçÇø, and the aviation industry at large.

"In the past 16 years that I've been teaching advanced aircraft systems, I have identified many gaps in the tools and equipment available to me as a professor. Ultimately, mixed reality bridges the gap between simulation, the aircraft and the classroom," says Brown.

Brown notes the operation and maintenance of modern aircraft requires an understanding of several interrelated human and machine components. Practice and immersion with these components can be created with mixed and augmented reality micro-simulations, making it possible to tackle challenging topics by creating a more visual and tactile experience."

From flight simulation to an entire virtual airport

Brown uses HoloLens to supplement flight simulation with ÃÛÌÒÉçÇø's CRJ-200 flight simulator, and has designed interactive textbooks with mixed reality overlays. Her team is currently designing an augmented reality application to transform aviation weather-related training for the Federal Aviation Administration that will overlay augmented reality 3D objects over traditional printed weather publications.

She is collaborating with other ÃÛÌÒÉçÇø colleges, instructors and students to take the technology a step further by creating additional applications with the help of computer science and aviation students and faculty, as well as a staff web developer.

Together, the team developed JetXplore, an interactive aviation training app that Brown uses with HoloLens in the classroom. Brown and her team are currently working with mentors from Microsoft to design an entire virtual airport, where the user controls what they see and how they see it. This puts the educational experience in the hands of the user creating immersive individual learning experiences. 

Brown sees augmented reality as a solution to meet what she describes as unprecedented global training demands and a better way to engage the next generation.

"Bringing Microsoft's HoloLens headset to aviation and other professions such as the medical, auto and marine industries is reshaping education," she says. "The quality of its images is nearly unprecedented; you can almost suspend disbelief and imagine the objects it projects are real. That's what makes these partnerships so potentially exciting."

Brown joined ÃÛÌÒÉçÇø's Department of Aviation Sciences in 2001. She is an Airline Transport Pilot and has trained Ab-initio cadet pilots for British Airways, KLM and UAE, as well as pilots for national and international government agencies. She teaches courses in advanced aircraft systems, airline flight operations and aviation meteorology.

In addition to aviation programs offered at ÃÛÌÒÉçÇø's main aviation campus in Battle Creek, the flight science program is offered in Florida at the University's Punta Gorda location. Aviation management and operations programs are also offered online.

Take a sneak peek at Brown's work: .

Learn more about ÃÛÌÒÉçÇø's College of Aviation: wmich.edu/aviation.

Learn more about the academic programs offered at ÃÛÌÒÉçÇø’s regional locations, including nearly 350 online courses: wmich.edu/extended/academics.

For more ÃÛÌÒÉçÇø news, arts and events, visit wmich.edu/news.