X-Reality: University of Michigan XR
Exploring the innovative uses of emerging technology
A tea house environment was designed to explore the limits of what is possible in interactivity and textures. Moving freely around the environment, the user could lift up, open, and move around objects. The scene was explored with the MIDEN and had real-world physics applies to the objects.
This Sailboat environment, similar to the Tea House, demonstrates the capabilities of real-time graphics in an immersive simulation. In this environment, the user can walk around the wave-ridden boat using a flashlight, showing the capabilities of fast-changing and dramatic lighting effects. This demonstration aimed to push the system to its limits with dynamic lighting, real-time global illumination, animated characters, and a fully physical environment that can be manipulated and interacted with.
Tom Bessai is a Canadian architect currently teaching at the University of Michigan Taubman College of Architecture & Urban Planning. This past year Tom has been on sabbatical working with Sean Alquist to research hybrid force-active structures—or structures that work under the force of tension. Much like a bungee cord, these structures have two forms: slack and taught. Sean and Tom have been researching material options and constraints for these structures, experimenting with rope, mesh, nylon, and elastic in various forms.
While these structures borrow from techniques seen in gridshell structures, they are entirely new in that they actuate material as well as the geometry of their design. These structures are first designed in computer-aided design (CAD) software and then are physically built. After building the scale models, Tom uses a Microscribe to plot the vertices of the model in 3D space. These points then appear in Rhino, creating a CAD model based off of the actual, physical structure. Tom can then compare his built model to his simulated model. Comparing the measurements of both structures identifies the relationship between the tension of the structure and the material used. By taking these measurements, the properties of the material can be more specifically defined, allowing for larger and smaller structures to be more accurately designed.
These structures are not only complex and beautiful; Tom imagines they could have a practical application as well. Hybrid force-active structures could be used to control architectural acoustics, create intimate or open environments, or define interior and exterior spaces.
“Dialogue of the Senses” was the theme for an exhibit of student work from the Department of Performing Arts Technology, School of Music, Theater & Dance (May 2013). Alex Surdu titled his piece, “Different Eyes / I’m Standing in a Vroom.” He designed it for exhibition in the MIDEN, for aural as well as visual immersion. In Alex’s words:
With each passing day, we find ourselves gaining perspective from the places we go, the people we meet, and the world that we experience. We are ultimately, however, alone in our individual universes of experience. With this piece, I attempt to bridge this gap by immersing participants in an abstract virtual universe that utilizes isochronic pulses to stimulate different states of consciousness. If art was a device created by man to communicate perspective, then works of this nature are the next logical step in realizing art’s purpose: providing not just something to look at, but a way with which to look at it.
Sometimes a mess of data is just a mess of data. But sometimes, as Dr. Suresh Bhavnani discovered, it is an opportunity for a new type of visualization. Ted Hall, advanced visualization specialist at the University of Michigan’s Duderstadt Center, set up an immersive stereoscopic projection of Bhavnani’s data in the MIDEN (Michigan Immersive Digital Experience Nexus), a small room that surrounds the user with 3D images. An antenna headset and a game console controller give Bhavnani a position in space relative to his data, from which he can virtually navigate the web of relationships between genes and diseases. This allowed him to see new patterns and identify unexpected regularities in gene function that are very difficult to untangle in 2D
In December of 2012, The University of Michigan held a mobile app competition to showcase new apps developed within the university and encourage the developer community to create innovative mobile designs. U-M students, faculty, and staff submitted a variety of apps from many different disciplines and genres. The event was sponsored and judged by individuals from Computer Science and Engineering, Google, Information and Technology Services, and Technology Transfer.
1st Place – PainTrek
Ever have a headache or facial pain that seemingly comes and goes without warning? Ever been diagnosed with migraines, TMD or facial neuralgias but feel that the medication or your ability to explain your pain is limited? PainTrek is a novel app that was developed to make it easier to track, analyze, and talk about pain.
2nd Place – PictureIt: The Epistles of St. Paul
The app will give you the feel of what it was like reading an ancient Greek book on papyrus, where the text is written without word division, punctuation, headings, or chapter and verse numbers. To aid the reader without knowledge of ancient Greek the translation mode will give a literal translation of the Greek text preserved on these pages (with addition of chapter and verse numbers), with explanatory notes showing where this text is different from the Standard text.
From AnnArbor.com:
You can now hold one of University of Michigan’s most valuable possessions in your hands.
Well, sort of.
Thirty of the rarest, earliest leaves of the Epistles of St. Paul, dating from 180 to 220 AD, have been digitized and turned into an interactive app usable on iPhones and iPads.
“What’s especially important is the direct experience with the ancient world,” Arthur Verhoogt, acting archivist of the library’s papyrology collection, said of the app, called PictureIt: EP.
“History is nice to read about but it’s much more important to be able to touch history.”
The collection of letters, known to scholars as Papyrus 46, is believed to be the oldest known surviving copy of the Letters of St. Paul. Out of the 104 page collection, 30 leaves reside here in Ann Arbor, 56 leaves reside at the Chester Beatty Library in Dublin and 18 are lost. A leaf is made up of two pages of a book.
The new app, prepared by the Digital Media Commons 3-D Lab at U-M, allows users to flip through the letters as they would a book.
Rebecca Davis, professor and researcher at the Grand Valley State University, received a research grant from the National Institute of Health to research how patients with Alzheimers disease navigate their living space. Assisted living homes can be drab or nondescript with long hallways adding to the confusion and frustration for those living in these homes. To research this problem and possible solutions, Davis recruited 40 people in the early stages of Alzheimer’s and 40 without the disease to virtually walk through a simulation of an actual assisted living home in the MIDEN. Staff and students at the Duderstadt Center modeled a 3D environment to re-create details such as the complicated lighting or maze-like hallways, to create a natural and immersive experience. This allows users to fully experience how the color schemes, lighting, and wall detail can affect the experience of living in the home. Various “visual cues” are placed throughout the space at key locations to determine if these help the subject in remembering which paths lead to where they need to go. Rebecca currently utilizes two environments in her study, one with visual cues and one without. Subjects are shown the path they must go to reach a destination and then given an opportunity to travel there themselves-if they can remember how.
Welcome to the world of second century C.E. Egypt. This app will allow you to leaf through pages of the world’s oldest existing manuscript of the letters of St. Paul (P.Mich.inv.6238, also known in NT scholarship as P46). Thirty leaves of this manuscript, written in about 200 C.E., were found in Egypt and purchased by the University of Michigan Papyrology Collection in 1931 and 1933 (another 56 leaves, not included in this app, are housed in the Chester Beatty Library, Dublin; 18 leaves are missing completely).
The app will give you the feel of what it was like reading an ancient Greek book on papyrus, where the text is written without word division, punctuation, headings, or chapter and verse numbers. To aid the reader without knowledge of ancient Greek the translation mode will give a literal translation of the Greek text preserved on these pages (with addition of chapter and verse numbers), with explanatory notes showing where this text is different from the Standard text.
Rachael Miller and Rob Soltesz presented their summer work on Kinect development, natural user interfaces, and capturing emotive qualities of users at the 2012 UROP Symposium for MSTEM. Rachael won a Blue Ribbon at the event for her poster and they are both the first (that I know of) who have successfully used multiple Kinects in an immersive virtual reality space for virtual physical presence.
Rachael focused on creating a natural user interface for immersive 3D environments by combining multiple connects for a more robust skeleton. This stable and predictable skeleton allowed her to then wrap virtual (invisible) objects around the user’s limbs and torso effectively allowing people to interact with virtual objects without markers or special tracking devices. Beyond simple interaction with virtual objects she then developed several gestures to be used for navigation in virtual reality.
Rob worked with Rachael on aspects of her project but also looked into using the Kinect’s multiple microphones and internal voice recognition capabilities to extract emotive qualities from the user inside a virtual reality space.
Andrew Janke also presented at a second UROP symposium on his work with iOS connectivity to a variety of applications. Getting data off of an iOS device is not always trivial. Formatting that data into a PDF and then sending it via email to a specific individual can be a challenge. Andrew developed a process that allows arbitrary iOS applications to send data, using simple sockets, which can then be formatted and then sent via email. This functionality was required by a few of our applications in development and proved to be extremely useful.
All students did a great job over the summer and we’re excited to be a part of the UROP program at the University of Michigan.