Navigate back to the homepage

AR / VR

Stitch - Immersive news consumption

With upcoming depth cameras in mobile devices, can we create a more immersive news consumption medium?
Year
2014
Technology
Intel / Perceptual Computing SDK / 3D gestures / Publishing / Unity3D

Introduction

The capstone project during MHCI+D focused on promoting novel applications of 3D image capture and touch gesture technology in the news publishing industry. My team partnered with Intel, who challenged us to envision a system that creates value for their upcoming RealSense depth-sensing camera in the News publishing industry.

Before hopping onto secondary research we evaluated existing spatial sensing platforms, and meanwhile also researched current publishing industry.

3

Then, our secondary research highlighted that the way people consume news is changing, due to its online access. However, the current news business model still supports print-based news, rather than digital. On the other hand, emerging technologies are enabling more immersive, collaborative experiences.

4

We combined these insights to form the following design question.

1

Our design response was Stitch:

0

We conceptualized the whole system but concentrated on one part of it which delth with exploration of news media on a tablet. Following the system diagram.

5

To refine the solution we iterated by developing functional prototypes backed by user testing and evaluation. We took the help of rapid prototyping to answer the following questions:

7

Prototyping

Before developing the final prototype we had several iterations of prototypes at increasing level of fidelity.

6

The final explore prototype supported the following interactions:

Select an Article

View the journalist-curated list of immersive articles and select to read more about it with 3D reconstruction in the background.

Fly-in

By tapping on start user dives down into the 3D reconstruction of the relevant place where the news took place. Fly-in gives a spatial perspective to the user.

Exploring a digital reconstruction of a news story’s environment as a way to deepen understanding of a situation, event, or location.

Content Markers

View multiple perspectives on the news through dynamic journalist and reader-contributed content. Linking these content markers together can generate Walkthroughs, which help create a story that users can follow.

Filter Markers

Filters helps in focusing on the content markers that matter the most. This protects users from getting overwhelmed by large number of markers.

More articles from Aniket Handa

NecX - Using neck as an input method

What if we hack into neural pass of the body which also provides vocal, movement and heart rate information?

Arduino / Signal Processing / EMG sensor / Gesture detection / Machine Learning

2014

Visualizing Neurological Connectivity

A focused visualization tool for neurological functional connectivity data

D3.js / JavaScript

2014
© 2014 – 2021 · Aniket Handa
Link to $https://twitter.com/atneikLink to $https://github.com/atneikLink to $https://instagram.com/_aniketLink to $https://www.linkedin.com/in/atneik/