Microsoft creates mood sensing software for smartphones

Microsoft creates mood sensing software for smartphones

  8:47:00 PM    Science Lover

---

Microsoft Research Asia has been working on creating software called MoodScope that notes how a user uses his or her phone, and then uses that information to guess that user's mood. Initial testing of the device has shown it to be 66 percent accurate; when tailored to an individual user, the team reports that the accuracy rate jumped to 93 percent. The research team includes Nicholas Lane and Robert LiKamWa of Rice University, and Lin Zhong and Yunxin Liu from Microsoft Research Asia. They built a prototype and posted their test study results on Microsoft's website.

The circumplex mood model. Credit: Robert LiKamWa et al.

Most people realize that their smartphone has a lot of embedded technology in it that interacts with the world at large—GPS hardware, accelerometers, etc. all monitor activity and use that data to provide useful functions, such as automatically switching from landscape to portrait mode when a phone is rotated. In this new effort, the researchers sought to discover whether software that monitors phone activities could reveal the users' moods.

To find out, the team wrote code that monitored email, texting, app usage, phone calls, location information, and browsing history, then added algorithms to guess mood based on that data. Next, they enlisted the assistance of 32 volunteers to help them test the accuracy of their code. The volunteers were asked to use the system for two months while also completing mood assessments to provide data for comparison. With no training or tweaking, the software was found to provide answers of happy, tense, calm, upset, excited, stressed, or bored that matched the actual mood reported by the volunteers, on average 66 percent of the time. After optimizing the system for the individual habits of each of the volunteers, the rate increased to 93 percent.

The researchers suggest third party hooks could be added to the software to allow for automatically transmitting user moods to applications like Facebook. They also acknowledge that privacy concerns could arise if the software were to be delivered to the public, but suggest the benefits of such software would likely outweigh such concerns. They note that sites like Netflix or Spotify could use data from MoodScope to offer movies or other content based on specific users' moods.

The team presented their findings at MobiSys 2013 held in Taiwan last month.
 
More information: MoodScope Building a Mood Sensor from Smartphone Usage Patterns: research.microsoft.com/apps/pubs/default.aspx?id=194498
 
Research paper: www.ruf.rice.edu/~mobile/publications/likamwa2013mobisys2.pdf

Read More

'Minority Report' software hits the real world

'Minority Report' software hits the real world

  8:00:00 AM    Science Lover

---

The software behind the film "Minority Report" -- where Tom Cruise speeds through video on a large screen using only hand gestures -- is making its way into the real world.

The interface developed by scientist John Underkoffler has been commercialized by the Los Angeles firm Oblong Industries as a way to sift through massive amounts of video and other data.

And yes, the software can be used by law enforcement and intelligence services. But no, it is not the "pre-crime" detection program illustrated in the 2002 Steven Spielberg sci-fi film.

Kwin Kramer, chief executive of Oblong, said the software can help in searching through "big data" for information. It can also create souped-up video-conference capabilities where participants share data from multiple devices like smartphones and tablets, integrated into a large video display.

"We think the future of computing is multiuser, multiscreen, multidevice," Kramer told AFP.

"This system helps with big workflow problems."

A key part of the system is the gesture interface, which the company calls the "g-speak" spatial operating environment.

That grew out of a project by Underkoffler -- then a scientist at the prestigious Massachusetts Institute of Technology -- for "Minority Report," before he became chief scientist at startup Oblong.

"We have demo versions of this kind of software which show exactly the 'Minority Report' user experience, allowing you to move back and forth in time, or to zoom in to look at details," Kramer said.

He said the same software can help businesses to "allow better collaboration, visualization and analysis of large amounts of data.

"You can have a lot of data but it's hard to make use of that," Kramer said.

"It can be on different machines and hard to access. This allows multiple people to look at that."

An employee demonstrates the use of a data glove to navigate a map on a computer screen at Los Angeles-based software company Oblong Industries' offices in Washington in June 2012. The software behind the film "Minority Report" -- where Tom Cruise speeds through video on a large screen using only hand gestures -- is making its way into the real world.

Gestural interfaces have been developed for other firms including Microsoft's Kinect but Oblong says it has far more sophisticated systems which can use Kinect and more.

Some highly sensitive systems use a data glove which can be more precise than ordinary hand movements.

Oblong has contracts with firms such as Boeing, General Electric and Saudi Aramco to help in analyzing large amounts of data. It is also developing a gestural interface for onboard computers with automaker Audi.

It has raised an unspecified amount of venture capital from investors including Foundry Group, Energy Technology Ventures and Morgan Stanley Alternative Investment Partners.

Brad Feld, managing director at Foundry Group, said Oblong offers "a path to fundamentally change the way we interact with computers."

Yet the question Oblong often gets is how users can get the "Minority Report" software.

David Schwartz, the company's vice president for sales, said "We get calls from people in the military who say, 'I want the 'Minority Report' interface."

He said the systems could be used for a realistic version of high-tech software interfaces on TV shows like "CSI."

"They would like to get it for free," he added.

What makes the real-life version of the software different from the one seen on film is that Oblong does not supply the analytics of the futuristic "pre-crime" division.

That does not prevent a company or law enforcement agency from using the software and adding its own analytics.

"We think law enforcement and intelligence are big data users and we think our technology is the leader," Kramer said.

He said Oblong currently has no government customers in the United States or abroad but offers itself as "a core technology provider."

Still, Oblong leverages its role in the movies to get in the door, even if the software is not quite the same.

"I think most people look at those 'Minority Report' interfaces and imagine how they could use that flexible system in their own office or designs studio," Kramer said.

"It isn't science fiction, it's real."

Read More