BTemplates.com

Powered by Blogger.

Pageviews past week

Quantum mechanics

Auto News

artificial intelligence

About Me

Recommend us on Google!

Information Technology

Popular Posts

Showing posts with label Machine learning. Show all posts
Showing posts with label Machine learning. Show all posts

Thursday, December 29, 2011

Crucial Advances in 'Brain Reading' Demonstrated





At UCLA's Laboratory of Integrative Neuroimaging Technology, researchers use functional MRI brain scans to observe brain signal changes that take place during mental activity. They then employ computerized machine learning (ML) methods to study these patterns and identify the cognitive state -- or sometimes the thought process -- of human subjects. The technique is called "brain reading" or "brain decoding."

An innovative machine learning method
anticipates neurocognitive changes,
similar to predictive text-entry for
cell phones, Internet search engines.
(Credit: © ktsdesign / Fotolia)

In a new study, the UCLA research team describes several crucial advances in this field, using fMRI and machine learning methods to perform "brain reading" on smokers experiencing nicotine cravings.

The research, presented last week at the Neural Information Processing Systems' Machine Learning and Interpretation in Neuroimaging workshop in Spain, was funded by the National Institute on Drug Abuse, which is interested in using these method to help people control drug cravings.

In this study on addiction and cravings, the team classified data taken from cigarette smokers who were scanned while watching videos meant to induce nicotine cravings. The aim was to understand in detail which regions of the brain and which neural networks are responsible for resisting nicotine addiction specifically, and cravings in general, said Dr. Ariana Anderson, a postdoctoral fellow in the Integrative Neuroimaging Technology lab and the study's lead author.

"We are interested in exploring the relationships between structure and function in the human brain, particularly as related to higher-level cognition, such as mental imagery," Anderson said. "The lab is engaged in the active exploration of modern data-analysis approaches, such as machine learning, with special attention to methods that reveal systems-level neural organization."

For the study, smokers sometimes watched videos meant to induce cravings, sometimes watched "neutral" videos and at sometimes watched no video at all. They were instructed to attempt to fight nicotine cravings when they arose.

The data from fMRI scans taken of the study participants was then analyzed. Traditional machine learning methods were augmented by Markov processes, which use past history to predict future states. By measuring the brain networks active over time during the scans, the resulting machine learning algorithms were able to anticipate changes in subjects' underlying neurocognitive structure, predicting with a high degree of accuracy (90 percent for some of the models tested) what they were watching and, as far as cravings were concerned, how they were reacting to what they viewed.

"We detected whether people were watching and resisting cravings, indulging in them, or watching videos that were unrelated to smoking or cravings," said Anderson, who completed her Ph.D. in statistics at UCLA. "Essentially, we were predicting and detecting what kind of videos people were watching and whether they were resisting their cravings."

In essence, the algorithm was able to complete or "predict" the subjects' mental states and thought processes in much the same way that Internet search engines or texting programs on cell phones anticipate and complete a sentence or request before the user is finished typing. And this machine learning method based on Markov processes demonstrated a large improvement in accuracy over traditional approaches, the researchers said.

Machine learning methods, in general, create a "decision layer" -- essentially a boundary separating the different classes one needs to distinguish. For example, values on one side of the boundary might indicate that a subject believes various test statements and, on the other, that a subject disbelieves these statements. Researchers have found they can detect these believe-disbelieve differences with high accuracy, in effect creating a lie detector. An innovation described in the new study is a means of making these boundaries interpretable by neuroscientists, rather than an often obscure boundary created by more traditional methods, like support vector machine learning.

"In our study, these boundaries are designed to reflect the contributed activity of a variety of brain sub-systems or networks whose functions are identifiable -- for example, a visual network, an emotional-regulation network or a conflict-monitoring network," said study co-author Mark S. Cohen, a professor of neurology, psychiatry and biobehavioral sciences at UCLA's Staglin Center for Cognitive Neuroscience and a researcher at the California NanoSystems Institute at UCLA.

"By projecting our problem of isolating specific networks associated with cravings into the domain of neurology, the technique does more than classify brain states -- it actually helps us to better understand the way the brain resists cravings," added Cohen, who also directs UCLA's Neuroengineering Training Program.

Remarkably, by placing this problem into neurological terms, the decoding process becomes significantly more reliable and accurate, the researchers said. This is especially significant, they said, because it is unusual to use prior outcomes and states in order to inform the machine learning algorithms, and it is particularly challenging in the brain because so much is unknown about how the brain works.

Machine learning typically involves two steps: a "training phase" in which the computer evaluates a set of known outcomes -- say, a bunch of trials in which a subject indicated belief or disbelief -- and a second, "prediction" phase in which the computer builds a boundary based on that knowledge.

In future research, the neuroscientists said, they will be using these machine learning methods in a biofeedback context, showing subjects real-time brain readouts to let them know when they are experiencing cravings and how intense those cravings are, in the hopes of training them to control and suppress those cravings.

But since this clearly changes the process and cognitive state for the subject, the researchers said, they may face special challenges in trying to decode a "moving target" and in separating the "training" phase from the "prediction" phase.

Wednesday, May 19, 2010

Software that Learns by Watching


KarDo learns how to perform common IT support tests by observing what the experts do.

Overworked and much in demand, IT support staff can't be in two places at once. But software designed to watch and learn as they carry out common tasks could soon help--by automatically performing the same jobs across different computers.
Me
Task manager: A screenshot 
shows KarDo performing administrative jobs 
via a graphical interface.
Credit: KarDo


The new software system, called KarDo, was developed by researchers at MIT. It can automatically configure an e-mail account, install a virus scanner, or set up access to a virtual private network, says MIT's Dina Katabi, an associate professor at MIT.

Crucially, the software just needs to watch an administrator perform this task once before being able to carry out the same job on computers running different software. Businesses spend billions of dollars each year on simple and repetitive IT tasks, according to reports from the analyst groups Forrester and Gartner. KarDo could reduce these costs by as much as 20 percent, Katabi says.

In some respects, KarDo resembles software that can be used to record macros--a set sequence of user actions on a computer. But KarDo attempts to learn the goal of each action in the sequence so it can be applied more generally later, says MIT post-graduate Hariharan Rahul, who codeveloped the system.

When IT staff want KarDo to learn a new task, they press a "start" button beforehand and a "stop" button afterwards. During a "learning phase," KarDo will attempt to map each of the actions performed in the graphical user interface, such as clicking on particular icons or buttons, with system-level actions, such as starting or closing a program, or opening a Web page. This allows a task to be applied across machines running different software, says Katabi. "I can go to my desktop, click on the Internet Explorer icon, go to a website, and then click on a particular link to download a file," she says. The same actions could then be applied by KarDo on a machine running a different Web browser like FireFox or Chrome. KarDo compares actions performed during the learning phase with a database of other tasks.

KarDo is able to reliably infer how to reproduce each of the subtasks after watching it being performed just once, says Rahul. For example, after watching an e-mail account being set up using Microsoft Outlook, it can do the same on other computers running different e-mail software. KarDo has been tested on hundreds of combinations of real tasks by IT staff at MIT and was found to get tasks right 82 percent of the time. When KarDo doesn't perform a task correctly, the results aren't serious, Katabi says.

The ultimate goal is for KarDo to intervene completely automatically, although this has not yet been tested. The idea is that when a user sends a request to the IT department , KarDo would perform the task automatically.

This sort of "programming by demonstration" is not a new idea, says Stephen Muggleton, an expert in machine learning at Imperial College London. But the approach has remained very much a research curiosity, he says. "An obvious concern from a user point of view will be the accuracy of the learned model," says Muggleton. Normally it takes relatively large amounts of data to generate error-free machine learning models, he notes.

"There's a great deal of promise in learning procedures and plans by watching," says Eric Horvitz of Microsoft Research in Redmond, WA. However, in general, this is very challenging to pull off. It is usually hard to do anything useful without constraining the nature of the task, says Horvitz.

KarDo was announced last week as the winner of the Web/IT track of MIT's $100K Entrepreneur Competition.