It's finally happened: Neuroscientists at Berkeley have created a computer system which can figure out what you're seeing by looking at your brain activity with an fMRI scanner. Even more astonishing: They did it using YouTube!
How does it work? First, test subjects watched 100 movie trailers; a computer program learned to associate brain activity with each image. The researchers then fed 18 million seconds of YouTube clips through the system, asking it to work in reverse, predicting which brain activity the images would evoke. "Finally, the 100 clips that the computer program decided were most similar to the clip that the subject had probably seen were merged to produce a blurry yet continuous reconstruction of the original movie."
The ultimate goal is to use a system like this one to visualize mental imagery -- that is, to display on a computer monitor the images we picture in our imaginations. As Jack Gallant, one of the neuroscientists involved in the study, puts it: “We are opening a window into the movies in our minds.” More at UC Berkeley.
The author is solely responsible for the content.
Leon Neyfakh is the staff writer for Ideas. Amanda Katz is the deputy Ideas editor. Stephen Heuser is the Ideas editor.
Guest blogger Simon Waxman is Managing Editor of Boston Review and has written for WBUR, Alternet, McSweeney's, Jacobin, and others.
Guest blogger Elizabeth Manus is a writer living in New York City. She has been a book review editor at the Boston Phoenix, and a columnist for The New York Observer and Metro.
Guest blogger Sarah Laskow is a freelance writer and editor in New York City. She edits Smithsonian's SmartNews blog and has contributed to Salon, Good, The American Prospect, Bloomberg News, and other publications.
Guest blogger Joshua Glenn is a Boston-based writer, publisher, and freelance semiotician. He was the original Brainiac blogger, and is currently editor of the blog HiLobrow, publisher of a series of Radium Age science fiction novels, and co-author/co-editor of several books, including the story collection "Significant Objects" and the kids' field guide to life "Unbored."
Guest blogger Ruth Graham is a freelance journalist in New Hampshire, and a frequent Ideas contributor. She is a former features editor for the New York Sun, and has written for publications including Slate and the Wall Street Journal.
Joshua Rothman is a graduate student and Teaching Fellow in the Harvard English department, and an Instructor in Public Policy at the Harvard Kennedy School of Government. He teaches novels and political writing.