Decoding How the Brain Accurately Depicts Ever-changing Visual Landscapes

A collaborative study finds that deeper regions of the brain encode visual information more slowly, enabling the brain to identify fast-moving objects and images more accurately and persistently.

by Erica K. Brockmeier

Busy pedestrian crossing at Hong Kong

New research from the University of Pennsylvania, the Scuola Internazionale Superiore de Studi Avanzati (SISSA), and KU Leuven details the time scales of visual information processing across different regions of the brain. Using state-of-the-art experimental and analytical techniques, the researchers found that deeper regions of the brain encode visual information slowly and persistently, which provides a mechanism for explaining how the brain accurately identifies fast-moving objects and images. The findings were published in Nature Communications.

Understanding how the brain works is a major research challenge, with many theories and models developed to explain how complex information is processed and represented. One area of particular interest is vision, a major component of neural activity. In humans, for example, there is evidence that around half of the neurons in the cortex are related to vision.

Researchers are eager to understand how the visual cortex can process and retain information about objects in motion in a way that allows people to take in dynamic scenes while still retaining information about and recognizing the objects around them.

“One of the biggest challenges of all the sensory systems is to maintain a consistent representation of our surroundings, despite the constant changes taking place around us. The same holds true for the visual system,” says Davide Zoccolan, director of SISSA’s Visual Neuroscience Laboratory. “Just look around us: objects, animals, people, all on the move. We ourselves are moving. This triggers rapid fluctuations in the signals acquired by the retina, and until now it was unclear whether the same type of variations apply to the deeper layers of the visual cortex, where information is integrated and processed. If this was the case, we would live in tremendous confusion.”

Experiments using static stimuli, such as photographs, have found that information from the sensory periphery are processed in the visual cortex according to a finely tuned hierarchy. Deeper regions of the brain then translate this information about visual scenes into more complex shapes, objects, and concepts. But how this process works in more dynamic, real-world settings is not well understood.

To shed light on this, the researchers analyzed neural activity patterns in multiple visual cortical areas in rodents while they were being shown dynamic visual stimuli. “We used three distinct datasets: one from SISSA, one from a group in KU Leuven led by Hans Op de Beeck and one from the Allen Institute for Brain Science in Seattle,” says Zoccolan. “The visual stimuli used in each were of different types. In SISSA, we created dedicated video clips showing objects moving at different speeds. The other datasets were acquired using various kinds of clips, including from films.”

Next, the researchers analyzed the signals registered in different areas of the visual cortex through a combination of sophisticated algorithms and models developed by Penn’s Eugenio Pasini and Vijay Balasubramanian. To do this, the researchers developed a theoretical framework to help connect the images in the movies to the activity of specific neurons in order to determine how neural signals evolve over different time scales.

“The art in this science was figuring out an analysis method to show that the processing of visual images is getting slower as you go deeper and deeper in the brain,” says Balasubramanian. “Different levels of the brain process information over different time scales; some things could be more stable, some quicker. It’s very hard to tell if the time scales across the brain are changing, so our contribution was to devise a method for doing this.”

Read the full story in Penn Today.

Vijay Balasubramanian is the Cathy and Marc Lasry Professor in the Department of Physics and Astronomy in the School of Arts & Sciences and a member of the Penn Bioengineering Graduate Group at the University of Pennsylvania.

The Pioneering Career of Norman Badler

by Ebonee Johnson

The retiring CIS professor chats about his recent ACM SIGGRAPH election and his expansive computer graphics path.

Norman Badler, Ph.D. (Image credit: Penn CIS)

Norman Badler’s election into the 2021 ACM SIGGRAPH Academy Class is right on time. After nearly five decades of teaching and trailblazing in the Penn community, the Rachleff Family Professor in the Department of Computer and Information Sciences retired at the end of the spring semester.

When he arrived at the University in 1974, CIS itself was only about 2 years old, and there was virtually no computer graphics focus or program at all. Badler had no intention to teach it.

“At that time, I was actually a computer vision researcher, but I was also working a little bit in natural language,” says Badler. “So I was literally brought in to fit between the chair, Aravind Joshi, who was a natural language person, and the computer vision person. It wasn’t until about three or four years after I came here that I switched over to computer graphics. Mostly because there was a vacuum and a need and an excitement.”

Several years after completing his dissertation in computer vision and forming a career path to head in that direction, Badler “started getting serious about computer graphics.” An organization that was getting its start around the same time as his Penn career would play a major role: ACM SIGGRAPH (the Association for Computing Machinery’s Special Interest Group on Computer Graphics and Interactive Techniques).

Read the full story in the CIS Blog.

N.B.: Badler was a member of the Penn Bioengineering Graduate Group.

New Grant Aims to Broaden Participation in Cutting-Edge Materials Research

University of Puerto Rico’s Edgardo Sánchez (left) and Penn graduate Zhiwei Liao working in the lab of Daeyeon Lee. Via the Advancing Device Innovation through Inclusive Research and Education program, researchers from Penn and the University of Puerto Rico will continue their materials science collaboration while supporting STEM career pathways for underrepresented groups. (Image credit: Felice Macera).

The National Science Foundation (NSF) has awarded grants to eight research teams to support partnerships that will increase diversity in cutting-edge materials research, education, and career development. One of those teams is Penn’s Laboratory for Research on the Structure of Matter (LRSM) and the University of Puerto Rico (UPR), whose long-running collaboration has now received an additional six years of support.

With the goal of supporting partnerships between minority-serving educational institutions and leading materials science research centers, NSF’s Partnership for Research & Education in Materials (PREM) program funds innovative research programs and provides institutional support to increase recruitment, retention, and graduation by underrepresented groups as well as providing underserved communities access to materials research and education.

‘Research at the frontier’

With this PREM award, known as the Advancing Device Innovation through Inclusive Research and Education (ADIIR) program, researchers from Penn and UPR’s Humacao and Cayey campuses will conduct research on the properties of novel carbon-based materials with unique properties, and will study the effects of surface modification in new classes of sensors, detectors, and purification devices.

Thanks to this collaboration of more than 20 years, both institutions have made significant scientific and educational progress aided by biannual symposia and regular pre-pandemic travel between both institutions before the pandemic, resulting in a rich portfolio of publications, conference presentations, patents, students trained, and outreach programs.

“Together we have been publishing good papers that have impact, and we’ve really cultivated a culture of collaboration and friendship between our institutions,” says Penn’s Arjun Yodh, former director of the LRSM. “Our goal is to carry out research at the frontier and, in the process, nurture promising students from Puerto Rico and Penn.”

Ivan Dmochowski, a chemistry professor at Penn who has been involved with PREM for several years, says that this program has helped his group connect with experts in Puerto Rico whose skills complement his group’s interests in protein engineering. Dmochowski has also hosted UPR faculty members and students in his lab and also travelled to Puerto Rico before the pandemic to participate in research symposia, seminars, and outreach events.

“I’ve had students who have benefitted from being a co-author on a paper or having a chance to mentor students, and the faculty we’ve interacted with are exceptional,” Dmochowski says. “There’s a lot of benefit for both me and my students, and I’ve enjoyed our interactions both personally and scientifically.”

Penn’s Daeyeon Lee, a chemical and biomolecular engineering professor who has been involved with PREM for several years, regularly hosts students and faculty from UPR while working on nanocarbon-based composite films for sensor applications. The success of this collaboration relies on unique materials made by researchers at UPR combined with a method for processing them into composite structures developed in Lee’s lab.

“What I really admire about people at PREM, both faculty and students, is their passion,” says Lee. “I think that’s had a really positive impact on my students and postdocs who got to interact with them because they got to see the passion that the students brought.”

Read the full story in Penn Today.

Daeyeon Lee is a professor and the Evan C Thompson Term Chair for Excellence in Teaching in the Department of Chemical and Biomolecular Engineering and a member of the Bioengineering Graduate Group in Penn’s School of Engineering and Applied Science.

Arjun Yodh is the James M. Skinner Professor of Science in the Department of Physics & Astronomy in Penn’s School of Arts & Sciences and a member of the Bioengineering Graduate Group in Penn’s School of Engineering and Applied Science.

“’Electronic Nose’ Accurately Sniffs Out Hard-to-Detect Cancers”

A.T. Charlie Johnson, Ph.D.

A.T. Charlie Johnson, Rebecca W. Bushnell Professor of Physics and Astronomy at the Penn School of Arts & Sciences, and member of the Penn Bioengineering Graduate Group has been working with a team of researchers on a new “electronic nose” that could help track the spread of COVID-19 based on the disease’s unique odor profile. Now, similar research shows that vapors emanating from blood samples can be tested to distinguish between benign and cancerous pancreatic and ovarian cells. Johnson presented the results at the annual American Society of Clinical Oncology meeting on June 4 (Abstract # 5544):

“It’s an early study but the results are very promising,” Johnson said. “The data shows we can identify these tumors at both advanced and the earliest stages, which is exciting. If developed appropriately for the clinical setting, this could potentially be a test that’s done on a standard blood draw that may be part of your annual physical.”

Read the full story in Penn Medicine News.

How HIV Infection Shrinks the Brain’s White Matter

by Katherine Unger Baillie

Researchers from Penn and CHOP detail the mechanism by which HIV infection blocks the maturation process of brain cells that produce myelin, a fatty substance that insulates neurons.

A confocal microscope image shows an oligodendrocyte in cell culture, labeled to show the cell nucleus in blue and myelin proteins in red, green, and yellow. Researchers from Penn and CHOP have shown that HIV infection prevents oligodendrocytes from maturing, leading to a reduction in white matter in the brain. (Image: Raj Putatunda)

It’s long been known that people living with HIV experience a loss of white matter in their brains. As opposed to gray matter, which is composed of the cell bodies of neurons, white matter is made up of a fatty substance called myelin that coats neurons, offering protection and helping them transmit signals quickly and efficiently. A reduction in white matter is associated with motor and cognitive impairment.

Earlier work by a team from the University of Pennsylvania and Children’s Hospital of Philadelphia (CHOP) found that antiretroviral therapy (ART)—the lifesaving suite of drugs that many people with HIV use daily—can reduce white matter, but it wasn’t clear how the virus itself contributed to this loss.

In a new study using both human and rodent cells, the team has hammered out a detailed mechanism, revealing how HIV prevents the myelin-making brain cells called oligodendrocytes from maturing, thus putting a wrench in white matter production. When the researchers applied a compound blocking this process, the cells were once again able to mature.

The work is published in the journal Glia.

“Even when people with HIV have their disease well-controlled by antiretrovirals, they still have the virus present in their bodies, so this study came out of our interest in understanding how HIV infection itself affects white matter,” says Kelly Jordan-Sciutto, a professor in Penn’s School of Dental Medicine and co-senior author on the study. “By understanding those mechanisms, we can take the next step to protect people with HIV infection from these impacts.”

“When people think about the brain, they think of neurons, but they often don’t think about white matter, as important as it is,” says Judith Grinspan, a research scientist at CHOP and the study’s other co-senior author. “But it’s clear that myelination is playing key roles in various stages of life: in infancy, in adolescence, and likely during learning in adulthood too. The more we find out about this biology, the more we can do to prevent white matter loss and the harms that can cause.”

Jordan-Sciutto and Grinspan have been collaborating for several years to elucidate how ART and HIV affect the brain, and specifically oligodendrocytes, a focus of Grinspan’s research. Their previous work on antiretrovirals had shown that commonly used drugs disrupted the function of oligodendrocytes, reducing myelin formation.

In the current study, they aimed to isolate the effect of HIV on this process. Led by Lindsay Roth, who recently earned her doctoral degree within the Biomedical Graduate Studies group at Penn and completed a postdoctoral fellowship working with Jordan-Sciutto and Grinspan, the investigation began by looking at human macrophages, one of the major cell types that HIV infects.

Read the full story in Penn Today.

Kelly Jordan-Sciutto is vice chair and professor in the University of Pennsylvania School of Dental Medicine’s Department of Basic & Translational Sciences and is director of Biomedical Graduate Studies. She is a member of the Penn Bioengineering Graduate Group.

Carl June Receives the Sanford Lorraine Cross Award

Carl June, MD

Carl June, MD, the Richard W. Vague Professor in Immunotherapy in the department of Pathology and Laboratory Medicine in the Perelman School of Medicine at the University of Pennsylvania, director of the Center for Cellular Immunotherapies at Penn’s Abramson Cancer Center, and member of the Penn Bioengineering Graduate Group, received the $1 million Sanford Lorraine Cross Award for his groundbreaking work in developing chimeric antigen receptor (CAR) T cell therapy. June is a world renowned cancer cell therapy pioneer.

“Sanford Health, the only health system in the country to award a $1 million prize for achievements in the medical sciences, announced the award on April 13 at a special ceremony in Sioux Falls, South Dakota. The biennial award recognizes life-changing breakthroughs and bringing emerging transformative medical innovations to patients.

‘This is a well-deserved and exciting award for one of Penn’s most distinguished faculty members, whose pioneering research has reshaped the fight against cancer and brought fresh hope for both adults and children with the disease,’ said J. Larry Jameson, MD, PhD, Executive Vice President of the University of Pennsylvania for the Health System and Dean of the Perelman School of Medicine. ‘His contributions truly have been transformative for patients across the globe and taken the field of oncology in new and powerful directions.'”

Read the full story in Penn Medicine News.

Bioengineering Contributes to “New COVID-19 Testing Technology at Penn”

César de la Fuente, Ph.D., a Presidential Assistant Professor in Psychiatry, Microbiology, and Bioengineering, is leading a team to develop an electrode that can be easily printed at low cost to provide COVID-19 test results from your smart phone.

A recent Penn Medicine blog post surveys the efforts across Penn and the Perelman School of Medicine to develop novel says to detect SARS-CoV-2 and features several Department of Bioengineering faculty and Graduate Group members, including César de la Fuente, Presidential Assistant Professor in Psychiatry, Microbiology, and Bioengineering; Arupa Ganguly, Professor in Genetics; A.T. Charlie Johnson, Rebecca W. Bushnell Professor in Physics and Astronomy; Lyle Ungar, Professor in Computer and Information Science; and Ping Wang, Associate Professor in Pathology and Laboratory Medicine.

Read “We’ll Need More than Vaccines to Vanquish the Virus: New COVID-19 Testing Technology at Penn” by Melissa Moody in Penn Medicine News.

Hao Huang Named AIMBE Fellow

Hao Huang, Ph.D.

Hao Huang, Research Associate Professor of Radiology in the Perelman School of Medicine and member of the Penn Bioengineering Graduate Group, has been named an American Institute for Medical and Biological Engineering (AIMBE) Fellow.

Election to the AIMBE College of Fellows is among the highest professional distinctions accorded to a medical and biological engineer. “The College of Fellows is comprised of the top two percent of medical and biological engineers in the country. The most accomplished and distinguished engineering and medical school chairs, research directors, professors, innovators, and successful entrepreneurs comprise the College of Fellows. AIMBE Fellows are regularly recognized for their contributions in teaching, research, and innovation.”

Huang was “nominated, reviewed, and elected by peers and members of the College of Fellows for contributions to the development and applications of innovative MR methods to study the developing brain.”

A formal induction ceremony will be held during AIMBE’s virtual 2021 Annual Event on March 26. Huang will be inducted along with 174 colleagues who make up the AIMBE Fellow Class of 2021.

Read the full press release.

Arjun Yodh Named 2021 Michael S. Feld Biophotonics Award Recipient by The Optical Society

Arjun Yodh, Ph.D.

The Department of Phsyics in the Penn School of Arts & Sciences has announced that Arjun Yodh, Professor in Physics and Astronomy and member of the Bioengineering Graduate Group, was awarded the 2021 Michael S. Biophotonics Award by the Optical Society (OSA):

“He was selected for his ‘pioneering research on optical sensing in scattering media, especially diffuse optical and correlation spectroscopy and tomography, and for advancing the field of biophotonics through mentorship.’

The award ‘recognizes innovative and influential contributions to the field of biophotonics, regardless of career stage.'”

Bioengineering Faculty Contribute to New Treatment That “Halts Osteoarthritis-Like Knee Cartilage Degeneration”

A recent study published in Science Translational Medicine announces a discovery which could halt cartilage degeneration caused by osteoarthritis: “These researchers showed that they could target a specific protein pathway in mice, put it into overdrive and halt cartilage degeneration over time. Building on that finding, they were able to show that treating mice with surgery-induced knee cartilage degeneration through the same pathway via the state of the art of nanomedicine could dramatically reduce the cartilage degeneration and knee pain.” This development could eventually lead to treating osteoarthritis with injection rather than more complicated surgery.

Among a team of Penn Engineering and Penn Medicine researchers, the study was co-written by Zhiliang Cheng, Research Associate Professor in Bioengineering, Andrew Tsourkas, Professor in Bioengineering, and Ling Qin, Associate Professor of Orthopaedic Surgery in the Perelman School of Medicine and member of the Bioengineering Graduate Group. The lead author was Yulong Wei of the Department of Orthopaedic Surgery and the McKay Orthopaedic Research Laboratory.

Read the press release in Penn Medicine News.