Through the Lens: A Digital Depiction of Dyslexia

by Nathi Magubane

Artist-in-residence and visiting scholar Rebecca Kamen has blended AI and art to produce animated illustrations representing how a dyslexic brain interprets information.

A collage of artwork depicts a series of abstract visualizations of networks.
A work that Penn artist-in-residence Rebecca Kamen produced for the show, “Dyslexic Dictionary” at Arion Press in San Francisco. Here, she reinterprets Ph.D. candidate Dale Zhou’s network visualization. (Image: Cat Fennell)

Communicating thoughts with words is considered a uniquely human evolutionary adaptation known as language processing. Fundamentally, it is an information exchange, a lot like data transfer between devices, but one riddled with discrete layers of complexity, as the ways in which our brains interpret and express ideas differ from person to person.

Learning challenges such as dyslexia are underpinned by these differences in language processing and can be characterized by difficulty learning and decoding information from written text.

Artist-in-residence in Penn’s Department of Physics and Astronomy Rebecca Kamen has explored her personal relationship with dyslexia and information exchange to produce works that reflect elements of both her creative process and understanding of language. Kamen unveiled her latest exhibit at Arion Press Gallery in San Francisco, where nine artists with dyslexia were invited to produce imaginative interpretations of learning and experiencing language.

The artists were presented with several prompts in varying formats, including books, words, poems, quotes, articles, and even a single letter, and tasked with creating a dyslexic dictionary: an exploration of the ways in which their dyslexia empowered them to engage in information exchange in unique ways.

Undiagnosed dyslexia

“[For the exhibit], each artist selected a word representing the way they learn, and mine was ‘lens,’” explains Kamen. “It’s a word that captures how being dyslexic provides me with a unique perspective for viewing and interacting with the world.”

From an early age, Kamen enjoyed learning about the natural sciences and was excited about the process of discovery. She struggled, however, with reading at school, which initially presented an obstacle to achieving her dreams of becoming a teacher. “I had a difficult time getting into college,” says Kamen. “When I graduated high school, the word ‘dyslexia’ didn’t really exist, so I assumed everyone struggled with reading.”

Kamen was diagnosed with dyslexia well into her tenure as a professor. “Most dyslexic people face challenges that may go unnoticed by others,” she says, “but they usually find creative ways to overcome them.”

This perspective on seeing and experiencing the world through the lens of dyslexia not only informed Kamen’s latest work for the exhibition “Dyslexic Dictionary,” but also showcased her background in merging art and science. For decades, Kamen’s work has investigated the intersection of the two, creating distinct ways of exploring new relationships and similarities.

“Artists and scientists are curious creatures always looking for patterns,” explains Kamen. “And that’s because patterns communicate larger insights about the world around us.”

Creativity and curiosity

This idea of curiosity and the patterns its neural representations could generate motivated “Reveal: The Art of Reimagining Scientific Discovery,” Kamen’s previous exhibit, which was inspired by the work of Penn professor Dani Bassett, assistant professor David Lydon-Staley and American University associate professor Perry Zurn on the psychological and historical-philosophical basis of curiosity.

The researchers studied different information-seeking approaches by monitoring how participants explore Wikipedia pages and categorically related these to two ideas rooted in philosophical understandings of learning: a “busybody,” who typically jumps between diverse ideas and collects loosely connected information; and a more purpose-driven “hunter,” who systematically ties in closely related concepts to fill their knowledge gaps.

They used these classifications to inform their computational model, the knowledge network. This uses text and context to determine the degree of relatedness between the Wikipedia pages and their content—represented by dots connected with lines of varying thickness to illustrate the strength of association.

In an adaption of the knowledge network, Kamen was classified as a dancer, an archetype elaborated on in an accompanying review paper by Dale Zhou, a Ph.D. candidate in Bassett’s Complex Systems Lab, who had also collaborated with Kamen on “Reveal.”

“The dancer can be described as an individual that breaks away from the traditional pathways of investigation,” says Zhou. “Someone who takes leaps of creative imagination and in the process, produces new concepts and radically remodels knowledge networks.”

Read the full story in Penn Today.

Rebecca Kamen is a visiting scholar and artist-in-residence in the Department of Physics & Astronomy in Penn’s School of Arts & Sciences.

Dale Zhou is a Ph.D. candidate in Penn’s Neuroscience Graduate Group.

Dani Smith Bassett is J. Peter Skirkanich Professor in Bioengineering with secondary appointments in the Departments of Physics & Astronomy, Electrical & Systems Engineering, Neurology, and Psychiatry.

David Lydon-Staley is an Assistant Professor in the Annenberg School for Communications and Bioengineering and is an alumnus of the Bassett Lab.

 

ASSET Center Inaugural Seed Grants Will Fund Trustworthy AI Research in Healthcare

by

Illustration credit: Melissa Pappas

Penn Engineering’s newly established ASSET Center aims to make AI-enabled systems more “safe, explainable and trustworthy” by studying the fundamentals of the artificial neural networks that organize and interpret data to solve problems.

ASSET’s first funding collaboration is with Penn’s Perelman School of Medicine (PSOM) and the Penn Institute for Biomedical Informatics (IBI). Together, they have launched a series of seed grants that will fund research at the intersection of AI and healthcare.

Teams featuring faculty members from Penn Engineering, Penn Medicine and the Wharton School applied for these grants, to be funded annually at $100,000. A committee consisting of faculty from both Penn Engineering and PSOM evaluated 18 applications and  judged the proposals based on clinical relevance, AI foundations and potential for impact.

Artificial intelligence and machine learning promise to revolutionize nearly every field, sifting through massive amounts of data to find insights that humans would miss, making faster and more accurate decisions and predictions as a result.

Applying those insights to healthcare could yield life-saving benefits. For example, AI-enabled systems could analyze medical imaging for hard-to-spot tumors, collate multiple streams of disparate patient information for faster diagnoses or more accurately predict the course of disease.

Given the stakes, however, understanding exactly how these technologies arrive at their conclusions is critical. Doctors, nurses and other healthcare providers won’t use such technologies if they don’t trust that their internal logic is sound.

“We are developing techniques that will allow AI-based decision systems to provide both quantifiable guarantees and explanations of their predictions,” says Rajeev Alur, Zisman Family Professor in Computer and Information Science and Director of the ASSET Center. “Transparency and accuracy are key.”

“Development of explainable and trustworthy AI is critical for adoption in the practice of medicine,” adds Marylyn Ritchie, Professor of Genetics and Director of the Penn Institute for Biomedical Informatics. “We are thrilled about this partnership between ASSET and IBI to fund these innovative and exciting projects.”

 Seven projects were selected in the inaugural class, including projects from Dani S. Bassett, J. Peter Skirkanich Professor in the Departments of Bioengineering, Electrical and Systems Engineering, Physics & Astronomy, Neurology, and Psychiatry, and several members of the Penn Bioengineering Graduate Group: Despina Kontos, Matthew J. Wilson Professor of Research Radiology II, Department of Radiology, Penn Medicine and Lyle Ungar, Professor, Department of Computer and Information Science, Penn Engineering; Spyridon Bakas, Assistant Professor, Departments of Pathology and Laboratory Medicine and Radiology, Penn Medicine; and Walter R. Witschey, Associate Professor, Department of Radiology, Penn Medicine.

Optimizing clinical monitoring for delivery room resuscitation using novel interpretable AI

Elizabeth Foglia, Associate Professor, Department of Pediatrics, Penn Medicine and the Children’s Hospital of Philadelphia

Dani S. Bassett, J. Peter Skirkanich Professor, Departments of Bioengineering and Electrical and Systems Engineering, Penn Engineering

 This project will apply a novel interpretable machine learning approach, known as the Distributed Information Bottleneck, to solve pressing problems in identifying and displaying critical information during time-sensitive clinical encounters. This project will develop a framework for the optimal integration of information from multiple physiologic measures that are continuously monitored during delivery room resuscitation. The team’s immediate goal is to detect and display key target respiratory parameters during delivery room resuscitation to prevent acute and chronic lung injury for preterm infants. Because this approach is generalizable to any setting in which complex relations between information-rich variables are predictive of health outcomes, the project will lay the groundwork for future applications to other clinical scenarios.

Read the full list of projects and abstracts in Penn Engineering Today.

Dani Smith Bassett Receives 2022-23 Heilmeier Award

by Olivia J. McMahon

Dani Bassett, Ph.D.

Dani Smith Bassett, J. Peter Skirkanich Professor in Bioengineering and in Electrical and Systems Engineering in Penn Engineering, has been named the recipient of the 2022-23 George H. Heilmeier Faculty Award for Excellence in Research for “groundbreaking contributions to modeling and control of brain networks in the contexts of learning, disease and aging.”

The Heilmeier Award honors a Penn Engineering faculty member whose work is scientifically meritorious and has high technological impact and visibility. It is named for the late George H. Heilmeier, a Penn Engineering alumnus and member of the School’s Board of Advisors, whose technological contributions include the development of liquid crystal displays and whose honors include the National Medal of Science and Kyoto Prize.

Bassett, who also holds appointments in Physics & Astronomy in Penn Arts & Sciences and in Neurology and Psychiatry in the Perelman School of Medicine, is a pioneer in the field of network neuroscience, an emerging subfield which incorporates elements of mathematics, physics, biology and systems engineering to better understand how the overall shape of connections between individual neurons influences cognitive traits. They lead the Complex Systems lab, which tackles problems at the intersection of science, engineering and medicine using systems-level approaches, exploring fields such as curiosity, dynamic networks in neuroscience, and psychiatric disease.

Bassett will deliver the 2022-23 Heilmeier Award Lecture in Spring 2023.

Grace Hopper Distinguished Lecture: “How Memory Guides Value-Based Decisions” (Daphna Shohamy, Columbia University)

We hope you will join us for the 2022 Grace Hopper Distinguished Lecture by Dr. Jennifer Lewis, presented by the Department of Bioengineering and hosted by Dani S. Bassett, J. Peter Skirkanich Professor in Bioengineering, Electrical and Systems Engineering, Physics & Astronomy, Neurology and Psychiatry.

Date: Thursday, December 8, 2022
Start Time: 3:30 PM EST
Location: Glandt Forum, Singh Center for Nanotechnology, 3205 Walnut Street, Philadelphia, PA 19104

Join us after the live lecture for a light reception!

Daphna Shohamy, Ph.D.

 

Speaker: Daphna Shohamy, Ph.D.
Kavli Professor of Brain Science, Co-Director of the Kavli Institute for Brain Science, Professor in the Department of Psychology & Zuckerman Mind Brain Behavior Institute
Columbia University

Title: “How Memory Guides Value-Based Decisions”

Zoom link
Passcode: 704696

 

Lecture Abstract:

From robots to humans, the ability to learn from experience turns a rigid response system into a flexible, adaptive one. In the past several decades, major advances have been made in understanding how humans and other animals learn from experience to make decisions. However, most of this progress has focused on rather simple forms of stimulus-response learning, such as automatic responses or habits. In this talk, I will turn to consider how past experience guides more complex decisions, such as those requiring flexible reasoning, inference, and deliberation. Across a range of behavioral contexts, I will demonstrate a critical role for memory in such decisions and will discuss how multiple brain regions interact to support learning, what this means for how memories are used, and the consequences for how decisions are made. Uncovering the pervasive role of memory in decision-making challenges the way we think about what memory is for, suggesting that memory’s primary purpose may be to guide future behavior and that storing a record of the past is just one way to do so.

Dr. Shohamy Bio:

Daphna Shohamy, PhD is a professor at Columbia University where she co-directs the Kavli Center for Neural Sciences and is Associate Director of the Zuckerman Mind, Brain Behavior Institute. Dr. Shohamy’s work focuses on the link between memory, and decision-making. Combining brain imaging in healthy humans with studies of patients with neurological and psychiatric disorders, Dr. Shohamy seeks to understand how the brain transforms experiences into memories; how memories shape decisions and actions; and how motivation and exploration affect human behavior.

Information on the Grace Hopper Lecture:
In support of its educational mission of promoting the role of all engineers in society, the School of Engineering and Applied Science presents the Grace Hopper Lecture Series. This series is intended to serve the dual purpose of recognizing successful women in engineering and of inspiring students to achieve at the highest level.

Rear Admiral Grace Hopper was a mathematician, computer scientist, systems designer and the inventor of the compiler. Her outstanding contributions to computer science benefited academia, industry and the military. In 1928 she graduated from Vassar College with a B.A. in mathematics and physics and joined the Vassar faculty. While an instructor, she continued her studies in mathematics at Yale University where she earned an M.A. in 1930 and a Ph.D. in 1934. Grace Hopper is known worldwide for her work with the first large-scale digital computer, the Navy’s Mark I. In 1949 she joined Philadelphia’s Eckert-Mauchly, founded by the builders of ENIAC, which was building UNIVAC I. Her work on compilers and on making machines understand ordinary language instructions lead ultimately to the development of the business language, COBOL. Grace Hopper served on the faculty of the Moore School for 15 years, and in 1974 received an honorary degree from the University. In support of the accomplishments of women in engineering, each department within the School invites a prominent speaker for a one or two-day visit that incorporates a public lecture, various mini-talks and opportunities to interact with undergraduate and graduate students and faculty.

Listen: ‘Curious Minds’ on NPR’s ‘Detroit Today’

by Ebonee Johnson

Twin siblings and scholars Dani S. Bassett of Penn and Perry Zurn of American University collaborated over half a dozen years to write “Curious Minds: The Power of Connection.” (Image: Tony and Tracy Wood Photography)

Twin academics Dani S. Basset, J. Peter Skirkanich Professor and director of the Complex Systems Lab, and Perry Zurn, a professor of philosophy at American University, were recently featured as guests on NPR radio show “Detroit Today” to discuss their new book, “Curious Mind: The Power of Connection.”

In their book, Basset and Zurn draw on their previous research, as well as an expansive network of ideas from philosophy, history, education and art to explore how and why people experience curiosity, as well as the different types it can take.

Basset, who holds appointments in the Departments of Bioengineering and Electrical and Systems Engineering, as well as the Department of Physics and Astronomy in Penn Arts & Science, and the Departments of Neuroscience and Psychiatry in Penn Perelman’s School of Medicine, and Zurn spoke with “Detroit Today” producer Sam Corey about what types of things make people curious, and how to stimulate more curiosity in our everyday lives.

According to the twin experts, curiosity is not a standalone facet of one’s personality. Basset and Zurn’s work has shown that a person’s capacity for inquiry is very much tied to the overall state of their health.

“There’s a lot of scientific research focusing on intellectual humility and also openness to ideas,” says Bassett. “And there are really interesting relationships between someone’s openness to ideas, someone’s intellectual humility and their curiosity and also their wellbeing or flourishing,”

Listen to “What makes people curious and how to encourage the act” at “Detroit Today.”

Register for a book signing event for “Curious Minds: The Power of Connection,” on Friday, December 9th at the Penn Bookstore.

This story originally appeared in Penn Engineering Today.

‘Curious Minds: The Power of Connection’

Twin siblings and scholars Dani S. Bassett of Penn and Perry Zurn of American University collaborated over half a dozen years to write “Curious Minds: The Power of Connection.” (Image: Tony and Tracy Wood Photography)

With appointments in the Departments of Bioengineering and Electrical and Systems Engineering, as well as the Department of Physics and Astronomy in Penn Arts & Science, and the Departments of Neuroscience and Psychiatry in Penn Perelman’s School of Medicine, Dani S. Bassett is no stranger to following the thread of an idea, no matter where it might lead.

Curious Minds book cover

Those wide-ranging fields and disciplines orbit around an appropriate central question: how does the tangle of neurons in our brains wire itself up to learn new things? Bassett, J. Peter Skirkanich Professor and director of the Complex Systems Lab, studies the relationship between the shape of those networks of neurons and the brain’s abilities, especially the way the shape of the network grows and changes with the addition of new knowledge.

 

To get at the fundamentals of the question of curiosity, Bassett needed to draw on even more disciplines. Fortunately, they didn’t have to look far; Bassett’s identical twin is Perry Zurn, a professor of philosophy at American University, and the two have investigated the many different ways a person can exhibit curiosity.

Bassett and Zurn have now published a new book on the subject. In Curious Minds: The Power of Connection, the twins draw on their previous research, as well as an expansive network of ideas from philosophy, history, education and art.

In an interview with The Guardian, Bassett explains how these threads wove together:

“It wasn’t clear at the beginning of our careers that we would even ever have a chance to write a book together because our areas were so wildly different,” Bassett says – but then, as postgraduates, Zurn was studying the philosophy of curiosity while Bassett was working on the neuroscience of learning. “And so that’s when we started talking. That talking led to seven years of doing research together,” Bassett says. “This book is a culmination of that.”

How exactly do philosophy and neuroscience complement each other? It all starts with the book’s first, and most deceptively simple question: what is curiosity? “Several investigators in science have underscored that perhaps the field isn’t even ready to define curiosity and how it’s different from other cognitive processes,” says Bassett. The ambiguity in the neuroscience literature motivated Bassett to turn to philosophy, “where there are really rich historical definitions and styles and subtypes that we can then put back into neuroscience and ask: ‘Can we see these in the brain?’”

Curious Minds: The Power of Connection is available now. Read Amelia Tait’s review “Are you a busybody, a hunter or a dancer? A new book about curiosity reveals all,” in The Guardian. 

This story originally appeared in Penn Engineering Today.

“The nanobots are among us”: Penn Bioengineering Research Featured in Wired

César de la Fuente, PhD

César de la Fuente, Presidential Assistant Professor in Bioengineering, Microbiology, Psychiatry, and Chemical and Biomolecular Engineering, co-led a team of researchers who created autonomous particles covered with patches of protein “motors,” with the goal that these bots can eventually carry livesaving drugs through bodily fluids.

 

 

Read “These Nanobots Can Swim Around a Wound and Kill Bacteria” in Wired.

César de la Fuente Receives 2022 RSEQ Young Investigator Award

César de la Fuente, PhD

César de la Fuente, Presidential Assistant Professor in Psychiatry, Bioengineering, Microbiology, and in Chemical and Biomolecular Engineering has been honored with a 2022 Young Investigator Award by the Royal Spanish Society of Chemistry (RSEQ) for his pioneering research efforts to combine the power of machines and biology to help prevent, detect, and treat infectious diseases.

Read the RSEQ’s announcement here.

This story originally appeared in Penn Medicine News’s Awards & Accolades post for April 2022.

 

Penn Bioengineering Celebrates Five Researchers on Highly Cited Researchers 2021 List

The Department of Bioengineering is proud to announce that five of our faculty have been named on the annual Highly Cited Researchers™ 2021 list from Clarivate:

Dani Bassett, Ph.D.

Dani S. Bassett, J. Peter Skirkanich Professor in Bioengineering and in Electrical and Systems Engineering
Bassett runs the Complex Systems lab which tackles problems at the intersection of science, engineering, and medicine using systems-level approaches, exploring fields such as curiosity, dynamic networks in neuroscience, and psychiatric disease. They are a pioneer in the emerging field of network science which combines mathematics, physics, biology and systems engineering to better understand how the overall shape of connections between individual neurons influences cognitive traits.

Robert D. Bent Chair
Jason Burdick, Ph.D.

Jason A. Burdick, Robert D. Bent Professor in Bioengineering
Burdick runs the Polymeric Biomaterials Laboratory which develops polymer networks for fundamental and applied studies with biomedical applications with a specific emphasis on tissue regeneration and drug delivery. The specific targets of his research include: scaffolding for cartilage regeneration, controlling stem cell differentiation through material signals, electrospinning and 3D printing for scaffold fabrication, and injectable hydrogels for therapies after a heart attack.

César de la Fuente, Ph.D.

César de la Fuente, Presidential Assistant Professor in Bioengineering and Chemical & Biomedical Engineering in Penn Engineering and in Microbiology and Psychiatry in the Perelman School of Medicine
De la Fuente runs the Machine Biology Group which combines the power of machines and biology to prevent, detect, and treat infectious diseases. He pioneered the development of the first antibiotic designed by a computer with efficacy in animals, designed algorithms for antibiotic discovery, and invented rapid low-cost diagnostics for COVID-19 and other infections.

Carl June, M.D.

Carl H. June, Richard W. Vague Professor in Immunotherapy in the Perelman School of Medicine and member of the Bioengineering Graduate Group
June is the Director for the Center for Cellular Immunotherapies and the Parker Institute for Cancer Therapy and runs the June Lab which develops new forms of T cell based therapies. June’s pioneering research in gene therapy led to the FDA approval for CAR T therapy for treating acute lymphoblastic leukemia (ALL), one of the most common childhood cancers.

Vivek Shenoy, Ph.D.

Vivek Shenoy, Eduardo D. Glandt President’s Distinguished Professor in Bioengineering, Mechanical Engineering and Applied Mechanics (MEAM), and in Materials Science and Engineering (MSE)
Shenoy runs the Theoretical Mechanobiology and Materials Lab which develops theoretical concepts and numerical principles for understanding engineering and biological systems. His analytical methods and multiscale modeling techniques gain insight into a myriad of problems in materials science and biomechanics.

The highly anticipated annual list identifies researchers who demonstrated significant influence in their chosen field or fields through the publication of multiple highly cited papers during the last decade. Their names are drawn from the publications that rank in the top 1% by citations for field and publication year in the Web of Science™ citation index.

Bassett and Burdick were both on the Highly Cited Researchers list in 2019 and 2020.

The methodology that determines the “who’s who” of influential researchers draws on the data and analysis performed by bibliometric experts and data scientists at the Institute for Scientific Information™ at Clarivate. It also uses the tallies to identify the countries and research institutions where these scientific elite are based.

David Pendlebury, Senior Citation Analyst at the Institute for Scientific Information at Clarivate, said: “In the race for knowledge, it is human capital that is fundamental and this list identifies and celebrates exceptional individual researchers who are having a great impact on the research community as measured by the rate at which their work is being cited by others.”

The full 2021 Highly Cited Researchers list and executive summary can be found online here.

Dani Bassett Elected an American Physical Society Fellow

Dani Bassett, Ph.D.

Dani S. Bassett,  J. Peter Skirkanich Professor in the departments of Bioengineering and Electrical and Systems Engineering, has been elected a 2021 Fellow of the American Physical Society (APS) “for significant contributions to the network modeling of the human brain, including dynamical changes caused by evolution, learning, aging, and disease.”

The prestigious APS Fellowship Program signifies recognition by one’s professional peers. Each year, no more than one half of one percent of the APS membership is recognized with this distinct honor. Bassett’s election and groundbreaking work in biological physics and network science will be recognized through presentation of a certificate at the APS March Meeting.

Bassett is a pioneer in the field of network neuroscience, an emerging subfield which incorporates elements of mathematics, physics,  biology and systems engineering to better understand how the overall shape of connections between individual neurons influences cognitive traits. They lead the Complex Systems lab which tackles problems at the intersection of science, engineering, and medicine using systems-level approaches, exploring fields such as curiosity, dynamic networks in neuroscience, and psychiatric disease.

Bassett recently collaborated with Penn artist-in-residence Rebecca Kamen and other scholars on an interdisciplinary art exhibit on the creative process in art and science at the Katzen Art Center at American University. They have also published research modeling different types of curiosity and exploring gender-based citation bias in neuroscience publishing.

“I’m thrilled and humbled to receive this honor from the American Physical Society,” says Bassett. “I am indebted to the many fantastic mentees, colleagues, and mentors that have made my time in science such an exciting adventure. Thank you.”

Read more stories about Bassett’s research here.