Assistant Professor, Psychological and Brain Sciences
White-matter, microstructure, anatomy and brain tracts. Tractogrpahy. Computational modeling of human behavior and brain activity. Psychophyscis of visual perception and reading. Behavioral and brain mechanisms of motivation and attention.
Mapping the human brain requires integrating technologies that allow measuring behavior and brain signals evolving over slower and faster time scales. Behavior is organized at multiple time scales. It take years to acquire fluency in non-native languages, but car drivers can reliably pay attention to approaching danger in congested rush-hour freeways in a matter of milliseconds. Such large operational range requires distinct, dedicated brain mechanisms. The mechanisms involved in processing slow-evolving events may depend on both, changes in the activity of populations of neurons as well as changes in the properties of networks of white-matter fascicles. The mechanisms dedicated to fast information processing are believed to be coded in the spikes and synaptic activity of neuronal populations.
I study the brain and psychology of individuals from a systems neuroscience perspective. This means that I am interested in understanding how neurons in different brain areas connect together to form networks. I combine multiple neurobiological measurements to study how the mechanisms of these brain networks determine our vision of the world, values and motivate our behavior. My research relies on a model-based approach. Models are implementations of otherwise abstract theories; they allow for generating specific predictions for human behavior or brain connectivity. Errors in model prediction can be exploited to test and falsify alternative theories. I use neurobiological measurements from two magnetic resonance imaging (MRI) technologies (diffusion and functional MRI). Using these measurements in living human brains I build models that predict either the properties of the brain network of connections (the connectome) or human behavior from brain activity.
Mapping the network of white-matter connections in living human brains. Magnetic resonance diffusion imaging and computational tractography are the only technologies that enable neuroscientists to measure white matter in the living human brain. Diffusion MRI provides a way to measure the changes in brain structures and tissue properties evolving over long time frames-weeks, months and years. In the decade since their development, these technologies revolutionized our understanding of the importance of white-matter for health and disease. Prior to these measurements, the white matter was thought of as a passive cabling system. But modern measurements show that white matter axons and glia respond to experience and that the tissue properties of the white matter are transformed during development and following training. The white matter pathways comprise a set of active wires and the responses and properties of these wires predict human cognitive and emotional abilities in health and disease. We can now predict confidently that to crack the neural code in mapping the human brain, neuroscientists will have to develop an account of the connections and tissue properties of these active wires. Diffusion imaging and computational tractography enable investigators to map the network of white matter tracts. Whereas there are many impressive findings using this technology, it is widely agreed that there is an urgent need to keep developing and improving tractography methods.
Evaluation and statistical inference in living connectomes. At Stanford University, I developed a technology, called LiFE - Linear Fascicle Evaluation, to perform both tractography validation and statistical testing on the network of brain connections. Previous validation methods are extrinsic. Investigators have demonstrated that tractography algorithms generate reasonable estimates by checking in phantoms and ex-vivo tissue. These methods do not take into account the quality of a specific tractography solution (the connectome) obtained from a specific group of subjects and a specific instrument. Extrinsic validations ask us to believe a tractography solution obtained from a child with a 3T GE scanner based on a validation carried out on a ex-vivo macaque brain from a 7T Siemens scanner. LiFE can be applied to the data at hand rather than appealing to validations based on very different datasets-I call this method native validation. I utilize Big Data and machine-learning methods to treat connectomes as models of the measured white-matter signal. The model generates a prediction of the measured diffusion signal. The model prediction-error is used to identify the network of brain connections best supporting the measured diffusion signal by rejecting false connections. The technology a principled way to test hypotheses about the geometric structure of white-matter fascicles and to compare the accuracy of different connectomes-I call the method virtual lesion. These method can be applied to any type of diffusion data in healthy and diseased populations. These new methods improve current techniques in fundamental ways. A full open-source software implementation of the method is available here.
Predicting perceptual decision-making from human brain activity. Functional MRI provides neurobiological measurements on the neuronal, synaptic and neuromodulatory mechanisms evolving over fast time scales-seconds, minutes and days. Fast information processing is important for goal-oriented behavior and decision-making. Healthy brains implement several mechanisms to quickly and reliably associate sensory inputs with internal goals and behavioral choices. Attention is an umbrella-term we use to address experimentally the set of brain mechanisms that deal with the selection of information. There are several types of attention. For example, primates can attend to a location in space, an object or feature-such as a color. During graduate school I studied the behavioral changes in contrast and visual acuity thresholds elicited by exogenous attention. This is the type of attention car drivers use to detect approaching danger. Contrast and acuity are fundamental processes that happen early on in the visual analysis. They are necessary for most subsequent perceptual processes; stimuli below acuity- or contrast-threshold are invisible to us. In a series of articles I showed that when attention is attracted to a location in the sensory scene, visibility improves. Concurrently to improved vision at attended locations, both contrast sensitivity and acuity are impaired at locations away from attended ones (Pestilli & Carrasco Vision Research 2005; Pestilli, Viera & Carrasco Journal of Vision 2007; Montagna, Pestilli & Carrasco Vision Research 2009; Pestilli, Ling & Carrasco Vision Research 2009). These behavioral trade-offs have matched effects on cortical activity, whereby the fMRI response in early visual cortex increases at attended and decreases at unattended locations (Liu, Pestilli & Carrasco Neuron 2005).
Attention and visual selection. A fundamental endeavor of neuroscience is to identify the neural mechanisms supporting healthy human decision-making. A successful way to embark in such an effort is by using computational methods to predict decision-making from brain activity. The challenge of such an approach is that it requires concurrent measurements of cortical activity and behavior in tasks for which models can be formulated to quantitatively predict the two measurements. When Gustav Fechner initiated what we call Psychophysics, he had specifically this problem in mind. Fechner had no access to measurements of brain activity, which he replaced with the psychological quantity just-noticeable-difference (JND). Recently, I used the very idea of JND in combination with measurements of brain activity (fMRI) and computational modeling to test the predictions of three alternative models of attentional enhancement. We demonstrated that improvements in behavioral sensitivity with attention are fully accounted for by a model of visual selection (a gating mechanism that pools sensory signals across the visual scene) that does not requires a change in quality of the sensory representation (Pestilli et al., Neuron 2011; Gardner, Hara and Pestilli, Frontiers in Computational Neuroscience in review).
Mechanisms of value processing and motivated behavior. Many situations require selecting one among several options of different value. In these situations valuation and preference drive motivation and behavior. Although attention allows for selecting task-relevant information out of the sensory scene, many decisions depend on the subjective value assigned to alternative options. About one hundred years before Fechner, Daniel Bernoulli (1700-1782) suggested that valuation conforms to a psychological rule akin to the JND proposed by Fechner for sensory Psychophysics. Bernoulli proposed that humans decide among alternatives by using internal utility not extrinsic value. Just like for the JND, utility is equal for alternatives with values of equal ratio. Bernoulli's Utility Theory held still for more than two-hundred years until Amos Tversky and Daniel Kahneman in the 1980s showed that the theory has flaws. They proposed the Prospect Theory, suggesting that utility is not absolute, but depends on the prospective of the decision-maker. Critically, they demonstrated that humans are loss averse; utility is higher for losses than gains of identical absolute value [11]. We investigated the effects of loss aversion, expecting gains versus losses, on perceptual decision-making and cortical activity in early visual cortex (Pestilli, Khan & Ferrera, Society for Neuroscience 2011). We measured fMRI response in early visual cortex concurrently with contrast discrimination thresholds for stimuli of different expected value. We used a computational model to manipulate task difficulty and expected value on a trial-by-trial base. The model determined that on half the trials observers had to perform a perceptual judgment expecting to win. On the other half of the trials subjects performed an identical judgment but expecting to lose. Both perceptual judgments, stimuli and absolute values were identical for gain- and loss-trials. We found that behavioral sensitivity improved and cortical response increased with value in early visual cortex (V1, V2, V3, hV4). The increase followed the log-expected absolute value but was, independent on whether the expected outcome was a loss or a gain. This is predicted by the Utility Theory. Most importantly, cortical responses in early visual cortex increase more for loss-predicting stimuli than for gain-predicting stimuli of equal value: an effect predicted only by the Prospect Theory (Pestilli, Khan and Ferrera in preparation).
Saber, G.*, Pestilli, F.* and Curtis, C. (2015) Saccade planning increases topographic activity in visual cortex The Journal of Neuroscience. *Equal contribution. 35(1):245 - 252.
Gomez, J., Pestilli, F., Witthoft, N., Golarai, G., Liberman, A., Poltoratski, A., Yoon, J., Grill-Spector, K. (2015) Development of high-level visual fasciculi correlates with face perception. Neuron. 85 (1):216 - 227.
Allen, B., Spiegel, D., Thompson, B., Pestilli, F.*, Rokers, B*. (in press) Altered white matter in visual pathways as a result of amblyopia. *Equal senior contribution. Vision Research.
Pestilli, F., Yeatman, J. Rokem, A., Kay, K. and Wandell, B. (2014) Evaluation and statistical inference in living connectomes. Nature Methods. doi:10.1038/nmeth.3098
Yeatman, J.D., Weiner, K.S., Pestilli, F., Rokem, A., Mezer, A., Wandell, B.A. (2014) The vertical occipital fasciculus: A century of controversy resolved by in vivo measurements. Proceedings of the National Academy of Sciences 111.48:E5214 - E5223.
Ling, S., Jehee, J., and Pestilli, F. (2014) A review of the mechanisms by which attentional feedback shapes visual selectivity. Brain Structure and Function. doi:10.1007/s00429 - 014 - 0818 - 5.
Main, K.*, Pestilli, F.*, Mezer, A. Yeatman, J. Martin, R. Phipps, S. Wandell, B. (2014) Speed discrimination predicts word but not pseudo-word reading rate in adults and children. Brain and Language. *Equal contribution.
Hara, Y., Pestilli, F.,and Gardner, JL (2014) Differing predictions for single-units and neuronal populations of the normalization model of attention. Frontiers in Computational Neuroscience.
Zheng, C. Pestilli, F., and Rokem, A. (2014) Deconvolution of High Dimensional Mixtures via Boosting, with Application to Diffusion-Weighted MRI of Human Brain. Neural Information Processing Systems (NIPS).
Zheng, C., Pestilli, F. and Rokem, A. (2014) Quantifying error in estimates of human brain fiber directions using Earth Mover’s Distance. arXiv:1411.5271.
Ogawa, S., Takemura, H., Horiguchi, H., Terao, M., Haji, T., Pestilli, F., Yeatman, J., Tsuneoka, H., Wandell, B., Masuda, Y. (2014) White matter consequences of retinal receptor and ganglion cell damage.Investigative Ophtalmology and Vision Science, IOVS.
Pestilli, F., Heeger, D., Carrasco, M., & Gardner, J. (2011) Attentional enhancement via selection and pooling of early sensory responses in human visual cortex. Neuron. 72(5): 832 - 846.
Pestilli, F., Ling, S., & Carrasco, M. (2009) A population - coding model of attention's influence on contrast response: estimating neural effects from psychophysical data. Vision Research. 49(7):735-745.
Liu T., Pestilli F., & Carrasco M. (2005) Transient attention enhances performance and fMRI response in human visual cortex. Neuron 45 (3): 469 - 47.
Pestilli F. & Carrasco M. (2005) Attention enhances contrast sensitivity at cued and impairs it at uncued locations. Vision Research 45 (14): 1867 - 75.
LiFE - Linear Fascicle Evaluation MatLab routines for evaluating the quality of white-matter connectomes generated using diffusion-weighted imaging. Standard tractography can use diffusion measurements from a living brain to generate a large collection of candidate white-matter fascicles; the connectome. Linear Fascicle Evaluation (LiFE) takes any connectome and uses a forward modelling approach to predict diffusion measurements in the same brain. LiFE predicts the measured diffusion signal using the orientation of the fascicles present in a connectome. LiFE uses the difference between the measured and predicted diffusion signals to measure prediction error. The connectome model prediction error is used to compute two metrics to evaluate the evidence supporting properties of the connectome. One metric -the strength of evidence - compares the mean prediction error between alternative hypotheses. The second metric - the earth movers distance - compares full distributions of prediction error. These metrics can be used for: 1. Comparing tractography algorithms 2. Evaluating the quality of tractography solutions for individual brains or group of brains and 3. Testing hypotheses about white-matter tracts and connections.
MBA - MatLab Brain Anatomy Set of routines for displaying and manipulating brain anatomy using MatLab.
VISTASOFT The main software repository of the Vista lab at Stanford University. It contains Matlab code to perform a variety of analysis on MRI data, including functional MRI and diffusion MRI.
mrTools Provides a set of Matlab tools to analyze fMRI data. It can do basic analyses like correlation analyses used in retinotopy experiments, event-related, population RF and GLM analyses. It can display the results of analyses on inplane anatomies, flat maps and surfaces. It is designed to make it easy to write your own script and programs in Matlab to analyze your data.
MGL - MatLab Open GL A suite of mex/m files for displaying visual psychophysics stimuli and writing experimental programs in Matlab. Runs on Mac OS X (G4/5 and Intel 32 and Intel 64 bit OSVersions 10.5-10.7) Version 2.0.
The College of Arts