Search results
Found 12778 matches for
Welcome to OXION, Universities of Oxford, Cambridge, London and MRC Harwell
Midbrain Dopamine Neurons Signal Belief in Choice Accuracy during a Perceptual Decision.
Central to the organization of behavior is the ability to predict the values of outcomes to guide choices. The accuracy of such predictions is honed by a teaching signal that indicates how incorrect a prediction was ("reward prediction error," RPE). In several reinforcement learning contexts, such as Pavlovian conditioning and decisions guided by reward history, this RPE signal is provided by midbrain dopamine neurons. In many situations, however, the stimuli predictive of outcomes are perceptually ambiguous. Perceptual uncertainty is known to influence choices, but it has been unclear whether or how dopamine neurons factor it into their teaching signal. To cope with uncertainty, we extended a reinforcement learning model with a belief state about the perceptually ambiguous stimulus; this model generates an estimate of the probability of choice correctness, termed decision confidence. We show that dopamine responses in monkeys performing a perceptually ambiguous decision task comply with the model's predictions. Consequently, dopamine responses did not simply reflect a stimulus' average expected reward value but were predictive of the trial-to-trial fluctuations in perceptual accuracy. These confidence-dependent dopamine responses emerged prior to monkeys' choice initiation, raising the possibility that dopamine impacts impending decisions, in addition to encoding a post-decision teaching signal. Finally, by manipulating reward size, we found that dopamine neurons reflect both the upcoming reward size and the confidence in achieving it. Together, our results show that dopamine responses convey teaching signals that are also appropriate for perceptual decisions.
Economic choices reveal probability distortion in macaque monkeys.
Economic choices are largely determined by two principal elements, reward value (utility) and probability. Although nonlinear utility functions have been acknowledged for centuries, nonlinear probability weighting (probability distortion) was only recently recognized as a ubiquitous aspect of real-world choice behavior. Even when outcome probabilities are known and acknowledged, human decision makers often overweight low probability outcomes and underweight high probability outcomes. Whereas recent studies measured utility functions and their corresponding neural correlates in monkeys, it is not known whether monkeys distort probability in a manner similar to humans. Therefore, we investigated economic choices in macaque monkeys for evidence of probability distortion. We trained two monkeys to predict reward from probabilistic gambles with constant outcome values (0.5 ml or nothing). The probability of winning was conveyed using explicit visual cues (sector stimuli). Choices between the gambles revealed that the monkeys used the explicit probability information to make meaningful decisions. Using these cues, we measured probability distortion from choices between the gambles and safe rewards. Parametric modeling of the choices revealed classic probability weighting functions with inverted-S shape. Therefore, the animals overweighted low probability rewards and underweighted high probability rewards. Empirical investigation of the behavior verified that the choices were best explained by a combination of nonlinear value and nonlinear probability distortion. Together, these results suggest that probability distortion may reflect evolutionarily preserved neuronal processing.
Dopamine prediction error responses integrate subjective value from different reward dimensions.
Prediction error signals enable us to learn through experience. These experiences include economic choices between different rewards that vary along multiple dimensions. Therefore, an ideal way to reinforce economic choice is to encode a prediction error that reflects the subjective value integrated across these reward dimensions. Previous studies demonstrated that dopamine prediction error responses reflect the value of singular reward attributes that include magnitude, probability, and delay. Obviously, preferences between rewards that vary along one dimension are completely determined by the manipulated variable. However, it is unknown whether dopamine prediction error responses reflect the subjective value integrated from different reward dimensions. Here, we measured the preferences between rewards that varied along multiple dimensions, and as such could not be ranked according to objective metrics. Monkeys chose between rewards that differed in amount, risk, and type. Because their choices were complete and transitive, the monkeys chose "as if" they integrated different rewards and attributes into a common scale of value. The prediction error responses of single dopamine neurons reflected the integrated subjective value inferred from the choices, rather than the singular reward attributes. Specifically, amount, risk, and reward type modulated dopamine responses exactly to the extent that they influenced economic choices, even when rewards were vastly different, such as liquid and food. This prediction error response could provide a direct updating signal for economic values.
Dopamine Neuron-Specific Optogenetic Stimulation in Rhesus Macaques.
Optogenetic studies in mice have revealed new relationships between well-defined neurons and brain functions. However, there are currently no means to achieve the same cell-type specificity in monkeys, which possess an expanded behavioral repertoire and closer anatomical homology to humans. Here, we present a resource for cell-type-specific channelrhodopsin expression in Rhesus monkeys and apply this technique to modulate dopamine activity and monkey choice behavior. These data show that two viral vectors label dopamine neurons with greater than 95% specificity. Infected neurons were activated by light pulses, indicating functional expression. The addition of optical stimulation to reward outcomes promoted the learning of reward-predicting stimuli at the neuronal and behavioral level. Together, these results demonstrate the feasibility of effective and selective stimulation of dopamine neurons in non-human primates and a resource that could be applied to other cell types in the monkey brain.
High-Yield Methods for Accurate Two-Alternative Visual Psychophysics in Head-Fixed Mice.
Research in neuroscience increasingly relies on the mouse, a mammalian species that affords unparalleled genetic tractability and brain atlases. Here, we introduce high-yield methods for probing mouse visual decisions. Mice are head-fixed, facilitating repeatable visual stimulation, eye tracking, and brain access. They turn a steering wheel to make two alternative choices, forced or unforced. Learning is rapid thanks to intuitive coupling of stimuli to wheel position. The mouse decisions deliver high-quality psychometric curves for detection and discrimination and conform to the predictions of a simple probabilistic observer model. The task is readily paired with two-photon imaging of cortical activity. Optogenetic inactivation reveals that the task requires mice to use their visual cortex. Mice are motivated to perform the task by fluid reward or optogenetic stimulation of dopamine neurons. This stimulation elicits a larger number of trials and faster learning. These methods provide a platform to accurately probe mouse vision and its neural basis.
Dopamine reward prediction error responses reflect marginal utility.
BACKGROUND: Optimal choices require an accurate neuronal representation of economic value. In economics, utility functions are mathematical representations of subjective value that can be constructed from choices under risk. Utility usually exhibits a nonlinear relationship to physical reward value that corresponds to risk attitudes and reflects the increasing or decreasing marginal utility obtained with each additional unit of reward. Accordingly, neuronal reward responses coding utility should robustly reflect this nonlinearity. RESULTS: In two monkeys, we measured utility as a function of physical reward value from meaningful choices under risk (that adhered to first- and second-order stochastic dominance). The resulting nonlinear utility functions predicted the certainty equivalents for new gambles, indicating that the functions' shapes were meaningful. The monkeys were risk seeking (convex utility function) for low reward and risk avoiding (concave utility function) with higher amounts. Critically, the dopamine prediction error responses at the time of reward itself reflected the nonlinear utility functions measured at the time of choices. In particular, the reward response magnitude depended on the first derivative of the utility function and thus reflected the marginal utility. Furthermore, dopamine responses recorded outside of the task reflected the marginal utility of unpredicted reward. Accordingly, these responses were sufficient to train reinforcement learning models to predict the behaviorally defined expected utility of gambles. CONCLUSIONS: These data suggest a neuronal manifestation of marginal utility in dopamine neurons and indicate a common neuronal basis for fundamental explanatory constructs in animal learning theory (prediction error) and economic decision theory (marginal utility).
Orbitofrontal cortex is required for optimal waiting based on decision confidence.
Confidence judgments are a central example of metacognition-knowledge about one's own cognitive processes. According to this metacognitive view, confidence reports are generated by a second-order monitoring process based on the quality of internal representations about beliefs. Although neural correlates of decision confidence have been recently identified in humans and other animals, it is not well understood whether there are brain areas specifically important for confidence monitoring. To address this issue, we designed a postdecision temporal wagering task in which rats expressed choice confidence by the amount of time they were willing to wait for reward. We found that orbitofrontal cortex inactivation disrupts waiting-based confidence reports without affecting decision accuracy. Furthermore, we show that a normative model can quantitatively account for waiting times based on the computation of decision confidence. These results establish an anatomical locus for a metacognitive report, confidence judgment, distinct from the processes required for perceptual decisions.
Components and characteristics of the dopamine reward utility signal.
Rewards are defined by their behavioral functions in learning (positive reinforcement), approach behavior, economic choices, and emotions. Dopamine neurons respond to rewards with two components, similar to higher order sensory and cognitive neurons. The initial, rapid, unselective dopamine detection component reports all salient environmental events irrespective of their reward association. It is highly sensitive to factors related to reward and thus detects a maximal number of potential rewards. It also senses aversive stimuli but reports their physical impact rather than their aversiveness. The second response component processes reward value accurately and starts early enough to prevent confusion with unrewarded stimuli and objects. It codes reward value as a numeric, quantitative utility prediction error, consistent with formal concepts of economic decision theory. Thus, the dopamine reward signal is fast, highly sensitive and appropriate for driving and updating economic decisions.
Distinct Structure of Cortical Population Activity on Fast and Infraslow Timescales.
Cortical activity is organized across multiple spatial and temporal scales. Most research on the dynamics of neuronal spiking is concerned with timescales of 1 ms-1 s, and little is known about spiking dynamics on timescales of tens of seconds and minutes. Here, we used frequency domain analyses to study the structure of individual neurons' spiking activity and its coupling to local population rate and to arousal level across 0.01-100 Hz frequency range. In mouse medial prefrontal cortex, the spiking dynamics of individual neurons could be quantitatively captured by a combination of interspike interval and firing rate power spectrum distributions. The relative strength of coherence with local population often differed across timescales: a neuron strongly coupled to population rate on fast timescales could be weakly coupled on slow timescales, and vice versa. On slow but not fast timescales, a substantial proportion of neurons showed firing anticorrelated with the population. Infraslow firing rate changes were largely determined by arousal rather than by local factors, which could explain the timescale dependence of individual neurons' population coupling strength. These observations demonstrate how neurons simultaneously partake in fast local dynamics, and slow brain-wide dynamics, extending our understanding of infraslow cortical activity beyond the mesoscale resolution of fMRI.
Dopaminergic and Prefrontal Basis of Learning from Sensory Confidence and Reward Value.
Deciding between stimuli requires combining their learned value with one's sensory confidence. We trained mice in a visual task that probes this combination. Mouse choices reflected not only present confidence and past rewards but also past confidence. Their behavior conformed to a model that combines signal detection with reinforcement learning. In the model, the predicted value of the chosen option is the product of sensory confidence and learned value. We found precise correlates of this variable in the pre-outcome activity of midbrain dopamine neurons and of medial prefrontal cortical neurons. However, only the latter played a causal role: inactivating medial prefrontal cortex before outcome strengthened learning from the outcome. Dopamine neurons played a causal role only after outcome, when they encoded reward prediction errors graded by confidence, influencing subsequent choices. These results reveal neural signals that combine reward value with sensory confidence and guide subsequent learning.
Transcription Factors Regulating Vasculogenesis and Angiogenesis.
Transcription factors play a crucial role in regulating the dynamic and precise patterns of gene expression required for the initial specification of endothelial cells (ECs), and during endothelial growth and differentiation. Whilst sharing many core features, ECs can be highly heterogeneous. Differential gene expression between ECs is essential to pattern the hierarchical vascular network into arteries, veins, and capillaries, to drive angiogenic growth of new vessels and to direct specialization in response to local signals. Unlike many other cell types, ECs have no single master regulator, instead relying on differing combinations of a necessarily limited repertoire of transcription factors in order to achieve tight spatial and temporal activation and repression of gene expression. Here, we will discuss the cohort of transcription factors known to be involved in directing gene expression during different stages of mammalian vasculogenesis and angiogenesis with a primary focus on development. This article is protected by copyright. All rights reserved.
Finding and Verifying Enhancers for Endothelial-Expressed Genes.
Identification and analysis of enhancers for endothelial-expressed genes can provide crucial information regarding their upstream transcriptional regulators. However, enhancer identification can be challenging, particularly for people with limited access or experience of bioinformatics, and transgenic analysis of enhancer activity patterns can be prohibitively expensive. Here we describe how to use publicly available datasets displayed on the UCSC Genome Browser to identify putative endothelial enhancers for mammalian genes. Furthermore, we detail how to utilize mosaic Tol2-mediated transgenesis in zebrafish to verify whether a putative enhancer is capable of directing endothelial-specific patterns of gene expression.
Hypoperfusion Precedes Tau Deposition in the Entorhinal Cortex: A Retrospective Evaluation of ADNI-2 Data.
BACKGROUND AND PURPOSE: Tau deposition in the entorhinal cortex is the earliest pathological feature of Alzheimer's disease (AD). However, this feature has also been observed in cognitively normal (CN) individuals and those with mild cognitive impairment (MCI). The precise pathophysiology for the development of tau deposition remains unclear. We hypothesized that reduced cerebral perfusion is associated with the development of tau deposition. METHODS: A subset of the Alzheimer's Disease Neuroimaging Initiative data set was utilized. Included patients had undergone arterial spin labeling perfusion MRI along with [18F]flortaucipir tau PET at baseline, within 1 year of the MRI, and a follow-up at 6 years. The association between baseline cerebral blood flow (CBF) and the baseline and 6-year tau PET was assessed. Univariate and multivariate linear modeling was performed, with p<0.05 indicating significance. RESULTS: Significant differences were found in the CBF between patients with AD and MCI, and CN individuals in the left entorhinal cortex (p=0.013), but not in the right entorhinal cortex (p=0.076). The difference in maximum standardized uptake value ratio between 6 years and baseline was significantly and inversely associated with the baseline mean CBF (p=0.042, R²=0.54) in the left entorhinal cortex but not the right entorhinal cortex. Linear modeling demonstrated that CBF predicted 6-year tau deposition (p=0.015, R²=0.11). CONCLUSIONS: The results of this study suggest that a reduction in CBF at the entorhinal cortex precedes tau deposition. Further work is needed to understand the mechanism underlying tau deposition in aging and disease.
Regulation of immunological tolerance by the p53-inhibitor iASPP.
Maintenance of immunological homeostasis between tolerance and autoimmunity is essential for the prevention of human diseases ranging from autoimmune disease to cancer. Accumulating evidence suggests that p53 can mitigate phagocytosis-induced adjuvanticity thereby promoting immunological tolerance following programmed cell death. Here we identify Inhibitor of Apoptosis Stimulating p53 Protein (iASPP), a negative regulator of p53 transcriptional activity, as a regulator of immunological tolerance. iASPP-deficiency promoted lung adenocarcinoma and pancreatic cancer tumorigenesis, while iASPP-deficient mice were less susceptible to autoimmune disease. Immune responses to iASPP-deficient tumors exhibited hallmarks of immunosuppression, including activated regulatory T cells and exhausted CD8+ T cells. Interestingly, iASPP-deficient tumor cells and tumor-infiltrating myeloid cells, CD4+, and γδ T cells expressed elevated levels of PD-1H, a recently identified transcriptional target of p53 that promotes tolerogenic phagocytosis. Identification of an iASPP/p53 axis of immune homeostasis provides a therapeutic opportunity for both autoimmune disease and cancer.
Analysis Protocol for Renal Sodium (23Na) MR Imaging.
The signal acquired in sodium (23Na) MR imaging is proportional to the concentration of sodium in a voxel, and it is possible to convert between the two using external calibration phantoms. Postprocessing, and subsequent analysis, of sodium renal images is a simple task that can be performed with readily available software. Here we describe the process of conversion between sodium signal and concentration, estimation of the corticomedullary sodium gradient and the procedure used for quadrupolar relaxation analysis.This chapter is based upon work from the COST Action PARENCHIMA, a community-driven network funded by the European Cooperation in Science and Technology (COST) program of the European Union, which aims to improve the reproducibility and standardization of renal MRI biomarkers. This analysis protocol chapter is complemented by two separate chapters describing the basic concept and experimental procedure.
