List of works - Kenji Doya

A computational neural model of goal-directed utterance selection.

scientific article published on 13 January 2010

A hierarchical Bayesian method to resolve an inverse problem of MEG contaminated with eye movement artifacts.

scientific article published on 25 December 2008

A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity

scientific article

A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task.

scientific article published in February 2004

A spiking neural network model of model-free reinforcement learning with high-dimensional sensory input and perceptual ambiguity

scientific article published on 3 March 2015

A unifying computational framework for motor control and social interaction

scientific article

Activation of dorsal raphe serotonin neurons is necessary for waiting for delayed rewards.

scientific article published in August 2012

Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards.

scientific article published in January 2011

Activation of the central serotonergic system in response to delayed but not omitted rewards ⬇️

scientific article published on November 11, 2010

An excellent year and a transition.

scientific article published in January 2011

Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics.

scientific article published on 18 September 2006

Cerebellar aminergic neuromodulation: towards a functional understanding

article published in 2004

Changing the structure of complex visuo-motor sequences selectively activates the fronto-parietal network.

scientific article published on 16 August 2011

Chaos may enhance information transmission in the inferior olive.

scholarly article

Complementary roles of basal ganglia and cerebellum in learning and motor control.

scientific article

Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions

scientific article

Current trends in decision making.

scientific article published in May 2007

Decision making

scientific article published on 21 November 2012

Derivatives of logarithmic stationary distributions for policy gradient reinforcement learning

scientific article published in February 2010

Distinct neural representation in the dorsolateral, dorsomedial, and ventral parts of the striatum during fixed- and free-choice tasks.

scientific article

Editorial for 2010.

scientific article published on 12 November 2009

Emergence of polymorphic mating strategies in robot colonies

scientific article

Evidence for model-based action planning in a sequential finger movement task.

scientific article

Expected energy-based restricted Boltzmann machine for classification

scientific article

Hierarchical Bayesian estimation for MEG inverse problem.

scientific article published in November 2004

Humans can adopt optimal discounting strategy under real-time constraints.

scientific article

Identification of depression subtypes and relevant brain regions using a data-driven approach

scientific article published on 20 September 2018

Inter-individual discount factor differences in reward prediction are topographically associated with caudate activation.

scientific article

Inter-module credit assignment in modular reinforcement learning.

scientific article published in September 2003

Low-serotonin levels increase delayed reward discounting in humans.

scientific article published in April 2008

Meta-learning in reinforcement learning.

scientific article

Metalearning and neuromodulation.

scientific article

Multi-scale, multi-modal neural modeling and simulation

scientific article published on 14 July 2011

Multiple model-based reinforcement learning explains dopamine neuronal activity

scientific article published on 06 June 2007

Multiple model-based reinforcement learning.

scientific article published in June 2002

Multiple representations and algorithms for reinforcement learning in the cortico-basal ganglia circuit ⬇️

scientific article published on April 29, 2011

Multiple representations of belief states and action values in corticobasal ganglia loops.

scientific article published on 13 April 2007

Near-Saddle-Node Bifurcation Behavior as Dynamics in Working Memory for Goal-Directed Behavior ⬇️

scientific article published on January 1, 1998

Neural and personality correlates of individual differences related to the effects of acute tryptophan depletion on future reward evaluation.

scientific article published on 5 January 2012

Neural substrate of dynamic Bayesian inference in the cerebral cortex

scientific article published on 19 September 2016

Neurocomputational models of brain disorders

scientific article

Nitric oxide regulates input specificity of long-term depression and context dependence of cerebellar learning

scientific article

Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards.

scientific article published on 21 August 2014

Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences - a computational approach.

scientific article published on July 2001

Parallel neural networks for learning sequential procedures.

scientific article

Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops.

scientific article

Reinforcement learning in continuous time and space.

scientific article published in January 2000

Reinforcement learning state estimator.

scientific article published in March 2007

Reinforcement learning with via-point representation.

scientific article published in April 2004

Reinforcement learning: Computational theory and biological mechanisms

scientific article published on 8 May 2007

Representation of action-specific reward values in the striatum.

scientific article published on November 2005

Reward-Predictive Neural Activities in Striatal Striosome Compartments.

scientific article published in January 2018

Robust reinforcement learning.

scientific article published in February 2005

Serotonergic projections to the orbitofrontal and medial prefrontal cortices differentially modulate waiting for future rewards

scientific article published on 27 November 2020

Serotonin affects association of aversive outcomes to past actions

scientific article published in December 2009

Serotonin and the evaluation of future rewards: theory, experiments, and possible neural mechanisms.

scientific article published on 14 March 2007

Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum

scientific article

The computational neurobiology of learning and reward.

scientific article

The mechanism of saccade motor pattern generation investigated by a large-scale spiking neuron model of the superior colliculus

scientific article

The role of serotonin in the regulation of patience and impulsivity

scientific article

The status of MRI databases across the world focused on psychiatric and neurological disorders

scientific article published in October 2024

Three-dimensional distribution of Fos-positive neurons in the supramammillary nucleus of the rat exposed to novel environment.

scientific article published on 3 May 2009

Understanding neural coding through the model-based analysis of decision making

scientific article published on August 2007

Validation of decision-making models and analysis of decision variables in the rat basal ganglia.

scientific article

What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?

scientific article

fMRI investigation of cortical and subcortical networks in the learning of abstract and effector-specific representations of motor sequences.

scientific article published on 22 June 2006

List of works by Kenji Doya

A computational neural model of goal-directed utterance selection.

A hierarchical Bayesian method to resolve an inverse problem of MEG contaminated with eye movement artifacts.

A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity

A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task.

A spiking neural network model of model-free reinforcement learning with high-dimensional sensory input and perceptual ambiguity

A unifying computational framework for motor control and social interaction

Activation of dorsal raphe serotonin neurons is necessary for waiting for delayed rewards.

Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards.

Activation of the central serotonergic system in response to delayed but not omitted rewards ⬇️

An excellent year and a transition.

Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics.

Cerebellar aminergic neuromodulation: towards a functional understanding

Changing the structure of complex visuo-motor sequences selectively activates the fronto-parietal network.

Chaos may enhance information transmission in the inferior olive.

Complementary roles of basal ganglia and cerebellum in learning and motor control.

Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions

Current trends in decision making.

Decision making

Derivatives of logarithmic stationary distributions for policy gradient reinforcement learning

Distinct neural representation in the dorsolateral, dorsomedial, and ventral parts of the striatum during fixed- and free-choice tasks.

Editorial for 2010.

Emergence of polymorphic mating strategies in robot colonies

Evidence for model-based action planning in a sequential finger movement task.

Expected energy-based restricted Boltzmann machine for classification

Hierarchical Bayesian estimation for MEG inverse problem.

Humans can adopt optimal discounting strategy under real-time constraints.

Identification of depression subtypes and relevant brain regions using a data-driven approach

Inter-individual discount factor differences in reward prediction are topographically associated with caudate activation.

Inter-module credit assignment in modular reinforcement learning.

Low-serotonin levels increase delayed reward discounting in humans.

Meta-learning in reinforcement learning.

Metalearning and neuromodulation.

Multi-scale, multi-modal neural modeling and simulation

Multiple model-based reinforcement learning explains dopamine neuronal activity

Multiple model-based reinforcement learning.

Multiple representations and algorithms for reinforcement learning in the cortico-basal ganglia circuit ⬇️

Multiple representations of belief states and action values in corticobasal ganglia loops.

Near-Saddle-Node Bifurcation Behavior as Dynamics in Working Memory for Goal-Directed Behavior ⬇️

Neural and personality correlates of individual differences related to the effects of acute tryptophan depletion on future reward evaluation.

Neural substrate of dynamic Bayesian inference in the cerebral cortex

Neurocomputational models of brain disorders

Nitric oxide regulates input specificity of long-term depression and context dependence of cerebellar learning

Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards.

Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences - a computational approach.

Parallel neural networks for learning sequential procedures.

Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops.

Reinforcement learning in continuous time and space.

Reinforcement learning state estimator.

Reinforcement learning with via-point representation.

Reinforcement learning: Computational theory and biological mechanisms

Representation of action-specific reward values in the striatum.

Reward-Predictive Neural Activities in Striatal Striosome Compartments.

Robust reinforcement learning.

Serotonergic projections to the orbitofrontal and medial prefrontal cortices differentially modulate waiting for future rewards

Serotonin affects association of aversive outcomes to past actions

Serotonin and the evaluation of future rewards: theory, experiments, and possible neural mechanisms.

Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum

The computational neurobiology of learning and reward.

The mechanism of saccade motor pattern generation investigated by a large-scale spiking neuron model of the superior colliculus

The role of serotonin in the regulation of patience and impulsivity

The status of MRI databases across the world focused on psychiatric and neurological disorders

Three-dimensional distribution of Fos-positive neurons in the supramammillary nucleus of the rat exposed to novel environment.

Understanding neural coding through the model-based analysis of decision making

Validation of decision-making models and analysis of decision variables in the rat basal ganglia.

What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?

fMRI investigation of cortical and subcortical networks in the learning of abstract and effector-specific representations of motor sequences.