Interval Timing, Dopamine, and Motivation
In: Timing & Time PerceptionSearch for other papers by Fuat Balcı in
Current site
Google Scholar
The dopamine clock hypothesis suggests that the dopamine level determines the speed of the hypothetical internal clock. However, dopaminergic function has also been implicated for motivation and thus the effect of dopaminergic manipulations on timing behavior might also be independently mediated by altered motivational state. Studies that investigated the effect of motivational manipulations on peak responding are reviewed in this paper. The majority of these studies show that a higher reward magnitude leads to a leftward shift, whereas reward devaluation leads to a rightward shift in the initiation of timed anticipatory behavior, typically in the absence of an effect on the timing of response termination. Similar behavioral effects are also present in a number of studies that investigated the effect of dopamine agonists and dopamine-related genetic factors on peak responding. These results can be readily accounted for by independent modulation of decision-thresholds for the initiation and termination of timed responding.
Purchase
Buy instant access (PDF download and unlimited online access):
Institutional Login
Log in with Open Athens, Shibboleth, or your institutional credentials
Personal login
Log in with your brill.com account
-
Abner R. T., Edwards T., Douglas A., Brunner D. (2001). Pharmacology of temporal cognition in two mouse strains. Int. J. Comp. Psychol., 14, 189–210.
-
Adams C. D. (1981). Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q. J. Exp. Psychol. B, 34, 77–98.
-
Badiani A., Stewart J. (1999). Long-lasting sensitization to the accelerating effects of amphetamine on the speed of an internal clock. Behav. Brain Res., 100, 217–223.
-
Balcı F., Papachristos E. B., Gallistel C. R., Brunner D., Gibson J., Shumyatsky G. P. (2008). Interval-timing in the genetically modified mouse: A simple paradigm. Genes, Brain Behav., 7, 373–384.
-
Balcı F., Freestone D., Gallistel C. R. (2009a). Risk assessment in man and mouse. Proc. Natl Acad. Sci. USA, 106, 2459–2463.
-
Balcı F., Gallistel C. R., Allen B. D., Frank K., Gibson J., Brunner D. (2009b). Acquisition of peak responding: What is learned? Behav. Proc., 80, 67–75.
-
Balcı F., Ludvig E. A., Abner R., Zhuang X., Poon P., Brunner D. (2010a). Motivational effects on interval timing in dopamine transporter (DAT) knock-down mice. Brain Res., 1325, 89–99.
-
Balcı F., Ludvig E. A., Brunner D. (2010b). Within-session modulation of timed anticipatory responding: When to start responding. Behav. Proc., 85, 204–206.
-
Balcı F., Wiener M., Cavdaroglu B., Coslett B. H. (2013). Epistasis effects of dopamine genes on interval timing and reward magnitude in humans. Neuropsychologia, 51, 293–308.
-
Balleine B. W., Dickinson A. (1998). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407–419.
-
Berridge K. C. (2007). The debate over dopamine’s role in reward: The case for incentive salience. Psychopharmacology, 191, 391–431.
-
Berridge K. C., Robinson T. E. (1998). What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience? Brain Res. Rev., 28, 309–369.
-
Bizot J. C. (1997). Effects of psychoactive drugs on temporal discrimination in rats. Behav. Pharmacol., 8, 293–308.
-
Buhusi C. V., Meck W. H. (2005). What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci., 6, 755–765.
-
Buhusi C. V., Aziz D., Winslow D., Carter R. E., Swearingen J. E., Buhusi M. C. (2009). Interval timing accuracy and scalar timing in C57BL/6 mice. Behav. Neurosci., 123, 1102–1113.
-
Cagniard B., Balsam P. D., Brunner D., Zhuang X. (2006). Mice with chronically elevated dopamine exhibit enhanced motivation, but not learning, for a food reward. Neuropsychopharmacology, 31, 1362–1370.
-
Catania A. C. (1970). Reinforcement schedules and psychophysical judgements: A study of some temporal properties of behavior. In Schoenfeld W. N. (Ed.), The theory of reinforcement schedules (pp. 1–42). New York, NY, USA: Appleton-Century-Croft.
-
Çevik M. O. (2003). Effects of methamphetamine on duration discrimination. Behav. Neurosci., 117, 774–784.
-
Cheng K., Westwood R. (1993). Analysis of single trials in pigeons timing performance. J. Exp. Psychol. Anim. Behav. Process., 19, 56–67.
-
Cheng R. K., Ali Y. M., Meck W. H. (2007a). Ketamine ‘unlocks’ the reduced clock-speed effect of cocaine following extended training: Evidence for dopamine–glutamate interactions in timing and time perception. Neurobiol. Learn. Mem., 88, 149–159.
-
Cheng R. K., Hakak O. L., Meck W. H. (2007b). Habit formation and the loss of control of an internal clock: Inverse relationship between the level of baseline training and the clock-speed enhancing effects of methamphetamine. Psychopharmacology (Berl.), 193, 351–362.
-
Chiang T.-J., Al-Ruwaitea A. S. A., Mobini S., Ho M.-Y., Bradshaw C. M., Szabadi E. (2000). The effect of D-amphetamine on performance on two operant timing schedules. Psychopharmacology, 150, 170–184.
-
Church R. M., Miller K. D., Meck W. H., Gibbon J. (1991). Symmetrical and asymmetrical sources of variance in temporal generalization. Anim. Learn. Behav., 19, 207–214.
-
Church R. M., Meck W. H., Gibbon J. (1994). Application of scalar timing theory to individual trials. J. Exp. Psychol. Anim. Behav. Process., 20, 135–155.
-
Church R. M., Lacourse D. M., Crystal J. D. (1998). Temporal search as a function of the variability of interfood intervals. J. Exp. Psychol. Anim. Behav. Process., 24, 291–315.
-
Çoşkun F., Sayalı C., Gürbüz E., Balcı F. (in press). Optimal temporal discrimination. Q. J. Exp. Psychol. doi:10.1080/17470218.2014.944921.
-
Coull J. T., Cheng R. K., Meck W. H. (2011). Neuroanatomical and neurochemical substrates of timing. Neuropsychopharmacology, 36, 3–25.
-
Doughty A. H., Richards J. B. (2002). Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons. J. Exp. Anal. Behav., 78, 17–30.
-
Drew M. R., Fairhurst S., Malapani C., Horvitz J. C., Balsam P. D. (2003). Effects of dopamine antagonists on the timing of two intervals. Pharmacol. Biochem. Behav., 75, 9–15.
-
Fox A. E., Kyonka E. G. (2014). Choice and timing in pigeons under differing levels of food deprivation. Behav. Proc., 106, 82–90.
-
Gallistel C. R., Balsam P. D., Fairhurst S. (2004a). The learning curve: Implications of a quantitative analysis. Proc. Natl Acad. Sci. USA, 101, 13124–13131.
-
Gallistel C. R., King A., McDonald R. (2004b). Sources of variability and systematic error in mouse timing behavior. J. Exp. Psychol. Anim. Behav. Process., 30, 3–16.
-
Galtress T., Kirkpatrick K. (2009). Reward magnitude effects on temporal discrimination. Learn. Motiv., 41, 108–124.
-
Galtress T., Kirkpatrick K. (2010). The role of the nucleus accumbens core in impulsive choice, timing, and reward processing. Behav. Neurosci., 124, 26–43.
-
Galtress T., Garcia A., Kirkpatrick K. (2012a). Individual differences in impulsive choice and timing in rats. J. Exp. Anal. Behav., 98, 65–87.
-
Galtress T., Marshall A. T., Kirkpatrick K. (2012b). Motivation and timing: Clues for modeling the reward system. Behav. Proc., 90, 142–153.
-
Gershman S. J., Moustafa A. A., Ludvig E. A. (2014). Time representation in reinforcement learning models of the basal ganglia. Front. Comput. Neurosci., 7, 194. doi:10.3389/fncom.2013.00194.
-
Gibbon J. (1977). Scalar expectancy theory and Weber’s Law in animal timing. Psychol. Rev., 84, 279–325.
-
Gibbon J., Church R. M., Meck W. H. (1984). Scalar timing in memory. In Gibbon J., Allan L. (Eds.), Timing and time perception (pp. 52–77). New York, NY, USA: New York Academy of Sciences.
-
Gibbon J., Church R. M. (1990). Representation of time. Cognition, 37, 23–54.
-
Gibbon J., Church R. M. (1992). Comparison of variance and covariance patterns in parallel and serial theories of timing. J. Exp. Anal. Behav., 57, 393–406.
-
Gooch C., Wiener M., Portugal G., Matell M. (2007). Evidence for separate neural mechanisms for the timing of discrete and sustained responses. Brain Res., 1156, 139–151.
-
Grace R. C., Nevin J. A. (2000). Response strength and temporal control in fixed interval schedules. Anim. Learn. Behav., 28, 313–331.
-
Gramling S. E., Fowler S. C. (1986). Some effects of pimozide and of shifts in sucrose concentration on lick rate, duration, and interlick interval. Pharmacol. Biochem. Behav., 25, 219–222.
-
Hatten J. L., Shull R. L. (1983). Pausing on fixed-interval schedules: Effects of the prior feeder duration. Behav. Anal. Lett., 3, 101–111.
-
Jozefowiez J., Staddon J. E., Cerutti D. T. (2010). The behavioral economics of choice and interval timing. Psychol. Rev., 116, 519–539.
-
Kacelnik A., Brunner D. (2002). Timing and foraging: Gibbon’s scalar expectancy theory and optimal patch exploitation. Learn. Motiv., 33, 177–195.
-
Killeen P., Fetterman J. G. (1988). A behavioral theory of timing. Psychol. Rev., 95, 274–295.
-
Lake J. I., Meck W. H. (2013). Differential effects of amphetamine and haloperidol on temporal reproduction: Dopaminergic regulation of attention and clock speed. Neuropsychologia, 51, 284–292.
-
Ludvig E., Conover K., Shizgal P. (2007). The effects of reinforcer magnitude on timing in rats. J. Exp. Anal. Behav., 87, 201–218.
-
Ludvig E. A., Balci F., Spetch M. L. (2011). Reward magnitude and timing in pigeons. Behav. Proc., 86, 359–363.
-
MacDonald C. J., Cheng R. K., Meck W. H. (2012). Acquisition of ‘Start’ and ‘Stop’ response thresholds in peak-interval timing is differentially sensitive to protein synthesis inhibition in the dorsal and ventral striatum. Front. Integr. Neurosci., 6, 10. doi:10.3389/fnint.2012.00010.
-
MacEwen D., Killeen P. (1991). The effects of rate and amount of reinforcement on the speed of the pacemaker in pigeons’ timing behavior. Anim. Learn. Behav., 19, 164–170.
-
Machado A., Keen R. (2003). Temporal discrimination in a long operant chamber. Behav. Proc., 62, 157–182.
-
Maggi D., Garbugino L., Heise I., Nieus T., Balci F., Wells S., Tocchini-Valentini G. P., Mandillo S., Nolan P. M., Tucci V. (2014). A cross-laboratory investigation of timing endophenotypes in mouse behavior. Timing Time Percept., 2, 35–40.
-
Malapani C., Deweer B., Gibbon J. (2002). Separating storage from retrieval dysfunction of temporal memory in Parkinson’s disease. J. Cogn. Neurosci., 14, 311–322.
-
Malapani C., Fairhurst S. (2002). Scalar timing in animals and humans. Learn. Motiv., 33, 156–176.
-
Malapani C., Rakitin B. C. (2003). Interval timing in the dopamine-depleted basal ganglia: From empirical data to timing theory. In Meck W. H. (Ed.), Functional and neural mechanisms of interval timing (pp. 485–514). Boca Raton, FL, USA: CRC Press.
-
Maricq A. V., Church R. M. (1983). The differential effects of haloperidol and methamphetamine on time estimation in the rat. Psychopharmacology (Berl.), 79, 10–15.
-
Maricq A. V., Roberts S., Church R. M. (1981). Methamphetamine and time estimation. J. Exp. Psychol. Anim. Behav. Process., 7, 18–30.
-
Mattell M. S., King R. K., Meck W. H. (2004). Differential modulation of clock speed by the administration of intermittent versus continuous cocaine. Behav. Neurosci., 118(1), 150–156.
-
Matell M. S., Aldridge J. W., Berridge K. C. (2006a). Dopamine D1 activation shortens the duration of phases in stereotyped grooming sequences. Behav. Proc., 71, 241–249.
-
Matell M. S., Bateman M., Meck W. H. (2006b). Single-trials analyses demonstrate that increases in clock speed contribute to the methamphetamine-induced horizontal shifts in peak-interval timing functions. Psychopharmacology, 188, 201–212.
-
McClure E. A., Saulsgiver K. A., Wynne C. D. L. (2005). Effects of D-amphetamine on temporal discrimination in pigeons. Behav. Pharmacol., 16, 193–208.
-
McClure E. A., Saulsgiver K. A., Wynne C. D. L. (2009). Manipulating pre-feed, density of reinforcement, and extinction produces disruption in the location variation of a temporal discrimination task in pigeons. Behav. Proc., 82, 85–89.
-
Meck W. H. (1983). Selective adjustment of the speed of internal clock and memory processes. J. Exp. Psychol. Anim. Behav. Process., 9, 171–201.
-
Meck W. H. (1986). Affinity for the dopamine D2 receptor predicts neuroleptic potency in decreasing the speed of an internal clock. Pharmacol. Biochem. Behav., 25, 1185–1189.
-
Meck W. H. (1988). Internal clock and reward pathways share physiologically similar information-processing stages. In Commons M. L., Church R. M., Stellar J. R., Wagner A. R. (Eds.), Quantitative analyses of behavior: Biological determinants of reinforcement (pp. 121–138). Hillsdale, NJ, USA: Erlbaum.
-
Meck W. H. (1996). Neuropharmacology of timing and time perception. Cogn. Brain Res., 3, 227–242.
-
Meck W. H. (2006). Neuroanatomical localization of an internal clock: A functional link between mesolimbic, nigrostriatal, and mesocortical dopaminergic systems. Brain Res., 1109, 93–107.
-
Meck W. H., Williams C. L. (1997). Characterization of the facilitative effects of perinatal choline supplementation on timing and temporal memory. Neuroreport, 8, 2831–2835.
-
Odum A. L., Lieving L. M., Schaal D. W. (2002). Effects of D-amphetamine in a temporal discrimination procedure: Selective changes in timing or rate dependency? J. Exp. Anal. Behav., 78, 195–214.
-
Odum A. L., Ward R. D. (2007). Characterizing the effects of D-amphetamine on temporal discrimination. Behav. Proc., 75, 156–166.
-
Papachristos E. B., Gallistel C. R. (2006). Autoshaped head poking in the mouse: A quantitative analysis of the learning curve. J. Exp. Anal. Behav., 85, 293–308.
-
Paterson N. E., Balci F., Campbell U., Olivier B., Hanania T. (2011). The triple reuptake inhibitor DOV216,303 exhibits limited antidepressant-like properties in the differential reinforcement of low-rate 72-sec responding assay, likely due to dopamine reuptake inhibition. J. Psychopharmacol., 25, 1357–1364.
-
Peciña S., Cagniard B., Berridge K. C., Aldridge J. W., Zhuang X. (2003). Hyperdopaminergic mutant mice have higher ‘wanting’ but not ‘liking’ for sweet rewards. J. Neurosci., 23, 9395–9402.
-
Penney T. B., Gibbon J., Meck W. H. (2008). Categorical scaling of duration bisection in pigeons (Columba livia), mice (Mus musculus), and humans (Homo sapiens). Psychol. Sci., 19, 1102–1108.
-
Plowright C. M. S., Church D., Behnke P., Silverman A. (2000). Time estimation by pigeons on a fixed interval: The effect of pre-feeding. Behav. Proc., 52, 43–48.
-
Rakitin B. C., Gibbon J., Penney T. B., Malapani C., Hinton S. C., Meck W. H. (1998). Scalar expectancy theory and peak-interval timing in humans. J. Exp. Anal. Behav., 24, 15–33.
-
Rammsayer T. (1989). Dopaminergic and serotoninergic influence on duration discrimination and vigilance. Pharmacopsychiatry, 22(Suppl. 1), 39–43.
-
Rammsayer T. H. (1993). On dopaminergic modulation of temporal information processing. Biol. Psychol., 36, 209–222.
-
Rammsayer T. H. (1997). Are there dissociable roles of the mesostriatal and mesolimbocortical dopamine systems on temporal information processing in humans? Neuropsychobiology, 35, 36–45.
-
Rammsayer T. H., Vogel W. H. (1992). Pharmacologic properties of the internal clock underlying time perception in humans. Neuropsychobiology, 26, 71–80.
-
Reuter M., Schmitz A., Corr P., Hennig J. (2006). Molecular genetics support Gray’s personality theory: The interaction of COMT and DRD2 polymorphisms predicts the behavioural approach system. Int. J. Neuropsychopharmacol., 9, 155–166.
-
Roberts S. (1981). Isolation of an internal clock. J. Exp. Psychol. Anim. Behav. Process., 7, 242–268.
-
Santi A., Weise L., Kuiper D. (1995). Amphetamine and memory for event duration in rats and pigeons: Disruption of attention to temporal samples rather than changes in the speed of the internal clock. Psychobiology, 23, 224–232.
-
Saulsgiver K. A., McClure E. A., Wynne C. D. (2006). Effects of D-amphetamine on the behavior of pigeons exposed to the peak procedure. Behav. Proc., 71, 268–285.
-
Schneider B. A. (1969). A two-state analysis of fixed-interval responding in the pigeon. J. Exp. Anal. Behav., 12, 677–687.
-
Simen P., Balcı F., deSouza L., Holmes P., Cohen J. D. (2011). A model of interval timing by neural integration. J. Neurosci., 31, 9238–9253.
-
Simen P., Rivest F., Ludvig E. A., Balci F., Killeen P. (2013). Timescale invariance in the pacemaker-accumulator family of timing models. Timing Time Percept., 30, 159–188.
-
Skinner B. F. (1976). Farewell, my lovely! J. Exp. Anal. Behav., 25, 218.
-
Taylor K. M., Horvitz J. C., Balsam P. D. (2007). Amphetamine affects the start of responding in the peak interval timing task. Behav. Proc., 74, 168–175.
-
Wallace D. G., Wallace P. S., Field E., Whishaw I. Q. (2006). Pharmacological manipulations of food protection behavior in rats: Evidence for dopaminergic contributions to time perception during a natural behavior. Brain Res., 1112, 213–221.
-
Ward R. D., Odum A. L. (2006). Effects of prefeeding, intercomponent-interval food, and extinction on temporal discrimination and pacemaker rate. Behav. Proc., 71, 297–306.
-
Ward R. D., Odum A. L. (2007). Disruption of temporal discrimination and the choose-short effect. Learn. Behav., 35, 60–70.
-
Wise R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci., 5, 483–494.
-
Yi L. (2007). Applications of timing theories to a peak procedure. Behav. Proc., 75, 188–198.
-
Yin B., Lusk N. A., Meck W. H. (in press). Interval-timing protocols and their relevancy to the study of temporal cognition and neurobehavioral genetics. In V. Tucci (Ed.), Neuro-phenome: Cutting-edge approaches and technologies in neurobehavioral genetics. Wiley-Blackwell.
-
Yin H. H., Knowlton B. J., Balleine B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci., 19, 181–189.
-
Yin H. H., Zhuang X., Balleine B. W. (2006). Instrumental learning in hyperdopaminergic mice. Neurobiol. Learn. Mem., 85, 283–288.
-
Zhuang X., Oosting R. S., Jones S. R., Gainetdinov R. R., Miller G. W., Caron M. G., Hen R. (2001). Hyperactivity and impaired response habituation in hyperdopaminergic mice. Proc. Natl Acad. Sci. USA, 98, 1982–1987.
| All Time | Past 365 days | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 5185 | 400 | 42 |
| Full Text Views | 375 | 17 | 0 |
| PDF Views & Downloads | 212 | 26 | 1 |
Interval Timing, Dopamine, and Motivation
In: Timing & Time PerceptionSearch for other papers by Fuat Balcı in
Current site
Google Scholar
PubMed
The dopamine clock hypothesis suggests that the dopamine level determines the speed of the hypothetical internal clock. However, dopaminergic function has also been implicated for motivation and thus the effect of dopaminergic manipulations on timing behavior might also be independently mediated by altered motivational state. Studies that investigated the effect of motivational manipulations on peak responding are reviewed in this paper. The majority of these studies show that a higher reward magnitude leads to a leftward shift, whereas reward devaluation leads to a rightward shift in the initiation of timed anticipatory behavior, typically in the absence of an effect on the timing of response termination. Similar behavioral effects are also present in a number of studies that investigated the effect of dopamine agonists and dopamine-related genetic factors on peak responding. These results can be readily accounted for by independent modulation of decision-thresholds for the initiation and termination of timed responding.
| All Time | Past 365 days | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 5185 | 400 | 42 |
| Full Text Views | 375 | 17 | 0 |
| PDF Views & Downloads | 212 | 26 | 1 |