BCS II Course
Syllabus
9.012
Spring 2001
Meeting Times: 10 -
12 am MWF NE20-461
Course Organizers:
Nancy Kanwisher and Earl Miller
TA: Camillo
Padoa-Schioppa camillo@mit.edu
Part I: Foundations of Cognitive Science - Steven Pinker
Feb 7 W: Organizational Meeting
Mental representation and computation
Feb 9 F: Mental representation and computation
Evolutionary Psychology and Behavioral Genetics
Feb 12 M: Evolutionary Psychology and Behavioral Genetics
Feb 14 W: Recitation
Readings:
0 Pinker, S. 1997. How the Mind Works, Chapters 1-3, and part of Chapter 4., pp. 284-298.
Papers to be
presented/discussed:
0 Daly, M. & Wilson, M. 1999. The truth about Cinderella. Yale University Press.
0 Klein, et al. 2000. Transient Activity in the Humam Cacalrine Cortex During Visual-Mental Imagery: An event-Related fMRI Study. J Cog Neuroscience, 12, 15-23.
0 Bouchard, T.J.Jr. 1994. Genes, environment, personality. Science, 264, 1700-1701.
Part II: Math
Background & Neural Networks - Sebastian Seung
**Note: Class will meet in 14-0637, basement of bldg. 14**
Feb 16 F: Linear algebra with MATLAB
[Feb 19 M: President's Day - Holiday]
Feb 21 W: Simple perceptrons
Feb 23 F: Multilayer perceptrons
Feb 26 M: Attractor neural networks
Readings:
0 J. Hertz, A. Krogh, and R. G. Palmer. Introduction to the Theory of Neural Computation, Addison-Wesley, 1991. sections 2.1-2.2, 5.1-5.3, 6.1, 6.3.
0 J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci.USA. 79:2554-8 (1982).
Optional recommended readings:
0 David A. Robinson. Implications of neural networks for how we think about brain function. Behav. Brain Sci. 15, 644-55 (1992).
Study questions:
X What is the difference between the way in which feedforward and recurrent network models store memories?
X What is the evidence for multistability in the brain, and what does this phenomenon have to do with memory?
Part III: Computational Vision - Pawan Sinha
Feb 28 W: Computational Vision I
Mar 2 F: Computational Vision II
Mar 5 M Computational Vision III
Mar 7 W Recitation
Readings:
Chapter 10 Motion and Depth in Foundations of Vision, by Brian Wandell.
Published by Sinauer Associates, MA, 1995.
Chapter 31 Interactions between
motion, depth, color, and form: the utilitarian theory of perception. VISION: Coding and Efficiency by Colin
Blakemore (Ed.). Published by Cambridge University Press, 1990.
Chapters 1 and 2, Object recognition in High-level Vision
by Shimon Ullman. Published by MIT Press, 1996.
Biederman, I. (1987) Recognition
by Components: A theory of human image understanding. Psychological Review, 94, 115-147.
Papers for discussion:
Sinha, P. and Poggio, T. (2000)
High-level learning of early perceptual tasks. Perceptual Learning, Ed. Manfred Fahle, MIT Press, Cambridge, MA.
(In press)
Williams, SM, McCoy AN, Purves D
(1998) An empirical explanation of brightness. Proc Natl Acad Sci 95: 13301-13306.
Lotto, RB, Purves D (1999) The
effects of color on brightness. Nature
Neurosci 2: 1010-1014.
Purves D, Lotto R B, Williams SM,
Nundy S, and Yang, Z (2000) Why we see things the way we do: Evidence for a
wholly empirical strategy of vision. Philos.
Trans. Roy. Soc (In press).
Study Questions:
1. Can there be a unified theory of visual perception, or are we doomed to live with an ever-growing compendium of largely unrelated case studies? What characteristics would a theory need to have to be considered a unified theory?
2. Is visual perception continuous
with visual cognition? Is it useful/meaningful to parse vision into low, mid
and high-level processes?
3. Contrary to popular belief, relatively few of the real-world machine vision systems use algorithms inspired by studies of human vision. What do you think this says about the brain's computational strategies for solving vision problems?
Part IV: Cognitive
Neuroscience of Object Recognition - Nancy Kanwisher
Mar 9 F Cognitive Neuroscience of Object Recognition I
Mar 12 M : Cognitive Neuroscience of Object Recognition II
Mar 14 W: Cognitive Neuroscience of Object Recognition III
Mar 16 F Recitation
Readings:
Kanwisher, N.; Downing, P.; Epstein, R.; & Kourtzi, Z. (2001). Functional Neuroimaging of Human Visual Recognition. Kingstone & Cabeza (Eds.), The Handbook on Functional Neuroimaging. MIT press.
Gauthier, I. (2000). What constrains the organization of the ventral temporal cortex? Trends in Cognitive Sciences 4: (1) 1-2.
Farah, M. (1995). Dissociable systems for recognition: A
cognitive neuropsychology approach. In Kosslyn & Osherson (Eds.), Visual
Cognition.
Tanaka, K. (1996). Inferotemporal cortex and object vision. Annual Review of Neuroscience 19,
109-39.
Moscovitch, M., Winocur, G., Behrmann, M. (1997). What is special about face recognition? Nineteen experiments on a person with visual object agnosia and dyslexia but normal face recognition. Journal of Cognitive Neuroscience 9, 555-604.
Logothetis, N.K.; Pauls, J. (1995). Psychophysical and physiological evidence for viewer-centered object representations in the primate. Cereb Cortex 5, 270-88.
Ullman, S. & Soloviev, S. (1999). Computation of pattern invariance in brain-like structures. Neural Networks 12, 1021-1036.
Grill-Spector, K; Kushnir, T; Edelman, S; Avidan, G; Itzchak, Y.; and Malach, R. (1999). Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex. Neuron, 24 (1) 187-203.
Study
Questions:
1. (How) does the brain carve up the job of object recognition? That is, what are the functional components of the object recognition system? How functionally independent are they?
2. What is the nature of the representations that are extracted en route to object recognition?
3. When and how can brain-based data constrain cognitive/computational theories of visual recognition?
Mar 19 M: MIDTERM EXAM
Mar 21 W: Visual working
memory
Mar 23 F: Conceptual short-term
memory (CSTM)
[March 26-30: Spring Vacation]
Apr 2 M: Stage theory, PRP, AB
Apr 4 W: Recitation
Readings:
Luck, S. J., & Vogel, E.K.
(1997). The capacity of visual working memory for features and conjunctions. Nature, 390, 279-281.
Simons, D. J., & Levin, D. T.
(1997). Change blindness. Trends in
Cognitive Sciences, 1, 261-267.
Potter, M. C. (1999).
Understanding sentences and scenes: The role of Conceptual Short Term Memory.
In V. Coltheart (Ed.), Fleeting Memories
(pp. 13-46). Cambridge, MA: MIT Press.
Pashler, H., & Johnston, J. C.
(1998). Attentional limitations in dual-task performance. In H. Pashler (Ed.), Attention (pp. 155-189). Hove, UK:
Psychology Press.
Papers to be presented/discussed:
Sternberg, S. (1969). The
discovery of processing stages: Extensions of Donders' method. In W. G. Koster
(Ed.) Attention and Performance II
(pp. 276-315). Amsterdam: Elsevier.
Treisman, A. (1993). The
perception of features and objects. In A. Baddeley & L. Weiskrantz (Eds.), Attention: Selection, awareness, and control
(pp. 5-35). Oxford: Clarendon Press.
Potter, M.C. (1975). Meaning in
visual search. Science, 187, 965-966.
Kanwisher, N, & Wojciulik, E.
(2000). Visual attention: Insights from brain imaging. Nature Reviews: Neuroscience, 1, 91-100.
Study questions:
- What are the advantages and disadvantages to the organism of capacity limits in processing (e.g., in selective attention)?
- Are there clear stages in
processing?
- What different kinds of information are involved in processing, and how are they integrated (if they are)? (Consider not only features in perception, but also semantic information.)
Part VI: Working Memory & Attention - Earl Miller
Apr 6 F: Working Memory and Attention I
Apr 9 M: Working Memory and Attention II
Apr 11 W: Working Memory and Attention III
Apr 13 F: Recitation
Readings:
7 Miller, E.K. and Cohen, J.D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, in press.
0 Desimone R, Duncan J (1995). Neural mechanisms of selective visual attention. Annual Review of Neuroscience 18, 193-222.
Papers to be
presented/discussed:
0 Rainer G, Rao SC, Miller EK (1999). Prospective coding for objects in the primate prefrontal cortex. Journal of Neuroscience 19, 5493-5505.
0 Tomita H, Ohbayashi M, Nakahara K, Hasegawa I, Miyashita Y (1999). Top-down signal from prefrontal cortex in executive control of memory retrieval. Nature 401 (6754), 699-703.
[Apr 16 M: Patriot's
Day >
0
Gabrieli JD (1998). Cognitive
neuroscience of human memory. Annual Review of Psychology, 49, 87-115.
0
Rugg MD, Wilding EL
(2000). Retrieval processing and
episodic memory. Trends in Cognitive Sciences, 4,
108-115.
0
Wiggs CL, Martin A (1998)
Properties and mechanisms of perceptual priming. Current Opinion in Neurobiology, 8, 227-233.
Papers to be presented/discussed:
0
Eldridge LL, Knowlton BJ,
Furmanski CS, Bookheimer SY, Engel SA (2000). Remembering episodes: a selective
role for the hippocampus during retrieval. Nature
Neuroscience, 3, 1149-1152.
0
Kirchhoff BA, Wagner AD,
Maril A, Stern CE (2000). Prefrontal-temporal circuitry for episodic encoding
and subsequent memory. Journal of Neuroscience, 20, 6173-6180.
0
Wagner AD, Maril A, Schacter
DL (2000). Interactions between forms
of memory: When priming hinders new learning. Journal of Cognitive Neuroscience, 12:S2, 52-60
Study questions:
X Characterize the multi-component model of working memory forwarded by Baddeley & Hitch. Specify the lines of evidence that support a distinction between phonological rehearsal and phonological storage processes.
X Describe the distinction between "blocking" and "suppression" mechanisms of forgetting, illustrating each with relevant data.
X Characterize the distinction between declarative and non-declarative forms of long-term memory, providing behavioral evidence from studies of healthy adults and neuroanatomical evidence from studies of patient populations for this distinction.
Part VIII: Intro to
Language & Psycholinguistics - Ted Gibson
Apr 27 F Lecture 1: Speech and speech processing
reading: chapters 6 and 7 of Tartter (1998)
Apr 30 M Lecture 2: The structure of sentences
reading: chapter 4 of Tartter (1998)
May 2 W Lecture 3: Sentence and discourse processing
reading: Gibson & Pearlmutter (1998)
May 4 F Recitation
readings:
A) Connectionist models of language, Elman (1991)
B) Linguistic complexity, Gibson (in press)
Tartter, V.C. (1998). Language and its Normal Processing. Thousand Oaks, CA: Sage.
Elman, J.L. (1991). Distributed representations, simple recurrent networks and grammatical structure. Machine Learning, 7, 195-225.
Gibson, E. (in press). The dependency locality theory: A distance-based theory of linguistic complexity. In Miyashita, Y., Marantz, A., & O'Neil, W. (Eds.), Image, Language, Brain. MIT Press, Cambridge, MA.
Gibson, E. & Pearlmutter, N. (1998). Constraints on sentence comprehension. Trends in Cognitive Sciences, 2, 262-268.
Part IX: Language
Acquisition - Ken Wexler
May 7 M: The Computational System
of Language, Universal Grammar, Parameters and the Problem of Learnability
Readings:
1) Cowper, Elizabeth A. 1992. A Concise Introduction to Syntactic Theory
The Government-Binding Approach.
University of Chicago Press: Chicago, London. pp. 1-24, pp. 48-56, pp.
66-70, pp. 71- 88, pp. 89-94.
2) Wexler, Kenneth and Culicover,
Peter W. 1980. Formal Principles of
Language Acquisition. MIT Press: Cambridge, MA. pp. 60-84
Additional Background Reading:
1) Gold, E.M. 1967. "Language identification in the limit." Information and Control 10: 447.
2) Newport, Elissa L; Gleitman,
Henry, and Gleitman, Lila A. 1979. "Mother, I'd rather do it myself: some
effects and non-effects of maternal speech style," in Snow and Ferguson
(eds.), Talking to Children: Language
input and acquisition. Cambridge
University Press: Cambridge, UK, 109-149.
May 9 W: The Development of
Finiteness, Word Order, Agreement, Case and Children's Knowledge of Language,
Universal and Learned: How to Understand the Development of Different Languages
Readings:
Wexler, Kenneth. 1994.
"Optional infinitives, head movement and the economy of derivations,"
in Lightfoot and Hornstein (eds.), Verb
Movement, Cambridge University Press, 305-350.
Additional Background Reading, for those interested in more linguistic detail:
Sch|tze, Carson T. and Kenneth
Wexler. 1996. "Subject Case Licensing and English Root Infinites." A.
Stringfellow et al. (eds.), BUCLD 20
Proceedings, 670-681. Somerville, MA: Cascadilla Press.
May 11 F: Variability in
Development, Impaired Language, Evidence for Genetic Variation
Readings:
1) Rice, Mabel L. and Wexler,
Kenneth. 1996. "Toward Tense as a Clinical Marker of
Specific Language Impairment in English-Speaking Children." Journal of Speech and Hearing Research,
vol. 38, 1239-1257.
2) Rice, Mabel L., Wexler, Kenneth and Scott Hershberger. 1998. "Tense Over Time: The Longitudinal Course of Tense Acquisition in Children with Specific Language Impairment." Journal of Speech, Language and Hearing Research 41, 1412-1431.
May 14 M: Recitation: How to
Distinguish Processing from Competence Models of Language Development
Readings to Present:
Hyams, Nina and Wexler, Ken. 1993.
"On the Grammatical Basis of Null Subjects in Child
Language." Linguistic Inquiry, vol. 24 (3), 421-459.
Bloom, Paul. 1990. "Subjectless Sentences in Child
Language." Linguistic Inquiry, vol. 21 (4), 491-504.