{\rtf1\mac\ansicpg10000\uc1 \deff0\deflang1033\deflangfe1033{\upr{\fonttbl{\f0\fnil\fcharset256\fprq2{\*\panose 02020603050405020304}Times New Roman{\*\falt Times};}{\f4\fnil\fcharset256\fprq2{\*\panose 02000500000000000000}Times;} {\f5\fnil\fcharset256\fprq2{\*\panose 02000500000000000000}Helvetica;}}{\*\ud{\fonttbl{\f0\fnil\fcharset256\fprq2{\*\panose 02020603050405020304}Times New Roman{\*\falt Times};}{\f4\fnil\fcharset256\fprq2{\*\panose 02000500000000000000}Times;} {\f5\fnil\fcharset256\fprq2{\*\panose 02000500000000000000}Helvetica;}}}}{\colortbl;\red0\green0\blue0;\red0\green0\blue255;\red0\green255\blue255;\red0\green255\blue0;\red255\green0\blue255;\red255\green0\blue0;\red255\green255\blue0; \red255\green255\blue255;\red0\green0\blue128;\red0\green128\blue128;\red0\green128\blue0;\red128\green0\blue128;\red128\green0\blue0;\red128\green128\blue0;\red128\green128\blue128;\red192\green192\blue192;}{\stylesheet{\widctlpar\adjustright \loch\af4\hich\af4\dbch\f4\cgrid \snext0 Normal;}{\*\cs10 \additive Default Paragraph Font;}}{\info{\author Marc Talusan}{\operator Marc Talusan}{\creatim\yr2003\mo9\dy23\hr22\min27}{\revtim\yr2003\mo9\dy23\hr22\min33}{\version1}{\edmins6}{\nofpages2} {\nofwords315}{\nofchars1800}{\*\company MIT}{\nofcharsws2210}{\vern115}}\widowctrl\ftnbj\aenddoc\formshade\viewkind1\viewscale125\pgbrdrhead\pgbrdrfoot \fet0\sectd \linex0\sectdefaultcl {\*\pnseclvl1\pnucrm\pnstart1\pnindent720\pnhang{\pntxta .}} {\*\pnseclvl2\pnucltr\pnstart1\pnindent720\pnhang{\pntxta .}}{\*\pnseclvl3\pndec\pnstart1\pnindent720\pnhang{\pntxta .}}{\*\pnseclvl4\pnlcltr\pnstart1\pnindent720\pnhang{\pntxta )}}{\*\pnseclvl5\pndec\pnstart1\pnindent720\pnhang{\pntxtb (}{\pntxta )}} {\*\pnseclvl6\pnlcltr\pnstart1\pnindent720\pnhang{\pntxtb (}{\pntxta )}}{\*\pnseclvl7\pnlcrm\pnstart1\pnindent720\pnhang{\pntxtb (}{\pntxta )}}{\*\pnseclvl8\pnlcltr\pnstart1\pnindent720\pnhang{\pntxtb (}{\pntxta )}}{\*\pnseclvl9 \pnlcrm\pnstart1\pnindent720\pnhang{\pntxtb (}{\pntxta )}}\pard\plain \widctlpar\tx560\tx1120\tx1680\tx2240\tx2800\tx3360\tx3920\tx4480\tx5040\tx5600\tx6160\tx6720\adjustright \loch\af4\hich\af4\dbch\f4\cgrid {\tab \tab \tab \tab \tab \tab \tab \tab \tab \tab \tab }{\hich\af4\dbch\af4\loch\f4 Notes by Philip Meier \par \tab \tab \tab \tab \tab \tab \tab \tab \tab \tab \tab \hich\af4\dbch\af4\loch\f4 pmmeier@mit.edu \par \tab \tab \tab \tab \tab \tab \tab \tab \tab \tab \tab \hich\af4\dbch\af4\loch\f4 9-23-03 \par \par \tab \tab \tab \tab \tab }{\scaps\fs28 \hich\af4\dbch\af4\loch\f4 Neural \hich\af4\dbch\af4\loch\f4 R\hich\af4\dbch\af4\loch\f4 epresentations}{\scaps\fs28 \par }{ \par What is a representation? \par \par -Some internal state related to the external world \par -numbers can describe the internal and external world \par -we can describe representations as some relation \par between an internal set of numbers that capture information about an external set of numbers \par \par Question: }{what sorts of questions would}{ you need to decide before working with a format of an image. \par \par Continuous vs. sampled \par Analog vs. digital world \par Analog vs digital computation (ie. spikes vs. voltage integration) \par \par If the set of all possible signals is}{ infinite in at least one dimens}{ion, then the total number of possible images is no longer countable, and so making probablis tic statements about the ratios becomes difficult. i.e. what is the ratio (signals that are natural images: total number of possible signals) \par \par Of course, it does not matter if the world is analog or not, so long as all sampling is discrete, and thus fi}{nite. }{ \par \par PCM }{\tab \tab \tab \tab }{Pulse Code Modulation}{ (251,252,250,251)}{ \par DCPM }{\tab \tab \tab \tab }{Differential Pulse Code Modulation}{ (+1,-2,+1)}{ \par Sum/Diff Transform \par Fourier }{\tab \tab \tab \tab }{Sum of a bunch of sinusoidal gratings \par PCA }{\tab \tab \tab \tab }{Sum of a bunch of the best N basis functions \par }{\tab \tab \tab \tab \tab (determimed with training set}{s and minimizing error) \par Subbands, pyramids,}{ \par and}{ waves \par \par }{\i "The only aspect of vision science that really works is color..."}{\i -T. Adelson}{\i \par }{ \par PCA with three components does a good job in capturing the spectral distribution of a signal. \par \par Physiology and }{ideal component seem to align; }{use the dot product of the activation values of cones \par \par \par }{\i "The rest of vision science is harder." \par }{ \par }{It is hard to detect an impul}{se edge in a signal. \par For example, consider a sharp bounda}{r}{y of a dye in a flower. This is a step edge. You cannot detect a step edge without an infinite number of components in PCA. Of course, with enough components you can get a very good approximation. \par \par Thus, vision science may be good at describing sampling methods of a spectral distribution at a point, but it has a harder time explaining how we see sharp color boundaries, when spectral distributions vary over space. \par }\pard \widctlpar\adjustright { \par }}