The Interface Problem: Motor Representation vs Intention
For a single action, which outcomes it is directed to may be multiply determined by an intention and, seemingly independently, by a motor representation. Unless such intentions and motor representations are to pull an agent in incompatible directions, which would typically impair action execution, there are requirements concerning how the outcomes they represent must be related to each other. This is the interface problem: explain how any such requirements could be non-accidentally met.
This recording is also available on stream (no ads; search enabled). Or you can view just the slides (no audio or video). You should not watch the recording this year, it’s all happening live (advice).
If the video isn’t working you could also watch it on youtube. Or you can view just the slides (no audio or video). You should not watch the recording this year, it’s all happening live (advice).
If the slides are not working, or you prefer them full screen, please try this link.
Notes
This part of the lecture was given by Johan Heemskerk:
Recap
We have seen arguments for three claims about motor representation:
Some motor representations represent outcomes rather than, say, only joint displacements and bodily configurations (see Motor Representation).
There are actions whose directedness to an outcome is grounded in motor representation (see Motor Representations Ground the Directedness of Actions to Goals).
Motor representation differs from intention with respect to representational format (see Motor Representations Aren’t Intentions).
A consequence of these claims is that a single instrumental action may involve representations of the outcomes to which it is directed in at least two different representational formats, motor and propositional. This leads to what we will call the interface problem, which this section introduces.
The Interface Problem
Realising it is rapidly going cold, you form an intention to drink the tea. Your hand expertly secures the mug and moves it to your mouth exactly as it opens. Nothing is spilled in these exquisitely coordinated movements.
As this illustrates, there are cases in which a particular action is guided both by one or more intentions and by one or more motor representations. In at least some such cases, the outcomes specified by the intentions match the outcomes specified by the motor representations. Furthermore, this match is not always accidental.
Equally, however, intentions and motor representations do not always match. Examples of mismatch can be found in Anarchic Hand Syndrome, action slips and apraxia (see below).
How do non-accidental matches between intention and motor representation come about? (This question is The Interface Problem)
This question is a problem because two natural routes to answering the question are unavailable. Appealing to common causes of intentions and motor representations is a non-starter; and appealing to content-respecting causal processes despite a lack of inferential integration between intentions and motor representations amounts to no more than a stab in the dark.
Background: Anarchic Hand Syndrome
Marchetti & Della Sala (1998, p. 196) characterise this syndrome as involving:
‘the occurrence of complex movements of an upper limb which are clearly goal-directed and well executed but unintended (Della Sala et al., 1994). These unwanted movements cannot be voluntarily interrupted and might interfere with the desired actions carried out by the other (healthy) hand. The patients are aware of the bizarre and potentially hazardous behaviour of their hand but cannot inhibit it. They often refer to the feeling that one of their hands behaves as if it has a will of its own, but never deny that this capricious hand is part of their own body. The bewilderment comes from the surprising and unwanted actions, not from a sensation of lack of belonging of the hand.’
For further details, see Young (2013, p. 58ff) (who also quote the above).
Background: Action Slips
action slips are actions that run contrary to intentions (Norman, 1981). More carefully:
an action ‘slip is a form of human error defined to be the performance of an action that was not intended’ (Norman, 1981, p. 1)
For instance:
‘I was at the end of a salad bar line, sprinkling raisins on my heaping salad, and reached into my left pocket to get a five-dollar bill. The raisins knocked a couple of croutons from the salad to the tray. I reached and picked them up, intending to pop them into my mouth. My hands came up with their respective loads simultaneously, and I rested the hand with the croutons on the tray and put the bill in my mouth, actually tasting it before I stopped myself.’ (Norman, 1981, p. 10)
For a philosophers’ perspective on action slips, see Mylopoulos (2022) (who also introduces many excellent scientific sources).
Background: apraxia
Apraxia provides a further illustration that intentions and motor representations do not always match.
Apraxia is a higher order motor disorder ‘observed in patients who, in spite of having no problem in executing simple actions (e.g. grasping an object), fail in actions involving more complex, and perhaps more conceptual, representations’ (Jeannerod, 2006, p. 12).[1]
Why we care about apraxia: those who exhibit apraxia can perform
simple actions but cannot perform more complex actions which are
nothing but structures of those simple actions.
For instance, one patient could use tools like spoons and forks,
razors and toothbruhes
effectively but at breakfast cereal with a fork and
put toothpaste onto a razor
(Mayer, Reed, Schwartz, Montgomery, & Palmer, 1990, p. table 11–1, 262).
In cases of ideomotor apraxia, patients have difficulty performing actions in response to instructions but can nevertheless perform the same actions when presented with a visual stimulus:
‘Patients with ideomotor apraxia may exhibit differing degrees of impairment depending on testing conditions. For instance, patients typically have greatest difficulty performing gestures elicited by verbal command. They tend to have less difficulty imitating a gesture or acting in response to a visually presented object. They may be least impaired when asked to use the object itself’ (Gross & Grossman, 2008, p. 490)
Mayer et al. (1990, p. 263) suggest that apraxia is continuous with action slips:
‘our observations suggest that there is a continuum of executive impairment, such that at the most severe end, patients experience difficulties with planning and organizing in even the most routine (ADL) tasks and are incapable of engaging in higher-level, nonroutine activities. With recovery, or less severe impairment, the patient may carry out ADL tasks normally but break down where more extensive planning and organization is required (e.g., managing family budgets).’ (Mayer et al., 1990, p. 263).
Taken together, then, observations of action slips and cases of apraxia strongly support the view that intentions and motor representations do not always match.
Further Reading
Recent work on the Interface Problem about intention and motor representation includes:
Ask a Question
Your question will normally be answered in the question session of the next lecture.
More information about asking questions.
Glossary
You may encounter variations on this definition of instrumental in the literature. For instance, Dickinson (2016, p. 177) characterises instrumental actions differently: in place of the teleological ‘in order to bring about an outcome’, he stipulates that an instrumental action is one that is ‘controlled by the contingency between’ the action and an outcome. And de Wit & Dickinson (2009, p. 464) stipulate that ‘instrumental actions are learned’.
To illustrate, one way of matching is for the B-outcomes to be the A-outcomes. Another way of matching is for the B-outcomes to stand to the A-outcomes as elements of a more detailed plan stand to those of a less detailed one.
[of plan-like structures] In the simplest case, plan-like hierarchies of motor representations match if they are identical. More generally, plan-like hierarchies match if the differences between them do not matter in the following sense. For a plan-like hierarchy in an agent, let the self part be those motor representations concerning the agent's own actions and let the other part be the other motor representations. First consider what would happen if, for a particular agent, the other part of her plan-like hierarchy were as nearly identical to the self part (or parts) of the other's plan-like hierarchy (or others' plan-like hierarchies) as psychologically possible. Would the agent's self part be different? If not, let us say that any differences between her plan-like hierarchy and the other's (or others') are not relevant for her. Finally, if for some agents' plan-like hierarchies of motor representations the differences between them are not relevant for any of the agents, then let us say that the differences do not matter.
[of motivational states] Two motivational states match in a particular context just if, in that context, the actions one would cause and the actions the other would cause are all proper ways of fulfilling both motivational states.
References
Endnotes
There are several varieties of apraxia (Gross & Grossman, 2008). Here our focus is on ideational and ideomotor varieties of apraxia. ↩︎