Affordances are Not Relations, Part 1: Chemero (2009)

Affordances are on my mind right now as I develop the throwing research programme, and a major commitment of that work is that affordances are (dispositional) properties of the environment picked out by organisms in the context of tasks. This commitment has become important enough that it's time to get into developing specific arguments against the various 'affordances are relations' papers that are out there. I am working towards a paper summarising my objections to the relations account that also strongly advocates for the properties account on the grounds it enables a lot more science. This will be an occasional series of posts as I read and draft my arguments; as always, feedback welcome.

In this first post, I want to draft a response to 'Affordances 2.0', from Chemero's (2009) book Radical Embodied Cognitive Science. I previously blogged this chapter in two parts here and here. 

Relational Theories of Affordances are Functional, Not Mechanistic (A Purple Peril)

Everyone and their dog has a theory about how to interpret Gibson's famously vague definition of affordances;

The affordances of the environment are what it offers the animal, what it provides or furnishes, either for good or ill....an affordance is neither an objective property nor a subjective property; or it is both if you like. An affordance cuts across the dichotomy of subjective-objective and helps us to understand its inadequacy. It is equally a fact of the environment and a fact of behavior. It is both physical and psychical, yet neither. An affordance points both ways, to the environment and to the observer.

There are two basic flavours of theories: affordances as dispositional properties of the environment (Turvey, Shaw, Reed & Mace, 1981; Turvey, 1992) and affordances as relational features of the animal-environment system. (A recent paper has just claimed they should be best understood as events, but to be honest I don't really know what's motivating this). The two most recent and popular relational accounts are Chemero's book (Chemero, 2009; see these posts on the relevant chapter) and Rietveld & Kiverstein (2014) in a paper entitled 'A Rich Landscape of Affordances'. Their goal, like most of the relational accounts, is to handle higher-order cognition by scaling up affordances to support it (our move, in contrast, has been to expand the uses of perceptual information; Golonka, 2015; Golonka & Wilson, 2016 preprint).

I am firmly in the 'affordances as dispositional properties' camp (see, for example, the discussion section of my recent throwing paper for an extended analysis). Specifically, they are dynamically defined dispositional properties of objects and events in the context of tasks. The reason is that this is the only way affordances can be the kind of thing that can create information and therefore be perceivable. They have to be 'out there' and made of things that light can bounce off, for example, and relations between organism and environments are not typically such things. In addition, if they do not exist until perceived, we need a story to explain how we come to learn to perceive them, and there is no viable ecological framework that will make this happen (Wilson et al, 2016).

Reading this material with my new mechanism glasses on has given me a new, concise way to identify the problems with these relational accounts:

Affordances-as-relations theories are all functional explanations, and not mechanistic explanations

Grounded vs. embodied cognition: a (hopefully uncontentious) note on terminology

Our Frontiers paper made the case that embodied cognition is, by definition, a fairly radical affair. We argue 

...if perception-action couplings and resources distributed over brain, body, and environment are substantial participants in cognition, then the need for the specific objects and processes of standard cognitive psychology (concepts, internally represented competence, and knowledge) goes away...

We argue that this is compulsory; as soon as you allow the perceived environment to play any kind of critical role in cognition, it's game on for what Shapiro calls 'replacement style' embodied cognition. This is why we don't think that we're just at one extreme end of a continuum of embodiment research; we think the rest of the field is making a category mistake. Chapter 2 of Chemero (2009) does an excellent job of laying out the history here; representations come from the structuralist school of thought, embodiment from the functionalist school. They are, quite literally, two different kinds of approach and mixing them is just an error.

I need to talk about this other stuff, though, and I'm tired of calling it 'not embodied cognition'. For one thing, the critical tone gets in the way of the argument. Shapiro calls it 'the conceptualisation hypothesis' and while this is basically accurate, it's a slightly non-intuitive technical term I'd have to explain all the time. So I want to be slightly cheeky and rename that other work, while picking a name they will hopefully not mind. This work, I think, is really grounded cognition (as per Barsalou, 2008) and that's how I'll talk about it from here on in.

Some Ground Rules for a Theory of Psychology

Add psychology to the list

A fairly common response to our theory post was 'here's my theory, which is designed to replace and fix all the others'. However, it's more a symptom of the problem I was discussing than a solution for everyone to have their own entirely separate theory which doesn't talk to any other work in the field (see above). One of my personal goals in science is to not be that guy. I want to see cognitive science become more integrated, not more fragmented. We have also been asked, however, and quite sensibly, what we think the solution to our problem is. The question then is how to propose a theoretical approach for psychology and cognitive science where we don't just reinvent the wheel.

Sabrina and I have been working on this for, well, the entire blog. It has been a place for our "brave attempt to think out loud about theories of psychology until we get some" since day one; we've been identifying problems but, just as importantly, solutions the whole time. The theory post identified the big picture problem we see in psychology; time to lay out some solutions.

Step one is to present a map of the blog, organised thematically to guide new readers to work we've already done here. This should also help map out the gaps in the approach, so we can focus on things to do next; feel free to point us to problems we can't yet address! (And yes, we know about episodic memory and language - we're working on it.) This post is not a comprehensive summary of past work - it's a map for you to use to find what we've done so far.

To summarise: in essence, and some minor details aside, we are advocating for Chemero's (2009) radical embodied cognitive science, with the addition of some elements he was missing (network science & task specific devices). Cognition is embodied, extended and held together by the direct perception of affordances and events; the result is a complex, nonlinear dynamical system that must be analysed as such. The brain is not the sole source of our behaviour, nor is it representing the world; it clearly plays a critical role in this system, though, and we propose that we'll need the tools of network science to describe what it's actually up to (Sporns, 2010). Methodologically, we must carefully characterise the task, the resources available to solve the task (which include brain, body and environment) and the information these resources create which can sustain the formation and control of an embodied solution. This method is Bingham's (1988) task specific device approach (the main piece Chemero was missing, I think).This approach applies to all and any behaviour you want to explain, including the hard stuff like episodic memory and language.

Critically, this approach, while new (and uncommon in insisting on a role for Gibson's ecological approach) isn't just something we invented: all these elements are active parts of modern cognitive science. The only new part is bringing it all under one roof, with the goal of getting on and getting some decent normal science under our belts.

Here's what we've covered so far. If you want more details on any point, click on the links!

Embodied cognition is not what you think it is

The most exciting thing in cognitive science right now is the theory that cognition is embodied. It is, in fact one of the things interested lay people know about cognitive science, thanks in part to a lot of high profile experiments that claim to show how cognition can be influenced and biased by states of the body, or that cognitive states can affect states of the body in ways that suggest abstract metaphors and concepts are grounded in the behaviour of the body. A recent blog post at Scientific American covers this ground quite nicely (although the large picture of Noam "not an embodied cognitive scientist" Chomsky hints that someone didn't actually read the piece).

The problem, however, is that this is not really what embodied cognition is about. Embodiment is not the weak claim that you can see small effects of the behaviour of the body in our mental representations of the world. Embodiment is the radical hypothesis that the brain is not the sole resource we have available to us to solve problems. Our bodies, and the meaning-filled perception of the world they allow, do much of the work required to achieve our goals, and this simple fact changes utterly what our theories of 'cognition' will look like.

Chemero (2009) Chapter 9 - The Metaphysics of Radical Embodiment

The final chapter of RECS tackles the metaphysical implications of the radical stance. Gibson was a staunch realist, but there are some odd elements to entities like affordances that, to certain minds, sound like idealism or antirealism of some kind. Realism is, essentially, the claim that there is a world independent of our experience of it, and that we can have basically accurate knowledge of that external world. In modern times this reality has been equated with the description given by physics. Affordances don't belong to physics, however; whether relations or dispositions, they are, at heart, facts which span the organism and the environment. This sounds wrong to a lot of ears (as Ken's comments on that post readily show!). Chemero therefore devotes the final chapter to defending the claim that RECS can be realist; this matters, because people tend not to like idealism in their science these days, and it's going to be a standard philosophical objection to the RECS programme if not addressed.

Chemero (2009) Chapter 8: Neurophilosophy Meets RECS

Chemero's book finishes with two chapters on some philosophical consequences of taking a radical, embodied approach to cognitive science. Chapter 8 is about the mind-body problem, and how various attempts to reduce cognitive science to, say, neuroscience, can be vigorously resisted via the RECS approach, without being dualist about the mind. There are many people who think cognitive science can be reduced to neuroscience (intertheoretic reduction), but one plank of any embodied approach is that this won't work. RECS is particularly committed to a more extended notion of cognition and so a strategy for resisting reduction is critical. Chemero's plan won't rely on the usual philosophical manoeuvres such as Martian pain mechanisms or zombies. Like me, Chemero is concerned that these create the impression that philosophers aren't tackling real problems; he wants the philosophical conclusions of RECS to be grounded in data, and I thoroughly endorse this approach.

Perception, Action & Dynamical Systems

Over Easter I visited the Center of Functionally Integrative Neuroscience at Aarhus University in Denmark, courtesy of the Interacting Minds group. I gave a talk, got the tour, and met some of the faculty and students - some interesting opportunities for future collaborations, I hope - thanks for the hospitality!

I wanted to lay out the basics of the talk I gave. I took the opportunity to present some ideas that have been developing as I work on this blog, reading Chemero and working on coordination experiments. There is a core of people in Aarhus interested in things ecological, as well as dynamical systems, so it was a good audience to try these ideas out and they seemed to go over well. This is also the sketch of a paper Sabrina and I are going to work on over the summer.

The take home message of the talk was simple - dynamical systems is the right kind of mindset for cognitive science, but it is not a theory of behaviour. Dynamics merely provides the right kind of modelling tools - the form of the model must be based on hypotheses about the specific kind of dynamical systems we are or else they are merely an exercise in data-fitting. Ecological psychology is the right theory, and the Bingham model of coordinated rhythmic movement is currently the only example of a genuinely perception-action dynamical systems model. My thoughts here are largely from my response to Chapter 4 of Chemero (on 'the dynamical stance') and Chapter 5, his initial attempt to use dynamics to serve as a guide to discovery which I think fails and which Chemero then replaces with ecological psychology. The description of Bingham's model comes from here.

Chemero (2009) - A Brief Pause to See Where I'm At

There are still a couple of chapters left for me to go over in Chemero, but the last two were the crux of the book for me, and I want to try and summarise where my analysis has left me before I go on holiday for Easter.

First, I'd like to separate out a couple of themes. First, there's the overall 'radical embodied cognitive science' programme, and second is the specific form of the 'shored up ecological psychology' that Chemero advocates as a basis for this programme. I am entirely on board with the basic idea of RECS; specifically, I think that cognition, whatever that is, is non-representational and that we can make great progress by making our science non-representational. I think Chemero has written a clear exposition of what such a radical science might look like, and why we might want to bother, and I think this makes RECS a must read for the field. 

Second, I think that Chemero is right to go to ecological psychology for a theoretical basis. The more I look, the more I have come to believe that James Gibson is about the only psychologist to have actually proposed a genuine scientific theory in psychology. A true theory provides you with tools to empirically attack novel problems in your domain, and provides you with a clear basis to interpret the results of your tests and to begin to tell a coherent story. Psychology has been chasing phenomena for most of it's scientific life, with no clear framework emerging to tell us a story about why things are the way they are. Ecological psychology is a genuine theory, and it's about a critical feature of our psychological lives: how we maintain contact with our world and move through it successfully. Regardless of what topic you're specifically interested in, you need to understand how we come to have knowledge about our environments.

Finally, though, I have problems with the proposals Chemero makes about the two pillars of an ecological psychology, affordances and information. It's these problems I want to try and sum up here, to focus the conversation a little.

Chemero (2009) Chapter 7: Affordances, etc (Pt 2)

Last time I went over affordances-as-dispositions, and Chemero's first swing at affordances-as-relations. Affordances can't be dispositions, claims Chemero, because

1. Dispositions manifest when the conditions are met; this is compulsory. But I am not currently trying to effect all the affordances in my vicinity, so they can't be dispositions. Relations are functions, and thus support malfunctions.
2. Dispositions require complements - for perception-action, the complement of an affordance is an effectivity. But what exactly is this? Body scale (e.g. leg length)? Actually, it's more likely in terms of ability (per some unpublished experiments Chemero has run); people's judgements of stair climbability are a relation between the riser height and the person's ability to step that high.
3. If affordances are properties that are directly perceived, then when two people perceive the same affordance their minds will overlap: the problem of two minds. Relations solve this problem by making the overall relation which the directly perceived affordance is part of unique to each observer.

This would be all well and good, except that 

1. Affordances and effectivities are complex dispositions, and the conditions for being realised can be a long list. In addition, I can only be one kind of effecting device at a time, so when seated I am literally not capable of complementing the climbing affordances of my stairs at that moment in time.
2. Noting that 'body scale' is an imperfect proxy for an effectivity, and then claiming that this means nothing is an effectivity makes no sense. In addition, 'abilities' are equally approximate. The issue (being careful what you claim is the actual complement of the affordance) is valid but applies equally to dispositions or relations.
3. The solution to the problem of two minds that Heft outlined and Chemero thinks supports his case lies in making the act of perception relational, not the thing perceived. The affordance does not, itself, need to be a relation.

So far, nothing has convinced me that affordances need to be relational. But to round the story out, I want to finish the chapter and address the final tweak Chemero adds: Affordances 2.0.

Chemero (2009) Chapter 7: Affordances, etc (Pt 1)

If you want perception to be direct (no 'mental gymnastics') you must identify where the content of perceptual experience comes from; when I view a chair, for example, I don't see a meaningless or random collection of surfaces or colours, I see an object that I can interact with in some ways and not others. For traditional, indirect theories of perception, this meaning is constructed internally: mental representations perform transformations (perhaps computational ones) on sensory input to infer what the input means. A theory of direct perception requires that meaning is not added to the signal; this 'enrichment' is not permitted. To solve this problem, Gibson proposed that the world, for a perceiving-acting organism, is not comprised of meaningless bits of physics and chemistry. Instead, he proposed that the world presents itself to this organism in terms of affordances, which are intrinsically meaningful for the organism and are about the possibility of behaviour.

So a theory of direct perception requires an ontology, a theory about the make-up of the world  that means it is intrinsically meaningful. Chemero wants RECS to include direct perception, therefore he needs such an ontology. He is happy with affordances; he is not, however, satisfied with the Turvey-Shaw-Mace approach which defines affordances as dispositions. This chapter will defend an extended version of his theory of affordances as relations: Affordances 2.0.

Affordances have cropped up here, er, a couple of times already - namely here, here, here, and most recently and enthusiastically here, as well as some empirical discussions here and here. The idea that affordances, not physics, is the correct ontology for a theory of direct perception also came up here. To jump ahead, I disagree with Chemero about affordances. I don't think the disposition account is flawed in the way he thinks, and I don't think relations solve the problem anyway. While I obviously agree that an affordance-based ontology is the way to go, I am so far satisfied that the dispositional account is the best current analysis, and I think that trying to make affordances relational is to confuse the world with information about the world.

I'm going to take this chapter in two parts, because this post got long; affordances are complicated things. After this chapter, I think a pause for station identification may also be in order, just to lay a few things out in response to Chapters 6 and 7, the real meat of the book. But first, Affordances 1.0 vs Affordances 1.1.

Chemero (2009) Chapter 6: Information and Direct Perception

In the previous chapter, Chemero laid out his first idea as to how a radical embodied cognitive science could be a science; he suggested taking a 'dynamical stance' in which researchers use simple dynamical systems models such as the HKB to drive empirical work. In this chapter, he moves towards his more recent suggestion, namely using Gibson's ecological psychology as a theoretical basis from which to make predictions and run experiments. This is a much more robust idea; sciences need theories or else they wander from phenomenon to phenomenon, which I believe to be a real issue in modern psychology and cognitive science.

Chemero has his own flavour of ecological psychology, however. He believes it stays true to Gibson's essential framework but expands it to cope with new and important issues. The two pillars of ecological psychology, information and affordances, remain. Chapter 6 is Chemero's expanded notion of information, while Chapter 7 is his updated theory of affordances as relations (which I've covered briefly before).

Chemero (2009), Chapter 5: Guides to Discovery

The dynamical stance laid out by Chemero in the previous chapter has a potential flaw (besides being a bit weak-ass) - it's not clear how it can serve as a guide to discovery. How do you do productive science taking this approach? Chemero is going to make two suggestions, only one of which I think works: first, he's going to suggest dynamical models such as the Haken-Kelso-Bunz (HKB) model can serve to stimulate empirical work even when they are entirely phenomenological. This approach is, I think, entirely incorrect, and this chapter is full of serious problems (only some of which are unique to Chemero). Second, he's going to suggest that Gibsonian ecological psychology can actually solve the problem much more robustly anyway, by serving as an underlying theory of behaviour. This will work better, and I would advocate Bingham's model of coordination as an exemplar of this, more promising route.

But first, the HKB model as guide to discovery (this chapter is largely the material from Chemero, 2000; I intend to turn this post into a paper to rebut that paper and point to the Bingham model as an alternative, so comments are especially welcome on this one). Time to get a little critical, I'm afraid.

Chemero (2009), Chapter 4: The Dynamical Stance

The problem with the theory of representation Chemero settles on in the previous chapter, as we shall see, is that it makes representation unavoidable. If there are representations, then RECS fails to get off the ground (remember, the radical bit is anti-representationalism). In this chapter, Chemero identifies a path past this problem (the 'dynamical stance'), explains why it works, but then concludes with a new problem, that of how to guide future discovery.

Chemero (2009), Chapter 3: Theories of Representation

The radical part of 'radical embodied cognitive science' is anti-representationalism. Simply put, the claim is that the brain does not internally represent states of the world in any way, nor are these the basis for our experience. It's radical because to a typical cognitive scientist, the mere suggestion is ludicrous: like suggesting you do biology without genes or particle physics without Large Hadron Colliders. But this indignation is hiding a dirty little secret: mental representations are generally just assumed to exist, because of assumptions about the poverty of stimulus we supposedly face. They are theoretical entities designed to solve a problem which, frankly, might not exist. There has been a lot of theoretical work on what it means to be a representation, but most of this has occurred in philosophy and most modern experimental cognitive psychologists don't ever engage with the issue. Sabrina has talked about this a bit already here and here and here and it's likely to keep cropping up.

Chemero's third chapter lays out some basics about what a theory of representation has to look like. If you're going to be anti-representational you need something to be against that isn't a straw man. This is unfortunately difficult because the concept of representation is a moving target: if I had a dollar for every conversation I've had that included the phrase 'Oh, that's not what I mean by representation' (even when it really is), I wouldn't need to submit the grant I should be working on just now. This chapter is therefore going to look for a 'minimal case' of representation that doesn't bug too many people but that isn't too easy a target.

Strap in, this chapter's busy.

Chemero (2009), Chapter 2: Embodied Cognition

Chemero spent Chapter 1 creating space for himself and his book in the marketplace of ideas about how we should do our cognitive science. Chapter 2 is about situating his theory in amongst the competition, with the goal of establishing exactly what a radical embodied cognitive science (RECS) is, and that it is a perfectly respectable competitor. He reviews a little history and an example study using dynamical systems that explains a  'representationally hungry' cognitive task to set things up. This is still quite preliminary work, but time well spent I think.

Chemero (2009), Chapter 1: Hegelian Arguments in Cognitive Science

The basic thesis of RECS is that cognitive science should give up on representations (the radical bit) and focus on explaining the embodiment of cognition in a complex, perceiving-acting dynamical system. Chemero spends Chapter 1 heading off the likely initial line of resistance to this thesis; namely, the argument that 'your thesis got ruled out in the 80s by [insert name here]'. Chemero labels arguments of this type 'Hegelian' and makes a case that a) they're mostly a sign of the immaturity of modern cognitive science, but most importantly b) they don't really need to convince anyone to stop trying to develop a radical, embodied cognitive science (and that the rest of the book is therefore still worth a read). I basically agree with this analysis; in fact, we started this blog to try and address the immaturity issue in (a) (in favour of some form of (b)). So we're off to a good start!

New Reading Group: Chemero (2009), Radical Embodied Cognitive Science

I thought it was time to pick up the next book I have on my list to go through here on the blog. This is Tony Chemero's book, Radical Embodied Cognitive Science (hence RECS). I've read through it once, and it inspired me to write on affordances here, here and here. My goal now is to take things a little more slowly and think about the detail.

Tony is a philosopher who's been actively engaged in things ecological for quite a while now. The goal of RECS is to lay out a) what radical embodied cognitive science is, b) propose a methodological stance in the form of dynamical systems, and then c) lay out how ecological psychology is the key theoretical structure that gives this approach it's methods for 'discovery', i.e. the ability to make predictions and do normal science. (Still curious? Check out the Wordle of the book!) Chemero's going to invoke what he describes as 'shored-up ecological psychology'; this refers to his ideas on the ontology of affordances and on information. I'm not currently all that convinced by the changes, but I'll leave the details until we get there. I'll try and entice Tony into stopping by, hopefully we can have a dialogue on some of this material (especially the later chapters on his 'shored up' version of Gibson).

I've been preparing posts on chapters for the last few months, actually, but I've waited to start posting so that I could be well ahead before I got going. This is going to let me tweak the posts with later information in mind, as well as post updates fairly regularly without crushing my schedule. I'm really enjoying this extended process, I'm coming to grips with what Tony is up to and it's been an excellent way to really study the book. My optimistic plan is to stay ahead like this, and move onto other books in the future.

I'll post on the first chapter as next Tuesday's update; I'd love it if people were reading along and commenting.

Reference

Chemero, A. (2009). Radical Embodied Cognitive Science. Cambridge, MA: MIT Press. Amazon.com, Amazon.co.uk, MIT Press e-book