Gibson’s most detailed analysis of the KSD problem came from work on the perception of dynamic occlusion (viewing one surface become progressively hidden behind another as they move; Gibson, Kaplan, Reynolds & Wheeler, 1969; Kaplan, 1969). As one surface goes behind another, the sensations coming from the rear surface stop hitting the retina; they disappear. However, was is perceived is the progressive occlusion of a persisting surface; it is not disappearing, it is going out of view. Gibson and his students identified the kinematic pattern of transformation of the optic array that was specific to occlusion and distinguished it from the pattern specific to a surface actually going out of existence. In the former case, optical texture from the rear surface is progressively deleted over time from the optic array at an edge as it goes in behind the closer surface, and that texture progressively accretes as it comes back into view. In the latter case, there are a variety of transformations depending on how the surface is disappearing (melting vs being eaten, etc). Each event creates a specific optical pattern, but these patterns are not identical to the underlying dynamics. Observers, however, readily and easily perceive and report the underlying dynamics, not the optical patterns. Additional evidence that people are perceiving the dynamics comes from work in multiple object tracking (Scholl & Pylyshyn, 1999). People can track multiple moving targets over time, and can continue to do so even if the objects move in and out of view, but only if they do so in an occlusion event. If the objects go out of view by imploding, tracking goes to chance. In the occlusion case, the visual attention system continues to perceive a persisting object and can often pick it back up when it returns to view. In the imploding case, this system perceives that the object has ceased to exist, and it no longer tracks it.
The central issue in the perception of the world is how the perceptual system comes into contact with that world. In vision, the assumption for centuries has been that the experienced world must be recovered somehow from the 2D image of the world projected onto the retina by the lens of the eye. Scientists therefore hunted for patterns on the retina that preserved critical structure from the world by copying some part of that critical structure.
James J Gibson was, for a long time, no exception to this hunt. His early empirical work (grounded in the theory he laid out in The Perception of the Visual World; Gibson, 1950) created and manipulated retinal images that, for example, contained gradients of optical texture that matched gradients of physical texture created as surfaces receded in depth, or changed their shape or orientation relative to a point of observation. But time and again, Gibson found that perceptual experience was not any straight-forward function of retinal stimulation (i.e. sensations). People did not ‘see’ what was on the retina (Reed, 1988). The most powerful demonstration of this fact is Gibson’s analysis of dynamic occlusion (Gibson, Kaplan, Reynolds & Wheeler, 1969; Kaplan, 1969) to which we will return below.
Gibson’s later career was defined by the search for an explanation of how perception could be possible if it wasn’t based on sensations and retinal images. Gibson’s solution was his theory of the ecological information available for visual perception published in The Ecological Approach to Visual Perception (Gibson, 1979).
What follows is a description of ecological information with reference to some of Gibson’s work and the extensive research literature that has taken place since Gibson’s death in 1979. The focus will be on the information in light for vision, because that has been the focus of the research. However, the principles hold for all the various energy media our perceptual systems interact with, and we will review this briefer evidence as well.
Over the years this blog has collected 232 posts on a wide range of topics and we have multiple papers out and forthcoming working on the ecological approach to psychology and the behavioural sciences more generally. On the plus side, I have material all over on a wide range of topics; on the down side, I have material all over on a wide range of topics and it's hard sometimes to hand someone a useful entry point.
I always figured we would accidentally write a textbook on this blog and while we aren't there yet, we are working on a fairly comprehensive paper that tries to walk through the entire approach. Over the next few weeks, I'm going to post some excerpts from that work to a) have some focused information in the them and b) get some feedback about whether it makes sense.
At this point, I assume you are sufficiently intrigued by the ecological approach that you would like to know how it works. One motivation for getting to that point is the fact it allows mechanistic models of psychological phenomena; another may be a desire to be more embodied or enactive in your science. I'm not going to work on convincing you at the moment; I'm just going to try out the clearest explanations of all the key ideas I currently have in order to educate and get feedback.
I will come back and update this post with links to all future posts on this topic, in order (you can also search with this tag). If by any chance you are finding this material useful, drop me a line and let me know.
Textbook Posts