Archive | essays RSS feed for this section

Media Futures 2006: 1/5 Automata: The Human Computer

9 Aug

Autocover
Automataoldandnewimage87_1

While the recent inventions of Web 2.0 and User Generated Content (UGC) seem to be radical departures from the computing culture we grew up in, their organic social metaphors are in fact rooted in the beginning of computer science.  In the 1940’s and 50’s work of Alan Turing, John Von Neumann and Norbert Weiner, most discussions of the future of computing evolve into a study of the brain.  The natural automata of human thought, the way in which our ideas express our independence, this is the machine intelligence that technologists tried to design into early computers.   

Alan Turing was fascinated by Automata and its relationship to natural human thought.  In his 1950 “Computing Machinery and Intelligence,” Turing outlined an experiment that was able to determine whether a computing machine could be defined as having the capacity to think.  The Turing test functions as follows: Human “X” and respondent “Y” take part in a teletype conversation, but X cannot know whether Y is human or a machine.   If, after a specified amount of time, X believes that Y has responded like a human, and Y is a machine, then Y can be defined as having that human capacity of thought.

In his biography of Turing, William Aspray writes that this:

“was among the earliest investigations of the use of electronic computers for artificial-intelligence research…He attempted to break down the distinctions between human and machine intelligence and to provide a single standard of intelligence, in terms of mental behavior, upon which both machines and biological organisms could be judged.   In providing his standards, he considered only the information that entered and exited the automata…Turing was moving toward a unified theory of information and information processing applicable to both the machine and the biological worlds.”

The fusion of machine and biology is promoted as a core computer architectural principle in the Interim Progress Report on the Physical Realization of an Electronic Computing Instrument:  Julian H. Bigelow, James H. Pomerene, Ralph J. Slutz and Willis H. Ware; Princeton: The Institute for Advanced Study; 1 January 1947.  This report was prepared for John Von Neumann, and the rest of the IAS authorities, on the development progress of a machine based entirely on mathematical equations.

Vneumannpeeps

Left to right: James Pomerence, Julian Bigelow, von Neumann and Herman Goldstine

Von Neumann had joined Princeton’s Institute for Advanced Study as a Mathematician in 1933.  About 10 years later he started concentrating on something less theoretical and more practical (which alienated many of his colleagues): building an electronic computing machine.  This project was a deep meditation on the act of creation.  Some of the greatest minds, across a variety of disciplines (math, biology, engineering, physics) converged in Princeton to help Von Neumann “physically realize” his ideas. 

Iasreport

IAS Report, 1947

According to the report, Organs are:  “portions or sub-assemblies of the machine which constitute the means of accomplishing some inclusive operation or function; as “arithmetic organ.”  Note how the processor in this case is able to extend its influence onto others in an “inclusive operation.”  The organ of social media was anticipated already then, in 1947, even without an Internet to enable it at scale.   

Von Neumann continued to extend his computer research towards an understanding of the human brain.  He described this specifically in his introduction to his 1958 work The Computer and the Brain:

Vonneumannbrainintro8706

In 1948, Norbert Weiner, the leader of cybernetics wrote Control and Communication in the Animal and the Machine.  His use of the word animal is different than Turing’s logic or Von Neumann’s brain, but he is similarly concerned with the organs of information and their ability to relay information between systems:

“It is a noteworthy fact that the human and animal nervous systems, which are known to be capable of the work of a computation system, contain elements which are ideally suited to act as relays.  These elements are the so-called neurons or nerve cells… The mechanical brain does not secrete thought <as the liver does bile>, as the earlier materialists claimed, nor does it put out in the form of energy, as the muscle puts out its activity.  Information is information, not matter or energy.”

Cyberneticssmall

Weiner, Control and Communication in the Animal and the Machine, 1947

In late 2004, the creator of del.icio.us Joshua Schachter described to me that tags were simply crystallized attention.  Both terms interested me: while attention has become my chief investigation, the transparent materialism expressed by “crystallized” has also been a key focus.  When you put these together, you get, in Weiner’s words, a “secretion” of passive behavioral data.

Socialmediaorgan_1

Seth Goldstein, April 2006

Just because a tag is a form of  information doesn’t mean that it lacks physicality  Without being matter or energy, can a tag be made of something else, something that comes closer in nature to mirror neurons?  Attentrons.  Remember that mirror neurons are a form of biological material.  These mirror neurons fire when the subject performs an action, but also when it observes somebody else performing an action.  In this latter case, the successful firing of a mirror neuron is based entirely on its ability to passively mimic the behavior of somebody else.  In this quiet absence of a human impulse, attention is full.

Electronicdataprocessing
Brainsforsale87

Media Futures 2006: 1/5 Automata: The Human Computer

9 Aug

Autocover
Automataoldandnewimage87_1

While the recent inventions of Web 2.0 and User Generated Content (UGC) seem to be radical departures from the computing culture we grew up in, their organic social metaphors are in fact rooted in the beginning of computer science.  In the 1940’s and 50’s work of Alan Turing, John Von Neumann and Norbert Weiner, most discussions of the future of computing evolve into a study of the brain.  The natural automata of human thought, the way in which our ideas express our independence, this is the machine intelligence that technologists tried to design into early computers.   

Alan Turing was fascinated by Automata and its relationship to natural human thought.  In his 1950 “Computing Machinery and Intelligence,” Turing outlined an experiment that was able to determine whether a computing machine could be defined as having the capacity to think.  The Turing test functions as follows: Human “X” and respondent “Y” take part in a teletype conversation, but X cannot know whether Y is human or a machine.   If, after a specified amount of time, X believes that Y has responded like a human, and Y is a machine, then Y can be defined as having that human capacity of thought.

In his biography of Turing, William Aspray writes that this:

“was among the earliest investigations of the use of electronic computers for artificial-intelligence research…He attempted to break down the distinctions between human and machine intelligence and to provide a single standard of intelligence, in terms of mental behavior, upon which both machines and biological organisms could be judged.   In providing his standards, he considered only the information that entered and exited the automata…Turing was moving toward a unified theory of information and information processing applicable to both the machine and the biological worlds.”

The fusion of machine and biology is promoted as a core computer architectural principle in the Interim Progress Report on the Physical Realization of an Electronic Computing Instrument:  Julian H. Bigelow, James H. Pomerene, Ralph J. Slutz and Willis H. Ware; Princeton: The Institute for Advanced Study; 1 January 1947.  This report was prepared for John Von Neumann, and the rest of the IAS authorities, on the development progress of a machine based entirely on mathematical equations.

Vneumannpeeps

Left to right: James Pomerence, Julian Bigelow, von Neumann and Herman Goldstine

Von Neumann had joined Princeton’s Institute for Advanced Study as a Mathematician in 1933.  About 10 years later he started concentrating on something less theoretical and more practical (which alienated many of his colleagues): building an electronic computing machine.  This project was a deep meditation on the act of creation.  Some of the greatest minds, across a variety of disciplines (math, biology, engineering, physics) converged in Princeton to help Von Neumann “physically realize” his ideas. 

Iasreport

IAS Report, 1947

According to the report, Organs are:  “portions or sub-assemblies of the machine which constitute the means of accomplishing some inclusive operation or function; as “arithmetic organ.”  Note how the processor in this case is able to extend its influence onto others in an “inclusive operation.”  The organ of social media was anticipated already then, in 1947, even without an Internet to enable it at scale.   

Von Neumann continued to extend his computer research towards an understanding of the human brain.  He described this specifically in his introduction to his 1958 work The Computer and the Brain:

Vonneumannbrainintro8706

In 1948, Norbert Weiner, the leader of cybernetics wrote Control and Communication in the Animal and the Machine.  His use of the word animal is different than Turing’s logic or Von Neumann’s brain, but he is similarly concerned with the organs of information and their ability to relay information between systems:

“It is a noteworthy fact that the human and animal nervous systems, which are known to be capable of the work of a computation system, contain elements which are ideally suited to act as relays.  These elements are the so-called neurons or nerve cells… The mechanical brain does not secrete thought <as the liver does bile>, as the earlier materialists claimed, nor does it put out in the form of energy, as the muscle puts out its activity.  Information is information, not matter or energy.”

Cyberneticssmall

Weiner, Control and Communication in the Animal and the Machine, 1947

In late 2004, the creator of del.icio.us Joshua Schachter described to me that tags were simply crystallized attention.  Both terms interested me: while attention has become my chief investigation, the transparent materialism expressed by “crystallized” has also been a key focus.  When you put these together, you get, in Weiner’s words, a “secretion” of passive behavioral data.

Socialmediaorgan_1

Seth Goldstein, April 2006

Just because a tag is a form of  information doesn’t mean that it lacks physicality  Without being matter or energy, can a tag be made of something else, something that comes closer in nature to mirror neurons?  Attentrons.  Remember that mirror neurons are a form of biological material.  These mirror neurons fire when the subject performs an action, but also when it observes somebody else performing an action.  In this latter case, the successful firing of a mirror neuron is based entirely on its ability to passively mimic the behavior of somebody else.  In this quiet absence of a human impulse, attention is full.

Electronicdataprocessing
Brainsforsale87

Media Futures 2006: 1/5 Automata: A Brief History of Automata: Cranking Away Since Alexandra

30 Jul


 

If every instrument could accomplish its own work, obeying or anticipating the will of others.  If the shuttle could weave, and the pick touch the lyre, without a hand to guide them, chief workmen would not need servants, nor masters slaves.

So wrote Aristotle of the possibilities of the automaton: an object acting of itself, something bearing the power of spontaneous motion.  The advent of such a mechanism not only promised to change labor – eliminating the need for servants and slaves – but also had the potential to change media production and publication. 

In tracing the development of the automaton from its roots in ritual articulated objects to its contemporary versions, (particularly in the context of robots and models of cellular automata in computability theory and theoretical biology), it is useful to keep Aristotle’s commentary from the fourth century B.C. in mind. 

The history of automata begins with “creation” itself.  Genealogies of these self-replicating objects extend back to the creation myths of every religion and culture – from the story of God’s creation of Adam to the story of Prometheus, who made the first man and woman on earth from clay, which he animated with the fire he stole from heaven.  Moreover, the earliest articulated objects from prehistory of early historic times probably served both artistic and religious purposes: used by shamans, priests, and entertainers, these simple clay or wooden dolls with turning heads, arms, legs and hands could provide the illusion of movement as it occurs in nature, thus adding emotional impact to plays and fables.   


This baker kneading dough is an articulated Egyptian toy, one which was
probably found in the tomb from the time of the XII dynasty onwards.
By being deposited in the tomb, the baker became forever bound to his
master, accompanying him into the Beyond to continue to perform his
duties through the rest of time.

The purposes of automata were not strictly in the realm of morality and spirituality.  Hero of Alexandria (who is credited with the invention of the crank, the cam-shaft and a system of rotations and counterweights, as well as with having demonstrated the principles of the vacuum and the incompressibility of water) used automata to illustrate scientific principles.  In his Treatise on Pneumatics from A.D. 62, he laid out applications of science in the forms of singing birds, sounding trumpets, animals that could drink and coin-operated machines.  Hero’s most famous automaton, though, is the steam eolipile, which, in showing the expansion of gas when heated and the force of reaction in its escape, is regarded as an ancestor of the steam engine:

Above all, automata were sources of delight and entertainment: mechanical orchestras, living snuff boxes and cuckoo-clocks.   From King-shu Tse’s 500 B.C. flying magpie of wood and bamboo to Jacques de Vaucanson’s A.D. 1738 duck, which could eat, drink, splash around the water and digest its food like a real duck, inventors imitated nature for the delight of man:

 

Over time, the makers of automata moved from simply trying to recreate the motion of creatures in the natural world to trying to use these motions to accomplish the work of those very creatures.  This is not to say that entertainment automata disappeared – after all, fake talking human heads like Roger Bacon’s from the 13th century still capture the wonder (and horror) of onlookers at circus fairs and carnivals, as do automaton scribes, dancers and singers in the tradition of those seen below (and in the tradition of “It’s a Small World”). 

 

Picture: The Jaquet-Droz Writer, 1774.  Artifact courtesy of the Neuchâtel Museum.

technorati tags:, , , , ,

Media Futures 2006: 1/5 Automata: A Brief History of Automata: Cranking Away Since Alexandra

30 Jul


 

If every instrument could accomplish its own work, obeying or anticipating the will of others.  If the shuttle could weave, and the pick touch the lyre, without a hand to guide them, chief workmen would not need servants, nor masters slaves.

So wrote Aristotle of the possibilities of the automaton: an object acting of itself, something bearing the power of spontaneous motion.  The advent of such a mechanism not only promised to change labor – eliminating the need for servants and slaves – but also had the potential to change media production and publication. 

In tracing the development of the automaton from its roots in ritual articulated objects to its contemporary versions, (particularly in the context of robots and models of cellular automata in computability theory and theoretical biology), it is useful to keep Aristotle’s commentary from the fourth century B.C. in mind. 

The history of automata begins with “creation” itself.  Genealogies of these self-replicating objects extend back to the creation myths of every religion and culture – from the story of God’s creation of Adam to the story of Prometheus, who made the first man and woman on earth from clay, which he animated with the fire he stole from heaven.  Moreover, the earliest articulated objects from prehistory of early historic times probably served both artistic and religious purposes: used by shamans, priests, and entertainers, these simple clay or wooden dolls with turning heads, arms, legs and hands could provide the illusion of movement as it occurs in nature, thus adding emotional impact to plays and fables.   


This baker kneading dough is an articulated Egyptian toy, one which was
probably found in the tomb from the time of the XII dynasty onwards.
By being deposited in the tomb, the baker became forever bound to his
master, accompanying him into the Beyond to continue to perform his
duties through the rest of time.

The purposes of automata were not strictly in the realm of morality and spirituality.  Hero of Alexandria (who is credited with the invention of the crank, the cam-shaft and a system of rotations and counterweights, as well as with having demonstrated the principles of the vacuum and the incompressibility of water) used automata to illustrate scientific principles.  In his Treatise on Pneumatics from A.D. 62, he laid out applications of science in the forms of singing birds, sounding trumpets, animals that could drink and coin-operated machines.  Hero’s most famous automaton, though, is the steam eolipile, which, in showing the expansion of gas when heated and the force of reaction in its escape, is regarded as an ancestor of the steam engine:

Above all, automata were sources of delight and entertainment: mechanical orchestras, living snuff boxes and cuckoo-clocks.   From King-shu Tse’s 500 B.C. flying magpie of wood and bamboo to Jacques de Vaucanson’s A.D. 1738 duck, which could eat, drink, splash around the water and digest its food like a real duck, inventors imitated nature for the delight of man:

 

Over time, the makers of automata moved from simply trying to recreate the motion of creatures in the natural world to trying to use these motions to accomplish the work of those very creatures.  This is not to say that entertainment automata disappeared – after all, fake talking human heads like Roger Bacon’s from the 13th century still capture the wonder (and horror) of onlookers at circus fairs and carnivals, as do automaton scribes, dancers and singers in the tradition of those seen below (and in the tradition of “It’s a Small World”). 

 

Picture: The Jaquet-Droz Writer, 1774.  Artifact courtesy of the Neuchâtel Museum.

technorati tags:, , , , ,

THE WAR FOR ATTENTION: SUMMER 2006

17 Jul

Soldiers_at_attention







Foreward

Since writing a series of essays on Media Futures in the Spring of 2005, I have spent the last year or so investing in and building out various data services.  These include: a lead generation marketplace at rootexchange.com, whose first vertical is mortgage;  a clickstream media platform at root.net, the command line for a new Attention-based OS; AttentionTrust and the promotion of its four principles of property, mobility, economy, and transparency (AttentionTrust.org is now the #2 organic search result for Attention on Google); the “crystallized attention” (tag) company del.icio.us, which was acquired by Yahoo!; and finally, Majestic Research, the investment firm that uses online consumer behavior for its equity models and which I co-founded in 2002.  Majestic is the name I used for this blog on typepad, and its subtitle transparent bundles was an attempt to describe how investment research and trading should operate. 

Sometimes it feels like I am working on a number of disconnected activities.  But enough of the time it feels like they are all connected in a deeper kind of way.  They all deal with consumer Internet usage; and more specifically, they share the common goal of maximizing the signal-to-noise ratio of online data in order to elicit the highest fidelity copy of an individual’s Attention.  This is not an easy problem to solve, as the interface between one’s mental focus and the TCP/IP protocol is indirect at best.  What we have as proxies are clicks, searches, tags, forms and other types of user generated media.  From the interplay of these artifacts we– as in the royal Web 2.0 we– are busy coding a social media fabric, the center of which always seems but one release away.

Unlike most media properties, Attention is inherently unstable and indeterminate.  Describing Attention is like making a movie inside of a house of mirrors, where it is impossible to keep the camera itself out of the picture.  It is because of this Heisenberg-like uncertainty principal that passive behavioral data provides the better indicator of pure Attention than explicit user generated content such as ratings, reviews and tags (which change the substance of Attention as they reflect it).  As we review the history of Attention, it seems always caught in its own shadow; artists and actors want Attention and create works and performances to “attract” and “capture” it.  Only recently have certain of us (guided by Goldhaber’s theories on the matter) come to see Attention in its own light: as a material substance that moves from one human being to another like a language or a liquid.  Our cognitive framework for Attention needs to shift from metaphors of coercion to metaphors of creation.

The distributor of Attention may indeed be influenced by that receiver who provides the most interesting information, but still the former maintains control over who gets his Attention.  It is this choice the individual has over where he spends his Attention that underlies the theory of Media Futures.  This new organon assumes that the user is in control of the media that he and his network of social and commercial relationships create.   With the traditional consumer now in control over the means of social media production, the traditional media company now needs a new value-creation model– one based on consuming the most relevant electronic gestures of its audience, rather than one based on producing the most engaging content.

For a broader dialectical context, I would encourage you to  tune into the following writers

Attention:  The underlying instrument of Media Futures

“Attention is scarce,” Michael Goldhaber writes, “because each of us only has so much of it to give, and it can only come from us – not machines, computers or anywhere else.”  It is in cyberspace, he argues, that a new type of economy comes into its own: this is the attention economy, an economy based on what is both “most desirable and ultimately most scarce.” 

Goldhaber’s principles of the attention economy enter into a long-standing dialogue among art historians and cultural theorists about the techniques and implications of attention in the production and reception of media.  As art historian Michael Fried argues in Absorption and Theatricality, it was first in the writings of Diderot that the terms of attention assumed critical in addition to rhetorical significance.  A painting, Fried writes, “had first to attract (attirer, appeller) and then to arrest (arrêter) and finally to enthrall (attacher) the beholder, that is, a painting had to call someone, bring him to a halt in front of itself, and hold him there as if spellbound and unable to move.”  Then, it was the media itself being consumed that did the work advertising does today: it was up to the media itself to call out to consumers for their attention.

The Beauty Salon

Parisiansalon

Of course, in today’s salons, we are more likely to consume the news of celebrity hook-ups than the spectacle of high art: that the salon is still a place for to see and be seen is telling.  In the eighteenth century, the salon was a privileged site for the bourgeoisie to consume, contemplate and discuss art and literature – truly a place for seeing and being seen.  We pay visits to an entirely different type of salon today: we go in preparation for – or to increase our chances of – the condition of being seen.  By doing work on our bodies – by taking clippers to our dead cells, by taking tweezers to our brows, we might too do our own advertising: we might attract, arrest and enthrall the passers-by.  We pay to increase our chances of being beheld – consumed, contemplated, discussed; we pay so that others might pay attention to us.

This is the to be seen half – but that which we see in salons, besides other guests questing to improve their own appearances, is the set of people important enough to be seen by the masses: celebrity.  Magazines like People and Us Weekly, which adorn the waiting areas, promise a behind-the-scenes look at the lives of people who have entertained us on stage or on the big screen, or perhaps even written books for our edification or delight.  These celebrities have captured the public’s attention with their work, and they certainly capture the public’s attention with their play.  And the placement of celebrity magazines in salons suggests the possibility that by altering our appearance, perhaps in the fashion of the star du jour, we might capture more attention.  At the end of this line of fantasy is the possibility of our own presence in such a magazine, the possibility that the banalities of our own lives will be represented in the world of others and put out for consumption by third, fourth, millionth parties.  We will be worthy of attention.

The Internet Salon

Whatstarsreallyeat

The truth is that our own private gestures are constantly being recognized, represented and put out for public consumption – and in real time.  Moreover, these gestures are at the same time being plugged into calculations to predict our future behavior, calculations which promise a personalized experience to those who click (and profit to those who calculate).  The playing-out of these phenomena takes place, of course, on the Internet.  This is an economy of attention – one, as Goldhaber argues, that is different from any economy seen before: “In its pure form, it doesn’t involve any sort of money, nor a market or anything closely resembling one.  It involves a quite different pattern of life than the routine-based, industrial one…What matters is seeking, obtaining and paying attention.”  The economy’s “characteristic form of property” is “the attention that is readily available to its ‘owner’ from other people, which depends on what attention this owner has gotten in the past”; it is a property “located, quite literally, in ‘the minds of the beholders.”

In his work on the attention economy, Goldhaber views the movement toward cyberspace as analogous to the move of western European civilization to the New World of the Americas around the time of the birth of the market economy.  “Unimpeded by the remains of feudalism,” he writes, “the market-industrial system in fact took most complete hold here in North America first.  From here, much later, it swept back to complete its conquest of the western European motherland, along with the rest of the globe.”  Similarly, “Cyberspace will be the ‘place’ where the new economy moves ahead most dynamically, but the strength gained in the process will eventually sweep back to dominate the rest of life.”

If Attention is indeed the substance of focus (that which registers our interests by indicating our choice for certain things and choice against other things), then Internet is the most fertile ground for the development of the Attention Economy;  for the Internet (and particularly web services) allows the recording and sharing of our choices, of our Attention, in real-time.  These choices of ours are manifested by the binary gestures of the keyboard and mouse.  With each click, our own narratives expand.  With each move to create a tag or a link, our narratives expand.  With each search, with each subscription, our narratives expand to tell the story of which team we follow, where we will be taking our next vacation, which conference we are planning to attend.  The gestures of our lives are recorded, and we become represented – on “Top 100” lists, blogrolls and Flickr badges of different  sizes.  And the narratives of our electronic Attention gestures have even crossed back into offline mass media: on CNN’s headline news or American Idol’s SMS voting.  We may not be followed by paparazzi, but airtime on national television is a start.   

The sociological, psychological and economic forces at play in this discussion warrant extended research.  As such, it is a daunting task to wrestle with the history of social media and probe into its future development.  The Internet is a dynamic site of all sorts of production and consumption, a place where familiar models are broken and reinvented, a place where the material being consumed is dynamic, produced on the fly.  We have tags, wikis, social networks and other forms of social media – we have new forms of media being created by everyman for everyman, and at any time, in any place.  And works in these media are being created at a far higher rate than they are being consumed.  Power and value shift, become redefined; the very possibilities of our personhood shift, become redefined.
The more we express ourselves electronically, the more residue we leave behind in this ever-growing, ever-changing landscape – shadows of our digital actions scattered about held together not by gravity, biology, optics but by algorithms and APIs.  The economics of behavioral data, and the electronic media gestures that constitute this data, reveal themselves in an analysis of Attention.   This is the goal of updating Media Futures one year later:   Over the coming weeks, I will write the five-boned skeleton of A’s into the skin of Attention: 

Apyramid_1

It is a body of work that seeks to better understand our gestures in social media, the very articulations of our attention and intentions – a pyramid topped by Attention and flanked by:

  • Automata- Human inspiration
  • Algorithm- Patterns of behavior
  • API- Natural expression
  • Alchemy- Value creation
  • Arbitrage- Economic discovery

This is a model I see as most compelling in examining the delta of change, the fertile crescent lying between Wall Street and Madison Avenue.

Note:  I am fortunate to be working with an extremely thoughtful and lyrical research assistant in Maggie Dillon, who recently graduated Princeton and who will be studying art history and media theory next year at the University of Cologne.  She likes to refer to herself as a "an aspiring poet and brewer from the country’s heartland," which is clearly the kind of midwestern pragmatic spirit that this blog needs more of!

Follow

Get every new post delivered to your Inbox.

Join 14,437 other followers