Bret Victor - The Humane Representation of Thought

For cool updated about the future of computing, follow me at   / iamvriad  .

Closing keynote at the UIST and SPLASH conferences, October 2014.
Preface:

http://worrydream.com/TheHumaneRepres...

References to baby-steps towards some of the concepts mentioned:

Dynamic reality (physical responsiveness):
The primary work here is Hiroshi Ishii's "Radical Atoms": http://tangible.media.mit.edu/project...
but also relevant are the "Soft Robotics" projects at Harvard: http://softroboticstoolkit.com
and at Otherlab:    • Saul Griffith, "SOFT, not SOLID: Beyond Tr...  
and some of the more avant-garde corners of material science and 3D printing

Dynamic conversations and presentations:
Ken Perlin's "Chalktalk" changes daily; here's a recent demo: http://bit.ly/1x5eCOX

Context-sensitive reading material:
http://worrydream.com/MagicInk/
"Explore-the-model" reading material:
http://worrydream.com/ExplorableExpla...
http://worrydream.com/LadderOfAbstrac...
http://ncase.me/polygons/
http://redblobgames.com/pathfinding/a...
http://earthprimer.com/

Evidence-backed models:
http://worrydream.com/TenBrighterIdeas/

Direct-manipulation dynamic authoring:
http://worrydream.com/StopDrawingDead...
http://worrydream.com/DrawingDynamicV...
http://tobyschachman.com/Shadershop/
Modes of understanding:
Jerome Bruner: http://amazon.com/dp/0674897013
Howard Gardner: http://amazon.com/dp/0465024335
Kieran Egan: http://amazon.com/dp/0226190390

Embodied thinking:
Edwin Hutchins: http://amazon.com/dp/0262581469
Andy Clark: http://amazon.com/dp/0262531569
George Lakoff: http://amazon.com/dp/0465037712
JJ Gibson: http://amazon.com/dp/0898599598
among others: http://en.wikipedia.org/wiki/Embodied...
I don't know what this is all about:
http://worrydream.com/ABriefRantOnThe...
http://worrydream.com/ABriefRantOnThe...

---
Abstract:

New representations of thought — written language, mathematical notation, information graphics, etc — have been responsible for some of the most significant leaps in the progress of civilization, by expanding humanity’s collectively-thinkable territory.

But at debilitating cost. These representations, having been invented for static media such as paper, tap into a small subset of human capabilities and neglect the rest. Knowledge work means sitting at a desk, interpreting and manipulating symbols. The human body is reduced to an eye staring at tiny rectangles and fingers on a pen or keyboard.

Like any severely unbalanced way of living, this is crippling to mind and body. But it is also enormously wasteful of the vast human potential. Human beings naturally have many powerful modes of thinking and understanding. Most are incompatible with static media. In a culture that has contorted itself around the limitations of marks on paper, these modes are undeveloped, unrecognized, or scorned.
We are now seeing the start of a dynamic medium. To a large extent, people today are using this medium merely to emulate and extend static representations from the era of paper, and to further constrain the ways in which the human body can interact with external representations of thought.

But the dynamic medium offers the opportunity to deliberately invent a humane and empowering form of knowledge work. We can design dynamic representations which draw on the entire range of human capabilities — all senses, all forms of movement, all forms of understanding — instead of straining a few and atrophying the rest.
This talk suggests how each of the human activities in which thought is externalized (conversing, presenting, reading, writing, etc) can be redesigned around such representations.

---
Art by David Hellman.
Bret Victor -- http://worrydream.com