ITP Blog

My journey in making things

Physical Computing – Lesson#1

We kicked off Physical Computing with an in-class discussion about physical human interaction following an in-class imaginative exercise. After following that discussion with further reading of Crawford’s ‘The Art of Interactive Design’ – Ch. 1-2, and Bret Victor’s ‘The Future of Interaction Design’ . I arrived at a rather different perspective on human-computer interaction, which at it’s core is somewhat of a synthesis of the two.

Starting with Crawford’s definition of Interactivity and his systematic ranking of the levels of engagement and up until Victor’s definition of a tool and use case, it seems to me there is a missing factor in current human-computer interaction in the aforementioned texts, the machine’s ability to learn patterns and mimic human associated decision making strategies that alter the Conversation’s characteristics.


In essence, I think the Crawford’s argument on Interactivity as ‘Conversation’ makes total sense, but lacks machine learning’s ability to improve it’s ‘Listening’ and ‘Speaking’ abilities to customise and grow over time, resulting in a better “Conversation Companion”, which in return increases human related feelings like empathy, comfort and feelings (this of course also applies for the negative aspect as well). With that being said, currently it seems the discussion around machine learning is software based and I can only assume seeing more physical applications of hardware transformations driven by machine learning software. With that in mind, I would like to further study and research the possible applications this world opens to musical instruments, composition and conventions further down the line.

Hi I am Or, I am a director, developer and artist. My current interest in research is sound interaction, computer vision & immersive media development.

Leave a Reply

Your email address will not be published. Required fields are marked *