Showing posts with label Robots in Art. Show all posts
Showing posts with label Robots in Art. Show all posts

Thursday, December 29, 2016

What can robotics community learn from artists with disabilities?

The robotics community aspires to build general purpose robots that can perform complex tasks effortlessly. In reality, we see the current generation of robots struggling to do even simple tasks.

We as roboticists admire human painters that can breathe life into canvasses with few brush strokes and sculptors in whose hands a marble slab melts like butter and an stunning awe-inspiring form emerges. We sigh with envy and hope that someday our robots will be good enough to carve a recognizable shape into the marble without us writing few hundred thousand lines of code.


We often look at human hands and eyes and marvel at the ingenious “design” behind the two. Everything from the available number of degrees of freedom to highly adaptive and high resolution sensing is truly remarkable. Human hands and eyes working in tandem endow artists with impressive hand-eye coordination capabilities that enable them to perform “miracles” and create mesmerizing art.
 

We compare human hands and eyes with the “clunky” hand designs and “dumb” cameras found in robots of today and resign to the fact that with current robotic hand and vision technologies, we are not going to get too far in terms of mimicking any impressive human feat. Do we need to wait for significantly improved robot hand and perception technology to build more capable robots or can we do better with what we already have?
 

I have been recently researching art created by artists with different types of disabilities. I am developing a very different perspective on whether the current hand and eye technology limitations are holding back the robotics community.  


I recently was introduced to paintings created by artists with severe visual impairment. A good starting point is “10 Remarkable Paintings by Blind and Visually Impaired Artists”.  This work is truly inspiring. Figures 1 and 2 show two representative paintings.

Figure 1: A painting by 
John Bramblitt (Image Source: http://illusion.scene360.com/art/78311/blind-artists/)

Figure 2: A painting by Eşref Armağan (Image Source: http://esrefarmagan.com/wp-content/uploads/2013/05/24.png)

Doug Landis is paralyzed from the neck down. He holds a pen in his mouth and creates amazing drawings by controlling the pen with his mouth. His art work is called mouth art. Figure 3 shows one of his drawings.
 

Figure 3: A painting by Doug Landis (Image Source: http://www.odditycentral.com/pics/doug-landis-mouth-art.html)
These examples show that humans are able to create amazing art despite serious physical handicaps. Something magical happens in the brain and it enables the artist to create amazing art by controlling the available sensing and manipulation modalities. Many years ago Matt Mason told me that "simple hands" are capable of doing quite a bit. My recent explorations seem to support that point of view. We need to develop a better understanding of what minimal sensory and manipulation capabilities are needed to create a piece of art.  

Hopefully, this post will inspire roboticists to stop waiting for the perfect robot hands and eyes. We ought to be able to do better with what we have right now  

Saturday, September 26, 2015

Are You Ready to Dance with Robots?

The world of art plays an important role in human lives. The art mesmerizes and inspires us. It unleashes the creative energy and challenges conventional thinking. It provokes new thoughts and compels us to ask new questions. Can robots play a role in the art world?

Fictional robots have been playing prominent roles in movies for many years. Star Wars movies will not be the same without C-3PO and R2D2. The use of robots in movies enables writers to create new plots and enables actors to interact with superhuman characters.

The field of robotics has made tremendous progress. We now have truly remarkable robots. Can these real robots influence the art world?

I had an opportunity to interview Huang Yi on Thursday September 24, 2015 in the Clarice Smith Performing Arts Center. He is one of the pioneers of a new form of dance. His partner is a Kuka robot!



Kogod Theater Stage (Photograph by Rebecca Copeland) 
He currently uses a large intimidating orange Kuka robot in his performances. He said that he liked the Kuka robot because of its form. He programs his “dance partner” to glide through a space in harmony with music. Huang Yi and the robot move in unison during the performance and are able to express emotions to complement and augment the ambiance created by the music. His thought provoking performance asks us to examine the relationship between humans and robots.


Huang Yi's Dance Partner
(Photograph by Rebecca Copeland)
Huang Yi likes the complete predictability of the robot moves. It makes the dance safe and enables him to keep the tempo high without worrying about the need to constantly watch the robot. Currently it takes him ten hours of programming to create one minute of performance.

I wonder how this form of dance will change as robots become more intelligent and safe? Safety will encourage many more people to explore dancing with robots. Intelligence will enable robots to react to human moves and hopefully it will become easier to create new dance moves.




Huang Yi in the lab with our Kuka robots
(Photograph by Rebecca Copeland) 
Some art students in the audience seem a bit concerned about the need to learn programming to master this new art form. Hopefully advances in the area of learning from demonstrations can eliminate this barrier.

I wonder how this art form will change if we had robots that can understand the human emotions and gauge the mood expressed by the music!

What will it take for you to dance with robots?