experimental result
experimental result

Accio

Accio is the incantation of summoning charm originated from our favourite book, ‘Harry Potter’. Witches uttering the spell of ‘Accio Firebolt’ would call the required broomstick to fly into their hands. Inspired by this magic, we come up with the idea of request things orally and have them delivered to us by robots. The job is designed to be accomplished as the result of collaboration of two robots, Turtlebot and Baxter.

Firstly, Turtle is told what is wanted among the 6 classes chosen. Then it goes to Baxter, and sends it the corresponding index of the desired class. After this, the deep neural network is triggered to train images and the resulting model is adapted to detect different objects appeared on the table. The process returns the coordinates of the desired object. Then Baxter grabs it by implementing inverse kinematics and puts it on Turtlebot. Turtlebot will wait until it gets the object, and then takes the object back to the commander.

To accomplish this task, we divided it into five segments, which are speech recognition, object detection, baxter manipulation, turtlebot motion as well as communication issues.