Deep Learning: Anki Vector Robot Dataset

About a month ago Amitabha Banerjee has released a dataset of images on Roboflow.org showing a Vector from the camera of another Vector. This dataset can be used to train a Deep Learning setup to recognize Vector Robots. The raw version has 303 images and the reworked version has 727 processed images.

With the help of this dataset solutions can be implemented (for example in Tensorflow) to let one Vector recognize another Vector. This will become interesting especially in the moment Escape Pod will arive as we then may be able to create server based solutions that do not need to run on the robot itself. Usually the data files created by training a Deep Learning neurolan network are way too big to store them on the robot itself, so he needs the help of an external server solution.

Again I want to stress that most probably a Raspberry Pi may not be the ideal solution for an upcoming Escape Pod server, as the computational power of the otherwise great minicomputer is too small for complex deep learning-based tasks. I will use a Jetson Nano for experiments instead, it is more expensive (around 140 Euros), but way more capable for tasks like this.

6 Comments

  1. Diana

    this is unbelievably cool. He doesn’t talk about how he uploaded this program though. Is he just taking Vector’s camera feed a processing it post-facto through Google Colab? This has nothing to do with real time data he could feed back to Vector using the OSKR, I’m assuming (though foolishly still hoping for).

Leave a Reply

Your email address will not be published. Required fields are marked *