187: Self-Driving Arm

Embedded · Feb 15, 2017 · 1h 12m

Crossing machine intelligence, robotics, and medicine, Patrick Pilarski (@patrickpilarski) is working on smart prosthetic limbs.

Build your own learning robot references: Weka Data Mining Software in Java for getting to know your data, OpenIA Gym for understanding reinforcement learning algorithms, Robotis Servos for the robot (AX is the lower priced line), and five lines of code:

pred = numpy.dot(xt,w)

delta = r + gamma*numpy.dot(xtp1,w) - pred

e = gamma*lamda*e + xt

w = w + alpha*delta*e

xt = xtp1

Patrick even made us a file (with comments and everything!).

Once done, you can enter the…