TECH

Engineers show off Astro the robot dog

What would you get if you combined Apple's Siri and Amazon's Alexa with Boston Dynamic's quadraped robots? You'd get "Astro," the four-legged seeing and hearing intelligent robodog.
Using deep learning and artificial intelligence (AI), scientists from Florida Atlantic University's Machine Perception and Cognitive Robotics Laboratory (MPCR) at the Center for Complex Systems and Brain Sciences at FAU's Charles E. Schmidt College of Science are bringing to life one of about a handful of these quadraped robots in the world. Astro is unique because it is the only one of these robots with a head, 3-D printed to resemble a Doberman pinscher, which contains a (computerized) brain.
Astro not only looks like a dog; he learns like one too. That's because it doesn't operate based on preprogrammed robotic automation. Instead, Astro is being trained using inputs to a deep neural network — a computerized simulation of a brain — so that he can learn from experience to perform human-like tasks, or in his case, "doggie-like" tasks, that benefit humanity. .
Equipped with sensors, high-tech radar imaging, cameras and a directional microphone, this 100-pound super robot is still a "puppy-in-training." Just like a regular dog, he responds to commands such as "sit," "stand" and "lie down." Eventually, he will be able to understand and respond to hand signals, detect different colors, understand many languages, coordinate his efforts with drones, distinguish human faces, and even recognize other dogs.
Astro information scout, Astro's key missions will include detecting guns, explosives and gun residue to assist police, the military, and security personnel. This robodog's talents won't just end there, he can also be programmed to assist a service dog for the visually impaired or to provide medical diagnostic monitoring. The MPCR team is also training Astro to serve as the first answer for search and rescue missions such as hurricane reconnaissance as well as military maneuvers.
Designed to engage and react to the world around him in real-time, this intelligent machine will be able to navigate through rough terrains and respond to dangerous situations to keep humans and animals out of harm's way. Astro will be outfitted with more than a dozen sensors that will consume environmental input across multiple modalities including optical, sound, gas and even radar. To process the sensory inputs and make autonomous behavioral decisions, a set of Nvidia Jetson TX2 graphics processing units are onboard with a combined four teraflops of computing power, which amounts to about four trillion computations a second. This robodog will be able to rapidly see and search thousands of faces in a database, smell the air to detect foreign substances, and hear and respond to distress calls that fall outside a human's audible hearing range. FAU's MPCR team will program Astro to have an extensive database of experiences that he can draw upon to help him make immediate decisions on the go.
The human brains behind Astro are a team of neuroscientists, IT experts, artists, biologists, psychologists, high school students and undergraduate and graduate students at FAU. At the helm of this project are Elan Barenholtz, Ph.D., an associate professor at FAU's Department of Psychology, co-director of FAU's MPCR laboratory, and a member of FAU's Brain Institute (I-BRAIN), one of the university's four research pillars; William Hahn, Ph.D., an assistant professor at FAU's Department of Mathematical Sciences and co-director of FAU's MPCR laboratory; and Pedram Nimreezi, director of intelligent software at FAU's MPCR laboratory, chief technology officer for RedGage and a martial arts expert.

"Our Machine Perception and Cognitive Robotics laboratory team was sought out by Drone Data's Astro Robotics group because of their extensive expertise in cognitive neuroscience, which includes behavioral, neurophysiological and embedded computational approaches to studying the brain," said Ata Sarajedini, Ph.D. , Dean of FAU's Charles E. Schmidt College of Science. "Astro is inspired by the human brain and he has come to life through machine learning and artificial intelligence, which is proving to be an invaluable resource in helping to solve some of the world's most complex problems."

by Gisele Galoustian