Deep3DFly:The Deep-learning Way to Design Fly-like Robots
"Just think about what a fly can do," says Professor Pavan Ramdya, whose lab at EPFL's Brain Mind Institute, with the lab of Professor Pascal Fua in EPFL's Institute for Computer Science, led the study. "A fly can climb across terrain that a wheeled robot would not be able to."
Flies aren't exactly endearing to humans. We rightly associate them with less-than-appetizing experiences in our daily lives. But there is an unexpected path to redemption: Robots. It turns out that flies have some features and abilities that can inform a new design for robotic systems.
"Unlike most vertebrates, flies can climb nearly any terrain," says Ramdya. "They can stick to walls and ceilings because they have adhesive pads and claws on the tips of their legs. This allows them to basically go anywhere. That's interesting also because if you can rest on any surface, you can manage your energy expenditure by waiting for the right moment to act."
It was this vision of extracting the principles that govern fly behavior to inform the design of robots that drove the development of DeepFly3D, a motion-capture system for the fly Drosophila melanogaster, a model organism that is nearly ubiquitously used across biology.
In Ramdya's experimental setup, a fly walks on top of a tiny floating ball - like a miniature treadmill - while seven cameras record its every movement. The fly's top side is glued onto an unmovable stage so that it always stays in place while walking on the ball. Nevertheless, the fly "believes" that it is moving freely.
The collected camera images are then processed by DeepFly3D, a deep-learning software developed by Semih Günel, a PhD student working with both Ramdya's and Fua's labs. "This is a fine example of where an interdisciplinary collaboration was necessary and transformative," says Ramdya. "By leveraging computer science and neuroscience, we've tackled a long-standing challenge."
What's special about DeepFly3D is that is can infer the 3D pose of the fly - or even other animals - meaning that it can automatically predict and make behavioral measurements at unprecedented resolution for a variety of biological applications. The software doesn't need to be calibrated manually and it uses camera images to automatically detect and correct any errors it makes in its calculations of the fly's pose. Finally, it also uses active learning to improve its own performance.
DeepFly3D opens up a way to efficiently and accurately model the movements, poses, and joint angles of a fruit fly in three dimensions. This may inspire a standard way to automatically model 3D pose in other organisms as well.
"The fly, as a model organism, balances tractability and complexity very well," says Ramdya. "If we learn how it does what it does, we can have important impact on robotics and medicine and, perhaps most importantly, we can gain these insights in a relatively short period of time."
MORE IN ITECHPOST
How Scars are Formed and How to Remove It
Scar formation is a result of a biological process in skin after an injury or trauma. It is formed when the dermis layer of the skin is damaged. It is our body's way to repair tissues and organs and is a natural part of the healing process. A scar tissue is composed of the same type of collagen it is replacing with. Scars lacks elasticity compared to normal tissue. There are different degrees of scarring depending on the injury the tissue is subjected to.
Reasons to Use Magento for your Ecommerce Store
There are so many eCommerce platforms out there ready to help you build your storefront it can be difficult to choose the right one. More and more companies, from Liverpool Football Club to Coca Cola, are using Magento hosting for their online storefronts, and for good reason.
NASA Unveils New High-Tech Spacesuit for Artemis Mission
NASA is spending people on the moon again for the Artemis mission, and they have unveiled new spacesuits for it.
Fortnite Chapter 2 is Finally Here; Massive Changes Take Game to an Entirely New Level
Fortnite Chapter 2 competes with Call of Duty Mobile and the updated PUBG Mobile with some massive changes that take the Fortnite gaming experience to the next level.
4 In-Demand Professions That Pay Well In Canada
Canada is turning out to be an emerging place for fresh graduates and skilled people looking for jobs. Every year the ratio of unemployed people for every job keeps decreasing. This decline in the ratio is accredited to a lot of skilled professionals recently moving to Canada, more job vacancies and more opportunities.