Facebook's AI Runs 5x Faster on GPUs and Now Beats Google! What Could Be Next for the Tech Giant?
Recently, a team from Facebook AI Research or FAIR has just developed a novel low-dimension design space which they call the "RegNet" that supposedly outperforms the traditional available models from Google and even runs five times faster on GPUs!
The RegNet is able to produce a simple, fast, and also versatile network and in previous experiments, it was even able to outperform Google's SOTA EfficientNet Models according to researchers in a paper titled the Designing Network Design Spaces which was published on pre-print repository ArXiv.
Facebook vs. Google
The researchers were previously aiming for "interpretability and to discover general design principles," explaining that it would describe networks that are really simple, work well, and are also capable of being generalized across the whole settings.
The Facebook AI team behind this has conducted controlled comparisons of their network to EfficientNet with no training-time for further enhancements and under the very same training setup. Back in 2019, Google's previous EfficientNet was using a combination of the NAS and also the model scaling rules and also represented the current SOTA.
With the comparable training settings and Flops, RegNet models actually outperformed the EfficientNet models while being up to 5 times faster on GPUs!
Instead of designing as well as developing different networks, the team keenly focused on designing actual network design spaces which compromise of huge and possibly infinite populations of model architectures. Analyzing the whole RegNet design space also provided the researchers with other unexpected insights into the network design.
What the team found
The team had noticed that, for, example, the depth of the best models is stable across the compute regimes with an optimal depth of 20 blocks or about 60 layers. According to the paper, "while it is common to see modern mobile networks employ inverted bottlenecks, researchers noticed that using inverted bottlenecks degrade performances" which points out that the best models do not actually use either bottlenecks or inverted bottlenecks.
The Facebook AI Research team has just recently developed a tool that tricks the whole facial recognition system into wrongly identifying a person in a certain video. The whole de-identification system, which works well in live videos, actually uses machine learning in order to change certain key features of a subject in a video.
FAIR is known as an advancing state-of-the-art in artificial intelligence through the use of fundamental and applied research in open collaboration with the community. This social networking giant even created the Facebook AI Research group way back in 2014 to advance the entire state of AI technology through open research for the benefit of all.
Ever since then, FAIR has grown even into international research organizations with labs all over Menlo Park, Montreal, Paris, Seattle, Tel Aviv, New York, London, and Pittsburgh. Facebook seems to be getting even better with its AI technology and with the help of FAIR, they have already beaten Google!
Buildots Raises $16 Million as It Brings AI Computer Vision to Construction Management
Buildots uses hardhat-mounted 360° cameras to seamlessly determine the exact status of an ongoing project and provides invaluable insight to contractors.
Facebook Group Against Face Masks Suspended For Spreading Coronavirus Misinformation
The Facebook group Unmasking America had almost ten thousand members before Facebook suspended the group for spreading misinformation about COVID-19.
5 Reasons Why Android OS Is Better Than IOS
Apple and Google will always have its patrons. But for those who simply want a device that suits their needs the choice between an Android device or an iOS device can be a difficult one. Let's make it easier for you: Android
This New Artificial Intelligence Can Determine The Orbits of Planets Faster Than Traditional Methods
There is a new AI that uses an algorithm that seems to be better than what researchers are using right now.
Best Microphones for Meetings: Perfect for Zoom, Skype, Google Hangouts, and More
Zoom? Skype? Google Hangouts? Here are the best microphones for meetings.
Hold Better Meetings: Microsoft Team's 'Together Mode' Lets You Be In The Room Where It Happens
The software giant has been working on a new 'Together Mode' for Teams ever since the COVID-19 pandemic began, and it's designed to create a virtual live avatar of yourself that's supposed to help you better engage with meetings
MORE IN ITECHPOST
At-Risk Mental Health for Students: Developing Resilience Among Students amid the Coronavirus Pandemic
At-Risk Mental Health for Students to help students struggling with their mental health, especially now amid the pandemic. It focuses more on developing students' resilience.
Tech Leaders and Health Authorities Join Forces, Launch New Initiative to Help Fight Pandemic and Future Epidemics
Two contact tracing apps have been successfully launched recently in Canada and Ireland. The open-source code underlying these apps has been contributed to a newly launched initiative to help other countries and U.S. states in the fight against the pandemic.
Fairy Tail Game Releases a Season Pass, a Week After It Was Launched
The anime RPG Fairy Tail from Koei Tecmo has just released a season pass that will release additional characters and content into the game, just a week after it was launched.