Facebook's AI Runs 5x Faster on GPUs and Now Beats Google! What Could Be Next for the Tech Giant?
Recently, a team from Facebook AI Research or FAIR has just developed a novel low-dimension design space which they call the "RegNet" that supposedly outperforms the traditional available models from Google and even runs five times faster on GPUs!
The RegNet is able to produce a simple, fast, and also versatile network and in previous experiments, it was even able to outperform Google's SOTA EfficientNet Models according to researchers in a paper titled the Designing Network Design Spaces which was published on pre-print repository ArXiv.
Facebook vs. Google
The researchers were previously aiming for "interpretability and to discover general design principles," explaining that it would describe networks that are really simple, work well, and are also capable of being generalized across the whole settings.
The Facebook AI team behind this has conducted controlled comparisons of their network to EfficientNet with no training-time for further enhancements and under the very same training setup. Back in 2019, Google's previous EfficientNet was using a combination of the NAS and also the model scaling rules and also represented the current SOTA.
With the comparable training settings and Flops, RegNet models actually outperformed the EfficientNet models while being up to 5 times faster on GPUs!
Instead of designing as well as developing different networks, the team keenly focused on designing actual network design spaces which compromise of huge and possibly infinite populations of model architectures. Analyzing the whole RegNet design space also provided the researchers with other unexpected insights into the network design.
What the team found
The team had noticed that, for, example, the depth of the best models is stable across the compute regimes with an optimal depth of 20 blocks or about 60 layers. According to the paper, "while it is common to see modern mobile networks employ inverted bottlenecks, researchers noticed that using inverted bottlenecks degrade performances" which points out that the best models do not actually use either bottlenecks or inverted bottlenecks.
The Facebook AI Research team has just recently developed a tool that tricks the whole facial recognition system into wrongly identifying a person in a certain video. The whole de-identification system, which works well in live videos, actually uses machine learning in order to change certain key features of a subject in a video.
FAIR is known as an advancing state-of-the-art in artificial intelligence through the use of fundamental and applied research in open collaboration with the community. This social networking giant even created the Facebook AI Research group way back in 2014 to advance the entire state of AI technology through open research for the benefit of all.
Ever since then, FAIR has grown even into international research organizations with labs all over Menlo Park, Montreal, Paris, Seattle, Tel Aviv, New York, London, and Pittsburgh. Facebook seems to be getting even better with its AI technology and with the help of FAIR, they have already beaten Google!
Best Microphones for Meetings: Perfect for Zoom, Skype, Google Hangouts, and More
Zoom? Skype? Google Hangouts? Here are the best microphones for meetings.
Hold Better Meetings: Microsoft Team's 'Together Mode' Lets You Be In The Room Where It Happens
The software giant has been working on a new 'Together Mode' for Teams ever since the COVID-19 pandemic began, and it's designed to create a virtual live avatar of yourself that's supposed to help you better engage with meetings
Android Users Now Have Dark Mode in G Suite Apps: Here's How to Enable It And Why It's Important
Have you wanted to have night mode on the G Suite apps? Look no further, dark mode is now coming to the G Suite apps on Android! Here's how you can enable it and why you need it.
Thanks To New Model, Artificial Intelligence Can Now Make More Ethical Decisions
A new model will be helping AI make better decisions as it seems they will now consider the ethics of what they do.
Why Should You Update Your Google Chrome? Is Microsoft Edge Better?
Now comes the hard decision, should you switch to Google Chrome or maintain Microsoft Edge? Here are a few tips to help you decide.
MORE IN ITECHPOST
Elon Musk’s Brain Microchip Neuralink Will Allegedly Cure Depression and Addiction
Elon Musk founded Neuralink in 2016, but what is the purpose of this brain-implanted computer chip? Musk has revealed additional details that you may find interesting.
Spotted in Deep Space: Never Before Seen Four Mystery Objects
A few mysterious objects that haven't been seen until now have recently been spotted in deep space thanks to massive radio telescopes.
A Leaker May Have Confirmed The Release Date Of 'Resident Evil Village'
A leaker who has been reliable in the past regarding Resident Evil may have revealed the release date of Resident Evil Village.