Facebook's AI Runs 5x Faster on GPUs and Now Beats Google! What Could Be Next for the Tech Giant?
Recently, a team from Facebook AI Research or FAIR has just developed a novel low-dimension design space which they call the "RegNet" that supposedly outperforms the traditional available models from Google and even runs five times faster on GPUs!
The RegNet is able to produce a simple, fast, and also versatile network and in previous experiments, it was even able to outperform Google's SOTA EfficientNet Models according to researchers in a paper titled the Designing Network Design Spaces which was published on pre-print repository ArXiv.
Facebook vs. Google
The researchers were previously aiming for "interpretability and to discover general design principles," explaining that it would describe networks that are really simple, work well, and are also capable of being generalized across the whole settings.
The Facebook AI team behind this has conducted controlled comparisons of their network to EfficientNet with no training-time for further enhancements and under the very same training setup. Back in 2019, Google's previous EfficientNet was using a combination of the NAS and also the model scaling rules and also represented the current SOTA.
With the comparable training settings and Flops, RegNet models actually outperformed the EfficientNet models while being up to 5 times faster on GPUs!
Instead of designing as well as developing different networks, the team keenly focused on designing actual network design spaces which compromise of huge and possibly infinite populations of model architectures. Analyzing the whole RegNet design space also provided the researchers with other unexpected insights into the network design.
What the team found
The team had noticed that, for, example, the depth of the best models is stable across the compute regimes with an optimal depth of 20 blocks or about 60 layers. According to the paper, "while it is common to see modern mobile networks employ inverted bottlenecks, researchers noticed that using inverted bottlenecks degrade performances" which points out that the best models do not actually use either bottlenecks or inverted bottlenecks.
The Facebook AI Research team has just recently developed a tool that tricks the whole facial recognition system into wrongly identifying a person in a certain video. The whole de-identification system, which works well in live videos, actually uses machine learning in order to change certain key features of a subject in a video.
FAIR is known as an advancing state-of-the-art in artificial intelligence through the use of fundamental and applied research in open collaboration with the community. This social networking giant even created the Facebook AI Research group way back in 2014 to advance the entire state of AI technology through open research for the benefit of all.
Ever since then, FAIR has grown even into international research organizations with labs all over Menlo Park, Montreal, Paris, Seattle, Tel Aviv, New York, London, and Pittsburgh. Facebook seems to be getting even better with its AI technology and with the help of FAIR, they have already beaten Google!
Do You Regret Posts You Made On Facebook Long Ago? Here's How You Can Hide Them Easily!
Facebook's new Manage Activity settings had made it easy to hide some embarrassing posts that you probably have made many years ago. Here's how you can do it!
How to Make Music on Facebook with the New Tik-Tok Inspired App Called Collab
Facebook has an upcoming TikTok-inspired app called Collab for music makers! Here's how to use it and create your music.
Google Engineers Reveal That Their "Unsafe" Code Causes 70% of Security Vulnerability
Google engineers have revealed that 70% of security bugs could actually be because of their "unsafe" code. The company blames C and C++ coding languages.
[Video] WWE's Undertaker Literally Freezes Himself at -240 Degrees as Part of His Preparation
The Undertaker named Mark William Callaway is a feared WWE superstar and in a recent clip released on Facebook, the wrestler shows how he literally freezes himself under -240 degrees to prepare.
How to Create Your Facebook Avatar
Facebook is trying to bring back a feature that was more than popular on the previous Yahoo Messenger, the avatar! Learn how to create your own today!
MORE IN ITECHPOST
6 COVID-19 Tracing Apps Including CDC Found to be Potential Threats to Your Privacy, Investigation Reveals
6 different COVID-19 tracing apps that included the CDC's official app were found to potentially be a threat to the user's privacy. Investigation reveals the unsettling truth about the apps.
3D Concept Comparison Between Crew Dragon and Starship Size Approved by Elon Musk?
A recent 3D concept comparison has been uploaded to Twitter showcasing both the Crew Dragon and the Starship's size. Guess what, Elon Musk himself liked the post! Could this be a sign of approval?
$149.99 Xbox Elite Wireless Controller VS. PS5 Controller. Can Xbox Compete?
Will Microsoft's $14.99 Xbox Elite Wireless controller beat Sony's PS5 next-gen controller?