How Apple’s New Face ID Works

How Apple’s New Face ID Works Featured Image

Apple’s new Face ID technology appears only in the flagship iPhone X. This replaces Touch ID on that device, instead unlocking the phone via facial recognition. This has sparked some concern with users who have grown used to the speed and reliability of Touch ID and seen similar face recognition technologies fail. While the technology underlying Face ID isn’t new or revolutionary, Apple claims it’s implemented better than ever before.

How does Face ID work?

what-is-face-id-2

Face ID is powered by Apple’s TrueDepth camera. When the user enrolls in Face ID, this infrared camera scans their face and creates a depth map with more than 30,000 points. The iPhone X uses these points to create a mathematical model of the face and then stores that model securely. On future unlock attempts, the camera re-scans the user’s face and compares the result. If it’s sufficiently similar, the device unlocks.

With gaze detection, Face ID detects when users are looking directly at the phone. When they do, it unlocks. Otherwise, the device will remain locked. This prevents unwanted unlocking when the device is sitting near the user.

What about sunglasses, beards, and darkness?

what-is-face-id-4

The infrared light used by Face ID is invisible to humans, but it functions much the way normal light does. However, because its frequency is lower than regular light, it has a slightly easier time passing through some objects. This includes things like sunglasses which are typically balanced to block visible and ultra-violet (UV) light. This light exists at the opposite, high-frequency end of the spectrum of visible light. As a result, most sunglasses allow infrared light to pass. This permits Face ID to catch a glimpse even when sunglasses obscure your face.

The iPhone X’s much-touted A11 Bionic chip supports machine learning, allowing Face ID to adapt to changes in your appearance. If you grow a beard, cut your hair or put on glasses, Face ID should keep up with the changes. We’ll have to see how successful this feature is in practice, but if it works as advertised, that will be a major advancement in face recognition’s utility.

Infrared light also allows Face ID to work in the dark. Because the camera provides its own light source in the form of an infrared beam, the system doesn’t require external sources of light to function. It can also use the flood illuminator (basically an infrared flash) to balance and normalize lighting on your face. And because this infrared light is invisible to humans, there won’t be a bright flash. This means that, even in total darkness or uneven illumination, the iPhone X should be able to correctly identify your face.

Is Face ID secure?

what-is-face-id-1

According to Apple, Face ID avoids common spoofing attacks that made other facial unlocking systems insecure. Because it uses a depth-sensitive infrared camera, attackers can’t fool the camera with a photograph. Even three-dimensional masks were apparently unsuccessful in fooling Face ID.

While the methods of avoiding three-dimensional spoofing haven’t been released, infrared light can penetrate the skin, allowing the TrueDepth camera to scan subdermal features that would be difficult (if not impossible) for mask-makers to replicate. We can also assume that the many thousand points of facial recognition make it difficult to create a mask with sufficient fidelity to fool the TrueDepth camera.

Like Touch ID’s fingerprints, the mathematical models of recognized faces stay within the iPhone X’s Secure Enclave. They’re encrypted, inaccessible to other apps and much of the OS, let alone attackers. Recognized faces exist only on the device and are not stored on Apple’s servers or synced to iCloud. And as far as we know, Secure Enclave has yet to be compromised.

Will Face ID replace Touch ID?

According to Apple, Face ID’s error rate is 1 in 1,000,000. This means that Face ID could unlock for the wrong person once in a million attempts. Touch ID had an error rate of 1 in 50,000, making Face ID more accurate by several orders of magnitude. And just like Touch ID, Face ID can also authenticate Apple Pay. Does this mean that Face ID will replace Touch ID eventually? If it turns out to be as easy and reliable as Apple claims, it just might.

Subscribe to our newsletter!

Our latest tutorials delivered straight to your inbox

Alexander Fox Avatar

Read next

When the SS Great Eastern laid the first working transatlantic telegraph cable in 1866, a message that had taken ten days by steamship suddenly crossed the ocean in minutes, and the financial markets of London and New York were forced, within a single trading week, to invent the modern concept of synchronised global price.
Masahiro Hara and Denso engineers built the QR code in 1994 to help Toyota suppliers scan car parts from any angle, then kept the patent open until phone cameras and a 2020 pandemic turned the factory square into a daily ritual on restaurant tables
In 1965, Mary Allen Wilkes wrote LAP6 for the LINC computer from her parents’ Baltimore home, testing an interactive operating system on a 250-pound machine in the living room and becoming the first known person to use a personal computer at home, twelve years before the Apple II reached buyers
When Grace Hopper wanted to explain a nanosecond to admirals who kept asking why satellites were slow, she handed each of them a piece of wire 11.8 inches long, the exact distance light travels in a billionth of a second, and told them to keep it in their pocket as a reminder that physics, not laziness, sets the limit.
The Big Ear telescope was scanning at 1420.4056 megahertz on the night of 15 August 1977, the exact frequency at which hydrogen atoms vibrate across the universe, because Giuseppe Cocconi and Philip Morrison had argued years earlier that any species trying to be found would broadcast on that channel — and then, for 72 seconds, something did.
When Doug Wheelock came home after 163 days in space, he said he had craved the aroma of leaves, grass, flowers, and trees, the rush of Earthiness that reaches astronauts only when the hatch opens back onto the living planet
When Frank Maixner’s team reconstructed Ötzi the Iceman’s 5,300-year-old stomach bacterium in 2016, the Helicobacter pylori strain looked less like modern Europe’s hybrid form than Asian lineages common today in South and Central Asia, leaving a migration signal no pot or stone tool could have shown
When Cingular chief Stan Sigman backed the original iPhone before its 2007 unveiling, he accepted terms American carriers usually refused: no logo on the device, no control over its software, no preloaded apps, and a share of monthly subscriber revenue flowing back to Apple, after signing on without seeing a prototype