Introducing DeepFocus: The AI Rendering System Powering Half Dome

| December 19, 2018

article image
Earlier this year, Facebook Reality Labs (FRL) unveiled Half Dome, an industry-first prototype headset whose eye-tracking cameras, wide-field-of-view optics, and independently focused displays demonstrated the next step in lifelike VR experiences. By adjusting its displays to match your eye movements, Half Dome’s varifocal design makes every virtual object come into sharp focus. This approach showed real progress in creating a more comfortable, natural, and immersive sense of perception within VR. But to reach its full potential, Half Dome’s advanced hardware needed equally innovative software. Today, we’re sharing details about DeepFocus, a new AI-powered rendering system that works with Half Dome to create the defocus effect that mimics how we see the world in everyday life. DeepFocus is the first system able to generate this effect—which blurs the portions of the scene that the wearer isn’t currently focusing on–in a way that is realistic, gaze-contingent, and that runs in real time. We presented our research paper at the SIGGRAPH Asia conference in Tokyo this month, and we are also open-sourcing DeepFocus, including the system’s code and the data set we used to train it, to help the wider community of VR researchers incorporate blur into their work.

Spotlight

Veygo

With our Secure Media Players, Analytics, Personalization, Application Framework and Content Workflow Management Solutions, we partner with the industry leaders to design, develop and deliver compelling new multiscreen entertainment, advertising and services propositions your customers will love spending time with.28 major Studios and leading Services Providers already qualified our core technologies now hosting 17,000 masters and powering the Live and On Demand, on & off line experience of 26M consumers in 16 countries and languages.

OTHER ARTICLES

Why Shares of AMC Entertainment Are Surging Today

Article | April 28, 2020

It was just two weeks ago that it looked as if the COVID-19 pandemic would push AMC into bankruptcy, as forced theater closures shut off revenue to the world's biggest cinema operator. The company also slashed its dividend, and executives all took pay cuts to help conserve cash. Investors should still be wary, even if AMC is able to open many of its theaters sooner than the mid-June date it had been eyeing.

Read More

The Future of Tech: Gaming Consoles, the Xbox and PlayStation of Tomorrow

Article | February 10, 2020

Consoles have come a very long way since the arrival of first-generation machines from Atari and Coleco in the seventies. Even the original PlayStation (1994) and Xbox (2001) look dated compared to the 4K/HDR-capable machines of today, and that divide will grow even larger once the PlayStation 5 and Xbox Series X arrive at the end of 2020. But what about the future? More than once console makers have tried to break new ground, by focusing on functionality beyond gaming, but for the most part those attempts have failed. Nintendo has found the most success with specialized hardware that still focuses on games first, while Sony and Microsoft have seemingly understood that building powerful general purpose machines that are akin to PCs is their best and safest bet.

Read More

How to Watch Netflix in Virtual Reality

Article | April 20, 2021

Playing virtual reality video games is a blast—but it also takes work. If you simply want to kick back, relax, and experience some mind-bending visuals without thinking too much, why not try watching Netflix in VR? It's ridiculously easy to do, even if you don't have state-of-the-art equipment. There are three primary methods, depending on what kind of device you're working with: fire up the Netflix VR app on Android, set up mirroring with your iPhone, or simply download the Netflix app from your preferred Oculus device. Here's What You'll Need VR headset: No matter your budget, there's a virtual reality option for you. On the pricey end, there are sophisticated VR headsets like the Oculus Quest 2, which starts at $299, and the HTC Vive Pro Eye, which retails for $799. We've included a few other options in the gallery below, too. If you're looking for something less expensive, there's the $99 Google Daydream View system (discontinued, but you can still find them here and there), the Samsung Gear VR headset (which the manufacturer has also discontinued in the U.S., but you can find it on Amazon for $128), and the $25 Google Cardboard viewer (although you may want to purchase an additional head strap for it).

Read More

Apple to Buy NextVR from Best Virtual Reality Platforms

Article | April 5, 2020

Technology giant Apple plans to take NextVR, one of the best platforms, by showing that it continues to work on virtual reality. NextVR was transferring important events over virtual reality today. Virtual reality (VR) and augmented reality (AR) technologies will undoubtedly be among the most used technologies in the future. Studies on this subject have been going on for years, but we still have not fully seen what this technology can do. For this reason, the virtual reality industry has not matured yet today. Apple has long been working on virtual reality and augmented reality.

Read More

Spotlight

Veygo

With our Secure Media Players, Analytics, Personalization, Application Framework and Content Workflow Management Solutions, we partner with the industry leaders to design, develop and deliver compelling new multiscreen entertainment, advertising and services propositions your customers will love spending time with.28 major Studios and leading Services Providers already qualified our core technologies now hosting 17,000 masters and powering the Live and On Demand, on & off line experience of 26M consumers in 16 countries and languages.

Events