Google brings cross-platform AI pipeline framework MediaPipe to the web

Roughly a year ago, Google open-sourced MediaPipe, a framework for building cross-platform AI pipelines consisting of fast inference and media processing (like video decoding). Basically, it’s a quick and dirty way to perform object detection, face detection, hand tracking, multi-hand tracking, hair segmentation, and other such tasks in a modular fashion, with popular machine learning frameworks like Google’s own TensorFlow and TensorFlow Lite. MediaPipe could previously be deployed to desktop, mobile devices running Android and iOS, and edge devices like Google’s Coral hardware family, but it’s increasingly making its way to the web courtesy WebAssembly, a portable binary code format for executable programs, and XNNPack ML Inference Library, an optimized collection of floating-point AI inference operators.

Spotlight

Spotlight

Related News

Technologies

The YES Network and MSG Networks Form Gotham Advanced Media and Entertainment (GAME), a New Technology

PR Newswire | January 05, 2024

The YES Network ("YES") and MSG Networks ("MSGN") today announced that they have formed Gotham Advanced Media and Entertainment ("GAME"), a new 50/50 joint venture to capitalize on technical and operational synergies associated with YES' and MSGN's streaming services. GAME will also offer turn-key digital content distribution services, including platform technology, operational support and comprehensive data analytics to third parties, utilizing the combined technical and operational expertise each company has garnered from the respective successful launch and operation of the YES App and MSG+. "As we continue to capitalize on the momentum created by YES' award-winning digital offerings, we look forward to collaborating with MSG Networks to further elevate the fan experience," said Jon Litner, CEO of the YES Network. "With the launch of GAME, we are excited to develop new product offerings, and premium features and functionality, to serve audiences like never before, while also providing a scalable tech solution for third-party content owners seeking to deliver state-of-the-art streaming experiences to their customers." Andrea Greenberg, President and Chief Executive Officer of MSG Networks, said: "This joint venture with YES will combine the streaming expertise of two of the largest regional sports networks in the country. With the formation of GAME, we seek to marry our collective insight, expertise and best-in-class technology not only to explore enhancements to our own products, but also to offer other networks, teams and sports properties an efficient way to launch a state-of-the-art streaming service. We are excited to partner with YES to create solutions for third-party content providers looking for a seamless way to reach new audiences." GAME expects that its potential clients would benefit from a broad range of world-class streaming services, all of which would be be run centrally by an expert staff experienced in live sports streaming. Streaming products will be customizeable and capable of delivering locally branded customer experiences, each catering to a client's particular needs. More information on GAME is available at {GothamAdvanced.com). To contact GAME directly please email {info@GothamAdvanced.com.} About YES Network The YES Network, the most-watched regional sports network in the country, owns the exclusive regional media rights of the 27-time World Champion New York Yankees, the Brooklyn Nets and the New York Liberty. YES, which has earned 146 Emmy Awards since its 2002 launch, also televises original biography, interview and magazine programs, college sports and Manchester City and AC Milan soccer. YES made the list of Forbes' top 10 most valuable sports business brands in the world for nine straight years. YES launched the YES App in March 2021 for authenticated users in its regional coverage territory, and it quickly became the #1 free sports app in the Apple App Store. Direct-to-consumer access to the YES Network has been available through the YES App since March 2023. In addition to providing fans with a live stream of the YES Network, the YES App features customizable push notifications, personalized content, game highlights, and app-exclusive original sports and lifestyle programming. It has won two New York Emmy Awards in its first two years of eligibility. About MSG Networks MSG Networks, a pioneer in sports media, owns and operates two award-winning regional sports and entertainment networks (MSG and MSG Sportsnet) and MSG+, a direct-to-consumer and authenticated streaming service, that serve the nation's number one media market, the New York DMA, as well as other portions of New York, New Jersey, Connecticut and Pennsylvania. The networks feature a wide range of compelling sports content, including exclusive live local games and other programming of the New York Knicks, New York Rangers, New York Islanders, New Jersey Devils and Buffalo Sabres, as well as significant coverage of the New York Giants and Buffalo Bills. This content, in addition to a diverse array of other sporting events and critically acclaimed original programming, has established MSG Networks as the gold standard in regional sports. MSG Networks is part of the Sphere Entertainment Co. (NYSE: SPHR). MSG+ launched in June 2023, and was the first Regional Sports Network to offer single game purchases. MSG+ offers fans access to all MSG-produced programming included on the networks in their area on a monthly or annual basis as well, and is available at no additional charge to subscribers of participating pay television providers of MSG Networks.

Read More

Solutions

Sphere studios and stmicroelectronics reveal new details on the world's largest cinema image sensor

PR Newswire | January 12, 2024

Sphere Entertainment Co. revealed new details on its work with STMicroelectronics a global semiconductor leader serving customers across the spectrum of electronics applications, to create the world's largest image sensor for Sphere's Big Sky camera system. Big Sky is the groundbreaking, ultra-high-resolution camera system being used to capture content for Sphere, the next-generation entertainment medium in Las Vegas. Inside the venue, Sphere features the world's largest, high-resolution LED screen which wraps up, over, and around the audience to create a fully immersive visual environment. To capture content for this 160,000 sq. ft., 16K x 16K display, the Big Sky camera system was designed by the team at Sphere Studios – the in-house content studio developing original live entertainment experiences for Sphere. Working with Sphere Studios, ST manufactured a first-of-its-kind, 18K sensor capable of capturing images at the scale and fidelity necessary for Sphere's display. Big Sky's sensor – now the world's largest cinema camera sensor in commercial use – works with the world's sharpest cinematic lenses to capture detailed, large-format images in a way never before possible. "Big Sky significantly advances cinematic camera technology, with each element representing a leap in design and manufacturing innovation," said Deanan DaSilva, lead architect of Big Sky at Sphere Studios. "The sensor on any camera is critical to image quality, but given the size and resolution of Sphere's display, Big Sky's sensor had to go beyond any existing capability. ST, working closely with Sphere Studios, leveraged their extensive expertise to manufacture a groundbreaking sensor that not only expands the possibilities for immersive content at Sphere, but also across the entertainment industry." "ST has been on the cutting edge of imaging technology, IP, and tools to create unique solutions with advanced features and performance for almost 25 years," said Alexandre Balmefrezol, Executive Vice President and Imaging Sub-Group General Manager, STMicroelectronics. "Building a custom sensor of this size, resolution, and speed, with low noise, high dynamic range, and seemingly impossible yield requirements, presented a truly novel challenge for ST – one that we successfully met from the very first wafer out of our 12" (300mm) wafer fab in Crolles, France." As a leader in the development and manufacturing of image sensors, ST's imaging technologies and foundry services cater to a wide range of markets, including professional photography and cinematography. Big Sky's 316-megapixel sensor is almost 7x larger and 40x higher resolution than the full-frame sensors found in high-end commercial cameras. The die, which measures 9.92cm x 8.31cm (82.4 cm2), is twice as large as a wallet-sized photograph, and only four full die fit on a 300mm wafer. The system is also capable of capturing images at 120 fps and transferring data at 60 gigabytes per second. Big Sky also allows filmmakers to capture large-format images from a single camera without having to stitch content together from multiple cameras – avoiding issues common to stitching including near distance limitations and seams between images. Ten patents and counting have been filed by Sphere Studios in association with Big Sky's technology. Darren Aronofsky's Postcard from Earth, currently showing at Sphere as part of The Sphere Experience, is the first cinematic production to utilize Big Sky. Since its debut, Postcard from Earth has transported audiences, taking them on a journey spanning all seven continents, and featuring stunning visuals captured with Big Sky that make them feel like they have traveled to new worlds without leaving their seats in Las Vegas. More information about The Sphere Experience is available at thesphere.com. For visual assets, please click here. About Sphere Entertainment Co. Sphere Entertainment Co. (NYSE: SPHR) is a premier live entertainment and media company. The Company includes Sphere, a next-generation entertainment medium powered by cutting-edge technologies to redefine the future of entertainment. The first Sphere venue opened in Las Vegas in September 2023. In addition, the Company includes MSG Networks, which operates two regional sports and entertainment networks, MSG Network and MSG Sportsnet, as well as a direct-to-consumer and authenticated streaming product, MSG+, delivering a wide range of live sports content and other programming. More information is available at sphereentertainmentco.com. About STMicroelectronics: At ST, we are over 50,000 creators and makers of semiconductor technologies mastering the semiconductor supply chain with state-of-the-art manufacturing facilities. An integrated device manufacturer, we work with more than 200,000 customers and thousands of partners to design and build products, solutions, and ecosystems that address their challenges and opportunities, and the need to support a more sustainable world. Our technologies enable smarter mobility, more efficient power and energy management, and the wide-scale deployment of cloud-connected autonomous things. We are committed to achieving our goal to become carbon neutral on scope 1 and 2 and partially scope 3 by 2027.

Read More

Technologies

ARound and Immersal Team Up to Revolutionize Augmented Reality in Sports and Live Entertainment

PR Newswire | January 04, 2024

ARound, the pioneering shared augmented reality (AR) platform, part of Stagwell, is excited to announce a groundbreaking partnership with Immersal, leaders in spatial computing and AR localization technology, and part of Hexagon. By creating a turn-key WebAR solution for stadium AR, this partnership facilitates easier integration of shared AR experiences for teams, venues, and events, broadening the scope of interactive fan engagement. ARound and Immersal are poised to announce their inaugural collaboration with a major sports league next month, marking a significant milestone in bringing this innovative vision to life. This partnership combines ARound's connected, shared AR technology that has transformed live fan experiences for professional sports teams across three professional leagues – MLB, NBA, NFL – including the Minnesota Twins, Los Angeles Rams, Kansas City Royals, and the Cleveland Cavaliers, with Immersal's visual positioning system (VPS) that creates centimeter-accurate, large-scale indoor and outdoor AR experiences. "This partnership is a game-changer in the world of sports and live entertainment as we collaborate to make stadium AR experiences more accessible and ubiquitous to all fans and types of events," said Josh Beatty, founder and CEO, ARound. "By integrating our fan engagement platform with Immersal's robust localization technology, we can seamlessly create dynamic digital experiences that put fans at the center of the action while scaling to new audiences around the world." The integration of ARound and Immersal technologies yields greater access and broader use cases of AR experiences through WebAR, enhancing the overall quality and ease of integration for in-stadium entertainment. Fans can interact with live events in real-time, participating in AR games, accessing real-time game content, and enjoying shared experiences with fellow attendees, all from their smartphones without the need for a standalone app. Brands and sponsors will also now be able to connect with audiences in innovative, meaningful ways, enhancing their marketing mix and creating new avenues for engagement. "We're committed to innovating and enhancing AR experiences at live events and our technology, combined with ARound's exciting platform, will set a new benchmark in how fans interact with live sports and entertainment, offering them an engaging and memorable experience like never before," Matias Koski, CEO, Immersal. This groundbreaking partnership heralds a new era in fan engagement, offering sports teams, venues, and brands an unparalleled platform to connect with audiences. Combining ARound's interactive fan experiences with Immersal's precision technology, the stage is now set for a revolution in live entertainment. About ARound ARound is a first-of-its-kind stadium-level shared augmented reality platform and is part of the Stagwell Marketing Cloud, a proprietary suite of SaaS solutions built for the modern marketer. ARound keeps audiences engaged by capturing their attention through immersive, interactive and shared experiences with fellow fans across the venue. Where other AR products offer isolating, singular experiences, ARound's massive multi-user AR – which uses 3D spatial computing to localize content – redefines what it means to be part of a connected fan experience. It was the winner of Stagwell's annual innovation competition which invests in new product ideas proposed by the network's 13,000+ employees. ARound and the Stagwell Marketing Cloud are a part of Stagwell (NASDAQ: STGW), the challenger network built to transform marketing. About Immersal Immersal, part of Hexagon, is building world-leading spatial mapping and visual positioning tools — the foundation of the metaverse. Founded in 2015, Immersal's team is based in Helsinki, Finland, and working with partners, developers and creators across the globe to reimagine how we explore, interact and create. Immersal also has sales offices in Hong Kong and in Silicon Valley, California, and is expanding its presence and partner networks globally. The company was acquired by Hexagon in 2021 and continues to pursue the vision of a metaverse built and experienced by everyone on any device. Hexagon (Nasdaq Stockholm: HEXA B) has approximately 24,000 employees in 50 countries and net sales of approximately 5.2bn EUR.

Read More