• Skip to main content
  • Skip to primary sidebar

Biz Builder Mike

You can't sail Today's boat on Yesterdays wind - Michael Noel

  • Tokenomics is not Economics – Digital CX -The Digital Transformation
  • Resume / CV – Michael Noel
  • Contact Us
  • Featured
You are here: Home / AI / Researchers From Microsoft and Delft University Propose An Artificial Intelligence (AI) Based Approach That Creates Synthetic Expression-Based Face Wrinkles

Nov 12 2022

Researchers From Microsoft and Delft University Propose An Artificial Intelligence (AI) Based Approach That Creates Synthetic Expression-Based Face Wrinkles

Synthetic data has frequently been used for a range of computer vision tasks, such as object identification, scene comprehension, eye tracking, hand tracking, and complete body analysis. However, the development of full-face synthetics for face-related machine learning has been substantially hindered by the difficulty of modeling the human skull. Although realistic digital humans have been produced for films and video games, each character typically requires much artistic time. Because of this, the synthesis of facial training data in literature has been accompanied by simplifications or a focus on specific facial features, like the area around the eyes or the hockey mask.

Due to the disparity in distributions between actual and artificial face data, generalization is difficult due to the domain gap. Because of this, it is believed that synthetic data cannot wholly replace real data for jobs that must be performed in the field. Domain adaptation and adversarial domain training, where models are urged to ignore domain differences, have been the essential methods to close this domain gap.

Procedural sampling can generate and render innovative 3D faces at random without human assistance. The technology does this by overcoming a significant scaling limitation in the methods used by the Visual Effects (VFX) industry to synthesize lifelike individuals. By creating synthetic looks with unparalleled realism, Wood et al. aimed to directly address the issue by minimizing the domain gap at the source. Their approach procedurally blends a parametric 3D face model with a vast collection of excellently crafted elements from artists, such as textures, hair, and apparel.

Machine learning algorithms trained on the synthetic data for landmark localization and face parsing achieved performance on par with the state-of-the-art without employing a single genuine image. However, one drawback of this technique is the absence of dynamic, expression-dependent wrinkles. In this paper, they provide an easy-to-use but efficient plan for implementing expression-based wrinkles. The method creates textures only from neutral-expression scans, which stay static during all expression-related deformations of the underlying face geometry.

Their main goal is to use high-resolution scans of posed faces to extract intricate wrinkling effects for identification. To store these potential wrinkles, they create wrinkle maps for albedo and displacement textures. They mix the crease and neutral surfaces during synthesis for any expression other than those depicted in the source scans, utilizing the tension in the face mesh to create dynamic wrinkling effects.

Animations are also a part of the Supplementary Material. Early VFX techniques initially utilized wrinkle maps to describe artist-defined bumps or normal maps for imitating dynamic wrinkles. These strategies, however, have three flaws. First, the shadows and silhouettes, essential for face-related tasks like landmark localization, are unaltered and imitate changes in underlying geometry. Second, neither the approaches impact the diffuse textures nor the albedo. Scale is the last and most significant flaw.

The techniques involve manually creating wrinkle maps and masks for each character’s blendshape. In contrast, their automated mesh-tension-driven approach incorporates genuine wrinkles for albedo and displacement textures from scans and organically grows with the number of identities and expressions. Additionally, they manage identities without expression scans by copying believable wrinkles from the most comparable neutral textures.

They make the following specific contributions to further the development of synthetics for face-related tasks:

  • A readily scalable system with growing identities and expressions for dynamic, expression-based wrinkles.
  • An empirical comparison of surface-normal estimation and face key point localization performance vs. the SOTA synthetics system.
  • New assessment measures and data for locating critical points in the area of the eye where wrinkles are significant for learning activities
This Article is written as a research summary article by Marktechpost Staff based on the research paper 'Mesh-Tension Driven Expression-Based Wrinkles for Synthetic Faces'. All Credit For This Research Goes To Researchers on This Project. Check out the paper and project.
Please Don't Forget To Join Our ML Subreddit



Aneesh Tickoo is a consulting intern at MarktechPost. He is currently pursuing his undergraduate degree in Data Science and Artificial Intelligence from the Indian Institute of Technology(IIT), Bhilai. He spends most of his time working on projects aimed at harnessing the power of machine learning. His research interest is image processing and is passionate about building solutions around it. He loves to connect with people and collaborate on interesting projects.


Written by Aneesh Tickoo · Categorized: AI · Tagged: AI

Primary Sidebar

https://youtu.be/Qvad1CQ9WOM

Blockchain Weekly Rebooted –

During the Blockchain Spring 2016 to 2020 I hosted Blockchain Weekly. Each week I interviewed someone who was doing interesting things in the blockchain space. At one time we had 29k subscribers and we were consistently getting over 15k views a week on the channel. All of that went away during the lockdown, including the Gmail address that controlled that channel. Recently, I found some of the original videos on some old hard drives. So I’m reposting a few of the relevant ones while I am starting to shoot new Blockchain Weekly Episodes to be aired 1st quarter 2023. Please subscribe to bless the You Tube Algorithm, and allow me to let you know about any updates! Our Sponsor – https://BlockchainConsultants.io

The National Digital Assets Research and Development Agenda is still being worked on by the administration of United States Vice President Joe Biden, who is still in office. The White House Office of Science and Technology Policy (OSTP) has issued a request for information (RFI) dated January 26 and posted by the Federal Register. The […]

Search Here

Market Insights

  • Mars Hub Launches Independent Cosmos Application Chain
  • Binance Informs Customers of Upcoming Service Disruption
  • The Federal Home Loan Banks System is lending to cryptocurrency
  • Highland Europe raises €1bn fund for start-up investing despite slowdown
  • Elliott takes multibillion-dollar activist stake in Salesforce
  • Can Big Tech make livestreams safe?
  • Crypto Adoption Among Women on the Rise
  • The Importance of NFTs in the Web3 industry
  • Bybit CEO clarifies company’s exposure to Genesis
  • The Use of Blockchain in the Film Industry

Tags

AI (188) andrewchen (4) Biz Builder Mike (24) Blockchain (327) Crowd Funding (48) crowdfundinsider (2) entrepreneur (647) eonetwork (27) Front Page Featured (17) MIT AI (71) startupmindset (94) Technology (377) virtual reality (1) youngupstarts (145)
  • Twitter
  • Facebook
  • About Us
  • LinkedIn
  • ANTI-SPAM POLICY
  • Google+
  • API Terms and Conditions
  • RSS
  • Archive Page
  • Biz Builder Mike is all about New World Marketing
  • Cryptocurrency Exchange
  • Digital Millennium Copyright Act (DMCA) Notice
  • DMCA Safe Harbor Explained: Why Your Website Needs a DMCA/Copyright Policy
  • Marketing? Well, how hard can that be?
  • Michael Noel
  • Michael Noel CBP
  • Noels Law of decentralization

Copyright © 2023 · Altitude Pro on Genesis Framework · WordPress · Log in

en English
ar Arabiczh-CN Chinese (Simplified)nl Dutchen Englishtl Filipinofi Finnishfr Frenchde Germanit Italianko Koreanpt Portugueseru Russiansd Sindhies Spanishtr Turkishuz Uzbekyi Yiddishyo Yoruba