A new generation of AI-enabled tools for accessible, personalised media experiences
en-GBde-DEes-ESfr-FR

A new generation of AI-enabled tools for accessible, personalised media experiences


Scientists from the University of Surrey are teaching artificial intelligence models to re-light different body types and clothing without the need for 3D modelling. This may have a positive impact on the film, television and gaming industries in the near future.

Current AI approaches to re-lighting people often require a geometric 3D model to be created in the form of triangle meshes or point clouds before the correct shadowing effects can be applied. This new model, in contrast, only requires 2D images of people, as well as the changes in lighting, to allow the proposed technique to render self-shadowing effects.

Farshad Einabadi, a senior researcher at the University of Surrey's Centre for Vision, Speech and Signal Processing (CVSSP), said:

"This AI4ME project is a great example of how AI can be used to help increase the accessibility and realism of compositing techniques in film and TV by teaching computer models what human body types, articulations and clothing look like in different lighting settings without relying on time consuming and expensive 3D modelling. It allows an alternative approach to (re)lighting actors and presenters.

"We can considerably reduce the time and cost needed to render (re-light) full-body human images by training AI models on how to adapt to different lighting, body type, and clothing scenarios. This research and its findings should be useful, for example, for studios to augment their green screens production pipelines."

Professor Adrian Hilton, the Director of the Surrey Institute for People-Centred AI, said:

"AI4ME's research is pioneering a new approach using AI to enable advanced video editing of lighting and shadows, which normally requires expensive 3D modelling. This advance will impact UK creative industries, introducing a new generation of AI-enabled creative tools for film and TV production which maintain video realism, and allowing consumers affordable access to advanced creative technologies and personalised media experiences."

*This research was supported by UKRI EPSRC and BBC Prosperity Partnership AI4ME: Future Personalised Object-Based Media Experiences Delivered at Scale Anywhere EP/V038087.

Learning Self-Shadowing for Clothed Human Bodies; Farshad Einabadi, Jean-Yves Guillemaut and Adrian Hilton; Eurographics Symposium on Rendering; 10.2312/sr.20241159; July 2024
Regions: Europe, United Kingdom
Keywords: Applied science, Artificial Intelligence, Computing, Business, Culture, media & publishing

Disclaimer: AlphaGalileo is not responsible for the accuracy of news releases posted to AlphaGalileo by contributing institutions or for the use of any information through the AlphaGalileo system.

Testimonials

For well over a decade, in my capacity as a researcher, broadcaster, and producer, I have relied heavily on Alphagalileo.
All of my work trips have been planned around stories that I've found on this site.
The under embargo section allows us to plan ahead and the news releases enable us to find key experts.
Going through the tailored daily updates is the best way to start the day. It's such a critical service for me and many of my colleagues.
Koula Bouloukos, Senior manager, Editorial & Production Underknown
We have used AlphaGalileo since its foundation but frankly we need it more than ever now to ensure our research news is heard across Europe, Asia and North America. As one of the UK’s leading research universities we want to continue to work with other outstanding researchers in Europe. AlphaGalileo helps us to continue to bring our research story to them and the rest of the world.
Peter Dunn, Director of Press and Media Relations at the University of Warwick
AlphaGalileo has helped us more than double our reach at SciDev.Net. The service has enabled our journalists around the world to reach the mainstream media with articles about the impact of science on people in low- and middle-income countries, leading to big increases in the number of SciDev.Net articles that have been republished.
Ben Deighton, SciDevNet

We Work Closely With...


  • BBC
  • The Times
  • National Geographic
  • The University of Edinburgh
  • University of Cambridge
  • iesResearch
Copyright 2024 by AlphaGalileo Terms Of Use Privacy Statement