Loughborough’s new development captures highly accurate 3D video in real time

A development at Loughborough University, which can capture highly accurate, 3D video in real-time, could lead to significant changes across medical science and the automotive industry.

The “Robot Eyes” project, within the University’s Wolfson School of Mechanical, Electrical and Manufacturing Engineering, has seen the creation of a bespoke micro-structured optical element that, when partnered with a high-speed projector and camera, allows robots to capture the 3D shape of moving objects one hundred times faster than current commercial systems.

The advancement allows structured light patterns to be projected onto objects at very high frame rates enabling billions of 3D coordinates to be captured per second – surpassing the storage capacity of a typical DVD every second. This 3D data is displayed in real-time using GPU accelerated software.

The development, which is the brainchild of academic researchers intent on advancing the way in which robots can see and act within dynamic environments, could see changes in the way robot-assisted surgeries are carried out, whilst also providing more efficient methods for automation of manufacturing and recycling processes.

Senior Research Associate in Optical Metrology, Dr Russ Coggrave, said: “Our systems are based on the principle of projecting structured light onto the object surface, with the surface profile distorting those patterns. The images we then capture from those distorted patterns allow us to decode and extract the 3D shape of the surface.

“The technique is well-established and widely used across industrial metrology. However, existing systems are relatively slow so only help when an object is static or slow-moving. The new technology that we’ve been working on allows us to increase the acquisition rate, capturing almost a hundred million coordinates per second – which is almost a hundred times faster than existing systems. That change in speed now allows us to measure fully moving objects, giving us the opportunity to overcome current robotic and engineering challenges.”

Professor of Applied Optics and Photonics, Pablo Ruiz, said: “Currently, in robotic assisted surgery, the surgeon can use different mechanisms to the give the robot the necessary feedback. However, if you could imagine a robot that has this 3D vision, that would give it an awareness and understanding of where the beating heart is and guide the position of the scalpel or tool to the shape of the heart.”

Dr Coggrave adds the development could also provide a more efficient method in the disposal and recycling of electric car batteries: “One of the challenges with electric car batteries is what we do with them at the end of their life – for instance, are we able to recycle the materials and bring them back into the production line?

“Currently, the process is not as efficient as it could be as the robot fails to adapt accordingly to the changing shape and structure of the battery as it’s being disassembled. Non-rigid components such as cables, springs, covers and insulation can deform in unexpected ways during disassembly, and this is a significant challenge for existing automated solutions.

“However, introducing this new 3D, high speed vision system will allow the robot to react in real time to changes in the assembly by providing the machine with closed loop feedback.”

The Optical Engineering Research Group at Loughborough University has a long history in developing leading technology in this space.

Professor Ruiz says this is just another example of the real-world impact their work is having: “This technology is just one example of the real-world impact that research developed at the University is delivering. The breakthrough was achieved through a combination of expertise in structured light techniques for 3D shape measurement, and laser-based techniques such as interferometry and holography.”

“We have developed a working demonstrator and are currently exploring partnerships to address specific challenges whilst identifying routes to impact.”

Notes for editors

Press release reference number: 25/46

Loughborough is one of the country’s leading universities, with an international reputation for research that matters, excellence in teaching, strong links with industry, and unrivalled achievement in sport and its underpinning academic disciplines. 

It has been awarded five stars in the independent QS Stars university rating scheme and named the best university in the world for sports-related subjects in the 2025 QS World University Rankings – the ninth year running. 

Loughborough is ranked 6th in The UK Complete University Guide 2025, 10th in the Guardian University League Table 2025 and 10th in the Times and Sunday Times Good University Guide 2025.  

Loughborough was also named University of the Year for Sport in the Times and Sunday Times Good University Guide 2025 - the fourth time it has been awarded the prestigious title.  

Loughborough is consistently ranked in the top twenty of UK universities in the Times Higher Education’s ‘table of tables’, and in the Research Excellence Framework (REF) 2021 over 90% of its research was rated as ‘world-leading’ or ‘internationally-excellent’. In recognition of its contribution to the sector, Loughborough has been awarded seven Queen's Anniversary Prizes. 

The Loughborough University London campus is based on the Queen Elizabeth Olympic Park and offers postgraduate and executive-level education, as well as research and enterprise opportunities. It is home to influential thought leaders, pioneering researchers and creative innovators who provide students with the highest quality of teaching and the very latest in modern thinking.

Categories