CamCyclopedia
Jae Kyeom Kim, Jeong Min Park, Jae Seong Choi
Content
- What is Under Display Camera (UDC)?
2. Galaxy UDC Camera
3. The new and improved Z Fold 5 UDC technology
What is Under Display Camera (UDC)?
The UDC camera structure has display pixels laid over the camera hole unlike the conventional punch hole structure, to improve the big screen immersion experience.
The top of the UDC hole is densely packed with pixels and wiring for the hole area display to work. This directly affects the camera picture quality.
This layer over the camera hole is like looking at a scenery through a mosquito net. The view through it is murky and unclear. Also, the opaque pixel structure reduces the light penetration ratio by half. The decline in penetration ratio refers to the amount of light reaching the camera sensor. The noise component worsens compared to the average camera. The below image shows how the UDC structure causes a decline in resolution (top) and an increase in noise (bottom).
Galaxy UDC Camera
The Z Fold 5 UDC has multiple software technologies to overcome the elements that cause a decline in picture quality as shown above. Introducing the two major technologies out of that below. One is High Dynamic Range Multi-frame processing technology and another is AI based better UDC resolution solution.
High Dynamic Range Multi-frame Processing
We have applied the UDC dedicated High Dynamic Range multi frame processing technology to overcome the super-saturated bright areas that form because of the noise and obscurity owing to the low penetration rate in Z Fold 5 UDC. HDR multi frame processing combines multiple frames together to take out the noise and reduce the over saturated areas.
The HDR multi frame processing technology used in UDC combines more frames than your everyday camera. Hence, the capture and processing takes quite some time, but it is crucial for modifying UDC image quality.
AI based UDC resolution modifier solution
The HDR multi-frame processing does take care of the noise and super-saturation, but we are still left with a fuzzy and low resolution image because of the pixel structure. We have additionally deployed the AI based UDC resolution modifier solution to resolve this, which works after the multi frames get processed in Z Fold 5 UDC.
The AI based UDC resolution modifier solution trains on datasets that combine tens of thousands of UDC images and images taken by the normal camera, and provides an optimized resolution corrected performance in the Z Fold 5 UDC structure.
Z FOLD 5 UDC has dramatically reduced the image quality difference with a traditional camera output in diverse indoor and outdoor environments by the application of cutting edge image processing technologies like HDR multi-frame processing, AI based UDC resolution modifier solution, etc.
Preview and Video
Preview and video requires real-time image processing for modifying the UDC resolution (process 30 frames/second). The Z Fold 5 this time has made quite a few image quality improvements applying the real time AI based resolution modifier solution. You will see glare-free and resolution improved previews and videos, and also see better noise removal with the application of AI based denoising technology.
The super saturation for lighter areas in photos may get worse depending on the environment, given the performance limitations of the real-time solution.
The new and improved Z Fold 5 UDC technology
We have developed and applied diverse technologies to the Z Fold 5 UDC allowing you to take livelier photos now. Allow us to introduce two of the core technologies out of that, i.e. the AI based denoising technology and the UDC distortion correction technology.
AI based UDC Noise Alleviation Technology
We have made use of a more advanced denoising technology in the Z Fold 5 UDC than the noise removal technology used before.
We have developed the AI denoising technology that trains on tens of thousands of UDC specific noise data and circumvents the drawback of the UDC structure that generates more noise than an everyday camera, given its positioning under the pixel hole and a low penetration rate.
Z Fold 5 UDC employs this technology to detect noise in various environments and adjusts the denoising level before generating the image.
UDC Distortion Correction Technology
Z Fold 5 UDC applies the UDC distortion correction technology to output clearer photos.
We have developed and applied the distortion correction technology that reflects the properties of the UDC hardware, to correct the decline in resolution brought on by distortion created by the physical build of the UDC display, the camera lens and their optical properties.
Z Fold 5 UDC generates pictures with much better resolution, thanks to this technology.
CamCyclopedia Index - Samsung Members
You can also access CamCyclopedia anytime by going to Community -> Category (app) -> CamCyclopedia -> “CamCyclopedia Index”.
4 Comments
