CN117237258B - Night vision image processing method, system, equipment and medium based on three-dimensional engine - Google Patents

Night vision image processing method, system, equipment and medium based on three-dimensional engine Download PDF

Info

Publication number
CN117237258B
CN117237258B CN202311507112.1A CN202311507112A CN117237258B CN 117237258 B CN117237258 B CN 117237258B CN 202311507112 A CN202311507112 A CN 202311507112A CN 117237258 B CN117237258 B CN 117237258B
Authority
CN
China
Prior art keywords
screen image
image
saturation
night vision
gray
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202311507112.1A
Other languages
Chinese (zh)
Other versions
CN117237258A (en
Inventor
朱春华
冯超亮
耿建新
姚舜宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Jerei Digital Technology Co Ltd
Original Assignee
Shandong Jerei Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Jerei Digital Technology Co Ltd filed Critical Shandong Jerei Digital Technology Co Ltd
Priority to CN202311507112.1A priority Critical patent/CN117237258B/en
Publication of CN117237258A publication Critical patent/CN117237258A/en
Application granted granted Critical
Publication of CN117237258B publication Critical patent/CN117237258B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Image Processing (AREA)

Abstract

The invention relates to the technical field of image processing, in particular to a night vision image processing method, a system, equipment and a medium based on a three-dimensional engine.

Description

Night vision image processing method, system, equipment and medium based on three-dimensional engine
Technical Field
The invention relates to the technical field of image processing, in particular to a night vision image processing method, a system, equipment and a medium based on a three-dimensional engine.
Background
The three-dimensional game engine is a software framework for developing and running games, comprises various technical processes of 3D graphics, can enhance human vision under low light conditions, is commonly used in applications such as games, virtual reality and simulated training, can provide realistic night scene effects, and enhances night vision experience of users.
In the aspect of night vision simulation, a pixel shader (loader) is commonly used for simulating the night vision effect, however, in the process of image processing by using the method, the calculation complexity is higher, the stability is poorer, the reliability of the calculation result is poorer, and the night vision simulation efficiency is low and the quality is poor.
Disclosure of Invention
The invention aims to provide a night vision image processing method, a system, equipment and a medium based on a three-dimensional engine.
The technical scheme of the invention is as follows:
a night vision image processing method based on a three-dimensional engine, comprising the following operations:
s1, acquiring a screen image, wherein the screen image is subjected to brightness enhancement processing to obtain a first screen image;
s2, acquiring a saturation minimum value of the first screen image, and acquiring a second screen image based on the saturation minimum value;
s3, creating a gray template image, wherein the gray template image and the second screen image are subjected to superposition processing to obtain a third screen image;
s4, carrying out gray processing on the third screen image to obtain a night vision simulation image.
The operation of the brightness enhancement processing in S1 specifically includes: and presetting a brightness coefficient, and based on the brightness coefficient, enhancing the intensity of a color channel at each position in the screen image to obtain the first screen image.
The operation of obtaining the second screen image based on the saturation minimum in S2 specifically includes: reducing the saturation of each position in the first screen image, wherein the reduction amplitude is equal to the minimum saturation value, and an indirect screen image is obtained; and (3) adding the saturation of each position in the indirect screen image with the minimum value of the saturation after equalization processing to obtain the second screen image.
The operation of S3 specifically includes: and presetting a contrast ratio, respectively reducing the saturation of the second screen image and the gray template image based on the contrast ratio, and obtaining the third screen image through superposition and fusion processing.
The operation of S4 specifically includes: and presetting a gray scale coefficient, and reducing the intensity of a color channel at each position in the third screen image based on the gray scale coefficient to obtain the night vision simulation image.
And (3) the gray value of the gray template image in the step (S3) is 0.5.
The color channels include a red channel, a green channel, and a blue channel.
A three-dimensional engine-based night vision image processing system, comprising:
the first screen image generation module is used for acquiring a screen image, wherein the screen image is subjected to brightness enhancement processing to obtain a first screen image;
the second screen image generating module is used for acquiring the minimum saturation value of the first screen image and obtaining a second screen image based on the minimum saturation value;
the third screen image generating module is used for creating a gray template image, and the gray template image and the second screen image are subjected to superposition processing to obtain a third screen image;
and the night vision simulation image generation module is used for obtaining a night vision simulation image through gray processing of the third screen image.
A night vision image processing device based on a three-dimensional engine comprises a processor and a memory, wherein the processor realizes the night vision image processing method when executing a computer program stored in the memory.
A computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the night vision image processing method described above.
The invention has the beneficial effects that:
according to the night vision image processing method based on the three-dimensional engine, the screen image of the three-dimensional engine camera is obtained, the minimum saturation acceptable for human eyes is obtained after the overall brightness of the screen image is enhanced, the first screen image is processed based on the minimum saturation, the first screen image is overlapped and fused with the preset gray template image to obtain the third screen image, the weighted average value of all color channels at each position in the third screen image is used as the gray value of the gray level image to obtain a night vision simulation image with good night vision effect, and the night vision effect is more vivid through simulating night illumination conditions and color adjustment.
Detailed Description
The embodiment provides a night vision image processing method based on a three-dimensional engine, which comprises the following operations:
s1, acquiring a screen image, wherein the screen image is subjected to brightness enhancement processing to obtain a first screen image;
s2, acquiring a saturation minimum value of the first screen image, and acquiring a second screen image based on the saturation minimum value;
s3, creating a gray template image, wherein the gray template image and the second screen image are subjected to superposition processing to obtain a third screen image;
s4, carrying out gray processing on the third screen image to obtain a night vision simulation image.
S1, acquiring a screen image, and performing brightness enhancement processing on the screen image to obtain a first screen image.
Acquiring a rendering picture of a three-dimensional engine camera, and then performing image sampling on the rendering picture to acquire a colored screen image M 0 And (R, G, B), presetting a brightness coefficient, and enhancing the intensity of a color channel at each position in the screen image based on the brightness coefficient to obtain a first screen image. The color channels include a red color channel, a green color channel, and a blue color channel.
The operation of obtaining the first screen image may be achieved by the following formula: m=m 0 ·L 1 M is the first screen image, L 1 For the brightness coefficient, L 1 Greater than 0.
S2, acquiring the minimum saturation value of the first screen image, and acquiring a second screen image based on the minimum saturation value.
And calculating the saturation value at each position in the first screen image, and obtaining the minimum saturation value acceptable to human eyes. The operation of obtaining the saturation minimum can be achieved by the following formula: l (L) s =min(M r ·0.30+M g ·0.59+M b ·0.11),L s At the lowest saturation value, M r For red channel intensity at a location in the first screen image, M g For the intensity of the green channel at a location in the first screen image, M b For the blue channel intensity at a certain position in the first screen image, 0.30, 0.59, 0.11 are the first red channel coefficient, the first green channel coefficient, and the first blue channel coefficient, respectively.
Based on the saturation minimum, the operation of obtaining the second screen image is as follows: reducing the saturation of each position in the first screen image, wherein the reduction amplitude is equal to the minimum saturation value, and an indirect screen image is obtained; and (3) adding the saturation of each position in the indirect screen image with the minimum value of the saturation after the balance processing to obtain a second screen image. The balancing processing is performed by presetting a saturation coefficient, multiplying the saturation of the image at each position in the indirect screen image by the saturation coefficient, and adding the multiplied saturation with the minimum value of the saturation to obtain a second screen image. The saturation coefficient may be a specific value or may be a data matrix corresponding to the pixel position of the image.
Based on the saturation minimum, the operation of obtaining the second screen image may be achieved by the following formula: m is M f1 =(1-C 1 )·Ls+ C 1 ·M,M f1 For the second screen image, ls is the saturation minimum, C 1 And M is a first screen image, and is a saturation coefficient.
S3, creating a gray template image, and overlapping the gray template image and the second screen image to obtain a third screen image.
And presetting a contrast ratio, respectively reducing the saturation of the second screen image and the gray template image based on the contrast ratio, and obtaining a third screen image through superposition and fusion processing. Wherein, the gray value of the gray template image is 0.5.
The operation of obtaining the third screen image may be achieved by the following formula: m is M f2 =(1- C 2 )·M z + C 2 ·M f1 ,M f2 C is the third screen image 2 For contrast ratio, M z (0.5,0.5,0.5) Gray template image, M f1 Is a second screen image.
S4, carrying out gray processing on the third screen image to obtain a night vision simulation image.
And the intensity of the color channel at each position in the third screen image is subjected to weighted average processing to obtain a night vision simulation image. The operation of obtaining the night vision simulation image can be realized through the following formula: gray=m f2r ·0.299+ M f2g ·0.587+ M f2b ·0.114,Mf=(Gray, Gray, Gray),M f The Gray value obtained by weighting and averaging is the night vision analog image and Gray, M f2r For the red channel at a certain position in the third screen image, M f2g Is the green channel at a certain position in the third screen image, M f2b For the blue channel at a certain position in the third screen image, 0.2999, 0.587, 0.114 are red channel gray scale weight, green channel gray scale weight, and blue channel gray scale weight, respectively.
The embodiment also provides a night vision image processing system based on a three-dimensional engine, which comprises:
the first screen image generation module is used for acquiring a screen image, and the screen image is subjected to brightness enhancement processing to obtain a first screen image;
the second screen image generating module is used for acquiring the minimum saturation value of the first screen image and acquiring the second screen image based on the minimum saturation value;
the third screen image generating module is used for creating a gray template image, and the gray template image and the second screen image are subjected to superposition processing to obtain a third screen image;
and the night vision simulation image generation module is used for obtaining a night vision simulation image through gray processing of the third screen image.
The embodiment also provides night vision image processing equipment based on the three-dimensional engine, which comprises a processor and a memory, wherein the processor realizes the night vision image processing method when executing the computer program stored in the memory.
The present embodiment also provides a computer-readable storage medium storing a computer program, wherein the computer program implements the night vision image processing method described above when executed by a processor.
According to the night vision image processing method based on the three-dimensional engine, the screen image of the three-dimensional engine camera is obtained, after the overall brightness of the screen image is enhanced, the minimum saturation acceptable to human eyes is obtained, based on the minimum saturation, the first screen image is processed, and then the first screen image is overlapped and fused with the preset gray template image to obtain the third screen image, the weighted average value of all color channels at each position in the third screen image is used as the gray value of the gray map, and the night vision simulation image with good night vision effect is obtained.

Claims (8)

1. A night vision image processing method based on a three-dimensional engine, comprising the following operations:
s1, acquiring a screen image, wherein the screen image is subjected to brightness enhancement processing to obtain a first screen image;
s2, acquiring a saturation minimum value of the first screen image, and acquiring a second screen image based on the saturation minimum value;
the operation of obtaining the second screen image based on the saturation minimum value specifically comprises the following steps: reducing the saturation of each position in the first screen image, wherein the reduction amplitude is equal to the minimum saturation value, and an indirect screen image is obtained; the saturation of each position in the indirect screen image is added with the minimum value of the saturation after being subjected to equalization treatment, so that the second screen image is obtained; the operation of the equalization process is as follows: presetting a saturation coefficient, multiplying the saturation of pixels at each position in the indirect screen image by the saturation coefficient, and adding the multiplied saturation with the saturation minimum to obtain the second screen image;
s3, creating a gray template image, wherein the gray template image and the second screen image are subjected to superposition processing to obtain a third screen image;
the method comprises the following steps: presetting a contrast ratio, respectively reducing the saturation of the second screen image and the gray template image based on the contrast ratio, and obtaining the third screen image through superposition and fusion processing;
s4, carrying out gray processing on the third screen image to obtain a night vision simulation image.
2. The night vision image processing method according to claim 1, wherein the operation of the brightness enhancement processing in S1 is specifically:
and presetting a brightness coefficient, and based on the brightness coefficient, enhancing the intensity of a color channel at each position in the screen image to obtain the first screen image.
3. The night vision image processing method according to claim 1, wherein the operation of S4 is specifically:
and presetting a gray scale coefficient, and reducing the intensity of a color channel at each position in the third screen image based on the gray scale coefficient to obtain the night vision simulation image.
4. The night vision image processing method of claim 1, wherein the gray scale value of the gray template image in S3 is 0.5.
5. A night vision image processing method as claimed in claim 2 or 3, wherein the color channels comprise a red channel, a green channel and a blue channel.
6. A three-dimensional engine-based night vision image processing system, comprising:
the first screen image generation module is used for acquiring a screen image, and the screen image is subjected to brightness enhancement processing to obtain a first screen image;
the second screen image generating module is used for acquiring the saturation minimum value of the first screen image and obtaining a second screen image based on the saturation minimum value; the operation of obtaining the second screen image based on the saturation minimum value specifically comprises the following steps: reducing the saturation of each position in the first screen image, wherein the reduction amplitude is equal to the minimum saturation value, and an indirect screen image is obtained; the saturation of each position in the indirect screen image is added with the minimum value of the saturation after being subjected to equalization treatment, so that the second screen image is obtained; the operation of the equalization process is as follows: presetting a saturation coefficient, multiplying the saturation of pixels at each position in the indirect screen image by the saturation coefficient, and adding the multiplied saturation with the saturation minimum to obtain the second screen image;
the third screen image generating module is used for creating a gray template image, and the gray template image and the second screen image are subjected to superposition processing to obtain a third screen image; the method comprises the following steps: presetting a contrast ratio, respectively reducing the saturation of the second screen image and the gray template image based on the contrast ratio, and obtaining the third screen image through superposition and fusion processing;
and the night vision simulation image generation module is used for obtaining a night vision simulation image through gray processing of the third screen image.
7. A night vision image processing device based on a three-dimensional engine, comprising a processor and a memory, wherein the processor implements the night vision image processing method according to any one of claims 1-5 when executing a computer program stored in the memory.
8. A computer-readable storage medium for storing a computer program, wherein the computer program, when executed by a processor, implements the night vision image processing method according to any one of claims 1-5.
CN202311507112.1A 2023-11-14 2023-11-14 Night vision image processing method, system, equipment and medium based on three-dimensional engine Active CN117237258B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311507112.1A CN117237258B (en) 2023-11-14 2023-11-14 Night vision image processing method, system, equipment and medium based on three-dimensional engine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311507112.1A CN117237258B (en) 2023-11-14 2023-11-14 Night vision image processing method, system, equipment and medium based on three-dimensional engine

Publications (2)

Publication Number Publication Date
CN117237258A CN117237258A (en) 2023-12-15
CN117237258B true CN117237258B (en) 2024-02-09

Family

ID=89093344

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311507112.1A Active CN117237258B (en) 2023-11-14 2023-11-14 Night vision image processing method, system, equipment and medium based on three-dimensional engine

Country Status (1)

Country Link
CN (1) CN117237258B (en)

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101303733A (en) * 2008-05-26 2008-11-12 东华大学 Method for viewing natural color at night with sense of space adopting pattern database
CN103034986A (en) * 2012-11-29 2013-04-10 奇瑞汽车股份有限公司 Night vision image enhancement method based on exposure fusion
CN104182947A (en) * 2014-09-10 2014-12-03 安科智慧城市技术(中国)有限公司 Low-illumination image enhancement method and system
CN105046663A (en) * 2015-07-10 2015-11-11 西南科技大学 Human visual perception simulation-based self-adaptive low-illumination image enhancement method
CN107358572A (en) * 2017-07-12 2017-11-17 杭州字节信息技术有限公司 A kind of ambient light adaptive approach of modified based on tactical information terminal
CN107633498A (en) * 2017-09-22 2018-01-26 成都通甲优博科技有限责任公司 Image dark-state Enhancement Method, device and electronic equipment
CN109543523A (en) * 2018-10-18 2019-03-29 安克创新科技股份有限公司 Image processing method, device, system and storage medium
CN111711808A (en) * 2020-07-28 2020-09-25 中国人民解放军空军特色医学中心 Night vision imaging device
CN112255839A (en) * 2020-11-04 2021-01-22 中国电子科技集团公司第五十五研究所 Liquid crystal display method for night vision mirror simulation training
CN112541868A (en) * 2020-12-07 2021-03-23 影石创新科技股份有限公司 Image processing method, image processing device, computer equipment and storage medium
CN112884661A (en) * 2020-12-23 2021-06-01 京东方科技集团股份有限公司 Image processing apparatus, display apparatus, computer-readable storage medium, and image processing method
CN113126252A (en) * 2019-12-30 2021-07-16 安讯士有限公司 Low-light-level imaging system
CN113556526A (en) * 2021-07-18 2021-10-26 北京理工大学 RGBW filter array-based color enhancement method for color night vision equipment
CN114596236A (en) * 2020-12-04 2022-06-07 国网智能科技股份有限公司 Method and system for enhancing low-illumination image of closed cavity
CN115620583A (en) * 2022-12-19 2023-01-17 中国人民解放军空军特色医学中心 Night-vision mirror compatible visual display system and flight simulator
CN116485679A (en) * 2023-04-27 2023-07-25 深圳市即构科技有限公司 Low-illumination enhancement processing method, device, equipment and storage medium
CN116894922A (en) * 2023-07-12 2023-10-17 天津津航计算技术研究所 Night vision image generation method based on real-time graphic engine

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016183681A1 (en) * 2015-05-19 2016-11-24 Irystec Software Inc. System and method for color retargeting
US10708525B2 (en) * 2018-08-27 2020-07-07 Qualcomm Incorporated Systems and methods for processing low light images

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101303733A (en) * 2008-05-26 2008-11-12 东华大学 Method for viewing natural color at night with sense of space adopting pattern database
CN103034986A (en) * 2012-11-29 2013-04-10 奇瑞汽车股份有限公司 Night vision image enhancement method based on exposure fusion
CN104182947A (en) * 2014-09-10 2014-12-03 安科智慧城市技术(中国)有限公司 Low-illumination image enhancement method and system
CN105046663A (en) * 2015-07-10 2015-11-11 西南科技大学 Human visual perception simulation-based self-adaptive low-illumination image enhancement method
CN107358572A (en) * 2017-07-12 2017-11-17 杭州字节信息技术有限公司 A kind of ambient light adaptive approach of modified based on tactical information terminal
CN107633498A (en) * 2017-09-22 2018-01-26 成都通甲优博科技有限责任公司 Image dark-state Enhancement Method, device and electronic equipment
CN109543523A (en) * 2018-10-18 2019-03-29 安克创新科技股份有限公司 Image processing method, device, system and storage medium
CN113126252A (en) * 2019-12-30 2021-07-16 安讯士有限公司 Low-light-level imaging system
CN111711808A (en) * 2020-07-28 2020-09-25 中国人民解放军空军特色医学中心 Night vision imaging device
CN112255839A (en) * 2020-11-04 2021-01-22 中国电子科技集团公司第五十五研究所 Liquid crystal display method for night vision mirror simulation training
CN114596236A (en) * 2020-12-04 2022-06-07 国网智能科技股份有限公司 Method and system for enhancing low-illumination image of closed cavity
CN112541868A (en) * 2020-12-07 2021-03-23 影石创新科技股份有限公司 Image processing method, image processing device, computer equipment and storage medium
CN112884661A (en) * 2020-12-23 2021-06-01 京东方科技集团股份有限公司 Image processing apparatus, display apparatus, computer-readable storage medium, and image processing method
CN113556526A (en) * 2021-07-18 2021-10-26 北京理工大学 RGBW filter array-based color enhancement method for color night vision equipment
CN115620583A (en) * 2022-12-19 2023-01-17 中国人民解放军空军特色医学中心 Night-vision mirror compatible visual display system and flight simulator
CN116485679A (en) * 2023-04-27 2023-07-25 深圳市即构科技有限公司 Low-illumination enhancement processing method, device, equipment and storage medium
CN116894922A (en) * 2023-07-12 2023-10-17 天津津航计算技术研究所 Night vision image generation method based on real-time graphic engine

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
NTIRE 2023 Challenge on Night Photography Rendering;Alina Shutova等;2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW);1982-1993 *
基于图像分析的自然彩色夜视成像方法研究;谷小婧;中国博士学位论文全文数据库 (信息科技辑);第2012年卷(第06期);I138-81 *
夜视战场环境视觉传感信息采集系统设计;杨艳燕;郭红转;;计算机测量与控制;第23卷(第03期);897-899 *
视景仿真中的夜视效果研究;李斌;张健;;红外;第30期(第04期);9-13 *

Also Published As

Publication number Publication date
CN117237258A (en) 2023-12-15

Similar Documents

Publication Publication Date Title
US11076142B2 (en) Real-time aliasing rendering method for 3D VR video and virtual three-dimensional scene
US20180332222A1 (en) Method and apparatus for obtaining binocular panoramic image, and storage medium
CN108022223B (en) Tone mapping method based on logarithm mapping function blocking processing fusion
CN110248242B (en) Image processing and live broadcasting method, device, equipment and storage medium
Ledda et al. A wide field, high dynamic range, stereographic viewer
CN112446939A (en) Three-dimensional model dynamic rendering method and device, electronic equipment and storage medium
CN112419472A (en) Augmented reality real-time shadow generation method based on virtual shadow map
CN108986232A (en) A method of it is shown in VR and AR environment picture is presented in equipment
CN106558017A (en) Spherical display image processing method and system
CN111047709A (en) Binocular vision naked eye 3D image generation method
EP4261784A1 (en) Image processing method and apparatus based on artificial intelligence, and electronic device, computer-readable storage medium and computer program product
CN106709888B (en) A kind of high dynamic range images production method based on human vision model
CN109427041A (en) A kind of image white balance method and system, storage medium and terminal device
CN117237258B (en) Night vision image processing method, system, equipment and medium based on three-dimensional engine
Majumder et al. Computer graphics optique: Optical superposition of projected computer graphics
CN116310005A (en) Holographic cabinet, dynamic virtual image video processing method and image processing method
CN106910240B (en) Real-time shadow generation method and device
CN109410308A (en) Image processing method and device, electronic equipment, computer readable storage medium
CN104581196A (en) Video image processing method and device
CA3103562C (en) Method and system for generating an augmented reality image
CN108900825A (en) A kind of conversion method of 2D image to 3D rendering
US20220198720A1 (en) Method and system for generating an augmented reality image
CN109859303B (en) Image rendering method and device, terminal equipment and readable storage medium
US11854121B2 (en) Water ripple effect implementing method and apparatus, electronic device, and computer readable storage medium
US20240054619A1 (en) Differently correcting images for different eyes

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant