CN114598858A - Color distribution method for improving visual comfort of stereoscopic video - Google Patents

Color distribution method for improving visual comfort of stereoscopic video Download PDF

Info

Publication number
CN114598858A
CN114598858A CN202210268063.XA CN202210268063A CN114598858A CN 114598858 A CN114598858 A CN 114598858A CN 202210268063 A CN202210268063 A CN 202210268063A CN 114598858 A CN114598858 A CN 114598858A
Authority
CN
China
Prior art keywords
color
video
image
information
right view
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210268063.XA
Other languages
Chinese (zh)
Other versions
CN114598858B (en
Inventor
陈丹丹
陈载清
陈建兵
云利军
黄小乔
石俊生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yunnan Normal University
Original Assignee
Yunnan Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yunnan Normal University filed Critical Yunnan Normal University
Priority to CN202210268063.XA priority Critical patent/CN114598858B/en
Publication of CN114598858A publication Critical patent/CN114598858A/en
Application granted granted Critical
Publication of CN114598858B publication Critical patent/CN114598858B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/324—Colour aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/385—Image reproducers alternating rapidly the location of the left-right image components on the display screens

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention discloses a color distribution method for improving the visual comfort of a three-dimensional video, belonging to the technical field of computer vision and image processing. The method comprises the steps of performing frame division processing on a 3D video to be processed to obtain each frame of RGB image of the video, wherein the obtained image can be regarded as being composed of a left view part and a right view part; converting the RGB image into color information corresponding to a CIELAB color space, and then adjusting the values of a channel and b channel to be 0 to obtain a new left view and a new right view after graying; based on a color distribution method of transmitting color information to a non-dominant eye and transmitting gray information to a dominant eye, corresponding color information is presented to both eyes to obtain two different video contents. The color distribution scheme reduces the processing amount of the vision system for binocular color information matching on the basis of approaching full-color perception, reduces the load of the vision system and effectively improves the phenomenon of visual discomfort.

Description

Color distribution method for improving visual comfort of stereoscopic video
Technical Field
The invention relates to a color distribution method for improving the visual comfort of a three-dimensional video, belonging to the field of computer vision and image processing.
Background
In recent years, stereoscopic three-dimensional (3D) technology has been rapidly developed. However, visual comfort has been one of the important factors affecting the development of stereoscopic display technology. If this problem is not improved or solved in time, the development of stereoscopic display technology will be greatly affected. The time interleaving technique is a method frequently used in the three-dimensional stereoscopic display technique, in which left and right images are delivered to both eyes in a time-alternating manner, and only one eye receives color information at the same time. Although the time interleaving technique delivers all pixels of an image or video to each eye, it is prone to distortion of perceived depth, resulting in visual discomfort, due to the time delay between the view information received by both eyes, which the vision system converts into spatial parallax.
There are studies that show that during binocular color fusion, both eyes are much worse than one. It is noted that since many people have a dominant eye, it is considered that the human brain habitually uses the imaging of the dominant eye to analyze and locate objects, and the non-dominant eye to process colors, color information is preferably presented to the non-dominant eye.
Based on this, it is an object of the present invention to provide a color allocation method that improves the visual comfort of stereoscopic video. The color distribution method mainly presents the color information on the non-dominant eye, so that the visual brain can better process the color information, and the visual comfort level is improved.
Disclosure of Invention
The invention aims to provide a color distribution method for improving the visual comfort of a stereoscopic video, which is a color distribution method for processing left (right) views of all frames in the stereoscopic video into colors, processing right (left) views of all frames into gray, presenting color information in the corresponding stereoscopic video to a non-dominant eye and presenting gray information to a dominant eye so as to improve the visual comfort of the stereoscopic video, and specifically comprises the following steps:
step 1: performing frame division processing on the 3D video to be processed to obtain each frame of RGB image I of the videonAn image InNaming in sequence to ensure that video content can be subsequently composed in the correct sequence and then image I is readnInformation of (1)n(width,height)。
The image obtained at this time can be regarded as being viewed from the left
Figure BDA0003552590320000021
And right view
Figure BDA0003552590320000022
The method comprises two parts, and can be obtained according to the principle of 3D images:
Figure BDA0003552590320000023
Figure BDA0003552590320000024
step 2: color characterization evaluation measurement is carried out on the experimental display, and an RGB image I is obtainednConverting the color information into color information corresponding to the LAB color space, adjusting the values of a and b channels to be 0, and obtaining a grayed left view
Figure BDA0003552590320000025
And right view
Figure BDA0003552590320000026
And step 3: based on the color distribution method of transmitting color information to the non-dominant eye and transmitting gray information to the dominant eye, corresponding color information is presented to both eyes to obtain two different video contents V (C)L,CR) Wherein, the left views of all frames of the stereo video are all in color, and all framesVideo with both right views in gray is set to V1 (C)L,CR) (ii) a The left view of all frames of the stereoscopic video is gray, and the video with the right view of all frames in color is set as V2 (C)L,CR)。
Figure BDA0003552590320000027
Wherein, CL，CRThe colors of the left and right eyes respectively.
Preferably, in step 2 of the present invention, the original image I is retained when converted into CIELAB color spacenLuminance information ofnLuminescence and deposit it in L channels, each image InThe RGB values of (a) correspond to L a b (I) in the CIELAB color spacenB), wherein a is a red-green channel, b is a yellow-blue channel, and the hue of the image can be changed by only changing the value of a/b; when a or b is 0, both represent gray information, so when graying the left/right view, its corresponding a or b channel value can be adjusted to 0.
The color space of the display is RGB, but the RGB color space depends on the device, and when the same picture is displayed by different display devices, a certain color difference exists. The CIELAB color space is a device-independent color system that uses digital methods to describe human visual perception. Therefore, in order to eliminate the difference of displaying the same picture on different display devices, the method of the invention carries out the conversion from RGB to CIELAB color space.
The color distribution method for presenting the color information to the non-dominant eye and presenting the gray information to the dominant eye avoids the problem of asymmetrical colors of the left eye and the right eye in the time interleaving technology; the method of the invention converts half of the color information into gray, reduces the processing amount of the visual system for matching the binocular color information, thereby improving the visual comfort of the stereo video.
The invention has the beneficial effects that:
(1) the method reduces the processing amount of the binocular color information matching of the vision system and reduces the load of the vision system.
(2) The method of the invention is closer to full-color perception in color perception degree, and does not influence the depth perception of the 3D video; the visual comfort of the stereoscopic video can be improved.
(3) The method of the invention reduces the color information of the 3D video, thereby reducing the transmission amount and the processing amount of the 3D video.
Drawings
Fig. 1 is an example of an image obtained by framing a 3D video, and is divided into a left view and a right view.
The specific implementation mode is as follows:
the present invention will be described in further detail with reference to specific examples, but the scope of the present invention is not limited to the examples.
Example 1
A color distribution method for improving the visual comfort of a stereoscopic video comprises the following specific steps:
step 1: performing frame division processing on the 3D video to be processed (as shown in FIG. 1, left view is a left view of the 3D image, right view is a right view of the 3D image, and the processing of the videos V1 and V2 is performed based on the left and right views shown in FIG. 1), so as to obtain an RGB image I of each frame of the videon(ii) a Image InNamed in order to ensure that the video content V (C) can be subsequently composed in the correct orderL,CR) Reading the image I againnInformation of (1)n(width,height)。
The image obtained at this time can be regarded as being viewed from the left
Figure BDA0003552590320000031
And right view
Figure BDA0003552590320000032
Two-part composition, which can be obtained according to the principle of 3D images:
Figure BDA0003552590320000033
Figure BDA0003552590320000034
step 2: color characterization evaluation measurement is carried out on the experimental display, and an RGB image I is obtainednConverting the color space into a CIELAB color space of a color system independent of equipment display, and then converting the CIELAB color space into RGB display after regulation and control treatment; when switching to the LAB color space, the original image I is retained, since the luminance information influences the content of the imagenLuminance information ofnLuminescence and deposit it in L channel; each image InThe RGB values of (A) correspond to L a b (I) in the LAB color spacenLuminescence, a, b); a is a red-green channel, b is a yellow-blue channel, and the hue of the image can be changed only by changing the value of a/b; when a or b is 0, both represent gray information, so when the left (right) view is grayed, its corresponding a or b channel value can be adjusted to 0; and then CIELAB is regulated and controlled and converted back to RGB display to obtain a grayed left view
Figure BDA0003552590320000041
And right view
Figure BDA0003552590320000042
And step 3: based on the color distribution method of transmitting color information to the non-dominant eye and transmitting gray information to the dominant eye, corresponding color information is presented to both eyes to obtain two different video contents V (C)L,CR). Wherein, the left views of all frames of the stereoscopic video are all in color, and the video with the right views of all frames being in gray is set as V1 (C)L,CR) (ii) a The left view of all frames of the stereoscopic video is gray, and the video with the right view of all frames in color is set as V2 (C)L,CR)。
Figure BDA0003552590320000043
Wherein, CL，CRThe colors of the left and right eyes respectively.

Claims (2)

1. A method of color allocation to improve the visual comfort of stereoscopic video, the method comprising the steps of
Step 1: performing frame division processing on the 3D video to be processed to obtain each frame of RGB image I of the videonAn image InNaming in sequence to ensure that video content can be subsequently composed in the correct sequence and then image I is readnInformation of (1)n(width,height)，
The image obtained at this time can be regarded as being viewed from the left
Figure FDA0003552590310000011
And right view
Figure FDA0003552590310000012
The method comprises two parts, and can be obtained according to the principle of 3D images:
Figure FDA0003552590310000013
Figure FDA0003552590310000014
step 2: color characterization evaluation measurement is carried out on the experimental display, and an RGB image I is obtainednConverting the color information into color information corresponding to the LAB color space, adjusting the values of a and b channels to be 0, and obtaining a grayed left view
Figure FDA0003552590310000015
And right view
Figure FDA0003552590310000016
And step 3:based on the color distribution method of transmitting color information to the non-dominant eye and transmitting gray information to the dominant eye, corresponding color information is presented to both eyes to obtain two different video contents V (C)L,CR) Wherein the left view of all frames of the stereoscopic video is color, and the video with the right view of all frames being gray is set as V1 (C)L,CR) (ii) a The left view of all frames of the stereoscopic video is gray, and the video with the right view of all frames in color is set as V2 (C)L,CR)；
Figure FDA0003552590310000017
Wherein, CL，CRThe colors of the left and right eyes respectively.
2. The method of claim 1, wherein the color allocation method for improving the visual comfort of the stereoscopic video comprises: when converting to CIELAB color space in step 2, original image I is retainednLuminance information ofnLuminescence and deposit it in L channels, each image InThe RGB values of (a) correspond to L a b (I) in the CIELAB color spacenLuminance, a, b), wherein a is a red-green channel, b is a yellow-blue channel, and the hue of the image can be changed only by changing the value of a/b; when a or b is 0, both represent gray information, so when graying the left/right view, its corresponding a or b channel value can be adjusted to 0.
CN202210268063.XA 2022-03-17 2022-03-17 Color distribution method for improving visual comfort of stereoscopic video Active CN114598858B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210268063.XA CN114598858B (en) 2022-03-17 2022-03-17 Color distribution method for improving visual comfort of stereoscopic video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210268063.XA CN114598858B (en) 2022-03-17 2022-03-17 Color distribution method for improving visual comfort of stereoscopic video

Publications (2)

Publication Number Publication Date
CN114598858A true CN114598858A (en) 2022-06-07
CN114598858B CN114598858B (en) 2023-08-08

Family

ID=81810099

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210268063.XA Active CN114598858B (en) 2022-03-17 2022-03-17 Color distribution method for improving visual comfort of stereoscopic video

Country Status (1)

Country Link
CN (1) CN114598858B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103986925A (en) * 2014-06-05 2014-08-13 吉林大学 Method for evaluating vision comfort of three-dimensional video based on brightness compensation
CN105721855A (en) * 2016-03-18 2016-06-29 南京洛菲特数码科技有限公司 Three-dimensional data drawing method, application thereof and three-dimensional image display method
RU2017125776A3 (en) * 2017-07-18 2019-01-23

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103986925A (en) * 2014-06-05 2014-08-13 吉林大学 Method for evaluating vision comfort of three-dimensional video based on brightness compensation
CN105721855A (en) * 2016-03-18 2016-06-29 南京洛菲特数码科技有限公司 Three-dimensional data drawing method, application thereof and three-dimensional image display method
RU2017125776A3 (en) * 2017-07-18 2019-01-23

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈载清等: "立体内容舒适视差范围研究", 吉林大学学报(工学版), vol. 43, no. 1, pages 291 - 294 *

Also Published As

Publication number Publication date
CN114598858B (en) 2023-08-08

Similar Documents

Publication Publication Date Title
US8860784B2 (en) Image processing apparatus, image processing method, and program
US9832445B2 (en) Stereoscopic image display system, disparity conversion device, disparity conversion method, and program
KR101803571B1 (en) Stereoscopic Image Display Device and Driving Method thereof
Goldmann et al. A comprehensive database and subjective evaluation methodology for quality of experience in stereoscopic video
US10154243B2 (en) Method and apparatus for customizing 3-dimensional effects of stereo content
KR101656887B1 (en) Image processing apparatus, image processing method and computer readable recording medium storing program
WO2010095081A1 (en) Transferring of 3d viewer metadata
CN110175969B (en) Image processing method and image processing apparatus
EP2434768A2 (en) Display apparatus and method for processing image applied to the same
JP2001258052A (en) Stereoscopic image display device
US20140093158A1 (en) Apparatus and method for generating a multi-viewpoint image
KR20120101881A (en) Image display method and apparatus thereof
US9210396B2 (en) Stereoscopic image generation apparatus and stereoscopic image generation method
US20120038743A1 (en) Method and Apparatus for Adjusting 3D Video Images
WO2013047007A1 (en) Parallax adjustment device and operation control method therefor
CN114598858B (en) Color distribution method for improving visual comfort of stereoscopic video
US20140063206A1 (en) System and method of viewer centric depth adjustment
Fezza et al. Perceptually driven nonuniform asymmetric coding of stereoscopic 3d video
Mangiat et al. Disparity remapping for handheld 3D video communications
US20130293687A1 (en) Stereoscopic image processing apparatus, stereoscopic image processing method, and program
Stelmach et al. Perceptual basis of stereoscopic video
Liu et al. Visual fatigue reduction based on depth adjustment for DIBR system
US9241153B2 (en) Contrast adjusted anaglyph for reducing ghosting artifacts
US20120140026A1 (en) 2D-to-3D COLOR COMPENSATION SYSTEM AND METHOD THEREOF
WO2011162474A2 (en) Method for configuring stereoscopic moving picture file

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant