CN110072098B - Stereo image adjusting method and display device - Google Patents

Abstract

A method for regulating stereo image includes obtaining an integrated image for reconstructing stereo image, forming integrated image by multiple unit images, obtaining pixel value of each unit image, selecting a range of pixels from one-dimensional pixels according to hardware information, filling selected pixel value into multiple areas divided by one-dimensional pixel area of each unit image in mode of increasing, decreasing, continuously repeating pixel value or any combination of them to form a new unit image, repeating above steps to form a new integrated image. The newly-built integrated image can reduce the difference between the image blocks, so that when a viewer watches the stereoscopic image in motion, the image cannot generate the unnatural image due to overlarge pixel difference.

Description

Stereo image adjusting method and display device

Technical Field

The present disclosure relates to a method and an apparatus for adjusting an image, and more particularly, to a method and a display device for adjusting a stereoscopic image, which solve an unnatural image by adjusting a unit image forming the stereoscopic image.

Background

In the prior art, most of the methods for displaying stereoscopic images employ the principle that parallax is generated when two eyes see the same object, so that the two eyes can respectively see stereoscopic patterns of two images with difference, or dynamic images of two different images are sequentially played, and the images are usually viewed through special glasses, such as red and blue glasses, polarized glasses or shutter glasses, so that the stereoscopic effects with depth are fused in the brain due to the parallax of the two eyes.

Another method is to provide a stereoscopic display device, which can enable a viewer to receive images with image difference at a specific viewing angle by two eyes without using special glasses through an optical assembly in the display device, and can also generate a stereoscopic effect with depth.

However, in the conventional naked-eye 3D technology, when a viewer who views a stereoscopic image moves, the viewer visually moves from one region of the stereoscopic image to another region (region/area), and an unnatural phenomenon occurs due to an excessive difference in pixels in the image, which causes a visual jitter.

Disclosure of Invention

In order to solve the unnatural phenomenon that a viewer who views a stereoscopic image visually generates jitter due to large pixel difference between image blocks when moving, the disclosure discloses a stereoscopic image adjusting method and a display device, wherein one of the main modes is to reduce the difference between the image blocks by adjusting smoothness of a unit image (elemental image) forming the stereoscopic image, so that the image does not generate unnatural image due to too large pixel difference.

According to an embodiment, the method for adjusting the stereoscopic image includes obtaining an integrated image for reconstructing the stereoscopic image, wherein the integrated image is composed of a plurality of unit images, and the method for adjusting the stereoscopic image adjusts smoothness of the unit images to solve the problem of overlarge pixel difference, and simultaneously maintains a certain amount of image information to complete reconstruction of the stereoscopic image. The method then obtains the pixel value of each unit image, selects a range of pixels from the one-dimensional pixels of each unit image, then divides the one-dimensional pixels into a plurality of areas, and fills the pixel value of the selected pixel into the plurality of areas divided by the one-dimensional pixel area of each unit image in an increasing, decreasing or continuous repeating pixel value mode, or the combination of the three modes, so as to form a new unit image. By repeating the above steps of selecting a range of pixels of each one-dimensional pixel in each unit image and filling the pixel values of the selected pixels into a plurality of regions of each one-dimensional pixel of each unit image, a new integrated image can be formed.

Further, the above method is applicable to two-dimensional pixels of one unit image, wherein the range of selecting pixels from the one-dimensional pixels of each unit image is determined according to physical information of multiple optical components in a display device for displaying the stereoscopic image, such as the spatial relationship between the spatial position of the projected stereoscopic image and each optical component, and the spatial relationship between each optical component and a display panel in the display device.

Preferably, the display device according to the embodiment of the disclosure includes a multi-optical module for displaying stereoscopic images, a display unit for displaying integrated images, a display driving unit for driving display, and an image processing unit for executing the stereoscopic image adjusting method.

Further, in an embodiment of the display apparatus, the physical information related to the multi-optical module at least includes a spatial relationship between a spatial position of the projected stereoscopic image and each optical module, and a spatial relationship between each optical module and a display panel in the display unit, and the optical modules are a lens group and form a lens array.

Drawings

FIG. 1 is a schematic diagram of an embodiment of a display device;

FIG. 2 is a schematic diagram of a second embodiment of a display device;

FIG. 3 is a block diagram of an embodiment of a circuit of a display device;

FIG. 4 is a flowchart illustrating an embodiment of generating a stereoscopic image in a display device;

FIG. 5 is a second flowchart illustrating an embodiment of generating a stereoscopic image in a display apparatus;

FIG. 6 is a schematic diagram illustrating a viewer moving to view a stereoscopic image;

FIG. 7 is a flowchart illustrating a process of an embodiment of a method for adjusting a stereoscopic image;

FIG. 8 is a schematic diagram of a pixel of a unit image;

FIG. 9 is a schematic diagram of an embodiment of fetching unit image pixels to fill back into multiple regions;

FIG. 10 is a second illustration of an embodiment of fetching unit image pixels to fill back into multiple regions;

FIG. 11 is a third schematic diagram of an embodiment of fetching unit image pixels to fill back into multiple regions.

Detailed Description

The embodiments disclosed in the specification relate to a stereoscopic image adjusting method and a display device, the disclosed stereoscopic image adjusting method is suitable for a display device provided with multiple optical components for displaying stereoscopic images, and the embodiments of the related display device can refer to the schematic illustration of the embodiment shown in fig. 1.

This figure shows a schematic view of a display device, wherein the display panel 1 may be a Liquid Crystal Display (LCD) panel with a backlight module (not shown in the figure), without excluding other display types with a backlight module, or may be an Organic Light Emitting Diode (OLED) with self-light emitting properties. The display image 11 displayed on the display panel 1 is an integrated image (integral image) generated by a method for displaying a stereoscopic image, the integrated image is composed of a plurality of unit images (element images), the unit images are images corresponding to the lens groups of the multi-optical module 2 composed of the lens groups shown in the embodiment shown in the figure, wherein each unit image on the display image 11 can be an image corresponding to the position of each lens group in a one-to-one manner, a one-to-many manner, a many-to-one manner, and the like.

In the multi-optical module 2, a base 21 and a lens portion 22 are provided, each optical component on the lens portion 22 can be a lens group, and the lens group can be composed of one or more convex lenses and concave lenses, and the multi-optical components form a lens matrix. The system presents stereoscopic images through the multi-optical module 2, however, in this technical concept, the position of the viewing position 5 and the angle relative to the display device will affect the formation of the integrated image and the unit image. The image processing unit 12 of the display device in the figure executes a general image processing program, that is, a computer program for generating a stereoscopic image, in addition to the general image processing program, and can adjust the reference image, the operation unit image, and form an integrated image according to the viewing position of the viewing position 5, the position where the stereoscopic image is displayed, and the physical characteristics of each lens group in the multi-optical module 2, and the spatial relationship between each component. According to the embodiment of the stereoscopic image generation system, if the user changes the viewing position 5, the user can be adaptively provided with proper viewing content at the viewing position 5. The image processing unit 12 is a digital signal processor or a microprocessor, and can be further configured to perform a stereo image adjusting method.

The display device shown in the figure can be an electronic device with a flat screen, such as a mobile phone, a tablet, a computer, etc., and the display panel 1 is arranged at the lower layer and is responsible for displaying a flat image which is not reproduced by light rays, mainly a display component for displaying integrated images; the multi-optical component module 2 is arranged on the upper layer, has the technical effect of regulating and controlling the light field, can regulate and control the light angle of the three-dimensional image, and redistributes and combines the plane image which is not recombined originally. In this embodiment, the integrated image is redistributed and combined by the multi-optical module 2 to display a recombined stereoscopic image.

The multi-optical module 2 may be a lens matrix composed of a plurality of lens sets, which constitutes the lens portion 22, and its physical characteristics such as refractive index and penetrability caused by material and lens curvature, and the number and arrangement of the lens sets of the lens matrix, in cooperation with the arrangement of the display panel 1, can determine the three-dimensional image content such as height, visual angle range and definition of the stereoscopic image.

Each lens group can be a single lens (single lens), a lens array (lens array), a lenticular lens (lenticular lens), a Fresnel lens (Fresnel lens), and can be matched with a pinhole (pin), a pinhole array (pin array), a light barrier (barrier), and a point light source (point light source) during imaging. The display device may alternatively display the image in the form of an array of displays, which are imaged by the lens at the default position.

Fig. 2 is another schematic diagram illustrating an embodiment of a display apparatus, in which a system displays an integrated image composed of unit images on a display panel 1, and reproduces a stereoscopic image through a multi-optical module 2.

In the illustrated embodiment, also shown in fig. 1, the user sees a "3D" floating stereoscopic image from his viewing position 5, and this stereoscopic image is displayed by the display panel 1 as a display image 11, which is an integrated image formed by a plurality of unit images, each unit image corresponding to a single optical element, i.e. a lens group, in the multi-optical module 2.

Since each lens group on the lens portion 22 is disposed at a different position, when the multi-optical module 2 is to reconstruct a floating stereoscopic image and the stereoscopic image is to be seen at a certain viewing position 5, it is obvious that the image projected by the lens group at each position is projected to a set spatial position, and therefore the lens group at each position should project a different image, that is, the unit images corresponding to each optical module will have a difference from each other.

For example, when a floating stereoscopic image is to be projected, an optical component located at the left of the projected stereoscopic image should project a unit image that is biased to a certain projection angle at the left of the stereoscopic image; the optical component positioned at the right side of the stereoscopic image needs to project a unit image with a projection angle more biased to the right side of the stereoscopic image; the optical elements below the stereoscopic image should project unit images projected upward with a higher weight below the stereoscopic image. Furthermore, the floating stereoscopic image represents a distance from the display plane, and the display effect is as floating in the air, but another embodiment does not exclude the effect of sinking in the display plane.

The display device described in the above embodiment can be implemented by a circuit system, and the embodiment can refer to a circuit block diagram shown in fig. 3.

The display device may implement the stereoscopic image adjusting method through hardware and software, wherein a portion of the hardware is a display device, and includes circuit units electrically connected to each other as shown in the figure, and the main components include a multi-optical component module 301, which is composed of a plurality of single optical components and is used to present a stereoscopic image. The system includes a display unit 303 including a display panel for displaying an integrated image, which can be reconstructed by the multi-optical module 301 to present a stereoscopic image.

The system includes a display driving unit 305, which may be a driving circuit of the display panel, capable of generating image control signals to drive the display unit 303 to display the integrated image. The system includes an image processing unit 307, which may be an image processing integrated circuit, such as a digital signal processor or a module implemented by specific software, for executing the stereo image adjustment method in addition to the computer program for displaying the stereo image, the image processing unit 307 is connected to a storage unit 311, the storage unit 311 is a memory of the system, for temporarily storing image data, system operation instructions and calculation instructions, can provide an instruction set for operation and related image data, and can be used as a buffer for temporarily storing a file generated during the operation of the system.

The system has an input interface unit 309 for connecting to an external stereoscopic image source 30, and when the image processing unit 307 operates to generate a stereoscopic image, it first receives a stereoscopic image information through the input interface unit 309. The source 30 may be a stereo image that is drawn by specific software and hardware, in one embodiment, information such as stereo coordinates and chromaticity of the stereo image is recorded, which may include color information and three-dimensional space information of the stereo image, and another embodiment may be a two-dimensional plane image and a depth map (depth map).

When the image processing unit 307 executes the stereo image adjusting method, the software instructions stored in the storage unit 311 are executed, and the stereo image adjusting method mainly includes obtaining an integrated image for reconstructing a stereo image, where the integrated image is composed of a plurality of unit images, obtaining a pixel value of each unit image, selecting a range of pixels from each unit image, and filling the pixel values of the selected pixels into a plurality of areas distinguished by a one-dimensional pixel area of each unit image to form a new unit image, i.e., to form a new integrated image. The integrated image can reduce the difference between the image blocks, so that when a viewer watches the stereoscopic image in motion, the image cannot generate unnatural image due to overlarge pixel difference.

Then, a spatial relative relationship is established according to the stereoscopic image information, and the spatial relative relationship can be actually reflected through a reference image, and the reference image can reflect the finally displayed stereoscopic image, the reference image is set by a user to be used for setting the stereoscopic image to be presented, then, the system calculates unit images corresponding to each optical assembly according to the physical information related to the multi-optical assembly module 301, and forms an integrated image for displaying by the display unit 303 corresponding to the plurality of unit images of the plurality of optical assemblies, and the integrated image is driven and displayed by the display driving unit 305, and then the stereoscopic image is presented through the multi-optical assembly module 301.

The physical information related to the multi-optical module mainly relates to the physical characteristics of each optical module, and further includes at least a spatial position for projecting the stereoscopic image and a spatial relationship between each optical module, such as a distance and a relative angle between the stereoscopic image and each optical module (e.g. a lens group); and the spatial relationship between each optical element and a display panel in the display unit 303, such as the distance between each optical element and the display panel.

The system can be arranged in the same space coordinate system, the distance and the relative angle between the stereoscopic image and each optical assembly can be calculated according to the space coordinate of the stereoscopic image and the relative coordinate of each optical assembly, the relative position between each optical assembly can be obtained accordingly, and the distance between each optical assembly and the display panel can also be obtained. The spatial relationship may also include the relative position of each optical element on the multi-optical module, and the distance and pixel size matching with respect to the display panel. Then, the information of the three-dimensional image to be displayed can be input when the three-dimensional image is displayed according to the various spatial relationships, including setting the oblique angle of the three-dimensional image display according to the watching position of the user, then forming a unit image after ray tracing, and generating the integrated image which is not reconstructed and displayed on the display panel.

Fig. 4 is a flowchart showing an embodiment of generating stereoscopic images in a display device, and the following steps are simply replaced without affecting the implementation of the present invention.

In the flow of this embodiment, in step S401, the system receives stereo image information from an external image source, for example, the received stereo image information includes color information and three-dimensional space information of the stereo image, such as a plane image data and a depth map, or a set of coordinate values and a chrominance value describing the stereo image. The depth map records a depth value (z value) of each pixel in the planar image, such that coordinate values (x, y, z) describing the stereoscopic image when the image is reproduced are added with the chrominance value to correctly display the correct spatial position and color of each portion of the image, thereby generating the stereoscopic image.

Then, in step S403, the system establishes a reference image (reference image) according to the received stereoscopic image information and the user ' S set requirements, such as viewing position, stereoscopic image projection position, or the system automatically detects the user ' S viewing position, such as detecting the user ' S eyes. According to one embodiment, the input original stereo image is transformed into the reference image by a coordinate transformation, wherein a set of transformation parameters is calculated according to a coordinate transformation algorithm.

Next, in step S405, the system obtains physical information related to the multiple optical components, including the size and characteristics of the optical components (e.g. lens groups), including the set coordinates, size, curvature, etc. of the single lens group and the multiple lens matrix, and the spatial position projected by the optical components, the spatial relationship between each optical component and the display unit/panel, the spatial relationship between the projected position and each optical component, etc. Then, in step S407, the system establishes a coordinate transformation function between the original stereoscopic image information and the reference image, and the algorithm calculates the reference image into a unit image (elemental image) corresponding to each optical element (e.g., each lens) according to the characteristics of the hardware, such as the physical information of each lens of each optical element, and the coordinate transformation function.

In step S409, an integrated image (integrated image) is generated according to the plurality of unit images, wherein the integrated image is provided for a display unit (such as a display panel, a backlight module, etc.) in a display device in the system to display, the integrated image includes a plurality of unit images, and each unit image maps each optical component. The final integrated image is made to display stereo image via the multiple optical assemblies, and the stereo image is also the reference image in accordance with the user's setting or the automatic judgment of the system.

It is noted that the generation of the reference image will involve displaying the panel position corresponding to each optical element (including one-to-one, one-to-many, or many-to-one), and in general, does not necessarily refer to the viewing position of the user. However, in an embodiment, since the user may view the stereoscopic image in an oblique direction, the calculated unit images will change, and the algorithm further sets the reference image in cooperation with the display at different angles in consideration of various physical information of the stereoscopic image that the light rays come out and converge again into the stereoscopic image when passing through the multiple optical components, even the stereoscopic image that floats above, below, or sinks behind the display device, so that the unit image and the integrated image that are finally generated are also different.

Next, as shown in the flowchart of fig. 5, the stereoscopic image is generated on the display device, and the relative positions of the stereoscopic image and the display device are not limited, wherein the inventive concept can also be applied to an embodiment in which two (or more) sets of display devices display one or more stereoscopic images.

In the aforementioned embodiment, the system generates a reference image reflecting the stereoscopic image that is determined to be finally imaged, calculates unit images, and combines them to form an integrated image, as in step S501, inputs the integrated image to a display driving unit in the system, which is a driving circuit for driving a display screen of the display unit, drives the display screen of the display unit, displays the integrated image, reconstructs corresponding unit images on the optical components through the multi-optical module, as in step S503, respectively, and finally reconstructs the stereoscopic image at a spatial position on the multi-optical module, as in step S505.

In the imaging process, the stereoscopic image can be displayed on, under, or in front and back of a display plane formed by multiple optical components in the display apparatus, referring to the schematic diagrams shown in fig. 1 and 2. Furthermore, if the stereoscopic image information relates to a dynamic stereoscopic image, a plurality of consecutive reference images reflecting the spatial relative relationship are established, a plurality of integrated images are output, and finally, the dynamic stereoscopic image is displayed through the multi-optical component.

It should be noted that the image display device converges the integrated image displayed on the display panel into a stereo image again through the lens matrix shown in fig. 1 and fig. 2, when a certain stereo image is reconstructed, especially a stereo image with a certain angle deviation, the system can actively exclude the corresponding unit image which generates a deviation image (deviation image), the deviation image can be determined according to the reference image, or the exclusion can be preset, or the deviation image can be excluded after comparing the reconstructed image afterwards, and the manner of excluding the deviation image includes means of correction, selection, deletion, etc. to form the integrated image. For example, the unit image of the edge may generate an image which generates a deviation when projected through the lens, and such unit image may be excluded.

Furthermore, when the viewer watching the stereoscopic image moves relative to the image display device, the schematic diagram is shown in fig. 6, which shows that the viewer watching the image display device at the position 6 generates the stereoscopic image "3D", which is composed of the planar images of the plurality of regions (areas) reconstructed by the plurality of lens portions 22 in the multi-optical module 2.

When a viewer moves from the original first position 6 to the second position 6' within a visual range, the viewer visually moves from one block to another block of the stereoscopic image "3D", and if the difference between pixels in the image at some positions is too large, the viewer visually jumps and generates an unnatural phenomenon.

The image of the display device is adjusted to a certain degree of smoothness to solve the problem of excessive image pixel difference, and the related embodiments are implemented by software programs, and the flow executed by the image processing unit in the display device can refer to the flow example shown in fig. 7.

The main concept of the stereo image adjusting method is that when a viewer watching a stereo image displayed by a display device moves, the viewer moves left and right, front and back or up and down, color block switching (flipping) occurs during the process, the viewer visually moves from one block of the stereo image to another block (area), the image is visually observed to jump or be wrong because of the overlarge pixel difference between the color blocks of the two-dimensional image forming the stereo image, and the main concept of the method is to adjust the pixel difference of the unit image forming the integrated image, so that the smoothness is increased moderately, and the image cannot have the unnatural image because of the overlarge pixel difference. However, it should be noted that the smoothness adjustment cannot be excessive to lose the effect of the stereoscopic image, such as the selection range is too small, so that the overall display environment needs to be considered when selecting a range of pixels of the one-dimensional pixels of the unit image and cutting a plurality of regions, i.e. the physical information related to the multiple optical components in the display device.

According to the exemplary flow chart shown in fig. 7, in step S701, an integrated image representing a stereoscopic image is initially obtained, the integrated image is composed of a plurality of unit images corresponding to each lens group of a multi-optical component of a display apparatus, the unit images are generally two-dimensional images (MxN pixels), and thus the disclosed stereoscopic image adjusting method is applied to two-dimensional pixels of the unit images.

Then, in step S703, a pixel value of each unit image is obtained through a software program, where the pixel value generally refers to a color value and a brightness value, and then, in step S705, the method may set a selection window to automatically select a certain range of pixels of the one-dimensional pixels of the unit image according to the display environment and the requirement; meanwhile, or in a different step, in step S707, the one-dimensional pixel of the unit image is divided into a plurality of regions, and the plurality of regions may be equally divided or unequally divided.

Then, in step S709, each area is filled with the selected pixels, according to one embodiment, the pixel values of the selected pixels can be filled into the plurality of areas divided by the one-dimensional pixel area of each unit image in an increasing or decreasing manner, and the filling manner does not exclude the pixel values that can be continuously repeated in the area, that is, in step S711, the selected pixel values can be filled in a combination of the above manners to form a new unit image. The new unit image is the unit image with the adjusted smoothness, a range of pixels of each one-dimensional pixel in each unit image is repeatedly selected, and the pixel values of the selected pixels are filled into a plurality of areas of each one-dimensional pixel of each unit image, so that a new integrated image can be formed.

The three-dimensional image is reconstructed by the new integrated image, wherein light is generated by the integrated image and is projected out through a lens matrix (a multi-optical component module) consisting of a plurality of lens groups, the light is subjected to refractive index and penetrability change caused by physical characteristics (such as material and lens curvature) of the multi-optical component module, the refractive index and penetrability change is one of main considerations for selecting a pixel range and a cutting area in the image adjusting step, and then three-dimensional image contents such as the height, the visual angle range and the definition of the three-dimensional image can be determined by matching the number and the arrangement mode of the lens groups of the lens matrix and the arrangement of a display panel.

The pixel values such as color value and brightness value, each pixel can have its own color value, for example, in three primary colors, and is divided into three sub-pixels of red, green and blue (RGB color gamut), and cyan, magenta, yellow and black (CMYK color gamut) can be used.

The new unit image and the integrated image can be formed by the stereo image adjusting method, and the same method can be applied to the pixels of the other dimension of each unit image, the pixels in the specific range are selected mainly according to the characteristics of hardware, as shown in a pixel diagram of one unit image shown in fig. 8, one unit image has pixels of two dimensions, the pixels of each dimension can be numbered, and as shown in an embodiment of fig. 9, the pixels of the unit image are taken out and filled back into a plurality of areas.

FIG. 9 schematically illustrates a one-dimensional pixel 90, wherein the pixels are numbered sequentially from 1 to 30. if desired, the software program has a selection window to determine a range of pixels, such as selected pixel 901, that includes more complete image information, but can select other ranges of pixels based on actual requirements.

In this example, the selected pixel 901 covers 10 pixels, and the unit image is divided into multiple regions (zones) in this dimension, which forms the backfill regions 902, 903, 904, and then each region is refilled with pixels in the selection window, and one embodiment sequentially fills the pixel values of the selected pixels into the backfill regions 902, 903, 904 in a decreasing and increasing manner according to the pixel numbers. This example shows that refill region 902 is filled in a decreasing manner from pixel number 20 to pixel number 11; backfill region 903 is incrementally filled from pixel number 11 to number 20; the backfill region 904 then fills in a decreasing manner from pixel number 20 to pixel number 11. It can be seen that there are close pixel values adjacent to several backfill regions 902, 903, 904, and then nested in other rows of pixels, which effectively adjusts the smoothness of the cell image as a whole.

In the step of backfilling the pixel values of the selection window, the backfilling manner includes an increasing order, a decreasing order, and the like, and the actual implementation is not limited to a specific manner.

Fig. 10 shows another embodiment of fetching unit image pixels to fill back into multiple regions, which shows that a pixel 101 selected from a one-dimensional pixel 100 (pixel numbers 1 to 30) is selected as a region, and pixels near the middle region are selected as the region, but the regions are not in equal proportion to form the back-filled regions 102, 103, 104.

Similarly, the backfill region 102 is shown to be filled in a decreasing manner from pixel number 20 to pixel number 12, wherein the pixel values may not be continuous, and the boundary pixel value difference between the adjacent region (e.g., the backfill region 103) is within a specific range; the backfill region 103 incrementally fills from pixel number 11 to number 20, with possibly also continuously repeating pixels; the backfill region 104 then fills in a decreasing manner from pixel number 20 to pixel number 15. It can be seen that there are still close pixel values adjacent to several backfill regions 102, 103, 04, and then pixels in other rows are applied to effectively adjust the smoothness of the cell image.

Fig. 11 shows one-dimensional pixels 110 (pixel numbers 1 to 30), from which a region of pixels 111 is selected, and the original one-dimensional pixels 110 are divided into backfill regions 112, 113 and 114. To form a new unit image, in this embodiment, each region of the one-dimensional pixels 110 may be filled with pixel values by incrementing, decrementing, or continuously repeating pixel values (i.e., filling a small range with a plurality of continuous repeated pixel values), or any combination thereof, and the boundary pixel values of each filled region and its neighboring region may not differ too much. It should be noted that, when a new unit image is actually generated, the number of times and the sequence of the several backfilling modes of the incremental, decremental and continuous repetition of the pixel values can be arbitrarily combined when the pixel values are backfilled in the respective backfilling areas of each one-dimensional pixel in an incremental, decremental and continuous repetition (same pixel value).

In this example, the backfill region 112 fills in a decreasing manner from pixel number 20 to pixel number 12, where the pixel values may not be consecutive; the backfill region 113 backfills pixel values in a region by matching incremental, decremental, and repeated pixel values, such as each of the backfill pixel numbers 13, 14, 15, 16, 17, 15, 14, 13, 15, 17, 19, including the arrangement of incremental or decremental pixel values, while matching consecutive repeated pixel values, such as consecutive pixel numbers 16, 17, and 15; the backfill region 114 backfills the pixel values in a decreasing manner. Similarly, the smoothness of the unit image can be adjusted by filling the adjacent regions of the backfill regions 112, 113, 114 with similar pixel values within a certain range.

In the whole view, the decision of the selection windows (901, 101) still considers whether the stereo information in the image is eliminated, if the selection window is too small, the smoothing (smooth) is too much, the stereo effect is affected, and if the selection window is too large, the problem of vision cannot be solved.

Therefore, according to the embodiments of the disclosure, the proposed stereoscopic influence adjusting method and the display device implementing the method mainly start from the way of adjusting the unit images, and generate the smoothed integrated influence by smoothing each unit image to generate the final smoothed and adjusted stereoscopic image, thereby effectively solving the problem that the visual unnatural appearance of the viewer is affected due to the excessive difference between the pixels.

The above-mentioned embodiments are only preferred embodiments of the present invention, and all equivalent changes and modifications made by the claims of the present invention should be covered by the scope of the present invention.

Claims (9)

1. A method for adjusting a stereoscopic image, the method comprising:

obtaining an integrated image, wherein the integrated image consists of a plurality of unit images with two dimensions, and a stereoscopic image is reconstructed through a lens array;

obtaining the pixel value of each unit image;

selecting a range of pixels from one-dimensional pixels in each unit image;

the pixel values of the selected pixels are filled into a plurality of areas divided by one-dimensional pixel areas of each unit image in a mode of gradually decreasing and then increasing, or gradually increasing and then decreasing, or continuously refilling a plurality of same pixel values in a small range by gradually decreasing and then increasing collocation, or gradually increasing and then decreasing collocation, so as to form a new unit image; and

a range pixel of each one-dimensional pixel in each unit image is selected repeatedly, and the pixel values of the selected pixels are filled into a plurality of areas of each one-dimensional pixel of each unit image in a mode of descending and ascending, ascending and descending or matching with continuous repeated pixel values according to the pixel number sequence to form a new integrated image.

2. The method of claim 1, wherein the unit image is a two-dimensional image, and the method is applied to pixels of two dimensions of the unit image.

3. The method as claimed in claim 2, wherein the pixel values include color values and luminance values.

4. The method for adjusting stereoscopic images according to any one of claims 1 to 3, wherein the range of pixels selected from the one-dimensional pixels of each unit image is determined according to physical information of a plurality of optical elements in a display device for displaying the stereoscopic image.

5. The method for adjusting stereoscopic images according to claim 4, wherein the physical information related to the multiple optical elements at least includes a spatial relationship between a spatial position of the projected stereoscopic image and each optical element, and a spatial relationship between each optical element and a display panel of the display device.

6. The method for adjusting stereoscopic images according to claim 4, wherein the method for forming the integrated image comprises:

receiving stereoscopic image information;

establishing a spatial relative relationship according to the three-dimensional image information;

obtaining physical information related to a plurality of optical components in a display device;

calculating the unit image corresponding to each optical assembly according to the spatial relative relationship and the physical information related to the multiple optical assemblies; and

the integrated image which is provided for the display device to display is formed corresponding to the plurality of unit images of the multi-optical assembly, and the three-dimensional image is displayed through the multi-optical assembly.

7. A display device, said display device comprising:

a multi-optical module for displaying a stereoscopic image;

a display unit for displaying an integrated image;

a display driving unit for driving the display unit to display the integrated image; and

an image processing unit for performing a stereo image adjustment method, comprising:

obtaining the integrated image, wherein the integrated image is composed of a plurality of unit images with two dimensions;

obtaining the pixel value of each unit image;

selecting a range of pixels from one-dimensional pixels in each unit image;

the pixel values of the selected pixels are filled into a plurality of areas divided by one-dimensional pixel areas of each unit image in a mode of gradually decreasing and then increasing, or gradually increasing and then decreasing, or continuously refilling a plurality of same pixel values in a small range by gradually decreasing and then increasing collocation, or gradually increasing and then decreasing collocation, so as to form a new unit image; and

a range pixel of each one-dimensional pixel in each unit image is selected repeatedly, and the pixel values of the selected pixels are filled into a plurality of areas of each one-dimensional pixel of each unit image in a mode of descending and ascending, ascending and descending or matching with continuous repeated pixel values according to the pixel number sequence to form a new integrated image.

8. The display apparatus of claim 7, wherein a range of selecting pixels from the one-dimensional pixels of each unit image is determined according to physical information of the multiple optical elements in the display apparatus displaying the stereoscopic image.

9. The display apparatus according to claim 8, wherein the physical information related to the multi-optical module comprises a spatial relationship between a spatial position of the projected stereoscopic image and each optical module, and a spatial relationship between each optical module and a display panel of the display unit; the optical assembly is a lens group which consists of one or more convex lenses and concave lenses, and the multiple optical assemblies form a lens matrix.

Images