TWI419077B - System and method for compensating binocular vision deficiency - Google Patents

Description

Stereoscopic visual information compensation system and method

The present invention relates to a system and method for visual information, and more particularly to a stereoscopic information compensation system and method for compensating for stereoscopic vision defects.

Humans use the eyes to obtain visual perception, especially through the binocular vision, and simultaneously obtain visual images with parallax, and then through the analysis and processing of the brain, to produce stereoscopic vision, that is, to know the respective visual lines. The relative distance of the three-dimensional object, the absolute distance between the three-dimensional object and the viewer, and even the thickness of the three-dimensional object.

However, for those who have limited vision because only the remaining unilateral eyes can receive images normally, or the brain cannot correctly analyze the images produced by the eyes, it is impossible to know the relative distance of the objects in front of the eyes, or the three-dimensional objects and viewing. The distance of the person itself. This lack of stereoscopic visual defects not only reduces the visual richness of viewing, but also makes it impossible for viewers to judge the distance between the scene and their own, causing safety concerns.

Currently known stereoscopic display devices or stereoscopic image generation techniques are developed on the premise that the viewer's binocular vision ability is not impaired; and the auxiliary mechanisms of many visual defects are not for stereoscopic vision. Defects provide compensation, so that viewers with defective binocular vision have no chance to detect the depth or distance of the scene as usual, and increase the inconvenience in life.

The invention relates to a stereoscopic visual information compensation system and method, which utilizes an image capturing unit to capture an image, and then processes the image and adds stereoscopic information to display the depth or distance information of the three-dimensional object on the planar image for visual A person who has a defect and cannot perform the binocular vision effect obtains a stereoscopic message to the scene.

According to an aspect of the present invention, a stereoscopic information compensation system is provided, wherein an embodiment includes: a plurality of image capturing units, an image processing unit, and a display unit. The image processing unit further includes: a distance operation unit, a temporary storage unit, and a stereo information fusion unit. The plurality of image capturing units are disposed on the same eye level, and respectively capture a plurality of plane images of different angles in the same scene, wherein the plane images include at least one three-dimensional object in the scene, and the plurality of plane images include a reference image. The distance calculating unit calculates a disparity between the plurality of plane images of the three-dimensional object, and calculates a distance value between the three-dimensional object and the eye level according to the distance between the aberration and the image capturing unit, and Record the distance value in the temporary storage unit. The three-dimensional information fusion unit obtains the stereoscopic information corresponding to the three-dimensional object according to the distance value temporarily stored by the temporary storage unit, and fuses the stereoscopic information corresponding to the three-dimensional object into the three-dimensional object of the reference image to generate a corrected image. The display unit receives and displays the corrected image.

According to another aspect of the present invention, a stereoscopic information compensation method is provided, wherein an embodiment includes: capturing, by a plurality of image capturing units disposed on the same eye level, a plurality of plane images of different angles for the same scene, each of each The planar image includes at least one three-dimensional object of the scene, the planar image includes a reference image; an image processing unit calculates an aberration between the planar images of the three-dimensional object; and the image capturing unit according to the aberration and the image capturing unit a distance between the three-dimensional object and the image capturing unit is calculated; the image processing unit fuses a stereoscopic information corresponding to the three-dimensional object to the three-dimensional object in the reference image according to the distance value to generate a corrected image. ; output corrected image to a display unit.

For details and illustrations of the embodiments and drawings, please refer to the following description.

The first figure is a block diagram of a first embodiment of a stereoscopic information compensation system provided by the present invention. The stereoscopic information compensation system 1 includes a plurality of image capturing units, an image processing unit 14, and a display unit 16. The image capturing unit of the present embodiment includes an image capturing unit 10 and an image capturing unit 12; the image processing unit 14 further includes a distance calculating unit 140, a temporary storage unit 142, a stereo information fusion unit 144, and a warning comparison unit 146.

The two image capturing units 10 and 12 are horizontally arranged side by side at the same eye level and spaced apart by a certain width; the width range can simulate the spacing between the left and right eyes of the human being, and is about 6 to 7 cm. between. The specific image capturing units 10 and 12 may be cameras or cameras, and sequentially capture the plane images of the same scene continuously or periodically. Both of the planar images include at least one of the same three-dimensional objects in the scene, such as a building, a vehicle, or a tree. In order to facilitate the understanding of the implementation, the planar image captured by the image capturing unit 10 is referred to as a reference image, and the planar image captured by the image capturing unit 12 is referred to as a reference image.

The reference image and the reference image captured by the image capturing units 10 and 12 are transmitted to the image processing unit 14 for processing. After receiving the reference image and the reference image, the distance calculation unit 140 of the image processing unit 14 recognizes the included in the reference image and the reference image by means of image analysis. Body object to calculate the distance between the solid object and the eye level. First, the object in the reference image can be parsed and marked by a technique such as Image Segmentation. Then, the distance operation unit 140 can pass through point matching or block matching. The image correspondence is analyzed, and the corresponding three-dimensional objects existing in the two planar images are identified by comparing textures, patches or edges in the image.

The analysis of the point correspondence or the block correspondence is based on the pixels of the image for comparison. Therefore, when the corresponding three-dimensional object in the two plane images is recognized, the three-dimensional object can be obtained in the reference image and the reference image, respectively. The position, in other words, the two-dimensional coordinates of the three-dimensional object in the image.

Since the positions between the image capturing units 10 and 12 are separated by a certain width, the contents of the reference image and the reference image are all related to the same scene, but the angle and range of the captured image are different, so that the captured image content is obtained. Will not completely overlap equal. Therefore, there is a gap between the position of the same solid object in the reference image and the position in the reference image, that is, disparity. In the image captured by the image capturing units 10 and 12 simulating the position of the human eye, the three-dimensional object generates horizontal aberration (x-axis direction aberration), and the closer to the horizontal line, the image generated by the three-dimensional object. The difference is greater. The distance operation unit 140 can calculate the aberration of the two planar objects in the two planar images according to the coordinates of the same three-dimensional object in the reference image and the reference image.

After obtaining the aberration between the two planar images of the three-dimensional object, the distance operation unit 140 can further estimate the aberration according to the width of the image capturing unit 10, 12 and the aberration of the three-dimensional object. The distance value of the solid object relative to the eye level. The means for calculating the distance value of a three-dimensional object from aberrations is well known to those skilled in the art, and this is no longer a rumor.

After calculating the distance values of the distinguishable three-dimensional objects in the plane image, the image processing unit 14 may temporarily store each distance value in the temporary storage unit 142, for example, temporarily stored in a buffer or recorded in the registration file (registry). ). The stereo information fusion unit 144 and the alert comparison unit 146 then process the distance values temporarily stored in the temporary storage unit 142 to provide images incorporating the stereoscopic information.

The stereo information fusion unit 144 reads the distance value of each three-dimensional object one by one from the temporary storage unit 142, and fuses the value of each distance value to the corresponding three-dimensional object in the reference image based on the picture of the reference image. A corrected image of the distance value of each of the three-dimensional objects is displayed in addition to the scene in the picture.

A schematic diagram of the corrected image 20 as shown in the second figure, wherein the three-dimensional objects 201, 202 to 206 recognized by the distance calculating unit 140 and calculating the distance value include a vehicle and a building. Appropriately around each of the three-dimensional objects 201 to 206, values 211, 212 through 216 of distance values are respectively identified to prompt the user the distance between each of the three-dimensional objects 201 to 206 and the eye level. Thereby, even if the user with binocular visual defects can not distinguish the distance of each three-dimensional object in the image, the front and back relationship of the three-dimensional object can be obtained by merging the distance value value of the corrected image 20, and the eye level Stereoscopic information of distance values. For example, in the second figure, according to the values 211 to 216 of the distance values, 3, 5, 20, 20, 120, and 200 are sequentially indicated, not only the relative distance between the three-dimensional objects 201 to 206 but also the relative distance between them. The absolute distance between each of the three-dimensional objects 201 to 206 and the eye level can be known.

After the stereo information fusion unit 144 fuses the stereo information to the reference image and generates the corrected image, or at the same time, the alert comparison unit 146 can read the distance values temporarily stored by the temporary storage unit 142, and each distance value is respectively The preset threshold values are compared. Setting the threshold value considers that a user with binocular visual defects cannot correctly determine the distance between the three-dimensional object and himself, and if the user is closer to the scene in front of the scene, he or she does not know, or cannot be short. When the reaction is made within a time, it is possible to collide because it is too close to the three-dimensional object. The threshold value preset by the system is used to confirm whether the distance between the eye level line and any three-dimensional object in the corrected image is close to a possible collision. When the alert comparison unit 146 compares any distance value that is equal to or less than the threshold value, a warning message, such as a dynamic flashing warning text, is generated.

The display unit 16 is connected to the image processing unit 14 for receiving and presenting the data processed by the image processing unit 14. The corrected image generated by the stereo information fusion unit 144 and the warning message generated by the alert comparison unit 146 are transmitted to the display unit 16, and the display unit 16 outputs a corrected image and displays a warning on the display unit 16. Text, which provides a function of providing an image with stereoscopic information to the user while providing an early warning of possible dangers.

The stereoscopic information compensation system 1 can be disposed on a helmet-type or glasses-type visual aid device, and the display unit 16 can be a liquid crystal screen or a similar image output component disposed opposite the user's eyes, and capture the image. The units 10, 12 are disposed above the display unit 16 and respectively vertically correspond to the positions of the left and right eyes of the user to obtain a planar image that is closest to the user's eyes. The image processing unit 14 can be disposed at the side or the rear of the helmet or the glasses to receive the planar image captured by the image capturing units 10 and 12, and generate corrected images and warning messages.

In addition to displaying the value of the distance value of the three-dimensional object, the technical means disclosed by the present invention can also provide other stereo information to assist in binocular viewing. The user of the defect identifies the three-dimensional object.

The third figure is a block diagram of a second embodiment of a stereoscopic information compensation system provided by the present invention. The stereoscopic information compensation system 1a of the second embodiment further includes an alert unit 18 as compared with the first embodiment; and further includes an alignment table 148 at the image processing unit 14a.

When the distance calculation unit 140 calculates the distance values of the respective three-dimensional objects according to the reference image and the reference image, and temporarily stores the distance values in the temporary storage unit 142, the stereo information fusion unit 144 can be based on the records in the temporary storage unit 142 and Comparing the contents of the table 148, the stereoscopic information of the three-dimensional object is obtained to generate a corrected image.

The comparison table 148 records the complex stereo information and the complex distance data, and each of the stereo information and each distance data correspond to each other one-to-one. The plurality of distance data may be distance segments that are consecutive but not overlapping. The stereo information fusion unit 144 can read one of the distance values from the temporary storage unit 142, and compare the distance value with the distance data recorded in the comparison table 148, when the read distance value and the comparison table 148 When one of the specific distance data matches (for example, the distance value falls within a range of the distance segment), the stereo information fusion unit 144 selects the stereo information corresponding to the distance data. The stereo information fusion unit 144 can use the image edge detection technology, such as the Sobel edge detection method, to identify the edges of the three-dimensional objects in the reference image, and change the contour of the three-dimensional object according to the selected stereo information. The far and near relationship of different three-dimensional objects and the distance from the eye-level line are displayed by the contour change of the three-dimensional object.

The stereoscopic information may include color information, and the distances and distances indicated by the different distance data respectively correspond to different colors or brightnesses. For example, the closer the distance to the view plane, the more the color information corresponding to the warm color And the higher the brightness; the farther away from the viewing plane, the more the color information corresponding to the color information is, the lower the brightness is.

For example, a distance section below 3 meters corresponds to red; a distance section of more than 3 meters to 10 meters corresponds to pink; a distance of more than 10 meters to 25 meters corresponds to orange; more than 100 The ruler to 150 meters below the blue, and so on. Taking the corrected image diagram of the second figure as an example, the distance calculating unit 140 calculates the distance values of the three-dimensional objects 203 and 205 to be 20 meters and 120 meters, respectively. According to the recorded data of the comparison table 148, the distance value of the three-dimensional object 203 is in a distance section indicating 10 to 25 meters, and thus corresponds to orange-red; and the distance value of the three-dimensional object 205 falls within the indication of 100 to 150. The distance of the meter is in the section, so it corresponds to blue.

The stereoscopic information fusion unit 144 may depict the outline of the building in orange-red along the three-dimensional object 203; and depict the outline of the three-dimensional object 204 in blue. When the corrected image is displayed on the display unit 16, the user can determine the distance of each of the three-dimensional objects by correcting the different edge colors of the respective three-dimensional objects in the image.

In another embodiment, the stereo information may also be shadow concentration information, for example, the closer the distance to the view plane, the thicker the shadow corresponding to the segment, and the farther away from the view plane, the lighter the shadow. . The shadow density can be expressed in grayscale. Therefore, the stereo information fusion unit 144 can select the corresponding grayscale value according to the distance value of each three-dimensional object, and then change the grayscale value of the pixel adjacent to the edge along the edge of the solid object side to make the three-dimensional object. The edges of the edges show a thick, light shadow. The user can also know the distance of the three-dimensional object by the shadow concentration of each three-dimensional object.

In another embodiment, the stereo information may also be line width information. . The different distance data recorded in the comparison table 148 corresponds to different line widths, for example, the distance value is less than 3 meters, the line width is 10 pixels wide; the distance is more than 3 meters to 10 meters, and the line width is 9 pixels are wide, and so on. The stereo information fusion unit 144 may select a relative line width according to the distance data corresponding to the distance value, and change the content of the adjacent pixels along the edge of the three-dimensional object according to the selected line width to make the edge of the three-dimensional object Different contour widths can be displayed as the distance value. As shown in the seventh figure, according to the difference in the contour width of the three-dimensional object, it can be seen that the three-dimensional object 201a and 203a in the seventh figure are relatively far apart, and the distance of the three-dimensional object 206a is longer than that of the three-dimensional object 206a. Object 203a is further away.

The stereoscopic information fusion unit 144 changes the outline appearance of each of the three-dimensional objects in the reference image according to the corresponding stereoscopic information based on the image of the reference image to generate a corrected image, and transmits the corrected image to the display unit 16 for display.

The warning comparison unit 146 reads the distance value temporarily stored by the temporary storage unit 142 and compares it with the preset threshold value. When it is determined that the specific distance value is less than or equal to the threshold value, a warning message is generated. The alert message in this embodiment may be a voice message, such as a continuous and short prompt tone; the alert unit 18 may be a sound amplifying device for receiving and playing a sound message to draw the user's attention. In another embodiment, the warning unit 18 can be a light-emitting device, such as a light-emitting diode (LED), blinking according to the warning message sent by the warning comparison unit 146, prompting the user to be too close to the three-dimensional object.

In order to ensure the safety of the user with binocular visual defects, in another embodiment, the alert comparison unit 146 can simultaneously generate an alert message to the display unit 16, and output an alert message to the alert unit 18, so that the user is too When approaching a three-dimensional object, you can receive multiple warnings at the same time, such as listening The prompt sound outputted to the sound amplification device and the warning text on the display unit 16 are used to prevent the user from colliding with the three-dimensional object.

In another embodiment, the stereo information fusion unit 144 can convert the three-dimensional object in the two-dimensional plane in the planar image according to the difference between the image and the angle of the reference image and the reference image of the three-dimensional object. A perspective view having a stereoscopic effect is presented on the display unit 16 with a numerical value of the distance value to provide another corrected image for the user to view. When the human eyes receive the image images respectively, the image viewing angles received by the left and right eyes are slightly different due to the difference in the distance between the eyes. The image capturing units 10 and 12 in this embodiment are also the same.

Please refer to FIG. 4A and FIG. 4B respectively to display schematic diagrams of the reference image 4a and the reference image 4b generated by the image capturing units 10 and 12 capturing images of the same three-dimensional object. The reference image 4a has more picture details of the left side view than the reference image 4b, that is, 42 blocks in the image, and the reference image 4b includes the picture detail of the right side view not displayed by the reference image 4a, that is, the area 44. Piece. The stereo information fusion unit 144 can extract features of the three-dimensional object, such as color, texture or shape, according to the reference image and the reference image, and find corresponding parts of the three-dimensional object in the two images, such as the reference image 4a and the reference image. The 40a of 4b and the 40b block correspond to each other.

The stereoscopic information fusion unit 144 can integrate the reference image 4a with a portion unique to the reference image 4b, so that the generated corrected image 4c (refer to the fourth C map) simultaneously displays the image image of the reference image 4a image and the reference image 4b. . As shown in FIG. 4C, the stereoscopic object displayed on the corrected image 4c is based on the reference image 4a, and includes a 40a region corresponding to the image in the two images, a 42 region of the reference image 4a, and a 44 region of the reference image 4b, and is utilized. The effect of a glossy or dark surface to reveal the stereoscopic effect of the merged object fruit. For example, in the fourth C, the regions 42a and 44a are respectively indicated by a dark surface, and the region 40a is represented by a glossy surface. In other embodiments, the stereoscopic information may be expressed only by the 40a of the glossy surface with the single dark side 42a or 44a. To provide the user with the basis for judging it as a three-dimensional object.

The fifth figure provides a flowchart of the first embodiment of the stereoscopic information compensation method. Please refer to the first figure for explanation. In the embodiment of the method, a plurality of image capturing units 10 and 12 disposed at the same viewing line and spaced apart by a certain width respectively capture a planar image of the same scene (S501), and each planar image includes the same at least A three-dimensional object. The plane image captured by the image capturing unit 10 is a reference image, and the plane image captured by the image capturing unit 12 is a reference image.

In the plurality of planar images, due to the difference in position of the image capturing units 10 and 12, the positions of the same three-dimensional object in the planar image displayed in the reference image and the reference image do not completely overlap.

The image capturing units 10 and 12 transmit the planar images to the image processing unit 14 for processing. The distance computing unit 140 performs image correspondence analysis to identify the same three-dimensional object in the reference image and the reference image; and calculates the aberration between the reference image and the reference image according to the pixel data of the three-dimensional object (S503) ). The distance calculating unit 140 further calculates the distance value of the three-dimensional object with respect to the eye-level line based on the width of the space between the image capturing units 10 and 12 and the aberration of the three-dimensional object (S505).

The distance operation unit 140 records the calculated distance values of the respective three-dimensional objects one by one to the temporary storage unit 142 (S507). The stereo information fusion unit 144 reads the stereo information of the three-dimensional object from the temporary storage unit 142, that is, the value of the distance value corresponding to each three-dimensional object, and based on the image of the reference image. Basically, the distance value of the temporary storage unit 142 is fused to the corresponding three-dimensional object in the image (S509) to generate a corrected image (S511), and transmitted to the display unit 16 for display. In the corrected image, the picture of the three-dimensional object and the distance value corresponding to each three-dimensional object are integrated.

The alert comparison unit 146 can also read the distance values recorded in the temporary storage unit 142 and compare them with a preset threshold value to determine whether any distance value is equal to or smaller than a preset threshold. Value (S513).

If the warning comparison unit 146 determines that all the distance values are greater than the threshold value, the distance between each three-dimensional object and the eye level in the scene is maintained at a safe distance, so that the user does not collide with any stereo. For the object, the warning comparison unit 146 does not generate a warning message, and the display unit 16 can simply display the corrected image with the added stereo information (S515) for the user to view and acquire between the three-dimensional objects and the user in the image. the distance.

On the other hand, if the warning comparison unit 146 determines that any distance value is less than or equal to the threshold value, the distance between the eye level line and the at least one three-dimensional object is too close, which may cause the user to collide with the three-dimensional object. The alert comparison unit 146 can generate a warning message (S517), such as a warning text. Then, the corrected image and the warning text are transmitted to the display unit 16, and the corrected image including the stereoscopic information and the warning message are displayed by the display unit 16 (S519).

The sixth figure further provides a flowchart of the second embodiment of the stereoscopic information compensation method. Please refer to the block diagram shown in the second figure. In the embodiment, the plurality of image capturing units 10 and 12 capture the complex planar image for the same scene (S601), and the distance computing unit 140 performs the image correspondence analysis to find the three-dimensional object commonly included in the planar image, and Calculating the aberration of the three-dimensional object (S603), and using the aberration and image capturing unit 10, 12 After calculating the distance value of the three-dimensional object (S605), the calculated distance value of the one or more three-dimensional objects is temporarily stored in the temporary storage unit 142 (S607).

The difference from the flow shown in FIG. 5 is that in the embodiment shown in FIG. 6 , the stereo information fusion unit 144 reads a distance value from the temporary storage unit 142 and compares the comparison table 148 with the distance value. The record in the middle to obtain a stereoscopic information corresponding to the distance value (S609). The comparison table 148 records a plurality of stereoscopic information, each stereoscopic information corresponds to a distance data, and the stereo information fusion unit 144 compares the read distance values with the distance data recorded by the comparison table 148. When it is determined that the distance value in the comparison matches one of the distance data, the stereo information corresponding to the distance data is selected to specify the stereoscopic information of the three-dimensional object corresponding to the distance value (S611). .

When the stereo information fusion unit 144 completes the comparison of the distance values recorded by the temporary storage unit 142, and reads the stereo information corresponding to each distance value, the stereo information is read based on the image of the reference image. The stereoscopic information is integrated into the three-dimensional object in the image to generate a corrected image (S613). The stereoscopic information in this embodiment may include color information, shadow density information or line width information. The stereo information fusion unit 144 may modify the contour of each three-dimensional object in the image according to the stereo information, by changing the three-dimensional object on the planar image. A two-dimensional outline of the outline to indicate the distance of the three-dimensional object. For example, in the schematic diagram shown in FIG. 7 , the stereo information fusion unit 144 generates the contours of different widths according to the distance values according to the stereo information of the three-dimensional objects 201 a to 206 a, corresponding to the second map. The distance value of the illustrated embodiment, wherein the distance values of the three-dimensional objects 201a and 202a are the same and closest, and thus are presented A wider outline line is formed; in contrast, the three-dimensional object 206a having the largest distance value (that is, the farthest distance) has a thin outline line. Thereby, the user is assisted to determine the distance of the three-dimensional object according to the sharpness of the contour of the three-dimensional object. The display of the difference between the dark and the light of the shadow density is also the same principle and will not be described again. For further details of this embodiment, please refer to the embodiment of the second figure.

The warning comparison unit 146 also reads the distance value temporarily stored by the temporary storage unit 142, and compares it with the preset threshold value to determine whether any distance value is equal to or smaller than the threshold value (S615): if each three-dimensional object The distance value is greater than the threshold value, and the display unit 16 can display the corrected image generated by the stereo information fusion unit 144 (S617); but if any distance value is detected to be equal to or smaller than the threshold value, the alert comparison unit 146 That is, a warning message (S619) is generated, such as a beep or flash, and the warning unit 18 outputs an alert message while the display unit 16 displays the corrected image (S621).

According to the technical means described in the above embodiments, it has been revealed that the present invention can capture images by simulating a user's eyes through a plurality of image capturing units, and uses image processing and calculation means to calculate the image included in the plane image. The distance between the three-dimensional object and the eye level, and then provide visual auxiliary information according to the distance and proximity of the different distances, so that the user who cannot recognize the distance of the three-dimensional object can obtain visually through the additional stereo information. The assistance to achieve the effect of compensating for visual defects and reducing the inconvenience of the user's daily life.

Even if the user is not an eye defect, and the defect of the stereoscopic information fusion function of the brain is caused by lack of binocular vision, the perception of the distance of the three-dimensional object can be cultivated by simple training by the technical means disclosed by the present invention. Estimate the ability to achieve distance or stereo information loss compensation Standard.

At the same time, the technology is supplemented with various warning messages to provide users with an early warning mechanism for possible collisions, and also to reduce the user's safety problems caused by visual defects in both eyes.

In addition, the technical means disclosed in the present invention can be implemented by a software program, and the program code is recorded in a memory connected to the image processing unit, or burned as a firmware, and read and executed by the image processing unit without complicated. The circuit design is easy to update, and has the advantages of reducing the manufacturing cost of the hardware device and not occupying the volume.

However, the elements and steps of the above-described embodiments are merely illustrative of the invention and are not intended to limit the scope of the claimed invention. It is also within the scope of the present invention to modify or modify the micro-frames in accordance with the spirit of the present invention and the technical means disclosed herein.

1,1a‧‧‧stereoscopic visual compensation system

10‧‧‧Image capture unit

12‧‧‧Image capture unit

14,14a‧‧‧Image Processing Unit

140‧‧‧distance unit

142‧‧‧ temporary storage unit

144‧‧‧Three-dimensional information fusion unit

146‧‧‧Warning comparison unit

148‧‧‧ comparison table

16‧‧‧Display unit

18‧‧‧Warning unit

20,20a‧‧‧Correct image

201-206, 201a-206a‧‧‧Three-dimensional objects

211-216‧‧‧Value

4a‧‧‧ benchmark image

4b‧‧‧Reference image

4c‧‧‧Correct image

40a, 40b, 42, 42a, 44, 44a‧‧‧ image area

S501-S519‧‧‧ Process steps

S601-S621‧‧‧ Process steps

The first figure is a block diagram of a first embodiment of a stereoscopic information compensation system provided by the present invention; the second figure is a schematic diagram of a corrected image provided by the present invention; and the third figure is a stereoscopic information provided by the present invention. A block diagram of a second embodiment of the compensation system; a fourth diagram A: a schematic diagram of a reference image embodiment; a fourth diagram B: a schematic diagram of a reference image embodiment; a fourth C diagram: a schematic diagram of a corrected image embodiment; and a fifth diagram: the present invention A schematic diagram of a stereoscopic visual information compensation method according to a first embodiment; a sixth figure: a stereoscopic information compensation method provided by the present invention A flow chart of two embodiments; and a seventh figure: another schematic image of the corrected image provided by the present invention.

1‧‧‧ Stereoscopic visual information compensation system

10‧‧‧Image capture unit

12‧‧‧Image capture unit

14‧‧‧Image Processing Unit

140‧‧‧distance unit

142‧‧‧ temporary storage unit

144‧‧‧Three-dimensional information fusion unit

146‧‧‧Warning comparison unit

16‧‧‧Display unit

Claims (21)

A method for compensating stereoscopic information includes: capturing, by a plurality of image capturing units disposed on the same eye level, a plurality of planar images of different angles for the same scene, wherein the planar images include at least one three-dimensional object of the scene, The image processing unit includes a reference image; an image processing unit calculates an aberration between the planar objects; and the image processing unit calculates the image according to the aberration and the distance between the image capturing units a distance value between the three-dimensional object and the eye-level line; according to the distance value, the image processing unit reads a comparison table, and the comparison table records a plurality of stereoscopic information corresponding to different distance data, respectively, by the image The processing unit compares the comparison table according to the distance value to obtain the stereoscopic information corresponding to the three-dimensional object; the stereoscopic information corresponding to the three-dimensional object is fused to the three-dimensional object in the reference image to generate a correction And outputting the corrected image to a display unit; wherein the stereoscopic information corresponding to the three-dimensional object is merged into the reference image The three-dimensional contour of the object is changed from the reference three-dimensional object based on the perspective image information; those wherein the ratio of the stereo information table records information as the color information of the width, the shadow density information or lines. The stereoscopic information compensation method of claim 1, wherein the calculating the distance value further comprises temporarily storing the distance value of the three-dimensional object in a temporary storage unit. The method for compensating the stereoscopic information according to the second aspect of the invention, wherein the step of fusing the stereoscopic information corresponding to the stereoscopic object to generate the corrected image according to the distance value comprises: reading the temporary storage unit The distance value temporarily stored; and the value of the distance value is fused to the reference image to indicate the distance of the three-dimensional object to generate the corrected image. The stereoscopic information compensation method according to claim 1, wherein when the stereoscopic information corresponding to the three-dimensional object is color information, the outline color of the three-dimensional object is changed according to the corresponding color information. The stereoscopic information compensation method according to claim 1, wherein when the stereoscopic information corresponding to the three-dimensional object is the shadow concentration information, the contour shadow density of the three-dimensional object is changed according to the corresponding shadow density information. . The stereoscopic information compensation method according to claim 1, wherein when the stereoscopic information corresponding to the three-dimensional object is line width information, the contour width of the three-dimensional object is changed according to the corresponding line width information. The stereoscopic information compensation method of claim 1, wherein the calculating the distance value further comprises temporarily storing the distance value of the three-dimensional object in a temporary storage unit. The stereoscopic information compensation method of claim 7, wherein the stereoscopic information corresponding to the three-dimensional object is fused to the three-dimensional object in the reference image, and further comprising: reading the temporary storage unit The distance value is fused to the corrected image to indicate the distance of the three-dimensional object. The method for compensating the stereoscopic information according to the second aspect of the invention, wherein the step of fusing the stereoscopic information corresponding to the stereoscopic object to generate the corrected image according to the distance value comprises: reading the temporary storage unit The distance value temporarily stored; and the difference region displayed by the three-dimensional object in the reference image and the reference image due to the difference in viewing angle is integrated into the reference image, and the value of the distance value is integrated into the integrated reference image To generate the corrected image. The stereoscopic information compensation method of claim 1, wherein before outputting the corrected image to the display unit, the method further comprises: determining whether the distance value is equal to or less than a threshold value, and if so, generating a warning message. The stereoscopic information compensation method of claim 10, wherein the outputting the correction image to the display unit further comprises: outputting the warning message to any one of the display unit and a warning unit or a combination thereof . A stereoscopic information compensation system includes: a plurality of image capturing units disposed on the same eye level, respectively capturing a plurality of plane images of different angles for the same scene, wherein the plane images include at least one three-dimensional object of the scene, and The image processing unit includes a reference image unit, including: a distance computing unit that calculates an aberration between the planar objects and the image capturing unit and the image capturing unit a distance, a distance value between the three-dimensional object and the eye level line is calculated; a temporary storage unit temporarily storing the distance value calculated by the distance computing unit; a comparison table, recording complex three-dimensional information, each of the three-dimensional information corresponding to a distance data; and a stereoscopic information fusion unit, according to the temporary storage The distance value temporarily stored by the unit and querying the comparison table to obtain a stereoscopic information corresponding to the three-dimensional object, and merging the stereoscopic information corresponding to the three-dimensional object into the three-dimensional object of the reference image to generate And a display unit that receives and displays the corrected image; wherein the stereoscopic information fusion unit changes an outline of the three-dimensional object of the reference image according to the stereoscopic information corresponding to the three-dimensional object; wherein the comparison table The recorded stereo information is color information, shadow density information or line width information. The stereoscopic information compensating system of claim 12, wherein the stereo information fusion unit reads the distance value recorded in the temporary storage unit, and fuses the value of the distance value to the reference image to indicate the The distance of the three-dimensional object to produce the corrected image. The stereoscopic information compensation system of claim 12, wherein the stereo information fusion unit reads the distance value recorded in the temporary storage unit, and fuses the value of the distance value to the corrected image to indicate the The distance of the three-dimensional object. The stereoscopic information compensation system of claim 12, wherein when the stereoscopic information corresponding to the three-dimensional object is color information, the stereo information fusion unit changes the three-dimensional object according to the color information. The outline color. The stereoscopic information compensation system of claim 12, wherein when the stereoscopic information corresponding to the three-dimensional object is the shadow concentration information, the stereo information fusion unit changes the contour shadow of the three-dimensional object according to the shadow concentration information. concentration. The stereoscopic information compensation system of claim 12, wherein when the stereoscopic information corresponding to the three-dimensional object is line width information, the stereo information fusion unit changes the contour width of the three-dimensional object according to the line width information. . The stereoscopic information compensating system of claim 12, wherein the stereoscopic information fusion unit integrates the difference image displayed by the stereoscopic image in the reference image and the reference image due to the difference in viewing angles, to the reference image, And reading the distance value recorded in the temporary storage unit, and merging the value of the distance value to the integrated reference image to generate the corrected image. The stereoscopic information compensation system of claim 12, wherein the image processing unit further comprises: a warning comparison unit, determining whether the distance value is less than or equal to a critical value, and the distance value is less than or A warning message is generated when the threshold is equal to. The stereoscopic information compensation system of claim 18, wherein the display unit receives and displays the alert message. The stereoscopic information compensation system of claim 18, further comprising: an alerting unit that outputs the alert message.