TWI572899B - Augmented reality imaging method and system - Google Patents

Description

Augmented reality imaging method and device thereof

An augmented reality imaging method and device thereof, in particular, an imaging method and a device thereof for forming a stereoscopic image by using visual residual.

In addition to providing general images and colors, display technology has also been developed in the direction of 3D in order to meet people's needs for more realistic images.

The current 3D display technology is mainly divided into two categories: glasses-type display technology and naked-eye 3D display system. The former is required to wear glasses and other accessories, so it will cause inconvenience to the user, and the latter is mainly divided into a full-image type. Volumetric, multi-planar, 2D multiplexed, although the above method allows users to directly view stereoscopic images without special accessories, but the technology still has its limitations, such as the image size of the holographic image is affected by Limited to acousto-optic modulator crystals; volumetric images are limited by the principle of actuation, and the image at the rotating axis is less clear; multi-planar must provide multiple displays and must be on the front of the display for better viewing Quality; 2D multiplex is to provide two different images of the left and right eyes, so that the viewer's brain can integrate the images of the left and right eyes into a stereoscopic image, but this method requires higher accuracy of image position calculation.

Therefore, how to further provide a new 3D display technology with lower equipment cost and simpler structure is still a problem to be solved in the industry.

Therefore, in order to improve the difficulty of the existing stereoscopic imaging technology, the creator is devoted to research and develops an augmented reality imaging method, which includes the following steps: A. generating a plurality of planar images by at least one image output unit, each plane image generating a different time, And the planar image is a planar image of different depth positions in a complete stereoscopic image; B. projecting the planar image to a corresponding depth position to combine the planar image to form the complete stereoscopic image by visual residual.

Further, in step A, an image is captured by an image capturing unit from a card to adjust a planar image output by the image output unit according to the image.

Further, the planar image is imaged by sequentially passing through a mirror, a focusing lens, and another mirror.

Further, in step B, the relative position of the image output unit and the focus lens is adjusted, so that the planar image is focused and imaged at different imaging positions.

Further, the dwell time of each planar image focused imaged at different imaging positions is between 0.01 seconds and 1 second.

The present invention is also an augmented reality imaging device, comprising: at least one image output unit for providing a plurality of planar images at different depth positions in a complete stereoscopic image, each planar image projecting time is different, and the time provided by the planar image is The order is determined according to the different depth positions; an imaging module is configured to receive the planar image and focus the image to be imaged; and a focus position adjustment module is coupled to the image output unit and the imaging module. According to the sequence of the different depth positions, the planar image is sequentially focused and imaged at different imaging positions corresponding to the depth position, so that the planar image is combined by visual residual to form the complete stereoscopic image.

The image capturing unit is configured to capture an identification image from a card, and the control terminal is connected to the image output unit, and the control terminal adjusts the image output according to the identification image. A planar image of the unit output.

Further, the imaging module includes a second mirror and a focusing lens disposed between the two mirrors to reflect the planar image from one of the mirrors to the focusing lens, and the other mirror reflects the planar image To the aforementioned imaging position.

Further, the focus position adjustment module relatively shifts the image output unit and the focus lens to focus the image on the image forming position.

The effect of this creation is:

1. The invention utilizes the technology of visual residual principle to make the stereoscopic image appear more vivid, rather than a simple static display, which is easy to attract the attention of the viewer.

2. The device of the present invention utilizes the principle of visual residual, so that the planar image can exhibit the effect of stereoscopic image, and the desired structure of the image is simpler, which helps to further reduce the cost of the product.

3. The image forming method of the present invention can be applied to various fields. For example: industrial product display, museum interactive experience, medical rehabilitation, etc., a wide range of applications.

(1)‧‧‧Image output unit

(2) ‧‧‧ imaging module

(21)‧‧‧Mirror

(22)‧‧‧focus lens

(3) ‧‧‧ Focus Position Adjustment Module

(4) ‧‧‧Image capture unit

(41)‧‧‧Tuca

(5) ‧ ‧ control terminal

[First figure] is a schematic perspective view of an embodiment of the present invention.

[Second figure] is a schematic diagram of a system architecture of an embodiment of the present invention.

[Third Figure] is a side view of an embodiment of the present invention.

[Fourth A] is a schematic diagram 1 of the state in which the stereoscopic image is adjusted according to the angle of the card according to the embodiment of the present invention.

[Fourth B] is a schematic diagram 2 of the state in which the stereoscopic image is adjusted according to the angle of the card according to the embodiment of the present invention.

[Fourth C] is a schematic diagram 3 of the state in which the stereoscopic image is adjusted according to the angle of the card according to the embodiment of the present invention.

[Fifth Figure] is a schematic flow chart of steps used in the embodiment of the present invention.

[Sixth Drawing] is a schematic view showing the state of use of the embodiment of the present invention.

In summary of the above technical features, the main effects of the augmented reality imaging device of the present invention will be apparent from the following embodiments.

Please refer to the first figure and the second figure first, which discloses the extended reality imaging device of the present invention, which mainly comprises: an image output unit (1) for providing a plurality of plane images of different depth positions in a complete stereo image, each The time of projection of a plane image is different, and the time sequence provided by the plane image is determined according to the different depth positions. In detail, the image output unit (1) stores the aforementioned planar image or transmits the planar image by the distal end, and cooperates with the image switching technology to form a visual residual (between 0.01 seconds and 1 second) speed switching. Each of the aforementioned planar images.

It should be added that the image processing technology can be used to obtain the general 2D image according to the distance of the image from the gray level (Graph Level) image by using the image processing technology to obtain multiple plane images of different depth positions. 000 (farthest) to 255 (recent) to represent, and create a "depth map" exactly the same size as the corresponding 2D image; then, the technology of DIBR (Depth Image Based Rendering) will correspond to this "depth map" The 2D image can be processed into a desired "multi-view 3D stereoscopic image", but this is a conventional technique and will not be described in detail.

Please also refer to the third figure, which further includes an imaging module (2) for receiving the planar image and focusing the planar image. Specifically, the imaging module (2) includes a second mirror (21) and a focusing lens (22) disposed between the two mirrors (21) to reflect the planar image from one of the mirrors to the mirror The focusing lens (22) is reflected by the other mirror (21) to the aforementioned imaging position. Since the planar image is reflected twice by the two mirrors (21), the opposite phenomenon of the planar image can be avoided, and the imaging of the planar image and the planar image is also rotated by the position of the mirror (21). °, so the imaging of the planar image is also There is no upside down problem. Further, the focus lens (22) is preferably a Fresnel lens to greatly reduce the thickness, weight and volume of the lens. Make the overall structure lighter.

A focus position adjustment module (3) is connected to at least one of the image output unit (1) and the imaging module (2) for sequentially focusing and imaging the planar image in accordance with the order of the different depth positions. The different imaging positions of the depth position are combined to form the complete stereoscopic image by visual residual, and the focus position adjustment module (3) relatively shifts the image output unit (1) and the focusing lens (22). The aforementioned planar image is focused and imaged at the aforementioned imaging position.

The focus image position may also be configured with a floating projection screen or an aerosol with suspended particles for the image to be projected onto the floating projection screen or the aforementioned aerosol.

Specifically, the focus position adjustment module (3) may be a displacement module such as a linear motor or a piezoelectric motor to linearly shift the focus lens (22) of the image output unit (1) or the imaging module (2). And adjust the aforementioned imaging position. However, it is not limited to this, and the main purpose is only to adjust the aforementioned imaging position.

Further comprising an image capturing unit (4) and a control terminal (5), the image capturing unit (4) is configured to capture an identification image from a card (41), and the control terminal (5) is connected to the image The image output unit (1), the control end (5) adjusts the planar image output by the image output unit (1) according to the identification image. In detail, please refer to the fourth A picture, the fourth B picture and the fourth C picture, the image capturing unit (4) is a camera (wed camera) to read the image on the picture card (41), And transmitting to the control terminal (5), the control terminal (5) will search for the corresponding image file according to the image on the card (41) to output a corresponding plane image to the image output unit (1). When the user adjusts the angle or distance of the card (41), the size of the image capturing unit (4) of the image capturing unit (4) is changed, so that the control terminal (5) can determine the card (41). The angle and the distance of the deflection, and then the size of the aforementioned planar image is adjusted according to the angle of deflection and the distance of the analysis. However, the above-mentioned manner of determining the angle and the distance is merely an example, and it is also possible to determine different reference criteria such as the user's hand image, or to combine other equivalent methods such as ranging sensing elements.

For the use, please refer to the fifth and sixth figures, and with the second picture, the user selects a card (41) and moves the card (41) to the corresponding image capturing unit ( 4) a position by which the image capturing unit (4) captures an identification image from the card (41) and transmits it to the control terminal (5), and the control terminal (5) will be based on the identification image Select the flat image output from the image output unit (1).

The image output unit (1) will sequentially generate a plurality of plane images, each plane image is generated at different times, and the plane images are respectively plane images of different depth positions in a complete stereo image, and each plane image is sequentially ordered. Imaging is performed by a mirror (21), a focusing lens (22) and another mirror (21).

Then, the relative position of the image output unit (1) and the focus lens (22) is adjusted by the focus position adjustment module (3), so that the plane image is projected at a corresponding depth position, and each plane image is focused and imaged. The dwell time of the different imaging positions is between 0.01 seconds and 1 second to combine the aforementioned planar images to form the complete stereoscopic image by visual residual.

In view of the above description of the embodiments, the above-described embodiments are merely a preferred embodiment of the present invention, and the implementation of the present invention is not limited thereto. The scope, that is, the simple equivalent changes and modifications made in accordance with the scope of the patent application and the content of the creation of the creation, are within the scope of this creation.

(1)‧‧‧Image output unit

(2) ‧‧‧ imaging module

(21)‧‧‧Mirror

(22)‧‧‧focus lens

(3) ‧‧‧ Focus Position Adjustment Module

(4) ‧‧‧Image capture unit

(41)‧‧‧Tuca

(5) ‧ ‧ control terminal

Claims (8)

An augmented reality imaging method includes the following steps: A. generating a plurality of planar images by at least one image output unit, each planar image generating a different time, and the planar images are respectively planar images of different depth positions in a complete stereoscopic image. B. The planar image is sequentially projected through a mirror, a focusing lens and another mirror and projected to a corresponding depth position, so that the planar image is combined to form the complete stereoscopic image by visual residual. For example, in the extended reality imaging method described in claim 1, in step A, an image capturing unit first captures an identification image from a card to adjust the output of the image output unit according to the identification image. Planar imagery. In the extended reality imaging method described in claim 1, in step B, the relative position of the image output unit and the focus lens is adjusted, so that the planar image is focused and imaged at different imaging positions. The augmented reality imaging method of claim 1, wherein each planar image is imaged at different imaging positions with a dwell time of between 0.01 seconds and 1 second. An augmented reality imaging device includes: at least one image output unit for providing a plurality of plane images at different depth positions in a complete stereo image, each plane image is projected at different times, and the time sequence provided by the plane image is based on Determined by the different depth positions; an imaging module, the imaging module includes a second mirror and a focusing lens disposed between the two mirrors to reflect the planar image from one of the mirrors to the focusing lens, and Reflecting the planar image to the image forming position by another mirror; and a focus position adjusting module connecting at least one of the image output unit and the imaging module for sequentially according to the order of the different depth positions The planar image is focused and imaged at different imaging positions corresponding to the depth position, so that the planar image is combined by visual residual to form the complete stereoscopic image. The augmented reality imaging device of claim 5, further comprising an image capturing unit and a control end, wherein the image capturing unit is configured to capture an identification image from a card, and the control terminal is connected. The image output unit adjusts the planar image output by the image output unit according to the identification image. The augmented reality imaging device of claim 5, wherein the focus position adjustment module causes the image output unit and the focus lens to be relatively displaced to focus the image on the image forming position. . The augmented reality imaging device of claim 5, wherein the imaging time of each planar image focused on different imaging positions is between 0.01 seconds and 1 second.