TWI507014B - System for calibrating three dimension perspective image and method thereof - Google Patents

Description

Three-dimensional fluoroscopic image correction method and system thereof

The following description relates to a method for correcting an image displayed on a screen and a system thereof, and more particularly, to an image correction in which a screen can be changed with a position or angle viewed by a user and a stereoscopic perspective of a three-dimensional perspective image is presented. Method and system.

In recent years, as operators have actively expanded their home three-dimensional (3D) display interfaces into the consumer market, human visual experience has moved from two-dimensional (2D) to 3D multimedia generations. In terms of interaction, the main decision is based on computing technology. The Remote Control and Touch Panel are calculated in 2D (only capturing the spatial position of the target, ie the X and Y axes), while the Motion Tracking technology, in addition to capturing the target. In addition to the spatial position (X-axis and Y-axis) and color, it can also capture the depth of the target (also known as the Z-axis), range, distance and its surroundings, which is called 3D operation. Therefore, the way of interaction has evolved from the past 2D computing method of mouse and joystick to the more humanized 3D interactive computing generation.

Infrared detection is an innovative 3D fluoroscopy technology. An infrared sensor is connected to a screen, and an infrared emitting device is mounted on the user. When the user moves, the infrared sensing device can be used by the infrared emitting device. Knowing the position of the user relative to the screen, using the location information to change the 3D image in the screen to the 2D of the screen, for example, when the user is away from the screen, the 3D image becomes smaller when used. When the screen is moved to the right, the 3D image is shifted to the left and zoomed out at the same time, so that the user has a stereoscopic perspective when viewing the 3D image.

However, in the above-mentioned 3D fluoroscopic image technology, while the screen is generated, the object on the screen is easily affected by the focal length of the lens to cause deformation such as a barrel shape or a pincushion shape, and if the deformation problem can be further solved, the user is watching. A 3D perspective image on the screen will have a better stereoscopic display experience.

The embodiment of the present invention is directed to a three-dimensional fluoroscopic image correction method and system thereof, which can correct the deformed image caused by the three-dimensional fluoroscopic image in the screen, so that the user can have a good stereoscopic display experience.

The embodiment of the present invention is directed to a three-dimensional fluoroscopic image correction method and system thereof. In addition to enabling the three-dimensional fluoroscopic image to be corrected in the horizontal direction, the method can directly apply the method to make the three-dimensional fluoroscopic image follow the user. Correct in the vertical direction.

According to the purpose of the present invention, a three-dimensional fluoroscopic image correction method is proposed, which is suitable for displaying a three-dimensional fluoroscopic image which changes with a position or angle viewed by a user and presents a stereoscopic perspective of the three-dimensional fluoroscopic image, and the three-dimensional fluoroscopic image correction The method comprises: setting a position of the user on a protruding axis of the screen and the three-dimensional fluoroscopic image as an origin (0, 0), and determining one of the screen coordinates (0, z1) and the three-dimensional fluoroscopic image of the screen on the protruding axis One of the original image coordinates (0, z2); when the user moves horizontally to a plurality of moving point coordinates (xi, 0), a processing unit calculates a plurality of original image coordinates (0, z2) to the origin (0, 0) an angle θ i formed by an edge formed by an original image coordinate (0, z2) to each of a plurality of moving point coordinates (xi, 0), where i is a positive integer greater than one; The three-dimensional fluoroscopic image is rotated by the plurality of moving point coordinates (xi, 0) according to each of the plurality of moving point coordinates (xi, 0) by a plurality of angles θ i; and the three-dimensional fluoroscopic image is used according to each of the plurality of moving points by using a movement correcting unit The coordinates (xi, 0) are Do not move to the corresponding plurality of new coordinates ((xi*z1)/z2, z1); and use a size correction unit to obtain the original image coordinates (0, z2) from the plurality of moving point coordinates (xi, 0) to The ratio of the distance of each of the plurality of moving point coordinates (xi, 0) to the distance between the original image coordinates (0, z2) and the origin (0, 0), and for each of the plurality of moving point coordinates (xi, 0) and each of its corresponding proportions to scale the size of the three-dimensional fluoroscopic image of the plurality of new coordinates ((xi*z1)/z2, z1).

More preferably, the processing unit comprises a central processing unit or a microprocessor.

More preferably, when each of the plurality of moving point coordinates (xi, 0) corresponds to each of the plurality of ratios greater than 1, the size correcting unit reduces the three-dimensional perspective image according to the multiple magnification, when each of the plurality of moving point coordinates ( When each of the plurality of ratios corresponding to xi, 0) is less than 1, the size correcting unit enlarges the three-dimensional fluoroscopic image according to the magnification.

More preferably, the angle correction unit, the motion correction unit or the size correction unit comprises a software application.

More preferably, the three-dimensional fluoroscopic image has a sense of perspective and a shape that retains the shape of the object.

According to the purpose of the present invention, a three-dimensional fluoroscopic image correction system is proposed, which is suitable for displaying a three-dimensional fluoroscopic image that changes with the position or angle of a user's viewing and presents a stereoscopic perspective of the three-dimensional fluoroscopic image. The calibration system includes: a processing unit that sets the position of the user on one of the protruding axes of the screen and the three-dimensional fluoroscopic image as an origin (0, 0), and determines one of the screen coordinates on the highlighted axis (0, z1) And one of the original image coordinates (0, z2) of the three-dimensional fluoroscopic image. When the user moves horizontally to a plurality of moving point coordinates (xi, 0), a plurality of original image coordinates (0, z2) are calculated to the origin (0). , 0) and the angle formed by side to each of the plurality of mobile coordinate points from the original image coordinates (0, z2) (xi, 0) formed by the edge constituted of [theta] i, where i is a positive integer greater than 1, An angle correction unit that rotates the three-dimensional fluoroscopic image according to each of the plurality of moving point coordinates (xi, 0) to respectively rotate the corresponding plurality of angles θ i; a movement correcting unit moves the three-dimensional fluoroscopic image according to each of the plurality of Point coordinates (xi, 0) to separate Move to the corresponding plurality of new coordinates ((xi*z1)/z2, z1); and a size correction unit to obtain the original image coordinates (0, z2) to each according to the plurality of moving point coordinates (xi, 0) The ratio of the distance between a plurality of moving point coordinates (xi, 0) and the distance between the original image coordinates (0, z2) and the origin (0, 0), and for each complex moving point coordinate (xi, 0) And each of its corresponding proportions to scale the size of the three-dimensional fluoroscopic image at a plurality of new coordinates ((xi*z1)/z2, z1).

More preferably, the processing unit comprises a central processing unit or a microprocessor.

More preferably, when each of the plurality of moving point coordinates (xi, 0) corresponds to each of the plurality of ratios greater than 1, the size correcting unit reduces the three-dimensional perspective image according to the multiple magnification, when each of the plurality of moving point coordinates ( When each of the plurality of ratios corresponding to xi, 0) is less than 1, the size correcting unit enlarges the three-dimensional fluoroscopic image according to the magnification.

More preferably, the angle correction unit, the motion correction unit or the size correction unit comprises a software application.

More preferably, the three-dimensional fluoroscopic image has a sense of perspective and a shape that retains the shape of the object.

100‧‧‧3D Vision Image Correction System

10‧‧‧Processing unit

204‧‧‧ Origin position

111‧‧‧ origin

112‧‧‧Screen coordinates

113‧‧‧ original image coordinates

114‧‧‧Mobile point coordinates

20‧‧‧Angle correction unit

30‧‧‧Moving correction unit

40‧‧‧Dimensional correction unit

S1~S5‧‧‧Step process

202‧‧‧3D Perspective Image Center

200‧‧‧3D fluoroscopic image

201‧‧‧ first image

203‧‧‧Second image

205‧‧‧Mobile Point

206‧‧‧Screen vertical position

207‧‧‧ third distance

208‧‧‧first distance

209‧‧‧New Center coordinates

210‧‧‧Second distance

211‧‧‧ Third image

212‧‧‧With barrel image

213‧‧‧Image with the shape of the original object

214‧‧‧ screen

215‧‧‧through shaft

216‧‧‧Users

The above and other features and advantages of the present invention will become more apparent from the detailed description of the exemplary embodiments illustrated in the accompanying drawings in which: FIG. 1 is a three-dimensional fluoroscopic image correction system according to an embodiment of the present invention. FIG. 2 is a first schematic diagram of a three-dimensional fluoroscopic image correction system according to another embodiment of the present invention; and FIG. 3 is a second schematic diagram of a three-dimensional fluoroscopic image correction system according to another embodiment of the present invention; Figure 4 is a third schematic view of a three-dimensional fluoroscopic image correction system according to another embodiment of the present invention; and Figure 5 is a first schematic view of a three-dimensional fluoroscopic image correction system according to a second embodiment of the present invention; 6 is a second schematic diagram of a three-dimensional fluoroscopic image correction system according to a second embodiment of the present invention; and FIG. 7 is a flow chart showing the steps of the three-dimensional fluoroscopic image correction method according to the third embodiment of the present invention.

As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items. When the phrase "at least one of" is preceded by a list of elements, the entire list of elements is modified instead of the individual elements in the list.

Please refer to FIG. 1 , which is a block diagram of a three-dimensional fluoroscopic image correction system according to an embodiment of the present invention. As shown in FIG. 1, the creation is suitable for displaying a three-dimensional fluoroscopic image 200 (not shown) that changes with the position or angle viewed by a user 216 and presents a three-dimensional perspective. A screen 214 of the stereoscopic perspective of the image 200, the three-dimensional fluoroscopic image correction system 100 includes a processing unit 10, an angle correction unit 20, a movement correction unit 30, and a size correction unit 40, wherein the angle correction unit 20 and the motion correction Unit 30 or size correction unit 40 includes a software application, and processing unit 10 includes a central processing unit or a microprocessor.

The processing unit 10 includes an origin 111, a screen coordinate 112, an original image coordinate 113, and a plurality of moving point coordinates 114. The origin 111 means that the user 216 is located at one of the through-screen 215 and the three-dimensional fluoroscopic image 200. In one of the upper positions, the screen coordinates 112 refer to the coordinates of the screen 214 on the through-shaft 215, and the original image coordinates 113 refer to a coordinate of the three-dimensional fluoroscopic image 200 passing through the axis 215.

When the user 216 moves horizontally to the plurality of moving point coordinates 114, the processing unit 10 calculates a plurality of edges formed by the original image coordinates 113 to the origin 111 and from the original image coordinates 113 to each of the plurality of moving point coordinates 114. The included angle θi, where i is a positive integer greater than one.

Then, the three-dimensional fluoroscopic image correction system 100 uses the angle correction unit 20 to rotate the three-dimensional fluoroscopic image 200 according to each of the plurality of moving point coordinates 114 to respectively rotate the corresponding plurality of angles θi; and then use the motion correction unit 30 to perform the three-dimensional fluoroscopic image. 200 according to each of the plurality of moving point coordinates 114 to respectively move to the corresponding plurality of new coordinates; finally, using a size correcting unit 40 to obtain the original image coordinates 113 to each of the plurality of moving point coordinates according to the plurality of moving point coordinates 114 a plurality of ratios of the distance of 114 from the original image coordinate 113 to the origin 111, and respectively scaling the three-dimensional fluoroscopic image of the plurality of new coordinates for each of the plurality of moving point coordinates 114 and each of the corresponding plurality of ratios 200 size.

Please refer to FIG. 2, which is a first schematic diagram of a three-dimensional fluoroscopic image correction system according to another embodiment of the present invention. As shown in FIG. 2, when the user 216 is located at an origin position 204 on the through-axis 215 of one of the screen 214 and the three-dimensional fluoroscopic image 200, the processing unit 10 sets the coordinates of the origin position 204 to (0, 0). The coordinates of the center of the three-dimensional fluoroscopic image are (0, Z2). When the user 216 moves horizontally to one of the plurality of moving points 205, the processing unit 10 can determine the coordinates of the moving point 205 by using infrared detection. Is (X1, 0), and determines an angle θ formed from the origin position 204 to the side of the three-dimensional fluoroscopic image center 202 and the edge from the origin position 204 to the moving point 205, at which time the angle correcting unit 20 is An angle θ rotates the three-dimensional fluoroscopic image 200 clockwise or counterclockwise to form a first image 201.

Please refer to FIG. 3, which is a second schematic diagram of a three-dimensional fluoroscopic image correction system according to another embodiment of the present invention. As shown in FIG. 3, on the through-axis 215 of the screen 214 and the three-dimensional fluoroscopic image 200, the distance from the origin position 204 to the vertical position 206 of the screen is equal to a first distance 208, the origin position 204 to the moving point 205. The distance is equal to a second distance 210, and the origin position 204 to the three-dimensional perspective image center 202 is equal to a third distance 207. At this time, the movement correction unit 30 is used to obtain a new center coordinate 209 of the first image 201. The position is ((X1*Z1)/Z2, Z1), and the user 216 can feel the original three-dimensional fluoroscopic image 200 as if it is following the user 216 when viewing the first image 201.

Please refer to FIG. 4, which is a third schematic diagram of a three-dimensional fluoroscopic image correction system according to another embodiment of the present invention. As shown in FIG. 4, a size correcting unit 40 determines the coordinates of the coordinates (0, Z2) of the three-dimensional fluoroscopic image 200 from the coordinates (X1, 0) of the moving point 205 and the coordinates of the three-dimensional fluoroscopic image 200 according to the moving point 205. The ratio of (0, Z2) to the distance of the coordinates (0, 0) of the origin position 204, and for this ratio is scaled to the first position on the coordinate position ((X1*Z1)/Z2, Z1) The image 201 is a second image 203. When the user 216 views the second image 203, the original three-dimensional fluoroscopic image 200 can be sensed not only to move along with the user 216 but also to have a three-dimensional effect. For example, when the ratio is greater than 1, it indicates that the three-dimensional fluoroscopic image 200 should be away from the user 216, and the three-dimensional fluoroscopic image 200 can be reduced at a multiple rate. Conversely, when the ratio is less than 1, the three-dimensional fluoroscopic representation is used. The image 200 should be close to the user 216, and the three-dimensional fluoroscopic image 200 can be enlarged at a magnification.

Please refer to FIG. 5 and FIG. 6 , which are a first schematic diagram and a second schematic diagram of a three-dimensional fluoroscopic image correction system according to a second embodiment of the present invention. As shown in FIG. 5, when a three-dimensional fluoroscopic image 200 is not viewed through the three-dimensional fluoroscopic image correction system 100 of the present invention, the edge of the three-dimensional fluoroscopic image 200 is moved to the right side of the image due to the focal length of the lens. When the image is gradually deformed, when moving to the rightmost side, it appears to contain a barrel-shaped image 212, and the three-dimensional fluoroscopic image 200 is corrected by the created three-dimensional fluoroscopic image correction system 100. At this time, the edge or other position of the three-dimensional fluoroscopic image 200 may include an image 213 of the original object shape. As shown in FIG. 6, it is known that the three-dimensional fluoroscopic image 200 generated by the three-dimensional fluoroscopic image correction system 100 has A sense of perspective and a characteristic of maintaining the shape of the object.

Please refer to FIG. 7, which is a flow chart of the steps of the three-dimensional fluoroscopic image correction method according to the third embodiment of the present invention. As shown in FIG. 7, step S1 sets the position of the user 216 on the through-axis 215 of the screen 214 and the three-dimensional fluoroscopic image as an origin (0, 0), and determines the screen 214 on the through-axis 215. A screen coordinate 112 (0, z1) and one of the original image coordinates (0, z2) of the three-dimensional fluoroscopic image, such as the origin position 204 in FIG. 2, the screen coordinates are located at the origin position 204 to the center of the three-dimensional fluoroscopic image 202 Through the shaft 215 and from the origin position 204 is Z1 unit length, step S2 is when the user moves horizontally to a plurality of moving point coordinates (xi, 0), and a processing unit calculates a plurality of original image coordinates (0, Z2) an angle θ i formed by the edge formed by the origin (0, 0) and the edge formed by the original image coordinate (0, z2) to each of the plurality of moving point coordinates (xi, 0), step S3 The angle-correcting unit is configured to rotate the three-dimensional fluoroscopic image according to each of the plurality of moving point coordinates (xi, 0) to respectively rotate the corresponding plurality of angles θ i , such as the first image 201 after the rotation of the θ angle in FIG. 2 , Step S4 uses a motion correction unit to view the three-dimensional perspective image according to each of the plurality of moving point coordinates (xi, 0). Do not move to the corresponding plurality of new coordinates ((xi * z1) / z2, z1), such as the second image 203 generated in Figure 3, step S5 uses a size correction unit according to a plurality of moving point coordinates (xi , 0) Find the distance between the original image coordinates (0, z2) to the distance of each of the plurality of moving point coordinates (xi, 0) and the distance between the original image coordinates (0, z2) and the origin (0, 0) Proportion, and for each complex moving point coordinate (xi, 0) and its corresponding multiple ratios to scale the size of the three-dimensional fluoroscopic image in a plurality of new coordinates ((xi * z1) / z2, z1) , the third image 211 generated as shown in FIG.

It can be seen from the above that through the creation, the three-dimensional fluoroscopic image can prevent the object on the screen from being affected by the focal length of the lens and generate deformation such as a barrel shape or a pincushion shape when the screen is generated on the screen. The method of the present invention can correct the horizontal direction. The three-dimensional fluoroscopic image can also be directly used to correct the three-dimensional fluoroscopic image in the vertical direction, so that the user can have a good stereoscopic display experience when viewing the three-dimensional fluoroscopic image on the screen, whether moving horizontally or vertically.

The present invention has been particularly shown and described with reference to the exemplary embodiments thereof, and it is understood by those of ordinary skill in the art And the scope can be used in form and detail Various changes. The advantages and features of the present invention, as well as the technical methods of the present invention, are described in more detail with reference to the exemplary embodiments and the accompanying drawings. The embodiments of the present invention are to be construed as being limited by the scope of the present invention, and the invention The scope of the patent application is defined.

100‧‧‧3D Vision Image Correction System

10‧‧‧Processing unit

111‧‧‧ origin

112‧‧‧Screen coordinates

113‧‧‧ original image coordinates

114‧‧‧Mobile point coordinates

20‧‧‧Angle correction unit

30‧‧‧Moving correction unit

40‧‧‧Dimensional correction unit

Claims (10)

A three-dimensional fluoroscopic image correction method is suitable for displaying a three-dimensional fluoroscopic image that changes with a position or angle viewed by a user and presents a stereoscopic perspective of the three-dimensional fluoroscopic image. The three-dimensional fluoroscopic image correction method includes: setting the The position of the user on the protruding axis of the screen and one of the three-dimensional fluoroscopic images is an origin (0, 0), and determines a screen coordinate (0, z1) of the screen on the protruding axis and the three-dimensional perspective One of the original image coordinates (0, z2); when the user moves horizontally to a plurality of moving point coordinates (xi, 0), a processing unit calculates a plurality of original image coordinates (0, z2) to the original edge angle [theta] i (0,0) and formed to each of the plurality of coordinates of the moving point in the original image coordinates (0, z2) (xi, 0) formed by the edges of the formed, wherein i is greater than a positive integer of 1; using an angle correction unit to rotate the three-dimensional perspective image according to each of the plurality of moving point coordinates (xi, 0) to respectively correspond to the plurality of angles θ i; using a motion correction unit The three-dimensional perspective image is moved according to each of the plurality of The point coordinates (xi, 0) are respectively moved to the corresponding plurality of new coordinates ((xi*z1)/z2, z1); and are obtained by using a size correcting unit according to the plurality of moving point coordinates (xi, 0) a plurality of ratios of the distance between the original image coordinates (0, z2) to each of the plurality of moving point coordinates (xi, 0) and the distance between the original image coordinates (0, z2) and the origin (0, 0) And for each of the plurality of moving point coordinates (xi, 0) and each of the corresponding plurality of ratios to respectively scale the three-dimensional perspective of the plurality of new coordinates ((xi*z1)/z2, z1) The size of the image. The method of three-dimensional fluoroscopic image correction according to claim 1, wherein the processing unit comprises a central processing unit or a microprocessor. The three-dimensional fluoroscopic image correction method of claim 1, wherein the size correcting unit is based on each of the plurality of moving point coordinates (xi, 0) corresponding to each of the plurality of ratios greater than one The magnification is used to reduce the three-dimensional fluoroscopic image. When each of the plurality of moving point coordinates (xi, 0) corresponds to each of the plurality of ratios being less than 1, the size correcting unit enlarges the three-dimensional fluoroscopic image according to the magnification. The three-dimensional fluoroscopic image correction method according to claim 1, wherein the angle correction unit, the movement correction unit or the size correction unit comprises a software application. The three-dimensional fluoroscopic image correction method according to claim 1, wherein the three-dimensional fluoroscopic image has a fluoroscopic feeling and a shape for maintaining an object shape. A three-dimensional fluoroscopic image correction system is adapted to display a three-dimensional fluoroscopic image that changes with a position or angle viewed by a user and presents a stereoscopic perspective of the three-dimensional fluoroscopic image, the three-dimensional fluoroscopic image correction system comprising: a process a unit that sets the position of the user on the highlighted axis of the screen and the three-dimensional fluoroscopic image as an origin (0, 0), and determines a screen coordinate (0, z1) of the screen on the protruding axis And an original image coordinate (0, z2) of the three-dimensional fluoroscopic image, when the user moves horizontally to a plurality of moving point coordinates (xi, 0), and calculates a plurality of original image coordinates (0, z2) to the original edge angle [theta] i (0,0) and formed to each of the plurality of coordinates of the moving point in the original image coordinates (0, z2) (xi, 0) formed by the edges of the formed, wherein i is greater than a positive integer of 1; an angle correcting unit, respectively rotating the three-dimensional fluoroscopic image according to each of the plurality of moving point coordinates (xi, 0) corresponding to the plurality of angles θ i; a movement correcting unit, The three-dimensional perspective image is based on each of the plurality of moving point seats (xi, 0) to respectively move to the corresponding plurality of new coordinates ((xi * z1) / z2, z1); and a size correcting unit, and obtain the original according to the plurality of moving point coordinates (xi, 0) a ratio of the distance between the image coordinates (0, z2) to each of the plurality of moving point coordinates (xi, 0) and the distance between the original image coordinates (0, z2) and the origin (0, 0), and And for each of the plurality of moving point coordinates (xi, 0) and each of the corresponding plurality of ratios to respectively scale the three-dimensional fluoroscopic image of the plurality of new coordinates ((xi*z1)/z2, z1) size. The three-dimensional fluoroscopic image correction system of claim 6, wherein the processing unit comprises a central processing unit or a microprocessor. The three-dimensional fluoroscopic image correction system of claim 6, wherein when each of the plurality of moving point coordinates (xi, 0) corresponds to each of the plurality of ratios greater than 1, the size correcting unit is The magnification is used to reduce the three-dimensional fluoroscopic image. When each of the plurality of moving point coordinates (xi, 0) corresponds to each of the plurality of ratios being less than 1, the size correcting unit enlarges the three-dimensional fluoroscopic image according to the magnification. The three-dimensional fluoroscopic image correction system of claim 6, wherein the angle correction unit, the movement correction unit or the size correction unit comprises a software application. The three-dimensional fluoroscopic image correction system of claim 6, wherein the three-dimensional fluoroscopic image has a sense of perspective and a shape that maintains the shape of the object.