TWI647424B - Sensing device for calculating information on position of moving object and sensing method using the same - Google Patents

Abstract

The present invention provides a sensing device and a sensing method capable of being accurately performed by a simple method in an image obtained by photographing an object motion such as a golf club having an indeterminate shape, size, material, reflectance, or the like. And stably extracting the object of motion, the sensing method of the sensing device for calculating the position information of the object of the motion according to the present invention includes the step of continuously acquiring an image from the perspective of observing the object of the motion; a step of forming a difference operation image of two consecutive difference operation images with respect to each difference operation image of each of the images acquired continuously; and a difference between the two consecutive difference operation images The operation image, the step of calculating the position information of the object of the motion.

Description

 Sensing device for calculating position information of a moving object and sensing method using the same  

The present invention pertains to a sensing device capable of continuously acquiring an image of a moving object and analyzing the object, extracting the object from each image, and calculating position information of the object, and a sensing method using the same For example, regarding the calculation of the motion of the golf ball and the golf club by acquiring and analyzing an image about the golf club and the golf ball when the user holds the golf club to perform the golf swing to hit the golf ball A sensing device for measuring data and a sensing method using the device.

The technique of analyzing the image obtained by photographing the moving object to calculate the position information of the object is mainly used in the form of a sensing device for performing an interactive sports simulation in a room or a specific place by simulation. A variety of simulators for popular sports events such as baseball, soccer, basketball, and golf, and devices for them.

If it is possible to calculate the position of each of the frames obtained by photographing the moving object such as the golf club and the golf ball when the user performs the golf swing with the golf club, the golf club can be utilized for The position information calculated in each frame is used to calculate various kinematic information such as the trajectory, speed, direction angle, and elevation angle of the golf club and the golf ball, and the information can be used to calculate the analysis information of the user for the golf swing, Or, an analog image of a golf ball flight can be realized by images in a virtual golf analog system such as a so-called screen golf.

Generally, in an image continuously acquired for a certain moving object, the moving object appears at mutually different positions for each frame, and on the other hand, the background portion thereof is substantially fixed for each frame without change, so if for one frame And the image of the other frame, the difference image is formed by a difference calculation on the primitive value (luminance value) of each primitive, and the background portion is removed in the difference image. Only the part of the moving object remains, and the difference image method is widely used when extracting the object of motion in the image.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a view for explaining a difference image method as described above, showing a difference image Diff (ta) of an image (frame_ta) photographed at a time point ta and an image (frame_tb) photographed at a time point tb. , tb).

The difference calculation is an operation obtained from the difference between the primitive values (luminance values) between the primitives at the same position, and when the difference between the primitive values of the primitives at the same position of the two images is greater than 0, The difference becomes the primitive value (luminance value) of the corresponding primitive. When the difference between the primitive values of the primitives at the same position of the two images is a negative number less than 0, the difference is made with 0 instead. image.

FIG. 1 illustrates a case where a difference calculation is performed for 14 images of 14×13 sizes in the x-axis direction and 13 in the y-axis direction.

The purpose of such a difference operation is to extract the object of motion (Part A) from the frame_ta image. If the image frame_tb at the time point tb is used for the difference operation for all the primitives of the two images, as shown in Fig. 1, a difference image of Diff(ta, tb) is formed.

As can be seen from FIG. 1, when, for example, the (1st, 1st) element of the frame_ta image and the (1st, 1st) element of the frame_tb image respectively have a primitive value of 20, the difference between the primitive values becomes 0 and the (1, 1)th element on the difference image Diff(ta, tb) is displayed in black.

For example, when the primitive value of the (2, 7)th element of the frame_ta image is 50 and the primitive value of the (2, 7)th picture of the frame_tb image is 20, the difference between the primitive values becomes 50-20=30 and the (2,7)th element on the difference image Diff(ta,tb) is displayed as a primitive having a primitive value of 30.

For example, when the primitive value of the (6th, 10th) primitive of the frame_ta image is 40 and the primitive value of the (6th, 10th) primitive of the frame_tb image is 100, the differential operation becomes 40-100. =-60 has a negative value, so that -60 is replaced by 0, the primitive value becomes 0, and the (6,10)th element on the difference image Diff(ta, tb) is displayed in black.

When the difference image of the frame_ta image with respect to the frame_tb image is obtained in such a manner, if the reflectance of the object based on the illumination motion is always constant and there are no other variables in the periphery, the difference image can be very accurately Extract object A.

However, since the reflectance for illumination, etc., may be different for each frame due to object motion, the primitive values of the primitives forming the object may be different for each frame, and an object that is caught in the middle or moved due to other objects is captured. It is often impossible to accurately extract the object A from the difference image by various variables such as images. If the difference image Diff(ta, tb) of the frame_ta image with respect to the frame_tb image is observed in FIG. 1, it is observed that the object A is partially damaged due to the difference operation, and is displayed as the A' portion.

In particular, due to the hue of the object or the reflection of illumination, the difference in ambient illumination, the shadow of the illumination, the material of the object, etc., the object on the image is almost similar to the background part or is darker. In the case of the primitive value, there is a problem that it is very difficult to extract the golf club by the difference image method on the image, and the accuracy of the position information calculated based on the extraction is very low.

Unlike the golf club, in the case of a golf ball, since the shape and size are shaped, and most of them are bright hue, the image can be extracted very accurately by the difference image method, and the difference image is In the process, even if a part of the picture element of the golf ball portion is lost, since the shape and size are shaped, it is possible to fit the outline very accurately.

However, the golf club is not only very difficult to extract by the difference image method, but even if it is extracted, the image processing method used in the extraction of the golf ball as described above is very difficult to extract.

In order to solve such a problem, a technique relating to a method of determining a position of a golf club by attaching a specific mark to a shaft of a golf club and a head or the like and finding the specific mark in the image has been proposed, but exists in the user. When performing golf practice or performing a virtual golf game, it is necessary to use a fatal problem such as a specific golf club with a specific mark attached, even if a specific mark is attached, the corresponding mark on the golf swing does not appear completely on the image or In the case of being blocked, there is a problem that it is difficult to accurately determine the accurate position of the golf club.

The prior art documents related to the present invention include Korean Patent Application No. 10-2011-0025149, Korean Patent Application No. 10-2011-0111875, Japanese Patent Publication No. 2005-210666, and the like.

The present invention has been made to solve the above conventional problems, and provides a sensing device for calculating position information of a moving object and a sensing method using the same, which can be determined not for a golf club. In the image obtained by photographing the object motion of the shape, size, material, and reflectance, the object of motion is extracted very accurately and stably by a simple method.

A sensing method of a sensing device for calculating position information of a moving object related to an embodiment of the present invention is characterized by comprising: a step of continuously acquiring an image from a viewing angle of an object observing the motion; a step of forming a difference operation image of two consecutive difference operation images with respect to each difference operation image of each of the images acquired continuously; and a difference between the two consecutive difference operation images The operation image, the step of calculating the position information of the object of the motion.

Further, preferably, the sensing method of the sensing device for calculating the position information of the moving object of the present invention is characterized in that the step of respectively forming the difference operation image of the two consecutive difference operation images includes: The image of one frame in the continuously acquired image is determined as the step of the reference image.

Further, preferably, the sensing method of the sensing device for calculating the position information of the moving object of the present invention is characterized in that the step of respectively forming the difference operation image of the two consecutive difference operation images includes: a difference operation of the image with respect to the successively acquired images, respectively forming a primitive including a primitive value having a brighter background portion than each of the images and a map having a darker primitive value than the background portion a step of calculating a difference image of all of the elements; and performing a difference operation process on the two consecutive difference operation images in the formed difference operation image to form a difference-difference operation image.

Further, preferably, the sensing method of the sensing device for calculating the position information of the moving object of the present invention is characterized in that the step of respectively forming the difference operation image of the two consecutive difference operation images includes: In each of the images successively acquired, an absolute value of the difference between the primitive values of the primitive values of the respective primitives and the primitive values of the corresponding positions of the reference image is formed as an absolute value difference operation graph of the primitive values. a step of the image; and for two consecutive images of the absolute value difference operation, if the difference between the primitive values of the respective corresponding primitives is greater than 0, the value is taken as the primitive value and if less than 0, 0 is used as the primitive The differential operation of the values is performed to form a differential-differential operation image.

In another aspect, a sensing method of a sensing device for calculating position information of a moving object related to another embodiment of the present invention is characterized by comprising: continuously acquiring an image from a viewing angle of an object observing the motion a step of including a background portion, a position moving object appearing at a new position for each frame, and a moving position overlapping portion appearing overlappingly on the continuous image on the successive images, to In each of the continuously acquired images, the step of extracting the position moving object and the moving position overlapping portion and removing the background portion, performing the image processing step; for the image processed image, passing the two consecutive images a difference operation of the image, a step of removing the overlapping portion of the motion position to extract a position moving object related to the object of the motion; and a step of calculating position information of the object of the extracted motion.

Further, preferably, the sensing method of the sensing device for calculating the position information of the moving object of the present invention is characterized in that the step of performing image processing in such a manner as to remove the background portion includes: continuously, by the reference image, the image Obtaining the absolute value of the difference operation of each image, including all the primitives having the primitive values that are brighter than the background portion of each image and the primitives having the primitive values that are darker than the background portion , the steps of image processing.

In another aspect, a sensing method of a sensing device for calculating position information of a golf club according to a user's golf swing motion according to an embodiment of the present invention is characterized by comprising: observing the user a step of continuously acquiring an image from a viewing angle of the golf swing; a step of acquiring an absolute value of a difference operation of the reference image with respect to the successively acquired respective images; forming an absolute value for the absolute value a sequence of two consecutive absolute value difference operation images in the difference operation image, respectively performing differential operation processing to form a difference-difference operation image; and calculating the motion based on the formed difference-difference operation image The step of the location information of the golf club.

In another aspect, a sensing device for calculating position information of a moving object related to an embodiment of the present invention is characterized by comprising: a camera portion that continuously acquires an image from a viewing angle of an object observing the motion; The processing unit performs image processing on the difference image of the reference image for each of the continuously acquired images, in order to extract the difference operation images of the two consecutive difference operation images, respectively; and the information calculation unit according to The difference calculation image of the two consecutive difference operation images extracted by the image processing unit calculates the position information of the object of the motion.

Further, preferably, the sensing device for calculating the position information of the moving object of the present invention is characterized in that the image processing unit is configured to determine an image of one frame of the continuously acquired images as the reference map. For example, an absolute value difference image obtained by performing a difference calculation between the reference image and each of the continuously acquired images is used as an absolute value difference operation image of the primitive value, and two consecutive absolute difference difference operation maps are formed. The difference operation of the image forms a differential-difference operation image.

In another aspect, a sensing device for calculating position information of a golf club according to a user's golf swing motion according to an embodiment of the present invention is characterized by comprising: a camera portion from which the user is observed The angle of view of the golf swing continuously acquires an image; the image processing unit acquires an absolute value difference calculation image by acquiring an absolute value of a difference calculation of the reference image with respect to each of the continuously acquired images, and forms an absolute image for the absolute The two consecutive absolute value difference operation images in the value difference operation image are subjected to differential operation processing to form a difference-difference operation image, and image processing is performed; and the information calculation unit performs each differential-difference based on the difference The image is calculated to calculate the position information of the golf club of the movement.

The sensing device for calculating position information of a moving object related to the present invention and the sensing method using the same have the effect of being relatively continuous with respect to the reference image without attaching a special mark or preparing additional equipment. The respective difference operation images of the respective images obtained by the ground form a difference operation image of two consecutive difference operation images, and the moving objects are extracted very accurately and stably, and accurate position information is calculated accordingly, wherein Each of the images acquired continuously is an image obtained by photographing an object motion such as a golf club having an undeterminable shape, size, material, reflectance, or the like.

S10~S14‧‧‧Steps

M1~Mn‧‧‧ object object

V1~Vn‧‧‧ overlapping position of motion position

VO1~Von‧‧‧ overlap of sports positions

U‧‧‧Users

GC‧‧‧ golf clubs

100‧‧‧ camera department

110‧‧‧Camera

120‧‧‧Camera

200‧‧‧Sensing and Processing Department

210‧‧‧Image Processing Department

220‧‧‧Information Computing Department

300‧‧‧ Client

1 is a view for explaining a difference image method generally used in the field of image processing technology; FIG. 2 is a block diagram showing a configuration of a sensing device according to an embodiment of the present invention; A flowchart of a process related to a sensing method of a sensing device according to an embodiment of the present invention; and FIG. 4 is a view showing an image continuously acquired in a camera portion of a sensing device according to an embodiment of the present invention; FIG. 5 is a diagram showing a process of forming an absolute value difference operation image using the image illustrated in FIG. 4; and FIG. 6 is a view showing an absolute value difference illustrated in FIG. 5. A drawing of a process of computing an image to form a differential-difference computed image.

A more specific content of a sensing device for calculating position information of a moving object and a sensing method using the same will be described with reference to the accompanying drawings.

First, the configuration of a sensing device according to an embodiment of the present invention will be described with reference to FIG. Fig. 2 is a block diagram showing the configuration of a sensing device according to an embodiment of the present invention.

The present invention is used as an image obtained by photographing a golf ball when it is hit by a golf club to hit a golf ball, and extracting a golf ball and a golf club in each image to calculate position information thereof. The invention completed in the development of the sensing device particularly provides a method of accurately and stably extracting a guest such as a golf club which is very difficult to extract in an image by a conventional image processing method, since it is possible to efficiently extract a golf club such as a golf club It is difficult to extract the object in the image, so it is not only a object that is shaped like a golf ball, but also can be used for image processing by using the sensing device and the sensing method according to the present invention for any unspecified object. Efficiently extract motion-based objects to accurately calculate their location information.

In the following, the "moving object" is mainly described by taking a golf club as an example. However, as described above, not only a golf club but also an arbitrary object that is difficult to be extracted by image processing, of course, The present invention can be applied similarly.

As shown in FIG. 2, a sensing device according to an embodiment of the present invention includes a camera unit 100 and a sensing processing unit 200. The sensing processing unit 200 includes a video processing unit 210 and an information computing unit 220.

The camera unit 100 is configured to continuously acquire an image from a viewing angle of a moving object, and in order to calculate positional information on a three-dimensional space of a moving object, the camera unit 100 preferably acquires different viewing angles from each other for the same object. The plurality of cameras of the image, for example, as shown in FIG. 2, synchronize the first camera 110 and the second camera 120 to each other in a three-dimensional manner.

As described above, the plurality of cameras 110, 120 of the camera unit 100 are synchronized with each other and configured in a stereoscopic manner, so that the image acquired by the first camera 110 for the same object and the respective images acquired by the second camera 120 can be acquired. The two-dimensional information of the corresponding object extracted in the object is transformed into three-dimensional information.

FIG. 2 shows a case where the plurality of cameras 110 and 120 of the camera unit 100 acquire an image when the user U holds the golf club GC to perform a golf swing. However, the present invention is not limited thereto and can be utilized, for example, for use. Various sports analog systems, such as the case of a baseball swing.

The sensing processing unit 200 includes a video processing unit 210 that collects images from the cameras 110 and 120 of the camera unit 100 and performs predetermined image processing to extract corresponding objects; and an information calculation unit 220 according to the image The two-dimensional position information of the extracted object calculates three-dimensional position information and the like.

The sensing processing unit 200 extracts the object of the motion from the respective images collected by the cameras 110 and 120 of the camera unit 100, calculates the location information of the corresponding object, and transmits the calculated information to the user terminal 300, the user. The terminal 300 performs a function inherent to the client 300 such as calculating new information or calculating analysis information by using the location information of the transmitted object.

For example, when the user terminal 300 is configured as a simulator used in the screen golf system, the position information of the golf ball and the golf club can be received from the sensing processing unit 200, and the information can be used to realize the virtual golf course of the ball. Analog image of the trajectory on the flight.

Further, when the user terminal 300 is configured as a golf swing analysis device, the position information of the golf ball and the golf club can be received from the sensing processing unit 200, and the information can be used to provide the golf swing for the user. Analyze information, diagnose problems with swings, and counseling information to solve the problem.

The image processing unit 210 is configured to extract a difference calculation image of two consecutive difference calculation images for each difference calculation image of each image continuously acquired by the camera unit 100 with respect to the reference image, and execute the image. In the processing, the information calculation unit 220 is configured to be able to calculate the position information of the object of the motion based on the difference calculation image of the two consecutive difference operation images extracted by the image processing unit.

Although the information calculation unit 220 is included in the sensing device as illustrated in FIG. 2 , the present invention is not limited thereto and may be included in the user terminal 300 . That is, the sensing device is further capable of performing image acquisition and extracting the function of the moving object by image processing, and transmitting the extracted information to the information calculation unit of the user side, calculating position information of the extracted moving object and using the position Information calculates various information.

On the other hand, a sensing method of the sensing device according to an embodiment of the present invention will be described with reference to the flowchart illustrated in FIG.

First, the camera unit photographs a situation in which the user performs a golf swing with a golf club to hit the ball from a predetermined angle of view, and continuously acquires an image (S10).

The continuously acquired image is transmitted to the image processing unit of the sensing processing unit, and the image processing unit selects the reference image for the difference calculation in accordance with a predetermined item in the continuously acquired image (S11). .

The reference image is an image for removing a background portion on the image utilized in the difference image, the difference image being used to extract the object of the motion to be detected (the object of interest) in the image.

The reference image is preferably selected to remove the object of motion as the object of interest and only the image of the background portion, at least selected such that even if the object of motion as the object of interest appears in the image but appears on the other image An image of the location where the objects do not overlap.

For example, when the image of the object of the motion is continuously acquired at the time of ta<...<t1<t2<...<tn, if it is used to extract the object of interest, it is used at t1, t2, etc. The image acquired at the time point can be used as a reference image for performing differential calculation on each image acquired at time points such as t1, t2, ..., and can select an image at a time point of ta or an image at a time point at tn. .

Here, for convenience of explanation, an image at a time point such as t1, t2, ..., which performs a difference calculation using a reference image is also referred to as a "bulb-eye chart image".

The image at which point in time is selected as the reference image can be individually determined depending on what the moving object is and how to move, for example, when the golf club wants to extract the moving golf club from the bull's eye chart image during the golf swing. Preferably, the position where the golf club appears on the bull's-eye chart image does not overlap with the position where the golf club appears on the reference image. Therefore, in the above-described example, the sensing processing unit can be set in advance as The image at the time point tn away from the time point of each of the bullseye chart images is selected as the reference image.

On the other hand, if the reference image is selected as described above, the object of interest object is extracted by the difference operation of the reference image with respect to each of the bull's-eye chart images. However, the differential operation associated with the present invention is not a general differential operation explained in the background section above, but a method of performing differential operation using differential operations for performing two differential operations, and more specifically, by performing for The "absolute value difference calculation image" formed by the "absolute value difference calculation" re-executes the "difference calculation" to form a "difference-differential calculation image", and accurately extracts the object of interest.

As described above, in the steps S12 and S13 of FIG. 3, when the image processing unit of the sensing processing unit selects the reference image as described above (S11), the image processing unit forms each map that is relatively continuously acquired by the reference image. The absolute value of the value obtained by the difference calculation of the (target image) is used as the absolute value difference calculation image of the primitive value (S12), and the differential operation of the image is performed by two consecutive absolute difference calculations to form a difference-differential operation. Image (S13).

In other words, the "absolute value difference calculation" is to obtain the absolute difference between the primitive value (luminance value) of the primitive on the target image image and the primitive value (luminance value) of the primitive at the corresponding position on the reference image. In the calculation of the value, an image in which the absolute value of the difference between the two primitive values is used as the primitive value is referred to as an "absolute value difference calculation image".

Further, an image formed by re-executing the difference calculation using the above-described absolute value difference calculation image is referred to as a "difference-differential calculation image".

In the difference-difference operation image formed by performing the difference operation twice as described above, the interference object object, that is, the element of the object of the motion to be extracted, that is, the interference element is excluded, and the object of interest object appears very accurately, so The object of interest object can be easily extracted from the difference-difference operation image.

The portion corresponding to the moving object on each of the differential-difference operation images formed as described above is a portion that uses the edge information to determine the contour, and can find the feature position such as the center or the center of gravity of the determined contour, and calculates the position as Location information of the moving object (S14).

It can be known from the techniques used in the past that it is most important to extract a portion corresponding to the moving object in the image, and if the portion is extracted, the position information is calculated in the extracted portion.

Hereinafter, the formation of the "absolute value difference calculation image" and the "difference-difference operation map" of the sensing method of the sensing device according to one embodiment of the present invention will be described with reference to FIGS. 4 to 6 . Like the formation of.

4 shows an example of an image continuously acquired in a camera portion of a sensing device according to an embodiment of the present invention, and FIG. 5 shows an image obtained by using the image illustrated in FIG. 4 to form an absolute value difference operation image. The process of FIG. 6 shows a process of forming a difference-differential operation image using the absolute value difference operation image illustrated in FIG. 5.

The images shown in FIGS. 4 to 6 are not actually images obtained by photographing, but are images which are schematically produced in order to more effectively explain the sensing method of the sensing device according to the present invention, in order to It is easy to explain and understand, simplifying the structure of the image.

As shown in FIG. 4, each image continuously acquired by the camera section is set as an image acquired at time points t1, t2, t3, ... tn, respectively, and in (a) of FIG. 4, it is shown at time t1. The image acquired by the point (Frame_t1), in (b), represents the image acquired at time t2 (Frame_t2), and in (c), the image acquired at time t3 (Frame_t3), and further, In (d), an image (Frame_tn) acquired at a time point tn which is quite distant from t1, t2, t3, ... is indicated.

Here, each of the images (Frame_t1, Frame_t2, Frame_t3, and the like) illustrated in (a) to (c) of FIG. 4 is defined by an image selected as a target image of the bull's-eye image, and, as in (d) The Frame_tn of the illustrated image is defined by the image selected as the reference image.

As can be seen from (a) to (d) of FIG. 4, in the images acquired continuously, the same background portion BG exists on the image.

The object objects M1, M2, M3, ... Mn corresponding to the object of the motion to be detected move while being in the period of t1 to tn of the acquired image, and exist in mutually different positions on each image (although It is possible that a part is slightly repeated, but it is preferably present in mutually different positions for each frame, depending on the moving speed of the object, the photographing speed of the camera, and the like.

In addition, it is assumed that there is a moving position overlapping portion V1, V2, V3 which is superimposed in the period of t1 to tn of the acquired image but does not move largely, or shakes, or moves in place, etc., in each image. ..Vn.

In (a) to (d) of Fig. 4, it is understood that the motion position overlapping portions V1, V2, V3, ..., Vn exhibit overlapping motion transitions.

For example, in the case where an image is continuously acquired for a case where a user performs a golf swing with a golf club, the body part of the user, the golf pad portion, the rubber ball seat portion, and the like overlap with the moving position of the motion change that exhibits overlap. In part, the golf club corresponds to a subject object of interest that exhibits a positional shift that does not overlap for each frame.

In Fig. 5, a process of forming a corresponding absolute value difference operation image in the step S12 of Fig. 3 by using the respective bullseye chart images and reference images shown in (a) to (d) of Fig. 4 is shown.

(a) of FIG. 5 shows a case where the absolute value difference operation image AbsDiff(t1, tn) is formed based on the absolute value difference of the target image chart image (Frame_t1) with respect to the reference image (Frame_tn) at time t1, and FIG. 5( b) shows the case where the absolute value difference operation image AbsDiff(t2, tn) is formed based on the absolute value difference calculation of the target image chart (Frame_t2) with respect to the reference image (Frame_tn) at time t2, and (c) of FIG. The absolute value difference operation image AbsDiff(t3, tn) is formed based on the absolute value difference calculation of the bullseye chart image (Frame_t3) with respect to the reference image (Frame_tn) at the time point t3.

When the absolute value difference calculation is performed as described above, the absolute value of the difference between the pixel value (luminance value) of the target image and the reference image is taken, so that the difference between the primitive values is larger, and the difference is calculated in the absolute value. Medium, the higher the primitive value (luminance value) is formed.

Therefore, the background portion BG in which the bullseye chart image and the reference image have substantially the same primitive value can be completely removed as shown in (a) to (c) of FIG. 5, but each of the bullseye chart images and the attention object on the reference image. The objects M1, M2, M3 and the moving position overlapping portions V1, V2, V3, Vn, and the unwanted position moving object Mn appear very completely on the absolute value difference operation image.

As illustrated in (a) of FIG. 5, an absolute value difference operation image AbsDiff(t1, tn) is formed based on the absolute value difference calculation of the target image chart image Frame_t1 with respect to the reference image Frame_tn, and the absolute value difference operation image is formed. In AbsDiff(t1, tn), the background portion BG is mostly deleted, and the object of interest object M1 and the unnecessary position moving object Mn existing at mutually different positions appear almost completely due to the absolute value of the difference operation, and still exist. The moving position overlaps the portion VO1 (the portion where V1 and Vn overlap by a considerable portion).

At this time, in the case where the moving position overlapping portion VO1 has the same pixel value in the portion where V1 and Vn overlap each other, the same portion appears after being deleted by the absolute value difference operation. That is, although it appears as a complete appearance in the drawing, a part of it appears in a deleted manner.

The absolute value difference operation image AbsDiff(t2, tn) formed in accordance with the absolute value difference calculation of the target image chart image Frame_t2 with respect to the reference image Frame_tn illustrated in (b) of FIG. 5 is not required to be formed with the object of interest object M2. The matter relating to the positional moving object Mn and the moving position overlapping portion VO2 and the absolute value difference operation based on the absolute value of the target image chart image Frame_t3 with respect to the reference image Frame_tn illustrated in (c) of FIG. 5 form an absolute value difference operation image AbsDiff The matters relating to the object of interest object M3, the unnecessary positional movement object Mn, and the moving position overlapping portion VO3 in the formation of (t3, tn) are also the same as those of (a) of Fig. 5 described above.

Thus, by the absolute value difference operation as described above, unlike the general difference operation, not only the portion having the high primitive value and the portion having the low primitive value in the primitive of the object of interest is formed in the absolute value difference operation. The image appears very completely, and it is also possible to make a portion with a low primitive value to have a high primitive value and be clearly distinguishable from the periphery (ie, to enable a portion that appears darker in the bull's-eye chart image to be absolute The value difference operation appears brighter in the image).

Here, as the background portion is deleted according to the absolute value difference operation, the remaining portions other than the object object objects M1, M2, M3, the unnecessary position moving object Mn, and the motion position overlapping portions VO1, VO2, VO3 become almost 0. The primitive values are shown in black, but for ease of illustration and understanding in the drawings, portions of the primitive values that become 0 are all displayed in white.

AbsDiff(t1, tn), AbsDiff(t2, tn), and AbsDiff(t3, tn), which are absolute value difference operation images respectively formed in (a) to (c) of FIG. 5, are again differentially formed by differential operation. The difference calculation image will be described with reference to Fig. 6 .

As described with reference to FIG. 5, an absolute value difference operation image such as AbsDiff(t1, tn), AbsDiff(t2, tn), and AbsDiff(t3, tn) is formed according to an absolute value difference operation, if two consecutive absolute value differences are formed. When the arithmetic image performs a difference operation (where the difference operation means a normal difference operation), as shown in FIG. 6, a difference-difference operation image can be obtained.

From the viewpoints of AbsDiff(t1, tn), AbsDiff(t2, tn), and AbsDiff(t3, tn) which are the absolute value difference operation images illustrated in FIG. 5, the object objects of interest are M1, M2, M3, The moving position overlapping portions VO1, VO2, VO3 and the unnecessary position moving objects Mn are all portions that should be removed as interference elements.

Such interference elements can be removed by the difference operation of two consecutive absolute value difference operation images. As shown in (a) of FIG. 6, the image AbsDiff(t1, tn) is calculated by absolute value difference with respect to AbsDiff(t2, The difference operation of tn), the portion that exists equally on the two images, that is, the position shifting object Mn and the portion that exists almost identically, that is, the moving position overlapping portions VO1 and VO2 are mostly deleted, and the object objects of interest that do not overlap each other M1 is saved, and the M2 portion having a negative value due to the difference operation disappears on the difference-difference operation image DOD(t1, t2|tn) because the primitive value is replaced by 0.

Similarly, as shown in (b) of FIG. 6, the difference between the absolute difference value operation image AbsDiff(t2, tn) and AbsDiff(t3, tn) is the same position on the two images. The moving object Mn and the almost identical portion, that is, the moving position overlapping portions VO2 and VO3 are mostly deleted, the object object M2 whose position is not overlapped is saved, and the M3 portion having a negative value due to the difference operation is due to the primitive value Replaced by 0 and disappeared on the difference-difference operation image DOD(t2, t3|tn).

Here, the difference between the moving position overlapping portions VO1 and VO2, VO2, and VO3 in the differential-differential operation image DOD(t1, t2|tn) and DOD is performed by the difference operation of the two consecutive absolute value difference operations. There is a very small portion left in (t2, t3|tn) and may become a noise NZ.

Here, the moving position overlapping portions VO1 and VO2 or VO2 and VO3 are removed without accurately leaving only the portion indicated by NZ by the differential-difference operation described above.

For example, the motion position overlapping portion VO1 on the absolute value difference operation image AbsDiff(t1, tn) and the motion position overlapping portion VO2 on the absolute value difference operation image AbsDiff(t2, tn) are not all identical except for the NZ portion. In the overlapping portion of the two motion positions, there may be portions in which the primitive values of the respective primitives at mutually corresponding positions are different from each other, so in addition to the NZ portion appearing on each differential-difference operation image actually appearing in FIG. In addition, there may be unknown noise of various sizes.

That is, in the present description, in order to simplify the explanation, only the NZ portion is represented as noise in FIG. 6, but in fact, other noise may exist in addition to the NZ portion, but such noise (the NZ portion and the other portions) Some of the other noise parts can be removed using the commonly used noise removal techniques.

Therefore, if the difference-difference operation image is obtained by the difference operation of the two absolute value difference operation images as described above, on the difference-difference operation image, the object of interest object appears very completely, so Accurately determine the object of interest by appropriate image processing.

As described above, in the difference-difference operation image, after separately extracting the object of interest, that is, the object of motion, using the edge information about the corresponding portion, etc., the contour line is determined, and the center of the portion determined by the contour line is determined. Or feature points such as center of gravity are calculated as position information.

Therefore, the object having the shape, the size, the material, the reflectance, and the like which cannot be determined, such as a golf club, can also be formed by the absolute value difference calculation image and the differential-difference calculation image according to the present invention described above. Very accurate extraction, so the position information of the object of the motion can be accurately and stably calculated in a simple manner.

Claims (7)

A sensing method of a sensing device for calculating position information of a moving object, comprising: a step of continuously acquiring an image from a perspective of an object observing the motion; and continuously acquiring the reference image a step of forming a difference operation image of two consecutive difference operation images for each difference operation image of each image; and calculating the motion based on each difference operation image of the two consecutive difference operation images The step of the location information of the object, the step of respectively forming the difference operation image of the two consecutive difference operation images includes: respectively forming, according to the difference operation of the reference image with respect to the successively acquired images, respectively a step of calculating a difference image of a primitive of a primitive value that is brighter than a background portion of each image and a primitive having a primitive value that is darker than the background portion; and a difference operation map for the formation The two consecutive difference operation images in the image are subjected to differential operation processing to form a differential-differential operation image. The sensing method of the sensing device for calculating the position information of the object of the motion according to claim 1, wherein the step of respectively forming the difference operation image of the two consecutive difference operation images comprises: the continuous The image of one frame in the acquired image is determined as the step of the reference image. A sensing method of a sensing device for calculating position information of a moving object, comprising: a step of continuously acquiring an image from a perspective of an object observing the motion; and continuously acquiring the reference image Each difference operation image of each image a step of forming a difference operation image of two consecutive difference operation images; and a step of calculating position information of the object of the motion based on each difference operation image of the two consecutive difference operation images, respectively forming The step of calculating the difference image of the two consecutive difference operation images includes: forming, in each of the successively acquired images, each primitive of the primitive value of each primitive and the corresponding position of the reference image The absolute value of the difference of the primitive values as a step of the absolute value difference operation image of the primitive value; and for the two consecutive images of the absolute difference difference operation, if the difference between the primitive values of the respective corresponding primitives is greater than If 0 is used as the primitive value and if it is less than 0, 0 is used as the difference operation processing of the primitive value to form a differential-difference operation image. A sensing method of a sensing device for calculating position information of a moving object, comprising: a step of continuously acquiring an image from a perspective of an object observing the motion; and each of the images continuously acquired Included in the background portion, a position moving object appearing at a new position for each frame, and a moving position overlapping portion appearing overlappingly on the continuous image on the continuous image to extract in each of the continuously acquired images The step of moving the object and the moving position overlapping portion and removing the background portion, performing a step of image processing; and for the image processed image, removing the overlapping portion of the moving position by performing a difference operation between two consecutive images a step of extracting a positional moving object associated with the object of the motion; and a step of calculating location information of the object of the extracted motion, The step of performing image processing in such a manner as to remove the background portion includes: by using an absolute value of the difference operation of the reference image with respect to the successively acquired respective images, to include a primitive having a brighter background portion than each image portion The image processing step is performed in such a manner that the primitive of the value and the primitive having a darker primitive value than the background portion. A sensing method for a sensing device for calculating position information of a golf club according to a user's golf swing motion, comprising: continuously acquiring an image from a perspective of observing a golf swing of the user a step of obtaining an absolute value difference operation image by obtaining an absolute value of a difference operation of the reference image with respect to the successively acquired respective images; and calculating two consecutive absolute numbers in the image for the formed absolute value difference The value difference operation image is subjected to a difference operation process to form a difference-difference operation image, and a step of calculating the position information of the moving golf club based on the formed difference-difference operation image. A sensing device for calculating position information of a moving object, comprising: a camera unit that continuously acquires an image from a viewing angle of an object that observes the motion; and an image processing unit that continuously views the reference image Each of the acquired difference image of each image is subjected to image processing for extracting a difference operation image of two consecutive difference operation images; and an information calculation unit according to the continuous two extracted by the image processing unit Calculating the position information of the object of the motion by using the difference calculation image of the difference calculation image, wherein the image processing unit is configured to determine the image of one frame of the continuously acquired image as the reference image. Forming respective images to be successively acquired by the reference image The absolute value of the value obtained by the difference operation is used as the absolute value difference operation image of the primitive value, and the differential-difference operation image is formed by the difference operation of the two consecutive absolute difference difference operation images. A sensing device for calculating position information of a golf club according to a user's golf swing motion, comprising: a camera portion that continuously acquires an image from a perspective of observing a golf swing of the user; The image processing unit forms an absolute value difference calculation image by acquiring an absolute value of a difference calculation of the reference image with respect to each of the continuously acquired images, and calculates two consecutive two of the images for the formed absolute value difference. The absolute value difference operation image is subjected to differential operation processing to form a difference-difference operation image, and image processing is performed; and the information calculation unit calculates the moving golf club based on the formed difference-difference operation images. Location information.