WO2018139810A1 - Appareil de détection pour calculer des informations de position d'un objet en mouvement, et procédé de détection l'utilisant - Google Patents

Appareil de détection pour calculer des informations de position d'un objet en mouvement, et procédé de détection l'utilisant Download PDF

Info

Publication number
WO2018139810A1
WO2018139810A1 PCT/KR2018/000897 KR2018000897W WO2018139810A1 WO 2018139810 A1 WO2018139810 A1 WO 2018139810A1 KR 2018000897 W KR2018000897 W KR 2018000897W WO 2018139810 A1 WO2018139810 A1 WO 2018139810A1
Authority
WO
WIPO (PCT)
Prior art keywords
difference
image
images
moving object
position information
Prior art date
Application number
PCT/KR2018/000897
Other languages
English (en)
Korean (ko)
Inventor
박현진
Original Assignee
주식회사 골프존
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 골프존 filed Critical 주식회사 골프존
Publication of WO2018139810A1 publication Critical patent/WO2018139810A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B69/00—Training appliances or apparatus for special sports
    • A63B69/36—Training appliances or apparatus for special sports for golf
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/254—Analysis of motion involving subtraction of images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/10—Positions
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/80—Special sensors, transducers or devices therefor
    • A63B2220/806—Video cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • the present invention provides a sensing device that can extract the object from each image to calculate the position information of the object from the image by continuously acquiring and analyzing the image of the object to be exercised, and a sensing method using the same.
  • a sensing device and sensing method using the same to calculate the sensing data for the golf ball and the motion of the golf club by acquiring and analyzing the image of the golf club and the golf ball when hitting the golf ball by holding a golf swing It is about.
  • the technology for calculating the location information of the object by analyzing the image of the moving object is mainly used for interactive sports simulation through simulation of popular sports games such as baseball, soccer, basketball, and golf indoors or at specific places. It is used as a sensing device in various simulators and devices for enjoying it in the form of simulation.
  • a moving object for example, when a user swings a golf club with a golf club and hits the golf ball, it is possible to calculate where the moving golf club and the golf ball are located in every frame where the golf ball is taken, the golf club uses the position information calculated every frame.
  • Various kinematic information such as track, speed, direction angle and height angle of the club and golf ball can be calculated and used to calculate the analysis information about the user's golf swing, or in a virtual golf simulation system such as screen golf
  • An image may be used to implement a simulation image of a golf ball flying.
  • the moving object In an image obtained continuously for a certain moving object, the moving object is displayed at different positions every frame while the background part is almost fixed and does not change from frame to frame. If a difference image is generated by difference calculation on the pixel value (brightness value) of each pixel, the background part is removed from the difference image and only the moving object part remains. Difference technique is widely used to extract moving objects from.
  • FIG. 1 is a diagram for explaining the difference image technique as described above.
  • the difference image Diff (ta, tb) of an image (frame_ta) photographed at time ta and an image (frame_tb) captured at time tb is illustrated in FIG. It is shown.
  • the difference operation is obtained by the difference in pixel values (brightness values) between pixels at the same position. If the difference between the pixel values of pixels at the same position of two images is greater than 0, the difference value is the pixel value of the corresponding pixel ( Brightness value), and if the difference between the pixel values of the pixels at the same position of the two images is less than zero, the difference image is made by replacing with zero.
  • FIG. 1 illustrates a case in which a difference operation is performed on 14 x 13 sized images in 14 x-axis directions and 13 x-axis directions.
  • the purpose of this difference is to extract the moving object (part A) from the frame_ta image.
  • a difference operation is performed on all pixels of two images using an image (frame_tb) at time tb, as shown in FIG. 1, a difference image of Diff (ta, tb) is generated.
  • the difference image Diff (ta , tb)) on pixel (1,1) will be black when the pixel value becomes 0.
  • the object A can be extracted fairly accurately through the difference image if the reflectivity of the moving object due to lighting is always constant and no other variables exist. .
  • the reflectance of the light may be different every frame, so the pixel values of the pixels that make up the object may be different every frame, and another object is captured in the image.
  • the difference image Diff (ta, tb) of the frame_tb image of the frame_ta image in FIG. 1 it can be seen that the object A is substantially damaged by the difference operation and appears as A ′.
  • the object may have a pixel value that is almost similar to or darker than the background part of the image. It is very difficult to extract the golf club from the image by the difference image technique, and even if extracted, the location information calculated therefrom has a problem that the accuracy is inevitably deteriorated.
  • the shape and size of golf balls are standardized, and most of them are bright colors. Therefore, the golf balls can be extracted from the image fairly accurately by the difference image technique, even if some pixels of the golf ball portion are lost during the difference image process.
  • the size is standardized so that the contours can be fitted fairly accurately.
  • Patent Application No. 10-2011-0025149 Patent Application No. 10-2011-0111875
  • Japanese Patent Application Laid-Open No. 2005-210666 Japanese Patent Application Laid-Open No. 2005-210666, and the like.
  • the present invention is to solve the conventional problems as described above, a simple method of moving the object in the image taken for the movement of the object having an unspecified shape, size, material, reflectivity, such as a golf club
  • the present invention provides a sensing device for calculating position information of a moving object that can be extracted quite accurately and stably, and a sensing method using the same.
  • a sensing method of a sensing device for calculating position information of a moving object includes: continuously obtaining an image at an angle of view of the moving object; Generating a difference operation image of two successive difference images for each difference operation image of the reference image for each of the successively acquired images; And calculating position information of the moving object from each of the successive computed images of the two successive computed images.
  • the step of generating the difference operation images of the two consecutive difference images may include determining an image of one frame among the continuously acquired images as the reference image.
  • the step of generating a difference operation image of each of the two successive difference images may include pixel values that are brighter than the background portion of each image by the difference calculation of the reference image for each of the successively acquired images.
  • the step of generating the difference operation images of the two successive difference images may include the pixel value of each pixel and the corresponding position of the reference image in each of the successively acquired images. Generating an absolute difference image with an absolute value for the difference in pixel values as the pixel value; and if the difference between the pixel values of each corresponding pixel is greater than zero for the two successive absolute difference images, the value is converted to pixels; And calculating a difference-difference image by performing a difference calculation process of setting the value to a value less than zero to zero as the pixel value.
  • the sensing method of the sensing device for calculating the position information of the moving object comprising: continuously obtaining an image at an angle of view looking at the moving object; Each successively acquired image includes a background portion, a position moving object appearing at a new position every frame, and a movement position overlapping portion in which a motion change position overlaps in a successive image. Performing image processing to extract the position moving object and the movement position overlapping portion and remove the background portion in each case; Extracting the moving object of the moving object by removing the moving position overlapping portion through the difference operation of two consecutive images with respect to the image processed images; And calculating position information of the extracted exercise object.
  • the performing of the image processing to remove the background portion comprises: a pixel having a brighter pixel value than the background portion of each image through the absolute value of the difference operation of the reference image for each of the successively acquired images; And image processing to include both pixels having pixel values that are darker than the background portion.
  • the sensing method of the sensing device for calculating the position information of the golf club exercising in accordance with the golf swing of the user to continuously acquire an image at an angle of view looking at the golf swing of the user step; Generating an absolute difference image by taking an absolute value of a difference operation of a reference image for each of the successively acquired images; Generating a difference-difference image by performing a difference operation on two consecutive absolute difference images among the generated absolute difference images; And calculating position information of the exercise golf club from each of the generated difference-calculated images.
  • the sensing device for calculating the position information of the moving object the camera unit for continuously obtaining an image at an angle of view looking at the moving object;
  • An image processing unit which performs image processing for extracting a difference operation image of two successive difference images for each difference operation image of a reference image for each successively acquired image;
  • an information calculator configured to calculate positional information of the moving object from each of the successive computed images of the two successive computed images extracted by the image processor.
  • the image processing unit may determine an image of one frame from among the continuously acquired images as the reference image, and determine an absolute value of a value by the difference operation of the reference image for each of the continuously acquired images. And generate an absolute difference image as a pixel value, and generate a difference-difference image through difference operations of two successive absolute difference images.
  • the sensing device for calculating the position information of the golf club exercising according to the golf swing of the user the camera unit for continuously obtaining an image at an angle of view looking at the golf swing of the user; Absolute difference image is generated by taking the absolute value of the difference operation of the reference image with respect to each of the successively acquired images, and performs a difference operation on two consecutive absolute value difference images among the generated absolute value difference images, respectively.
  • An image processing unit which performs image processing to generate a difference-difference image; And an information calculator configured to calculate location information of the golf club to be exercised from each of the generated difference-calculated images.
  • the sensing device for calculating the position information of the moving object and the sensing method using the same according to the present invention has a non-specific shape, size, material, reflectivity, etc., such as a golf club, without attaching a special marker or additional equipment
  • the moving object is extracted fairly accurately and reliably by generating a difference operation image of two consecutive difference images. There is an effect of calculating accurate position information therefrom.
  • FIG. 1 is a diagram for explaining a difference image technique, which is generally used in an image processing technology.
  • FIG. 2 is a block diagram illustrating a configuration of a sensing device according to an embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating a process according to a sensing method of a sensing device according to an embodiment of the present invention.
  • FIG. 4 is a diagram illustrating an example of images continuously acquired by a camera unit of a sensing apparatus according to an embodiment of the present invention.
  • FIG. 5 illustrates a process of generating an absolute difference image using the images illustrated in FIG. 4.
  • FIG. 6 is a diagram illustrating a process of generating a difference-difference image using the absolute value difference images shown in FIG. 5.
  • FIG. 2 is a block diagram illustrating a configuration of a sensing device according to an embodiment of the present invention.
  • the present invention is completed in the development process of the sensing device for extracting the golf ball and the golf club from the image to calculate the location information by analyzing the images taken when the user hits the golf ball by golf swing to the golf club
  • the present invention provides a method for accurately and stably extracting an object that is difficult to extract from an image by a conventional image processing technique such as a golf club, and effectively extracts an object that is difficult to extract from an image such as a golf club. Therefore, using the sensing device and the sensing method according to the present invention, as well as a standardized object such as a golf ball, the object according to the motion can be effectively extracted through image processing to accurately calculate its position information. have.
  • the golf club will be described mainly as an example of the above-mentioned 'working object', but as described above, the present invention can be equally applied to any object that is difficult to extract through image processing as well as the golf club. Of course.
  • the sensing device includes a camera unit 100 and a sensing processor 200, and the sensing processor 200 includes an image processor 210 and an information calculator. And 220.
  • the camera unit 100 is configured to continuously acquire an image at an angle of view looking at a moving object. In order to calculate position information in a three-dimensional space with respect to the moving object, the camera unit 100 has different viewing angles. For example, as illustrated in FIG. 2, a plurality of cameras acquiring images of the same object, for example, the first camera 110 and the second camera 120 are preferably synchronized with each other and configured in a stereo manner.
  • the plurality of cameras 110 and 120 of the camera unit 100 are synchronized with each other and configured in a stereo manner, thereby obtaining the image and the second camera 120 acquired through the first camera 110 for the same object.
  • the 2D information of the corresponding object extracted from each of the acquired images may be converted into 3D information.
  • FIG. 2 illustrates a case where a plurality of cameras 110 and 120 of the camera unit 100 acquires an image of a user swinging a golf club GC with a user U, but the present invention is limited thereto.
  • the present invention can be used for various sports simulation systems, such as when the user swings a baseball.
  • the sensing processor 200 collects an image from each of the cameras 110 and 120 of the camera unit 100 and performs a predetermined image processing to extract a corresponding object, and an object extracted from the image. It may be configured to include an information calculation unit 220 for calculating the three-dimensional position information and the like from the two-dimensional position information of.
  • the sensing processor 200 extracts a moving object from each of the images collected by the cameras 110 and 120 of the camera unit 100, calculates position information of the object, and calculates the position information of the corresponding object to the client 300.
  • the client 300 may perform a unique function of the client 300 such as calculating new information or calculating analysis information using the position information of the received object.
  • the client 300 when the client 300 is implemented as a simulator used for a screen golf system, the location information of a golf ball and a golf club is received from the sensing processing unit 200 and simulation of the trajectory of the ball flying on a virtual golf course using the location information is received. You can implement the image.
  • the client 300 in the case of implementing the client 300 as a golf swing analysis device, receiving the position information of the golf ball and the golf club from the sensing processing unit 200 using the analysis information on the user's golf swing, the diagnosis of the swing and It can be implemented to provide lesson information for solving this.
  • the image processing unit 210 processes an image to extract a difference operation image of two successive difference images, respectively, for each difference operation image of the reference image for each image continuously acquired by the camera unit 100.
  • the information calculating unit 220 may be configured to calculate position information of the moving object from each of the difference calculated images of the two consecutive difference images extracted by the image processing unit.
  • the information calculating unit 220 may be configured to be included in the sensing device, but may be configured to be included in the client 300 without being limited thereto. That is, the sensing device performs a function of extracting a moving object by acquiring an image and processing the image, and transmits the extracted information to the information calculating unit of the client to obtain the location information of the extracted moving object and various information using the same. It is also possible to make calculations.
  • the camera unit shoots a golf swing at a golf club at a predetermined angle of view to acquire an image continuously (S10).
  • the continuously acquired image is transferred to the image processing unit of the sensing processing unit, and the image processing unit selects the reference image for the difference calculation according to a preset item among the images acquired continuously (S11).
  • the reference image is an image for removing a background part on an image to be used in a difference image for extracting a moving object (object of interest) to be detected from the image.
  • the reference image may be selected as an image having only a background portion except for a moving object of interest, and at least a moving object of interest may be selected as an image appearing at a position that does not overlap with an object appearing in another image. It is preferable.
  • an image at time ta or an image at time tn may be selected as a reference image for performing a difference operation on each of the images acquired at times t1, t2...
  • images of viewpoints t1, t2, etc., in which the difference operation is to be performed using the reference image will be referred to as 'target images' for convenience.
  • Whether to select an image acquired at a certain point as a reference image can be determined individually from what the object is being exercised and how it is to be exercised. For example, when a golf club exercising during golf swing is to be extracted from the target images, the target is selected. Since the position where the golf club appears on the images is preferably not overlapped with the position where the golf club appears on the reference image, in the above example, the image of the tn viewpoint, which is a point far from the target images, is selected as the reference image. It can be set in advance in the sensing processing unit.
  • the difference operation according to the present invention is not a general difference operation described in the background art, but a method using a difference operation of a difference operation in which two difference operations are performed, and more specifically, an absolute value difference operation. 'Difference operation' is again performed on 'absolute difference calculation images' generated by performing 'to generate a difference difference image', thereby providing a method of accurately extracting an object of interest.
  • steps S12 and S13 of FIG. 3 As described above, when the image processor of the sensing processor selects the reference image (S11), the image processor determines the reference image of each of the images (target images) that are continuously acquired. An absolute value difference image is generated by using the absolute value of the difference value as the pixel value (S12), and a difference-difference image is generated through the difference operation of two consecutive absolute value difference images (S13).
  • the absolute value difference operation is an operation that takes an absolute value of a difference between a pixel value (brightness value) of a pixel on a target image and a pixel value (brightness value) of a pixel at a corresponding position on a reference image.
  • An image whose absolute value of the difference in values is a pixel value will be referred to as an "absolute value difference operation image”.
  • a 'difference difference image' The image generated by performing the difference operation again using the absolute difference operation images described above will be referred to as a 'difference difference image'.
  • the difference-difference image generated by performing two difference calculations excludes an interfering element, that is, an interference element, from the object of interest, that is, a moving object to be extracted, and the object of interest appears fairly accurately. Therefore, the object of interest may be easily extracted from the difference-difference image.
  • the portion corresponding to the moving object on each difference-difference image generated as described above is used to determine the contour using edge information, and to find a specific position such as the center point or the center of gravity of the determined contour and then move the position. It can calculate as positional information of (S14).
  • FIGS. 4 to 6 a specific example of generation of an absolute value difference image and generation of a difference difference image by the sensing method of the sensing device according to an embodiment of the present invention will be described.
  • FIGS. 4 to 6 a specific example of generation of an absolute value difference image and generation of a difference difference image by the sensing method of the sensing device according to an embodiment of the present invention will be described.
  • FIG. 4 illustrates an example of images continuously acquired by a camera unit of a sensing apparatus according to an embodiment of the present invention
  • FIG. 5 illustrates a process of generating an absolute value difference image using the images shown in FIG. 4.
  • FIG. 6 illustrates a process of generating a difference-difference image by using the absolute difference images shown in FIG. 5.
  • FIGS. 4 to 6 are not images acquired by photographing, but are images arbitrarily created to more effectively explain the sensing method of the sensing apparatus according to the present invention. It was planned.
  • the images continuously acquired by the camera unit are images acquired at the times t1, t2, t3 ... tn, respectively.
  • FIG. 4A the images acquired at the time t1 (Frame_t1). ), (B) an image (Frame_t2) acquired at time t2, (c) an image (Frame_t3) acquired at time t3, and (d) somewhat far from t1, t2, t3 ...
  • Each of the images Frame_tn acquired at the viewpoint tn viewpoint is shown.
  • the images (Frame_t1, Frame_t2, Frame_t3, etc.) shown in (a) to (c) of FIG. 4 are a target image
  • Frame_tn which is the image shown in (d)
  • the same background portion BG is present on the image in the images acquired continuously.
  • the objects of interest (M1, M2, M3 ... Mn) corresponding to the moving object to be detected are present at different positions on each image while moving over the time t1 to tn when the image is acquired (slightly some of them). Overlapping may occur, but it is desirable to exist in different positions every frame, depending on the movement speed of the object and the shooting speed of the camera.
  • the user's body part, golf mat part, rubber tee part, etc. correspond to the exercise position overlapping part that indicates the overlapping movement change
  • the golf Clubs correspond to objects of interest that represent positional changes that do not overlap every frame.
  • FIG. 5 A process of generating an absolute value difference operation image corresponding to step S12 of FIG. 3 using the target images and reference images illustrated in FIGS. 4A to 4D is illustrated in FIG. 5.
  • FIG. 5A illustrates a case where an absolute value difference image AbsDiff (t1, tn) is generated by the absolute value difference operation on the reference image Frame_tn of the target image Frame_t1 at the time point t1.
  • (b) illustrates a case in which the absolute value difference image AbsDiff (t2, tn) is generated by the absolute value difference operation on the reference image Frame_tn of the target image Frame_t2 at the time t2
  • FIG. 5 (c) Denotes a case where the absolute value difference image AbsDiff (t3, tn) is generated by the absolute value difference operation on the reference image Frame_tn of the target image Frame_t3 at the time t3.
  • the absolute difference calculation takes an absolute value for the difference between the pixel value (brightness value) of the target image and the reference image, so the higher the pixel value, the higher the pixel value (brightness value) in the absolute difference calculation image. ).
  • the background portion BG of which the pixel values of the target image and the reference image are substantially the same as the pixel values can all be removed as shown in FIGS.
  • Objects of interest (M1, M2, M3), motion position overlaps (V1, V2, V3, Vn), and unnecessary position shift objects (Mn) on the reference image appear fairly intact on the absolute difference image.
  • an absolute value difference image AbsDiff (t1, tn) is generated by an absolute value difference operation on the reference image Frame_tn of the target image Frame_t1, and the absolute value difference image AbsDiff (t1, tn) is generated.
  • the background portion BG is mostly erased and the object of interest M1 and the unnecessary position movement object Mn, which exist at different positions, appear almost intact by the absolute value of the difference operation, and the movement position overlapping portions VO1 (V1 and Vn). A substantial part of this overlapping part) also exists.
  • the moving position overlapping part VO1 may be erased by the absolute value difference operation when the pixel value is the same in the part where V1 and Vn overlap each other. That is, although the drawings are shown as appearing intact, some of them appear to be erased.
  • the absolute difference calculation as described above whether the portion having the high pixel value or the low pixel value of the pixels constituting the object of interest, appears completely in the absolute difference calculation image. Not only that, but the low pixel values can have a high pixel value so that they can be significantly distinguished from the surroundings (i.e., the dark parts of the target image appear bright in the absolute difference image).
  • AbsDiff (t1, tn), AbsDiff (t2, tn), AbsDiff (t3, tn), and the like, which are the absolute value difference images respectively generated in FIGS. An image is generated, which will be described with reference to FIG. 6.
  • an absolute value difference operation generates absolute difference operations images such as AbsDiff (t1, tn), AbsDiff (t2, tn), and AbsDiff (t3, tn).
  • a difference operation means a conventional difference operation
  • a difference difference image can be obtained as shown in FIG. 6.
  • the objects of interest are M1, M2, M3, and the movement position overlapping part (VO1). , VO2, VO3) and the unnecessary displacement object Mn are all parts to be removed as an interference element.
  • Such interferences can be eliminated by the difference operation of two consecutive absolute value difference images.
  • AbsDiff (t2, tn) of the absolute value difference image AbsDiff (t1, tn) is shown.
  • the moving position overlapping portions VO1 and VO2 which are almost identical to the moving object Mn, which are the same portions on the two images, are almost eliminated, and the positions are not overlapped.
  • the object of interest M1 is preserved, and the portion of M2 that has a negative value by the difference operation disappears on the difference-difference image (DOD (t1, t2
  • the position shift object which is a part that exists equally on both images through the difference operation on AbsDiff (t3, tn) of the absolute value difference image AbsDiff (t2, tn),
  • AbsDiff (t3, tn) of the absolute value difference image AbsDiff (t2, tn) AbsDiff (t3, tn) of the absolute value difference image AbsDiff (t2, tn)
  • the movement position overlapping portions VO2 and VO3, which are almost the same as Mn) are almost all erased, the object of interest M2 whose position does not overlap is preserved, and the M3 portion having a negative value by the difference operation.
  • the pixel value is replaced by 0 and disappears on the difference-difference image (DOD (t2, t3
  • the motion position overlapping portions VO1 and VO2, VO2 and VO3, which are not completely overlapped by the difference operations of two successive absolute difference images the difference-difference images DOD (t1, t2
  • the motion position overlap portion VO1 on the absolute difference image AbsDiff (t1, tn) and the motion position overlap portion VO2 on the absolute difference image AbsDiff (t2, tn) are not completely identical except for the NZ portion, Since there may be portions in which the pixel values of pixels at positions corresponding to each other in the position overlapping portions are different from each other, in reality, there are a number of large and unidentifiable large portions other than the NZ portions shown on each difference-difference image shown in FIG. You can leave small noises.
  • NZ portion is shown as noise in FIG. 6, but in fact, other noises may exist in addition to the NZ portion, and such noise (NZ portion and other noise portions) is generally used. It can be removed by applying the noise reduction technique used.
  • the contour is specified using the edge information of the corresponding part, and the center point or the center of gravity of the part specified by the contour.
  • the feature point of can be specified and computed as positional information.
  • Sensing device for calculating the position information of a moving object and a sensing method using the same by allowing the golf simulation based on the industrial field and virtual reality related to the golf practice, such as hit analysis according to the golf swing It can be used in the so-called screen golf industry, etc., where the user can enjoy a virtual golf game.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

La présente invention a pour objet un appareil de détection et un procédé de détection qui peuvent de manière simple, très précise et stable extraire un objet en mouvement d'images capturées pendant que l'objet, tel qu'un club de golf, ayant une forme, une taille, un matériau, une réflectivité, etc. qui ne peuvent pas être spécifiés, est en mouvement. Le procédé de détection, qui est réalisé par l'appareil de détection pour calculer des informations de position d'un objet en mouvement selon la présente invention, comprend les étapes consistant à : obtenir successivement des images selon l'angle de vue auquel l'objet en mouvement est vu ; générer des images de calcul de différence entre chacune des images obtenues successivement et une image de référence, et générer des images de calcul de différence entre chaque paire d'images de calcul de différence successives ; et calculer des informations de position de l'objet en mouvement à partir de chacune des images de calcul de différence entre chaque paire d'images de calcul de différence successives.
PCT/KR2018/000897 2017-01-25 2018-01-19 Appareil de détection pour calculer des informations de position d'un objet en mouvement, et procédé de détection l'utilisant WO2018139810A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2017-0012196 2017-01-25
KR1020170012196A KR101932525B1 (ko) 2017-01-25 2017-01-25 운동하는 객체의 위치 정보를 산출하기 위한 센싱장치 및 이를 이용한 센싱방법

Publications (1)

Publication Number Publication Date
WO2018139810A1 true WO2018139810A1 (fr) 2018-08-02

Family

ID=62978049

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2018/000897 WO2018139810A1 (fr) 2017-01-25 2018-01-19 Appareil de détection pour calculer des informations de position d'un objet en mouvement, et procédé de détection l'utilisant

Country Status (3)

Country Link
KR (1) KR101932525B1 (fr)
TW (1) TWI647424B (fr)
WO (1) WO2018139810A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114317675A (zh) * 2022-01-06 2022-04-12 福州大学 基于机器学习定性和定量不同创面细菌的检测方法及系统
US20220291139A1 (en) * 2021-03-15 2022-09-15 The Government Of The United States Of America, As Represented By The Secretary Of The Navy Foreign object debris detection

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102256260B1 (ko) * 2020-02-10 2021-05-27 (주) 알디텍 스크린 골프용 스마트 카메라 센서
KR102439549B1 (ko) * 2020-09-14 2022-09-02 주식회사 골프존 골프스윙에 대한 센싱장치 및 이를 이용한 클럽헤드의 임팩트 위치 센싱방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003111880A (ja) * 2001-10-04 2003-04-15 Ditect:Kk ゴルフスイング解析システム及び画像処理方法
JP2003296741A (ja) * 2002-03-29 2003-10-17 Toshiba Corp 物体画像切り出し方法及びプログラム並びに物体画像切り出し装置
KR101078954B1 (ko) * 2011-03-22 2011-11-01 (주) 골프존 가상 골프 시뮬레이션 장치와, 이에 이용되는 센싱장치 및 센싱방법
JP2012212373A (ja) * 2011-03-31 2012-11-01 Casio Comput Co Ltd 画像処理装置、画像処理方法及びプログラム
JP2013118876A (ja) * 2011-12-06 2013-06-17 Dunlop Sports Co Ltd ゴルフスイングの診断方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1158270A1 (fr) * 2000-05-24 2001-11-28 Seiko Epson Corporation Système de mesure pour événements sportifs
EP2125124B1 (fr) * 2007-02-14 2016-04-13 NIKE Innovate C.V. Collecte et affichage d'informations athlétiques
KR20130050405A (ko) * 2011-11-07 2013-05-16 오수미 인터 모드에서의 시간 후보자 결정방법
CN104567919A (zh) * 2013-10-12 2015-04-29 北京航天计量测试技术研究所 一种标定摄影测量系统动态测量误差的装置及使用方法
CN103713148A (zh) * 2013-12-13 2014-04-09 柳州市蓝海科技有限公司 高尔夫模拟系统球检测装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003111880A (ja) * 2001-10-04 2003-04-15 Ditect:Kk ゴルフスイング解析システム及び画像処理方法
JP2003296741A (ja) * 2002-03-29 2003-10-17 Toshiba Corp 物体画像切り出し方法及びプログラム並びに物体画像切り出し装置
KR101078954B1 (ko) * 2011-03-22 2011-11-01 (주) 골프존 가상 골프 시뮬레이션 장치와, 이에 이용되는 센싱장치 및 센싱방법
JP2012212373A (ja) * 2011-03-31 2012-11-01 Casio Comput Co Ltd 画像処理装置、画像処理方法及びプログラム
JP2013118876A (ja) * 2011-12-06 2013-06-17 Dunlop Sports Co Ltd ゴルフスイングの診断方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220291139A1 (en) * 2021-03-15 2022-09-15 The Government Of The United States Of America, As Represented By The Secretary Of The Navy Foreign object debris detection
CN114317675A (zh) * 2022-01-06 2022-04-12 福州大学 基于机器学习定性和定量不同创面细菌的检测方法及系统

Also Published As

Publication number Publication date
KR101932525B1 (ko) 2018-12-27
TW201827788A (zh) 2018-08-01
KR20180087748A (ko) 2018-08-02
TWI647424B (zh) 2019-01-11

Similar Documents

Publication Publication Date Title
WO2018139810A1 (fr) Appareil de détection pour calculer des informations de position d'un objet en mouvement, et procédé de détection l'utilisant
WO2012128574A2 (fr) Dispositif de simulation de golf virtuel, dispositif de détection et procédé intégré
WO2013043021A2 (fr) Système et procédé pour photographier un sujet en mouvement au moyen d'un appareil photo, et acquérir la trajectoire de mouvement réelle du sujet sur la base de l'image prise
WO2014109545A1 (fr) Appareil et procédé de détection d'une balle en mouvement
WO2017204571A1 (fr) Appareil de détection de caméra pour obtenir des informations tridimensionnelles d'un objet, et appareil de simulation de golf virtuel l'utilisant
WO2012108699A2 (fr) Appareil et procédé de simulation de golf virtuelle
WO2012128568A2 (fr) Dispositif de simulation de golf virtuel, dispositif de détection et procédé intégré
WO2016200208A1 (fr) Procédé et dispositif de détection de balle en mouvement
WO2015080431A1 (fr) Simulateur de golf et procédé de simulation de golf
CN107543530B (zh) 用于测量球的旋转的方法、系统及非暂时性计算机可读记录介质
WO2011081471A2 (fr) Appareil de simulation de golf virtuel comportant un guide de potting
CN107871120A (zh) 基于机器学习的体育赛事理解系统及方法
WO2014109544A1 (fr) Dispositif et procédé pour détecter une balle en mouvement et procédé de traitement d'image de balle pour le calcul de la rotation d'une balle en mouvement
WO2018030673A1 (fr) Dispositif de calcul d'informations de vol de balle, et procédé de calcul d'informations de vol de balle et support d'enregistrement lisible par un dispositif informatique pour l'enregistrement de celles-ci
WO2018030656A1 (fr) Dispositif interactif de match de baseball à réalité virtuelle et procédé de commande de match de baseball virtuel à l'aide dudit dispositif
WO2022004961A1 (fr) Procédé de comparaison et de correction de posture utilisant une application qui superpose deux images de golf et des données de résultat en une seule et les vérifie
JP7076955B2 (ja) ボールの画像の明るさを補正するための方法、システム、及び非一時的なコンピュータ読み取り可能な記録媒体
WO2011081470A2 (fr) Appareil et procédé de simulation de golf virtuel avec affichage d'image en incrustation et réaffichage d'image
WO2017160057A1 (fr) Système de golf avec écran, procédé de mise en œuvre d'une image pour le golf avec écran, et support d'enregistrement lisible par ordinateur pour enregistrer celle-ci
WO2011065804A2 (fr) Appareil de simulation de golf virtuel et son procédé
WO2020054954A1 (fr) Procédé et système pour fournir une rétroaction virtuelle en temps réel
WO2014189315A1 (fr) Système d'entraînement au golf pour communiquer un swing de golf, serveur et procédé de traitement d'informations concernant le swing de golf l'utilisant
CN109001484A (zh) 旋转速度的检测方法和装置
WO2012128566A2 (fr) Dispositif et procédé de simulation de golf virtuel, dispositif de détection et procédé intégré
WO2012134209A2 (fr) Appareil et procédé de simulation de golf virtuel

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18744280

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18744280

Country of ref document: EP

Kind code of ref document: A1