KR101862138B1 - Method and apparatus for providing information about golf swing - Google Patents

Abstract

Determining at least one of a posture and a movement of the user based on at least one body part of the user detected in the obtained depth image, determining at least one of a determined posture and a movement of the user, A method of generating an image including information about a golf swing posture of a user, transmitting the generated image to a wearable device worn by the user, and providing the information about the golf swing displayed on the wearable device And an apparatus are disclosed.

Description

[0001] METHOD AND APPARATUS FOR PROVIDING INFORMATION ABOUT GOLF SWING [0002]

The disclosed embodiments provide a method for a server to provide information about a golf swing, a method for providing a wearable device with information about a golf swing, a server for providing information about a golf swing, and a wearable device for providing information about a golf swing .

In golf swing practice, a golf swing can only be achieved if each action from address (address) to back swing, down swing, impact, and finish is correctly implemented have. In order to achieve such a good golf swing, it is necessary to repeatedly perform the calibration based on the steady practice and the analysis result based on the expert's accurate analysis of the golf swing.

Conventionally, analysis of a golf swing posture by an expert has been performed in such a manner that a guideline is manually displayed on an image of a user's golf swing motion and the user's swing motion is explained to what extent a wrong portion is present with respect to the displayed guideline .

However, the above-described conventional technique requires the help of a specialist or a third party. In addition, in the course of a user's golf practice in a manner in which a guide line is manually displayed, the golf swing is self- There was a limit to the ability to proceed with the exercises.

The disclosed technical idea is to acquire a depth image for a user who performs a golf swing, to analyze the attitude or movement of the user through analysis of the depth image, and to provide a video including information about the golf swing to the user in real time, And more particularly, to a method and apparatus for accurately analyzing a problem with a golf swing posture and providing information on a golf swing capable of correcting a posture.

According to one embodiment, a method for a server to provide information about a golf swing includes: obtaining a depth image for a golf swinging user; Determining at least one of a posture and a movement of the user based on at least one body part of the user detected in the obtained depth image; Generating an image including information on a golf swing posture of the user based on at least one of a determined attitude and a motion of the user; And transmitting the generated image to a wearable device worn by the user, wherein the image is displayed on the wearable device.

According to an exemplary embodiment of the present invention, a method for providing information about a golf swing in a server includes acquiring a depth image for a user as a predetermined voice signal is acquired from a user.

A method of providing information about a golf swing according to an embodiment, the step of generating an image includes the steps of: generating a video image showing a figure indicating a reference swing posture at a position corresponding to at least one body part of the detected user .

In a method of providing information about a golf swing according to an embodiment, the step of generating an image includes generating at least one body part of the detected user from a user's body that does not correspond to a figure representing a reference swing pose And generates an image in which the identifier is displayed in the region.

In a method of providing information about a golf swing according to an embodiment, the step of determining includes, in a depth image acquired during a predetermined time interval, based on at least one body part of the detected user, And the step of generating an image includes extracting an image of a time period in which the motion of the user corresponding to the swing motion is detected.

A method for providing a wearable device with information about a golf swing according to an embodiment includes: establishing a communication session with a server acquiring a depth image for a golf swinging user; Receiving an image through a communication session established from a server as an image including information about a golf swing posture of a user is generated based on a depth image in a server; And displaying the received image.

A method of providing a wearable device according to an embodiment for providing information about a golf swing, the step of displaying displays a received image as a user input requesting playback of the received image is obtained.

In a method of providing a wearable device according to an embodiment of the present invention, information on a golf swing is provided. The received image is displayed on a position corresponding to at least one body part of the user detected in the depth image, Is displayed.

A method for providing information about a golf swing according to an embodiment, the method comprising: receiving, from at least one body part of a user detected in a depth image, Is an image in which an identifier is displayed on the body part of the user.

A method of providing information about a golf swing according to an exemplary embodiment of the present invention includes the steps of: receiving a video by sensing a swing motion of a golf swing user in a server, And receives the image of the detected time interval.

According to an embodiment of the present invention, there is provided a server for providing information on a golf swing, including: an image acquiring unit acquiring a depth image for a golf swing user; Determining at least one of a posture and a movement of the user based on at least one body part of the user detected in the obtained depth image and determining at least one of information about the golf swing posture of the user A control unit for generating an image including the image; And a communication unit for transmitting the generated image to the wearable device worn by the user, and the image is displayed on the wearable device.

According to an embodiment of the present invention, there is provided a server for providing information on a golf swing, wherein an image acquiring unit acquires a depth image for a user as a predetermined voice signal is acquired from a user.

In a server for providing information on a golf swing according to an embodiment, the control unit generates an image in which a figure indicating a reference swing posture is displayed at a position corresponding to at least one body part of the detected user.

In a server for providing information on a golf swing according to an embodiment, the control unit may be configured to display, in at least one body part of the detected user, a video image in which an identifier is displayed on a body part of the user that does not correspond to a figure indicating a reference swing posture .

In a server for providing information on a golf swing according to an embodiment, the control unit may control, based on at least one body part of the detected user in a depth image obtained during a predetermined time interval, And extracts the image of the time period in which the motion of the user corresponding to the swing motion is detected.

A wearable device for providing information on a golf swing according to an embodiment includes a controller for establishing a communication session with a server for acquiring a depth image for a golf swinging user; A communication unit for receiving an image through a communication session established from a server as an image including information about a golf swing posture of a user is generated based on a depth image on a server; And an output unit for displaying the received image.

In a wearable device that provides information about a golf swing according to an embodiment, the output unit displays the received image as the user input requesting playback of the received image is acquired.

In a wearable device for providing information on a golf swing according to an embodiment, a received image is displayed on a display screen that displays a figure indicating a reference swing posture at a position corresponding to at least one body part of the user detected in the depth image to be.

In a wearable device that provides information about a golf swing according to one embodiment, a received image is a portion of at least one body part of a user detected in a depth image, It is the image with the identifier on the part.

According to an embodiment of the present invention, there is provided a wearable device for providing information on a golf swing, wherein a communication unit detects a movement of a user corresponding to a swing motion generated in a server, As shown in FIG.

A method and apparatus for providing information on a golf swing according to the present invention includes: acquiring a depth image for a user who is swinging golf, analyzing the attitude or movement of the user through analysis of a depth image, The user can precisely analyze the problem of the golf swing posture and correct the posture.

1 is a conceptual diagram for explaining an apparatus for measuring a speed and a spin of a moving object according to an embodiment.
2 is a flowchart illustrating a method of measuring a speed and a spin of a subject according to an embodiment of the present invention.
FIG. 3 is a flowchart for explaining a method of calculating a speed of a subject in more detail according to an embodiment of the present invention. FIG.
4 is a diagram for explaining a method of calculating a speed of a subject in more detail by the measuring apparatus according to an embodiment.
5 is a flowchart for explaining a method of calculating a spin of a subject in more detail according to an embodiment of the present invention.
FIG. 6 is a diagram for explaining a method of calculating a spin of a subject in more detail according to an embodiment of the present invention. FIG.
Figures 7 and 8 are block diagrams of a measurement device according to one embodiment.
FIG. 9 is a view for explaining a method of a server according to an embodiment of the present invention to generate an image including information on a finish posture.
10 is a flowchart illustrating a method of providing a wearable device with an image in which a server displays an identifier on a body part of a user that does not correspond to a reference swing posture according to an exemplary embodiment.
11 and 12 are views for explaining a method of generating an image in which a server displays an identifier on a body part of a user that deviates from a reference swing posture in a back swing posture according to an exemplary embodiment.
13 is a view for explaining a method of generating an image in which an identifier is displayed on a body part of a user whose server deviates from a reference swing posture in a release posture according to an embodiment of the present invention.
FIGS. 14 and 15 are diagrams for explaining a method of generating an image in which a server displays an identifier on a body part of a user that deviates from a reference swing posture in a finish state.
16 is a view for explaining a method of generating an image in which a server displays an identifier on a body part of a user who deviates from a reference swing posture in a back swing posture according to an embodiment of the present invention.
FIG. 17 is a view for explaining a method of generating an image in which a server displays an identifier on a body part of a user who deviates from a reference swing posture in a downswing posture.
18 is a diagram for explaining a method of generating a video by detecting a motion of a user from a depth image obtained by a server according to an embodiment.
19 is a block diagram of a server that provides information about a golf swing in accordance with one embodiment.
20 and 21 are block diagrams of a wearable device that provides information regarding a golf swing in accordance with one embodiment.

The terms used in this specification will be briefly described and the present invention will be described in detail.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as " including " an element throughout the specification, it is to be understood that the element may include other elements as well, without departing from the spirit or scope of the present invention. Also, the terms " part, " " module, " and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram for explaining a method of providing information on a golf swing according to an embodiment.

The server 100 according to an exemplary embodiment may acquire a depth image for a golf swinging user. Here, the depth image means an image having three-dimensional coordinates. For example, the server 100 generates a depth image having three-dimensional coordinate information including depth information by detecting a reflected wave reflected from a user by irradiating a pulse of an ultrasonic wave or an infrared ray to a golf swing user, can do.

The server 100 according to an exemplary embodiment may detect at least one body part of the user in the acquired depth image. For example, the server 100 may detect a head region, a body region, a body region, and an arm region of a golf swing user from the obtained depth image. In addition, the server 100 may determine at least one of the user's posture and movement based on at least one body part of the detected user. For example, the server 100 may determine that the user is taking an addressing posture based on at least one body part of the detected user. According to another example, the server 100 may determine that the user is taking a swing action based on at least one body part of the user detected for a predetermined time period.

 The server 100 according to an exemplary embodiment may generate an image including information about the golf swing posture of the user based on at least one of a determined attitude and a motion of the user. For example, the server 100 may generate an image displaying a figure indicating a reference swing posture at a position corresponding to at least one body part of the detected user. In addition, the server 100 can generate an image having an identifier on the body part of the user that does not correspond to the reference swing posture, together with a figure indicating the reference swing posture.

Meanwhile, the server 100 can transmit the generated image to the wearable device worn by the user. Here, the server 100 can establish a communication session with the wearable device 200 existing within a predetermined range from the server. The server 100 can transmit the image to the wearable device 200 worn by the user through the established communication session.

The wearable device 200 according to an embodiment can receive an image including information on the golf swing posture of the user from the server 100 through the established communication session with the server 100. [ The wearable device 200 may display the received image when a user input requesting the image playback is obtained from the user. However, this is an embodiment only, and according to another example, the wearable device 200 may display an image automatically received as the image is received.

According to an embodiment, a wearer wearing the wearable device 200 can view an image including information on the golf swing posture of the user in real time while performing a swing motion. Accordingly, the user can correct the golf swing posture while watching the video in real time without changing the posture.

2 is a flow chart illustrating a method by which the server 100 according to an embodiment provides information on a golf swing posture.

In step S210, the server 100 acquires a depth image for a golf swing user. Here, the depth image may be a still image or a moving image according to the setting of the server 100.

The server 100 according to an exemplary embodiment may acquire a depth image of the user as the predetermined voice signal is obtained from the user. For example, the server 100 may acquire a depth image of a user by inputting a voice signal 'start' from the user.

In step S220, the server 100 determines at least one of the posture and the movement of the user based on at least one body part of the user detected in the obtained depth image.

The server 100 according to an embodiment can compare at least one body part sample with a previously obtained depth image to detect at least one body part of the user from the obtained depth image. However, this is only an example, and the method for the server 100 to detect at least one body part of the user from the acquired depth image is not limited thereto.

The server 100 according to an exemplary embodiment may determine at least one of a user's posture and a motion by comparing information about a plurality of postures constituting a golf swing operation with at least one body part of the detected user. For example, the server 100 may determine that the user is taking an address posture if the detected angle of the user's arm corresponds to the angle of the arm of the address posture. Further, according to another example, the server 100 may detect a change in the attitude of the user during a specific time interval, and determine that the user has taken a swing motion.

In step S230, the server 100 generates an image including information on the golf swing posture of the user, based on at least one of the determined attitude and movement of the user.

The server 100 according to an exemplary embodiment may generate an image in which a figure indicating a reference swing posture corresponding to a determined user's posture is displayed, as the user's posture is determined. In addition, the server 100 may generate an image displaying an identifier indicating a body part of the user that deviates from a reference swing posture.

The server 100 according to another embodiment may extract an image of a time interval in which the determined motion is performed and generate an image including information about the golf swing posture of the user as the user's motion is determined. For example, when it is determined that the user has performed the swing motion, the server 100 may extract an image of a time interval during which the swing motion is performed, and generate an image including information about the golf swing posture of the user have.

In step S240, the server 100 transmits the generated image to the wearable device 200 worn by the user.

The server 100 according to an exemplary embodiment may establish a communication session with the wearable device 200 worn by the user. For example, as the user wears the wearable device 200, a signal may be sent from the wearable device 200 to the server 100 to request a communication session setup. According to another example, the server 100 may send a signal requesting the wearable device 200 to establish a communication session.

The server 100 according to the exemplary embodiment may transmit the generated image to the wearable device 200 worn by the user through the established communication session. The transmitted image can be displayed on the wearable device 200. Accordingly, the user wearing the wearable device 200 can correct the golf swing posture while watching the video displayed on the wearable device 200. [

FIG. 3 is a flow chart for explaining how the wearable device 200 according to one embodiment provides information about a golf swing posture.

In step S310, the wearable device 200 establishes a communication session with a server that acquires a depth image for a golf swinging user.

In step S320, the wearable device 200 receives the video through the communication session established from the server 100 as the video including the information about the golf swing posture of the user is generated based on the depth image in the server 100 do.

In step S330, the wearable device 200 displays the received image.

4 is a flowchart for explaining a method of generating an image in which a figure indicating a reference swing posture is displayed, and transmitting the generated image to the wearable device 200 according to an embodiment of the present invention.

In step S410, the server 100 may acquire a depth image for a golf swing user.

On the other hand, step S410 may correspond to step S210 described above with reference to FIG.

In step S420, the server 100 may determine at least one of the posture and the movement of the user based on at least one body part of the user detected in the obtained depth image.

On the other hand, step S420 may correspond to step S220 described above with reference to FIG.

In step S430, the server 100 may generate an image displaying a figure indicating a reference swing pose at a position corresponding to at least one body part of the detected user.

In the server 100 according to the embodiment, information about the reference swing posture may be stored for a plurality of postures constituting the golf swing motion. For example, information about the reference swing posture may be stored in the server 100 with respect to the address posture, the backswing posture, and the downswing posture.

On the other hand, the server 100 can use a solid line and a dotted line to display the reference swing posture on the image. For example, the server 100 may display the reference swing posture on a depth image, in which the front and side of the user are respectively photographed, by solid lines. The server 100 can display information about the reference swing posture to the user more easily by displaying the figure indicating the reference swing posture using the depth image of the side as well as the front side of the user. According to another example, the server 100 may fill a vacant portion with a color in a reference swing posture indicated by a solid line, thereby allowing the user to easily identify the reference swing posture.

In step S440, the server 100 may transmit the generated image to the wearable device 200 worn by the user.

The server 100 according to an exemplary embodiment may establish a communication session with a wearable device worn by a user. The server 100 may transmit the generated image to the wearable device 200 through the established communication session.

On the other hand, the image can be displayed on the wearable device 200. A user wearing the wearable device 200 according to an embodiment can view or correct the posture through monitoring by simultaneously viewing the displayed image. Particularly, when the wearable device 200 is a smart glass, the user can monitor the posture of the user through the displayed image and check or correct the posture, without turning his head or changing his posture, have.

FIG. 5 is a diagram for explaining a method of generating an image including information on an address posture in the server 100 according to an embodiment.

The server 100 according to an exemplary embodiment may acquire a depth image of the user as the predetermined voice signal is obtained from the user. For example, the server 100 may acquire a depth image of the front and side views of the user. However, this is an embodiment only, and the server 100 may acquire a depth image of the rear view of the user according to the setting.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. Referring to FIG. 5, the server 100 may determine that the user is taking an address posture based on at least one body part detected from the obtained depth image. The server 100 may display an outline 512 indicating a reference swing posture with respect to the address posture at a position corresponding to the detected at least one body part.

The server 100 may transmit the image indicated by the outline 512 indicating the reference swing posture to the wearable device 200 worn by the user. In addition, the wearable device 200 can display images received from the server 100. [

The user can calibrate the address posture of the user by watching an image displayed on the wearable device 200. [

6 is a view for explaining a method of generating an image including information about a backswing posture in the server 100 according to an exemplary embodiment.

The server 100 according to an exemplary embodiment may acquire a depth image of the user as the predetermined voice signal is obtained from the user. For example, the server 100 may acquire a depth image of the front and side views of the user. However, this is an embodiment only, and the server 100 may acquire a depth image of the rear view of the user according to the setting.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. Referring to FIG. 6, the server 100 may determine that the user is taking a back-swing posture based on at least one body part detected from the obtained depth image. The server 100 may display a first contour 612 indicating a reference swing posture for the back swing posture at a location corresponding to the detected at least one body part.

In addition, the server 100 may display a second contour line 614 that is identifiable in a particular body part, among the detected body parts. For example, the server 100 may display a second contour line 614 at a location corresponding to the user's right leg to see if a swing occurs in the backswing posture.

The server 100 may transmit the image showing the first contour line 612 and the second contour line 614 indicating the reference swing position to the wearable device 200 worn by the user. In addition, the wearable device 200 can display images received from the server 100. [

A user according to an exemplary embodiment of the present invention can correct a back swing posture of a user by watching an image displayed on the wearable device 200.

7 is a diagram for explaining a method by which the server 100 according to an embodiment generates an image including information about a top posture of a backswing.

The server 100 according to an exemplary embodiment may acquire a depth image of the user as the predetermined voice signal is obtained from the user. For example, the server 100 may acquire a depth image of the front and side views of the user. However, this is an embodiment only, and the server 100 may acquire a depth image of the rear view of the user according to the setting.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. Referring to FIG. 7, the server 100 may determine, based on at least one body part detected from the obtained depth image, that the user is taking a backswing top posture. The server 100 may display a first contour 712 indicating a reference swing posture with respect to the backswing top posture at a location corresponding to the detected at least one body part.

In addition, the server 100 may display a second contour 714 that is identifiable on a particular body part, among the detected body parts. For example, the server 100 may display a second contour line 714 at a position corresponding to the user's right leg to check whether a swing phenomenon occurs in the backswing top posture. In addition, the server 100 may display a third contour line 716 indicating upper body tilt information on the upper body part of the user to check whether a reverse pivot occurs in the back swing top posture.

The server 100 may transmit the image with the first contour line 712, the second contour line 714, and the third contour line 716 indicating the reference swing position to the wearable device 200 worn by the user. In addition, the wearable device 200 can display images received from the server 100. [

The user can calibrate the back swing top posture of the user by watching the image displayed on the wearable device 200 according to one embodiment.

8 is a diagram for explaining a method by which the server 100 according to an embodiment generates an image including information about a downswing posture.

The server 100 according to an exemplary embodiment may acquire a depth image of the user as the predetermined voice signal is obtained from the user. For example, the server 100 may acquire a depth image of the front and side views of the user. However, this is an embodiment only, and the server 100 may acquire a depth image of the rear view of the user according to the setting.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. Referring to FIG. 8, the server 100 may determine that the user is taking a backswing top posture based on at least one body part detected from the obtained depth image. The server 100 may display a first contour 812 indicating a reference swing posture for the downswing posture at a location corresponding to the detected at least one body part.

In addition, the server 100 may display a second outline 814 that is identifiable in a particular body part, among the detected body parts. For example, the server 100 may display a second contour line 814 at a position corresponding to the left leg of the user to check whether a slide phenomenon occurs in a downswing posture.

The server 100 may transmit the image showing the first contour line 812 and the second contour line 814 indicating the reference swing position to the wearable device 200 worn by the user. In addition, the wearable device 200 can display images received from the server 100. [

A user according to an embodiment can view a video displayed on the wearable device 200, thereby correcting a user's downswing posture.

FIG. 9 is a view for explaining a method by which the server 100 according to an embodiment generates an image including information on a finish posture.

The server 100 according to an exemplary embodiment may acquire a depth image of the user as the predetermined voice signal is obtained from the user. For example, the server 100 may acquire a depth image of the front and side views of the user. However, this is an embodiment only, and the server 100 may acquire a depth image of the rear view of the user according to the setting.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. Referring to FIG. 7, the server 100 may determine that the user is in a finishing posture based on at least one body part detected from the obtained depth image. The server 100 may display a first contour line 912 indicating a reference swing posture with respect to the finish position at a position corresponding to the detected at least one body part.

In addition, the server 100 may display a second outline 914 that is identifiable on a particular body part, among the detected body parts. For example, the server 100 may display a second contour 914 that represents the left foot stall line so that the user's body can settle on the left foot stance line in the finish posture.

The server 100 may transmit the image showing the first contour line 912 and the second contour line 914 indicating the reference swing attitude to the wearable device 200 worn by the user. In addition, the wearable device 200 can display images received from the server 100. [

The user can calibrate the back swing top posture of the user by watching the image displayed on the wearable device 200 according to one embodiment.

10 is a flowchart illustrating a method of providing the wearable device 200 with an image in which the server 100 displays an identifier on a body part of a user that does not correspond to the reference swing posture according to an embodiment.

In step S1010, the server 100 may acquire a depth image for a golf swing user.

On the other hand, step S1010 may correspond to step S210 described above with reference to FIG.

In step S1020, the server 100 may determine at least one of the posture and the movement of the user based on at least one body part of the user detected in the obtained depth image.

On the other hand, step S1020 may correspond to step S220 described above with reference to FIG.

In step S1030, the server 100 can generate, from among at least one body part of the detected user, an image in which the identifier is displayed on the body part of the user that does not correspond to the figure indicating the reference swing pose.

For example, the server 100 may display a body part out of the reference swing posture by a dotted line among at least one body part of the user detected from the depth image of the front and side of the user, respectively. However, this is an embodiment only, and the identifier indicating the body part out of the reference swing posture is not limited to the dotted line.

In step S1040, the server 100 may transmit the generated image to the wearable device 200 worn by the user.

The server 100 according to an exemplary embodiment may establish a communication session with a wearable device worn by a user. The server 100 may transmit the generated image to the wearable device 200 through the established communication session.

On the other hand, the image can be displayed on the wearable device 200. A user wearing the wearable device 200 according to an embodiment can easily correct a body part that deviates from a reference swing posture by viewing an image to be displayed.

11 and 12 are views for explaining a method of generating an image in which a server 100 according to an embodiment displays an identifier on a body part of a user who is out of a reference swing posture in a back swing posture.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. The server 100 may determine that the user is taking a back swing posture based on at least one body part detected from the obtained depth image.

Referring to FIG. 11A, the server 100 may display a first contour line 1112 indicating a reference swing posture with respect to the back swing posture at a position corresponding to at least one detected body part. In addition, the server 100 may display a second contour 1114 that is identifiable in a particular body part, among the detected body parts. For example, the server 100 may display a second contour line 1114 at a position corresponding to the user's right leg to see if a swing phenomenon occurs in the backswing posture.

In FIG. 11A, the server 100 according to an embodiment can detect a body part of a user that does not correspond to the first contour line 1112 and the second contour line 1114, which represent the reference swing attitude. The server 100 may display the third contour 1112 on the right side of the user that does not correspond to the first contour 1112 and the second contour 1114. [

The server 100 may transmit the image with the first contour line 1112, the second contour line 1114 and the third contour line 1122 to the wearable device 200. In addition, the wearable device 200 can display the received image. The user can confirm that the user's right leg is out of the reference swing posture by checking the third contour 1122 in the image displayed on the wearable device 200. [

Referring to FIG. 11B, it can be confirmed that the user's posture is corrected to correspond to the reference swing posture by moving the right leg to correspond to the second contour line 1114. The server 100 may generate an image displaying the reference swing position from the depth image of the user obtained while the user corrects the posture and transmit the image to the wearable device 200. [ The user can easily calibrate the posture in real time by watching the video received by the wearable device 200. [

12A, the server 100 can display a first contour 1211 indicating a reference swing posture with respect to the back swing posture at a position corresponding to the detected at least one body part have. In addition, the server 100 may display a second contour line 1213 and a third contour line 1215, which are identifiable in a specific body part, among the detected body parts. For example, in order to check whether a reverse pivot phenomenon and a swing phenomenon occur in the back swing posture, the server 100 may set the second contour line 1213 and the third contour line 1215 ) Can be displayed.

12A, the server 100 according to an embodiment can detect a body part of a user that does not correspond to the second contour line 1213 and the third contour line 1215, which represent the reference swing attitude. The server 100 may display a fourth contour 1222 of the user's back that does not correspond to the second contour 1213. [

The server 100 may transmit to the wearable device 200 an image in which the first contour line 1211, the second contour line 1213, the third contour line 1215 and the fourth contour line 1222 are displayed. In addition, the wearable device 200 can display the received image. The user can confirm that the back slope of the user is out of the reference swing posture by checking the fourth contour 1222 in the image displayed on the wearable device 200. [

Referring to FIG. 12B, it can be confirmed that the user's posture is corrected to correspond to the reference swing posture by moving the backward slope corresponding to the second contour 1213. The server 100 may generate an image displaying the reference swing position from the depth image of the user obtained while the user corrects the posture and transmit the image to the wearable device 200. [ The user can easily calibrate the posture in real time by watching the video received by the wearable device 200. [

FIG. 13 is a view for explaining a method of generating an image in which an identifier is displayed on a body part of a user whose server 100 deviates from a reference swing posture in a release posture according to an embodiment.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. The server 100 may determine that the user is taking a release posture based on at least one body part detected from the obtained depth image.

Referring to FIG. 13, the server 100 may display a first contour 1312 indicating a reference swing posture with respect to a release posture at a position corresponding to at least one detected body part. In addition, the server 100 may display a second outline 1314 that is identifiable in a specific body part, among the detected body parts. For example, the server 100 may display a second contour line 1314 at a position corresponding to the user's right leg to see if a slide phenomenon occurs in the release position.

In FIG. 13, the server 100 according to one embodiment may detect a body part of the user that does not correspond to the first contour line 1312 and the second contour line 1314, which represent the reference swing attitude. The server 100 may display the third contour 1322 on the left leg of the user that does not correspond to the first contour 1312 and the second contour 1314. [

The server 100 may transmit to the wearable device 200 an image in which the first contour line 1312, the second contour line 1314 and the third contour line 1322 are displayed. In addition, the wearable device 200 can display the received image. The user can confirm that the left leg of the user is out of the reference swing posture by checking the third contour line 1322 in the image displayed on the wearable device 200. [

FIGS. 14 and 15 are diagrams for explaining a method of generating an image in which a server 100 according to an embodiment displays an identifier on a body part of a user, which deviates from a reference swing posture in a finish state.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. The server 100 can determine that the user is taking a finish posture based on at least one body part detected from the obtained depth image.

Referring to FIG. 14, the server 100 may display a first contour 1412 indicating a reference swing posture with respect to a finish posture at a position corresponding to at least one detected body part. In addition, the server 100 may display a second outline 1414 that is identifiable in a particular body part, among the detected body parts. For example, the server 100 may display a second contour line 1414 at a position corresponding to the left foot stance line of the user to check if a slide phenomenon occurs in the finish posture.

In FIG. 14, the server 100 according to one embodiment can detect a body part of a user that does not correspond to a first contour 1412 and a second contour 1414, which represent a reference swing posture. The server 100 may display the third contour 1422 on the left leg of the user that does not correspond to the first contour 1412 and the second contour 1414. [

The server 100 may transmit the image with the first contour line 1412, the second contour line 1414 and the third contour line 1422 to the wearable device 200. In addition, the wearable device 200 can display the received image. The user can confirm that the left leg of the user is out of the reference swing posture by checking the third contour line 1422 in the image displayed on the wearable device 200. [

Referring to FIG. 15, the server 100 may display a first contour line 1512 indicating a reference swing posture with respect to the finish position at a position corresponding to at least one detected body part. In addition, the server 100 may display a second outline 1514 that is identifiable in a particular body part, among the detected body parts. For example, the server 100 may display a second contour line 1514 at a position corresponding to the left leg stance line of the user to check whether a hanging back phenomenon occurs in the finish position.

In FIG. 15, the server 100 according to an embodiment can detect a body part of a user that does not correspond to a first contour line 1512 and a second contour line 1514, which represent the reference swing attitude. The server 100 may display the third contour 1522 on the left leg of the user that does not correspond to the first contour 1512 and the second contour 1514. [

The server 100 may transmit to the wearable device 200 an image in which the first contour 1512, the second contour 1514 and the third contour 1522 are displayed. In addition, the wearable device 200 can display the received image. The user can confirm that the left leg of the user is out of the reference swing posture by checking the third outline 1522 in the video displayed on the wearable device 200. [

16 is a diagram for explaining a method of generating an image in which an identifier is displayed on a body part of a user whose server 100 deviates from a reference swing posture in a back-swing posture according to an embodiment.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. The server 100 may determine that the user is taking a back swing posture based on at least one body part detected from the obtained depth image.

Referring to FIG. 16, the server 100 may display a first contour 1612 indicating a reference swing posture with respect to the back swing posture at a position corresponding to the detected at least one body part.

In FIG. 16, the server 100 according to an embodiment can detect a body part of a user that does not correspond to a first contour line 1612 indicating a reference swing posture. The server 100 may display an arrow 1622 in the head portion of the first contour 1612 user.

The server 100 may transmit the image with the first contour line 1612 and the arrow 1622 to the wearable device 200. [ In addition, the wearable device 200 can display the received image. The user can confirm that the head of the user is out of the reference swing posture by checking the arrow 1622 in the video displayed on the wearable device 200. [

FIG. 17 is a diagram for explaining a method of generating an image in which a server 100 according to an embodiment displays an identifier on a body part of a user who is out of a reference swing posture in a downswing posture.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. The server 100 may determine that the user is taking a downswing posture based on at least one body part detected from the acquired depth image.

Referring to FIG. 17, the server 100 may display a first contour 1712 indicating a reference swing posture with respect to the downswing posture at a position corresponding to at least one detected body part.

In FIG. 17, the server 100 according to one embodiment may detect a body part of a user that does not correspond to a first contour line 1712 indicating a reference swing posture. The server 100 may display an arrow 1722 in the head portion of the first contour 1712 user.

The server 100 may transmit the image with the first contour 1712 and the arrow 1722 to the wearable device 200. [ In addition, the wearable device 200 can display the received image. The user can confirm that the head of the user is out of the reference swing posture by checking the arrow 1722 in the video displayed on the wearable device 200. [

18 is a diagram for explaining a method for the server 100 according to an embodiment to detect a motion of a user from an acquired depth image to generate an image.

 The server 100 according to an exemplary embodiment may acquire a depth image of a user swinging golf during a predetermined time interval. The server 100 may detect at least one body part of the user in the depth image obtained during a predetermined time interval to detect the movement of the user corresponding to the swing operation. For example, the server 100 may determine that the user is performing a swing motion when a continuous posture from the address posture to the finish posture is detected in the depth image obtained during a predetermined interval. The server 100 may extract the image 1810 of the time interval in which the motion corresponding to the swing motion of the user is detected in the depth image obtained during the preset time interval. The server 100 can extract the image 1810 of the interval in which the swing operation is automatically performed when the user's movement corresponding to the swing motion is detected in the depth image for a predetermined interval without any separate control command.

The server 100 according to an embodiment can transmit an image obtained by combining the extracted image 1810 and the game information 1820 to the wearable device 200. [ The wearable device 200 may display an image received from the server 100 when a playback request input is received from the user. The user can view the image displayed on the wearable device 200 and easily correct the swing motion of the user.

The server 100 according to an exemplary embodiment may acquire a depth image of the user as the predetermined voice signal is obtained from the user. For example, the server 100 may acquire a depth image of the front and side views of the user. However, this is an embodiment only, and the server 100 may acquire a depth image of the rear view of the user according to the setting.

The server 100 according to an exemplary embodiment may detect at least one body part from the obtained depth image to determine the posture of the user. Referring to FIG. 8, the server 100 may determine that the user is taking a backswing top posture based on at least one body part detected from the obtained depth image. The server 100 may display a first contour 812 indicating a reference swing posture for the downswing posture at a location corresponding to the detected at least one body part.

In addition, the server 100 may display a second outline 814 that is identifiable in a particular body part, among the detected body parts. For example, the server 100 may display a second contour line 814 at a position corresponding to the left leg of the user to check whether a slide phenomenon occurs in a downswing posture.

The server 100 may transmit the image showing the first contour line 812 and the second contour line 814 indicating the reference swing position to the wearable device 200 worn by the user. In addition, the wearable device 200 can display images received from the server 100. [

19 is a block diagram of a server 100 that provides information regarding a golf swing in accordance with one embodiment.

19, a server 100 providing information on a golf swing according to an embodiment includes an image acquisition unit 110, a control unit 120, a communication unit 130, and a memory 140 . However, not all illustrated components are required. A server 100 that provides information about a golf swing by more components than the components shown may be implemented and a server 100 that provides information about a golf swing by fewer components may be implemented have.

The image acquiring unit 110 acquires a depth image for a golf swing user. The image acquiring unit 110 may acquire a depth image for a user as a predetermined voice signal is acquired from a golf swing user. However, this is only an example, and the signal that can control the image acquisition unit 110 is not limited to the voice signal.

The control unit 120 determines at least one of the posture and the movement of the user based on at least one body part of the user detected in the obtained depth image. Also, the control unit 120 generates an image including information about the golf swing posture of the user based on at least one of the determined attitude and motion of the user.

The control unit 120 according to an exemplary embodiment may generate an image displaying a figure indicating a reference swing posture at a position corresponding to at least one body part of the detected user.

In addition, the controller 120 according to an exemplary embodiment may generate an image in which an identifier is displayed on a body part of a user that does not correspond to a graphic form indicating a reference swing posture, among at least one body part of the detected user.

The control unit 120 according to an exemplary embodiment may detect a motion of a user corresponding to a swing motion based on at least one body part of a detected user in a depth image obtained during a predetermined time period. In addition, the control unit 120 can extract an image of a time interval in which the movement of the user corresponding to the swing motion is detected.

The communication unit 130 may include one or more components for communicating between the server 100 and a peripheral device. For example, the communication unit 130 may include a local communication unit, a mobile communication unit, and a broadcast receiving unit.

The communication unit 130 according to an exemplary embodiment transmits the generated image to the wearable device worn by the user.

The memory 140 may store a program for processing and controlling the control unit 120, and may store input / output data.

20 and 21 are block diagrams of a wearable device 200 that provides information regarding a golf swing in accordance with one embodiment.

20 and 21, a wearable device 200 that provides information regarding a golf swing according to an embodiment may include a control unit 210, a communication unit 220, and an output unit 230 . However, not all illustrated components are required. A wearable device 200 that provides information about a golf swing by more components than the components shown may be implemented and a wearable device 200 that provides information about a golf swing by fewer components may be implemented .

Hereinafter, the components will be described in order.

The control unit 210 establishes a communication session with a server that acquires a depth image for a golf swinging user.

The communication unit 220 may include one or more components that allow communication between the wearable device 200 and the peripheral device. For example, the communication unit 20 may include a local communication unit, a mobile communication unit, and a broadcast receiving unit.

The communication unit 220 receives an image through a communication session established from the server as an image including information on the golf swing posture of the user is generated based on the depth image in the server.

The communication unit 220 according to an exemplary embodiment of the present invention can receive an image of a time interval during which a motion of a user corresponding to a swing motion is detected as the swing motion of a golf swing user is sensed by the server 100. [

The output unit 230 displays the received image.

The output unit 230 according to an exemplary embodiment may display the received image as the user input requesting the playback of the received image is acquired.

Meanwhile, referring to FIG. 21, the wearable device 200 may include a smart glass. According to one embodiment, a user who wears the wearable device 200 wears the wearable device 200 and performs information on the golf swing transmitted from the server 100 to the wearable device 200 in real time By receiving this, it is possible to more easily correct the golf swing motion.

The method according to an embodiment of the present invention can be implemented in the form of a program command which can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

Claims (21)

Acquiring a depth image for a golf swing user;
Determining a swing posture of the user based on at least one body part of the user detected in the obtained depth image;
Displaying a first contour representing the reference swing posture with respect to the swing posture of the user determined in the step of determining the swing posture of the user at a position corresponding to the detected at least one body part on the obtained depth image;
Detecting a body part of the user that does not correspond to the first contour representing the reference swing pose;
Displaying an arrow pointing to the detected part of the body at a corresponding part of the first contour for a part of the body detected not to correspond to the first contour;
Generating an image in which the first contour and the arrow are displayed on the depth image; And
And transmitting the generated image to a wearable device worn by the user,
Wherein the image is displayed on the wearable device. The method according to claim 1,
Wherein the determining of the swing posture of the user comprises:
And detecting that the user is taking a backswing posture based on the detected at least one body part,
Wherein the step of displaying the first contour on the obtained depth image comprises:
And displaying the first contour representing the reference swing posture with respect to the backswing posture on the depth image,
Displaying a second contour line for determining whether a swing phenomenon occurs in the backswing posture at a position corresponding to the right leg of the user,
Further comprising the step of detecting a body part not corresponding to the second contour of the body part of the user and displaying a third contour on the body part. The method according to claim 1,
Wherein the determining of the swing posture of the user comprises:
And detecting that the user is taking the backswing top position based on the detected at least one body part,
Wherein the step of displaying the first contour on the obtained depth image comprises:
And displaying the first contour representing the reference swing posture with respect to the backswing top posture on the depth image,
Displaying a second contour line and a third contour line for determining whether a reverse pivot phenomenon or a swing phenomenon occurs in the backswing top posture at a position corresponding to the back and right legs of the user,
Detecting a body part not corresponding to the second contour and the third contour of the body part of the user and displaying a fourth contour on the body part; How to provide. The method according to claim 1,
Wherein the determining of the swing posture of the user comprises:
And detecting that the user is taking a release position based on the detected at least one body part,
Wherein the step of displaying the first contour on the obtained depth image comprises:
And displaying the first contour representing the reference swing posture with respect to the release posture on the depth image,
Displaying a second contour for determining whether a slide phenomenon occurs in the release posture at a position corresponding to the right leg of the user,
Further comprising the step of detecting a body part not corresponding to the second contour of the body part of the user and displaying a third contour on the body part. The method according to claim 1,
Wherein the determining of the swing posture of the user comprises:
And detecting that the user is in a finish state based on the detected at least one body part,
Wherein the step of displaying the first contour on the obtained depth image comprises:
And displaying the first contour representing the reference swing posture with respect to the finish posture on the depth image,
Displaying a second contour for determining whether a hanging back phenomenon occurs in the finish position at a position corresponding to the left foot stance line of the user,
Further comprising the step of detecting a body part not corresponding to the second contour of the body part of the user and displaying a third contour on the body part. delete delete delete delete delete An image acquiring unit acquiring a depth image for a golf swing user;
Determining a swing posture of the user based on at least one body part of the user detected in the obtained depth image and determining a swing posture of the user at a position corresponding to the detected at least one body part A first contour line indicating a reference swing pose of the determined swing attitude of the user is displayed on the obtained depth image and a body part of the user not corresponding to the first contour line indicating the reference swing pose is detected, An arrow pointing to the detected part of the body is displayed on a corresponding part of the first contour with respect to a part of the body detected as not corresponding to the first contour, and an image in which the first contour and the arrow are displayed on the depth image A control unit configured to control the display unit; And
And a communication unit for transmitting the generated image to the wearable device worn by the user,
Wherein the image is displayed on the wearable device. 12. The image processing apparatus according to claim 11,
And providing information about a golf swing to acquire a depth image for the user as a predetermined voice signal is obtained from the user. 12. The apparatus according to claim 11,
Displays the first contour representing the reference swing posture with respect to the backswing posture on the depth image when the user detects that the user is taking the backswing top posture based on the detected at least one body part, A second contour line and a third contour line for determining whether a reverse pivot phenomenon and a swing phenomenon occur in the top posture are respectively displayed at positions corresponding to the back and right legs of the user, And to display a fourth contour on the body part by detecting a body part not corresponding to the contour and the third contour. 12. The apparatus according to claim 11,
Displays the first contour indicating the reference swing posture with respect to the release posture on the depth image when the user detects that the user is taking the release posture based on the detected at least one body part, A second contour line for determining whether a slide phenomenon occurs is displayed at a position corresponding to the right leg of the user and a body part that does not correspond to the second contour line of the user's body part is detected, And to display a third outline of the golf swing. 12. The apparatus according to claim 11,
And displays the first contour indicating the reference swing posture with respect to the finish posture on the depth image when the user detects that the user is taking the finish posture based on the detected at least one body part, A second contour line for determining whether a hanging back phenomenon occurs is displayed at a position corresponding to the left leg stance line of the user and a body part not corresponding to the second contour line of the user's body part is detected, Wherein the server is configured to display a third contour on the golf swing. delete delete delete delete delete A computer-readable recording medium on which a program for performing the method of claim 1 is recorded.

Images