JP2021103483A - Image processing device, method, and program - Google Patents

Abstract

To provide an image processing device capable of immediately grasping a change in a club head speed during a golf swing, a method, and a program.SOLUTION: An image processing device comprises: an image generation unit 21 which generates a locus image representing a locus of a club head 41a of a golf club 41 when the golf club 41 is swung or a group of face surface images representing a plurality of face surfaces of the club head 41a during a golf swing; an image measuring unit 22 which acquires information on a club head speed during the golf swing; and a control unit 24 which changes a method for displaying each segmented portion of the locus image or each face surface image constituting a group of phase surface images on the basis of the information on the club head speed during the golf swing.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image processing apparatus and method for displaying information regarding a golf club swing, and a program.

Conventionally, various devices have been proposed that photograph a golfer's swing and provide the photographed information. By providing the golfer with the shooting information of the swing, it is possible to promote the improvement of golf and the selection of the golf club suitable for the golfer.

As the above-mentioned device, for example, in Patent Document 1, a golf club and a golf ball when a golf club is swung are photographed from above, and an image of the photographed club head and the golf ball is displayed on the floor surface in full size. It has been proposed to project it.

Further, Patent Document 2 proposes to display a movement locus when a golf club is visually recognized from above.

JP-A-2018-61729 Japanese Unexamined Patent Publication No. 2012-40052

Here, one of the important factors in a golfer's swing is a change in the speed of the club head during the swing. By recognizing the change in the speed of the club head during the swing, it is possible to grasp the characteristics of the golfer's swing, and it is possible to select a golf club that matches the characteristics.

Patent Document 1 proposes to project a full-scale image of a club head onto the floor, but simply displaying a full-scale image of the club head changes the speed of the club head during a swing. Is difficult to recognize immediately.

Further, Patent Document 2 proposes to measure the speed at which the club head impacts a golf ball and the maximum speed of the club head. However, a method of recognizing a change in the speed of the club head as an image is provided. Has not been proposed.

In view of the above problems, it is an object of the present invention to provide an image processing device, a method and a program capable of immediately grasping a change in the speed of a club head during a swing.

The image processing apparatus of the present invention is an image generation unit that generates a group of trajectory images representing the trajectory of a club head of a golf club when the golf club is swung or face surface images representing a plurality of face surfaces of the club head during the swing. A speed information acquisition unit that acquires information on the speed of the club head during the swing, and each part that divides the trajectory image or a group of face surface images based on the information on the speed of the club head during the swing. It is provided with a control unit that changes the display method of the face surface image.

Further, in the image processing apparatus of the present invention, the control unit can identifiablely display a trajectory image or a face surface image of a portion where the speed of the club head is maximized.

Further, in the image processing apparatus of the present invention, the control unit can display the color of the trajectory image of the portion where the speed of the club head is maximum in a color different from the color of the other portion.

Further, in the image processing apparatus of the present invention, the control unit can display the color of the face surface image at which the speed of the club head is maximized in a color different from the color of other face surface images.

Further, in the image processing apparatus of the present invention, the image generation unit can generate an image in which the face surface is represented by a straight line as the face surface image, and the control unit is the face when the speed of the club head is maximized. The surface image can be displayed longer than other face surface images.

Further, in the image processing apparatus of the present invention, the control unit can project a group of orbital images or face surface images onto the floor surface by the projection unit.

Further, in the image processing apparatus of the present invention, the control unit can project and display a group of face surface images on the floor surface in real time by the projection unit in accordance with the swing of the golf club.

Further, in the image processing apparatus of the present invention, the control unit can sequentially project and display a plurality of face surface images constituting a group of face surface images on the floor surface in chronological order.

Further, in the image processing apparatus of the present invention, the image generation unit can generate a face surface image based on a photographed image of the club head during the swing, and the control unit can generate a plurality of face surface images thereof. Immediately after each captured image corresponding to each face surface image is captured, it can be sequentially projected and displayed.

Further, in the image processing apparatus of the present invention, the control unit can adjust the length of the straight line of the face surface image.

The image processing method of the present invention generates a group of trajectory images representing the trajectory of the club head of the golf club when the golf club is swung or face surface images representing a plurality of face surfaces of the club head during the swing, and swings. Acquire information on the speed of the club head inside, and change the display method of each face image that constitutes each part of the trajectory image or a group of face images based on the information on the speed of the club head during the swing. can do.

The image processing program of the present invention includes a step of generating a trajectory image representing the trajectory of a club head of a golf club when the golf club is swung, or a group of face surface images representing a plurality of face surfaces of the club head during the swing. Based on the step of acquiring the information on the speed of the club head during the swing and the information on the speed of the club head during the swing, the display of each face image that constitutes each part of the trajectory image or a group of face images. You can have your computer perform steps and steps to change the method.

According to the image processing apparatus, method and program of the present invention, information on the speed of the club head during the swing is acquired, and each portion of the trajectory image of the club head is divided based on the information on the speed of the club head during the swing. Or, since the display method of each face surface image that constitutes a group of face surface images representing the face surface of the club head during the swing is changed, it is possible to immediately grasp the change in the speed of the club head during the swing. it can. For example, it is possible to immediately grasp the period during which the speed of the club head becomes the fastest during a swing.

The figure which shows the schematic structure of the golf simulation system using one Embodiment of the image processing apparatus of this invention. The figure which shows an example of the mark provided on the club head A diagram showing another example of a seal for detecting the face surface of a club head. The figure which shows the group of the face surface image generated by one swing of a golf club and the projection display example of the trajectory image. The figure which shows the group of the face surface image generated by the swing of a golf club, and the projection display example of the trajectory image TG. The figure which shows the example which displayed the part of the trajectory image with the fastest club head in an identifiable manner. The figure which shows the other example which displayed the part of the trajectory image with the fastest club head in an identifiable manner. Diagram showing an example of the measurement result display screen A flowchart for explaining the operation of the golf simulation system shown in FIG. A flowchart for explaining the operation of the golf simulation system shown in FIG. The figure which shows the example which projected and displayed only the 1st face surface image and the 2nd face surface image on the floor surface. A diagram showing an example in which the previously displayed face surface image is continuously projected and displayed in chronological order. The figure showing an example in which the face surface image displayed once earlier is sequentially hidden in chronological order.

Hereinafter, a golf simulation system using an embodiment of the image processing apparatus of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic configuration diagram of the golf simulation system 1 of the present embodiment.

As shown in FIG. 1, the golf simulation system 1 of the present embodiment includes a photographing device 10, an image processing device 20, and a projection device 30. The photographing device 10 and the image processing device 20 and the image processing device 20 and the projection device 30 are communicably connected by wire or wirelessly, and various signals can be exchanged. In the present embodiment, the photographing device 10 corresponds to the photographing unit of the present invention, and the projection device 30 corresponds to the projection unit of the present invention.

The photographing device 10 photographs the club head 41a of the golf club 41 when the golfer 40 swings the golf club 41 from above. The photographing device 10 is installed above the golfer 40 swinging the golf club 41, and is installed directly above the above range so that the range where the club head 41a passes near the floor surface can be photographed. Specifically, the photographing device 10 is installed directly above a predetermined photographing range R including the installation position P of the golf ball 42 set in advance on the floor surface in the vicinity of the center, for example. The photographing device 10 may be installed on a support member such as a stand, or may be installed on the ceiling.

The photographing device 10 includes an illumination unit 11 and a camera unit 12. The illumination unit 11 of the present embodiment has an infrared light source, and irradiates the photographing range R with infrared light emitted from the infrared light source. Further, the camera unit 12 has an image sensor such as a CMOS (Complementary metal-oxide-semiconductor) image sensor or a CCD (Charged-coupled devices) image sensor, and an IR filter arranged in front of the image sensor. The IR filter is an optical filter that absorbs visible light and transmits infrared light.

The photographing device 10 emits infrared light from the illumination unit 11 based on the control signal output from the control unit 24 described later of the image processing device 20, and the camera unit 12 photographs the photographing range R. Specifically, the photographing device 10 emits infrared light from the illumination unit 11 at a predetermined frame rate, and photographs the club head 41a passing through the photographing range R. The captured image captured by the photographing device 10 at a predetermined frame rate is output to the image processing device 20.

The image processing device 20 is composed of a computer or the like, and includes semiconductor memories such as a CPU (Central Processing Unit), ROM (Read Only Memory) and RAM (Random access memory), storage such as a hard disk, and hardware such as a communication I / F. Equipped with clothing.

The image processing device 20 includes an image generation unit 21, an image measurement unit 22, a swing history information storage unit 23, a control unit 24, a display unit 25, and an input unit 26.

A golf simulation program including an embodiment of the image processing program of the present invention is installed in the semiconductor memory or the hard disk of the image processing device 20. Then, when this program is executed by the CPU, the image generation unit 21, the image measurement unit 22, and the control unit 24 described above function. In this embodiment, all the functions of the above-mentioned parts are executed by the golf simulation program, but the present invention is not limited to this, and some or all the functions are performed by ASIC (Application Specific Integrated Circuit) or FPGA (Field-). It may be composed of hardware such as Programmable Gate Array) and other electric circuits.

The swing history information storage unit 23 is composed of a semiconductor memory or a hard disk.

Hereinafter, each part of the image processing apparatus 20 will be described in detail.

The image generation unit 21 acquires captured images of a plurality of club heads 41a photographed in time series by the photographing device 10, and represents the face surface of each club head 41a with a straight line based on the acquired plurality of captured images. Generate a group of face surface images. Although the term face surface is used throughout the present specification, this face surface means the surface on which the golf ball impacts on the club head 41a, but is expressed by the term face surface. There is also. That is, the face surface and the face surface used in the present specification have the same meaning.

Specifically, as shown in FIG. 2, two marks M1 and M2, which are indicators of the face surface 41b, are provided on the upper surface of the club head 41a of the golf club 41 on which the golfer 40 swings. The marks M1 and M2 are provided with, for example, a sticker. The marks M1 and the marks M2 are provided at predetermined intervals along the face surface 41b of the club head 41a.

The image generation unit 21 detects the image portions of the marks M1 and M2 described above from the captured images captured in time series. Then, the image generation unit 21 generates a face surface image in which the face surface 41b is represented by a straight line by connecting the image portion of the mark M1 and the image portion of the mark M2 with a straight line.

In the present embodiment, the image portions of the marks M1 and M2 are used, but the present invention is not limited to this. For example, the image portion of the club head 41a is extracted from the captured image and the length set in advance from the contour thereof. The above-mentioned face surface image may be generated by detecting the straight line portion above the above. For the extraction of the image portion of the club head 41a, known image processing such as pattern recognition can be used. Further, as for the detection of the straight line portion, a known straight line detection process can be used.

The marks M1 and M2 described above are not only circular stickers as shown in FIG. 2, but also donut-shaped (double circle) having a white outer circumference and a black central circle as shown in FIG. A seal may be used. As a result, a white sticker can be used as a sticker for other measuring instruments. Then, at the time of image recognition, the sticker of the present embodiment may recognize a pattern having a black outer circumference and a white center by recognizing the black-and-white inversion, and the sticker for other measuring instruments becomes a black circle. So it can be excluded. As a result, the seals of the marks M1 and M2 of the present embodiment and the seals for other measuring instruments can be used at the same time. Further, since the sticker shown in FIG. 3 has a black pattern on the outer circumference and a white pattern on the center during image recognition, it is possible to detect the sticker with high accuracy without covering the entire club head 41a with masking tape or the like.

When the golf club 41 is an iron, both the top blade and the leading edge are recognized by attaching a sticker in the same manner as described above, and one of these face surface images is generated and adopted. Is preferable. It is desirable to switch between the top blade and the leading edge in the middle of the swing.

Regarding the method of switching between the top blade and the leading edge, for example, the points at the four corners of the face surface of the club head 41a are detected from the captured image, and the area of the quadrangle connecting the four points is calculated. Then, when the area of the quadrangle is equal to or more than a preset threshold value, it is desirable to adopt a leading edge, and when it is less than the threshold value, it is desirable to adopt a top blade to generate a face surface image.

Alternatively, the distance between the golf ball 42 and the club head 41a may be calculated instead of the area of the face surface, and the top blade and the leading edge may be switched and adopted based on the calculated distance. For example, it is desirable to adopt a top blade when the above distance is equal to or more than a preset threshold value, and to adopt a leading edge when the distance is less than the threshold value to generate a face surface image. By using this switching method, the top blade and the leading edge can be switched at the timing of the impact of the club head 41a on the golf ball 42. This switching method is also applicable when the golf club 41 is a driver.

Further, the image generation unit 21 extracts an image portion of the club head 41a from each photographed image, and generates a trajectory image in which the trajectory of the club head 41a is represented by a line based on the image portion of the club head 41a. Specifically, the image generation unit 21 calculates the position of the center of gravity of each image portion of the club head 41a, connects the calculated positions of the center of gravity, and approximates the curve to generate a trajectory image.

The image measuring unit 22 acquires the captured images of the plurality of club heads 41a photographed in time series by the photographing device 10, and measures various items related to the swing based on the acquired plurality of captured images. Items measured by the image measuring unit 22 include, for example, the head speed (HS) of the club head 41a, the ball speed (BS), the meet rate, the face angle of the club head 41a, and the club pass.

For example, the image measuring unit 22 measures the head speed based on the interval of each face surface image generated from each captured image of the club head 41a and the frame rate of the captured image. The image measurement unit 22 calculates the head speed by, for example, multiplying the distance traveled by the face surface image between frames by the frame rate. In the present embodiment, the image measurement unit 22 corresponds to the speed information acquisition unit of the present invention.

Further, the ball speed is measured based on the distance between the centers of the image portion of the golf ball 42 and the frame rate of the captured image by extracting the image portion of the golf ball 42 from each captured image captured in time series. For the extraction of the image portion of the golf ball 42, known image processing such as pattern recognition can be used.

Further, the image measuring unit 22 measures the meet rate based on the head speed and the ball speed measured as described above. The meat rate is a value obtained by dividing the initial speed of the golf ball 42 immediately after the club head 41a impacts the golf ball 42 by the head speed (ball speed (initial speed) / head speed). The head speed when measuring the meet rate is the head speed when the club head 41a passes the golf ball installation position P.

Further, the image measuring unit 22 measures the face angle of the club head 41a based on each face surface image generated from each captured image of the club head 41a. Specifically, the image measuring unit 22 sets a target flight direction of the golf ball 42 on a horizontal plane, for example. Then, the image measurement unit 22 measures the angle in the stretching direction of each face surface image (straight line) with respect to the direction orthogonal to the flight direction on the horizontal plane as the face angle.

Further, the image measurement unit 22 measures the club path based on the above-mentioned trajectory image. Specifically, the image measuring unit 22 measures the extending direction of the trajectory image on the horizontal plane when the club head 41a passes through the impact area between the golf ball 42 and the club head 41a as a club path.

The swing history information storage unit 23 stores the group of face surface images, the trajectory image, and the measurement result by the image measurement unit 22 described above for each type of golf club and its swing. Specifically, when the golfer 40 makes the first swing using the golf club A, for example, the swing history information storage unit 23 determines the type of golf club "A" and the number of swings "first time". The information is stored in association with the group of face surface images generated by the swing, the trajectory image, and the measurement result by the image measuring unit 22.

Then, when the golfer subsequently makes a second swing using the golf club A, the swing history information storage unit 23 provides information on the golf club type "A" and the number of swings "second time". A group of face surface images generated by the swing, a trajectory image, and a measurement result by the image measuring unit 22 are stored in association with each other.

Further, when the golfer next makes the first swing using the golf club B, the swing history information storage unit 23 provides information on the golf club type "B" and the number of swings "first time". A group of face surface images generated by the swing, a trajectory image, and a measurement result by the image measuring unit 22 are stored in association with each other.

The control unit 24 includes a CPU and controls the entire golf simulation system 1. Specifically, the control unit 24 communicates with the photographing device 10 via the communication I / F, and outputs a control signal instructing the photographing device 10 of the shooting start timing, the shooting frame rate, and the like.

Regarding the shooting start timing, for example, the user may input instructions using an input unit 26 having a mouse, a keyboard, or the like, or the golf ball 42 is installed at the golf ball installation position P within the shooting range R. It may be possible to detect that and start shooting in response to the detection signal. For the installation detection of the golf ball 42, a contact sensor or an optical sensor may be used, or a photographed image captured by the photographing device 10 may be used. As a method of using the captured image, for example, before the swing of the golf club 41 is started, the photographing device 10 performs pre-imaging of the photographing range. The captured image captured by the pre-imaging is input to the control unit 24.

Then, the control unit 24 detects the installation of the golf ball 42 by detecting that the image of the golf ball 42 appears at a preset position in the captured image. The control unit 24 starts the main shooting according to the installation of the golf ball 42, and starts shooting the club head 41a.

It is preferable to change the shooting conditions between the pre-shooting and the main shooting described above. Specifically, it is preferable that the pre-shooting has a lower frame rate and a higher number of shooting pixels than the main shooting. This is because the captured image taken in advance is used for detecting the installation of the golf ball 42, so it is preferable to obtain a high-quality captured image and improve the detection accuracy of the golf ball 42. However, since it takes time for the detection process to obtain high image quality, it is preferable to lower the frame rate as described above.

Further, the control unit 24 outputs the group of face surface images and the orbital image generated by the image generation unit 21 to the projection device 30, and the projection device 30 projects the group of face surface images and the orbital image on the floor surface. Display it.

FIG. 4 is a diagram showing a group of face surface image FG generated by one swing of the golf club 41 and a projection display example of the trajectory image TG. The projection device 30 projects and displays a group of face surface image FG and a trajectory image TG on the floor surface, for example, as shown in FIG. The CG shown in FIG. 4 is a three-dimensional object image representing the club head.

The three-dimensional object image CG is an image in which the club head is schematically represented as a three-dimensional image, unlike the captured image captured by the photographing device 10. The three-dimensional object image CG representing the club head is also generated by the image generation unit 21. Then, the control unit 24 outputs the three-dimensional object image CG to the projection device 30, and the projection device 30 projects and displays the three-dimensional object image CG on the floor surface.

FIG. 4 shows a three-dimensional object image CG of the club head at a predetermined position on the orbital image TG, but the projection device 30 is controlled by the control unit 24 to three-dimensionally follow the line of the orbital image TG. The object image CG may be moved to display an animation.

Further, FIG. 4 shows an example in which a group of face surface images FG and orbital image TG by one swing are projected and displayed, but a group of face surface images and orbital images by two or more swings are projected in an overlapping manner. It may be displayed. FIG. 5 is an example in which a group of the face surface image FG1 and the orbital image TG1 by the first swing and a set of the face surface image FG2 and the orbital image TG2 by the second swing are projected and displayed. It is preferable that the group of the face surface image FG1 and the orbital image TG1 by the first swing and the group of the face surface image FG2 and the orbital image TG2 by the second swing are projected and displayed in different colors.

Further, the control unit 24 of the present embodiment changes the display method of each part in which the trajectory image is divided based on the speed information of the club head 41a during the swing. The display method may be changed when the user inputs a predetermined instruction using the input unit 26, or may be set as a default setting.

The control unit 24 displays, for example, the color of the trajectory image of the portion where the speed of the club head 41a is maximum is different from the color of the other portions. In the present embodiment, the speed (head speed) of the club head 41a is measured based on the captured image taken by the image measuring unit 22 at a predetermined frame rate as described above. Therefore, for example, the club head 41a for each frame is measured. The speed of can be calculated.

Therefore, for example, as shown in FIG. 6, the trajectory image is divided into points corresponding to each frame, and among the divisions, the division with the fastest speed of the club head 41a is displayed in red, and the other parts are displayed in different colors. By displaying (for example, green), the section having the fastest speed of the club head 41a can be displayed in an identifiable manner. In FIG. 6, points corresponding to each frame are indicated by x marks, but these x marks are added for explanation and are not displayed. Further, the colors of the section with the fastest speed of the club head 41a and the other sections are not limited to the above-mentioned examples (red and green), and if the fastest section is displayed in an identifiable manner, other colors should be adopted. You may do it.

Further, the display method of the section having the fastest speed of the club head 41a is not limited to the color change as described above, and for example, the fastest section or other sections may be blinked and displayed, or the trajectory of the earliest section. The line thickness of the image may be thicker than the other divisions. Further, as shown in FIG. 7, the line of the orbital image of the section where the speed of the club head 41a is the fastest may be displayed in an identifiable manner by adding a mark such as a star shape.

Further, in the present embodiment, the display method of the trajectory image is changed based on the information of the speed of the club head 41a during the swing, but the present invention is not limited to this, and each face surface constituting the face surface image group is not limited to this. The image display method may be changed.

For example, the control unit 24 may display the color of the face surface image at which the speed of the club head 41a is maximized in a color different from the color of the other face surface images. Regarding the allocation of the speed of the club head 41a to the face surface image, for example, the speed calculated for each frame as described above is used as the face surface of the frame with the slower shooting timing or the faster frame with the shooting timing between the frames. You can assign it to an image. Alternatively, the average value of the two velocities calculated between the adjacent frames may be assigned to the face surface image of the frame sandwiched between the adjacent frames.

Then, for example, the face image having the fastest speed of the club head 41a is displayed in red, and the other face images are displayed in different colors (for example, green), so that the face image having the fastest speed of the club head 41a is displayed. It can be displayed in an identifiable manner. The colors of the face image and other face images having the fastest speed of the club head 41a are not limited to this example (red and green), and other if the fastest face image is displayed identifiablely. Colors may be adopted.

Further, the method of displaying the face surface image having the fastest speed of the club head 41a is not limited to the color change as described above, and for example, the fastest face surface image or other face surface image may be blinked and displayed. , The line length of the earliest face image may be longer than other face images. Further, the line thickness of the earliest face surface image may be made thicker than that of other face surface images. Further, the face surface image having the fastest speed of the club head 41a may be displayed in an identifiable manner by adding a mark such as a star shape.

Further, in the present embodiment, the trajectory image or the face surface image of the portion where the speed of the club head 41a is maximized is displayed in an identifiable manner, but the present invention is not limited to this, and for example, the speed change of the club head 41a is maximum. The orbital image or the face surface image of the portion to be used may be displayed in an identifiable manner.

Further, what is important in the swing is the speed of the club head 41a immediately before the club head 41a impacts the golf ball 42. Therefore, the portion of the trajectory image or the face surface image where the speed of the club head 41a is maximized is identifiablely displayed within a range set in front of the golf ball 42 by a preset distance from the time when the club head 41a impacts the golf ball 42. You may do it. The above-mentioned distance is preferably, for example, 20 cm or more and 40 cm or less, and more preferably 30 cm.

Further, the control unit 24 changes the color along the trajectory image according to the speed of the club head 41a and displays the gradation, or changes the color of each face surface image according to the speed of the club head 41a and displays the gradation. You may.

Further, the control unit 24 calculates the change (rotation rate) of the face angles of the face surface images adjacent to each other in time based on the face angles calculated for each face surface image constituting the face surface image group. The face surface image in which the change in the face angle is maximized may be displayed in an identifiable manner.

According to the golf simulation system 1 of the present embodiment, as described above, each part of the trajectory image or each face image group constituting the face image group is formed based on the information of the speed of the club head 41a during the swing. I changed the display method of
The change in the speed of the club head 41a during the swing can be immediately grasped. For example, it is possible to immediately grasp the period during which the speed of the club head 41a becomes the fastest during the swing. As a result, the characteristics of the golfer's swing can be grasped, and appropriate guidance can be given to the golfer. Further, a golf club 41 or a club head 41a suitable for a golfer can be selected.

Further, the control unit 24 causes the display unit 25 of the image processing device 20 to display the group of face surface images generated by the image generation unit 21, the trajectory image, and the measurement result measured by the image measurement unit 22.

FIG. 8 is a diagram showing an example of a measurement result display screen displayed on the display unit 25 by the control unit 24. The measurement result display screen shown in FIG. 8 has a trajectory display column R1, a head speed display column R2, a face angle display column R3, and a swing history display column R4.

The orbit display column R1 is a column for displaying a group of face surface images generated by the image generation unit 21 and an orbit image. In FIG. 8, a group of face surface images and trajectory images of a total of four swings when two swings are performed using golf club A and one swing is performed using golf clubs B and C are shown. The displayed example is shown.

The control unit 24 displays a group of face surface images and trajectory images for each golf club in different colors. Specifically, for example, the group of face image FGa1 and track image TGa1 corresponding to two swings using golf club A and the group of face image FGa2 and track image TGa2 are displayed in the same color, but golf. The group of face surface image FGb and the trajectory image TGb corresponding to the swing using the club B and the group of the face surface image FGc corresponding to the swing using the golf club C and the trajectory image TGc are displayed in different colors. In FIG. 8, different colors are shown as different line types.

By displaying different colors for each golf club in this way, it is possible to easily identify the group of face surface images and the trajectory image for each golf club. However, the present invention is not limited to this, and even when the same golf club is used, the colors of the face surface image group and the trajectory image may be changed for each swing.

Further, as shown in FIG. 8, in the trajectory display column R1, a circular image CC indicating the golf ball installation position P and a center line CL extending in the left-right direction through the center of the circular image CC are displayed. The center line CL is a line representing the target flight direction of the golf ball 42.

Further, the control unit 24 displays two check boxes CB1 and CB2 under the trajectory display column R1. Then, the control unit 24 displays only the orbit image in the orbit display column R1 when only the check box CB1 is checked, and when only the check box CB2 is checked, the face surface is displayed in the orbit display column R1. Only the group of images is displayed, and when both check boxes CB1 and CB2 are checked, both the group of the trajectory image and the group of the face surface image are displayed in the trajectory display column R1.

Further, the control unit 24 changes the display method of each part of the trajectory image based on the speed information of the club head 41a for the trajectory image displayed in the trajectory display column R1 as in the projection display described above. Alternatively, the display method of each face surface image constituting the face surface image group can be changed.

Further, the control unit 24 may display the above-mentioned three-dimensional object image CG or the captured image of the club head 41a as a moving image in the trajectory display column R1. Further, the three-dimensional object image CG or the captured image of the club head 41a may be displayed frame by frame.

The head speed display column R2 is a column for displaying a graph of the head speed measured by the image measuring unit 22. FIG. 8 shows an example in which a graph of the head speeds of a total of four swings when two swings are performed using golf club A and one swing is performed using golf clubs B and C is displayed. Shown.

The control unit 24 displays a graph of the head speed for each golf club in different colors. In FIG. 8, different colors are shown as different line types. By displaying different colors for each golf club in this way, it is possible to easily identify changes in the head speed for each golf club. Even when the same golf club is used, the color of the head speed graph may be changed for each swing.

The face angle display column R3 is a column for displaying a graph of the face angle measured by the image measuring unit 22. FIG. 8 shows an example in which a graph of face angles of a total of four swings is displayed when two swings are performed using golf club A and one swing is performed using golf clubs B and C. Shown.

The control unit 24 displays the graph of the face angle for each golf club in different colors. In FIG. 8, different colors are shown as different line types. By displaying different colors for each golf club in this way, it is possible to easily identify changes in the face angle for each golf club. Even when the same golf club is used, the color of the face angle graph may be changed for each swing.

The swing history display column R4 is a column in which the types of golf clubs stored in the swing history information storage unit 23 and the measurement results for each swing are displayed in a list. FIG. 8 shows the measurement results of swings using golf clubs A, B, and C, the measurement results of two swings are shown for golf club A, and the measurement results of golf club B and golf club C are shown. , The measurement result of each swing is shown. Further, below the measurement result of each golf club, the average value of the measurement result of each golf club is shown.

The head speed (HS) displayed in the swing history display column R4 indicates the head speed at the time when the club head 41a impacts the golf ball 42, that is, when the position of the graph in the head speed display column R2 is 0 cm. The face angle indicates the face angle when the club head 41a impacts the golf ball 42, that is, when the position of the graph in the face angle display column R3 is 0 cm, and the face angle (front) is when the club head 41a hits the golf ball. It shows the face angle when the position is in front of the player by a preset distance from the time of impact on 42. This preset distance can be arbitrarily set by the user, but is preferably, for example, 20 cm or more and 40 cm or less, and more preferably 30 cm.

Further, at the left end of the swing history display column R4, check boxes CB3 to CB6 are displayed for each type of golf club and each swing. The control unit 24 reads out a group of face surface images and a trajectory image from the swing history information storage unit 23 based on the checked golf club type and swing, displays them in the trajectory display column R1, and head speed and face angle. The measurement result of is read out and displayed in the head speed display column R2 and the face angle display column R3. That is, the control unit 24 displays only the group of face surface images and trajectory images corresponding to the checked check boxes, as well as the head speed and face angle. In the present embodiment, as will be described later, the check box is checked as a default, and when the user unchecks the check box, the group and trajectory of the face surface image corresponding to the check box. The image, as well as the head speed and face angle, are hidden and will be displayed again if checked again.

Further, a check box CB7 is displayed on the upper left of the swing history display field R4, and when this check box CB7 is checked, all the check boxes CB3 to CB6 in the swing history display field R4 are checked. When the check boxes CB7 are unchecked, all the check boxes CB3 to CB6 are unchecked, and then any check box can be selected.

Further, a delete button DB and an end button EB are displayed on the upper right of the swing history display field R4. When the delete button DB is pressed, the control unit 24 outputs a group of face surface images corresponding to the checked check boxes, a trajectory image, and measurement results such as head speed and face angle from the swing history information storage unit 23. delete. When the end button EB is pressed, the control unit 24 ends the display of the measurement result display screen.

The display unit 25 includes a display device such as a liquid crystal display. Further, the input unit 26 includes an input device such as a mouse or a keyboard. Further, the image processing device 20 may be composed of a tablet terminal, and the display unit 25 and the input unit 26 may be composed of a touch panel.

The projection device 30 is composed of a projector, and projects and displays a group of face surface images and a trajectory image on the floor surface under the control of the control unit 24 of the image processing device 20 as described above. The projection device 30 is installed above the golfer swinging the golf club, and is installed adjacent to the photographing device 10. Further, the projection device 30 has a projection distance and brightness capable of displaying a group of face surface images and a trajectory image on the floor surface with sufficient brightness and clearly.

The projection device 30 is installed so that a group of face surface images and a trajectory image can be projected and displayed in a predetermined projection range including the golf ball installation position P on the floor surface in the vicinity of the center. The projection device 30 may be installed on a support member such as a stand together with the photographing device 10, or may be installed on the ceiling.

Further, the projection device 30 projects and displays the group of face surface images and the orbit image on the floor surface in conjunction with the group of face surface images and the orbit image displayed in the orbit display column R1 described above. That is, only the group of face surface images of the swing and the trajectory image checked in the swing history display field R4 by the user are projected and displayed on the floor surface.

Further, the projection device 30 projects and displays a three-dimensional object image of the club head on the floor surface as described above.

Next, the operation of the golf simulation system 1 of the present embodiment will be described with reference to the flowcharts shown in FIGS. 9 and 10.

First, each device of the golf simulation system 1 is activated (S10). Next, as shown in FIG. 1, a golfer stands in the vicinity of the shooting range R, and the golf ball 42 is installed at the golf ball installation position P within the shooting range R. At this time, the type of golf club 41 used by the golfer is set and input by the user in the image processing device 20 (S12). In the present embodiment, the type of golf club 41 (for example, “club A”) displayed above the track display column R1 shown in FIG. 5 is set as the type of golf club 41 used this time. The type of golf club 41 displayed above the track display column R1 can be switched by pressing the selection arrows A1 and A2.

Then, the user sets and inputs a shooting start instruction in the image processing device 20, and shooting by the shooting device 10 is started (S14).

After the shooting by the shooting device 10 is started, the golfer swings the golf club 41 and hits the golf ball 42 (S16).

While the golfer swings the golf club 41, the photographed image within the photographing range R is photographed at a predetermined frame rate by the photographing device 10, and the photographed images taken in chronological order are sequentially output to the image processing device 20 (. S18). The photographing device 10 ends the photographing when a preset time has elapsed from the start of the photographing (S20).

The captured image output from the photographing device 10 is input to the image processing device 20, and the image generation unit 21 generates a group of face surface images and a trajectory image based on the plurality of input captured images (S22). Further, the image measuring unit 22 measures the head speed (HS), the ball speed (BS), the meet rate, the face angle of the club head 41a, and the club path (S24).

Then, the group and trajectory images of the face surface images generated by the image generation unit 21 and the measurement results measured by the image measurement unit 22 correspond to the type of the golf club 41 and the number of swings using the golf club 41. It is attached and stored in the swing history information storage unit 23 (S26).

Subsequently, the image processing apparatus 20 displays the measurement result display screen shown in FIG. 4 in response to a predetermined instruction input (S28).

In the swing history display field R4 of the measurement result display screen, as described above, the type of golf club 41 corresponding to each swing, the number of swings, and the measurement result are displayed in a list (S30). At this time, the check box corresponding to the swing is checked as the default.

In addition, a group of face surface images and orbit images corresponding to this swing are displayed in the orbit display column R1, and a graph of changes in head speed and a graph of changes in face angle corresponding to the swing are head speeds, respectively. It is displayed in the display column R2 and the face angle display column R3, respectively (S32).

Further, a group of face surface images and orbital images corresponding to the current swing are output to the projection device 30, and are projected and displayed on the floor surface by the projection device 30 (S34).

Subsequently, when the swing is continued, the processes from S12 to S34 are repeated (S36, NO). When a swing is performed using the same type of golf club 41, the number of swings is incremented by 1 for each swing.

Then, when the swing is completed, the swing to be displayed on the face surface image group, the trajectory image, and the measurement result is selected (S38, YES). Specifically, when any of the check boxes CB3 to CB6 in the swing history display field R4 is unchecked, the face surface image group, trajectory image, and measurement result of the swing corresponding to the check box are hidden. , Only the face surface image group, the trajectory image, and the measurement result of the swing corresponding to the check box in which the checked state is maintained are displayed (S40). When the unchecked check box is checked again, the face surface image group, the trajectory image, and the measurement result of the swing corresponding to the checked check box are redisplayed. At this time, the display of the face surface image group and the trajectory image projected and displayed on the floor surface by the projection device 30 is also changed in conjunction with the display of the trajectory display column R1 (S42).

Then, when the selection of the swing is completed in S38, the display of the measurement result display screen is terminated by pressing the end button EB, and the processing of the golf simulation system 1 is terminated (S44).

In the golf simulation system 1 of the above embodiment, a group consisting of a large number of face surface images is displayed on the floor surface, but the display mode of the face surface image is not limited to this. For example, the image generation unit 21 generates a first face surface image based on the captured image at the time when the club head impacts the golf ball 42, and at the same time, the captured image at a predetermined distance before the position of the ink pact. A second face surface image is generated based on the above, and the projection device 30 projects and displays only the first face surface image F1A and the second face surface image F2A on the floor surface as shown in FIG. 11A. You may do it. At this time, as shown in FIG. 11A, the three-dimensional object image of the club head may be projected and displayed at the positions of the first face surface image F1A and the second face surface image F2A. The position of the second face surface image can be arbitrarily set by the user, but can be, for example, the same position as the position of the face angle (front) measured by the image measuring unit 22.

In this way, by projecting and displaying only the first face surface image F1A and the second face surface image F2A, it is possible to make it easier to understand the change in the face angle of the club head 41a from the front of the impact to the impact. Can be done.

Further, the golf club 41 suitable for the swinging person (golfer) can be selected from the change in the face angle of the club head 41a from the front of the impact to the impact.

For example, FIG. 11A shows a first face image F1A and a second face image F2A by Mr. A's swing, and FIG. 11B shows a first face image F1B and a second face image by Mr. B's swing. Let the image be F2B.

Comparing FIGS. 11A and 11B, Mr. A and Mr. B also tend to open three times at the time of impact, but the face angles in front of the impact are different from each other. That is, the usage of the club head 41a is different between Mr. A and Mr. B. Mr. A's face is not rotated, but Mr. B's face is greatly closed.

When it is necessary to close the face surface greatly like Mr. B, it tends to be better to use a golf club with a good response of the club head 41a. That is, it is preferable to select a club head 41a in which the MOI (Moment of Inertia) is not too large and the distance of the center of gravity is short.

On the other hand, Mr. A has less rotation, so if the swing is stable, select a club head 41a with a similar MOI to the golf club used for this measurement, and a club head 41a with a short center of gravity distance. It is preferable to do so.

By projecting and displaying the first face surface images F1A and F1B and the second face surface images F2A and F2B as described above, it is possible to select an appropriate club head 41a for Mr. A and Mr. B.

When the first face surface image and the second face surface image are projected and displayed on the floor surface as described above, the projection device 30 is at least one of the first face surface image and the second face surface image. One face angle may be projected onto the floor surface. 11A and 11B show an example in which the face angle of the second face surface image is projected and displayed.

Further, the rotation direction from the face angle of the second face surface image to the face angle of the first face surface image may be projected and displayed by an arrow, or the rotation amount may be projected and displayed by text or color. When the amount of rotation is projected and displayed in color, for example, an arrow indicating the direction of rotation may be projected and displayed in different colors according to the amount of rotation.

Further, as described above, regarding the first face surface image and the second face surface image projected on the floor surface by the projection device 30, the face angle, the rotation direction, and the amount of rotation, the trajectory display column R1 of the image processing device 20 It may be displayed in.

Further, in the golf simulation system 1 of the above embodiment, after the golfer 40 swings the golf club 41, a group of face surface images and a trajectory image corresponding to the swing are projected and displayed on the floor surface. Not limited to this, the control unit 24 may project a group of face surface images on the floor surface in real time by the projection device 30 in accordance with the swing of the golf club 41 of the golfer 40.

Specifically, the control unit 24 sequentially projects and displays a plurality of face surface images constituting a group of face surface images on the floor surface in chronological order. At this time, it is preferable that the control unit 24 sequentially projects and displays a plurality of face surface images immediately after taking each of the captured images corresponding to the face surface images. As a result, each face surface image can be sequentially projected and displayed according to the position of the club head 41a that moves on the shooting range R by the swing of the golfer 40.

By displaying the group of face surface images in real time in this way, the golfer 40 and the instructors around the golf club 40 can immediately recognize the change in the face surface 41b of the club head 41a during the swing process of the golf club 41. it can.

When displaying a group of face surface images in real time as described above, the face surface image displayed first until the last face surface image is displayed, that is, until the club head 41a moves to the frontmost within the shooting range R. The FG may be continuously projected and displayed as it is, or the face surface image FG displayed once may be sequentially hidden. That is, the projection display time of each face surface image FG may be set to a short time.

FIG. 12 is a diagram showing an example in which the previously displayed face surface image FG is continuously projected and displayed as it is, and FIG. 13 is a diagram showing an example in which the previously displayed face surface image FG is sequentially hidden. It is a figure which shows the example in chronological order.

Further, when the group of face surface images is projected and displayed on the floor surface, the control unit 24 may be able to adjust the length of the straight line of the face surface image. Specifically, for example, when a group of face surface images is projected and displayed on the floor surface in real time as described above, each face surface image is displayed on the club head 41a as it moves, so that the face is linear. It may be difficult to immediately grasp the stretching direction of the surface image. In such a case, the control unit 24 can immediately grasp the stretching direction of the face surface image by setting the length of the face surface image to be longer than the length of the face surface 41b of the club head 41a, for example. , This makes it possible to instantly grasp the face angle. Further, not only the length of the straight line of the face surface image but also the thickness may be adjustable. The length and thickness of the straight line of the face surface image can be arbitrarily set by the user.

Further, the face surface image is not limited to the solid line, and may be displayed by other line types such as a dotted line and a dash-dotted line.

Further, in the golf simulation system 1 of the above embodiment, the speed information of the club head 41a is acquired by using the photographed image, but the method of acquiring the speed information of the club head 41a is not limited to this. For example, the club head 41a itself may be provided with a sensor such as an acceleration sensor to acquire speed information, or a Doppler sensor, an optical sensor, or the like may be used to acquire speed information of the club head 41a. You may.

1 Golf simulation system 4a Club head 10 Imaging device 11 Lighting unit 12 Camera unit 20 Image processing device 21 Image generation unit 22 Image measurement unit 23 Swing history information storage unit 24 Control unit 25 Display unit 26 Input unit 30 Projection device 40 Golfer 41 Golf club 41a Club head 41b Face surface CB1-CB7 Check box CG 3D object image CL Center line DB Delete button EB End button F1A, F1B First face surface image F2A, F2B Second face image FG Face surface image FG1 Face surface image FG2 Face surface image FGa1 Face surface image FGa2 Face surface image FGb Face surface image FGc Face surface image M1, M2 Mark P Golf ball installation position R Shooting range R1 Track display column R2 Head speed display column R3 Face angle display column R4 Swing history display column TG orbit image TG1 orbit image TG2 orbit image TGa1 orbit image TGa2 orbit image TGb orbit image TGc orbit image

Claims (12)

An image generation unit that generates a trajectory image representing the trajectory of the club head of the golf club when the golf club is swung or a group of face surface images representing a plurality of face surfaces of the club head during the swing.
A speed information acquisition unit that acquires speed information of the club head during the swing, and a speed information acquisition unit.
An image including a control unit that changes a display method of each face surface image that constitutes each portion of the trajectory image or a group of the face surface images based on information on the speed of the club head during the swing. Processing equipment. The image processing device according to claim 1, wherein the control unit identifiablely displays a trajectory image or a face surface image of a portion where the speed of the club head is maximized. The image processing device according to claim 1 or 2, wherein the control unit displays the color of the trajectory image of the portion where the speed of the club head is maximum in a color different from the color of the other portion. The image processing apparatus according to any one of claims 1 to 3, wherein the control unit displays the color of the face surface image at which the speed of the club head is maximized in a color different from the colors of other face surface images. The image generation unit generates an image in which the face surface is represented by a straight line as the face surface image.
The image processing device according to any one of claims 1 to 4, wherein the control unit displays a face image when the speed of the club head is maximized longer than other face images. The image processing apparatus according to any one of claims 1 to 5, wherein the control unit projects and displays the trajectory image or a group of the face surface images on the floor surface by the projection unit. The image processing device according to claim 6, wherein the control unit projects and displays a group of the face surface images on the floor surface in real time by the projection unit in accordance with the swing of the golf club. The image processing device according to claim 7, wherein the control unit sequentially projects and displays a plurality of face surface images constituting the group of face surface images on the floor surface in chronological order. The image generation unit generates the face surface image based on the captured image of the club head during the swing.
The image processing device according to claim 8, wherein the control unit sequentially projects and displays a plurality of face surface images immediately after shooting each of the captured images corresponding to the face surface images. The image processing apparatus according to any one of claims 1 to 9, wherein the control unit can adjust the length of a straight line of the face surface image. A group of trajectory images representing the trajectory of the club head of the golf club when the golf club is swung or face surface images representing a plurality of face surfaces of the club head during the swing is generated.
Obtaining information on the speed of the club head during the swing,
An image processing method for changing a display method of each face surface image constituting each portion of the trajectory image or a group of the face surface images based on information on the speed of the club head during the swing. A step of generating at least one of a group of trajectory images representing the trajectory of the club head of the golf club when the golf club is swung and face surface images representing a plurality of face surfaces of the club head during the swing. ,
A step of acquiring information on the speed of the club head during the swing, and
Based on the information on the speed of the club head during the swing, the computer is made to perform a step of changing the display method of each face surface image that constitutes each portion of the trajectory image or the group of the face surface images. Image processing program.

Images