KR20220124904A - device, method, system for inserting time index to sports videos and storage of computer program therefor - Google Patents

Abstract

The present invention relates to a device, method, and system for inserting a time index to sports videos and a recording medium in which a computer program therefor is stored. More specifically, the present invention relates to a technology for filming a video in which a player or a striking tool such as a club owned by the player strikes a target such as a ball and analyzing a frequency change pattern of a radar signal reflected from the striking tool and the target to generate an index corresponding to a striking time and reflect the index to the video.

Description

A sports video indexing device, method, system, and a recording medium storing a computer program therefor {device, method, system for inserting time index to sports videos and storage of computer program therefor}

The present invention relates to a sports image indexing apparatus, method, and system, and a recording medium storing a computer program therefor. More specifically, the present invention shoots an image in which a hitting means such as a player or a club possessed by the player hits a target such as a ball, and analyzes the frequency change pattern of the radar signal reflected from the hitting means and the target to analyze the hitting moment It relates to a technique for generating an index corresponding to , and reflecting the index on an image.

Radar has been mainly used for military purposes, but now it is being used in many parts of the civilian field. It is being used in various fields such as communication technology and automobile autonomous driving technology, and in particular, recently, it is being used in various fields including golf.

Examples of prior art in which radar is used in the sports field are as follows.

The golf swing analysis apparatus and method disclosed in Korean Patent Registration No. 10-1716360 uses a radar that emits a transmission wave to a golf club and a golf ball, detects a frequency deviation of the reflected wave, and generates an output signal. Then, the speed of the golf club and the golf ball is calculated based on the output signal. However, this technology using radar only has a speed analysis for golf clubs and golf balls, and has a disadvantage in that it is difficult for the user to monitor his or her posture.

As disclosed in Korean Patent Application Laid-Open No. 2011-0122148, a device including a radar and a camera derives data related to a golf ball and a golf club, and radar data (ball/club/club head trajectory, direction, and ball) angle of the hitting golf club, etc.) may be shown in the image provided by the camera. Therefore, the user can visually see his/her posture and various pieces of information. However, when you want to check a specific point of view, that is, the posture at the time of hitting, among the images captured by the radar and camera, you cannot quickly move to the relevant part, and there are restrictions on the installation location other than the field environment, so the user cannot use it easily.

Republic of Korea Patent Registration No. 10-1716360 (2017.03.08) Korean Patent Publication 10-2011-0122148 (2011. 11. 09)

An object of the present invention is to generate an index regarding the time point at which the striking means hits a target, and insert the index into the image to easily check the image at a specific point in time, a method, a system, and a computer program for storing the same to provide the medium.

The sports image indexing apparatus 1 of the present invention includes: a Doppler radar 10 for sensing the movement of the object and the target when the object hits the target; The sports image indexing apparatus of the present invention includes: a radar for detecting the movement of the striking means and the target; a digital camera for photographing the movement of the striking means and the target; and an index generator that inserts an index of an event occurrence time into the image captured by the digital camera when the frequency change pattern of the signal detected by the radar matches a preset event pattern.

The radar includes a transmitter (transmitter) for transmitting a transmission wave to the striking means and the target, a receiver (receiver) for receiving the reflected wave of the striking means and the target, and a beat reception signal based on a frequency difference between the transmitted wave and the reflected wave It may include a signal generating unit for generating, and a digital conversion unit (ADC) for converting the analog bit received signal into a digital signal.

The index generator includes a filtering unit that selects a signal equal to or greater than a threshold value from the digital converted signal provided by the radar, a windowing unit that divides the filtered signal into a predetermined unit time, and frequency the divided signal of the unit time. A fast Fourier transform unit for converting a signal in the frequency domain, a frequency estimator for estimating an effective frequency from the transformed signal in the frequency domain, and a change pattern for a frequency above a threshold among the estimated effective frequencies matches a preset event pattern an analysis module including an event detection unit outputting an event signal notifying the occurrence of an event; and an indexing module for inserting an index into the image captured by the digital camera according to the event signal.

The analysis module may further include a speed calculator for calculating the instantaneous speed of the hitting means and the target based on the frequency corresponding to the hitting means and the target in the frequency pattern matching the event pattern and the magnitude of the frequency have.

In the frequency pattern matching the event pattern, the last frequency peak of the frequency change region indicating the movement of the striking means may be the striking instantaneous frequency of the striking means, and the single frequency peak indicating the movement of the target may be the striking instantaneous frequency of the target.

The index generator includes a filtering unit that selects a signal equal to or greater than a threshold value from the digital conversion signal provided by the radar, a windowing unit dividing the filtered signal into a predetermined unit time, and a signal of the divided unit time a fringe counter for converting the changed interference fringe into a signal in the frequency domain; a frequency estimator for estimating an effective frequency from the converted signal in the frequency domain; a temporary storage for storing the estimated frequency information; an analysis module including an event detection unit for outputting an event signal notifying an event occurrence when a change pattern for a frequency greater than or equal to a threshold value among valid frequencies matches a preset event pattern; and

An indexing module for inserting an index into the image captured by the digital camera according to the event signal may be included.

The analysis module may further include a speed calculator for calculating the instantaneous speed of the hitting means and the target based on the frequency corresponding to the hitting means and the target in the frequency pattern matching the event pattern and the magnitude of the frequency have.

In the frequency pattern matching the event pattern, the last frequency peak of the frequency change region indicating the movement of the striking means may be the striking instantaneous frequency of the striking means, and the single frequency peak indicating the movement of the target may be the striking instantaneous frequency of the target.

The sports image indexing system of the present invention includes a radar module for detecting the movement of the striking means and the target; and a camera module for photographing the movement of the striking means and the target, and when the frequency change pattern of the signal detected by the radar module matches a preset event pattern, outputs an event signal and sets the index of the event occurrence time, the camera module Mobile communication terminal including an index generating module to be inserted into the captured image

may include

The index generating module includes a filtering unit that selects a signal equal to or greater than a threshold value from the digital conversion signal detected by the radar module, a windowing unit dividing the filtered signal into a predetermined unit time, and the divided signal of the unit time. A fast Fourier transform unit for converting a signal in a frequency domain, a frequency estimator for estimating an effective frequency from the transformed signal in the frequency domain, and an event pattern in which a change pattern for a frequency above a threshold value among the estimated effective frequencies is set in advance It may include an event detection unit for outputting an event signal notifying the occurrence of an event when coincident with, and an image editing unit for inserting an index into the image captured by the camera module according to the event signal.

The index generation module may further include a speed calculator for calculating the instantaneous speed of the striking means and the target based on the frequency corresponding to the striking means and the target in the frequency pattern matching the event pattern and the magnitude of the frequency. can

In the frequency pattern matching the event pattern, the last frequency peak of the frequency change region indicating the movement of the striking means may be the striking instantaneous frequency of the striking means, and the single frequency peak indicating the movement of the target may be the striking instantaneous frequency of the target.

The indexing method of sports images of the present invention comprises the steps of converting a bit received signal of a radar for a striking means and a target into a digital signal; selecting a signal greater than or equal to a threshold value from the digitally converted bit received signal; dividing the selected bit reception signal into a predetermined unit time; converting the segmented unit time signal into a frequency domain; estimating an effective frequency from the frequency domain transformed signal; and outputting an event signal when the estimated effective frequency change pattern matches a preset event pattern.

When the output of the event signal is sensed while photographing the striking means and the target, the method may further include inserting an index indicating an event occurrence time in the digital image being photographed.

It may further include calculating the instantaneous speed of the striking means and the target based on the frequency and the magnitude of the frequency corresponding to the striking means and the target in the effective frequency change pattern matching the event pattern.

In the frequency pattern matching the event pattern, the last frequency peak of the frequency change region indicating the movement of the striking means may be the striking instantaneous frequency of the striking means, and the single frequency peak indicating the movement of the target may be the striking instantaneous frequency of the target.

The event may be that the striking means hits the target.

It may include a recording medium storing a computer program that implements each step of the sports image indexing method of the present invention as an algorithm.

Since the embodiments of the present invention use a simple principle of finding a specific pattern in the frequency domain for the reflected signal of ultrasound or radar, expensive equipment or There is no need to use complex analysis algorithms.

In addition, according to embodiments of the present invention, by accurately identifying the timing of occurrence of an event considered meaningful in sports at the same time as shooting an image and including it as an index in the image, the user can quickly search for an image at a specific point in time without having to search the entire image. can be found

Also, according to embodiments of the present invention, since the instantaneous speed of the striking means and/or the target can be found together in addition to the specific point in time when the event occurs by analyzing the reflected signal of the ultrasonic wave or radar, it is possible to provide comprehensive information on the event image.

1 is a block diagram showing an indexing apparatus according to the first embodiment.
2 is a block diagram illustrating a detailed configuration of a radar among the indexing apparatus according to the first embodiment.
3 is a block diagram showing an example of the detailed configuration of the analysis module of the first embodiment.
4 and 5 are graphs showing the experimental results of an example in the frequency domain and the time domain, respectively.
6 is a graph showing experimental results of another example in the frequency domain, respectively.
7 illustrates various image play related functions that can be output through a display.
Fig. 8 is a block diagram showing an indexing apparatus according to the second embodiment.
9 is a block diagram illustrating a detailed configuration of a radar among the indexing apparatus according to the second embodiment.
10 is a block diagram illustrating an example of a detailed configuration of an analysis module according to the second embodiment.
11 is a conceptual diagram of an indexing apparatus according to the first or second embodiment.
12 is a conceptual diagram of an indexing system according to the third embodiment.
13 is a conceptual diagram of an indexing system according to the fourth embodiment.
14 is a flowchart illustrating a sports image indexing method step-by-step according to an embodiment.
15 is a flowchart illustrating a sports image indexing method according to another embodiment step by step.

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them. However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

When a component is referred to as being “connected” or “connected” to another component, it is understood that other components may exist in between, although it may be directly connected or connected to the other component. should be

On the other hand, when it is mentioned that a certain element is "directly connected" or "directly connected" to another element, it should be understood that no other element is present in the middle.

The terms used herein are used only to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, process, operation, component, part, or combination thereof described in the specification is present, but one or more other features It is to be understood that this does not preclude the existence or addition of numbers, processes, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having meanings consistent with the meanings in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

The term "MODULE" as used herein means a unit that processes a specific function or operation, which may mean hardware or software or a combination of hardware and software.

The terms or words used in the present specification and claims should not be construed as being limited to their ordinary or dictionary meanings, and the inventor may properly define the concept of the term in order to best describe his invention. Based on the principle that there is, it should be interpreted as meaning and concept consistent with the technical idea of the present invention. In addition, unless there are other definitions in the technical and scientific terms used, it has the meaning commonly understood by those of ordinary skill in the art to which this invention belongs, and in the following description and accompanying drawings, the gist of the present invention Descriptions of known functions and configurations that may be unnecessarily obscure will be omitted. The drawings introduced below are provided as examples in order to sufficiently convey the spirit of the present invention to those skilled in the art. Accordingly, the present invention is not limited to the drawings presented below and may be embodied in other forms. Also, like reference numerals refer to like elements throughout. It should be noted that the same components in the drawings are denoted by the same reference numerals wherever possible.

In the specification of the present invention, the term "hitting means (打擊手段, hitter)" refers to an exercise device called a club, a stick, or a racket for each sport, and uses a separate exercise device. In sports such as soccer, basketball, volleyball, and boxing that are not played, it may refer to a player's hands or feet or to the player himself.

In addition, in the specification of the present invention, the term "target" refers to a ball, a puck, etc. as a target to hit using the above-listed exercise equipment.

Hereinafter, for convenience of explanation, golf will be described as a main example. In other words, “iron” and “hitting means” used by golfers can be used interchangeably, and both are understood to have the same meaning. Also, “golf ball” and “target” may be used interchangeably, and both are understood to have the same meaning.

An apparatus for indexing sports images according to an embodiment of the present invention finds a point of occurrence of a meaningful event by using a radar. Here, the term “event” may be defined in various ways according to the characteristics of the sports event. For example, a meaningful event in the golf event may be defined as a moment when a golfer strikes a golf ball using an iron. Similarly, in soccer, when a player hits a soccer ball with his foot near the goal (the moment he makes an effective shot), in volleyball when a player hits a volleyball with his hand near the net, in hockey when a player hits the puck with a stick towards the goal The moment of hitting, in tennis, can be defined as the moment when a player strikes a tennis ball with a racket at the serve point, and can be defined in various other ways.

In the present specification, the indexing device may employ at least one of laser, infrared, ultrasonic, and electromagnetic waves or a radar using one of them. In addition, an appropriate modulation method may be used depending on the characteristics of the signal used. For example, a continuous wave method that sweeps a frequency to measure the difference in frequency between transmission and reception, and a pulse Doppler (Pulse Doppler) method that measures time delay by sending and receiving pulses Pulse Doppler) method and amplitude modulation (Amplitude Modulation) method of measuring a phase difference between transmission and reception signals by amplitude-modulating a carrier wave may be used. More specific examples include continuous wave modulation methods such as continuous wave (CW) and frequency modulation continuous wave (FMCW), pulse amplitude modulation, pulse position modulation, and pulse width modulation. , pulse number modulation (Pulse Number Modulation), pulse code modulation (Pulse Code Modulation), a pulse modulation method such as delta modulation (delta modulation), any one of the amplitude modulation (Amplitude Modulation) method may be used. However, the listed modulation schemes are merely examples and do not need to be limited to a specific modulation scheme.

Hereinafter, for convenience of description, embodiments in which a radar using a continuous wave modulation scheme for electromagnetic waves and ultrasonic waves is adopted will be described.

<Example 1>

Embodiment 1 relates to an indexing apparatus for sports images using electromagnetic waves as radar signals. 1 is a block diagram showing an indexing apparatus according to the first embodiment.

Referring to FIG. 1 , the indexing apparatus according to the first embodiment includes a radar 100 , a digital camera 200 , and an index generator 300 , and a display 400 may be further included here.

When the striking means strikes the target, the radar 100 detects the movement of the striking means and the target by using the reflected wave of the radar. In the example of golf, when the iron corresponding to the striking means hits the golf ball corresponding to the target, the radar 100 receives the reflected wave reflected by the iron and the golf ball with respect to the electromagnetic wave transmitted by the radar 100, and analog Converts the received bit signal into a digital signal for easy analysis.

2 is a block diagram illustrating a detailed configuration of a radar among the indexing apparatus according to the first embodiment.

The radar 100 includes a transmitter 110 that transmits an electromagnetic wave, a receiver 120 that receives a reflected wave that is reflected by a striking means and a target, and a received beat signal based on a frequency difference between the transmitted wave and the reflected wave. It may include a signal generating unit 130 for generating , and a digital converting unit (ADC) 140 for converting an analog bit received signal into a digital signal.

The digital camera 200 generates digital image data by photographing a situation in which the striking means strikes the target.

The index generator 300 includes an analysis module 310 for determining an event occurrence time (identify), and an indexing module 320 for inserting an index indicating an event occurrence time point in an image captured by the digital camera 200.

3 is a block diagram illustrating an example of a detailed configuration constituting the analysis module 310 .

The analysis module 310 identifies a preset wavelength change pattern from the signal detected by the radar 100, and calculates the occurrence time of the event in which the striking means hits the target based on the identified wavelength change pattern. 2 is a block diagram illustrating an example of a detailed configuration of the analysis module 310 .

Referring to FIG. 3 , the analysis module 310 includes a filtering unit 311 that selects a signal equal to or greater than a predetermined threshold value from the digitally converted signal transmitted from the radar 100, and divides the selected signal into a predetermined unit time. From the signal converted by the windowing unit 312, the fast Fourier transform unit 313 that converts the signal of the unit time partitioned by the windowing unit 312 into a signal in the frequency domain, and the fast Fourier transform unit 313 A frequency estimator 314 for estimating the magnitude of a frequency for each effective frequency spectrum and effective frequency, and a change pattern for a frequency signal above a preset threshold magnitude among the estimated frequency signals. and an event detection unit 315 for outputting an event signal indicating that the unit time is a hitting moment when it matches a preset event pattern. It is preferable that the wing-doing unit 312 divides the selected digital signal into a unit time short enough to be used as an index.

The windowing unit 312 , the fast Fourier transform unit 313 , and the frequency estimation unit 314 are repeatedly performed with respect to the received signal selected by the filtering unit 311 until the event detection unit 315 finds an event pattern. do.

When the event detection unit 315 detects an event pattern, the analysis module 310 corresponds to each hitting means (golf iron, tennis racket, hockey stick, etc.) and target (golf ball, tennis ball, hockey puck, etc.) in the pattern. The frequency (frequency)-magnitude (magnitude) value of the point to be identified, the time domain conversion value of the points may further include a speed calculation unit 316 for setting the speed of the striking means and the target. That is, when the analysis module 31 includes the event detecting unit 315 and the speed calculating unit 316 together, when the event pattern is detected from the reflected wave, the speed of the striking means and the target at the time of occurrence of the event and the corresponding time are simultaneously measured. be able to comprehend

The operation of the analysis module 310 will be described as a specific experimental example as follows.

* FIGS. 4 and 5 are graphs showing experimental results in the frequency domain and time domain, respectively, assuming a 7 iron club and a golf ball of golf as the striking means and the target, respectively.

More specifically, FIG. 4 is a frequency-magnitude graph derived as a result of estimating the frequency by the frequency estimator 314 from the signal transformed into the frequency domain by the fast Fourier transform unit 313 . In the graph of FIG. 4, in the range of about 3500 Hz to about 5800 Hz, a pattern in which the frequency magnitude changes abruptly several times in a relatively wider frequency range than that of a golf ball is shown. It may be predefined as a pattern to indicate. Also, in the frequency domain showing such a pattern, a specific frequency may be predefined as a frequency for the iron at the moment of hitting by repeated experimentation. The frequency peak at about 5000 Hz indicated by a rectangle in FIG. 3 is the frequency of the iron at the moment of hitting. That is, as a result of repeated experiments, it can be defined that the last frequency peak in the frequency change pattern indicating the movement of the iron club indicates the iron at the moment of striking.

In the region of about 6000 Hz to about 6500 Hz, a single frequency shows a sudden change in magnitude in a relatively narrow frequency region than an iron. . Also, in the frequency domain showing such a pattern, a specific frequency may be predefined as a frequency for a golf ball at the moment of hitting by repeated experimentation. A frequency peak at a point of about 6500 Hz indicated by a circle in FIG. 3 is the frequency of the golf ball at the moment of hitting. In other words, a single frequency peak with some frequency gap near the frequency change pattern indicating the movement of the iron club indicates the iron at the moment of striking.

In addition, the frequency change pattern for the iron and golf ball as described above may be preset as an event pattern.

The event detection unit 315 analyzes whether a change pattern for a frequency signal greater than or equal to a preset threshold magnitude in the estimated frequency signal of the actually received signal matches the preset event pattern as above, and if they match, the unit Generates an event signal indicating that time is the moment of hitting.

FIG. 5 is a graph of time-frequency after inverse transformation of a frequency domain signal including an event pattern (ie, the signal of FIG. 3 ) into a time domain.

Looking at the time domain values corresponding to the frequency of the iron (square marked point) and the golf ball frequency (circular marked point) in FIG. 4 , it can be confirmed that the strike occurred at approximately 0.55 second (Sec). In addition, it can be seen that the frequency spectrum of the golf club at the time is relatively wide spread up and down in the region of about 3500 Hz to about 5800 Hz, and the frequency spectrum of the golf ball is relatively narrowly spread up and down in the region of about 6000 Hz to about 6500 Hz. .

6 is a graph showing experimental results in the frequency domain assuming a tennis racket and a tennis ball, respectively, as other examples of the striking means and the target.

In the case of tennis, it can be seen that the frequency pointing to the tennis racquet is determined at about 4800 Hz and the frequency pointing to the tennis ball is determined at about 6200 Hz. In addition, when the threshold value of the frequency magnitude is set to 2, the frequency magnitude change pattern of FIG. 5 derived through a number of experiments may be determined as the event pattern.

Finally, the display 400 shows the index-inserted image and shows the instantaneous velocity of the target at the moment of hitting on a part of the screen. The display 400 may be a part included in the indexing apparatus according to the first embodiment, or may be a separate display apparatus provided separately from the indexing apparatus. In the latter case, the indexing device further includes an interface module (not shown in FIG. 1 ) for transmitting an image including an index to the display device through a predetermined communication network or communication line.

The display 400 may output an image in various ways by using the index. 7 illustrates various types of image play related functions that can be output through the display 400 . That is, with respect to the index image generated by Example 1, the function to move to the point in time at which indexing is given, the function to repeat the playback at the point in time at which indexing is given, the function to play slowly, the function to play slowly, the function to stop, the function to show only the hitting speed data, only the hitting scene An image may be output as at least one of a function to show, a function to simultaneously display a hitting scene and speed data at the time of hitting, and a function to divide and show a plurality of recent hitting scenes on one screen.

<Example 2>

Embodiment 2 relates to an indexing apparatus for sports images using ultrasound as a radar signal. Fig. 8 is a block diagram showing an indexing apparatus according to the second embodiment.

Referring to FIG. 8 , the indexing apparatus according to the second embodiment includes a radar 1000 , a digital camera 2000 , and an index generator 3000 , and a display 4000 may be further included here.

When the striking means strikes the target, the radar 1000 senses the movement of the striking means and the target by using the reflected wave of the ultrasonic wave. In the example of tennis, when the racquet corresponding to the striking means hits the tennis ball corresponding to the target, the radar 1000 receives the reflected wave reflected by the racquet and the tennis ball with respect to the ultrasonic wave it transmits, and analog Converts the received bit signal into a digital signal for easy analysis.

9 is a block diagram illustrating a detailed configuration of a radar 1000 among the indexing apparatus according to the second embodiment.

The radar 1000 includes a transmitter 1100 that transmits a transmitted wave, a receiver 1200 that receives a reflected wave that is reflected back by the ultrasonic strike means and the target, and a beat reception signal based on a frequency difference between the transmitted wave and the reflected wave. It may include a signal generating unit 1300 for generating , and a digital conversion unit (ADC) 1400 for converting a bit received signal into a digital signal.

The index generator 3000 includes an analysis module 3100 for calculating an event occurrence time (identify), and an indexing module 3200 for inserting an index indicating an event occurrence time point in an image captured by the digital camera 2000.

The analysis module 3100 identifies a preset pattern of wavelength change from the signal detected by the radar 1000, and calculates the occurrence time of the event in which the striking means hits the target based on the identified pattern of wavelength change. 10 is a block diagram illustrating an example of a detailed configuration of the analysis module 3100 .

Referring to FIG. 10 , the analysis module 3100 includes a filtering unit 3110 that selects a signal equal to or greater than a predetermined threshold value from the digital conversion signal transmitted from the radar 1000, and divides the selected signal into a predetermined unit time. The windowing unit 3120, the fringe counter 3130 that converts the change of the interference fringe included in the signal of the unit time partitioned by the windowing unit 3120 into the frequency domain, and the signal converted by the fringe counter 3130 A frequency estimator 3140 for estimating a frequency from a frequency change pattern for a frequency signal greater than a preset threshold magnitude among a frequency estimator 3140, a temporary storage unit 3150 for storing the estimated frequency information, and a preset threshold magnitude among the temporarily stored signals It includes an event detection unit 3160 that outputs an event signal when it matches a preset event pattern.

The fringe counter 3130 measures the number of changes in the interference fringes and differentiates the strength of the interference fringes with respect to time to calculate the magnitude of the frequency and the waveform. In addition, it is preferable that the wing-doing unit 3120 divides the selected digital signal into a short unit time that can be used as an index.

The windowing unit 3120, the fringe counter 3130, and the frequency estimator 3140 may be repeatedly performed with respect to the received signal selected by the filtering unit 3110 until the event detecting unit 3160 finds an event pattern. have.

Since the speed calculating unit 3170 and the display 4000 are the same as the speed calculating unit 316 and the display 400 of the first embodiment, overlapping descriptions will be omitted.

Since the indexing device according to the second embodiment uses ultrasound as a transmission wave, it is inevitably sensitive to acoustic noise such as cheering sound from a stadium. Therefore, the indexing device of the second embodiment can be mainly used in a quiet environment such as an indoor golf driving range.

<Example 3>

In the indexing apparatuses of the first and second embodiments described above, the radars 100 and 1000, the digital cameras 200 and 2000, and the index generators 300 and 3000 are mounted together in the same housing (not shown in the drawing) and are one It can be implemented as an independent device E1 of In this case, the radars 100 and 1000, the digital cameras 200 and 2000, and the index generators 300 and 3000 are connected through at least one board (PCB board, not shown in the drawing), and a bus on the board or Communication may be performed through electronic circuitry. FIG. 11 shows the concept of an independent indexing device according to the first or second embodiment.

In contrast, Embodiment 3 relates to a case in which the radars 100 and 1000, the digital cameras 200 and 2000, and the index generators 300 and 3000 are implemented as separate devices. In this case, the radars 100 and 1000, the digital cameras 200 and 2000, and the index generators 300 and 3000 may be connected to each other through a wired communication network or a local area wireless communication network.

12 is a block diagram showing an example of the indexing system according to the third embodiment.

Considering the case where the indexing device of Embodiment 3 is installed in an indoor golf practice room, radars 100 and 1000 and digital cameras 200 and 2000 are installed on the ceiling or side wall of the practice room, and radars 100 and 1000 and digital The image or radar signal output from the cameras 200 and 2000 is connected to a short-distance wireless communication network such as Bluetooth, Zigbee, or Wi-Fi, or an index generator connected to a wired communication network such as Ethernet (ethernet or LAN). (300, 3000) may be transmitted.

At this time, the index generators 300 and 3000 may be implemented in the form of a PC or a server, and the analysis modules 310 and 3100 and the indexing modules 320 and 3200 constituting the index generator are installed in the form of a computer program on a PC or server. can be Also, the displays 400 and 4000 may be implemented as separate monitors or beam projectors.

<Example 4>

Embodiment 4 relates to a case in which the radars 100 and 1000 are implemented as separate devices, and the digital cameras 200 and 2000 and the index generators 300 and 3000 are implemented as a single device. In this case, the first devices 100 and 1000 including the radar and the second devices E2 including the digital cameras 200 and 2000 and the index generators 300 and 3000 are connected to each other such as RS-232C or USB. It may be connected through wired serial communication or parallel communication, it may be connected through a wired network such as Ethernet, it may be connected through a short-range wireless communication network such as Bluetooth, Zigbee, Wi-Fi, etc., or it may be connected through a broadband mobile communication network.

In particular, these days, mobile communication terminals such as smartphones are equipped with high-performance digital cameras as a standard, and when the functions of the index generators 300 and 3000 are implemented and installed as an application program, it can be a preferable example of the second device. .

13 is a configuration diagram showing an example of an indexing system according to the fourth embodiment.

In the indoor golf practice room, the user connects the small radar module implemented in mobile form to the smartphone through a USB cable, and then mounts the smartphone and radar module in a position where the swing posture can be viewed. The user starts the golf practice after running the index generator app installed on the smartphone. The index generator app operates the camera module mounted on the smartphone while operating the small radar module connected via USB. Here, the small radar module corresponds to the radars 100 and 1000 , the camera module corresponds to the digital cameras 200 and 2000 , and the index generator app corresponds to the index generators 300 and 3000 . In addition, the liquid crystal of the smartphone corresponds to the displays 400 and 4000 .

Since the radars 100 and 1000, the digital cameras 200 and 2000, and the index generators 300 and 3000 have been described in detail above, the small radar module, camera module, index generator app and the liquid crystal of the smartphone corresponding to each of these have been described in detail. A duplicate description will be omitted.

In the fourth embodiment, the small radar module may be implemented in a form detachable to the smartphone through a predetermined interface provided in the smartphone.

<Example 5>

Example 5 relates to an indexing method of sports images using electromagnetic wave radar, and FIG. 14 is a flowchart illustrating the indexing method of Example 5 step by step.

First, the analog bit reception signal is converted into a digital signal for easy analysis (S101).

Since it is wasteful to analyze all the bit received signals provided by the radar for event detection, it is preferable to selectively analyze only the bit received signals related to the state in which the movement of the striking means or the target once occurred. To this end, the bit received signal is filtered by selecting a signal equal to or greater than a predetermined threshold value from the digitally converted bit received signal (S102).

Next, the filtered bit reception signal is divided into a predetermined unit time (S103). It is preferable to set the predetermined unit time to a short interval so as to correspond to an index indicating the occurrence of an event.

Next, in order to detect an event using the change in frequency, the divided signal of the unit time is converted into a signal in the frequency domain using a fast Fourier transform (FFT) or a similar algorithm (S104).

Next, a spectrum of an effective frequency and a magnitude of a frequency for each effective frequency are estimated from the signal converted to the frequency domain (S105).

Next, a change pattern for a signal of a preset threshold magnitude or more among the estimated frequency signals is compared with a preset event pattern (S106), and if both coincide, an event signal indicating that the unit time is a hitting moment output (S107).

When the output of the event signal is sensed while the striking means and the target are photographed, an index indicating an event occurrence time is inserted into the digital image being photographed (S108)

Steps S103 to S105 are repeatedly performed until an event pattern is found.

*<Example 6>

Example 6 relates to an indexing method of sports images using ultrasonic radar, and FIG. 15 is a flowchart illustrating the indexing method of Example 6 step by step.

First, the analog bit reception signal is converted into a digital signal for easy analysis (S1001). And for efficient event analysis, the bit received signal is filtered by selecting a signal greater than a predetermined threshold value from the digitally converted bit received signal (S1002).

Next, the filtered bit reception signal is divided into a predetermined unit time (S1003). It is preferable to set the predetermined unit time to a short interval so as to correspond to an index indicating the occurrence of an event.

Next, a change in the interference fringe included in the divided unit time signal is converted into a frequency domain signal using a fringe counter (S1004). More specifically, the frequency magnitude and waveform are calculated by measuring the number of changes in the interference fringes included in the divided signal of the unit time and differentiating the strength of the interference fringes with respect to time.

Next, a spectrum of an effective frequency and a magnitude of a frequency for each effective frequency are estimated from the signal converted to the frequency domain (S1005). Then, the estimated frequency information is temporarily stored (S1006).

Next, a change pattern for a signal of a preset threshold magnitude or higher among the temporarily stored frequency signals is compared with a preset event pattern, and if both coincide, an event signal indicating that the unit time is a hitting moment is output ( S1007).

Steps S1003 to S1005 are repeatedly performed until an event pattern is found.

Those skilled in the art can easily understand that the partial functions of the sports image indexing apparatus and/or method described above may be provided by being included in a recording medium that can be read through a computer by tangibly implementing a program of instructions for implementing it. There will be. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer readable recording medium may be specially designed and configured for the present invention, or may be known and used by those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and floppy disks. magneto-optical media, and hardware devices specially configured to store and carry out program instructions, such as ROM, RAM, flash memory, USB memory, and the like. The computer-readable recording medium may be a transmission medium such as an optical or metal wire or waveguide including a carrier wave for transmitting a signal designating a program command, a data structure, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter or the like, in addition to machine language codes such as those generated by a compiler. The hardware device may be configured to operate as one or more software modules to perform the operations of the present invention and vice versa.

In addition, the present invention is not limited to the embodiments described above, and various modifications can be made without departing from the gist of the present invention as claimed in the claims as well as having a wide range of applications.

100, 1000: Radar
110, 1100: transmitter 120, 1200: receiver
130, 1300: signal generating unit 140, 1400: digital conversion unit (ADC)
200, 2000: digital camera
300, 3000: index generator
311, 3110: filtering unit 312, 3120: windowing unit
313: fast Fourier transform unit 3130: fringe counter
314, 3140: frequency estimation unit 315, 3160: event detection unit
3150: temporary storage unit 316, 3170: speed calculation unit
400, 4000: display

Claims (10)

Radar for detecting the movement of the striking means and the target using electromagnetic waves;
a digital camera for photographing the movement of the striking means and the target; and
A filtering unit that selects a signal greater than or equal to a threshold value from the digital converted signal provided by the radar, a windowing unit that divides the filtered signal into a predetermined unit time, and converts the divided signal of the unit time into a signal in the frequency domain a fast Fourier transform unit to, a frequency estimator for estimating an effective frequency from the transformed signal in the frequency domain; An index generator comprising an analysis module including an event detection unit for outputting an event signal, and an indexing module for inserting an index into an image captured by the digital camera according to the event signal
Indexing device of sports video comprising a. According to claim 1,
The radar is
A transmitter (transmitter) for transmitting a transmission wave to the striking means and the target, a receiver (receiver) for receiving the reflected wave of the striking means and the target, and a signal generation for generating a bit reception signal based on the frequency difference between the transmitted wave and the reflected wave and a digital conversion unit (ADC) for converting an analog bit received signal into a digital signal. 3. The method of claim 2,
The analysis module,
Sports image, characterized in that it further comprises a speed calculator for calculating the instantaneous speed of the striking means and the target based on the frequency corresponding to the striking means and the target in the frequency pattern matching the event pattern and the magnitude of the frequency indexing device. 4. The method of claim 3,
In the frequency pattern matching the event pattern, the last frequency peak of the frequency change region indicating the movement of the striking means is the striking instantaneous frequency of the striking means, and the single frequency peak indicating the movement of the target is the striking instantaneous frequency of the target Indexing device for sports videos. 3. The method of claim 2,
The index generator,
A filtering unit that selects a signal greater than or equal to a threshold value from the digitally converted signal provided by the radar, a windowing unit that divides the filtered signal into a predetermined unit time, and a change in an interference fringe included in the divided signal of the unit time a fringe counter that converts to a signal in the frequency domain; a frequency estimator for estimating an effective frequency from the converted signal in the frequency domain; a temporary storage unit for storing the estimated frequency information; and a threshold value among the estimated effective frequencies an analysis module including an event detection unit outputting an event signal notifying the occurrence of an event when the change pattern with respect to the above frequency matches the preset event pattern; and
Indexing module for inserting an index into the image captured by the digital camera according to the event signal
Sports image indexing device comprising a. 6. The method of claim 5,
The analysis module,
Sports image, characterized in that it further comprises a speed calculator for calculating the instantaneous speed of the striking means and the target based on the frequency corresponding to the striking means and the target in the frequency pattern matching the event pattern and the magnitude of the frequency indexing device. 7. The method of claim 6,
In the frequency pattern matching the event pattern, the last frequency peak of the frequency change region indicating the movement of the striking means is the striking instantaneous frequency of the striking means, and the single frequency peak indicating the movement of the target is the striking instantaneous frequency of the target Indexing device for sports videos. a radar module for detecting the movement of the striking means and the target using electromagnetic waves; and
A camera module for photographing the movement of the striking means and the target, and when the frequency change pattern of the signal detected by the radar module matches a preset event pattern, outputs an event signal and sets an index for finding an event occurrence time to the camera module Including a mobile communication terminal including an index generating module to be inserted into the captured image,
The index creation module,
A filtering unit that selects a signal equal to or greater than a threshold value from the digitally converted signal detected by the radar module, a windowing unit that divides the filtered signal into a predetermined unit time, and converts the divided signal of the unit time into a signal in the frequency domain A fast Fourier transform unit for transforming, a frequency estimator for estimating an effective frequency from the transformed signal in the frequency domain, and generating an event when a change pattern for a frequency above a threshold among the estimated effective frequencies matches a preset event pattern An event detection unit for outputting an event signal to notify, and an image editing unit for inserting an index into the image captured by the camera module according to the event signal
Indexing system for sports videos. 9. The method of claim 8,
The index creation module,
Sports image, characterized in that it further comprises a speed calculator for calculating the instantaneous speed of the striking means and the target based on the frequency corresponding to the striking means and the target in the frequency pattern matching the event pattern and the magnitude of the frequency indexing system. 10. The method of claim 9,
In the frequency pattern matching the event pattern, the last frequency peak of the frequency change region indicating the movement of the striking means is the striking instantaneous frequency of the striking means, and the single frequency peak indicating the movement of the target is the striking instantaneous frequency of the target Indexing system for sports videos.

Images