JP6778864B2 - Golf digest creation system, moving shooting unit and digest creation device - Google Patents

Description

The present invention relates to a golf digest creation system that automatically performs from shooting golf play to creating a digest.

Conventionally, there has been a system described in Patent Document 1 as a system for photographing a golf play and providing a moving image to a player after the play. FIG. 29 is a diagram showing a conventional golf information system described in Patent Document 1.

In FIG. 29, the information input / output terminal means 41 is carried by the player to input play data and display information including an image, and the photographing means 42 is installed on the course to photograph the player's play. The information processing means 43 exchanges information with the information input / output terminal means 41 and the photographing means 42. Then, the information processing means 43 processes the information input from the information input / output terminal means 41 and the shooting means 42, and transmits the play support information and the video captured by the shooting means 42 to the information input / output terminal means 41. is there.

Further, as a conventional device that digests and reproduces a play scene from a video of golf play, there is a device as described in Patent Document 2. FIG. 30 is a diagram showing a configuration of an apparatus for extracting a golf play scene described in Patent Document 2.

In FIG. 30, the attention section extraction unit 51 extracts the attention section, which is the time interval of interest in the program, based on the movement of the image, and the play scene degree calculation unit 52 extracts the movement, color, and shot sound in the attention section. Based on this, the play scene degree, which represents the degree to which the attention section is the golf play scene, is calculated. Then, the play scene determination unit 53 determines whether or not the attention section is a golf play scene based on the play scene degree, and performs digest reproduction.

Japanese Unexamined Patent Publication No. 9-239089 Japanese Unexamined Patent Publication No. 2011-234018

However, in the configuration described in Patent Document 1 of the above-mentioned conventional example, since the photographing means is fixed during the course, there is a problem that the play outside the photographable range cannot be photographed.

Further, in the configuration described in Patent Document 2 of the above-mentioned conventional example, since the digest is created from the golf program, there is a problem that the scene being played cannot be arbitrarily specified and the digest cannot be created.

The present invention has been made to solve the above-mentioned conventional problems, and the purpose of the present invention is to automatically create a digest of highlight scenes (highlight scenes) anywhere on a golf course. The purpose is to provide an automatic digest creation system.

The golf digest automatic creation system according to the present invention that solves the above-mentioned conventional problems includes a 360-degree camera installed at a position where a 360-degree view is open above the golf cart, a sound collecting microphone installed in the golf cart, and a 360-degree sound collecting microphone. An AV storage unit that stores video data from the camera and audio data from the sound collecting microphone, and a control unit that attaches time information for synchronizing the video data and audio data to the AV storage unit and stores it in the AV storage unit. A mobile shooting unit that has, a data analysis unit that analyzes video data stored in the AV storage unit and / or audio analysis of audio data, and a digest creation unit that extracts highlight scenes based on the results of the data analysis unit. It is provided with a digest creating device having and.

As a result, the 360-degree camera moves with the player and records the play as an image, so that it is possible to create a digest that is collected without missing highlight scenes anywhere on the golf course.

Further, the 360-degree camera of the golf digest automatic creation system according to the present invention is a 4K or 8K video camera that shoots at high resolution, and the data analysis unit captures a specific subject in a frame of video data. The area is cut out and the image is analyzed.

As a result, the omnidirectional image is recorded as ultra-high resolution data, so that the image in which the player is placed in the center with a certain size or more can be viewed with high image quality.

Further, the golf digest automatic creation system according to the present invention further includes a mobile terminal that notifies the moving shooting unit of the occurrence of a highlight scene in response to an instruction from the player, and the moving shooting unit receives the notification and the AV storage unit. The time information of the highlight scene is stored in the image, the digest creation device acquires the time information from the moving shooting unit, and the highlight scene is determined by adding the time information.

As a result, the highlight scene that the player wants to keep can be arbitrarily specified, so that a digest including the highlight scene desired by the player can be created.

Further, the mobile photographing unit of the golf digest automatic creation system according to the present invention further includes a GPS receiver and a course information storage unit that stores map information of the golf course, and the position information and map information detected by the GPS receiver. When it is detected that the tee ground of the start hole has been reached, recording of video data and audio data is started in the AV storage unit, the number of the hall where the video data was taken is recorded, and the current position is the position of the clubhouse. If the numbers of all 18 holes have been recorded when it is detected, the recording to the AV storage unit is stopped.

This allows the player to play from the beginning to the end of play without worrying about shooting.

Further, the mobile photographing unit of the golf digest automatic creation system according to the present invention has a camera with a zoom drive function instead of a 360-degree camera, and an electric cloud stand that can rotate 360 degrees, and the mobile terminal is a GPS. When the mobile terminal further has a receiver and the mobile terminal notifies the mobile shooting unit of the current position information detected by the GPS receiver, the mobile shooting unit causes the mobile terminal based on its own position information and the position information from the mobile terminal. The distance and direction to the camera are calculated, the electric platform is rotated in the direction of the mobile terminal, and the zoom magnification of the camera is changed according to the distance to the mobile terminal.

As a result, the amount of video data to be recorded can be kept small, so that the transmission time of the moving image data from the moving shooting unit 21 to the digest creating device 23 is shorter than that of the first embodiment, and the moving image cutting process is performed. Therefore, the time required for the image processing time performed by the digest creation device 23 can be completed in a short time.

According to the present invention, it is possible to create a digest that is collected without missing highlight scenes anywhere on the golf course.

Schematic diagram of the golf digest creation system according to the first embodiment of the present invention. The figure which shows the structure of the golf digest creation system of this embodiment (A) Hardware configuration diagram of the mobile photographing unit according to the first embodiment of the present invention, (b) Hardware configuration diagram of the mobile terminal according to the first embodiment of the present invention. Hardware configuration diagram of the digest creation device according to the first embodiment of the present invention (A) A diagram showing an example of a one-frame image of video data according to the first embodiment of the present invention, and (b) an example of a frame image cut out from the video data according to the first embodiment of the present invention centering on a specific person. Figure The operation flow diagram of the moving photography unit in Embodiment 1 of this invention Operation flow chart of the mobile terminal according to the first embodiment of the present invention Operation flow chart of the digest making apparatus according to Embodiment 1 of this invention The operation flow diagram explaining the digest making process of the digest making apparatus in Embodiment 1 of this invention. An operation flow diagram for explaining a highlight scene determination process according to the first embodiment of the present invention. The figure explaining the process of giving the evaluation value to the operation type and the voice type in Embodiment 1 of this invention. The figure which shows the structure of the golf digest automatic creation system in Embodiment 2 of this invention. The figure which shows the hardware structure of the fixed imaging unit in Embodiment 2 of this invention. Operation flow chart of the fixed imaging unit according to the second embodiment of the present invention The operation flow diagram of the moving photography unit in Embodiment 2 of this invention Operation flow chart of the digest creation process performed by the digest creation device according to the second embodiment of the present invention. (A) A diagram showing a hardware configuration of a mobile photographing unit according to the third embodiment of the present invention, and (b) a diagram showing a hardware configuration of a mobile terminal according to the third embodiment of the present invention. Operation flow chart of the mobile terminal according to the third embodiment of the present invention Configuration diagram of the golf digest creation system according to the fourth embodiment of the present invention Hardware configuration diagram of the moving shooting unit according to the fourth embodiment of the present invention Hardware configuration diagram of the digest creation device according to the fourth embodiment of the present invention The operation flow diagram of the moving photography unit in Embodiment 4 of this invention Operation flow chart of the digest making apparatus according to Embodiment 4 of this invention Operation flow diagram of the digest distribution server according to the fourth embodiment of the present invention Operation flow chart of the golf course terminal according to the fourth embodiment of the present invention Configuration diagram of the golf digest creation system according to the fifth embodiment of the present invention Configuration diagram of the golf course terminal according to the fifth embodiment of the present invention Operation flow chart of the golf course terminal according to the fifth embodiment of the present invention Diagram showing a conventional golf information system The figure which shows the structure of the apparatus which extracts the conventional golf play scene

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)
FIG. 1 is a diagram showing an outline of a golf digest creation system according to the first embodiment of the present invention.

Golf is a sport in which a player goes around all 18 golf courses in a fixed order and competes for the total number of hits by hitting a golf ball from the teeing ground to the cup on the green.

In FIG. 1, the golf course 11 shows one of 18 holes, and the golf cart 12 on which the player 13 rides and moves on the course has a 360-degree camera 101 capable of shooting in all directions and omnidirectional. The sound collecting microphone 102, the GPS receiver 103, and the mobile recording device 104 having a wireless communication function are mounted. In particular, the 360-degree camera 101 is installed at a position above the roof of the golf cart 12 with a 360-degree field of view.

The resolution of the 360-degree camera 101 is 4K (3,840 pixels x 2,160 pixels) or 8K (7,680 pixels x 4,320 pixels). The video data and audio data from the 360-degree camera and the sound collecting microphone 102 are transmitted to the mobile recording device 104 by wire or wirelessly. Further, the 360-degree camera 101 may be configured to cover 360 degrees by using a plurality of cameras, and each image may be combined.

The mobile terminal 105 attached to the waist or the like by the player 13 is for the player to notify the movement recording device 104 of the occurrence of the highlight scene when the highlight scene occurs, and when the scene that the player wants to be the highlight scene occurs. Presses down the button attached to the mobile terminal 105 within a predetermined time.

A digest creation device 106 having a wireless communication function is installed in the clubhouse 14. The digest creation device 106 receives or moves video data (hereinafter, both “video data” and “audio data”) recorded from the movement recording device 104 mounted on the golf cart by wireless communication. A medium such as a memory card removed from the recording device 104 is attached and read, and a digest is created by analyzing video data and audio data.

FIG. 2 is a diagram showing the configuration of the golf digest creation system of the present embodiment. Further, FIG. 3A is a diagram showing a hardware configuration of a moving shooting unit constituting a golf digest creation system, FIG. 3B is a diagram showing a hardware configuration of a mobile terminal, and FIG. 4 is a digest creation device. It is a figure which shows the hardware configuration of.

In FIG. 3A, the moving shooting unit 21 controls the imaging unit 211, the sound collecting unit 212, the AV storage unit 213, the course information storage unit 214, the player information storage unit 215, the GPS receiving unit 216, and the wireless transmission / reception unit 217. It consists of part 218.

The imaging unit 211 includes a 360-degree camera and transmits video data from the 360-degree camera to the AV storage unit 213, but at that time, the distortion caused by the wide-angle lens of the 360-degree camera is corrected and output. This distortion correction is realized in real time by an ASIC (Application Specific Integrated Circuit) incorporating a known algorithm.

The sound collecting unit 212 includes a sound collecting microphone 102, and transmits audio data from the sound collecting microphone 102 to the AV storage unit 213.

The GPS receiver 216 includes a GPS receiver, receives signals from satellites, and outputs current position information and time information.

The AV storage unit 213 is a non-volatile storage device using a large-capacity hard disk or a semiconductor memory card as a recording medium, and a semiconductor memory card having excellent impact resistance is preferable.

The course information storage unit 214 is also a non-volatile storage device, and geographic information and topographical information of all the courses of the golf course are recorded.

The player information storage unit 215 is also a non-volatile storage device, and records information for identifying a player riding in a cart or identification information for a mobile terminal held by the player.

The wireless transmission / reception unit 217 performs wireless communication (IEEE802.11), and can communicate for several hundred meters.

The control unit 218 controls the entire moving shooting unit 21, and writes the video data from the imaging unit 211 and the audio data from the sound collecting unit 212 to the AV storage unit 213. This video data is shot at a frame rate of 20 fps to 60 fps, and each frame is recorded with an elapsed time (time code) from the start of shooting. In addition, the audio data is also recorded with time information (time code) synchronized with each of the above frames. Further, the control unit 218 obtains the hole number at which the golf cart is currently stopped from the position information acquired from the GPS receiver 215 and the geographic information of each golf course stored in the course information storage unit 214, and uses them in the video data. Record location information and hole numbers. Further, the control unit 218 receives the notification from the mobile terminal 22 and records the notification and the reception time information (time code).

The above-mentioned mobile recording device 104, which is obtained by removing the 360-degree camera 101, the sound collecting microphone 102, and the GPS receiver 103 from the mobile photographing unit 21, is realized by a wireless communication device and a computer device. This computer device includes a CPU, a memory, a non-volatile storage unit, an input / output interface, and a wireless communication interface, which are connected by a bus. In particular, the control unit 218 realizes the function by expanding and executing the control program stored in the non-volatile storage unit in the memory.

Next, the hardware configuration of the mobile terminal 22 will be described.

In FIG. 3B, the mobile terminal 22 includes an input unit 221, a player information storage unit 222, a wireless transmission / reception unit 223, and a control unit 224.

The input unit 221 includes a button for receiving an instruction from a player when a scene to be recorded as a highlight scene, for example, a chip-in or an event such as OB occurs.

The player information storage unit 222 is a non-volatile memory, and stores information for identifying the player who owns the mobile terminal 22 (hereinafter, referred to as “player identification information”) or identification information for the mobile terminal.

The wireless transmission / reception unit 223 performs wireless communication (IEEE802.11), and can communicate for several hundred meters.

The control unit 224 controls the entire mobile terminal 22.

The above mobile terminal 22 is realized by an input button, a wireless communication device, and a computer device. This computer device includes a CPU, memory, a non-volatile storage unit, an input / output interface, and a wireless communication interface, which are connected by a bus. In particular, the control unit 224 realizes the function by expanding and executing the control program stored in the non-volatile storage unit in the memory.

Next, the hardware configuration of the digest creation device 23 will be described.

In FIG. 4, the digest creation device 23 includes an AV storage unit 231, a moving image cutting unit 232, a motion analysis unit 233, a voice analysis unit 234, a digest creation unit 235, a digest storage unit 236, a DVD writing unit 237, and a key input unit 238. It includes a display unit 239, a wireless transmission / reception unit 241 and a control unit 242.

The AV storage unit 231 is a storage device that stores moving image data received from a medium such as a semiconductor memory removed from the mobile photography unit 21 by wireless communication or from the mobile photography unit 21. The AV storage unit 231 corresponds to the digest creation AV storage unit according to the present invention.

The moving image cutting unit 232 cuts out a video by designating an arbitrary area from the video data, detects a person by motion detection, performs a process of cutting out to a peripheral area including all the people, or cuts out a person. When specifically cutting out, as shown in FIG. 5B, a process of cutting out an area is performed so that the person has a predetermined size or more. When cutting out a specific person, a person tracking process is performed to cut out the person in the center.

FIG. 5A shows an image example of a frame of video data, and this frame is an image of 360 degrees around a golf cart. The moving image cutting unit 232 cuts out an area surrounded by a broken line so that all the people in this frame are included.

These person detection, person tracking, and image cropping processing are open to the public in OpenCV (Open Source Computer-Vision-Library is an open source computer vision library developed and published by Intel). This is performed by performing software processing using a known image processing program, motion analysis program, object tracking program, pattern recognition program, or the like.

The motion analysis unit 233 recognizes the video data and analyzes whether the player swings, puts, jumps, or raises his / her hand. As this analysis technique, for example, a technique for determining an operation using a steric high-order local autocorrelation feature amount is known. Then, the motion analysis unit 233 creates a highlight scene candidate list including each determined motion type and the determination time information.

In this embodiment, an ultra-high resolution camera is used, and in the case of a 4K camera, the pixels of the recorded moving image are 3,840 pixels x 2,160 pixels, and in the case of an 8K camera, 7,680 pixels x 4, The frame is recorded with 320 pixels. Therefore, even after cutting out, the number of pixels of a person is four times or eight times as large as that after cutting out in the case of recording HD image quality, so that motion analysis can be performed with high accuracy.

The voice analysis unit 234 performs frequency analysis of voice data to obtain a spectrogram, and obtains a degree of similarity with a preset model spectrogram. Further, the voice information is classified into shot sound, cheers, laughter, speaking voice, and other voices in consideration of the magnitude of the squared average value of the volume. In this way, the voice analysis unit 234 creates a highlight scene candidate list including the determined voice type and time information.

The digest creation unit 235 extracts highlight scenes from the video data and audio data stored in the AV storage unit 231 based on the time information list, and combines them to create a digest. Further, the frame cut out by the moving image cutting unit 232 is corrected to full HD image quality by a known up-conversion technique.

The digest storage unit 236 stores the digest created by the digest creation unit 235.

The DVD writing unit 237 reads out the digest stored in the digest storage unit 236 and writes it to a DVD in full HD image quality.

The control unit 242 controls the entire digest creation device 23, displays a menu on the display unit 239, and instructs each processing unit constituting the digest creation device 23 to perform the process selected by the key input unit 238. Is.

The digest creation device 23 described above is realized by a display, a keyboard, a DVD recorder, a wireless communication device, and a computer device. This computer device includes a CPU, memory, a non-volatile storage unit, an input / output interface, and a wireless communication interface, which are connected by a bus. In particular, the digest creation unit 235, the moving image cutting unit 232, the motion analysis unit 233, the voice analysis unit 234, and the control unit 242 function by expanding and executing various programs stored in the non-volatile storage unit in the memory. It has been realized.

The data analysis unit according to the present invention includes a moving image cutting unit 232, a motion analysis unit 233, and a voice analysis unit 234.

The operation and operation of each device of the golf digest creation system configured as described above will be described below.

FIG. 6 is an operation flow diagram of the moving shooting unit.

In FIG. 6, first, the control unit 218 of the moving shooting unit 21 determines whether or not the current position is the teeing ground of the start hole (S601), and if it determines that the current position is the teeing ground of the start hole, the image pickup unit 211 and Recording / recording of the moving image data from the sound collecting unit 212 to the AV storage unit 213 is started (S602). Then, the golf cart number for identifying the moving image data to be recorded and the time when the recording / recording of the moving image is started are recorded. After that, the control unit 218 of the moving shooting unit 21 adds the elapsed time (time code) from the start of recording, the hole number where the golf cart is stopped, and the position information (latitude / longitude information) to the video data. Record.

Next, when the control unit 218 of the moving shooting unit 21 receives the highlight scene generation information from the mobile terminal 22 while the golf cart 12 is moving on the course (S603), the player attached to the notification. If the identification information is any of those registered in advance in the player information storage unit 215, this is accepted, and the reception time information is recorded in the AV storage unit 213 as highlight scene generation information (S604).

Next, the control unit 218 of the moving shooting unit 21 determines whether or not the current position is a clubhouse (S605), and if it determines that the current position is not a clubhouse, determines whether or not the video data is being recorded. (S606). If the video data is already being recorded / recorded, the process returns to step S603.

On the other hand, if it is determined that the recording / recording is stopped, the recording / recording of the moving image data is started (S607).

Further, in step S605, if the current position is the clubhouse, recording / recording is stopped (S608).

Next, the control unit 218 of the moving shooting unit 21 determines whether or not the play of all 18 holes has already been recorded (step S609), and if not all 18 holes have been recorded, returns to step S605 and is currently Check the position again. When all 18 holes have been recorded, the control unit 218 of the moving shooting unit 21 determines that the round has ended, and closes each file of the video data and the audio data recorded in the AV storage unit 213. Then, these files and the highlight scene occurrence time information file are transmitted to the digest creation device installed in the clubhouse via the wireless transmission / reception unit 217 (S610).
The above is the operation flow of the moving shooting unit 21.

Next, the operation flow of the mobile terminal 22 will be described with reference to the drawings.

FIG. 7 is an operation flow diagram of the mobile terminal 22.

In FIG. 7, the control unit 224 of the mobile terminal 22 checks the pressing of the button by the player (S701), and returns to step S701 if the pressing is not detected.

On the other hand, when the control unit 224 of the mobile terminal 22 detects that the button is pressed, the preset player identification information and highlight scene generation information are transmitted to the control unit 218 of the moving shooting unit 21 via the wireless transmission / reception unit 223. (S702).

In the above example, the mobile shooting unit 21 uses the player identification information in order to confirm whether or not the highlight scene generation information from the mobile terminal 22 is from the player to be shot. It is also possible to use the identification information.

Next, the operation flow of the digest creation device 23 will be described with reference to the drawings.
FIG. 8 is an operation flow diagram of the digest creation device 23.
In FIG. 8, first, the control unit 242 of the digest creation device 23 checks whether or not there is a transmission request for moving image data from the control unit 218 of the moving shooting unit 21 (S801), and if there is a transmission request, transmits. Allow and start receiving the video data file, audio data file, and highlight scene occurrence time information file.

Then, when the reception of all the files is completed in the AV storage unit 231 (S802), the control unit 242 of the digest creation device 23 then gives an instruction to create a digest among the options displayed on the display of the display unit 239. Is checked from the key input unit 238 (S803), and if instructed, the control unit 242 of the digest creation device 23 performs the digest creation process (S804).

FIG. 9 is an operation flow for explaining the digest creation process.

In FIG. 9, the control unit 242 of the digest creation device 23 reads out the video data file with the golf cart number from the AV storage unit 231 based on the golf cart number assigned when instructing the digest creation (S901). ). Then, the control unit 242 requests the moving image cutting unit 232 to perform the moving image cutting process. In response to this request, the moving image cutting unit 232 performs a person detection process and cuts out an area including a portion recognized as a person (S902).

Next, the control unit 242 of the digest creation device 23 requests the motion analysis unit 233 to perform motion analysis processing on the moving image cut out. In response to this, the motion analysis unit 233 performs motion analysis processing (S903), and creates a highlight scene candidate list 1 of the motion type and its occurrence time information (S904). Even if the video data has a high resolution, the motion analysis is performed using the video data obtained by cutting out a part of the video data, so that the analysis time can be kept short.

Next, the control unit 242 requests the voice analysis unit 234 to perform voice analysis processing on the voice data read from the AV storage unit 231. The voice analysis processing unit 234 performs voice analysis processing (S905) and creates a highlight scene candidate list 2 of the voice type and its determination time information (S906).

Next, the control unit 242 of the digest creation device 23 uses the list created by the motion analysis unit 233 and the voice analysis unit 234 and the time information of the highlight scene occurrence notified from the mobile terminal 22 during play as a highlight scene. The scene to be extracted is determined (S907).

FIG. 10 is an operation flow diagram for explaining the highlight scene determination process.

In FIG. 10, first, a candidate list in which the highlight scene candidate list 1 and the highlight scene candidate list 2 are integrated in chronological order is created (S1001), and evaluation values are given to each operation type and voice type (S1002). ..

FIG. 11 is a diagram illustrating a process of assigning an evaluation value to an operation type and a voice type.

As the criteria for assigning the evaluation value, for example, an evaluation value of 6 is assigned when the motion type is swing or putting, and an evaluation value of 4 is assigned when the motion is jumping or raising a hand. Further, when the voice type is a shot sound, the evaluation value is 6, when the voice type is a cheer, the evaluation value is 4, and when the voice type is a laughing voice, the evaluation value is 3. In particular, when the voice is determined to be a spoken voice, if the voice recognized by the known voice recognition process is a "nice shot" or a "good shot", the evaluation value is set to 6 because it is a promising candidate for the highlight scene. In the case of other voice types, the evaluation value is 0.

First, as shown in FIG. 11A, the control unit 242 assigns an evaluation value to each operation type and voice type according to these assignment criteria.

Next, based on the highlight scene occurrence notification notified by the player as shown in FIG. 11B, the evaluation value 4 is applied to the operation type and the voice type within a range from the notification time to a predetermined time, for example, 15 seconds before. To add points. This makes it possible to include the scene desired by the player in the digest as a highlight scene.

Furthermore, it is also effective to have a learning function such as adding points even if there is no subsequent notification for the operation type and voice type that occurred when the notification was given. For example, if the situation of being notified twice occurs after performing the jumping motion, points will be added when the jumping motion is determined even if there is no subsequent notification. This makes it more possible to include the player's favorite scenes.

Next, the evaluation value is added in relation to the position of the golf cart. For example, when the swing motion and the shot sound are on the teeing ground, an evaluation value of 4 is added to each. Further, as shown in FIG. 11 (c), an evaluation point 4 is added to the putting operation when the player is on the green. This makes it possible to prevent the putting action of cupping in with the tee shot from leaking from the highlight scene.

In addition, at the stage of assigning the evaluation value, the position information in the video of the person (for example, the direction information from the golf cart) so that the person in the video that is the target of the judgment of the operation type can be identified in the subsequent re-video cutting process. And the order of people) is recorded.

Next, as shown in FIG. 11, the control unit 242 sets a predetermined time before and after one operation type or voice type as one section, and obtains the total of the evaluation values for each section as the section evaluation value (S1004). For example, the swing and putting motion types are set to 5 seconds each before and after, and the cheering, jumping motion, and hand raising motion are set to 5 seconds before and 1 second after. If the sections overlap, the sections are extended and treated as one section. For example, in FIG. 11A, one section is from the movement type swing to the movement type jump. Further, in FIG. 11B, one section is from 5 seconds before the swing of the operation type to 5 seconds after the shot sound of the voice type. Similarly, in FIG. 11C, one section is from 5 seconds before the operation type putting to 1 second after the operation type hand is raised.

As a result, when an event is detected by both motion analysis and voice analysis in one block, the block evaluation value becomes high and the probability of extracting as a highlight scene increases, so the validity of highlight scene selection is high. Increase.

Next, the control unit 242 determines the selected section as a highlight scene having a section evaluation value equal to or higher than a predetermined score. Alternatively, the interval evaluation values are determined in descending order so as to be within a predetermined time. The latter method is effective when the length of the digest is kept within a predetermined time.

The above is the highlight scene determination process (S907).

Next, the control unit 242 of the digest creation device 23 extracts the moving image data of the selected section from the moving image data stored in the AV storage unit 231 before the moving image cutting process (S908), and the moving image thereof. The moving image is cut out from the data again (S909). That is, the moving image cutting unit 232 cuts out from the video data of the section selected as the highlight scene in response to the request from the control unit 242, and at this time, the moving image cutting unit 232 specifies the selected section. When the position information of the person to be expected is recorded, the cutting process centering on this person is performed as shown in FIG. 5 (b). If the person is moving within the time of the selected section, the moving image cutting unit 232 tracks the person and performs cutting processing so as not to be out of the frame (S909).

Next, the control unit 242 of the digest creation device 23 requests the digest creation unit 235 to create a digest. In response to this, the digest creation unit 235 combines the cut-out moving image data in chronological order while correcting it to full HD image quality by the up-conversion technique, sequentially writes it to the digest storage unit 236, and creates a digest (S910). At this time, the control unit 242 refers to the hole number recorded together with the time information, and inserts an image showing the hole number prepared in advance before the moving image of the tee shot. Further, the control unit 242 synthesizes the position information of the cart recorded together with the time information marked on the course map prepared in advance into a part of the moving image data. This makes it possible to indicate the approximate location of the highlight scene.

The steps S901 to S910 described above are the digest creation process (S804) when the control unit 242 of the digest creation device 23 receives the instruction to create the digest, and then the process proceeds to step S805.

On the other hand, when this instruction is not input in step S803, the control unit 242 of the digest creation device 23 gives an instruction to create a digest DVD from the key input unit 238 among the options displayed on the display of the display unit 239. It is checked whether or not the file has been accepted (S805), and if a DVD creation instruction has been received, the digest file is read from the digest storage unit 236 based on the golf cart number assigned when the digest writing instruction was given. Then, the control unit 242 requests the DVD writing unit 237 to write the digest file to the DVD, and the DVD writing unit 237 creates the digest DVD with full HD (1920 pixels x 1080 pixels) image quality (S806). ).

On the other hand, when there is no instruction to create a DVD from the key input unit 238 in step S805, the control unit 242 of the digest creation device 23 has an instruction to delete the digest file among the options displayed on the display of the display unit 239. When it is determined whether or not the file is deleted (S807) and an erase instruction is given, the control unit 242 deletes the digest file of the cart number attached to the erase instruction from the digest storage unit 236 (S808). After that, the process returns to step S801.

Further, in step S807, if the instruction to delete the digest file has not been received, the process returns to step S801 without any processing.

In the present embodiment, the camera is installed at a position where a 360-degree field of view is opened by erecting a support on the roof of the golf cart or the frame of the vehicle body, but the camera is not limited to this, because the caddy and the player carry the golf bag. It is also possible to install a 360-degree camera by attaching a support or the like to a wheelbarrow or the like. An object of the present invention is to move a 360-degree camera together with a player to perform photography, and the present invention can be applied to any moving body to which a 360-degree camera can be attached.

Further, in the present embodiment, the mobile terminal 105 is provided with a button for designating the timing for specifying the highlight scene, but the present invention is not limited to this, and the mobile terminal can be provided with an acceleration sensor. It is also possible to detect the timing of notifying the moving shooting unit 21 by an operation such as shaking with an acceleration sensor.

Further, the mobile terminal 105 is provided with a sound collecting microphone, and voice data is transmitted to the mobile photographing unit 21 in real time via the wireless communication unit 224, and the sound collected by the control unit 218 of the mobile photographing unit 21 by the sound collecting unit 212. It is also possible to detect the event as voice data different from the data.

Further, in the present embodiment, the size of the moving image cutout is determined on the premise of creating a high-definition digest, but the size is not limited to this, and it is assumed that a DVD is created with SD image quality (720 pixels x 480 pixels). You may decide the size of the moving image cutout. Further, in the present embodiment, the moving image data is transmitted to the digest creation device 23 when returning to the clubhouse, but the present invention is not limited to this, and wireless relay units are provided at several places in the golf course and via the wireless relay units during play. It is also possible to send the data to the digest creation device 23. As a result, it is possible to shorten the time for the player to receive the digest after playing.

As described above, in the present embodiment, the golf digest automatic creation system includes an ultra-high resolution 360-degree camera installed at a position where a 360-degree view of the upper part of the golf cart is open, and a sound collecting sound installed in the golf cart. Equipped with a microphone, all the video data and audio data from these are stored in the AV storage unit during the golf round, so after the round, the stored ultra-high resolution video data and audio data are analyzed and audio. It is possible to extract highlight scenes that have been analyzed and determined according to preset criteria, and create a digest that collects highlight scenes anywhere on the golf course without missing them.

Further, in the present embodiment, the resolution of the camera is 4K or 8K, and the resolution is high, so that the high image quality of the moving image can be maintained even if only the portion in which the person is shown is cut out in the digest creation.

Further, in the present embodiment, since it is possible to instruct a scene that the player wants to record as a highlight scene, it is possible to create a digest that satisfies the player's wishes.

Further, in the present embodiment, since the moving shooting unit 21 detects the current position and automatically starts and ends the recording of the moving image data, it is possible to prevent forgetting to record or omission.

In the present embodiment, as shown in FIG. 11, the highlight scene section is determined by both the operation type and the voice type, but the present invention is not limited to this, and only the movement type or only the voice type is used. It is also possible to determine the highlight scene section. As described above, it is preferable to use both the motion type and the audio type because the reliability of the highlight scene judgment can be increased, but using only the audio type does not perform the motion analysis processing using the video data. , The load on the digest creation device is reduced, and the digest creation time can be shortened.

Further, in the present embodiment, only the digest of the moving image is created, but the present invention is not limited to this, and a snapshot photo book in which the player arbitrarily selects an image from the moving image and records the still image on the DVD is created. Is also possible. This can be achieved by a known technique using the library software OpenCV.

Further, in the present embodiment, the digest is written to a DVD and provided to the player, but the present invention is not limited to this, and the digest file can be downloaded to the player's personal computer or transferred to the player via the Internet. ..

In the present embodiment, the moving shooting unit 21 and the digest creating device 23 are separate devices, but the present invention is not limited to this, and the digest creating unit 235, the moving image cutting unit 232, and the motion analysis unit 233 that create the digest are not limited to this. It is also possible to include the voice analysis unit 234 and the digest storage unit 236 in the moving shooting unit 21. By using a multi-CPU configuration, recording / recording processing and highlight scene candidate extraction processing can be performed in parallel, and the time required to create a digest after the end of the round can be shortened.

(Embodiment 2)
FIG. 12 is a diagram showing the configuration of the golf digest automatic creation system according to the second embodiment of the present invention, and is different from the first embodiment in that the fixed photographing unit 25 is provided. The differences will be described below.

In FIG. 12, the fixed shooting unit 25 is installed near the teeing ground or the green or in an area where the golf cart cannot enter, and is provided in an area that cannot be covered only by the shooting of the moving shooting unit 21. Then, when the moving shooting unit 21 comes near the fixed shooting unit 25, the moving shooting unit 21 instructs the fixed shooting unit 25 to start shooting, and when the moving shooting unit 21 moves from the vicinity of the fixed shooting unit 25. Instruct the end of shooting.

FIG. 13 is a diagram showing a hardware configuration of the fixed photographing unit 25 according to the second embodiment of the present invention.
As shown in FIG. 13, the fixed photographing unit 25 of the present embodiment controls the imaging unit 251 including the camera, the sound collecting unit 252 including the voice microphone, the AV storage unit 253 for recording the moving image data, and the wireless transmission unit 254. It consists of a part 255. Since the shooting target range of the camera is limited, the camera shoots at a full HD image quality (1920 pixels x 1080 pixels) at a rate of 30 fps. At that time, the distortion caused by the wide-angle lens of the camera is corrected and output.

The fixed photographing unit 25 is realized by a camera, a sound collecting microphone, a wireless communication device, and a computer device. This computer device includes a CPU, memory, a non-volatile storage unit, an input / output interface, and a wireless communication interface, which are connected by a bus. In particular, the control unit 255 realizes the function by expanding and executing the control program stored in the non-volatile storage unit in the memory.

The operation and operation of the fixed photographing unit 25 configured as described above will be described below.

FIG. 14 is an operation flow diagram of the fixed photographing unit 25.
In FIG. 14, first, the control unit 255 of the fixed shooting unit 25 waits for a shooting start request from the moving shooting unit 21 (S1401), and when there is a request, the control unit 255 receives the imaging unit 251 and the sound collecting unit 252. Recording / recording of the moving image data from the above to the AV storage unit 253 is started (S1402). At this time, the control unit 255 records the golf cart number notified together with the shooting start instruction and the time when the recording / recording of the moving image is started in order to identify the moving image data to be recorded.

Next, the control unit 254 waits for a shooting end request from the mobile shooting unit 21 (S1403), and if there is a request, ends recording / recording to the AV storage unit 253 (S1404).

Next, the control unit 255 of the fixed shooting unit 25 wirelessly transmits the recorded video data file, audio data file, and attribute information file in which the golf cart number, shooting start time information, and shooting position are described to the digest creation device 23. Transmit (S1405).

Then, the control unit 255 of the fixed photographing unit 25 returns to the process of step S1401 for the next set.

In the present embodiment, video data and audio data are once recorded in the AV storage unit 251 and then transmitted to the digest creation device 23, but the present invention is not limited to this, and the method is not limited to this. Depending on the transmission speed, it is possible to transmit in real time without temporarily storing it in a hard disk or the like.

Alternatively, these files are transmitted to the moving shooting unit 21 instead of the digest creating device 23, and after the round is completed, the moving shooting unit 21 transmits these files to the digest creating device 23 together with the moving image file shot by itself. You may do it.

Next, the operation and operation of the moving shooting unit 21 in the present embodiment will be described. However, the moving shooting unit 21 described in the first embodiment has instructions for starting and ending recording in the fixed shooting unit 25. Only different.

FIG. 15 is an operation flow diagram of the moving shooting unit 21 of the present embodiment.
In FIG. 15, the control unit 218 of the moving shooting unit 21 checks whether or not the current position detected by the GPS receiving unit 216 is in the predetermined area where the fixed shooting unit 25 is installed (S1501). Then, when entering the predetermined area, the fixed photographing unit 25 in the area is instructed to start photographing together with the golf cart number (S1502). Then, the control unit 218 of the moving shooting unit 21 stops recording in the AV storage unit 213 (S1503).

Next, the control unit 218 of the moving shooting unit 21 checks whether or not the current position is in the predetermined area (S1504), and when the current position leaves the predetermined area, the fixed shooting unit 25 in the area finishes shooting. Instruct with the cart number (S1505). Then, the control unit 218 of the moving shooting unit 21 starts recording in the AV storage unit 213 (S1506).

Other operations of the moving shooting unit 21 are the same as those in the first embodiment.

The operation of the mobile terminal 22 is also the same as that of the first embodiment.

Next, the operation and operation of the digest creation device 23 in the present embodiment will be described.

FIG. 16 is an operation flow diagram of the digest creation process performed by the digest creation device 23.

In FIG. 16, first, when the control unit 242 of the digest creation device 23 receives an instruction to create a digest, it reads a moving image file to which the notified golf cart number is assigned from the AV storage unit 231 (S1601), and is a moving shooting unit. For the moving image file taken by 21, the moving image cutting process (S1602) to the creation of the highlight scene scene candidate list 2 (S1606) are performed in the same manner as in the first embodiment.

Next, the control unit 242 performs the same operation analysis processing as in the first embodiment (S1607) for the moving image file shot by the fixed shooting unit 25, without performing the moving image cutting process. From S1608) to the creation of the highlight scene candidate list 2 (S1611). This is because shooting with a fixed camera only shoots a limited space.

Next, the control unit 242 combines all the highlight scene candidate lists in chronological order (S1612), and performs the same highlight scene determination process (S1613) to digest creation (S1616) as in the first embodiment. In this digest, both the moving image taken by the moving shooting unit 21 and the moving image taken by the fixed shooting unit 25 are all in full HD image quality by the up-conversion technique, so that it is possible to create a high image quality digest as in the first embodiment. it can.

Also in this embodiment, since the wireless transmission / reception unit 217 mounted on the golf cart can receive the highlight scene generation notification from the mobile terminal 22, the highlight scene generation information file is created as a digest as in the first embodiment. The control unit 242 of the device 23 also adds an evaluation value to the video data recorded by the fixed shooting unit 25, and the highlight scene is not lost even in the section where the fixed shooting unit 25 is installed.

As described above, in the present embodiment, since the fixed shooting unit is installed in the area where the golf cart cannot enter, the highlight scene of the area that cannot be covered only by the shooting of the moving shooting unit 21 is not missed. You can create a collected digest.

In the present embodiment, the installation area of the fixed shooting unit is an area where the moving shooting unit 21 cannot enter, but the area is not limited to this, and the moving shooting unit 21 can be inserted, but from an angle more suitable for shooting. It is also possible to install a fixed shooting unit for shooting. In such a case, it is possible to simultaneously perform the shooting by the fixed shooting unit and the moving shooting unit 21 and select the highlight scene from the moving images of both shots.

Further, in the present embodiment, the resolution of the photographing camera is set to full HD image quality (1920 pixels x 1080 pixels) and the image is taken at a rate of 30 fps, but the image quality is not limited to this, and the image quality is higher or the frame rate is higher. It is also possible to.

(Embodiment 3)
The golf digest automatic creation system according to the third embodiment of the present invention comprises a mobile photographing unit, a mobile terminal, and a digest creating device as in the first embodiment, but the photographing camera is not a 360-degree camera but a camera with a zoom drive function. The point that the sound collecting microphone is a directional microphone, the point that these cameras and microphones are installed on an electric cloud stand that can rotate 360 degrees, and the point that the mobile terminal 22 has a GPS receiver. Is different. The shooting camera is capable of shooting in full HD image quality.

FIG. 17A is a diagram showing a hardware configuration of a moving shooting unit according to the present embodiment.

In FIG. 17A, the photographing camera of the imaging unit 211 is a camera with a zoom drive function having an optical zoom lens and a motor for driving the optical zoom lens as described above, and the sound collecting microphone of the sound collecting unit 212 is directional. It's Mike. The camera drive unit 219 includes an electric pan head, a motor drive circuit for driving the electric pan head, and a motor drive circuit for driving the zoom lens. Others are the same as the hardware of the first embodiment.

FIG. 17B is a diagram showing the hardware configuration of the mobile terminal 22 in the present embodiment, but the mobile terminal 22 is different from the first embodiment in that it includes a GPS receiving unit 225.
The digest creation device 23 is the same as that of the first embodiment.

The operation and operation of the golf digest automatic creation system configured as described above will be described below in terms of differences from the first embodiment.

FIG. 18 is an operation flow diagram of the mobile terminal 22, which is different from that of the first embodiment in that the current position information and the player identification information are transmitted to the moving shooting unit 21 at a predetermined time, for example, every 2 seconds.

That is, first, the control unit 224 of the mobile terminal 22 transmits the current position detected from the GPS receiving unit 225 to the moving shooting unit 21 (S1801), and checks whether or not 2 seconds have passed (S1802). If 2 seconds have not passed, the control unit 224 checks the pressing of the button (S1803), and when the pressing is detected, wirelessly transmits and receives the preset player identification information and the highlight scene occurrence information with the current time. It is transmitted to the moving shooting unit 21 via the unit 223 (S1804). After that, the process of the control unit 224 returns to step S1802 and checks whether or not 2 seconds have elapsed. On the other hand, when the control unit 224 does not detect the pressing of the button, the process returns to step S1802, and if 2 seconds have passed, the process proceeds to step S1801, the current position is detected from the GPS receiving unit 216, and the moving image is taken. Notify unit 21 (S1801).

In this way, the mobile terminal 22 notifies the moving shooting unit 21 of the current position at predetermined time intervals, and notifies the moving shooting unit 21 of the highlight scene generation information when the button is pressed.

Next, the operation / operation of the moving shooting unit 21 of the present embodiment will be described. The difference from the first embodiment is that the control unit 218 controls the drive of the zoom lens and the electric pan head of the camera in order to capture the subject. Is to do.

That is, when the control unit 218 of the mobile photographing unit 21 receives the position information from the mobile terminal 22, it checks whether the player identification information is one of those registered in advance, and if it is registered, the transmission source. The direction and distance of the mobile terminal 22 are calculated, and the position of the person is recognized including the position information from the other mobile terminal 22. Then, the control unit 218 rotates the electric pan head so that all the people are within the shooting range, and zooms the person so that the person can be recorded in a predetermined size or more. As a result, the moving shooting unit 21 can continue to track the player even if the player moves. Other operations are the same as those in the first embodiment.

Further, regarding the operation / operation of the digest creation device 23, since the moving image data recorded by the moving shooting unit 21 has already been taken mainly by the player, it is not necessary to perform the moving image cutting process (S902), so this is performed. Absent. This point is different from the first embodiment, and other operations are the same as those of the first embodiment.

As described above, in the present embodiment, since the camera is not an ultra-high resolution, the amount of data stored in the AV storage unit 213 of the moving shooting unit 21 can be significantly smaller than that in the first embodiment. Further, as a result, the transmission time of the moving image data from the moving shooting unit 21 to the digest creating device 23 is also shortened. Further, since the image processing time performed by the digest creation device 23 does not include the moving image cutting process (S902), there is an advantage that the image processing time can be completed in a shorter time than the time required in the first embodiment.

In addition, since the directional microphone faces the direction in which the person is present together with the camera, there is an advantage that the sound emitted by the player can be acquired more sensitively.

In the present embodiment, the optical zoom is used, but the zoom function is not limited to this, and it is possible to realize the zoom function without causing deterioration in image quality by performing the electronic zoom using a camera with a high resolution CCD. is there.

(Embodiment 4)
The golf digest automatic creation system according to the fourth embodiment of the present invention includes a mobile photographing unit, a mobile terminal, a digest creation device, a digest distribution server, and a golf course terminal, and the digest creation device and the digest distribution server exist on the Internet. , The mobile photographing unit existing in the golf course and the golf course terminal communicate data with them. The mobile terminal is the same as that of the first embodiment.

FIG. 19 is a diagram showing a configuration of a golf digest creation system according to the present embodiment.

In FIG. 19, the mobile photographing unit 21 performs two-way wireless communication with the mobile terminal 22 as in the first embodiment, but further with the digest creating device 23 existing on the Internet 27. Perform generational mobile communication (5G). This fifth generation mobile communication (5G) system is composed of a UE (user device), a 5G access network (5G-AN) 29, and a 5G core network (5GCN) 28. The 5G access network (5G-AN) 29 is a fifth-generation wireless network portion that directly exchanges radio waves with the user equipment, and the 5G core network 28 performs connection processing and user data routing processing as a whole. This is the 5th generation wireless network part. Regarding the 5G access network (5G-AN) 29 and the 5G core network (5GCN) 28, for example, from page 218 to 241 of the document "5G textbook (LTE / IoT to 5G)" (publisher: Impress Co., Ltd.). As stated on the page.

The mobile photographing unit 21 in the present embodiment corresponds to the above UE, and is a 5G wireless transmission / reception unit capable of bidirectional communication with a 5th generation wireless base station via a new wireless interface (hereinafter referred to as NR). It has. The above NR is as described on pages 108 to 117 of the above-mentioned document "5G textbook (LTE / IoT to 5G)". It should be noted that this NR has a communication capability that realizes a maximum data rate of 20 Gbps for downlink and a maximum of 10 Gbps for uplink.

The golf course terminal 24 performs two-way wired communication with the digest creation device 23, and performs some functions of the display unit 239, the key input unit 238, and the control unit 242 of the digest creation device 23 in the first embodiment. It is to be carried out.

The digest distribution server 26 receives a digest from the digest creation device 23, assigns an individual ID or URL, and stores / stores the digest. In addition, the digest file specified by the ID or URL is transferred from the outside to the requesting terminal (smartphone or personal computer) or streamed.

Only the points different from the first embodiment will be described below.

FIG. 20 is a diagram showing a hardware configuration of the moving shooting unit 21 according to the present embodiment.

In FIG. 20, the mobile photographing unit 21 is newly provided with a 5G wireless transmission / reception unit 251.

The 5G wireless transmission / reception unit 251 performs high-speed wireless communication with the 5th generation wireless base station as described above.

The control unit 218 controls the entire moving shooting unit 21 as in the first embodiment, but the video data and audio data written in the AV storage unit 213 are transferred to the digest creation device 23 while the cart is moving. It differs from the first embodiment in that transmission is performed via the 5G wireless transmission / reception unit 251.

Next, the hardware configuration of the digest creation device 23 according to the present embodiment will be described with reference to FIG.

In FIG. 21, the digest creation device 23 is provided with a network i / f in place of the wireless transmission / reception unit 241 and can be connected to the Internet to transmit / receive data to / from the outside, and the display unit 239 and the key input unit 238. It is different from the first embodiment in that it is not provided. The AV storage unit 231 corresponds to the digest creation AV storage unit according to the present invention.

In addition, the golf course terminal 24 and the digest distribution server 26 have the golf digest creation system of the present embodiment, but the golf course terminal 24 is a general personal computer having a DVD writing function and a network i / f, and provides a digest. The service program is stored in the built-in storage device. The digest providing service is executed by expanding this application program from the built-in storage device to the memory and executing it by the CPU.

The digest distribution server 26 transfers files by a known streaming server that performs streaming distribution of the digest requested by HTTP Live Streaming (hereinafter referred to as HLS), a known web server that distributes by the HTTP protocol, or an FTP protocol. It is a known file server.

The operation and operation of each device of the golf digest creation system configured as described above will be described below only in terms of differences from the first embodiment. The operation / operation of the mobile terminal 22 is the same as that of the first embodiment.

FIG. 22 is an operation flow diagram of the moving shooting unit 21.

In FIG. 22, the control unit 218 of the moving shooting unit 21 first performs steps S2201 to S2204 as in the operation flow of the first embodiment. This is the same as steps S601 to S604, which are the operation flows of the first embodiment shown in FIG.

Next, the control unit 218 of the moving shooting unit 21 determines whether or not the cart is moving (S2205). Whether or not the cart is moving is determined by whether or not the position information output by the GPS receiving unit 216 has changed. When it is determined that the cart is moving, the control unit 218 of the moving shooting unit 21 stops recording / recording of the moving image data and closes the moving image data file. Then, the moving image data file is transferred to the digest creation device 23 on the Internet via the 5G wireless transmission / reception unit 251 by the FTP protocol (S2206). In this video data file, a video ID consisting of a golf course number, a play date, a cart number, and a serial number assigned each time the data is transmitted is given as a file name.

Then, after transmitting this moving image data file to the digest creation device 23, the process of step S2203 is performed.

On the other hand, when it is determined in step S2205 that the cart is not moving, the control unit 218 of the moving shooting unit 21 starts recording / recording if the video recording / recording has not started, and if it has already started, the control unit 218 starts recording / recording as it is. Continue (S2207).

Next, the control unit 218 of the moving shooting unit 21 determines whether or not the current position is a clubhouse (S2208), and if it is determined that the current position is not a clubhouse, returns to step S2203.

On the other hand, if the current position is the clubhouse, recording / recording is stopped (S2209).

Next, the control unit 218 of the moving shooting unit 21 determines whether or not the play of all 18 holes has already been recorded (step S2210), and if not all 18 holes have been recorded, returns to step S2208 and is currently Check the position again. If all 18 holes have been recorded, the control unit 218 of the moving shooting unit 21 determines that the round is over and ends the operation.

The above is the operation flow of the mobile imaging unit 21 in the fourth embodiment. Even if the video data is captured at a resolution of 4K or 8K as in the first embodiment, the 5G mobile communication network system is used to transfer the video data to the digest creation device. It makes it possible to transmit a large amount of video data and audio data in a short time when moving the cart.

Next, only the differences between the operation flow of the digest creation device 23 and the first embodiment will be described.

FIG. 23 is an operation flow diagram of the digest creation device 23.

In FIG. 23, first, the control unit 242 of the digest creation device 23 determines whether or not there is a request for receiving moving image data from the mobile shooting unit 21 (S2301), and if there is a request, permits transmission, and each of them is allowed to transmit. The video data file with the moving image ID, the audio data file, and the highlight scene occurrence time information file are received by the FTP protocol.

Then, when the video data file or the audio data file is received by the AV storage unit 231 (S2302), it is combined with the respective files having the same moving image ID that have been received so far (S2303).

It should be noted that the reception of the video data file and the like and the combination of the respective files are performed every time the cart moves until the round of 18 holes is completed.

Next, when the control unit 242 of the digest creation device 23 receives the digest creation instruction from the golf course terminal 24 (S2304), the digest creation process is performed (S2305). This digest creation process is the same as that of the first embodiment.

Then, when the digest creation process is completed, the created digest is assigned a digest ID and transferred to the digest distribution server 26 (S2306). This digest ID consists of a golf course ID, which is an identification number of the golf course, a play date, and a cart number.

Next, when the control unit 242 of the digest creation device 23 receives the storage completion notification of the digest file and the URL of the storage location from the digest distribution server 26 (S2307), the URL of the storage location is associated with the digest ID. Notify the golf course terminal 24 (S2308).

After that, the control unit of the digest creation device 23 returns to the process of step S2301.

The above is the operation flow of the digest creation device 23 in the fourth embodiment.

Next, the operation flow of the digest distribution server 26 will be described.

FIG. 24 is an operation flow diagram of the digest distribution server 26.

As described above, the digest distribution server 26 is a web server that transfers and streams digests (video files) managed by itself on the Internet.

First, when the digest distribution server 26 receives a storage request from the digest creation device 23 (S2401), it receives a digest file having the digest ID as a file name and stores it in the storage device (S2402). Then, the URL of the storage location of the digest file is returned to the digest creation device 23 (S2403). At this time, the digest distribution server 26 manages the digest ID, which is the file name of the received file, in association with the URL of the storage location.

Next, when the digest distribution server 26 receives a transfer request or a streaming distribution request for the digest file specified by the URL from a mobile terminal such as a player or a golf course terminal 24 (S2404), the digest distribution server 26 reads the specified digest file from the storage device. , File transfer by FTP protocol or streaming distribution by HLS protocol is performed to the requesting terminal (S2405).

Next, when the digest distribution server 26 receives an instruction to delete the digest file specified by the URL from a mobile terminal such as a player or a golf course terminal 24 (S2406), the digest distribution server 26 deletes the digest file specified from the storage device and also deletes the digest file. Notifying the player terminal or golf course terminal 24 of the transmission source that the digest file has been deleted (S2407).

The above is the operation flow of the digest distribution server.

Next, the operation of the golf course terminal 24 will be described.

FIG. 25 is an operation flow diagram of the golf course terminal 24.

As described above, the golf course terminal 24 is a general personal computer that can be connected to the Internet, but a digest providing service program is executed. That is, first, a menu of a digest creation request, a DVD creation request, and a digest erasure request is displayed on the display.

Then, when the golf course terminal 24 receives the digest creation request after the golf cart number is input from the keyboard or the like (S2501), the golf course ID, the date of play, and the cart number are added to the digest creation device 23. Requests that a digest be created from a file such as the corresponding video data (S2502). This request is transmitted to the digest creation device 23 on the Internet via the network i / f provided in the golf course terminal.

In response to this request, the digest creation device 23 reads a file such as the corresponding video data from the AV storage unit 231, creates a digest, and transfers it to the digest distribution server 26.

After that, the golf course terminal 24 receives the digest ID and the URL of the storage location of the digest from the digest creation device 23, and stores the URL and the digest ID in association with each other.

Then, the golf course terminal 24 receives the URL and notifies the player who played with the cart number indicated by the digest ID by e-mail or the like (S2504).

When the player who receives this mail accesses the URL from his / her own terminal and makes a request for forwarding the digest, the digest distribution server 26 transfers the digest to the requesting terminal or performs streaming distribution, so that the player Will be able to watch the digest.

Further, when the golf course terminal 24 receives a DVD creation request from the player (S2505), the golf course terminal 24 obtains a URL from the related information of the URL and the digest ID using the designated cart number. Then, the corresponding URL is accessed, the digest file is downloaded from the digest distribution server 26 (S2506), and the digest file is written to a DVD (S2507).

Next, when the golf course terminal 24 receives the cart number and the digest deletion instruction from the display menu (S2508), the golf course terminal 24 similarly requests the corresponding URL and transmits a digest file deletion request to the digest distribution server 26. (S2509).

In response to this, the digest distribution server 26 deletes the digest file whose address is the specified URL.

As described above, according to the present embodiment, in addition to the action and effect shown in the first embodiment, it is not necessary to equip the golf course with the digest creation device 23, and the golf digest creation system at the golf course can be introduced. It will be easier. In addition, the digest creation device 23 and the digest distribution server 26 are operated by a service provider or the like, and by accepting digest creation and distribution requests from a plurality of golf courses, it is possible to efficiently operate the golf digest creation system. Become.

In the present embodiment, the digest creation device 23 and the digest distribution server 26 are separate devices, but the present invention is not limited to this, and the digest distribution function can be included in the digest creation device to form one device. Is.

(Embodiment 5)
In the golf digest automatic creation system according to the fifth embodiment of the present invention, as shown in FIG. 26, the mobile photographing unit 21 and the golf course terminal 24 are connected by wireless communication, and moving image data is transmitted via the golf course terminal 24. It differs from the golf digest automatic creation system of the fourth embodiment in that it is transferred to the digest creation device 23.

Hereinafter, only the points different from the fourth embodiment will be described.
First, the configuration of the mobile photographing unit 21 is the same as that described in the first embodiment, but the operation flow is that the video data and the like are transmitted to the digest creation device by wireless communication in the first embodiment ( FIG. 6 Step S610), the present embodiment is different in that the data is transmitted to the golf course terminal 24 installed in the clubhouse 14.

Next, the configuration of the digest creation device 23 is the same as that described in the fourth embodiment, but instead of receiving the video data or the like from the moving shooting unit 21, the video data or the like is received from the golf course terminal 24. The point to do is different. Further, since the received video data or the like is a file in which all 18 holes are combined, the combination processing of each file (step S2303 in FIG. 23) is not performed.

Next, the golf course terminal 24 will be described.

FIG. 27 is a diagram showing a configuration of a golf course terminal 24 according to the present embodiment.

In FIG. 27, the golf course terminal 24 includes an AV storage unit 306, a digest storage unit 305, a DVD writing unit 304, a key input unit 302, a display unit 301, a network i / f 308, a wireless transmission / reception unit 307, and a control unit 303. ..

The AV storage unit 306 is a storage device that stores moving image data received from the mobile photographing unit 21 by wireless communication performed by the wireless transmission / reception unit 307.

The digest storage unit 305 stores the digest file received from the digest distribution server 26.

The DVD writing unit 304 reads out the digest stored in the digest storage unit 236 and writes it to the DVD in full HD image quality.

The control unit 303 controls the entire golf course terminal 24 to execute the digest providing service, displays a menu on the display unit 301, and performs the process selected by the key input unit 302 on the golf course terminal 24. Instruct each component processing unit to perform this.

The golf course terminal 24 described above is realized by a display, a keyboard, a mouse, a DVD recorder, a network interface card, a wireless communication device, and a computer device. This computer device includes a CPU, memory, a non-volatile storage unit, an input / output interface, and a wireless communication interface, which are connected by a bus. In particular, the control unit 242 realizes the function by expanding and executing various programs stored in the non-volatile storage unit in the memory. The golf course terminal 24 can be realized by a personal computer having these hardware resources as in the fourth embodiment.

FIG. 28 is an operation flow diagram of the golf course terminal 24.

In FIG. 28, the control unit 303 of the golf course terminal 24 first checks whether or not there is a request for receiving moving image data from the mobile shooting unit 21 (S2801), and if there is a request for reception, permits transmission of the video. Start receiving the data file, audio data file, and highlight scene occurrence time information file.

Then, when the AV storage unit 306 completes the reception of all the files (S2802), the control unit 303 requests the digest creation device 23 to receive these files.

When the digest creation device 23 permits the reception request, the golf course terminal 24 digests all the files received earlier, that is, the video data file and the audio data file with the video ID, and the highlight scene occurrence time information file. It is transmitted to the creation device 23 by the FTP protocol.

Next, the control unit 303 of the golf course terminal 24 checks the options displayed on the display of the display unit 301.

Subsequent processes from step S2803 to step S2811 are the same as the processes from step S2501 to step S2509 of the fourth embodiment.

As described above, according to the present embodiment, as in the fourth embodiment, in addition to the action and effect shown in the first embodiment, it is not necessary to provide the digest creating device 23 at the golf course, and the golf digest creating system Is easy to introduce. In addition, the digest creation device 23 and the digest distribution server 26 are operated by a service provider or the like, and by accepting digest creation and distribution requests from a plurality of golf courses, it is possible to efficiently operate the golf digest creation system. Become.

Further, the golf course can use the digest creation device 23 and the digest distribution server 26 on the Internet without using the 5th generation wireless communication system.

The AV storage unit 306 of the golf course terminal 24 in the present embodiment is supposed to receive moving image data or the like from the mobile shooting unit 21 by wireless communication, but the present invention is not limited to this, and the AV storage unit 213 of the mobile shooting unit 21 is not limited to this. A semiconductor memory card is removed from the moving shooting unit 21, attached to a dedicated adapter provided in the golf course terminal, and video data is acquired via this dedicated adapter, or the mounted semiconductor memory itself is the AV storage unit 306. It is also possible to make the configuration as follows.

The present invention is useful for creating a digest of golf play, and is suitable for making a digest that collects highlight scenes anywhere on the golf course without missing them.

11 Golf course 12 Golf cart 13 Player 14 Clubhouse 21 Mobile shooting unit 22 Mobile terminal 23 Digest creation device 24 Golf course terminal 25 Fixed shooting unit 26 Digest distribution server 41 Information input / output terminal means 42 Shooting means 43 Information processing means 51 Attention section Extraction unit 52 Play scene degree calculation unit 53 Play scene judgment unit 101 360 degree camera 102 Omnidirectional microphone 103 GPS receiver 104 Mobile recording device 105 Mobile terminal 106 Digest creation device 111 Tea ground 112 Fairway 113 Green 211, 251 Imaging unit 212 , 252 Sound collecting unit 213, 231, 253 AV storage unit 214 Course information storage unit 215 Player information storage unit 216, 225 GPS receiving unit 217, 223, 241, 254 Radio transmission / reception unit 218, 224, 242, 255 Control unit 219 Camera Drive unit 221 Input unit 222 Player information storage unit 232 Video cutout unit 233 Motion analysis unit 234 Voice analysis unit 235 Digest creation unit 236 Digest storage unit 237 DVD writing unit 238 Key input unit 239 Display unit 251 5G Wireless transmission / reception unit 261 Network i / f
301 Display unit 302 Key input unit 303 Control unit 304 DVD writing unit 305 Digest storage unit 306 AV storage unit 307 Wireless transmission / reception unit 308 Network i / f

Claims (10)

A 360-degree camera installed at a position where a 360-degree view of the upper part of the golf cart is open, a sound collecting microphone installed on the golf cart, video data from the 360-degree camera, and audio data from the sound collecting microphone are stored. A mobile photographing unit having an AV storage unit, a control unit that attaches time information for synchronizing the video data and the audio data to the AV storage unit, and stores the time information in the AV storage unit.
A digest having a data analysis unit for image analysis and / or audio analysis of the audio data stored in the AV storage unit, and a digest creation unit for extracting highlight scenes based on the results of the data analysis unit. A golf digest creation system equipped with a creation device. The 360 degree camera is a 4K or 8K video camera that shoots at high resolution.
The golf digest creation system according to claim 1, wherein the data analysis unit cuts out a region in a frame of the video data in which a specific subject is photographed and analyzes the image. Further equipped with a mobile terminal that notifies the mobile shooting unit of the occurrence of a highlight scene in response to an instruction from the player.
Upon receiving the notification, the moving shooting unit stores the time information of the highlight scene in the AV storage unit.
The golf digest creation system according to claim 2, wherein the digest creation device acquires the time information from the moving shooting unit and determines a highlight scene in consideration of the time information. The mobile photographing unit further has a GPS receiver and a course information storage unit that stores map information of the golf course, and reaches the tee ground of the start hole from the position information detected by the GPS receiver and the map information. When this is detected, recording of video data and audio data is started in the AV storage unit, the number of the hall where the video data is taken is recorded, and when it is detected that the current position is at the clubhouse position, 18 The golf digest creation system according to claim 1, wherein when the numbers of all the holes are recorded, the recording to the AV storage unit is stopped. The moving shooting unit has a camera with a zoom drive function and an electric pan head that can rotate 360 degrees in place of the 360 degree camera.
Moreover, the mobile terminal further has a GPS receiver,
When the mobile terminal notifies the mobile photographing unit of the current position information detected by the GPS receiver, the mobile photographing unit reaches the mobile terminal based on its own position information and the position information from the mobile terminal. The third aspect of claim 3 , wherein the distance and the direction are calculated, the electric platform is rotated in the direction of the mobile terminal, and the zoom magnification of the camera is changed according to the distance to the mobile terminal. Golf digest creation system. The control unit of the moving shooting unit further detects whether or not the moving shooting unit is currently moving based on the position information from the GPS receiver, and records the video data and the audio data during the movement. The golf digest creation system according to claim 4, wherein when the moving shooting unit is stopped, the video data and the audio data are recorded. The control unit of the moving shooting unit transmits the video data and the audio data with the time information stored in the AV storage unit to the digest creating device while the moving shooting unit is moving. The golf digest creation system according to claim 6, wherein the golf digest is created. The digest creation device has a digest creation AV storage unit that stores the video data and the audio data received from the mobile photographing unit.
When the digest creation device receives the digest creation request, the data analysis unit performs image analysis and / or audio analysis of the audio data stored in the digest creation AV storage unit, and the digest creation unit performs audio analysis. The golf digest creation system according to claim 7, wherein a highlight scene is extracted based on the result of the data analysis unit. A 360-degree camera installed at the top of the golf cart with a 360-degree field of view,
The sound collecting microphone installed in the golf cart and
An AV storage unit that stores video data from the 360-degree camera and audio data from the sound collecting microphone.
A control unit that attaches time information for synchronizing the video data and the audio data to the AV storage unit and stores the time information in the AV storage unit.
A moving shooting unit with. Receives and stores video data from a 360-degree camera installed at the top of the golf cart with time information for synchronization and a 360-degree view at the top of the golf cart and audio data from the sound collecting microphone installed in the golf cart. AV storage unit for creating digests
An image analysis unit that analyzes video data stored in the digest creation AV storage unit and / or a data analysis unit that performs audio analysis of audio data stored in the digest creation AV storage unit.
A digest creation device having a digest creation unit that extracts a highlight scene based on the result of the data analysis unit.

Images