JP4934094B2 - Sports video transmission device - Google Patents

Description

  The present invention relates to a sports video transmission device that transmits sports video shot by a plurality of broadcast cameras.

  Conventionally, production of a sports program has been performed by an operator switching a plurality of video systems and a plurality of audio systems with a switcher and operating a recording device as necessary. At this time, depending on the situation of the game, the situation of the sport such as the audience's excitement, etc., select a video that seems to be appropriate, and if the game is not in a situation that attracts the viewer's interest, It was done to insert the famous scene.

Here, as an invention in which switching work (switcher switching) is performed without human intervention, it is known to perform speaker determination and utterance content identification based on voice information and consider switching switching timing ( For example, see Patent Document 1).
JP-A-2005-295431

However, in the production of conventional sports programs, the operator performs switching work, which requires human costs and requires operators to be familiar with sports rules and production on broadcast programs.
Further, since the invention described in Patent Document 1 uses audio information, it is suitable for a program in which a person's utterance is directly linked to the production such as a dialogue program or an information program, but the positional relationship of the players affects the production. It was unsuitable for sports programs.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a sports video transmission device that enables switching work without human intervention and that can transmit sports video with high viewer interest.

  In order to solve the above-described problem, the sports video transmission device according to claim 1 is a sports video transmission device that uses sports video captured by a plurality of cameras, a situation determination camera, an interest degree calculation unit, and event detection. Means, recording control means, recording means, sending control means, and sending means.

  In such a configuration, the sports video transmission device captures, as a subject, a sports situation video including any one or more of sports players, equipment, spectators, or the environment of a stadium where sports are performed, using the situation determination camera. In other words, the situation determination camera, apart from the sports video taken by the broadcast camera, sports such as the movement and position of the players, the position of the courts and balls and other sports equipment, the gesture gestures of the spectators, the stadium weather, etc. Shoot the sports situation video including the situation.

  Further, the sports video transmission device calculates the image feature amount of the sports situation video by the interest level calculation means, and outputs this image feature amount as the interest level that the sports video gives to the viewer. Accordingly, the sports video transmission device can indicate whether or not the sports video captured by the camera is interested in the viewer.

  In addition, the sports video transmission device detects the positional relationship between the subjects included in the sports situation video by the event detection means, and when the positional relationship between the subjects matches the preset pattern, the event set in advance in the sport Event information indicating this event is generated. Thus, the sports video transmission device can detect an event that interests the viewer from the sports video taken by the camera.

  In addition, the sports video transmission device uses the video recording control unit to perform optimal shooting preset according to each event among a plurality of cameras based on event information and camera parameters including shooting angles for the plurality of cameras. A camera with a shooting angle closest to the angle is determined, and if the degree of interest is equal to or greater than a predetermined threshold, a recording control signal is generated that instructs recording of a sports video shot by the determined camera. The sports video transmission device records the sports video captured by the camera based on the recording control signal by the recording means. As a result, the sports video transmission device can record a scene of an event that is of interest to the viewer among sports videos taken by a plurality of cameras.

  In addition, the sports video transmission apparatus determines a camera having a shooting angle closest to the optimal shooting angle among a plurality of cameras based on the event information and the camera parameter by the transmission control unit, and the degree of interest is a predetermined threshold value. In the above case, the camera instructs to send a sports video, and if the degree of interest is less than a predetermined threshold, the recording means generates a transmission control signal that instructs the sports video recorded.

  Then, the sports video transmission device transmits the sports video captured by the camera or the sports video recorded by the recording unit based on the transmission control signal by the transmission unit. As a result, the sports video transmission device transmits an event scene that is of interest to the viewer, out of the sports video captured by the camera or the sports video recorded by the recording means.

  According to a second aspect of the present invention, there is provided the sports video transmission device according to the first aspect, further comprising a situation determination microphone to which a sports situation sound, which is a sound generated by the subject, is input. Outputs the magnitude of the sports situation sound as the degree of interest, and the event detection means detects whether the sound pattern preset according to the event is included in the sports situation sound, and the sound pattern is included in the sports situation sound In this case, it is determined that an event has occurred in the sport, and event information indicating the event is generated.

  In this configuration, the sports video transmission device determines an event scene in which the viewer is interested by using a sports situation sound such as a player's shout, an audience cheer, and a ball hitting sound in addition to the sports situation video.

  The sports video transmission device according to claim 3 is a sports video transmission device according to claim 1 or 2, wherein the sports video transmission device is configured to shoot a sports video for each of a plurality of cameras based on event information and camera parameters. The shooting instruction information generating means for calculating the shooting angle and generating shooting instruction information indicating the set shooting angle, and the shooting instruction information generated by the shooting instruction generating means are displayed, and the setting shooting angles are instructed to operators of a plurality of cameras. And a photographing instruction display means.

  In such a configuration, the sports video transmission device instructs the camera operator on the optimal setting shooting angle according to the event.

  The sports video transmission device according to claim 4 is the sports video transmission device according to claim 1 or 2, wherein the sports video transmission device is configured to shoot a sports video for each of a plurality of cameras based on event information and camera parameters. Shooting control information generating means for calculating a shooting angle and generating shooting control information indicating the set shooting angle; camera driving means for driving each of the plurality of cameras based on the shooting control information generated by the shooting control information generating means; Are further provided.

  In such a configuration, the sports video transmission device drives the camera to the optimum setting shooting angle according to the event.

  The sports video transmission device according to claim 5 is the sports video transmission device according to any one of claims 1 to 4, wherein the metadata includes a transmission control signal and a time when the output control signal is generated. And metadata recording means for recording next transmission candidate information in which the correspondence relationship between the camera and recording means that are currently sending sports video and the camera and recording means that can be sent next is preset, and transmission control. The means can determine the camera or recording means that is currently sending the sports video from the transmission control signal at the latest time included in the metadata, and can send it next to the determined camera or recording means based on the next sending candidate information A transmission control signal for instructing transmission of a sports video from a simple camera or recording means is generated.

  In this configuration, the sports video transmission device generates a transmission control signal based on the camera switching history that can be acquired from the metadata and the next transmission candidate information in which the optimal switching work is set.

  The sports video transmission device according to claim 6 is the sports video transmission device according to any one of claims 1 to 5, wherein the event detection means calculates an average luminance of the sports situation video, and calculates an average luminance. When is more than a predetermined threshold value, it is determined that an event has occurred in sports.

  In this configuration, the sports video transmission device can determine the sports weather as an event from the average luminance of the sports video.

The sports video transmission device according to the present invention has the following excellent effects.
According to the first aspect of the present invention, the sports video transmission device transmits a scene of an event that is of interest to the viewer, out of the sports video captured by the camera or the sports video recorded by the recording means. There are few scenes to be sent out, switching work is possible without human intervention, sports videos with high viewer interest can be sent out, and human costs can be reduced.

  According to the second aspect of the present invention, since the event scene that interests the viewer is determined using the sports situation sound in addition to the sports situation video, the proportion of the event scene included in the sports video is improved. And increase viewer interest.

  According to the third aspect of the invention, since the camera operator is instructed about the optimal setting shooting angle according to the event, it becomes easy for the operator to shoot a sports video with an effective presentation, and the viewer's interest is increased. Can be higher.

  According to the invention described in claim 4, since the camera is driven to the optimal setting shooting angle according to the event, it is possible to send a sports video with an effective production without human intervention, further reducing human costs. , Which can make viewers more interested.

According to the fifth aspect of the present invention, the transmission control signal is generated based on the camera switching history that can be acquired from the metadata and the next transmission candidate information in which the optimum switching work is set.
Therefore, it is possible to send a sports video that is effective in production without human intervention.

  According to the sixth aspect of the present invention, since the weather in sports can be determined as an event, the proportion of event scenes included in the sports video is improved, and the viewer's interest can be further increased.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate. In each embodiment, means having the same function and the same member are denoted by the same reference numerals, and description thereof is omitted.

(First embodiment)
[Configuration of sports program production device]
With reference to FIG. 1, the structure of the sports program production apparatus which concerns on 1st Embodiment of this invention is demonstrated. FIG. 1 is a block diagram of a sports program production device according to the first embodiment of the present invention. As shown in FIG. 1, a sports program production device (sports video transmission device) 1 includes three broadcast cameras (cameras) 2, a sensor camera (situation determination camera) 3, and a sensor microphone 4 (for situation determination). Microphone), interest level calculation means 5, event detection means 6, recording control means 7, transmission control means 8, recording / playback means (recording means) 9, recording switching means 10, and transmission switching means 11 ( Sending means) and metadata recording means 12. The sports program production device 1 corresponds to the sports video transmission device described in the claims.

  The broadcasting camera (camera) 2 is used to shoot sports videos such as soccer, baseball, volleyball, rugby, golf and the like. The broadcast camera 2 has an angle sensor that measures and outputs a shooting angle, and outputs camera parameters including the shooting angle. The broadcast camera 2 corresponds to the camera described in the claims.

  In FIG. 1, three broadcast cameras 2 are illustrated as being adjacent to each other. However, in order to shoot sports videos from various directions, the broadcast cameras 2 are generally arranged at different locations. is there. In FIG. 1, the number of broadcasting cameras 2 is three, but the number is not limited as long as it is two or more (not shown).

  Here, as the broadcast camera 2, for example, there is a camera for HDTV (High Definition TeleVision) or a camera for SDTV (Standard Definition TeleVision).

  The sensor camera (situation determination camera) 3 captures, as a subject, a sports situation video including any one or more of sports players, equipment, spectators, or a stadium environment where sports are performed. Here, the sensor camera 3 is, for example, an optical camera installed in order for the interest level calculation means 5 described later to calculate the interest level and for the event detection means 6 to detect the event. The sensor camera 3 corresponds to the situation determination camera described in the claims.

  The sensor camera 3 is fixed or movable, and the position, posture, lens, etc. of the sensor camera 3 are set so that each position in the screen of the image captured by the sensor camera 3 corresponds to a position in the real world. The parameters of the sensor camera 3 are calibrated. The parameter of the sensor camera 3 may include a focal length or an angle of view. The sensor camera 3 may shoot a multi-wavelength moving image such as a color image or a monochrome image. Furthermore, the sensor camera 3 may photograph a wavelength band in an invisible light region such as infrared rays or ultraviolet rays.

  In FIG. 1, the number of sensor cameras 3 is one, but may be two or more (not shown). Here, when two or more cameras are used as the sensor camera 3, the sensor camera 3 may be composed of only the same type of camera, or different types of cameras may be mixed. Furthermore, when two or more cameras are used as the sensor camera 3, a wide range of the real space may be photographed (mosaicing) by shifting the real space photographed by each camera, and each camera is spatially separated. Arrangement may be taken (stereo) for the location of real space determination.

  The sensor microphone (situation determination microphone) 4 is a sports situation sound which is a sound generated by a subject, which is installed in order to calculate an interest level and an event detection means 6 detects an event. Is the input microphone. Further, the number of sensor microphones 4 is not limited as long as it is one or more, and may be arranged in the vicinity of the sensor camera 3. Here, examples of the sensor microphone 4 include microphones such as a wireless microphone, a condenser microphone, and a built-in microphone built in the sensor camera 3. The sensor microphone 4 corresponds to the situation determination microphone described in the claims.

  The interest level calculation means 5 calculates the image feature quantity of the sports situation video imaged by the sensor camera 3, and outputs this image feature quantity as the interest level that the sports video gives to the viewer. This degree of interest is, for example, an index indicating whether or not the content of the sports video is interesting for the viewer.

  Here, the spectators in the stadium are excited, singing cheering, cheering, dancing, etc. in scoring scenes, foul scenes, scenes where players played wonderfully, scenes where players played interestingly, etc. There is a tendency to become active. Therefore, for example, the interest level calculation means 5 masks a region (for example, a court) where a player of a sports situation video is present, extracts only a region where a spectator is present, and calculates an image feature amount of the region where the spectator is present And

  Specifically, the interest level calculating means 5 averages the magnitude (for example, absolute value) of temporal changes (for example, inter-frame differences) of pixel values such as luminance values and chromaticity values for the area where the audience is present. Is calculated (hereinafter, the absolute value of the difference between frames is averaged). When the spectator's movement is intense, the absolute value average value of the difference between frames described above tends to increase. Therefore, the interest level calculation means 5 can use the absolute value average of the difference between frames as the interest level. . Note that the degree-of-interest calculation means 5 may calculate the image feature amount from the motion vector between the preceding and following frames and the difference between the preceding and following frames, and output this as the degree of interest.

  Further, the interest level calculation means 5 may output the magnitude of the sports situation sound input to the sensor microphone 4 as the interest level. As described above, in the scoring scene, the foul scene, the scene where the player played wonderfully, the scene where the player played interestingly, etc., the audience sings a cheer song or cheers, making it noisy. Therefore, the interest level calculation means 5 may output a value proportional to the magnitude (sound pressure) of the sports situation sound input to the sensor microphone 4 as the interest level.

  The event detection means 6 detects the positional relationship between the subjects included in the sports situation video imaged by the sensor camera 3, and if the positional relationship between the subjects matches a preset pattern, an event set in advance for the sport is detected. It is determined that the event has occurred, and event information indicating the event is generated. Specifically, the event detection means 6 cuts out the area of each player (subject), and outputs event information corresponding to the pattern when the arrangement of each player matches a preset pattern (formation). .

  For example, the event detection means 6 detects the color area and center line of the uniforms of two teams from the sports situation video in soccer, and sets them as players of each team. And the event detection means 6 has a player who wears the uniform of one team intensively on one side of the court and the player who wears the uniform of the other team is on the other side of the court. When concentrated on one side, “kick-off” is output as event information. Similarly, the event detection means 6 outputs “corner kick” and “throw-in” as event information by determining the presence or absence of a player near a corner arc or a touch line in soccer. Further, as the event detection means 6, the invention described in Japanese Patent Application Laid-Open No. 2006-285878 may be used.

  The event detection means 6 detects whether a sound pattern preset according to the event is included in the sports situation sound input to the sensor microphone 4, and if the sound pattern is included in the sports situation sound, the event is detected. It is determined that the event occurred in sports, and event information corresponding to the event is generated. For example, in the case of a golf program, several shot sounds are registered in advance as sound patterns, and the event detection means 6 determines whether or not the sports situation sound input to the sensor microphone 4 corresponds to the shot sound. To do. When the sports situation sound corresponds to a shot sound, the event detection means 6 outputs “shot” as event information. Thus, even when a spectator, such as golf, appreciates a sport quietly, the event detection means 6 can output event information.

  Further, the event detection means 6 calculates the average luminance of the sports situation video imaged by the sensor camera 3, and determines that an event has occurred in the sport when the average luminance is equal to or greater than a predetermined threshold. For example, the event detection means 6 outputs “sunny” as event information when the average luminance is greater than or equal to a threshold value, and outputs “other than sunny” as event information when the average luminance is less than the threshold value.

  Further, the event detection means 6 may output “rain” and “other than rain” as event information instead of outputting “other than sunny”. For example, a second threshold value indicating “rain” is further set below the threshold value (first threshold value) indicating the event “sunny”. When the average brightness is less than the first threshold and greater than or equal to the second threshold, the event detection means 6 outputs “other than rain” as event information, and when less than the second threshold, outputs “rain” as event information. To do. Note that the first threshold and the second threshold can be arbitrarily set.

  Based on the event information generated by the event detection unit 6 and the camera parameters including the shooting angles for each of the plurality of broadcast cameras 2, the recording control unit 7 responds to each event among the plurality of broadcast cameras 2. The broadcast camera 2 having the shooting angle closest to the preset optimum shooting angle is determined, and when the interest level calculated by the interest level calculation means 5 is equal to or greater than a predetermined threshold, the sports video imaged by the broadcast camera 2 is captured. A recording control signal for instructing recording is generated. Details of the recording control means 7 will be described later.

  Here, the recording control signal includes, for example, instructions for reproduction, recording, stop, fast forward, rewind and cueing to the recording / reproducing means 9. Further, the recording control signal includes an instruction for the recording switching means 10 to record which of the sports videos taken by the plurality of broadcast cameras 2.

  Based on the event information generated by the event detection unit 6 and the camera parameters, the sending control unit 8 determines the broadcasting camera 2 having the shooting angle closest to the optimum shooting angle among the plurality of broadcasting cameras 2, When the interest level calculated by the interest level calculation means 5 is greater than or equal to a predetermined threshold value, the broadcast camera 2 is instructed to send a sports video. When the interest level is less than the predetermined threshold value, the recording / playback means 9 A transmission control signal for instructing transmission of a recorded sports video is generated. Details of the sending control means 8 will be described later.

  The recording / reproducing means 9 records the sports video from the recording switching means 10 based on the recording control signal generated by the recording control means 7. Further, the recording / reproducing means 9 may reproduce the recorded sports video. Examples of the recording / reproducing means 9 include a video tape recorder and a video disk recorder. The recording / reproducing means 9 may record the video signal in the individual memory and reproduce it.

  The recording switching means 10 switches the plurality of broadcasting cameras 2 to record and reproduce the sports video indicated by the recording control signal generated by the recording control means 7 among the sports videos input from the plurality of broadcasting cameras 2. Is output. The recording switching unit 10 may be a matrix switcher integrated with a transmission switching unit 11 described later (not shown).

  The transmission switching means (transmission means) 11 is for transmitting a sports video taken by the broadcast camera 2 or a sports video recorded by the recording / reproducing means 9 based on the transmission control signal generated by the transmission control means 8. is there. The transmission switching unit 11 corresponds to the transmission unit described in the claims.

  The metadata recording unit 12 includes an interest level calculated by the interest level calculation unit 5, event information generated by the event detection unit 6, a recording control signal generated by the recording control unit 7, a transmission control signal generated by the transmission control unit 8, And metadata including any one or more of the shooting angles of the broadcast camera 2 is recorded.

  Further, the metadata recording unit 12 may record metadata including the shooting time of the sports video. At this time, the metadata recording unit 12 reads the metadata at the time requested by the transmission control unit 8 and outputs it to the transmission control unit 8. Further, the metadata recording unit 12 includes a table in which the optimum shooting angle in the event is set in advance, a table indicating the relationship between the time and sun direction, which will be described later, next switching candidate information to be described later, and the positional relationship between subjects. A pattern indicating the above may be recorded in advance.

  Hereinafter, metadata recorded by the metadata recording unit will be described with reference to FIG. 2 (see FIG. 1 as appropriate). FIG. 2 is a diagram showing a data structure of metadata recorded by the metadata recording means of FIG.

  As shown in FIG. 2, the metadata has one or more lines of records having three items of “time”, “type”, and “value”. Here, “time” indicates the time when the recording control signal, interest level, event information, or transmission control signal stored in the record is generated. “Type” indicates the type of information or signal stored in the record. For example, if “type” is control, it indicates a recording control signal, if “type” is an interest level, it indicates an interest level, if “type” is an event, indicates event information, and “type” can be switched. Indicates a transmission control signal. That is, the metadata is history information indicating a history such as a transmission control signal.

  The “value” indicates a value or content corresponding to the type of information or signal stored in the record. For example, if the “type” is control, the “value” indicates the content of the recording control signal, for example, playback, recording, stop, fast forward, or rewind. For example, if “type” is an interest level, “value” indicates a value of interest level (eg, 75.2), and if “type” is an event, “value” indicates the event information. If the “type” indicates the content (for example, kick-off) and the “type” is switching, the “value” indicates the content of the transmission control signal, for example, the identifier of the camera that is shooting the sports video to be transmitted (for example, the camera 3). Show. Note that the metadata is not limited to that shown in FIG. 3. For example, the metadata is in XML format, and each of the three items “time”, “type”, and “value” is enclosed by a unique tag. Also good.

<Details of recording control means: determination example of broadcast camera used for recording>
Hereinafter, returning to FIG. 1, the details of the recording control means will be described.
The recording control unit 7 determines the broadcasting camera 2 used for recording and controls the recording / reproducing unit 9. First, the determination of the broadcast camera 2 used for recording will be described.

  First, when event information is input from the event detection unit 6, the recording control unit 7 acquires camera parameters including a shooting angle measured by the angle sensor of the broadcast camera 2. And according to the event which event information shows, the video recording control means 7 acquires the optimal imaging | photography angle in the event. Subsequently, the recording control means 7 compares the optimum shooting angle with the shooting angle of each broadcasting camera 2 to determine the broadcasting camera 2 with the two shooting angles closest to each other. A recording control signal for instructing recording of a sports video to be generated is generated.

  For example, in soccer, when event information “corner kick at the left back corner” is input, the recording control means 7 is for broadcasting at a shooting angle closest to the optimum shooting angle including the vicinity of the left goal area from the left back corner. The camera 2 is determined, and a recording control signal for instructing recording of a sports video taken by the broadcasting camera 2 is generated.

  On the other hand, when the event information “kick-off” is input, the recording control means 7 determines the broadcasting camera 2 with the shooting angle closest to the optimum shooting angle including the vicinity of the center circle, and the broadcasting camera 2 takes a picture. A recording control signal for instructing recording of a sports video is generated.

  Also, for example, when event information “sunny” is input, the recording control means 7 determines an optimum shooting angle other than the direction of the sun and determines the broadcasting camera 2 with the shooting angle closest to the optimum shooting angle. A recording control signal for instructing recording of a sports video photographed by the broadcast camera 2 is generated. In this case, a table showing the relationship between the time and the direction of the sun (for example, facing east from 6 am to 10 am, facing south from 10 am to 3 pm, and from 3 pm to 6 pm From the west direction, the recording control means 7 can determine the direction of the sun at the recording time. Thereby, the recording control means 7 can prevent backlighting in the recorded sports video. When event information “other than clear” is input, the recording control means 7 may generate a recording control signal that instructs recording of a sports video taken by the broadcasting camera 2 facing the sun.

  Further, for example, when the event information changes from “other than rain” to “rain”, the recording control means 7 selects the broadcasting camera 2 with the shooting angle closest to the optimum shooting angle including the sky (facing upward). The recording control signal for instructing the recording of the sports video taken by the broadcasting camera 2 is generated. As a result, the recording control means 7 can record a sports video that produces rain.

  The recording control unit 7 generates a recording control signal based on the event information input from the event detection unit 6, the shooting angle of the broadcast camera 2, and the transmission control signal input from the transmission control unit 8. May be. In this case, the recording control means 7 acquires the optimum shooting angle for the event from the event information. Subsequently, the recording control unit 7 determines all the broadcasting cameras 2 that are not used for transmission from the transmission control signal input from the transmission control unit 8. Finally, the recording control means 7 compares the optimum shooting angle with the shooting angle of the broadcasting camera 2 that is not used for transmission, determines the broadcasting camera 2 that has the closest shooting angles, and determines the broadcasting camera 2. A recording control signal for instructing recording of a sports video taken by the camera 2 is generated.

<Details of Recording Control Unit: First Example of Control of Recording / Reproducing Unit>
Next, a first example of control of the recording / playback means will be described. Specifically, the recording control means 7 generates a recording control signal according to the degree of interest, and instructs the recording / reproducing means 9 described later to record, reproduce, fast forward, rewind or stop.

For example, when the degree of interest is greater than or equal to a threshold T _A (for example, the sound pressure of the sports situation sound is 120 dB), the recording control unit 7 generates a recording control signal that instructs the recording / reproducing unit 9 to perform recording.
Further, for example, the recording control unit 7, degree of interest, the threshold value T threshold after a higher _A T _{B (e.g.,} the sound pressure of the sports situations sound is 110dB) hereinafter become or threshold T _A more remains fixed time When the time elapses, a recording control signal for instructing the recording / reproducing means 9 to rewind, or a recording control signal for instructing the cueing of the head of the video at the previous recording time is generated.
For example, the recording control unit 7 instructs the recording / reproducing unit 9 to perform reproduction when the rewinding is completed and the interest level is equal to or less than a predetermined threshold T _C (for example, the sound pressure of the sports situation sound is 100 dB). A recording control signal is generated. Note that the thresholds T _A , T _B , and T _C satisfy Expression (1).

Formula (1) T _A ≧ T _B ≧ T _C

  At this time, the recording control means 7 does not generate the recording control signal for a certain period of time after generating the recording control signal for setting the recording / reproducing means 9 in the recording state, and the recording / reproducing means 9 Is preferably prevented from being repeated in a short time. This fixed time may be a fixed value of 5 seconds, or may be variable within a range of 1 second to 60 seconds by an operation from an input means such as a jog dial.

<Details of Recording Control Unit: Second Example of Control of Recording / Reproducing Unit>
Next, a second example of the control of the recording / reproducing means will be described. In this second example, the recording control means 7 generates a recording control signal in cooperation with the transmission control means 8.

For example, the recording control unit 7, interest threshold T _A above, and, if the transmission control signal input from the transmission control unit 8 does not select a recorded sports video to recording and reproducing means 9, the recording and playback A recording control signal that instructs the means 9 to record is generated.
Further, for example, the recording control unit 7, degree of interest, when elapsed a predetermined time threshold T _B hereinafter become or threshold T _A more remains after becoming equal to or larger than the threshold value T _A, rewind the recording reproducing unit 9 Or a recording control signal for instructing cueing of the beginning of the video at the time of the previous recording.
For example, the image control means 7 selects the sports video recorded in the recording / reproducing means 9 based on the transmission control signal input from the transmission control means 8 after the rewinding is finished, and the interest level is the threshold value Tc. In the following cases, a recording control signal for instructing the recording / reproducing means 9 to generate is generated.

  Here, the recording control unit 7 may output to the transmission control unit 8 a transmission control signal instructing to select a sports video recorded in the recording / reproducing unit 9 after a predetermined waiting time. For example, when using a video tape recorder as the recording / reproducing means 9, the recording control means 7 can set the pre-roll time as a waiting time. Furthermore, when the recording / reproducing means 9 reproduces the video recorded on the magnetic disk or the optical disk, the recording control means 7 may use the sum of the seek time of the disk and the time required for decoding as the waiting time. By using such a transmission control signal, it is possible to avoid the influence of a delay that may occur after a command to the recording / reproducing means 9 and prevent an unstable video signal immediately after the start of reproduction from being transmitted.

  The recording control unit 7 may change the operation based on the transmission control signal input from the transmission control unit 8. For example, when a broadcast camera 2 having a transmission control signal is indicated, the recording control means 7 generates a recording control signal indicating a broadcast camera 2 other than the broadcast camera 2 indicated by the transmission control signal. As a result, the sports program production device 1 can transmit the sports video of the broadcasting camera 2 that has not yet been broadcast as a replay video. Further, the recording control means 7 may generate a recording control signal indicating the same broadcast camera 2 as the broadcast camera 2 indicated by the transmission control signal. In this case, the sports program production device 1 can send a replay video in a format that repeats a sports video that has already been broadcast.

<Details of sending control means>
Details of the sending control means 8 will be described.
Specifically, when event information is input from the event detection unit 6, the transmission control unit 8 acquires camera parameters including a shooting angle measured by the angle sensor of the broadcast camera 2. Then, the transmission control means 8 acquires the optimum shooting angle for the event according to the event indicated by the event information. Subsequently, the transmission control means 8 compares the optimum shooting angle with the shooting angle of each broadcast camera 2 to determine the broadcast camera 2 with the two shooting angles closest to each other. A transmission control signal for instructing transmission of a sports video to be generated is generated.

  For example, in soccer, when event information “corner kick at the left back corner” is input, the sending control means 8 is for broadcasting at a shooting angle closest to the optimal shooting angle including the vicinity of the left goal area from the left back corner. The camera 2 is determined, and a transmission control signal for instructing transmission of a sports video photographed by the broadcast camera 2 is generated.

  On the other hand, when the event information “kick-off” is input, the transmission control means 8 determines the broadcasting camera 2 having the shooting angle closest to the optimum shooting angle including the vicinity of the center circle, and the broadcasting camera 2 takes a picture. A transmission control signal for instructing transmission of a sports video is generated.

  Further, for example, when event information “sunny” is input, the transmission control means 8 determines the broadcasting camera 2 having the shooting angle closest to the optimum shooting angle, with the shooting direction other than the sun as the optimum shooting angle, A transmission control signal for instructing transmission of a sports video photographed by the broadcast camera 2 is generated. In this case, the sending control means 8 can determine the sun direction at the sending time from the table showing the relationship between the time and the sun direction. Thereby, the transmission control means 8 can prevent backlighting in the sports video to be transmitted. When event information “other than clear” is input, the transmission control means 8 may generate a transmission control signal that instructs transmission of a sports video imaged by the broadcast camera 2 facing the sun.

  Further, for example, when the event information changes from “other than rain” to “rain”, the transmission control means 8 selects the broadcasting camera 2 with the shooting angle closest to the optimum shooting angle including the sky (pointed upward). A transmission control signal for instructing transmission of a sports video photographed by the broadcast camera 2 is generated. As a result, the transmission control means 8 can transmit a sports video that produces rain.

  At this time, when the interest level is lower than the threshold value and the recording control signal is not in the recording state, the transmission control unit 8 determines that the sports video of the recording / reproducing unit 9 is transmitted instead of the broadcast camera 2. good. Thereby, the sports program production device 1 can prevent replay of past recorded video by sending a replay of the past recorded video when the current game development is boring and the recording / reproducing means 9 is not recording, Increased viewer interest.

  Further, the transmission control unit 8 may output to the metadata recording unit 12 either one of the time and type of the metadata to be read or both the time and the type. At this time, if there is metadata of the designated type and close to the designated time, the metadata recording unit 12 reads this and outputs it to the transmission control unit 8. For example, the transmission control means 8 requests the metadata recording means 12 for metadata of a transmission control signal for a fixed time (for example, 5 minutes) from the current time, and acquires this metadata. Then, the transmission control unit 8 determines the broadcast camera 2 or the recording / reproducing unit 9 that is currently transmitting the sports video from the transmission control signal at the latest time included in the acquired metadata. Further, the transmission control means 8 instructs the transmission of the sports video of the broadcast camera 2 or the recording / reproducing means 9 that can be transmitted next to the determined broadcasting camera 2 or the recording / reproducing means 9 based on the next switching candidate information. A transmission control signal is generated.

  Hereinafter, the next switching candidate information in the present invention will be described with reference to FIG. 3 (see FIG. 1 as appropriate). FIG. 3 is a diagram showing a data structure of next switching candidate information in the present invention. The next switching candidate information corresponds to the next transmission candidate information described in the claims.

  As shown in FIG. 3, the next switching candidate information indicates the correspondence relationship between the broadcasting camera 2 and the recording / reproducing means 9 that are currently sending sports videos, and the broadcasting camera 2 and the recording / reproducing means 9 that can be sent next. It is set in advance. Here, the next switching candidate information has two items of “current switching state” and “next switching state”. In FIG. 3, the first broadcast camera 2 is the camera 1, the second broadcast camera 2 is the camera 2, the third broadcast camera 2 is the camera 3, and the recording / reproducing means 9 is recorded. Reproduction means.

  The “current switching state” indicates the broadcast camera 2 or the recording / playback unit 9 that the transmission switching unit 11 is currently transmitting. For example, the first line record from the top of the next switching candidate information indicates that the transmission switching unit 11 is transmitting the sports video of the first broadcasting camera 2 (camera 1). The “next switching state” indicates other broadcasting cameras 2 and recording / reproducing means 9 that can be sent out next. For example, if the first row record from the top of the next switching candidate information is currently sending the sports video of the first broadcast camera 2, the first to third broadcast cameras 2 (camera 1 to camera 3). ) And the recording / reproducing means 9 (recording / reproducing means) indicate that transmission is possible next.

  Taking the metadata in FIG. 2 as an example, the transmission control means 8 acquires the transmission control information at the latest time, that is, a record of “type” switching from this metadata. Here, the transmission control means 8 refers to a record in which “type” is switching and “time” is 19: 02: 09: 15, and sports video of the third broadcast camera 2 (camera 3). Is currently transmitted. Then, the transmission control means 8 refers to the record in which the “current switching state” is the third broadcasting camera 2 (camera 3) in the next switching candidate information in FIG. When input, the first broadcast camera 2 (camera 1) defined in the “next switching state”, the second broadcast camera 2 (camera 2), or the recording / reproducing means 9 (recording / reproducing means) ) To generate a transmission control signal instructing transmission of the sports video.

[Operation of sports program production equipment]
Hereinafter, the operation of the sports program production device according to the first embodiment of the present invention will be described with reference to FIG. 4 (see FIG. 1 as appropriate). FIG. 4 is a flowchart showing the operation of the sports program production device of FIG. In FIG. 4, it is assumed that the broadcast camera 2 and the sensor camera are performing sports photography.

  First, the sports program production device 1 calculates the image feature quantity of the sports situation video imaged by the sensor camera 3 by the interest level calculation means 5 and outputs this image feature quantity as the interest level that the sports video gives to the viewer. (Step S1). In addition, the sports program production device 1 detects the positional relationship between subjects included in the sports situation video by the event detection means 6, and when the positional relationship between the subjects matches a preset pattern, it is set in advance for sports. It is determined that an event has occurred, and event information indicating this event is generated (step S2).

  Subsequent to step S <b> 2, the sports program production device 1 uses the recording control unit 7 based on event information generated by the event detection unit 6 and camera parameters including shooting angles for each of the plurality of broadcast cameras 2. Among the broadcasting cameras 2, the broadcasting camera 2 having the shooting angle closest to the optimum shooting angle set in advance according to each event is determined, and the interest level calculated by the interest level calculation means 5 is equal to or greater than a predetermined threshold value. In this case, a recording control signal for instructing recording of sports video taken by the broadcast camera 2 is generated (step S3).

  Subsequent to step S3, the sports program production device 1 records and reproduces any of the plurality of sports videos input from the broadcast camera 2 based on the recording control signal generated by the recording control unit 7 by the recording switching unit 10. The output is switched to the means 9 (step S4). Further, the sports program production device 1 records the sports video output from the recording switching means 10 by the recording / reproducing means 9 based on the recording control signal generated by the recording control means 7 (step S5).

  Subsequent to step S5, the sports program production device 1 sets the optimum shooting angle among the plurality of broadcast cameras 2 based on the event information generated by the event detection unit 6 and the camera parameters by the transmission control unit 8. The broadcast camera 2 with the closest shooting angle is determined, and when the interest level calculated by the interest level calculation means 5 is equal to or greater than a predetermined threshold, the broadcast camera 2 is instructed to transmit a sports video, and the interest level Is less than the predetermined threshold value, the recording / reproducing means 9 generates a transmission control signal for instructing transmission of the recorded sports video (step S6).

  Subsequent to step S6, the sports program production device 1 uses the transmission switching unit 11 to record the sports video or the recording / reproducing unit 9 captured by the broadcast camera 2 based on the transmission control signal generated by the transmission control unit 8. The recorded sports video is sent out (step S7). As a result, the sports program production device 1 can perform a switching work without depending on human hands, and can transmit a sports video with high viewer interest.

(Second Embodiment)
[Configuration of sports program production device]
With reference to FIG. 5, the structure of the sports program production apparatus which concerns on 2nd Embodiment of this invention is demonstrated. FIG. 5 is a block diagram of a sports program production device according to the second embodiment of the present invention. As shown in FIG. 5, the sports program production device 1B includes three broadcast cameras (cameras) 2, a sensor camera (situation determination camera) 3, an interest level calculation means 5, an event detection means 6, Recording control means 7, sending control means 8, recording / playback means (recording means) 9, recording switching means 10, sending switching means (sending means) 11, metadata recording means 12, and photographing instruction information generating means 13 and photographing instruction display means 14.

  The shooting instruction information generation unit 13 calculates a set shooting angle for each of the plurality of broadcast cameras 2 based on the event information generated by the event detection unit 6 and the camera parameters, and sets shooting instruction information indicating the set shooting angle. Is to be generated. In this case, the broadcast camera 2 is a manned camera photographed by an operator (cameraman).

  For example, the shooting instruction information generation unit 13 acquires the optimum shooting angle described above. Subsequently, the shooting instruction information generation unit 13 compares the camera parameter value of each broadcast camera 2 with the optimum shooting angle, and determines the broadcast camera 2 having the smallest difference. For example, the shooting instruction information generation unit 13 obtains an angle between the optical axis direction of each broadcast camera 2 and the optical axis direction of the optimum shooting angle from the difference in pan angle and the difference in tilt angle, and the angle formed by the angle It is determined which broadcast camera 2 is the smallest.

  Next, the shooting instruction information generation means 13 calculates the difference in pan angle, tilt angle, and focal length between the optimum shooting angle and the shadow angle measured by the angle sensor of the broadcast camera 2 with a sign, and takes the shooting instruction. Generate information. Here, the pan angle difference is Δθ, the tilt angle difference is Δφ, and the focal length difference is Δf. Here, by setting (rule-based) the optimum shooting angle and camera work in advance, the shooting instruction information generating unit 13 can determine the optimum pan angle, tilt angle, and focal length of each broadcast camera 2, and If necessary, the optimum speed of pan, tilt and zoom operations can be obtained.

  Note that the shooting instruction information generation unit 13 may consider the interest level from the interest level calculation unit 5 in addition to the event information from the event detection unit 6. In this case, for example, when the interest level is equal to or less than a predetermined threshold, the imaging instruction information generation unit 13 does not need to instruct display of the imaging instruction information.

  The shooting instruction display means 14 displays the shooting instruction information generated by the shooting instruction generation means 13 and instructs the operator of the plurality of broadcast cameras 2 about the set shooting angle. As the photographing instruction display means 14, for example, an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube), a PDP (Plasma Display Panel), an LED (Light Emission Diode) display, an EL (Electro Luminescence) display, or the like can be used. Furthermore, the imaging instruction display means 14 can give instructions by voice or vibration instead of instructions by visual display, and may give instructions combining these.

  For example, when a plurality of broadcasting cameras 2 are a single display device (not shown), the shooting instruction display means 14 clearly indicates which broadcasting camera 2 is the setting shooting. Display the angle. In this case, the imaging instruction display unit 14 performs display such as “camera 3, left pan 10 degrees, tilt up 5 degrees, zoom in”. On the other hand, when the shooting instruction display unit 14 is a display device for each broadcast camera 2, the shooting instruction display unit 14 displays a set shooting angle for each broadcast camera 2. In this case, the imaging instruction display unit 14 displays, for example, “right pan 20 degrees, tilt down 10 degrees, zoom out”.

  As a result, the sports program production device 1B instructs the camera operator on the optimal setting shooting angle in accordance with the event, which makes it easier for the operator to shoot a sports video with an effective presentation, and makes viewers more interested. Can be high.

(Third embodiment)
[Configuration of sports program production device]
With reference to FIG. 6, the structure of the sports program production apparatus which concerns on 3rd Embodiment of this invention is demonstrated. FIG. 6 is a block diagram of a sports program production device according to the third embodiment of the present invention.

  As shown in FIG. 6, the sports program production device 1 </ b> C includes three broadcast cameras (cameras) 2, a sensor camera (situation determination camera) 3, an interest level calculation means 5, an event detection means 6, Recording control means 7, transmission control means 8, recording / playback means (recording means) 9, recording switching means 10, transmission switching means (sending means) 11, metadata recording means 12, and photographing control information generating means 15.

  The broadcast camera 2 is mounted on the camera platform, and the shooting angle can be freely changed, and the camera driving means 2a is incorporated. The camera driving unit 2a drives the plurality of broadcast cameras 2 based on shooting control information generated by the shooting control information generating unit 15 to be described later. For example, the camera driving means 2a is an actuator for driving one or more of a pan angle, a tilt angle, a focal length (zoom), and a focal position (focus) for each broadcast camera 2.

  In this case, the camera driving means 2a can be an arbitrary rotary actuator or linear actuator, for example. Further, as the camera driving means 2a, for example, any electrically movable actuator such as an induction motor, a DC motor, a synchronous motor, a stepping motor, an ultrasonic motor, and a solenoid can be used. In addition, the camera drive means 2a is provided with a sensor for measuring the rotation angle and displacement amount attached to the actuator, and the position and speed information are fed back, thereby enabling accurate positioning of the rotation angle and displacement amount. You may comprise as follows. In addition, although the control method of the camera drive means 2a is arbitrary, for example, PID (proportional, integral, differential) control can be used.

  The shooting control information generation unit 15 calculates event information generated by the event detection unit 6 and a set shooting angle for each of the plurality of broadcast cameras 2, and generates shooting control information indicating the set shooting angle.

  For example, the shooting control information generation unit 15 acquires the optimum shooting angle described above. Subsequently, the shooting control information generation unit 15 compares the camera parameter value from each broadcast camera 2 with the optimum shooting angle, and determines the broadcast camera 2 with the smallest difference. For example, the shooting control information generation unit 15 obtains an angle between the optical axis direction of each broadcast camera 2 and the optical axis direction of the optimum shooting angle from the difference in pan angle and the difference in tilt angle, and the angle formed by the angle. It is determined which broadcast camera 2 is the smallest.

  Next, the shooting control information generating means 15 calculates the difference in pan angle, tilt angle, and focal length between the optimal setting shooting angle and the shooting angle measured by the angle sensor of the broadcast camera 2 with a sign, Shooting control information is generated. Here, the pan angle difference is Δθ, the tilt angle difference is Δφ, and the focal length difference is Δf. Then, the shooting control information generation unit 15 generates shooting control information in which these differences are all 0 for the camera driving unit 2a. Here, by setting the optimal shooting angle and camera work in advance for each event (rule base), the optimum values of the pan angle, tilt angle, and focal length of each broadcast camera 2 as well as necessary Accordingly, the optimum speeds of pan, tilt and zoom operations can be obtained.

  Note that the imaging control information generation unit 15 may consider the interest level from the interest level calculation unit 5 in addition to the event information from the event detection unit 6. In this case, the imaging control information generation unit 15 may generate imaging control information that instructs the camera driving unit 2a to stop when the degree of interest is equal to or less than the threshold value.

  As a result, the sports program production device 1C drives the camera to the optimal setting shooting angle according to the event, so that it is possible to send a sports video with an effective production without human intervention, further reducing human costs, Increase viewer interest.

1 is a block diagram of a sports program production device according to a first embodiment of the present invention. It is a figure which shows the data structure of the metadata which the metadata recording means of FIG. 1 records. It is a figure which shows the data structure of the next switching candidate information in this invention. It is a flowchart which shows operation | movement of the sports program production apparatus of FIG. It is a block diagram of the sports program production apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram of the sports program production apparatus which concerns on 3rd Embodiment of this invention.

Explanation of symbols

1 Sports program production device (sports video transmission device)
1B Sports program production device (sports video transmission device)
1C Sports program production device (sports video transmission device)
2 Broadcasting camera (camera)
2a Camera drive means 3 Sensor camera (camera for situation determination)
4 Sensor microphone (situation determination microphone)
5 Interest level calculating means 6 Event detecting means 7 Recording control means 8 Sending control means 9 Recording / reproducing means (recording means)
10 recording switching means 11 sending switching means (sending means)
12 metadata recording means 13 photographing instruction information generating means 14 photographing instruction display means 15 photographing control information generating means

Claims (6)

In a sports video transmission device that uses sports video taken by multiple cameras,
A situation determination camera for shooting a sports situation video including any one or more of sports players, equipment or spectators or the environment of a stadium where the sports are performed as a subject;
An interest level calculating means for calculating an image feature amount of the sports situation video and outputting the image feature amount as an interest level given to a viewer by the sports video;
When the positional relationship between the subjects included in the sports situation video is detected and the positional relationship between the subjects matches a preset pattern, it is determined that a preset event has occurred in the sports, Event detection means for generating event information indicating an event;
Based on the event information and camera parameters including shooting angles for each of the plurality of cameras, among the plurality of cameras, the shooting angle closest to the optimal shooting angle set in advance for each event is set. A video recording control means for determining a camera and generating a video recording control signal for instructing video recording of sports video captured by the camera when the degree of interest is equal to or greater than a predetermined threshold;
Recording means for recording the sports video based on the recording control signal;
Based on the event information and the camera parameter, the camera having the shooting angle closest to the optimum shooting angle is determined from the plurality of cameras, and when the degree of interest is equal to or greater than a predetermined threshold, the camera Instructing transmission of sports video to be photographed, and when the degree of interest is less than a predetermined threshold value, transmission control means for generating a transmission control signal instructing transmission of sports video recorded by the recording means;
Based on the transmission control signal, a transmission unit that transmits a sports image captured by the camera or a sports image recorded by the recording unit;
A sports video transmission device comprising: It further comprises a situation determination microphone to which a sports situation sound that is a sound generated by the subject is input,
The degree-of-interest calculation means outputs the level of the sports situation sound as the degree of interest,
The event detection means detects whether a sound pattern preset according to the event is included in the sports situation sound, and when the sound pattern is included in the sports situation sound, the event has occurred in the sport The sports video transmission device according to claim 1, wherein the event information indicating the event is generated. Shooting instruction information generating means for calculating a set shooting angle for shooting the sports video for each of the plurality of cameras based on the event information and the camera parameter, and generating shooting instruction information indicating the set shooting angle; ,
Shooting instruction display means for displaying shooting instruction information generated by the shooting instruction generation means and instructing the set shooting angle to an operator of the plurality of cameras;
The sports video transmission device according to claim 1, further comprising: Shooting control information generating means for calculating a set shooting angle for shooting the sports video for each of the plurality of cameras based on the event information and the camera parameter, and generating shooting control information indicating the set shooting angle; ,
Camera driving means for driving each of the plurality of cameras based on the shooting control information generated by the shooting control information generating means;
The sports video transmission device according to claim 1, further comprising: Metadata including the transmission control signal and the time when the transmission control signal was generated, and the camera and the recording unit that are currently transmitting the sports video, and the camera and the recording unit that can be transmitted next Further comprising metadata recording means for recording the next transmission candidate information in which the correspondence is set in advance,
The transmission control unit determines the camera or the recording unit that is currently transmitting the sports video from the transmission control signal at the latest time included in the metadata, and determines based on the next transmission candidate information 5. The transmission control signal for instructing transmission of a sports video of the camera or the recording unit that can be transmitted next to the camera or the recording unit is generated. The sports video transmission device described in 1.   The said event detection means calculates the average brightness | luminance of the said sports condition image | video, and when the said average brightness | luminance is more than a predetermined threshold value, it determines with the said event having generate | occur | produced in the said sport. The sports video transmission device according to claim 5.

Images