JP2020170980A - Video information output device, video information output system, video information output program, and video information output method - Google Patents

Abstract

To output video information that can be used to generate a digest video.SOLUTION: A receiving unit receives audio data from built-in microphones 13A and 13B and a reference microphone 12, a cheering time specifying unit identifies a time when the sound pressure of the audio data of the reference microphone exceeds 15 dB (cheering start time), and a filtering unit identifies three seconds before the cheering start time. In addition, the filtering unit extracts the frequency component of the footsteps from the audio data received from the built-in microphones 13A and 13B in the specified three seconds, and a camera selection unit selects one of the built-in microphones on the basis of the extracted frequency component while selecting a video camera that captures a range corresponding to the installation position of the selected built-in microphone. Then, an output unit outputs digest information including information on the selected video camera to an editing unit.SELECTED DRAWING: Figure 10

Description

The present invention relates to a video information output device, a video information output system, a video information output program, and a video information output method.

Conventionally, various techniques for editing moving image data and generating a digest have been proposed. For example, there is known a method of extracting image data for a predetermined time from moving image data for a predetermined time, extracting a portion of the image data having a large movement, and generating a digest. Further, there is also known a technique of dividing moving image data into a plurality of scenes, evaluating each scene, and selecting and editing a scene based on the evaluation result (see, for example, Patent Document 1 and the like). Further, as a technique for selecting and reproducing a digest scene from an audio / video signal, there is known a technique for using an audio / video signal within a predetermined time including an excitement time when a power value of the audio signal satisfies a predetermined condition as a digest scene ( For example, refer to Patent Document 2 and the like).

Further, in a video surveillance system having a plurality of surveillance cameras and a plurality of microphones, there is known a technique of recording video information of a surveillance camera corresponding to the microphones when the microphones detect an abnormal sound or the like (for example,). See Patent Document 3 etc.).

JP-A-2002-142189 JP-A-2007-267351 Japanese Unexamined Patent Publication No. 2008-219227

For example, when shooting sports with a plurality of cameras, the position where the cheering spectator is present and the position where the play that triggered the cheering is performed may be far apart. In this case, if the image of the camera corresponding to the microphone that detects the swelling sound is recorded as a sports digest as in Patent Document 3, an appropriate digest image may not be generated.

In one aspect, an object of the present invention is to provide a video information output device, a video information output system, a video information output program, and a video information output method that can be used to generate a digest video. To do.

In one embodiment, the video information output device refers to a receiving unit that receives audio data from a plurality of microphones and a time when the sound pressure level of the audio data of the reference microphones included in the plurality of microphones exceeds a predetermined threshold. A specific unit that specifies the time zone, an extraction unit that extracts a predetermined frequency component from the sound data of the time zone received from each of at least two microphones among the plurality of microphones, and the extracted predetermined unit. A selection unit that selects one microphone based on the frequency component and selects a camera that shoots a range corresponding to the installation position of the selected microphone, information on the time including the time zone, and the selected camera. It is equipped with an output unit that outputs video information including information.

It is possible to output video information that can be used to generate a digest video.

It is a figure which shows roughly the structure of the information processing system which concerns on one Embodiment. It is a figure which shows the hardware configuration of the information processing apparatus of FIG. It is a functional block diagram of the information processing apparatus of FIG. It is a flowchart which shows the process of the cheering time specific part. FIG. 5A is a diagram showing an example of voice data of a reference microphone, and FIG. 5B is a diagram showing a data structure of a cheering time DB. It is a flowchart which shows the processing of a filtering part, a camera selection part and an output part. It is a figure for demonstrating the process of step S50 of FIG. 8 (a) to 8 (d) are diagrams for explaining the process of step S52 of FIG. It is a figure which shows the data structure of the digest information DB. FIG. 10 (a) is a diagram showing a comparative example, and FIG. 10 (b) is a diagram for explaining the operation and effect of one embodiment.

Hereinafter, one embodiment will be described in detail with reference to FIGS. 1 to 10.

FIG. 1 schematically shows a configuration of an information processing system 100, which is an embodiment of a video information output system. The information processing system 100 of the present embodiment captures, for example, a futsal game held on an indoor futsal court with a plurality of video cameras, and extracts a digest scene from a video file (including video data and audio data) after shooting. This is a system for editing digest video.

As shown in FIG. 1, the information processing system 100 includes an information processing device 10 as a video information output device, video cameras 14A and 14B, and a reference microphone 12. The information processing device 10, the video cameras 14A and 14B, and the reference microphone 12 are connected via a PoE (Power over Ethernet (registered trademark)) HUB or L2SW (layer 2 switch).

It is assumed that the video cameras 14A and 14B are installed at the corners of the futsal court as shown in FIG. 1, and the angles of view of the video cameras 14A and 14B are fixed. In the present embodiment, the video cameras 14A and 14B photograph the vicinity of the installation position. That is, as shown by the broken line in FIG. 1, one video camera 14A mainly shoots the left half side of the futsal court, and the other video camera 14B mainly shoots the right half side of the futsal court. Here, the sound collecting range of the built-in microphones 13A and 13B is around each microphone. Therefore, it can be said that the shooting range of the built-in microphone 13A and the video camera 14A correspond to each other, and the shooting range of the built-in microphone 13B and the video camera 14B correspond to each other. The video cameras 14A and 14B transmit the captured video data and the audio data acquired by the built-in microphones (13A and 13B) to the information processing device 10 in the form of a video file such as an mkv file.

The reference microphone 12 is installed near the center line of the futsal court, acquires voice data in the room (around the futsal court), and transmits it to the information processing device 10.

The information processing device 10 edits the digest video based on the video data and audio data transmitted from the video cameras 14A and 14B and the reference microphone 12.

FIG. 2 shows the hardware configuration of the information processing device 10. As shown in FIG. 2, the information processing device 10 includes a CPU (Central Processing Unit) 90, a ROM (Read Only Memory) 92, a RAM (Random Access Memory) 94, and a storage unit (here, HDD (Hard Disk Drive)) 96. , A network interface 97, a display unit 93, an input unit 95, a portable storage medium drive 99, and the like. The display unit 93 includes a liquid crystal display and the like, and the input unit 95 includes a keyboard, a mouse, a touch panel and the like. Each component of the information processing device 10 is connected to the bus 98. In the information processing device 10, a program stored in the ROM 92 or HDD 96 (including a video information output program) or a program read from the portable storage medium 91 by the portable storage medium drive 99 (including a video information output program). By the CPU 90 executing the above, the functions of the respective parts shown in FIG. 3 are realized. The functions of each part in FIG. 3 may be realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

FIG. 3 shows a functional block diagram of the information processing device 10. As shown in FIG. 3, the information processing apparatus 10 functions as a digest information generation / output unit 15 and an editing unit 50 when the CPU 90 executes a program. The digest information generation / output unit 15 generates video data and audio data information (digest information) to be a digest scene from the video data and audio data transmitted from the video cameras 14A and 14B and the reference microphone 12. , Output to the editorial unit 50. The editorial unit 50 edits the digest video based on the digest information output from the digest information generation / output unit 15.

Here, as shown in FIG. 3, the digest information generation / output unit 15 includes a receiving unit 20, a cutting processing unit 22, a cheering time specifying unit 24, a filtering unit 26 as an extraction unit, and a camera selection unit 28 as a selection unit. , And an output unit 30.

The receiving unit 20 receives the video data and audio data transmitted from the video cameras 14A and 14B and the reference microphone 12, and stores them in the video / audio DB 40.

For example, when the user or the like specifies the start time and the end time of the match and inputs the edit start instruction, the cutout processing unit 22 is in the match from the video data and the audio data stored in the video / audio DB 40. Executes the process of cutting out video data and audio data. The cutout processing unit 22 stores the cut out video data and audio data in the cutout video / audio DB 42.

The cheering time specifying unit 24 identifies the time zone in which the cheering was performed by using the audio data of the reference microphone 12 stored in the cutout video / audio DB 42.

The filtering unit 26 acquires the audio data acquired by the built-in microphones 13A and 13B from the cut-out video / audio DB 42 at a predetermined time (for example, 3 seconds) before the cheering time zone. Then, the filtering unit 26 applies each of the acquired voice data to a bandpass filter, and extracts only a predetermined frequency component.

The camera selection unit 28 selects the built-in microphone having the largest integrated value of the predetermined frequency component extracted by the filtering unit 26, and selects the video camera corresponding to the selected built-in microphone. The camera selection unit 28 stores the information of the selected video camera and the information of the time zone (digest time) including the time zone in which the cheers were received and the predetermined time (for example, 3 seconds) before the cheering in the digest information DB 46.

The output unit 30 outputs the information (digest information) stored in the digest information DB 46 to the editorial unit 50.

In the present embodiment, the cheering time specifying unit 24 and the filtering unit 26 specify a time zone based on the time when the sound pressure of the voice data of the reference microphone 12 exceeds the threshold value (cheering start time). The function as is realized.

(Digest information generation / processing of output unit 15)
Next, the specific processing of the digest information generation / output unit 15 will be described in detail with reference to other drawings according to the flowcharts of FIGS. 4 and 6.

(About the processing in Fig. 4)
The process of FIG. 4 is a process executed by the cheering time specifying unit 24 when the user specifies the futsal game start time and the game end time via the input unit 95 and inputs an edit start instruction. It is assumed that the futsal game has already ended when the process of FIG. 4 is started. Further, the receiving unit 20 receives the video file obtained from the video cameras 14A and 14B and the audio data obtained from the reference microphone 12 while the user is using the futsal court, and receives the video data obtained from the reference microphone 12 into the video / audio DB 40. It is assumed that it is stored. Further, it is assumed that the cutout processing unit 22 cuts out the video data and the audio data during the match based on the match start time and the match end time specified by the user, and stores them in the cutout video / audio DB 42.

In the process of FIG. 4, first, in step S10, the cheering time specifying unit 24 acquires the audio data of the reference microphone 12 from the cut-out video / audio DB 42. For example, it is assumed that the cheering time specifying unit 24 has acquired the voice data as shown in FIG. 5A.

Next, in step S12, the cheering time specifying unit 24 acquires the sound pressure (sound pressure level) at the initial time of the acquired voice data. Next, in step S14, the cheering time specifying unit 24 determines whether or not the acquired sound pressure is 15 dB or more. If the determination in step S14 is denied, the process proceeds to step S28. In step S28, the cheering time specifying unit 24 determines whether or not it is the end of the voice data. If the determination in step S28 is denied, the process proceeds to step S30, and the cheering time specifying unit 24 returns to step S14 after acquiring the sound pressure after t seconds (for example, after 10 ms).

On the other hand, when the determination in step S14 is affirmed, that is, when the acquired sound pressure is 15 dB or more, the process proceeds to step S16, and the cheering time specifying unit 24 stores the cheering start time in the cheering time DB44. .. Here, the cheering time DB44 has a data structure as shown in FIG. 5B. Specifically, the cheering time DB 44 can store information on the cheering time (cheering start time and cheering end time). Therefore, in step S16, the cheering time specifying unit 24 stores the time (year / month / day / hour / minute / second / millisecond) corresponding to the acquired sound pressure in the cheering start time column. At this point, it is assumed that the cheering end time corresponding to the memorized cheering start time is not memorized (blank).

Next, in step S18, the cheering time specifying unit 24 acquires the sound pressure after t seconds. Then, in the next step S20, the cheering time specifying unit 24 determines whether or not the sound pressure is less than 15 dB. While the determination in step S20 is denied, that is, while the sound pressure is 15 dB or more, steps S18 and S20 (denial) are repeated. On the other hand, when the determination in step S20 is affirmed, that is, when the sound pressure becomes less than 15 dB, the process proceeds to step S22.

When the process proceeds to step S22, the cheering time specifying unit 24 determines whether or not the elapsed time from the cheering start time is 300 ms or more. When the determination in step S22 is affirmed, that is, when the sound pressure of 15 dB or more continues for 300 ms or more as in the range A of FIG. 5A, it means that there was cheering. In this case, the cheering time specifying unit 24 shifts to step S24, and sets the cheering end time corresponding to the cheering start time stored in the cheering time DB44 in step S16 as the time corresponding to the sound pressure acquired in step S18 immediately before. Memorize the year, month, day, hour, minute, second, and millisecond). After that, the process proceeds to step S28.

On the other hand, when the determination in step S22 is denied, that is, when the sound pressure of 15 dB or more does not continue for 300 ms or more as in the range B of FIG. 5A, it means that there was no cheering. In this case, the cheering time specifying unit 24 shifts to step S26, deletes the cheering start time stored in the cheering time DB44 in step S16, and shifts to step S28.

After that, the above-described processing is repeatedly executed until the determination in step S28 is affirmed, and when the determination in step S28 is affirmed, all the processing in FIG. 4 is terminated. At the stage when all the processing of FIG. 4 is completed, the information (cheering time) of all the cheers generated during the match is stored in the cheering time DB44. An example of this is each entry in FIG. 5 (b).

(About the processing in Fig. 6)
Next, the process of FIG. 6 will be described. The process of FIG. 6 is a process executed by the filtering unit 26, the camera selection unit 28, and the output unit 30 after the process of FIG. 4 is completed.

In the process of FIG. 6, first, in step S50, the filtering unit 26 selects one cheering start time stored in the cheering time DB44 and specifies the 3 seconds immediately before that. For example, when the cheering start time at the beginning of the range A shown in FIG. 7 is selected, the 3 seconds immediately before that is specified.

Next, in step S52, the filtering unit 26 executes frequency filtering processing on the audio data obtained for 3 seconds specified from the built-in microphones corresponding to all the video cameras. For example, when the frequency band of the footsteps (shoes sound) of a futsal player is 3 to 4 kHz, the filtering unit 26 passes audio data to a bandpass filter that passes through the frequency band.

For example, it is assumed that the voice data of the built-in microphones 13A and 13B for 3 seconds is the data shown in FIGS. 8 (a) and 8 (c). In this case, the audio data of the built-in microphone 13A of FIG. 8A is passed through a bandpass filter to become audio data of only frequency components of 3 to 4 kHz as shown in FIG. 8B. Further, the audio data of the built-in microphone 13B of FIG. 8C is passed through a bandpass filter to become audio data of only frequency components of 3 to 4 kHz as shown in FIG. 8D.

Next, in step S54, the camera selection unit 28 integrates the sound pressures of the audio data of the built-in microphones 13A and 13B for 3 seconds after filtering. That is, the camera selection unit 28 obtains the areas of the graphs of FIGS. 8 (b) and 8 (d).

Next, in step S56, the camera selection unit 28 selects the built-in microphone having the largest integrated value, selects a video camera that shoots a range corresponding to the selected built-in microphone, and digests the digest together with the digest start time and the digest end time. It is stored in the information DB 46. The built-in microphone having the largest integrated value of the frequency component corresponding to the footsteps is considered to be the built-in microphone closest to the position where the play that triggered the cheers was performed. Therefore, it is probable that the video camera that shoots the range corresponding to the built-in microphone having the largest integrated value of the frequency component corresponding to the footsteps was shooting the play that triggered the cheers.

FIG. 9 shows the data structure of the digest information DB 46. As shown in FIG. 9, the digest information DB 46 has fields for a camera ID, a digest start time, and a digest end time. The digest information DB 46 stores information indicating which video camera has captured the video in which time zone is the digest scene.

For example, in the case of FIGS. 8 (b) and 8 (d), the integrated value of the built-in microphone 13A of FIG. 8 (b) is larger. Therefore, the camera selection unit 28 selects the video camera 14A corresponding to the built-in microphone 13A. Then, the camera selection unit 28 includes the camera ID (referred to as “A”) of the video camera 14A, the digest start time (time 3 seconds before the cheer start time), and the digest end time (the same time as the cheer end time). And are stored in the digest information DB 46.

Returning to FIG. 6, in the next step S58, the camera selection unit 28 determines whether or not all the cheering start times have been selected. In other words, it is determined whether the processing for all the entries in FIG. 5B has been completed. If the determination in step S58 is denied, the process returns to step S50, and the processing / determination in steps S50 to S58 is repeatedly executed. On the other hand, if the determination in step S58 is affirmed, the process proceeds to step S60, and the output unit 30 outputs the information (digest information) stored in the digest information DB 46 to the editorial unit 50. The output unit 30 outputs the information stored in the digest information DB 46 to the editorial unit 50 in the form of a csv file or the like.

When the digest information generation / output unit 15 executes the above processing, the digest information stored in the digest information DB 46 as shown in FIG. 9 is output to the editorial unit 50. Therefore, the editorial unit 50 can automatically generate an appropriate digest video in which the play that triggered the cheers is captured by cutting out the digest scene from the cut-out video / audio DB 42 based on the digest information. it can.

Here, as a comparative example, the camera selection unit 28 selects the built-in microphone having the larger sound pressure among the built-in microphones 13A and 13B, and digests the image of the video camera that shoots the range corresponding to the selected built-in microphone. The case of making a video will be described. In this example, as shown in FIG. 10A, it is assumed that the spectator on the right side of the futsal court cheers when a shot is scored on the goal on the left side of the futsal court. In this case, in the comparative example, the image of the video camera 14B on the side closer to the cheering audience becomes the digest image, so that the image that does not include the goal scene that triggered the cheering may become the digest image. There is. On the other hand, in the present embodiment, the camera selection unit 28 selects the built-in microphone 13A having a large integrated value of the frequency component of the footsteps, and also selects the video camera 14A that shoots the range corresponding to the selected built-in microphone 13A. Therefore, as shown in FIG. 10B, the image obtained by shooting the scene that triggered the cheers can be used as the digest image.

As described in detail above, according to the present embodiment, the cheering time specifying unit 24 specifies the time when the sound pressure of the voice data of the reference microphone 12 exceeds 15 dB (cheering start time), and the filtering unit 26 determines. Identify the 3 seconds before the cheer start time. Further, the filtering unit 26 extracts the frequency component of the footsteps from the voice data received from the built-in microphones 13A and 13B in the specified 3 seconds. Further, the camera selection unit 28 selects one of the built-in microphones based on the extracted frequency component, and also selects a video camera that shoots a range corresponding to the installation position of the selected built-in microphone. Then, the output unit 30 outputs the digest information including the information of the selected video camera to the editorial unit 50. Thereby, in the present embodiment, it is possible to output appropriate information that can be used to generate a digest video from the video of a game such as futsal. Therefore, the editorial unit 50 can generate appropriate digest information by using the digest information.

Further, in the present embodiment, the camera selection unit 28 obtains the integrated value of the frequency component corresponding to the footsteps of the built-in microphones 13A and 13B, selects the built-in microphone having the largest integrated value, and corresponds to the selected microphone. Select a video camera. This makes it possible to appropriately select a video camera that captures the play that triggered the cheers immediately before the cheers.

Further, in the present embodiment, when the sound pressure of the voice data of the reference microphone 12 exceeds a predetermined threshold value (for example, 15 dB) for a predetermined time (for example, 300 ms) or more, it is determined that there is a cheer. It is possible to appropriately judge the presence or absence of cheers.

In the above embodiment, the case where the information processing apparatus 10 has the editorial unit 50 has been described, but the present invention is not limited to this. For example, the output unit 30 of the information processing device 10 may output (display) the digest information on the display unit 93. In this case, since the user can edit the digest video while referring to the digest information, it is possible to reduce the work load of the user. Further, the output unit 30 of the information processing device 10 may output the digest information to another device (terminal or the like). In this case, another device may automatically edit the digest video based on the digest information, or a user of the other device may edit the digest video while referring to the digest information. When the information processing device 10 outputs digest information to the display unit 93 or another device, the information processing device 10 does not have to receive (acquire) video data from the video cameras 14A and 14B.

In the above embodiment, the case where there is one reference microphone 12 has been described, but the present invention is not limited to this, and there may be a plurality of reference microphones. In this case, the sound pressures of the plurality of reference microphones at each time may be totaled and compared with the threshold value, or the sound pressures of the plurality of reference microphones at each time may be averaged and compared with the threshold value. Further, for example, at least one of a plurality of built-in microphones may be used instead of the reference microphone 12 without preparing the reference microphone 12. When a plurality of built-in microphones are used as reference microphones, the sound pressures of the plurality of reference microphones at each time may be totaled and compared with the threshold value, or the sounds of the plurality of reference microphones at each time may be compared. The pressure may be averaged and compared to the threshold.

In the above embodiment, the shooting range of the video camera may not be in the vicinity of the video camera. For example, the video camera 14A of FIG. 1 may shoot the right side of the futsal court of FIG. 1 with a telephoto, and the video camera 14B may shoot the left side of the court with a telephoto. In such a case, prepare a table showing which built-in microphone's sound collection range corresponds to which video camera's shooting range. Then, the camera selection unit 28 may select the video camera corresponding to the built-in microphone having the largest integrated value by referring to the prepared table in step S56.

In the above embodiment, the case where the frequency corresponding to the footsteps is set to 3 to 4 kHz and the frequency component is extracted from the voice data has been described, but the present invention is not limited to this. The frequency component to be extracted may be changed according to the type and place of sports. For example, in the case of kendo, the frequency component corresponding to the sound of a bamboo sword may be extracted, and in the case of judo, the frequency component corresponding to the sound of rubbing the feet and tatami mats may be extracted. Further, the sound pressure threshold value (15 dB) and the elapsed time threshold value (300 ms) used for determining the presence or absence of cheers may be changed to other values according to the type and place of the sport.

In the above embodiment, the filtering unit 26 has described the case of specifying the 3 seconds before the cheer start time when specifying the time zone based on the cheer start time, but the present invention is not limited to this. Absent. The length of the time zone based on the cheering start time may be other than 3 seconds. Further, the filtering unit 26 may specify the time zone after the cheering start time and the time zone before and after the cheering start time.

In the above embodiment, the camera selection unit 28 has described the case where the built-in microphone and the video camera corresponding thereto are selected based on the integrated value of the predetermined frequency component of the audio data, but the present invention is limited to this. is not. For example, the camera selection unit 28 may select a built-in microphone having the largest number of peaks exceeding a predetermined sound pressure (for example, 15 dB) in a predetermined frequency component of audio data, and a video camera corresponding thereto. Further, the camera selection unit 28 may select the built-in microphone and the video camera corresponding thereto by another method.

In the above embodiment, the case where two video cameras are installed near the futsal court has been described, but the present invention is not limited to this, and three or more video cameras may be installed.

The above processing function can be realized by a computer. In that case, a program that describes the processing content of the function that the processing device should have is provided. By executing the program on a computer, the above processing function is realized on the computer. The program describing the processing content can be recorded on a computer-readable recording medium (however, the carrier wave is excluded).

When a program is distributed, it is sold in the form of a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. It is also possible to store the program in the storage device of the server computer and transfer the program from the server computer to another computer via the network.

The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes the processing according to the program. The computer can also read the program directly from the portable recording medium and execute the processing according to the program. In addition, the computer can sequentially execute processing according to the received program each time the program is transferred from the server computer.

The embodiments described above are examples of preferred embodiments of the present invention. However, the present invention is not limited to this, and various modifications can be made without departing from the gist of the present invention.

Regarding the description of the above embodiments, the following additional notes will be further disclosed.
(Appendix 1) A receiver that receives audio data from multiple microphones,
A specific unit that specifies a time zone based on the time when the sound pressure level of the sound data of the reference microphones included in the plurality of microphones exceeds a predetermined threshold value, and
An extraction unit that extracts a predetermined frequency component from audio data in the time zone received from at least two microphones among the plurality of microphones.
A selection unit that selects one microphone based on the extracted predetermined frequency component and selects a camera that captures a range corresponding to the installation position of the selected microphone.
An output unit that outputs video information including time information including the time zone and information of the selected camera, and an output unit.
Video information output device equipped with.
(Supplementary Note 2) The video information output device according to Supplementary note 1, wherein the predetermined frequency component is a frequency component corresponding to a human footstep.
(Supplementary Note 3) The video information output device according to Supplementary Note 1 or 2, wherein the selection unit selects a microphone having the largest integrated value of the sound pressure level of the predetermined frequency component.
(Supplementary Note 4) The video information output device according to any one of Supplementary notes 1 to 3, further comprising an editing unit for editing video images taken by a plurality of cameras using the video information output by the output unit.
(Appendix 5) When the sound pressure level of the voice data of the reference microphone exceeds a predetermined threshold value for a predetermined time or longer, the specific unit is a time zone immediately before the time when the predetermined threshold value is exceeded. The video information output device according to any one of Supplementary note 1 to 4, wherein the image information output device is specified.
(Appendix 6) With multiple microphones
A video information output device connected to the plurality of microphones is provided.
The video information output device is
A receiver that receives audio data from the plurality of microphones,
A specific unit that specifies a time zone based on the time when the sound pressure level of the sound data of the reference microphones included in the plurality of microphones exceeds a predetermined threshold value, and
An extraction unit that extracts a predetermined frequency component from audio data in the time zone received from at least two microphones among the plurality of microphones.
A selection unit that selects one microphone based on the extracted predetermined frequency component and selects a camera that captures a range corresponding to the installation position of the selected microphone.
It has an output unit that outputs video information including time information including the time zone and information of the selected camera.
A video information output system characterized by this.
(Appendix 7) Receive audio data from multiple microphones
A time zone based on the time when the sound pressure level of the voice data of the reference microphones included in the plurality of microphones exceeds a predetermined threshold value is specified.
A predetermined frequency component is extracted from the voice data of the time zone received from each of at least two microphones among the plurality of microphones.
One microphone is selected based on the extracted predetermined frequency component, and a camera that captures a range corresponding to the installation position of the selected microphone is selected.
Outputs video information including time information including the time zone and information of the selected camera.
A video information output program that allows a computer to execute processing.
(Supplementary Note 8) The video information output program according to Supplementary note 7, wherein the predetermined frequency component is a frequency component corresponding to a human footstep.
(Supplementary note 9) The video information output program according to Supplementary note 7 or 8, wherein in the selection process, a microphone having the largest integrated value of the sound pressure level of the predetermined frequency component is selected.
(Supplementary Note 10) The video information output according to any one of Supplementary notes 7 to 9, which causes the computer to further execute a process of editing images taken by a plurality of cameras using the video information output in the output process. program.
(Appendix 11) In the specific process, when the time when the sound pressure level of the voice data of the reference microphone exceeds the predetermined threshold value exceeds the predetermined time, the time immediately before the time when the predetermined threshold value is exceeded. The video information output program according to any one of Supplementary notes 7 to 10, wherein the band is specified.
(Appendix 12) Receive audio data from multiple microphones
A time zone based on the time when the sound pressure level of the voice data of the reference microphones included in the plurality of microphones exceeds a predetermined threshold value is specified.
A predetermined frequency component is extracted from the voice data of the time zone received from each of at least two microphones among the plurality of microphones.
One microphone is selected based on the extracted predetermined frequency component, and a camera that captures a range corresponding to the installation position of the selected microphone is selected.
Outputs video information including time information including the time zone and information of the selected camera.
A video information output method characterized in that a computer executes processing.

10 Information processing device (video information output device)
12 Reference microphone (microphone)
13A, 13B Built-in microphone (microphone)
14A, 14B video camera (camera)
20 Receiver 24 Cheers time Specific part (part of specific part)
26 Filtering section (part of specific section, extraction section)
28 Camera selection section (selection section)
30 Output unit 50 Editorial unit 100 Video information output system (information processing system)

Claims (8)

A receiver that receives audio data from multiple microphones,
A specific unit that specifies a time zone based on the time when the sound pressure level of the sound data of the reference microphones included in the plurality of microphones exceeds a predetermined threshold value, and
An extraction unit that extracts a predetermined frequency component from audio data in the time zone received from at least two microphones among the plurality of microphones.
A selection unit that selects one microphone based on the extracted predetermined frequency component and selects a camera that captures a range corresponding to the installation position of the selected microphone.
An output unit that outputs video information including time information including the time zone and information of the selected camera, and an output unit.
Video information output device equipped with. The video information output device according to claim 1, wherein the predetermined frequency component is a frequency component corresponding to a human footstep. The video information output device according to claim 1 or 2, wherein the selection unit selects a microphone having the largest integrated value of the sound pressure level of the predetermined frequency component. The video information output device according to any one of claims 1 to 3, further comprising an editorial unit that edits images taken by a plurality of cameras using the video information output by the output unit. When the sound pressure level of the voice data of the reference microphone exceeds a predetermined threshold value for a predetermined time or longer, the specific unit specifies a time zone immediately before the time when the predetermined threshold value is exceeded. The video information output device according to any one of claims 1 to 4, wherein the video information output device is characterized. With multiple microphones
A video information output device connected to the plurality of microphones is provided.
The video information output device is
A receiver that receives audio data from the plurality of microphones,
A specific unit that specifies a time zone based on the time when the sound pressure level of the sound data of the reference microphones included in the plurality of microphones exceeds a predetermined threshold value, and
An extraction unit that extracts a predetermined frequency component from audio data in the time zone received from at least two microphones among the plurality of microphones.
A selection unit that selects one microphone based on the extracted predetermined frequency component and selects a camera that captures a range corresponding to the installation position of the selected microphone.
It has an output unit that outputs video information including time information including the time zone and information of the selected camera.
A video information output system characterized by this. Receive audio data from multiple microphones
A time zone based on the time when the sound pressure level of the voice data of the reference microphones included in the plurality of microphones exceeds a predetermined threshold value is specified.
A predetermined frequency component is extracted from the voice data of the time zone received from each of at least two microphones among the plurality of microphones.
One microphone is selected based on the extracted predetermined frequency component, and a camera that captures a range corresponding to the installation position of the selected microphone is selected.
Outputs video information including time information including the time zone and information of the selected camera.
A video information output program that allows a computer to execute processing. Receive audio data from multiple microphones
A time zone based on the time when the sound pressure level of the voice data of the reference microphones included in the plurality of microphones exceeds a predetermined threshold value is specified.
A predetermined frequency component is extracted from the voice data of the time zone received from each of at least two microphones among the plurality of microphones.
One microphone is selected based on the extracted predetermined frequency component, and a camera that captures a range corresponding to the installation position of the selected microphone is selected.
Outputs video information including time information including the time zone and information of the selected camera.
A video information output method characterized in that a computer executes processing.

Images