WO2024084953A1 - Information processing device, information processing method, and program - Google Patents

Abstract

The present disclosure relates to an information processing device, an information processing method, and a program with which improved sound collection can be achieved. An information acquisition unit acquires information necessary for calculating an optimal arrangement of a directional microphone that collects sounds to be collected, the information including at least information indicating the position or orientation of the directional microphone. An arithmetic processing unit calculates, on the basis of the information, the optimal arrangement of the directional microphone that collects sounds to be collected. Further, an operation control unit controls an operation of the position or orientation of a moving device, on which the directional microphone is mounted, so that the directional microphone reaches the arrangement calculated by the arithmetic processing unit. The present technology can be used in, for example, a system for imaging and sound collecting.

Description

Information processing device, information processing method, and program

The present disclosure relates to an information processing device, an information processing method, and a program, and in particular to an information processing device, an information processing method, and a program that enable better audio pickup.

Traditionally, directional microphones are sometimes used to capture the voices of actors during filming of movies, dramas, and other video content. Generally, when recording sound using a directional microphone set at the end of a boom, the sound staff holding the boom must be careful not to capture themselves, the directional microphone, or the boom in the footage. Also, traditionally, the positioning of the directional microphone and holding the boom were performed by the sound staff, but in the future, it is expected that this will be replaced by drones, robots, and the like.

For example, cited reference 1 discloses an imaging system that determines the positions of multiple moving bodies that capture images of a subject, the moving bodies including a moving body having an imaging unit that captures images of the subject and a moving body having an illumination unit that illuminates the subject with light.

Furthermore, cited document 2 discloses an information processing device that acquires status information of an imaging unit possessed by a moving object, calculates the imageable area of the imaging unit based on the status information, and transmits information regarding the imageable area to the moving object.

International Publication No. 2019/189370 International Publication No. 2021/024627

As mentioned above, when the positioning or holding of a directional microphone is substituted, it is required to be able to pick up sound well.

This disclosure was made in light of these circumstances, and aims to make it possible to pick up sound more effectively.

The information processing device of one aspect of the present disclosure includes an information acquisition unit that acquires information including at least information indicating the position or orientation of the sound pickup equipment that picks up the sound of the target sound pickup, and that acquires information necessary to calculate an optimal placement of the sound pickup equipment, a calculation processing unit that calculates, based on the information by the information acquisition unit, an optimal placement of the sound pickup equipment for picking up the sound of the target sound pickup, and an operation control unit that controls the operation of the position or orientation of the sound pickup equipment so as to achieve the placement calculated by the calculation processing unit.

An information processing method or program according to one aspect of the present disclosure includes at least information indicating the position or orientation of a pickup device that picks up a target sound, and includes acquiring information necessary to calculate an optimal placement of the pickup device, calculating an optimal placement of the pickup device for picking up the target sound based on the information, and controlling the position or orientation of the pickup device to achieve that placement.

In one aspect of the present disclosure, information is acquired that includes at least information indicating the position or orientation of the pickup equipment that picks up the target sound, and the optimal placement of the pickup equipment is calculated based on that information, and the position or orientation of the pickup equipment is controlled to achieve that placement.

1 is a diagram showing an example of the configuration of an embodiment of an imaging and sound collecting system to which the present technology is applied; 1 is a block diagram showing an example of the configuration of an information processing device; 11 is a flowchart illustrating a first processing example of an imaging and sound collection process. 13 is a flowchart illustrating a second processing example of the shooting and sound collection processing. FIG. 13 is a diagram illustrating considerations, conditions, and additional input information. FIG. 13 is a diagram illustrating an example in which a noise source is taken into consideration. FIG. 13 is a diagram illustrating an example in which lighting equipment is taken into consideration. FIG. 2 is a diagram illustrating a first example of collecting sounds from a plurality of sound collection targets. FIG. 11 is a diagram illustrating a second example of collecting sounds from a plurality of sound collection targets. FIG. 13 is a diagram illustrating a third example of collecting sounds from a plurality of sound collection targets. FIG. 13 is a diagram illustrating a fourth example of collecting sounds from a plurality of sound collection targets. FIG. 13 is a diagram showing an example of an arrangement screen. FIG. 13 is a diagram showing an example of an arrangement screen. 1A and 1B are diagrams illustrating an example configuration using a microphone cable. 1 is a block diagram showing an example of the configuration of an embodiment of a computer to which the present technology is applied.

Below, specific embodiments of the application of this technology will be described in detail with reference to the drawings.

<Example of a recording and recording system configuration>
FIG. 1 is a diagram showing an example of the configuration of an embodiment of an imaging and sound collecting system to which the present technology is applied.

As shown in FIG. 1, the imaging and recording system 11 is configured with a imaging camera 12, a directional microphone 13, a moving device 14, and an information processing device 15.

For example, the filming and recording system 11 can be used on location for movies, dramas, etc., and can use the directional microphone 13 to record sounds such as lines spoken by a specific actor who is being filmed by the filming camera 12 as the recording target 21. The filming and recording system 11 can also use the information processing device 15 to control the operation of the mobile device 14 equipped with the directional microphone 13 so that the mobile device 14 is in the optimal position or orientation for recording the sound of the recording target 21.

The photographing camera 12 is, for example, photographing equipment that takes photographs with an angle of view that corresponds to the lens used.

Directional microphone 13 is, for example, a recording device with directional characteristics that mainly picks up sounds in a narrow range along the sound axis and does not pick up sounds outside that range.

The moving device 14 can be, for example, an unmanned aerial vehicle (a so-called drone) that can fly autonomously using multiple propellers, and moves the directional microphone 13 to a desired position or orientation according to the control of the information processing device 15.

The information processing device 15 calculates the optimal position or orientation of the directional microphone 13 for picking up the sound of the collection target 21 (hereinafter referred to as the optimal arrangement of the directional microphone 13), and controls the operation of the moving device 14 so that the sound of the collection target 21 can be picked up in the optimal arrangement of the directional microphone 13.

For example, the information processing device 15 can estimate the reflection range (the range surrounded by the dashed line in FIG. 1) that is the range that is reflected in the image captured by the capturing camera 12, based on the position, orientation, and angle of view of the capturing camera 12. The information processing device 15 can also estimate the recording possible range (the range surrounded by the dashed line in FIG. 1) that is the range in which the direct sound of the sound collection target 21 can be recorded when the sound axis of the directional microphone 13 is directed toward the sound collection target 21, based on the position and orientation of the sound collection target 21.

Therefore, the information processing device 15 calculates the position where the directional microphone 13 can get closest to the sound collection target 21, inside the range where the sound of the sound collection target 21 can be recorded and outside the range of the image capture camera 12, as the optimal position of the directional microphone 13 for picking up the sound of the sound collection target 21. Furthermore, the information processing device 15 calculates the direction in which the sound axis of the directional microphone 13 faces toward the sound collection target 21 at that position as the optimal orientation of the directional microphone 13 for picking up the sound of the sound collection target 21. Then, the information processing device 15 controls the operation of the moving device 14 so that the directional microphone 13 is positioned (position or orientation) optimally.

FIG. 2 is a block diagram showing an example configuration of the information processing device 15.

As shown in FIG. 2, the information processing device 15 includes a user input unit 31, an operation control unit 32, an information acquisition unit 33, a positional relationship determination unit 34, a memory unit 35, and a calculation processing unit 36.

The user input unit 31 is used by the user of the filming and recording system 11 to input various information to the information processing device 15. For example, the user uses the user input unit 31 to input equipment information related to the equipment used in the filming and recording system 11, such as information indicating the angle of view of the filming camera 12, information indicating the shape and directional characteristics of the directional microphone 13, and information indicating the shape of the mobile device 14. The user input unit 31 supplies this equipment information to the calculation processing unit 36.

Furthermore, the user can use the user input unit 31 to specify the directional microphone 13 to be used for collecting sound for each sound collection target 21, and the user input unit 31 supplies information indicating the directional microphone 13 specified for each sound collection target 21 to the calculation processing unit 36. Furthermore, the user can use the user input unit 31 to specify the position or orientation of the directional microphone 13 or adjust the position or orientation before shooting by the shooting camera 12 begins, and the user input unit 31 supplies information indicating the position or orientation of the directional microphone 13 specified or adjusted by the user to the operation control unit 32.

Before the imaging camera 12 starts capturing images, the operation control unit 32 controls the operation of the moving device 14 based on information indicating the position or orientation of the directional microphone 13 supplied from the user input unit 31, and moves the directional microphone 13 to a position or orientation according to the information. After the imaging camera 12 starts capturing images, the operation control unit 32 controls the operation of the moving device 14 based on information indicating the optimal placement of the directional microphone 13 supplied from the calculation processing unit 36, as described below, and moves the directional microphone 13 to a position or orientation according to the information.

The information acquisition unit 33 acquires various pieces of information required for the calculation processing unit 36 to calculate the optimal placement of the directional microphone 13.

For example, the information acquisition unit 33 acquires information indicating the position and orientation of the imaging camera 12 before imaging by the imaging camera 12 begins (hereinafter referred to as initial camera information), and supplies this to the calculation processing unit 36. In addition, before imaging by the imaging camera 12 begins, the information acquisition unit 33 acquires information indicating the position and orientation of the sound collection target 21 for each sound collection target 21 (hereinafter referred to as initial sound collection target information), and information indicating the position or orientation of the directional microphone 13 (hereinafter referred to as initial microphone information), and supplies this to the positional relationship identification unit 34 and the calculation processing unit 36.

In addition, after the shooting camera 12 starts shooting, the information acquisition unit 33 continues to acquire information indicating the position or orientation of the shooting camera 12, the sound collection target 21, and the directional microphone 13 at all times until the shooting ends. The information acquisition unit 33 then supplies the calculation processing unit 36 with information indicating the position and orientation of the shooting camera 12 at each time point during shooting (hereinafter referred to as camera information), information indicating the position and orientation of the sound collection target 21 at each time point during shooting (hereinafter referred to as sound collection target information), and information indicating the position or orientation of the directional microphone 13 at each time point during shooting (hereinafter referred to as microphone information).

The positional relationship determination unit 34 determines the positional relationship between the directional microphone 13 and the sound collection target 21 at the time when shooting by the shooting camera 12 begins, based on the initial microphone information and initial sound collection target information supplied from the information acquisition unit 33. For example, the positional relationship determination unit 34 determines the direction in which the directional microphone 13 is pointed and the distance from the directional microphone 13 to the sound collection target 21 as the positional relationship. Then, the positional relationship determination unit 34 stores the positional relationship information indicating the positional relationship between the directional microphone 13 and the sound collection target 21 in the memory unit 35.

The storage unit 35 stores the positional relationship information supplied from the positional relationship identification unit 34.

The calculation processing unit 36 is supplied with information indicating the angle of view of the shooting camera 12, information indicating the shape and directional characteristics of the directional microphone 13, and information indicating the shape of the moving device 14 from the user input unit 31. Alternatively, the calculation processing unit 36 may acquire this information by communicating with other equipment. Furthermore, the calculation processing unit 36 is supplied with camera information, sound collection target information, and microphone information from the information acquisition unit 33. Then, based on this information, the calculation processing unit 36 calculates the position or orientation of the directional microphone 13 that is optimal for picking up the sound of the sound collection target 21, and supplies information indicating the optimal placement of the directional microphone 13, which instructs the operation control unit 32 to place the directional microphone 13 in that position or orientation.

For example, the calculation processing unit 36 has a recordable range estimation unit 41, a reflection range estimation unit 42, and an optimal placement calculation unit 43.

The recording range estimation unit 41 estimates the recording range of the sound of the sound collection target 21 at each point during shooting based on the sound collection target information supplied from the information acquisition unit 33.

The reflection range estimation unit 42 estimates the reflection range of the shooting camera 12 at each point during shooting based on information indicating the angle of view of the shooting camera 12 supplied from the user input unit 31 and camera information supplied from the information acquisition unit 33.

The optimal placement calculation unit 43 estimates an area that is inside the recordable range estimated by the recordable range estimation unit 41 and outside the reflected range estimated by the reflected range estimation unit 42 as a possible placement area in which the directional microphone 13 can be placed. At this time, the optimal placement calculation unit 43 refers to information indicating the shape of the directional microphone 13 and information indicating the shape of the mobile device 14, and estimates the possible placement area of the directional microphone 13 so that the directional microphone 13 and the mobile device 14 do not enter the angle of view of the shooting camera 12.

Then, the optimal placement calculation unit 43 calculates the position that is closest to the sound collection target 21 within the placement area of the directional microphone 13 as the optimal position for picking up the sound of the sound collection target 21. Furthermore, based on the information indicating the directional characteristics of the directional microphone 13 supplied from the user input unit 31 and the sound collection target information supplied from the information acquisition unit 33, the optimal placement calculation unit 43 calculates the direction in which the sound axis of the directional microphone 13 faces the sound collection target 21 at the optimal position for picking up the sound of the sound collection target 21 as the optimal orientation for picking up the sound of the sound collection target 21. In this way, the optimal placement calculation unit 43 can calculate the optimal placement (position or orientation) of the directional microphone 13, and can supply information indicating the optimal placement of the directional microphone 13 to the operation control unit 32.

The filming and recording system 11 configured in this manner can record the sound of the recording target 21 with the directional microphone 13 in an optimal position, for example, pointing the sound axis toward the recording target 21 at a position that is inside the recording range and outside the projection range and closest to the recording target 21, and can record the sound of the recording target 21 with the directional microphone 13. This allows the filming and recording system 11 to record the sound of the recording target 21 more effectively.

Furthermore, in the filming and sound collection system 11, the user can specify the position or orientation of the directional microphone 13 before filming by the filming camera 12 begins, and adjust the position or orientation of the directional microphone 13 as necessary while checking the sound being collected. For example, the user can adjust the sound axis of the directional microphone 13 to point toward the mouth, forehead, chest, etc. of the sound collection target 21, or adjust the position of the directional microphone 13 so that it is at a distance where the sound can be more easily heard.

Then, in the filming and sound collection system 11, by identifying and storing the positional relationship between the directional microphone 13 and the sound collection target 21 at the time when filming by the filming camera 12 begins, for example, when the sound collection target 21 moves, it is possible to collect sound while maintaining this positional relationship within a range where it is not captured by the filming camera 12. In other words, the operation control unit 32 can control the operation of the moving device 14 to read out the positional relationship information stored in the memory unit 35 and reproduce that positional relationship. In addition, in the filming and sound collection system 11, the positional relationship between the directional microphone 13 and the sound collection target 21 can be reproduced when the same scene is filmed multiple times, including rehearsals, on a filming site for a movie or drama, or when filming is resumed after being interrupted.

In addition, in the filming and recording system 11, the information acquisition unit 33 can use the following first to third identification methods to identify the position and orientation of the recording target 21.

In the first identification method, if a sensor is installed at a pre-specified sound collection target 21 (such as an actor), the position and orientation of the sound collection target 21 can be identified by the sensor. Alternatively, if a camera is installed on the mobile device 14 together with the directional microphone 13, the position and orientation of the sound collection target 21 can be identified by analyzing the video captured by the camera. Of course, identification of the sound collection target 21 by the sensor and identification of the sound collection target 21 by analyzing the video captured by the camera may be combined.

In the second identification method, the person at the center of the image captured by the camera 12 can be identified as the sound collection target 21. For example, when a small number of people (e.g., people who speak at a certain time) are identified as the sound collection targets 21 from among many people, it is necessary to point the directional microphone 13 at the speaker every time they speak. Therefore, by analyzing the image captured by the camera 12, the speaker can be identified as the sound collection target 21.

In the third identification method, for example, the speaker and their position are identified based on speech picked up by multiple microphones or a microphone array, and the speaker who made the speech can be set as the pickup target 21.

In addition, the filming and recording system 11 can determine the sound collection position of the directional microphone 13 using information indicating the acoustic radiation characteristics of the sound collection target 21. For example, if the sound collection target 21 has acoustic radiation characteristics, the user can input information regarding the direction from which sound should be collected in advance using the user input unit 31, and the position or orientation of the directional microphone 13 is determined based on that information. In particular, for a sound collection target 21 such as a musical instrument for which there is know-how regarding the sound collection position, it is preferable to store in advance the best information regarding where and from what distance sound should be collected. Note that if the sound collection target 21 does not have acoustic radiation characteristics, i.e., if sound can be considered to be radiated in all directions, the orientation of the sound collection target 21 does not need to be taken into consideration when calculating the position or orientation of the directional microphone 13.

In addition, the filming and sound collection system 11 can automatically perform post-processing on the collected sound by referring to information obtained when the sound of the sound collection target 21 was collected. For example, in the filming and sound collection system 11, if it is desired to remove the propeller noise of the moving device 14 contained in the sound signal in the post-processing of the collected sound, information indicating the rotation speed of the propeller of the moving device 14 is stored. Then, in the post-processing, the frequency of the propeller noise can be identified according to that information, and the propeller noise of the moving device 14 can be removed. In addition, in the filming and sound collection system 11, for example, in the post-processing of the collected sound, the volume and frequency characteristics can be adjusted according to the positional relationship with the sound collection target 21, the directional characteristics of the directional microphone 13, and the radiation characteristics of the sound collection target 21.

With reference to the flowchart shown in FIG. 3, a first processing example of the imaging and sound recording process executed in the imaging and sound recording system 11 will be described.

In step S11, the user uses the user input unit 31 to input equipment information including information indicating the angle of view of the imaging camera 12, information indicating the shape and directional characteristics of the directional microphone 13, and information indicating the shape of the mobile device 14. In response, the user input unit 31 supplies the equipment information input by the user to the calculation processing unit 36.

In step S12, the information acquisition unit 33 acquires initial camera information indicating the position and orientation of the imaging camera 12 before imaging by the imaging camera 12 begins, and supplies this information to the calculation processing unit 36.

In step S13, the user uses the user input unit 31 to specify the directional microphone 13 to be used to collect sound for each sound collection target 21. In response to this, the user input unit 31 supplies information indicating the directional microphone 13 specified for each sound collection target 21 to the calculation processing unit 36. Then, in steps S14 to S17, pre-imaging processing is performed for each sound collection target 21 for which a directional microphone 13 was specified in step S13.

In step S14, the information acquisition unit 33 acquires initial sound collection target information indicating the position and orientation of the sound collection target 21 before shooting by the shooting camera 12 begins. Furthermore, for the directional microphone 13 specified in step S13, the information acquisition unit 33 acquires initial microphone information indicating the position or orientation of the directional microphone 13 before shooting by the shooting camera 12 begins.

In step S15, the user specifies the position or orientation of the directional microphone 13 using the user input unit 31. In response, the user input unit 31 supplies information indicating the position or orientation of the directional microphone 13 specified by the user to the operation control unit 32, and the operation control unit 32 controls the operation of the mobile device 14 based on that information. As a result, the directional microphone 13 is positioned so that it is in the position or orientation specified by the user.

In step S16, the user adjusts the position or orientation of the directional microphone 13 using the user input unit 31 while checking the sound picked up by the directional microphone 13 placed in step S15. In response, the user input unit 31 supplies information indicating the position or orientation of the directional microphone 13 adjusted by the user to the operation control unit 32, and the operation control unit 32 controls the operation of the mobile device 14 based on that information. In this way, the directional microphone 13 is placed so that it is in the position or orientation adjusted by the user. In this way, the user adjusts the placement of the directional microphone 13 and checks the sound picked up by the directional microphone 13, and the placement of the directional microphone 13 before the shooting camera 12 starts shooting is determined.

In step S17, the information acquisition unit 33 acquires initial microphone information for the arrangement determined in step S17 and supplies it to the positional relationship determination unit 34. Then, based on the initial microphone information for the arrangement determined in step S17 and the initial sound collection target information supplied in step S14, the positional relationship determination unit 34 determines the positional relationship between the directional microphone 13 and the sound collection target 21 at the time when shooting by the shooting camera 12 begins, and stores the positional relationship information indicating this positional relationship in the storage unit 35.

In step S18, it is determined whether the positional relationships of all sound collection targets 21 have been stored in the storage unit 35, and if it is determined that the positional relationships of all sound collection targets 21 have not been stored in the storage unit 35, the process returns to step S13. That is, in this case, in step S13, the directional microphone 13 to be used for picking up the sound of the next sound collection target 21 is specified, and the same process is repeated thereafter.

On the other hand, if it is determined in step S18 that the positional relationships of all sound collection targets 21 have been stored in the memory unit 35, the process proceeds to step S19.

In step S19, the camera 12 starts capturing images, and the directional microphone 13 starts collecting sound.

In step S20, the information acquisition unit 33 acquires information indicating the position or orientation of each of the shooting camera 12, the sound collection target 21, and the directional microphone 13, and supplies the camera information, sound collection target information, and microphone information to the calculation processing unit 36.

In step S21, the calculation processing unit 36 calculates the optimal position or orientation of the directional microphone 13 based on the camera information, sound collection target information, and microphone information supplied from the information acquisition unit 33 in step S20. The calculation processing unit 36 then supplies information indicating the optimal placement of the directional microphone 13 to the operation control unit 32, which instructs the directional microphone 13 to be placed in that position or orientation.

In step S22, the operation control unit 32 controls the operation of the moving device 14 based on the information indicating the optimal placement of the directional microphone 13 supplied from the calculation processing unit 36 in step S21. As a result, the directional microphone 13 is placed in an optimal position or orientation for picking up the sound of the sound collection target 21.

In step S23, it is determined whether or not to end image capture by the imaging camera 12. If it is determined that image capture by the imaging camera 12 should not be ended, the process returns to step S20, and the same process is repeated thereafter. On the other hand, if it is determined in step S23 that image capture by the imaging camera 12 should be ended, the process ends.

As described above, in the filming and sound collection system 11, by performing the filming and sound collection process, the directional microphone 13 is positioned in the optimal position or orientation for collecting the sound of the sound collection target 21, thereby enabling better sound collection.

A second example of the imaging and sound recording process executed in the imaging and sound recording system 11 will be described with reference to the flowchart shown in FIG. 4.

In steps S31 to S34, the same processing as in steps S11 to S14 in FIG. 3 is performed, and in step S35, the calculation processing unit 36 calculates the optimal position or orientation of the directional microphone 13 based on the initial camera information, the initial sound collection target information, and the initial microphone information, and supplies information indicating that position or orientation to the operation control unit 32.

In step S35, the operation control unit 32 controls the operation of the moving device 14 based on the information indicating the position or orientation of the directional microphone 13 supplied from the calculation processing unit 36 in step S34. As a result, the directional microphone 13 is positioned so that it is in the optimal position or orientation calculated in step S34. After that, in steps S36 to S43, the same processing as in steps S16 to S23 in FIG. 3 is performed.

As described above, the filming and sound collection system 11 performs filming and sound collection processing, and from the time filming begins, the directional microphone 13 is positioned in the optimal position or orientation for collecting the sound of the sound collection target 21, allowing for better sound collection.

<About what is to be considered>
5 to 7, a method for determining the optimal position or orientation of the directional microphone 13 will be described, taking into consideration various factors at the shooting site in addition to the positions and orientations of the shooting camera 12, directional microphone 13, sound collection target 21, etc.

As shown in Figure 5, in the filming and recording system 11, it is necessary to determine the optimal position or orientation of the directional microphone 13 in consideration of noise sources, lighting equipment, reflective objects/reflected objects, the position of the sun, surrounding conditions, etc., in order to eliminate their effects.

When considering the noise source, it is necessary to determine the position or orientation of the directional microphone 13 so as to avoid picking up noise other than the target 21. Therefore, in order to meet this condition, in the filming and recording system 11, the generation position of sounds other than the target 21 and the directional characteristics of the directional microphone 13 are input to the information processing device 15 as additional input information.

When considering lighting equipment, the position or orientation of the directional microphone 13 must be determined so that the directional microphone 13 does not block the lighting light and so that the shadow of the directional microphone 13 is not cast. Therefore, in order to satisfy this condition, in the filming and recording system 11, the position, orientation, and size of the lighting equipment, as well as the directional characteristics and light amount of the lighting light, are input to the information processing device 15 as additional input information.

When considering reflective objects such as glass and mirrors, it is necessary to determine the position or orientation of the directional microphone 13 so that the directional microphone 13 is not reflected in such objects. Therefore, in order to satisfy this condition, in the filming and recording system 11, the position, orientation, shape, and size of the reflective object and the reflected object, as well as the reflectance, are input to the information processing device 15 as additional input information.

When taking into account the position of the sun, it is necessary to determine the position or orientation of the directional microphone 13 so that the shadow of the directional microphone 13 is not cast. Therefore, in order to satisfy this condition, in the filming and recording system 11, the time, latitude, longitude, and weather are input to the information processing device 15 as additional input information.

When taking the surrounding conditions into consideration, it is necessary to determine the position or orientation of the directional microphone 13 so as not to come into contact with people or objects around the directional microphone 13. Therefore, to meet this condition, the output of a camera or sensor that observes the surrounding conditions is input to the information processing device 15 as additional input information.

Figure 6 is a diagram that explains an example of the optimal position or orientation of the directional microphone 13 when taking into account the noise source.

As shown in FIG. 6, if there is a noise source 22 at a shooting location where the shooting and sound collection system 11 is used, it is necessary to prevent the directional microphone 13 from picking up the noise from the noise source 22. For example, noise from the noise source 22 may be noise from various devices such as air conditioners, refrigerators, ventilation fans, or generators, traffic noise from aircraft or emergency vehicles, construction noise, etc.

Then, when calculating the optimal placement of the directional microphone 13 as described above, the optimal placement calculation unit 43 calculates the optimal placement of the directional microphone 13 based on the position of the noise source 22 and the directional characteristics of the directional microphone 13 so as to avoid the sound axis of the directional microphone 13 pointing towards the noise source 22. In other words, the optimal placement calculation unit 43 calculates the optimal placement of the directional microphone 13 at a position that is closest to the sound collection target 21 within the placement area of the directional microphone 13 so that the sound axis of the directional microphone 13 points towards the sound collection target 21 and not towards the noise source 22.

Therefore, as shown in FIG. 6A, it is preferable to position the directional microphone 13 outside the reflection range so that its sound axis faces the sound collection target 21 and not the noise source 22. Note that FIG. 6B shows an undesirable example in which the directional microphone 13 is located outside the reflection range and its sound axis faces the sound collection target 21, but the sound axis of the directional microphone 13 also faces the noise source 22.

In addition, the filming and recording system 11 may, for example, analyze the recorded signal and output an alert to notify the user if the signal contains noise other than the voice of the recording target 21.

Figure 7 is a diagram illustrating an example of the optimal position or orientation of the directional microphone 13 when taking lighting equipment into consideration.

As shown in Figure 7, if lighting equipment 16 is present at a shooting location using the filming and sound recording system 11, it is necessary to prevent the directional microphone 13 from blocking the illumination light and to prevent the shadow of the directional microphone 13 from being cast.

Then, when calculating the optimal placement of the directional microphone 13 as described above, the optimal placement calculation unit 43 calculates the optimal placement of the directional microphone 13 based on the position, orientation, and size of the lighting equipment 16, the directional characteristics of the lighting light, and the amount of light, so as to prevent the directional microphone 13 from blocking the lighting light and to prevent the shadow of the directional microphone 13 from being cast. In other words, the optimal placement calculation unit 43 calculates the optimal placement of the directional microphone 13 at a position that is closest to the sound collection target 21 within the placement area of the directional microphone 13, and so as to prevent the directional microphone 13 from entering the area where the lighting equipment 16 irradiates the lighting light.

Therefore, as shown in A of FIG. 7, it is preferable to place the directional microphone 13 in a position outside the reflection range and not in the area irradiated by the illumination light, so that the sound axis of the directional microphone 13 is oriented toward the sound collection target 21. Note that B of FIG. 7 shows an undesirable example in which the directional microphone 13 is placed in a position outside the reflection range but in the area irradiated by the illumination light.

<About multiple recording targets>
A method for collecting sounds from a plurality of sound collection targets 21 will be described with reference to Figs.

Figure 8 shows an example of using one directional microphone 13 in a situation where multiple targets 21 for recording are facing each other and conversing simultaneously.

As shown in FIG. 8, when sound collection targets 21A and 21B are facing each other and conversing at the same time, it is preferable to point the sound axis of the directional microphone 13 at the midpoint between sound collection targets 21A and 21B. Similarly, when two or more sound collection targets 21 are nearby and one directional microphone 13 is used, it is preferable to point the sound axis of the directional microphone 13 at the midpoint between the multiple sound collection targets 21. This allows the single directional microphone 13 to effectively pick up the sounds of the multiple sound collection targets 21.

Figure 9 shows an example of using one directional microphone 13 in a situation where multiple recording targets 21 are nearby and taking turns conversing.

As shown in FIG. 9, when sound collection targets 21A and 21B are nearby and alternately conversing, it is preferable to change the direction of the sound axis of directional microphone 13 according to the time when sound collection target 21A and sound collection target 21B each speak. For example, according to a scenario prepared in advance, the sound axis of directional microphone 13 can be directed toward sound collection target 21A at time t1 when sound collection target 21A speaks, and toward sound collection target 21B at time t2 when sound collection target 21B speaks. This allows one directional microphone 13 to pick up the voices of multiple sound collection targets 21 well.

Figure 10 shows an example of use of one omnidirectional microphone 17.

As shown in FIG. 10, when an omnidirectional microphone 17 is mounted on a mobile device 14, it is preferable to place the omnidirectional microphone 17 at a position equidistant to multiple sound collection targets 21. This allows one omnidirectional microphone 17 to effectively pick up the sounds of multiple sound collection targets 21.

FIG. 11 shows an example of using multiple directional microphones 13 for each of multiple sound collection targets 21.

As shown in FIG. 11, two directional microphones 13A and 13B are mounted on a mobile device 14, and the mobile device 14 is positioned halfway between sound collection targets 21A and 21B. It is preferable to orient the sound axis of directional microphone 13A toward sound collection target 21A, and the sound axis of directional microphone 13B toward sound collection target 21B. This allows the multiple directional microphones 13 to effectively pick up the sounds of multiple sound collection targets 21.

<About the placement screen>
The layout screen displayed on the display unit of the information processing device 15 will be described with reference to FIGS.

The filming and sound recording system 11 can visualize the situation at the filming site as if looking down from the sky, and display an arrangement screen 51 showing the arrangement of the filming cameras 12, directional microphones 13, lighting equipment 16, sound recording targets 21, etc. on the display unit of the information processing device 15. The situation at the filming site can be visualized from the side, or in a stereoscopic three-dimensional form, and displayed on the arrangement screen 51.

For example, the directional microphone 13 needs to be placed within an area of a recording range that is a range in which the direct sound of the sound collection target 21 can be recorded when the sound axis of the directional microphone 13 is directed toward the sound collection target 21. Also, the directional microphone 13 needs to be placed outside an area of a reflection range that is a range in which the microphone appears in the image captured by the shooting camera 12. Furthermore, the directional microphone 13 needs to be placed so as not to block the illumination light and so as not to cast a shadow.

As shown in FIG. 12, the arrangement screen 51 displays areas that are appropriate for placing the directional microphone 13, areas that are not acceptable because they will be reflected in the image captured by the imaging camera 12, areas that are not acceptable because they will obstruct or cast a shadow on the lighting equipment 16, areas that are not acceptable because they are far from the sound collection target 21, and areas that are not acceptable because reflections from glass or the like will be reflected in the image captured by the imaging camera 12. Furthermore, the arrangement screen 51 displays icons representing the imaging camera 12, the directional microphone 13, the lighting equipment 16, the sound collection target 21, etc. The user can recognize whether the arrangement of the directional microphone 13 is appropriate by referring to the arrangement screen 51.

For example, the placement screen 51 shown in FIG. 12A shows an OK example in which the icon of the directional microphone 13 is displayed in an area appropriate for the placement of the directional microphone 13, indicating that the placement of the directional microphone 13 is optimal.

On the other hand, the arrangement screen 51 shown in FIG. 12B shows an example of an NG situation in which the icon of a directional microphone 13 is displayed in an area that is NG because it will be reflected in the image captured by the filming camera 12. A message is displayed to inform the user that the directional microphone 13 is NG because it will be reflected in the filming camera 12. For example, in the filming and sound collection system 11, if the user specifies the position of the directional microphone 13 or mobile device 14 and the position is not appropriate, a message informing the user of the cause can be displayed and an alert can be output.

In addition, in the filming and recording system 11, as in the arrangement screen 51 shown in the upper part of FIG. 13, if there is no suitable area for the arrangement of the directional microphone 13, a message is displayed indicating that it is NG because there is no suitable area for the arrangement of the directional microphone 13. In this case, the filming and recording system 11 can present alternatives indicating which conditions should be relaxed to obtain a suitable area for the arrangement of the directional microphone 13.

In other words, as shown in the layout screen 51 at the bottom of Figure 13, an icon of the directional microphone 13 is displayed in an area that is appropriate as the layout position of the directional microphone 13 obtained when the position of the lighting equipment 16 is moved.

Alternatively, a user interface may be displayed that allows the user to change the position or orientation of those objects on the placement screen 51 and check whether an appropriate area exists for placing the directional microphone 13.

In addition, in the filming and sound recording system 11, when the moving mobile device 14 is about to come into contact with another object or person, the operation control unit 32 controls the moving device 14 to move to a position or orientation that will avoid contact with the other object or person, regardless of whether the device will enter the range of the filming camera 12. In this way, when avoiding contact with other objects or people is given priority, the arrangement screen 51 notifies the user that the arrangement position of the directional microphone 13 is different from that expected.

<Example of configuration using a microphone cable>
An example of a configuration using a microphone cable will be described with reference to FIG.

As shown in FIG. 14, the filming and recording system 11 can be configured to utilize a microphone cable 18, and the directional microphone 13 is connected to a recording system 19 that records sound via the microphone cable 18. In other words, the directional microphone 13 can transmit audio signals to the recording system 19 wirelessly, or can transmit audio signals to the recording system 19 wired via the microphone cable 18.

In the thus configured filming and recording system 11, information indicating the length of the microphone cable 18, information indicating the position of the recording system 19, and the like are input to the information acquisition unit 33, and the calculation processing unit 36 controls the operation of the mobile device 14A equipped with the directional microphone 13 so as to prevent the microphone cable 18 from appearing in the image captured by the filming camera 12. At this time, in the filming and recording system 11, the position of the mobile device 14A is determined so that, for example, the distance from the mobile device 14A to the recording system 19 is within a range less than the length of the microphone cable 18.

The filming and recording system 11 may also use a moving device 14B for supporting the microphone cable 18 to prevent the microphone cable 18 from appearing in the image captured by the filming camera 12.

Note that while FIG. 14 illustrates one moving device 14B supporting the microphone cable 18, two or more moving devices 14B can be used to support the microphone cable 18. In the filming and sound collection system 11, information indicating the number of multiple moving devices 14B supporting the microphone cable 18 is input to the information acquisition unit 33, and the calculation processing unit 36 controls the operation of the moving device 14A or one or more moving devices 14B so as to prevent the microphone cable 18 from appearing in the image captured by the filming camera 12.

At this time, in the filming and recording system 11, the positions of the multiple mobile devices 14B are determined, for example, between the mobile device 14A and the recording system 19 so that the multiple mobile devices 14B support the microphone cable 18 at equal intervals. In addition, the positions of the mobile device 14A and the multiple mobile devices 14B are determined so that the distance from the mobile device 14A to the recording system 19 via the multiple mobile devices 14B is within a range less than the length of the microphone cable 18.

In addition, when an omnidirectional microphone 17 is used in the filming and sound collection system 11, there is no need to control the direction. Also, when a spherical array microphone is used in the filming and sound collection system 11, the sound of the sound collection target 21 arriving from any direction can be emphasized in post-processing, so there is no need to control the direction. Also, because the shape and diaphragm position of the microphone differ from microphone to microphone, the filming and sound collection system 11 must take these factors into consideration when calculating the optimal placement of the directional microphone 13.

In addition, in the filming and recording system 11, in addition to the angle of view, the focal length and sensor size may be used as equipment information related to the filming camera 12. Furthermore, the image itself captured by the filming camera 12 may be analyzed to detect whether the directional microphone 13 is captured.

In addition, in the filming and sound collection system 11, in addition to the moving device 14, a crane, rover, wire, etc. can be used as a moving object that holds the directional microphone 13. In this case, to prevent the crane, rover, wire, etc. from appearing in the image captured by the filming camera 12, information about these must be input to the information processing device 15 and the optimal placement of the directional microphone 13 must be calculated.

In this embodiment, when a directional microphone 13 is used, the position and orientation of the directional microphone 13 are controlled using information including both the position and orientation of the directional microphone 13. On the other hand, when an omnidirectional microphone 17 is used, the position of the omnidirectional microphone 17 is controlled using information including at least the position of the omnidirectional microphone 17.

<Example of computer configuration>
Next, the above-mentioned series of processes (information processing method) can be performed by hardware or software. When the series of processes is performed by software, a program constituting the software is installed in a general-purpose computer or the like.

FIG. 15 is a block diagram showing an example of the configuration of one embodiment of a computer on which a program that executes the series of processes described above is installed.

The program can be pre-recorded on the hard disk 105 or ROM 103 as a recording medium built into the computer.

Alternatively, the program can be stored (recorded) on a removable recording medium 111 driven by the drive 109. Such a removable recording medium 111 can be provided as so-called packaged software. Here, examples of the removable recording medium 111 include a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, a semiconductor memory, etc.

In addition to being installed in a computer from the removable recording medium 111 as described above, the program can also be downloaded to the computer via a communication network or broadcasting network and installed in the built-in hard disk 105. That is, the program can be transferred to the computer wirelessly from a download site via an artificial satellite for digital satellite broadcasting, or transferred to the computer via a wired connection via a network such as a LAN (Local Area Network) or the Internet.

The computer has a built-in CPU (Central Processing Unit) 102, to which an input/output interface 110 is connected via a bus 101.

When a command is input by the user via the input/output interface 110 by operating the input unit 107, the CPU 102 executes a program stored in the ROM (Read Only Memory) 103 accordingly. Alternatively, the CPU 102 loads a program stored on the hard disk 105 into the RAM (Random Access Memory) 104 and executes it.

As a result, the CPU 102 performs processing according to the above-mentioned flowchart, or processing performed by the configuration of the above-mentioned block diagram. Then, the CPU 102 outputs the processing results from the output unit 106 via the input/output interface 110, or transmits them from the communication unit 108, or even records them on the hard disk 105, as necessary.

The input unit 107 is composed of a keyboard, mouse, microphone, etc. The output unit 106 is composed of an LCD (Liquid Crystal Display), speaker, etc.

In this specification, the processing performed by a computer according to a program does not necessarily have to be performed in chronological order according to the order described in the flowchart. In other words, the processing performed by a computer according to a program also includes processing that is executed in parallel or individually (for example, parallel processing or processing by objects).

The program may be processed by one computer (processor), or may be distributed among multiple computers. Furthermore, the program may be transferred to a remote computer for execution.

Furthermore, in this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.

Also, for example, the configuration described above as one device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, the configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit). Also, it is of course possible to add configuration other than that described above to the configuration of each device (or each processing unit). Furthermore, as long as the configuration and operation of the system as a whole are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).

Also, for example, this technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.

Furthermore, for example, the above-mentioned program can be executed in any device. In that case, it is sufficient that the device has the necessary functions (functional blocks, etc.) and is capable of obtaining the necessary information.

Furthermore, for example, each step described in the above flowchart can be executed by one device, or can be shared and executed by multiple devices. Furthermore, if one step includes multiple processes, the multiple processes included in that one step can be executed by one device, or can be shared and executed by multiple devices. In other words, multiple processes included in one step can be executed as multiple step processes. Conversely, processes described as multiple steps can be executed collectively as one step.

In addition, the processing of the steps that describe a program executed by a computer may be executed chronologically in the order described in this specification, or may be executed in parallel, or individually at the required timing, such as when a call is made. In other words, as long as no contradictions arise, the processing of each step may be executed in an order different from the order described above. Furthermore, the processing of the steps that describe this program may be executed in parallel with the processing of other programs, or may be executed in combination with the processing of other programs.

Note that the multiple present technologies described in this specification can be implemented independently and individually, provided no contradictions arise. Of course, any multiple present technologies can also be implemented in combination. For example, some or all of the present technologies described in any embodiment can be implemented in combination with some or all of the present technologies described in other embodiments. Also, some or all of any of the present technologies described above can be implemented in combination with other technologies not described above.

<Examples of configuration combinations>
The present technology can also be configured as follows.
(1)
An information acquisition unit that acquires information necessary to calculate an optimal arrangement of the sound collection equipment, the information including at least information indicating a position or orientation of a sound collection device that collects a sound to be collected;
A calculation processing unit that calculates an optimal arrangement of the sound pickup equipment for picking up the sound of the sound pickup target based on the information by the information acquisition unit;
and an operation control unit that controls the position or orientation of the sound pickup equipment so as to achieve the arrangement calculated by the calculation processing unit.
(2)
The information acquisition unit acquires information indicating a position and an orientation of an imaging device that captures the sound collection target, and information indicating a position and an orientation of the sound collection target, and supplies the information to the arithmetic processing unit;
The information processing device described in (1) above, wherein the calculation processing unit calculates the optimal placement of the sound collection equipment as a direction toward the sound collection target at a position that is closest to the sound collection target, inside a recording range in which the direct sound of the sound collection target can be recorded when the sound axis of the sound collection equipment is directed toward the sound collection target, and outside a reflection range in which the sound will be reflected in the image captured by the filming equipment.
(3)
An input unit for inputting information used by the arithmetic processing unit is further provided,
The information processing device described in (2) above, wherein the input unit inputs information indicating the angle of view of the photographing equipment, information indicating the shape and directional characteristics of the sound collection equipment, and information indicating the shape of a moving device that moves the sound collection equipment to the calculation processing unit.
(4)
The information processing device according to (3) above, further comprising: a positional relationship specifying unit that specifies and stores a positional relationship between the sound collection equipment and the sound collection target before the shooting by the shooting equipment is started.
(5)
The information processing device described in (3) above, wherein the operation control unit controls the operation of the position or orientation of the sound collection equipment in accordance with a designation or adjustment of the position or orientation of the sound collection equipment input to the input unit before shooting by the photographing equipment begins.
(6)
The information processing device described in (3) above, wherein the operation control unit controls the operation of the position or orientation of the sound collection equipment so that the position is positioned as calculated by the calculation processing unit based on the information acquired before shooting is started by the photographing equipment.
(7)
The information processing device according to (3) above, wherein the calculation processing unit calculates an optimal arrangement of the sound collection equipment for collecting the sound of the sound collection target based on information indicating the position of a noise source that emits noise other than the sound collection target.
(8)
The information processing device according to (3) above, wherein the calculation processing unit calculates an optimal arrangement of the sound collection equipment for collecting the sound of the sound collection target based on information about an irradiation equipment that irradiates the sound collection target with illumination light.
(9)
The information processing device according to any one of (1) to (8) above, wherein when one directional sound recording device is used for a plurality of sound recording targets, the sound axis of the sound recording device is directed toward a midpoint between the sound recording targets.
(10)
When one directional sound recording device is used for multiple sound recording targets, the sound axis of the sound recording device is directed toward each of the sound recording targets according to the time at which each of the sound recording targets speaks. An information processing device as described in any of (1) to (9) above.
(11)
The information processing device according to any one of (1) to (10) above, wherein the sound collection equipment is omnidirectional for a plurality of the sound collection targets.
(12)
The information processing device according to any one of (1) to (11) above, wherein a plurality of the sound collection devices each having directivity are used for each of the plurality of sound collection targets.
(13)
An information processing device as described in any of (1) to (12) above, wherein a layout screen is displayed on a display unit, which displays areas suitable for placement of the sound recording equipment and areas inappropriate for placement of the sound recording equipment, and which displays at least an icon of the sound recording equipment.
(14)
The information processing device according to (13) above, wherein, if the placement of the sound pickup equipment is not appropriate, a message notifying the user of the cause is displayed on the placement screen.
(15)
The information processing device according to (13) or (14) above, wherein, when the placement of the sound pickup equipment is not appropriate, an alternative for appropriately placing the sound pickup equipment is presented on the placement screen.
(16)
The information processing device described in any of (1) to (15) above, wherein the operation control unit performs control to prioritize moving the moving device so as to avoid contact with another object or person when the moving device moving the sound collection equipment is about to come into contact with the other object or person.
(17)
The information processing device described in any of (1) to (16) above, wherein the sound collection equipment is connected via a microphone cable to a recording system that records sound, and the calculation processing unit controls the operation of a mobile device equipped with the sound collection equipment or one or more mobile devices that support the microphone cable so as to avoid the microphone cable being captured in an image captured by the filming equipment.
(18)
When using the sound pickup equipment having directivity, the information including both the position and the orientation of the sound pickup equipment is used,
The information processing device according to any one of (1) to (17) above, wherein when the sound pickup equipment is non-directional, the information including at least the position of the sound pickup equipment is used.
(19)
An information processing device acquires information including at least information indicating a position or orientation of a sound collection device that collects a sound of a sound collection target, and information necessary for calculating an optimal arrangement of the sound collection device;
Calculating an optimal arrangement of the sound pickup equipment for picking up the sound of the sound pickup target based on the information;
and controlling the position or orientation of the sound pickup equipment so as to achieve the arrangement.
(20)
The computer of the information processing device
Acquiring information necessary for calculating an optimal arrangement of the sound pickup equipment, the information including at least information indicating a position or orientation of the sound pickup equipment that picks up the sound of the sound pickup target;
Calculating an optimal arrangement of the sound pickup equipment for picking up the sound of the sound pickup target based on the information;
and controlling the position or orientation of the sound pickup equipment so as to achieve the arrangement.

Note that this embodiment is not limited to the above-described embodiment, and various modifications are possible without departing from the gist of this disclosure. Furthermore, the effects described in this specification are merely examples and are not limiting, and other effects may also be present.

11. Filming and sound recording system, 12. Filming camera, 13. Directional microphone, 14. Mobile device, 15. Information processing device, 16. Lighting equipment, 17. Omnidirectional microphone, 18. Microphone cable, 19. Recording system, 21. Sound recording target, 22. Noise source, 31. User input unit, 32. Operation control unit, 33. Information acquisition unit, 34. Positional relationship determination unit, 35. Memory unit, 36. Calculation processing unit, 41. Recordable range estimation unit, 42. Reflection range estimation unit, 43. Optimal placement calculation unit

Claims (20)

1. An information acquisition unit that acquires information necessary to calculate an optimal arrangement of the sound collection equipment, the information including at least information indicating a position or orientation of a sound collection device that collects a sound to be collected;
   A calculation processing unit that calculates an optimal arrangement of the sound pickup equipment for picking up the sound of the sound pickup target based on the information by the information acquisition unit;
   and an operation control unit that controls the operation of the position or orientation of the sound pickup equipment so as to achieve the arrangement calculated by the calculation processing unit.
2. The information acquisition unit acquires information indicating a position and an orientation of an imaging device that captures the sound collection target, and information indicating a position and an orientation of the sound collection target, and supplies the information to the arithmetic processing unit;
   The information processing device of claim 1, wherein the calculation processing unit calculates the optimal position of the sound collection equipment as a direction toward the sound collection target at a position that is closest to the sound collection target, inside a recording range in which the direct sound of the sound collection target can be recorded when the sound axis of the sound collection equipment is directed toward the sound collection target, and outside a reflection range in which the sound is reflected in the image captured by the photographing equipment.
3. An input unit for inputting information used by the arithmetic processing unit is further provided,
   The information processing device according to claim 2 , wherein the input unit inputs information indicating an angle of view of the photographing equipment, information indicating a shape and directional characteristics of the sound collecting equipment, and information indicating a shape of a moving device that moves the sound collecting equipment to the calculation processing unit.
4. The information processing apparatus according to claim 3 , further comprising a positional relationship specification unit that specifies and stores a positional relationship between the sound collection equipment and the sound collection target before shooting is started by the photographing equipment.
5. The information processing device according to claim 3 , wherein the operation control unit controls the operation of a position or orientation of the sound pickup equipment in accordance with a designation or adjustment of a position or orientation of the sound pickup equipment input to the input unit before shooting by the photographing equipment is started.
6. The information processing device according to claim 3 , wherein the operation control unit controls the operation of the position or orientation of the sound collection equipment so as to achieve a position calculated by the calculation processing unit based on the information acquired before the shooting is started by the photographing equipment.
7. The information processing device according to claim 3 , wherein the calculation processing unit calculates an optimal arrangement of the sound pickup equipment for picking up the sound of the sound pickup target, based also on information indicating a position of a noise source that emits noise other than the sound pickup target.
8. The information processing device according to claim 3 , wherein the calculation processing unit calculates an optimal arrangement of the sound collection equipment for collecting the sound of the sound collection target, based also on information on an irradiation equipment that irradiates the sound collection target with illumination light.
9. The information processing apparatus according to claim 1 , wherein, when one of the sound collection devices having directivity is used for a plurality of the sound collection targets, a sound axis of the sound collection device is directed to a midpoint between the sound collection targets.
10. The information processing device according to claim 1 , wherein when one sound collection device having directionality is used for a plurality of sound collection targets, the sound axis of the sound collection device is directed toward each of the sound collection targets according to the time at which each of the sound collection targets speaks.
11. The information processing apparatus according to claim 1 , wherein the sound collection device is non-directional for a plurality of the sound collection targets.
12. The information processing apparatus according to claim 1 , wherein a plurality of the sound collection devices each having directivity are used for a plurality of the sound collection targets.
13. The information processing device according to claim 1 , wherein a layout screen is displayed on a display unit, the layout screen displaying areas suitable for placement of the sound pickup equipment and areas unsuitable for placement of the sound pickup equipment, and displaying at least an icon of the sound pickup equipment.
14. The information processing device according to claim 13 , wherein, when the placement of the sound pickup devices is not appropriate, a message notifying the cause is displayed on the placement screen.
15. The information processing device according to claim 13 , wherein, when the placement of the sound pickup equipment is not appropriate, an alternative plan for appropriately placing the sound pickup equipment is presented on the placement screen.
16. The information processing device according to claim 1 , wherein the operation control unit performs control to prioritize moving the moving device so as to avoid contact with another object or person when the moving device moving the sound collection equipment is about to come into contact with the other object or person.
17. The information processing device according to claim 1, wherein the sound collection equipment is connected to a recording system that records sound via a microphone cable, and the calculation processing unit controls the operation of a mobile device equipped with the sound collection equipment or one or more mobile devices that support the microphone cable so as to prevent the microphone cable from appearing in an image captured by the filming equipment.
18. When using the sound pickup equipment having directivity, the information including both the position and the orientation of the sound pickup equipment is used,
    The information processing apparatus according to claim 1 , wherein when the sound pickup device is non-directional, the information including at least a position of the sound pickup device is used.
19. An information processing device acquires information including at least information indicating a position or orientation of a sound collection device that collects a sound of a sound collection target, and information necessary for calculating an optimal arrangement of the sound collection device;
    Calculating an optimal arrangement of the sound pickup equipment for picking up the sound of the sound pickup target based on the information;
    and controlling the position or orientation of the sound pickup equipment so as to achieve the arrangement.
20. The computer of the information processing device
    Acquiring information necessary for calculating an optimal arrangement of the sound pickup equipment, the information including at least information indicating a position or orientation of the sound pickup equipment that picks up the sound of the sound pickup target;
    Calculating an optimal arrangement of the sound pickup equipment for picking up the sound of the sound pickup target based on the information;
    and controlling the position or orientation of the sound pickup equipment so as to achieve the arrangement.

Images