JP2017175598A - Sound collecting device and sound collecting method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a sound collecting device and a sound collecting method capable of effectively collecting sound at a specified position.SOLUTION: The sound collecting device includes: a sound collecting position input interface for inputting a piece of information of sound collecting position of a voice, which represents a sound collecting position; a voice interface for inputting voice signals voices collected by two or more sound collecting parts which are disposed at predetermined positions; a record medium that stores a piece of sound collecting part disposition information, which represents a piece of disposition information of the sound collecting parts; and a controller that selects voice signals which are output by the sound collecting parts based on the information of the sound collecting positions and the sound collecting part disposition information.SELECTED DRAWING: Figure 3

Description

  The present disclosure relates to a sound collection device and a sound collection method for collecting sound.

  Patent Document 1 discloses a configuration in which when a specific subject is specified for a captured image, a synthesized audio signal corresponding to the subject is generated from a plurality of audio signals. With this configuration, it is possible to emphasize and reproduce only the sound of the designated subject.

JP 2008-193196 A

  The present disclosure provides a sound collection device and a sound collection method effective for collecting sound at a specified position.

  The sound collection device according to the present disclosure includes a sound collection position input interface for inputting sound collection position information indicating a sound collection position of the sound, and a sound signal collected by two or more sound collection units arranged in advance at a predetermined position. Based on the input audio interface, the recording medium storing the sound collection unit arrangement information indicating the arrangement information of the sound collection unit, the sound signal output by the sound collection unit based on the sound collection position information and the sound collection unit arrangement information A controller to be selected.

  In addition, the sound collection method according to the present disclosure includes a first step of inputting sound collection position information indicating a sound collection position of sound, and two or more sound signals collected by a sound collection unit arranged in advance at a predetermined position. A second step of inputting, and a third step of selecting an audio signal output by the sound collection unit based on the sound collection position information and the sound collection unit arrangement information indicating the arrangement information of the sound collection unit.

  The sound collection device and the sound collection method according to the present disclosure are effective for collecting sound at a designated position.

1 is a block diagram illustrating a configuration of a sound collection system including a sound collection device according to Embodiment 1. FIG. FIG. 3 is an overhead view showing an example of a relationship among a sound collection position, a microphone position, and an imaging range of a camera in the first embodiment. The flowchart which shows the process of the sound collection device in Embodiment 1. An overhead view showing an example of the relationship between the seat and the position of the microphone in the second embodiment An overhead view showing an example of a relationship between a sound collection position, a microphone position, and an obstacle arrangement in the third embodiment Flowchart showing the processing of the sound collection device in the third embodiment

  Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.

  The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

(Embodiment 1)
1. Configuration of Sound Collection System and Sound Collection Device FIG. 1 is a block diagram illustrating a configuration of a sound collection system including the sound collection device according to the present embodiment. In FIG. 1, the sound collection system includes a sound collection device 100, a client 200, a camera 301a, a camera 301b, a microphone 302a, and a microphone 302b. Here, the camera 301 a and the camera 301 b are collectively referred to as a camera (imaging unit) 301. In this embodiment, a configuration including two cameras 301 is described; however, one or more cameras 301 may be used. In addition, the microphone 302 a and the microphone 302 b are collectively referred to as a microphone (sound collecting unit) 302. In this embodiment mode, a configuration including two microphones 302 is described; however, it is sufficient that the number of microphones 302 is two or more.

  The sound collection device 100 includes a CPU (controller) 101, a memory (recording medium) 102, a network interface (sound collection position input interface) 103, a video interface 104, and an audio interface 105.

  The CPU 101 executes a computer program stored in the memory 102 and selects an optimum microphone among the microphones 302 used for sound collection. By this selection, the audio data output from the microphone 302 is selected. An optimum microphone selection method will be described later.

  The memory (recording medium) 102 stores the position coordinates where the camera 301 and the microphone 302 are arranged in a coordinate system arbitrarily set in the space where the sound collection system is arranged. The position coordinates of the microphone 302 are an example of sound collection unit arrangement information indicating arrangement information of the microphone 302. The position coordinates of the camera 301 are an example of image capturing unit arrangement information indicating the arrangement of the camera 301.

  In addition, the memory 102 stores specific position information indicating one or more specific positions in a predetermined space. Specific position information includes a sound collection position, a position of a seat arranged in a predetermined space, and the like (details will be described later).

  The network interface (sound collection position input interface) 103 is an interface for the sound collection device 100 to communicate with the client 200. The network interface 103 receives sound collection position information indicating a sound collection position. Specifically, the network interface 103 receives a pixel position (an example of sound collection position information) on the video data indicating the sound collection position of the audio from the client 200 and sends it to the CPU 101. The network interface 103 transmits video data and audio data sent from the CPU 101 to the client 200.

  The video interface 104 is an interface for connecting the camera 301 and the CPU 101. Specifically, the video interface 104 is connected to one or more cameras (imaging units) 301 that capture a predetermined range of video that is arranged in advance at a predetermined position.

  The audio interface 105 is an interface for connecting the microphone 302 and the CPU 101. Two audio signals picked up by a microphone (sound pickup unit) 302 arranged in advance at a predetermined position are input to the audio interface 105.

  The client 200 includes a CPU 201, a memory 202, a network interface 203, and an input / output interface 206. The client 200 is connected to the sound collection device 100 via the network interface 203.

  The input / output interface 206 includes, for example, a display 206a, a touch panel 206b, and a speaker 206c. The display 206 a can receive and display the video data captured by the camera 301 via the sound collection device 100. The user can designate a specific position in the video using the touch panel 206b attached on the display 206a. The speaker 206c can receive and reproduce the audio data collected by the microphone 302 via the sound collection device 100.

  The camera 301 is installed, for example, on a ceiling portion in an aircraft cabin. The camera 301 transmits the captured video data to the sound collection device 100.

  The microphone 302 is installed, for example, on a ceiling in an aircraft cabin. The microphone 302 transmits the collected sound data to the sound collection device 100.

  The CPU 101 is an example of a controller. The memory 102 is an example of a recording medium. The network interface 103 is an example of a sound collection position input interface that inputs sound collection position information indicating a sound collection position. The camera 301 is an example of an imaging unit. The microphone 302 is an example of a sound collection unit.

2. Operation of Sound Collection Device The operation of the sound collection device 100 configured as described above will be described below.

  FIG. 2 is an overhead view showing an example of the relationship between the sound collection position, the position of the microphone 302, and the imaging range of the camera 301. In FIG. 2, the camera 301 is installed on the ceiling in an aircraft cabin, for example. Therefore, the imaging range is within the frame shown in FIG. The passenger's head and nose as seen from above are shown near the center of the imaging range in FIG. From the position of the head and nose, it can be seen that the passenger is facing left in the figure. That is, the passenger is considered to be standing (or sitting) with the microphone 302a in front and the microphone 302b in the back. Here, the sound collection position P is designated as an arbitrary position within the imaging range. In FIG. 2, the sound collection position P indicates a position where a passenger is present.

  The microphone 302a is arranged at a position in the figure separated from the sound collection position P (position where the passenger is present) by a distance Da, and the position coordinate is represented as a microphone position Pa. That is, the microphone 302a is located at a location Pa that is in front of the passenger and is separated from the passenger by a distance Da.

  The microphone 302b is disposed at a position in the figure separated from the sound collection position P by a distance Db, and the position coordinate is represented as a microphone position Pb. That is, the microphone 302b is located at a place Pb behind the passenger and separated from the passenger by a distance Db. Note that the microphone 302 may be disposed outside the imaging range of the camera 301.

  In the following, the operation of the sound collection device in the present embodiment will be described by taking as an example the case where there is an arrangement relationship as described above.

  FIG. 3 is a flowchart showing processing of the sound collection device 100 according to the present embodiment.

  In FIG. 3, first, the sound collection device 100 calculates a sound collection position P when receiving a designation of a sound collection position (a place where a certain passenger is present in the aircraft) from the client 200 (S <b> 101).

  The sound collection position P is specified as follows, for example. The input / output interface 206 in the client 200 includes a display 206a and a touch panel 206b (see FIG. 1). The display 206 a receives and displays video data captured by the camera 301 via the sound collection device 100. Then, the user designates an arbitrary position in the video displayed on the display 206a using the touch panel 206b. Then, the CPU 201 in the client 200 calculates a pixel position (an example of sound collection position information) corresponding to the designated position in the video. Then, the calculated pixel position is transmitted to the sound collection device 100 via the network interface 203. As a result, the CPU 101 in the sound collection device 100 uses the video data captured by the camera 301 and the camera position as the coordinates for the coordinate system arbitrarily set in the space where the sound collection system is arranged. The sound collection position P is calculated from the pixel position inside.

  Next, the CPU (controller) 101 in the sound collection device 100 determines whether or not a person (passenger) exists within a certain distance range from a specified position in the video. The fixed distance is usually a distance of several centimeters to several meters.

  Determination of whether or not a person exists is performed as follows. The CPU 101 recognizes the position of the person's (passenger's) head and nose from the image shown in the imaging range. If the CPU 101 determines that there is a person, the CPU 101 recognizes the positions of the person's head and nose, and calculates the face direction X indicating the direction in which the person is facing as the sound collection direction (S102). Here, the sound collection direction is a direction in which a target that produces sound to be collected produces sound, in other words, a direction in which collected sound is produced. That is, in the case of a person (passenger), since the utterance is made in the face direction X, which is the direction in which the person is facing, the face direction X is specified as the sound collection direction.

  Further, the CPU 101 calculates a weighting factor for each microphone 302 based on the relative position based on the sound collection position P and the face direction X (S103). Here, the determination method of the weighting coefficient in this Embodiment is demonstrated using FIG.

  The CPU 101 gives a weighting coefficient w1 to the microphone 302 existing within the angle range of −θ to + θ with the sound collection position P as the center and the direction indicated by the face direction X as a reference. Further, the CPU 101 gives a weight coefficient w2 having a value larger than w1 to the microphone 302 existing outside the angle range of −θ to + θ. That is, in the case of the arrangement relationship shown in FIG. 2, w1 is given to the microphone 302a existing within the angle range of −θ to + θ, and w2 is given to the microphone 302b existing outside the angle range of −θ to + θ. It is done.

  The values of the angle θ and the weighting factors w1 and w2 are determined as prior information based on, for example, knowledge about the dependence relationship between the volume level attenuation of the speech uttered by the person and the angle with respect to the person's face direction. The values of the angle θ and the weighting factors w1 and w2 are stored in the memory 102 in the sound collection device 100 as processing parameters of the CPU 101.

  Next, based on the coordinates of the microphone positions Pa and Pb stored in the memory (recording medium) 102 and the calculated coordinates of the sound pickup position P, the CPU 101 starts the microphones 302a and Linear distances Da and Db up to 302b are calculated (S104).

  Further, the CPU 101, based on the weighting factors w1 and w2 determined for each microphone 302 and the calculated linear distances Da and Db, weighted distances Dwa from the sound collection position P to the microphones 302a and 302b, and Dwb is calculated (S105).

Here, the weighted distances Dwa and Dwb are calculated by the following relational expression, for example.
Dwa = Da × w1
Dwb = Db × w2
Finally, the CPU 101 selects an audio signal corresponding to the microphone 302 that minimizes the weighted distance from the calculated sound collection position P to each microphone 302 (S106). That is, the CPU (controller) 101 determines the weight coefficient determined by the relative positional relationship between the position indicated by the sound collection position information and the position indicated by each sound collection unit arrangement information, and the sound collection position P and each sound collection unit. The audio signal corresponding to the sound collection unit having the smallest weighted distance calculated based on the straight line distance is selected.

  The selected audio signal is transmitted to the client 200, for example. Then, it is reproduced by the speaker 206c included in the input / output interface 206 so that the user can listen. Thereby, the process of the sound collection apparatus 100 is complete | finished.

  As described above, the sound collection device 100 according to the present embodiment gives the weight coefficient w1 to the microphone 302 existing in the angle range of −θ to + θ with the face direction X as a reference. A weight coefficient w2 having a value larger than w1 is given to the microphone 302 existing outside the angle range of −θ to + θ. For this reason, the weighted distance of the microphone 302 existing within the angle range of −θ to + θ tends to be a relatively small value.

  That is, the CPU 101 determines the weight coefficient (w1, w2) determined by the relative positional relationship between the position indicated by the sound collection position information and the position indicated by each sound collection unit arrangement information, the sound collection position P, and each microphone (sound collection). Part) 302 is selected based on the straight line distance (Da, Db) and the sound signal corresponding to the sound collecting part having the smallest weighted distance (Dwa, Dwb).

  By such a selection method, the microphone 302 that exists in the angle range of −θ to + θ, that is, the microphone 302 that exists in the face direction X where the volume level attenuation amount of the speech uttered by a human is small can be easily selected. Therefore, the sound collection device 100 according to the present embodiment can effectively collect the sound at the designated position.

  For the weighting factors w1 and w2, for example, the value of the weighting factor w2 given to the microphone 302 existing outside the angle range of −θ to + θ may be set as a very large value with respect to w1. In this case, the weighted distance corresponding to the microphone 302 existing outside the angle range of −θ to + θ is sufficiently larger than the weighted distance corresponding to the microphone 302 existing within the angle range of −θ to + θ. . For this reason, when selecting the microphone 302 having the smallest weighted distance, the microphone 302 existing outside the angle range of −θ to + θ can be prevented from being selected. That is, the CPU 101 collects the sound collection position information and the sound collection information among the microphones 302 existing within a predetermined angle range (−θ to + θ) centered on the sound collection direction (face direction X) with respect to the sound collection position P. The sound signal corresponding to the microphone 302 having the smallest linear distance between the sound collection position P calculated based on the sound part arrangement information and each microphone 302 is selected.

  Further, without using the weighting factors w1 and w2, the CPU 101 causes the microphone 302 to be within a predetermined angle range (−θ to + θ) with the sound pickup direction (face direction X) as the center with respect to the sound pickup position P. Of these, an audio signal corresponding to the microphone 302 having the smallest linear distance between the sound collection position P and each microphone 302 may be selected.

  By the above-described method, an optimum microphone is selected, and sound collection at a designated position is effectively performed.

  The coordinate system arbitrarily set in the space in which the sound collection system is arranged may be a two-dimensional coordinate system ignoring height information or a three-dimensional coordinate system considering height information. In the case of a three-dimensional coordinate system, the height of the sound collection position is calculated based on video data captured by two or more cameras 301 and the position coordinates of the cameras 301 stored in the memory 102.

3. Effects As described above, in the present embodiment, the sound collection device 100 is arranged at a predetermined position in advance with the network interface (sound collection position input interface) 103 for inputting the sound collection position information indicating the sound collection position of the sound. An audio interface 105 for inputting two or more audio signals collected by the microphone 302, a memory (recording medium) 102 for storing sound collection unit arrangement information indicating arrangement information of the microphone 302, sound collection position information, And a CPU (controller) 101 that selects an audio signal output from the microphone (sound collecting unit) 302 based on the sound collecting unit arrangement information.

  As a result, the CPU 101 can easily select the microphone 302 that easily collects sound at the designated position.

(Embodiment 2)
The second embodiment will be described with reference to FIGS. 3 and 4.

  FIG. 4 is an overhead view (part of the layout diagram) showing an example of the relationship between the seats 401 a, 401 b and 401 c and the position of the microphone (sound collecting unit) 302. The sound collection system of the second embodiment is different from the first embodiment in the sound collection position P calculation method (step S101) and the sound collection direction calculation in the microphone selection process in the sound collection apparatus shown in FIG. It is a method (step S102). Since the configuration and operation of the other parts are the same as in the first embodiment (see FIG. 1), detailed description is omitted.

  First, the calculation method (step S101) of the sound collection position P of the sound collection device 100 in the present embodiment will be described. The input / output interface 206 in the client 200 in this embodiment includes a display 206a and a touch panel 206b (see FIG. 1). A memory 202 in the client 200 stores data of a layout of seats arranged at predetermined positions in the space.

  The display 206a displays this layout drawing. The user can designate an arbitrary seat using the touch panel while looking at the layout diagram displayed on the display 206a. When the user designates an arbitrary seat, the client 200 transmits the designated seat number (sound collection position information) to the sound collection device 100 via the network interface 203 in the client 200.

  The memory 102 (recording medium) in the sound collection device 100 stores an arrangement database that associates seat position coordinates and seat numbers in a coordinate system arbitrarily set in a space in which the sound collection system is arranged. . That is, the position of a seat arranged in a predetermined space is specific position information indicating a specific position, and this specific position information is stored in the memory 102.

  In addition, since a passenger sits on a seat, the position of the seat arrange | positioned in the predetermined space can become a sound collection position. Therefore, when the designation of the seat number is accepted, the sound collection device 100 refers to the seat arrangement database stored in the memory 102 and determines the position coordinate of the seat corresponding to the designated seat number as the sound collection position P. To do.

  Next, a method for calculating the sound collection direction (step S102) in the present embodiment will be described. In the present embodiment, the seat arrangement direction Y corresponding to the designated seat number is determined as the sound collection direction. The seat arrangement direction Y refers to the direction in which the front surface of the seat back (the surface on which the seated person's back contacts) is facing. That is, the seat arrangement direction Y indicates the direction in which the passenger's face is normally facing when the passenger (person) is seated on the seat.

  Here, when the arrangement direction of the seats in the space is a constant direction for all the seats, the arrangement direction Y of the seats is set as a processing parameter of the CPU (controller) 101 in the sound collection device 100. May be. Further, when the arrangement direction of the seats in the space differs depending on the seats, the arrangement direction Y of the seats may be stored as information associated with the seat number in the seat arrangement database. Further, the CPU 101 may read the seat arrangement direction Y corresponding to the designated seat number from the seat arrangement database, and use this as the sound collection direction. Since the subsequent processing is the same as that of the first embodiment, detailed description thereof is omitted.

  In order to clarify the difference in the sound collection direction between the first embodiment and the second embodiment, a description will be given with reference to FIG. In FIG. 4, a seat 401 is illustrated by extracting seats 401a, 401b, and 401c as a part of the seats arranged in the space. Of these, it is assumed that the seat 401b is designated as the sound collection position P.

  The microphone 302a is disposed at a position in the figure separated from the sound collection position P (position where the passenger is seated) by a distance Da, and the position coordinate is represented as a microphone position Pa. That is, the microphone 302a is located at a location Pa that is in front of the seated passenger and is separated from the passenger by a distance Da.

  The microphone 302b is disposed at a position in the figure separated from the sound collection position P by a distance Db, and the position coordinate is represented as a microphone position Pb. That is, the microphone 302b is located at a location Pb behind the seated passenger and separated from the passenger by a distance Db.

  These displays are obtained by simply replacing the face direction X in FIG. 2 with the seat arrangement direction Y, and the processing method is the same. As a result, the microphone 302 that exists within the angle range of −θ to + θ, that is, the microphone 302 that exists in front of the seat arrangement direction with a small attenuation level of the volume level of the sound emitted at the seat position is selected. It becomes easy.

  For example, the CPU (controller) 101 in the sound collection device 100 includes a weight coefficient (w1, w2) determined based on a relative positional relationship with each sound collection unit arrangement information with respect to the arrangement direction Y of the seat, and a sound collection position. Audio signal corresponding to the microphone (sound collecting unit) 302 having the smallest weighted distance (Dwa, Dwb) calculated based on the linear distance (Da, Db) between P and each microphone (sound collecting unit) 302 Select.

  The sound collection position P is selected from one or more seats arranged in a predetermined direction, and the CPU 101 selects a microphone (sound collection unit) 302 in a predetermined direction with respect to the sound collection position P. Thus, the sound collection unit having the shortest linear distance between the sound collection position P calculated based on the sound collection position information and the sound collection unit arrangement information and each microphone (sound collection unit) 302 may be selected. Furthermore, the predetermined direction may be a forward direction with respect to the sound collection position P.

(Embodiment 3)
The third embodiment will be described with reference to FIGS. Since the configuration of the sound collection system in the third embodiment is the same as that in the first embodiment (see FIG. 1), detailed description thereof is omitted. For example, the configuration for designating the sound collection position P is the same as in the first embodiment.

  FIG. 5 is an overhead view (part of the layout diagram) showing an example of the relationship between the sound collection position P, the position of the microphone 302 (sound collection unit), and the obstacle. In FIG. 5, the arranged obstacle has the same height as the space. That is, it shows a simple example that can be handled as a two-dimensional coordinate system that can ignore the height information of the sound collection position P, the position Pa of the microphone 302a, and the position Pb of the microphone 302b.

  It is assumed that the origin O of the coordinate system discretized with respect to the space arbitrarily set in the space is set at a position in the drawing. In this discretized coordinate system, dx is the minimum unit of distance defined in the x direction (right direction in FIG. 5). dy is the minimum unit of distance defined in the y direction (downward direction in FIG. 5). Here, the position of a person or an object is represented by an integer multiple of dx and dy.

  When the sound collection position P in the figure is designated as an arbitrary position according to this coordinate system, the coordinates are (3dx, 4dy).

  The microphone 302a is arranged at a position in the figure, and its position coordinate Pa is (3dx, dy). Similarly, the microphone 302b is arranged at a position in the figure, and its position coordinate Pb is (3dx, 6dy).

  In addition, an object having the same height as the space is arranged as an obstacle at a position in the drawing. Specifically, (2dx, 2dy), (3dx, 2dy), (4dx, 2dy), (2dx, 3dy), (3dx, 3dy) are coordinates corresponding to the arrangement range of the object on the discretized coordinates. ), (4dx, 3dy) are stored as a database (object arrangement information) in the memory (recording medium) 102 in the sound collection device 100.

  In the following, the operation of the sound collection device 100 in the present embodiment will be described by taking as an example the case where there is an arrangement relationship as described above.

  FIG. 6 is a flowchart showing processing of the sound collection device 100 according to the present embodiment. In FIG. 6, when the sound collection device 100 receives the designation of the sound collection position from the client 200, the sound collection device 100 calculates the sound collection position P (S301). The sound collection position P is designated by a method similar to the method described in the first embodiment. Based on the sound collection position P and the coordinates of the microphones 302a and 302b, the CPU (controller) 101 calculates an equation of a line segment connecting the sound collection position P and each of the position Pa of the microphone 302a and the position Pb of the microphone 302b. Calculate (S302).

For example, assuming that the coordinates of the sound collection position P are (Px1, Py1) and the coordinates of the position of a certain microphone 302 are (Px2, Py2), the equation of the line segment connecting the sound collection position P and the position of the microphone 302 is as follows: It is expressed as follows.
(I) When Px1 ≠ Px2,
Y = (Py2-Py1) / (Px2-Px1) * (X-Px1) + Py1
However, Px1 <= X <= Px2 (Px1 <Px2)
(Ii) When Px1 = Px2 and Py1 ≠ Py2,
X = Px1
However, Py1 <= Y <= Py2 (assuming Py1 <Py2)
In the case of the example shown in FIG. 5, the equation of the line segment connecting the sound collection position P and the position Pa of the microphone 302a is
X = 3 dx, where 1 dy <= Y <= 4 dy
And the equation of the line segment connecting the sound pickup position P and the position Pb of the microphone 302b is
X = 3 dx, where 4 dy <= Y <= 6 dy
It becomes.

  Next, the CPU (controller) 101 has no object on a line segment connecting the sound collection position P and the position of each microphone 302 based on the sound collection position P, the position of each microphone 302 and the object arrangement information. Among the microphones 302, an audio signal corresponding to the microphone 302 having the smallest linear distance between the sound collection position P and the position of each microphone 302 is selected. More specifically, the CPU 101 first determines whether or not there is one or more microphones 302 such that no object exists between the sound pickup position P and the sound pickup position P. Specifically, the CPU 101 determines whether or not each of the calculated line segment equations passes through the object arrangement range. The CPU 101 determines that the microphone 302 corresponding to the line segment that does not pass through the object arrangement range (does not cross the obstacle) is the microphone 302 in which no object exists between the sound collection position P (S303). The memory (recording medium) 102 stores digital values of all coordinates corresponding to the existence range of the object as a database in a coordinate system arbitrarily set in the space.

  Then, the CPU 101 calculates digital values of all possible coordinates for the line segment equation calculated in step S302 and compares them with the coordinates of the object stored in the database stored in the memory 102. It is determined whether or not the line segment passes through the object arrangement range.

  In the case of the example shown in FIG. 5, the coordinate values corresponding to the arrangement range of the object are (2dx, 2dy), (3dx, 2dy), (4dx, 2dy), (2dx, 3dy), (3dx, 3dy), ( 4dx, 3dy), and an equation of a line segment connecting the sound collection position P and the position Pa of the microphone 302a can take the coordinate values of (3dx, 2dy) and (3dx, 3dy). Therefore, it is determined that the line segment connecting the sound pickup position P and the position Pa of the microphone 302a passes through the object arrangement range. On the other hand, it is determined that the line segment connecting the sound pickup position P and the position Pb of the microphone 302b does not pass through the object arrangement range. As described above, the CPU 101 identifies the microphone 302 having no object on the line segment connecting the sound collection position P and the position of each microphone 302.

  When the CPU 101 determines that there is one or more microphones 302 corresponding to a line segment that does not pass through the object arrangement range (Yes in S303), the CPU 101 determines that the microphones 302 that are determined not to pass through the object arrangement range are included. An audio signal corresponding to the microphone 302 having the smallest linear distance from the sound position P to each microphone 302 is selected (S304).

  That is, the CPU (controller) 101 collects the sound collection position information and the sound collection among the microphones (sound collection units) 302 having no object on the line segment connecting the sound collection position P and each microphone (sound collection unit) 302. The sound signal corresponding to the microphone (sound collecting unit) 302 having the shortest linear distance between the sound collecting position P calculated based on the part arrangement information and each microphone (sound collecting unit) 302 is selected. Further, the CPU 101 is calculated based on a weighting factor that varies depending on whether an object exists on a line segment connecting the sound collection position P and each microphone 302 and a linear distance between the sound collection position P and each microphone 302. An audio signal corresponding to the microphone 302 having the smallest weighted distance may be selected.

  When the CPU 101 determines that any microphone 302 passes through the object arrangement range (No in S303), the CPU 101 corresponds to the microphone 302 having the smallest linear distance among the linear distances from the respective microphones 302 to the sound pickup position P. The audio signal to be selected is selected (S305).

  In the case of the example shown in FIG. 5, in step S303, it is determined that the microphone 302 corresponding to the line segment that does not pass through the object arrangement range is only the microphone 302b. That is, among the microphones corresponding to the line segments that do not pass through the object arrangement range, the microphone 302 having the minimum distance to the sound collection position P is the microphone 302b, and therefore the audio signal corresponding to the microphone 302b is selected. . As a result, it is easy to select the microphone 302 in which no object exists on the line segment connecting the sound collection position P and the position of the microphone 302, that is, the sound volume level attenuation amount is small due to the obstacle.

  In this embodiment, for the sake of simplification of explanation, a case where a coordinate system arbitrarily set in the space where the sound collection system is arranged can be treated as a two-dimensional coordinate system ignoring height information is explained. However, a three-dimensional coordinate system that takes height information into consideration may be used. In the case of a three-dimensional coordinate system, the height of the sound collection position is calculated based on video data captured by two or more cameras 301 and the position coordinates of the cameras 301 stored in the memory 102.

(Other embodiments)
As described above, Embodiments 1 to 3 have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to embodiments in which changes, replacements, additions, omissions, and the like are performed. In addition, it is possible to combine the components described in the first, second, and third embodiments to form a new embodiment. Therefore, other embodiments will be exemplified below.

  In the first to third embodiments, the sound collection device 100 that appropriately selects the microphone 302 in the sound collection system in which a plurality of microphones (sound collection units) 302 are arranged in the space has been described. However, each of the microphones 302 arranged in the space may be replaced with a microphone array composed of a plurality of microphone elements, and a sound collection device that selects a sound signal obtained as a result of signal processing of the sound signal of the microphone element may be used.

  In the first to third embodiments, the sound collection device 100 that selects one microphone 302 that is most suitable for sound collection in the sound collection system in which a plurality of microphones 302 is arranged in the space has been described. However, a sound collecting device may be used in which sound signals from the plurality of microphones 302 are weighted and added based on each predetermined condition, and the weighted and summed sound signals are selected as sound signals to be picked up. Specifically, in FIGS. 2 and 4, the weighting of the sound signal from the microphone 302 existing in the angle range of −θ to + θ is relatively increased, and the sound from the microphone 302 existing in the other range is set. The weighting addition may be performed with a relatively small weighting for the signal. Furthermore, when there are a plurality of microphones 302 within the angle range of −θ to + θ, the weighting may be increased as the distance between the sound collection position P and the microphone position is shorter, and the weighting may be decreased as the distance is increased. .

  In the third embodiment, among the microphones 302 in which no object is present on the line segment connecting the sound pickup position P and the microphone position, the sound corresponding to the microphone 302 having the smallest linear distance from the sound pickup position P to the microphone 302. A sound collection device for selecting a signal has been described. However, based on the object arrangement information, a different weighting factor is calculated depending on whether or not the object exists on a line segment connecting the sound collection position and the position of each microphone 302, and the distance from the sound collection position to the microphone 302 is calculated. A sound collection device that selects a sound signal corresponding to the microphone 302 having the smallest weighted distance calculated by multiplying the linear distance by this weighting coefficient may be used.

  Note that the above-described embodiments are for illustrating the technique in the present disclosure, and therefore various modifications, replacements, additions, omissions, and the like can be made within the scope of the claims and the equivalents thereof.

  The present disclosure is applicable to a sound collection device that collects sound at a specified position. Specifically, the present disclosure is applicable to a sound collection device or the like installed in a cabin of a moving body such as an aircraft.

100 sound pickup device 101 CPU (controller)
102 Memory (recording medium)
103 Network interface (sound pickup position input interface)
104 Video interface 105 Audio interface 200 Client 201 CPU
202 Memory 203 Network Interface 206 Input / Output Interface 206a Display 206b Touch Panel 206c Speaker 301 Camera (Imaging Unit)
301a camera 301b camera 302 microphone (sound collecting unit)
302a microphone 302b microphone 401 seat 401a seat 401b seat 401c seat

Claims (20)

A sound collection position input interface for inputting sound collection position information indicating a sound collection position;
An audio interface for inputting two or more audio signals to be collected by a sound collection unit arranged in advance at a predetermined position;
A recording medium storing sound collection unit arrangement information indicating arrangement information of the sound collection unit;
A sound collection device comprising: a controller that selects an audio signal output by the sound collection unit based on the sound collection position information and the sound collection unit arrangement information. The controller is
Of the sound collection units within a predetermined angle range centered on the sound collection direction with the sound collection position as a reference, the sound collection unit is calculated based on the sound collection position information and the sound collection unit arrangement information. Selecting an audio signal corresponding to the sound collection unit having the shortest linear distance between the sound position and each sound collection unit;
The sound collecting device according to claim 1. A video interface that inputs a video image of one or more imaging units that are arranged in advance at a predetermined position and that captures a video image of a predetermined range;
The recording medium further stores imaging unit arrangement information indicating the arrangement of the imaging unit,
The controller determines the face direction of the person reflected within a certain distance range from the sound collection position,
The face direction is the sound collection direction,
The sound collecting device according to claim 2. The recording medium stores specific position information indicating one or more specific positions in a predetermined space,
The sound collection position is selected from the one or more specific positions.
The sound collecting device according to claim 2. The specific position is a position of a seat arranged in a predetermined space.
The sound collecting device according to claim 4. The sound collection direction is a direction in which a seat is arranged.
The sound collecting device according to claim 5. The controller is calculated based on a weighting factor determined by a relative positional relationship between the sound collection position information and each sound collection unit arrangement information, and a linear distance between the sound collection position and each sound collection unit. Selecting an audio signal corresponding to the sound collection unit having the smallest weighted distance.
The sound collecting device according to claim 1. A video interface for inputting video output from one or more imaging units that are pre-arranged at a predetermined position and capture a video in a predetermined range;
The recording medium further stores imaging unit arrangement information indicating the arrangement of the imaging unit,
The controller determines a face direction of a person reflected within a certain distance range from the sound collection position,
Weighted distance calculated based on a weighting factor determined by a relative positional relationship with each of the sound collecting unit arrangement information with respect to the face direction, and a linear distance between the sound collecting position and each of the sound collecting units. Select the audio signal corresponding to the sound collection part where
The sound collecting device according to claim 7. The recording medium stores specific position information indicating one or more specific positions in a predetermined space,
The sound collection position is selected from the one or more specific positions.
The sound collecting device according to claim 7. The specific position is a position of a seat arranged in a predetermined space.
The sound collecting device according to claim 9. The controller is based on a weighting factor determined by a relative positional relationship with each of the sound collection unit arrangement information with respect to a direction in which a seat is arranged, and a linear distance between the sound collection position and each of the sound collection units. Select the audio signal corresponding to the sound collection unit with the smallest weighted distance calculated by
The sound collecting device according to claim 10. The controller includes the sound collection position calculated based on the sound collection position information and the sound collection unit arrangement information among the sound collection units in a predetermined direction with respect to the sound collection position, and Selecting an audio signal corresponding to the sound collection unit having the smallest linear distance to the sound collection unit;
The sound collecting device according to claim 1. The sound collection position is selected from one or more seats arranged in a predetermined direction,
The controller is configured to calculate the sound collection position and the sound collection units calculated based on the sound collection position information and the sound collection unit arrangement information among the sound collection units in the forward direction with respect to the sound collection position. Select the sound pickup part with the smallest linear distance to
The sound collecting device according to claim 12. The recording medium further stores arrangement information of an object fixedly arranged in a predetermined space,
The controller specifies a sound collection unit where the object does not exist on a line segment connecting the sound collection position and each of the sound collection units based on the arrangement information of the object, and identifies the object on the line segment. Among the non-existing sound collecting units, the sound collecting unit having the shortest linear distance between the sound collecting position calculated based on the sound collecting position information and the sound collecting unit arrangement information and each sound collecting unit. Select the corresponding audio signal,
The sound collecting device according to claim 1. The recording medium further stores arrangement information of an object fixedly arranged in a predetermined space,
The controller, based on the arrangement information of the object, a weighting factor that differs depending on whether or not the object exists on a line segment connecting the sound collection position and each sound collection unit, the sound collection position and each of the sound collection positions Selecting an audio signal corresponding to the sound collection unit that has the smallest weighted distance calculated based on the linear distance to the sound collection unit;
The sound collecting device according to claim 1. A first step of inputting sound collection position information indicating a sound collection position;
A second step of inputting two or more audio signals collected by a sound collection unit arranged in advance at a predetermined position;
A sound collecting method comprising: a third step of selecting an audio signal output by the sound collecting unit based on the sound collecting position information and sound collecting unit arrangement information indicating arrangement information of the sound collecting unit. The third step includes a weighting factor determined by a relative positional relationship between the position indicated by the sound collection position information and the position indicated by the sound collection unit arrangement information, and the sound collection position and each sound collection unit. Selecting an audio signal corresponding to the sound collection unit having the smallest weighted distance calculated based on the linear distance;
The sound collection method according to claim 16. The third step includes: the sound collection position calculated based on the sound collection position information and the sound collection section arrangement information among the sound collection sections in a predetermined direction with respect to the sound collection position; Selecting an audio signal corresponding to the sound collection unit having the smallest linear distance to each sound collection unit;
The sound collection method according to claim 16. In the third step, a sound collection unit where the object does not exist is specified on a line segment connecting the sound collection position and each sound collection unit based on the arrangement information of the object fixedly arranged in a predetermined space. Of the sound collection units where the object does not exist on the line segment, the sound collection position calculated based on the sound collection position information and the sound collection unit arrangement information and each of the sound collection units Selecting an audio signal corresponding to the sound pickup part having the smallest linear distance;
The sound collection method according to claim 16. The third step differs depending on whether or not the object exists on a line segment connecting the sound collection position and each sound collection unit based on the arrangement information of the object fixedly arranged in a predetermined space. A weighting factor is calculated, and an audio signal corresponding to the sound collecting unit having the smallest weighted distance calculated based on the weighting factor and the linear distance between the sound collecting position and each sound collecting unit is calculated. select,
The sound collection method according to claim 16.

Images