JP2015088887A - Sound recording apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform sound recording with small noise and high quality having stable recording level.SOLUTION: A sound recording apparatus comprises: sound recording means for sound recording a subject in an imaging direction; sound recording means for sound recording sound in a specified direction; direction control means for controlling so that the specified direction is always constant even when the imaging direction is changed; and sound recording control means for controlling a recording condition on the basis of relation between the imaging direction and the specified direction.

Description

  The present invention relates to an apparatus capable of recording sound. In particular, the present invention relates to a recording apparatus for recording a plurality of sounds together with photographing.

  It is desired that a sound processing apparatus can acquire / record a faithful sound under various environments. However, in practice, sounds other than the main subject are also recorded as noise.

  Many mechanical devices / electrical processes have been proposed to alleviate this problem.

  Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for recording a sound by combining a plurality of subjects with a plurality of microphones having directivity in the direction and synthesizing those audio signals. In such a configuration, it can be expected that background noise can be reduced.

JP 2006-222618 A

  However, the conventional techniques disclosed in the above-mentioned patent documents do not consider the movement of the subject. For example, when two subjects are adjacent to each other or overlap, there is a problem that the recording level changes. there were.

  Accordingly, an object of the present invention is to always maintain a stable recording level even when a subject moves.

Recording means for recording the subject in the shooting direction, recording means for recording the designated direction,
Direction control means for controlling the designated direction to be always constant even if the shooting direction changes,
The recording apparatus is composed of recording control means for controlling recording conditions based on the relationship between the recording direction and the designated direction.

  According to the present invention, a stable recording level can always be maintained by combining a simple microphone structure with signal processing and camera direction detection means.

Block diagram of the first embodiment of the present invention Operational explanatory diagram of the first embodiment of the present invention Flowchart of the first embodiment of the present invention First embodiment of the present invention Optical axis changing operation explanatory diagram First embodiment gain adjustment explanatory diagram of the present invention First embodiment of the present invention utilization environment explanatory diagram Explanatory drawing of how to use the first embodiment of the present invention Transmission / reception block diagram of the first embodiment of the present invention Block diagram of the second embodiment of the present invention Second embodiment flowchart of the present invention Detailed block diagram of optical axis direction change detecting means of the second embodiment of the present invention Flow chart of sound tracking according to the second embodiment of the present invention. The figure explaining the state of 2nd Example sound wobbling of this invention The figure explaining the volume comparison method of 2nd Example of this invention. Block diagram of the third embodiment of the present invention Operational explanatory diagram of the third embodiment of the present invention Detailed block diagram of optical axis direction change detecting means according to the third embodiment of the present invention. Flow chart for setting the recording direction of the third embodiment of the present invention

[Example 1]
FIG. 1 is a diagram for explaining the configuration of a first embodiment of the present invention, in which 11 is a camera body, 12 is a lens barrel that can be attached to and detached from the camera body, 13 is a main subject photographed by the camera body, and 14 is It is a background sound source arranged away from the main subject, and is a speaker or orchestra that plays BGM.

  Reference numeral 15 denotes a microphone directivity area for recording the main subject sound (area control will be described later), and reference numeral 16 denotes a microphone directivity area for recording the background sound source (area control will be described later).

  The microphones 17a, 17b, 17c, and 17d are arranged over the entire periphery of the camera body 11, and the directivity of an arbitrary direction and width is created by appropriately processing and synthesizing these microphone signals.

  18 is a block diagram for explaining signal processing built in the camera body 11, 19 is an optical axis direction change detecting means for detecting a change in the direction of the camera, such as a magnetic compass and a gyroscope, and 115 is an optical axis direction change detecting means. 110a is a first gain adjusting means for adjusting the gain of the microphone 17a, 110b is a second gain adjusting means for adjusting the gain of the second synthesizing means to be described later, 111a, 111b, 111c , 111d delays each microphone 17a, 17b, 17c, 17d in order to create the above-mentioned directivity, and gain delay adjusting means for performing gain processing, and 112a combines the outputs of the first and second gain adjusting means. 1 synthesis means. 112b is a second synthesizing unit that synthesizes the signals of the gain and delay adjusting units 111a, 111b, 111c, and 111d, 113 is a recording unit that records the audio signal output from the first synthesizing unit 112a, and 114 is a second synthesizing unit. It is a transmission / reception means for transmitting / receiving an audio signal output from the means.

  As shown in FIG. 1, the recording apparatus of the present invention performs narrow directivity recording toward the main subject and the background sound source 14. For this reason, noises outside this range, such as air-conditioning sounds and spectator coughing, are not recorded, and high-quality recording can be performed.

  Here, a method for specifying the direction of the background sound source 14 will be described.

  First, the recording person points the camera (the camera body 11 and the lens barrel 12) toward the background sound source 14. This can be done accurately by recognizing the background sound source using the camera's viewfinder or rear LCD monitor.

  In this state, the background sound source 14 is locked by pressing the lock button 115, then the camera is directed to the main subject 13, the lock button 115 is released, and then recording and recording are started.

  The optical axis direction change detecting means detects the action of “pointing the camera at the main subject” during the period from when the lock button 115 is pressed to when it is released. For example, the integration of the gyro angular velocity output from the state in which the lock button 115 is pressed is started, and the direction of the background sound source is specified with the integration angle from when the lock button 115 is released to the angle formed by the main subject 13 and the background sound source 14.

  The gain / delay means 111a, 111b, 111c, and 111d can set the directivity region 16 by adjusting the signal delay and gain of the microphones 17a, 17b, 17c, and 17d.

  The main subject 13 is regarded as being on the extension of the camera optical axis, and recording is performed only with the microphone 17a.

  The sound of the main subject 13 and the sound of the background sound source 14 thus recorded are synthesized by the first synthesizing means and recorded in the recording means 113.

  Therefore, only the main subject sound and the background sound source are recorded, and high-quality recording can be performed.

  FIG. 2 is a simplified diagram showing a case where the main subject 13 has moved in the configuration of FIG.

  In FIG. 2, a stage 21 has a main subject 13 and a background sound source 14.

  First, as described with reference to FIG. 1 in the state of FIG. 2A, the photographer sets the direction of recording on the background sound source 14 and the main subject 13 and starts recording.

  FIG. 2B shows a state in which the main subject 13 has moved to the background sound source side. When the camera pans following the main subject 13 at this time, the region 16 deviates from the direction of the background sound source 14 and good recording is possible. become unable.

  Therefore, as shown in FIG. 2 (c), the optical axis direction change detecting means 19 detects an angle 22 panned from the state of FIG. 2 (a) following the main subject 13, and an angle 24 corresponding to the angle is detected as FIG. 2 (b). The gain and delay means 111a, 111b, 111c, and 111d are adjusted so that the direction 23 of the region 16 indicated by () is changed to the direction 25 of FIG.

  As a result, the directivity direction can be matched with the direction of the background sound source.

  However, the areas 15 and 16 are partially overlapped as they are. Therefore, the sound of the main subject 13 is recorded also in the area 16 where the background sound source 14 is recorded, and the sound of the background sound source 14 is recorded also in the area 15 where the main subject 13 is recorded. As a result, the output of the first synthesizing unit 112a is increased in volume.

  Therefore, the amount of overlap between the regions 15 and 16 is obtained from the angle 26 formed by the regions 15 and 16 at that time, and the gains of the gain adjusting means 110a and 110b are readjusted.

  That is, if the overlapping amount of the regions 15 and 16 is large, the gain of the gain adjusting means 110a and 110b is lowered by that amount to prevent an increase in volume due to the overlapping.

  FIG. 3 is a flowchart for explaining the above operation. This flow starts when the main power of the camera is turned on.

In step # 3001, it is determined whether or not the lock button 115 is turned on. If turned on, the process proceeds to step # 3002, and if not, the process proceeds to step # 3014.
The case where the lock button 115 is not turned on will be described later.

  In step # 3002, an angular velocity meter such as a vibration gyro, which is the optical axis direction change detection means 19 incorporated in the camera body 11 or the lens barrel 12, is activated and the gyro output is integrated to start conversion into an angle. If the gyro is used for other purposes such as camera shake correction, the gyro has already been started and integration corresponding to camera shake correction has been started. For example, the integration operation of the calculation frequency characteristic for obtaining the accuracy on the lower frequency side and the characteristic for calculating the wide angle without obtaining the camera shake correction accuracy is started.

  In step # 3003, the process waits until the lock button 115 is turned off. That is, during this time, the gyro output is continuously integrated. When the lock button 115 is turned off, the process proceeds to step # 3004.

  In step # 3004, the angle formed by the background sound source 15 and the main subject 14 is output from the integration result of the gyro.

  FIG. 4 shows an integration result (angle) obtained by detecting the optical axis direction of the camera with a gyro, the horizontal axis indicates the elapsed time, and the vertical axis indicates the change angle of the optical axis. A waveform 41 is a waveform obtained by integrating the panning angular velocity of the camera detected by the gyro to convert it into an angle. Step # 3004 is the timing of time t1, and the angle θ1 at that time is output.

  In step # 3005, the gain and delay means 111a, 111b, 111c, and 111d are adjusted, and the directivity area 16 of the microphone toward the background sound source 14 is set as shown in FIG. The directivity region 16 is shifted by the angle obtained in step # 3004 with respect to the directivity region 15 of the microphone directed toward the subject 13.

  In step # 3006, steps # 3004 and # 3005 are circulated and waited until recording and a recording start operation are performed. That is, the direction of the directivity region 16 is reset at the latest angle obtained from the gyro until recording is started.

  Recording and recording start operation are performed, and recording and recording are started in step # 3007. As a result, the sounds of the main subject 13 and the background sound source 14 are individually recorded, synthesized by the first synthesis unit 112a, and recorded in the recording unit 113.

In step # 3008, the direction change of the main subject 13 is continuously detected using the gyro. This corresponds to detecting the angle 22 in FIG. (Step # 3008 corresponds to time t2 in FIG. 4 and outputs the angle θ2).
In step # 3009, the angle 24 in FIG. 2C is calculated corresponding to the obtained angle 22 (the same angle as the angle 22), and the angle formed by the direction of the main subject 13 and the background sound source 14 is recalculated accordingly. . (An angle 26 in FIG. 2 (c)) Then, the gain, delay means 111a, 111b, 111c, and 111d are adjusted, and the microphone directivity region 16 toward the background sound source 14 with respect to the optical axis direction is adjusted. Reset it.

  In step # 3010, an angle formed by the two directivity directions 15 and 16 obtained in step # 3009 is obtained.

  In step # 3011, the outputs of the first and second gain adjusting means 110a and 110b are adjusted according to the angle.

  FIG. 5 shows the amount of gain to be adjusted, the horizontal axis indicates the angle formed by the directivity directions 15 and 16, and the vertical axis indicates the gain of the gain adjusting means 110a and 110b.

  As can be seen from FIG. 5, the gain of each of the gain adjusting means 110 a and 110 b is 1 when the angle formed is larger than a predetermined value (an angle at which the two directivity regions 15 and 16 do not overlap). However, as the angle formed becomes smaller (the overlap between the two directivity regions 15 and 16 becomes larger), the gain of each of the gain adjusting means 110a and 110b becomes smaller and the two directivity regions 15 and 16 overlap. In this case, each gain is set to 0.5.

  In step # 3012, steps # 3008, # 3009, # 3010, and # 3011 are circulated and waited until recording and recording end operations are performed.

  That is, in steps # 3008, the angles θ3, θ4 at times t3, t4, etc. in FIG. 4 are obtained, and in step # 3009, the direction of the directivity region 16 is changed based on the angles θ3, θ301, gain adjustment means 110a, Continue to adjust the gain of 110b.

  When the recording and the recording end operation are performed, the process proceeds to step # 3013, the recording and the recording are finished, and the process returns to step # 3001.

  If the lock button ON 115 operation is not performed in step # 3001, the process proceeds to step # 3014, and the process waits while circulating through step # 3001 until a recording and recording start operation is performed.

  If recording and recording start operation are performed in step # 3014, the process proceeds to step # 3015.

  In step # 3015, the gain of the second gain adjusting unit 110b is set to zero and the background sound source 14 is not recorded.

  In step # 3016, recording is started. That is, when recording is started without the lock button 115 being operated, only the main subject 13 is recorded, and the directional area 16 for background sound source recording is not controlled.

  In step # 3017, step # 3016 is circulated and waited until the recording and recording end operation. When the recording and recording end operation is performed, the process proceeds to step # 3018.

  In step # 3018, the recording is completed, and the process returns to step # 3001.

  Up to this point, the recording control closed in the recording apparatus of the present invention has been described.

  This apparatus also has a function of transmitting the recording result of the background sound source 14 to the outside by the transmission / reception means 114. A description of this function is given below.

  As described with reference to FIG. 1, the directivity region 16 is formed for the purpose of recording the background sound source 14. However, if a plurality of background sound sources are arranged apart from each other, the directivity region 16 cannot be used.

  Therefore, it is possible to divide the role of recording the background sound source with multiple cameras and synthesize them on the cloud, for example.

  That is, as shown in FIG. 6, different recording points are recorded with narrow directivity and no noise by the cameras 61a, 61b, 61c, 61d, and transmitted to the network 62, and the network 62 synthesizes these signals in synchronization. .

  FIG. 7 is a diagram for explaining the above, and the operation method will be described in order.

  First, each photographer prepares the cameras 61a, 61b and 61c, and determines the direction of the background sound source by meeting in advance. For example, the camera 61a is in charge of recording the background sound source 14a, and the camera 61b is in charge of the center of the stage 21 as a background. The camera 61c is in charge of the background sound source 14c.

  Each photographer records the main subject 13a, 13b, 13c that he / she aims at separately for the main subject and the background sound source as described above, and records the combined result in the recording means 113 of his / her camera.

  At the same time, as shown in FIG. 8, each background sound source is transmitted to the network through transmission / reception means 114a, 114b, 114c, where it is synthesized by the voice synthesis means 81 and recorded in the recording means 82.

  As a result, the background sound sources 14a and 14c and the sound of the stage center are recorded, and recording and recording are performed in an ideal environment without ambient noise.

  The synthesized result of the voice synthesizing means 82 is sent to the transmitting / receiving means 114a, 114b, 114c (transmission and reception are shown separately in FIG. 8) provided in each camera 61a, 61b, 61c, and recorded by the recording means 113 by itself. Separately from the result (first synthesized signal), the recorded result in the main subject direction is synthesized (second synthesized signal) and stored.

  The result recorded in the recording means 82 is stored on a server for a certain period of time, for example. The photographer can check the result through a network, and is also disclosed to individuals who do not have a camera.

  Because of such a system, it is possible to simultaneously acquire the result of recording the main subject and the background sound source that are intended and the recording result in an ideal environment.

  As described above, the main subject 13 and the background sound source 14 are individually recorded with a narrow directivity and synthesized, thereby enabling high-quality recording with less noise.

  Furthermore, since the directivity direction of the background sound source 14 is controlled based on the panning operation of the camera following the main subject, the recording direction can always be stabilized.

  Further, since the recording gain is adjusted according to the direction of the main subject 13 and the angle of the background sound source 14, recording can be performed with a stable volume.

  In addition, even if there are multiple background sound sources, high quality recording can be performed using the network.

  In this way, the recording direction changes between the recording means (microphone 17a) for recording the subject in the shooting direction (main subject 13) and the recording means (microphones 17a, 17b, 17c, 17d) for recording the specified direction (background sound source 14). However, the recording conditions are controlled based on the direction control means (gain delay means 111a, 111b, 111c, 111d, second combining means 112b) for controlling the designated direction to be always constant and the relationship between the shooting direction and the designated direction. By configuring the recording apparatus with the recording control means (gain adjusting means 110a and 110b) to perform, high-quality recording can be realized.

  Recording means (microphone 17a) for recording the subject (main subject 13) in the photographing direction and recording means (microphones 17a, 17b, 17c, 17d) for recording the designated direction (background sound source 14) and the photographing direction change. Direction control means (gain delay means 111a, 111b, 111c, 111d, second combining means 112b) for controlling the designated direction to be always constant, and transmission means (transmission / reception means 114) for transmitting the recording result in the designated direction The high-quality recording can be realized by configuring the recording system with the voice synthesizing unit 81 that receives and synthesizes a plurality of transmission results of the transmitting unit.

  Also, the recording direction (microphone 17a) for recording the subject in the shooting direction (main subject 13) and the recording means (microphones 17a, 17b, 17c, 17d) for recording the designated direction (background sound source 14) change the shooting direction. Also, direction control means (gain delay means 111a, 111b, 111c, 111d, second combining means 112b) for controlling the designated direction to be always constant, and transmission means for transmitting the recording signal in the designated direction to the network 62 ( The transmission / reception means 114), the reception means (transmission / reception means 114) for receiving the recording signal in the designated direction processed (speech synthesis means 81) by the network 62, and the recording signal received by the reception means and the subject in the shooting direction are recorded. The recording device is composed of recording means 113 for recording a synthesized signal (second synthesized signal) obtained by synthesizing the recorded signals.

  Further, the recording unit 113 is configured to record a recording signal (first combined signal) of a recording signal recording a subject in the photographing direction and a recording signal recording the specified direction in the recording unit 113.

[Example 2]
FIG. 9 shows a second embodiment of the present invention, which differs from the first embodiment in the following points.
・ The recording directivity of the main subject can also be controlled.
・ When the background sound source is not recorded, widen the directivity area of the main subject.
・ Detects changes in the optical axis direction based on changes in the sound of the background sound source.

  9, gain delay adjusting means 91a, 91b, 91c, 91d and third synthesizing means 92 are added to FIG.

  The gain delay adjusting means 91a, 91b, 91c, 91d, when recording a background sound source, narrows the directivity area 15 and records only the main subject 13 to prevent the mixing of noise, as in the first embodiment. However, when the background sound source is not recorded, the gain and delay are adjusted to widen the directivity area like the directivity area 91 so that the background sound source can be recorded simultaneously.

  FIG. 10 is a flowchart of the second embodiment of the present invention. Since only step # 3019 is added to the flow of FIG. 4, only that step will be described.

  Step # 3019 is a step that flows in the flow of recording and starting recording without operating the lock button 115. Therefore, in step # 3015, the gain of the second gain adjusting means 110b is set to zero and the recording of the background sound source is stopped. In step # 3019, the directivity area toward the main subject 13 is changed from the narrow area 15 to the wide area 91 by adjusting the gain delay means 91a, 91b, 91c, 91d.

  The optical axis direction change detecting means 19 in FIG. 9 uses a method different from that of the first embodiment.

  In the first embodiment, the change in the optical axis direction is detected by using the gyro. However, an error occurs in the integration result due to the temperature drift of the gyro itself and the background sound source 14 and the directivity region 16 are gradually used in a long time use. There is a risk of displacement in the direction.

  Therefore, in the second embodiment, the recording direction is scanned to detect the direction in which the volume of the background sound source can be recorded with the highest volume, and the change is the change in the optical axis direction.

  FIG. 11 is a block diagram of optical axis direction change detection in the second embodiment, and shows details of the optical axis direction changing means 19 of FIG.

  Inside the optical axis direction change detection means 19, there is provided wobbling means 1102 for changing the recording direction alternately, and gain delay means 1103a, 1103b similar to the gain delay means 111a, 111b, 111c, 111d in FIG. 1103c and 1103d are controlled, and the direction of the directivity region 1101 is changed alternately as indicated by an arrow 1104 within a range of angle plus or minus 3 degrees at 60 Hz, for example. The directivity angle of the directivity region 1101 is set to be narrower than the directivity region 16 of FIGS. 1 and 9 by adjusting the gain delay means 1103a, 1103b, 1103c, and 1103d, and the directivity direction is changed alternately. When it changes, it becomes easy to detect the change in the volume of the background sound source 14.

  The outputs of the gain delay means 1103a, 1103b, 1103c, and 1103d are synthesized by the third synthesis means 1105 to form a recording area 1101 having directivity. The sound volume determination means 1106 compares the sound volume in the recording direction changed alternately, and detects the direction in which the sound volume is high. A specific method will be described later. The recording direction instruction means 1107 receives the output of the sound volume determination means 1106, determines the recording direction, and sends it to the wobbling means 1102. With this output, the wobbling means 1102 determines a reference position (axis 1108 in FIG. 11) when performing the recording direction alternately. The signal of the recording direction instruction means 1107 is output to the outside from the optical axis direction change detection means 19 and adjusts the obtaining delay means 111a, 111b, 111c, 111d in FIG. This determines the recording direction of the background sound source to be recorded.

  FIG. 12 is a flowchart for explaining the above, and corresponds to the details of step # 3008 in FIG.

  The flow starts from step # 3008 in FIG. 10 to step # 12001, and the gain and delay means 1103a, 1103b, 1103c, and 1103d are adjusted to start changing the recording direction at 240 Hz within a range of plus or minus 3 degrees.

  In this step, for example, when the recording direction is changed to the left and right, each sound at that time is recorded, and the volume is averaged four times for each left and right to obtain the left and right average volume for every 60 Hz.

  In step # 12002, it is determined whether or not the left and right sound volumes are substantially the same, and the process returns from step # 3009 to the step of FIG.

  However, in this case, since the left and right sounds are the same, in step # 3009, the gain and delay means 111a, 111b, 111c, and 111d are not readjusted and the recording direction is not changed.

  If there is a predetermined difference or more between the left and right sounds in step # 12002, the process proceeds to step # 12003.

  In step # 12003, if the sound when wobbling in the right direction is loud, the process proceeds to step # 12004, and if not, the process proceeds to step # 12005.

  In step # 12004, the gain and delay means 1103a, 1103b, 1103c, and 1103d are adjusted to change the recording direction to the right by 3 degrees. That is, when wobbling is performed next time, the wobbling of plus or minus 3 degrees is performed in a state where the recording direction is directed to the right by 3 degrees.

  Thereafter, the flow in FIG. 12 is exited, and the gain and delay means 111a, 111b, 111c, and 111d are readjusted in step # 3009 in the flow in FIG. 9 to change the recording direction to the right by 3 degrees.

  In step # 12005, the gain and delay means 1103a, 1103b, 1103c, and 1103d are adjusted to change the recording direction to the left by 3 degrees. That is, when wobbling is performed next time, the wobbling of plus or minus 3 degrees is performed with the recording direction facing left by 3 degrees.

  Thereafter, the flow in FIG. 12 is exited, and the gain and delay means 111a, 111b, 111c, and 111d are readjusted in step # 3009 in the flow in FIG. 9 to change the recording direction to the left by 3 degrees.

  13 and 14 are diagrams for explaining tracking by sound wobbling.

  In FIG. 13, the horizontal axis represents time, and the vertical axis represents the direction in which the optical axis direction change detecting means 19 records.

  Here, the waveform 1301 indicates that the recording direction is alternately changed at 240 Hz within a range of plus or minus 3 degrees with respect to a certain direction θ1.

  Here, FIG. 14A shows the volume recorded when weaving in the right direction (θ1 + 3), and FIG. 14B shows the volume recorded when weaving in the left direction (θ1-3).

  In FIG. 14, the horizontal axis indicates time, and the vertical axis indicates volume.

  FIG. 14C shows the average value of the volumes recorded four times.

  In FIG. 14C, the left volume is shown in a dark color in the average volume in the left-right direction.

  Here, the average is obtained in order to stabilize the sound because it changes depending on the sampling timing.

  FIG. 14D shows the result obtained by normalizing the difference between the left and right volume, and the result of calculating (left volume−right volume) / (left volume + right volume).

  In FIG. 14D, the right volume is larger at time t1 (the difference is positive), so the volume is changed to the right in step # 12004 of FIG.

  When the waveform 1302 is obtained and the flow in FIG. 12 is passed, wobbling is continued.

  As a result, the normalized volume difference in FIG. 14D obtained at time t2 is still larger in the right volume (the difference is positive), so the volume is changed to the right in step # 12004 in FIG.

  Similarly, when the normalized volume difference at time t3 is seen, the volume difference is less than half compared to the previous time t2.

  In this way, when the difference in volume greatly changes, the recording direction is not changed because the recording direction may exceed the background sound source.

  Specifically, when the change from the previous volume difference is large and the previous volume difference is greater than or equal to a predetermined value, the recording direction is not changed.

  Here, the condition “when the previous volume difference is greater than or equal to a predetermined value” is added because the tracking in the recording direction is not necessary when the volume difference is small, and at the time t4 in FIG. It is a countermeasure for the problem.

  In FIG. 14D, the volume difference at time t4 is the same as that at time t3.

  For this reason, if the above condition is not applied, the recording direction changing operation is performed because the previous volume difference is not greater than or equal to a predetermined value.

  As described with reference to FIGS. 13 and 14, the recording direction is changed alternately, and the sound volume is compared and the direction of the sound is tracked to perform recording with higher stability than the detection of the change in the optical axis direction by the gyro. I can do things.

  In this way, the recording direction changes between the recording means (microphone 17a) for recording the subject in the shooting direction (main subject 13) and the recording means (microphones 17a, 17b, 17c, 17d) for recording the specified direction (background sound source 14). However, the recording conditions are controlled based on the direction control means (gain delay means 111a, 111b, 111c, 111d, second combining means 112b) for controlling the designated direction to be always constant and the relationship between the shooting direction and the designated direction. By configuring the recording apparatus with the recording control means (gain adjusting means 110a and 110b) to perform, high-quality recording can be realized.

  Then, the wobbling means 1102 that alternately changes the recording direction by the microphones 17a, 17b, 17c, and 17d, the volume determination means 1106 that determines the direction of the sound source based on the alternately changed recording volume, and the output of the volume determination means Recording direction indicating means 1107 for indicating the recording direction based on the above.

  Then, the volume determination means 1106 performs a comparison (FIG. 14D) for each direction of the volume of the recording changed alternately.

  Then, the volume determination means compares the average value (FIG. 14C) for each direction of the recording volume.

  The sound volume determination means detects the sound source direction based on the result of normalizing the difference between the average values for each direction by the recording sound volume (dividing the sound volume difference by the sum of sound volumes).

  Then, the sound volume determination means detects the direction of the sound source based on the normalized current comparison value and the change in the previous comparison value (comparison between times t2 and t3 in FIG. 14D).

[Example 3]
FIG. 15 shows a third embodiment of the present invention, which differs from the second embodiment in the following points.
・ Background sound source recording should have a wide directivity.
-Even if the main subject and the background sound source overlap, the gain of the background sound source is not adjusted.
・ Detects changes in the optical axis direction based on changes in the sound of the gyro and background sound sources.

  In FIG. 15, the angle of the directivity region 16 is wider than those in FIGS. Therefore, not only the background sound source 14 but also other sound sources can be recorded. (For example, the background sound sources 14a and 14c in FIG. 7 can be recorded simultaneously.) Although noise can be easily picked up, the influence of the sound of the main subject 13 is small because it is recorded and synthesized by the microphone having the directivity region 15. .

  However, if the camera follows the movement of the main subject 13, the background sound source may fall out of the directivity area 16 even if the directivity of the directivity area 16 is wide. Therefore, as in the first and second embodiments, the direction of the directivity region 16 is controlled in accordance with the change in the optical axis of the camera.

  Therefore, even when the panning operation of the camera is performed, the recording direction of the background sound source determined at the start of recording is always constant, and stable background sound source recording becomes possible.

  The directivity can be widened and narrowed by a known technique by adjusting the gain delay adjusting means 111a, 111b, 111c, and 111d.

  FIG. 16 is a diagram for explaining the above. In FIG. 16, reference numeral 21 denotes a stage where the main subject 13 and the background sound source 14 are located.

  First, in the state of FIG. 16A, as in the first embodiment, the photographer sets the direction of recording for the background sound source 14 and the main subject 13 and starts recording.

  At this time, since the directivity area 16 is wide, both the background sound sources 14a and 14b on the stage 21 can be recorded.

  FIG. 16B shows a state in which the main subject 13 has moved to the background sound source 14c side. When the camera pans following the main subject 13 at this time, the background sound source 14a deviates from the directivity region 16 and good recording is performed. become unable.

  Therefore, as shown in FIG. 16C, the optical axis direction change detecting means 19 detects the angle 22 panned from the state of FIG. The gain and delay means 111a, 111b, 111c, and 111d are adjusted so that the direction 23 of the region 16 indicated by () is changed to the direction 25 of FIG.

  As a result, the directivity direction can be matched with the direction of the background sound source.

  However, the areas 15 and 16 are partially overlapped as they are. Therefore, the sound of the main subject 13 is recorded also in the area 16 where the background sound source 14 is recorded, and the sound of the background sound source 14 is recorded also in the area 15 where the main subject 13 is recorded. As a result, the output of the first synthesizing unit 112a is increased in volume.

  Therefore, the amount of overlap between the regions 15 and 16 is obtained from the angle 26 formed by the regions 15 and 16 at that time, and the gain of the gain adjusting means 110a is readjusted.

  Here, the difference from the first embodiment is that the gain adjusting means 110b is not provided and the recording gain of the background sound source is not adjusted.

  As can be seen from the relationship between the directivity areas 15 and 16 in FIGS. 16A to 16C, the directivity area 15 is included in the directivity area 16, and therefore the main subject 13 and the background sound source. This is because there is no change in the volume of the main subject at that time regardless of the positional relationship of 14.

  However, since the directivity area 15 for recording the main subject 13 has a narrow directivity, when the area approaches the background sound source 14, the sound is also recorded.

  Therefore, when the main subject 13 approaches the background sound source 14, only the volume of the background sound source increases in the sound synthesized by the first synthesis means 112a.

  Therefore, the gain adjusting means 110a adjusts the volume according to the angle formed by the directivity regions 15 and 16.

  The change in the optical axis direction is detected by the gyro in the first embodiment and by the volume tracking in the second embodiment, both of which have advantages and disadvantages. As described above, the accuracy of the gyro is lowered when the signal drifts and the sound volume approaches the background sound source and the main subject sound source, or when there is a sudden change in sound volume.

  Therefore, in the third embodiment, both are combined to improve accuracy.

  FIG. 17 shows the internal details of the optical axis direction change detecting means 19 in the third embodiment. The difference from the second embodiment in FIG. 11 is that a gyro 1701 and an integrating means 1702 for integrating the output are provided. It is a point.

  The output of the integration means 1702 is input to the recording direction instruction means 1107 together with the output of the volume determination means 1106, and the recording direction is set by both signals.

  The recording direction is basically changed by the angle obtained from the integration result of the gyro 1701 signal integration unit 1702. After the angle change, the wobbling means 1102 performs wobbling in the recording direction and corrects the direction.

  FIG. 18 is a flowchart for explaining the above and corresponds to steps # 3008 and # 3009 in FIG. Steps having the same functions as those in FIGS. 3 and 12 are denoted by the same numbers.

  When recording and recording is started in step # 3007 in FIG. 3 or FIG. 10, the process proceeds to step # 3007 in FIG.

  In step # 3008, the signal from the gyro 1701 is integrated by the integrating means 1702 to detect the recording direction (optical axis change).

  In step # 3009, the gain and delay of the gain and delay means 111a, 111b, 111c and 111d are adjusted based on the change in the recording direction obtained in step # 3008. As a result, the recording direction of the background sound source relative to the photographic optical axis is changed (when viewed from the background sound source, the recording direction is tracked).

  In step # 12001, wobbling is started. As described with reference to FIGS. 13 and 14 of the second embodiment, the direction in which the maximum recording can be performed from step # 12002 to steps # 12004 and # 12005 based on the difference between the average values of the four volumes recorded during left and right wobbling. Ask.

  In step # 12006, the left and right volume changes are detected, and steps # 12003 to # 12006 are circulated until the change disappears. As a result, the direction in which recording can be performed to the maximum is set, and the recording direction of the background sound source is updated.

  Then, the process returns to step # 3010 in FIG.

  In this way, the adjustment is performed by the gyro and the fine adjustment is performed by the sound wobbling, thereby preventing the sound tracking error from being caused by the gyro drift error or the external noise in the exposure sound direction changing process.

  In this way, the recording direction changes between the recording means (microphone 17a) for recording the subject in the shooting direction (main subject 13) and the recording means (microphones 17a, 17b, 17c, 17d) for recording the specified direction (background sound source 14). However, the recording conditions are controlled based on the direction control means (gain delay means 111a, 111b, 111c, 111d, second combining means 112b) for controlling the designated direction to be always constant and the relationship between the shooting direction and the designated direction. By configuring the recording apparatus with the recording control means (gain adjusting means 110a and 110b) to perform, high-quality recording can be realized.

  The direction control means controls the recording direction based on the gyro and microphone signals, determines the recording direction based on the gyro signal (step # 3008 in FIG. 18), and then the direction of the sound source based on the microphone signal. Is detected (steps # 12001 to # 12006 in FIG. 18).

  The present invention is a recording control technique for a device capable of shooting a moving image, and can be suitably used for conditions for recording a plurality of sound sources with high quality using a digital camera, a digital video, a mobile phone, or the like.

13. Main subject (subject)
14. Background sound source (specified direction)
17. Microphone 19. Optical axis direction change detection means 110. Gain adjustment means (recording control means)
111. Gain delay adjustment means (direction control means)
113. Recording means 114. Transmission / reception means

Claims (12)

Recording means for recording the subject in the shooting direction;
Recording means for recording the specified direction;
Direction control means for controlling the designated direction to be always constant even if the shooting direction changes,
A recording apparatus comprising recording control means for controlling recording conditions based on the relationship between the shooting direction and the designated direction. Recording means for recording the subject in the shooting direction;
Recording means for recording the specified direction;
Direction control means for controlling the designated direction to be always constant even if the shooting direction changes,
Transmitting means for transmitting the recording signal in the designated direction to the network;
The receiving means for receiving the recording signal in the designated direction processed by the network, and the recording means for recording the composite signal obtained by synthesizing the recording signal received by the receiving means and the recording signal recording the subject in the photographing direction. Recording device. A composite signal composed of a recording signal obtained by recording the subject in the photographing direction, a composite signal obtained by recording the designated direction, and a composite signal obtained by synthesizing the recording signal received by the receiving means and the recording signal obtained by recording the subject in the photographing direction. 3. A recording apparatus according to claim 2, comprising recording means for recording a signal. The recording apparatus according to claim 1, wherein the direction control means is a gyro. The recording apparatus according to claim 1, wherein the direction control means is a microphone. Wobbling means for alternately changing the recording direction by the microphone;
Volume determination means for determining the direction of the sound source based on the alternately changed recording volume;
6. The recording apparatus according to claim 5, further comprising a recording direction instruction means for instructing a recording direction based on an output of the volume determination means. The recording apparatus according to claim 6, wherein the volume determination means performs a comparison for each direction of the volume of the recording changed alternately. The recording apparatus according to claim 7, wherein the volume determination unit compares an average value for each direction of the recording volume. The recording apparatus according to claim 8, wherein the volume determination unit detects a sound source direction based on a result obtained by normalizing a difference in average value for each direction with a recording volume. The recording apparatus according to claim 9, wherein the volume determination unit detects a direction of a sound source based on a change in the normalized comparison value of the current time and the previous comparison value. 6. The recording apparatus according to claim 4, wherein the direction control means controls a recording direction based on signals from the gyro and the microphone. 12. The recording apparatus according to claim 11, wherein the direction control means determines a recording direction based on the gyro signal and then detects the direction of the sound source based on the microphone signal.