JP2011114769A - Imaging device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device that can properly collect sounds made by a plurality of objects. <P>SOLUTION: The imaging device comprises imaging means (10, 16, 18) for imaging, detecting means (22, 28) for detecting the number of objects in an image imaged by the imaging means, a plurality of sound collecting means (44, 46, 48) for collecting the sounds made by the objects, sensitivity adjusting means (50, 52, 54, 60) that, when there are a plurality of objects, adjust the sensitivity of the plurality of sound collecting means. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus.

  Japanese Patent Application Laid-Open No. 2004-133867 discloses an imaging apparatus that enables adjustment of the direction of sound collection using an operation unit, and allows the directivity of the sound collection unit to be set for a sound collection target that is different from the imaging subject.

JP 2006-287735 A

  However, when there are a plurality of targets having different distances and directions from the imaging device, it is not possible to properly collect sounds emitted from the targets.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an imaging apparatus capable of appropriately collecting sounds emitted from a plurality of objects.

  The imaging apparatus includes an imaging unit (10, 16, 18) that captures an image, a detection unit (22, 28) that detects the number of objects in the image, and a plurality of sounds that collect sound generated by the object. Sound collecting means (44, 46, 48) and sensitivity adjusting means (50, 52, 54, 60) for adjusting the sensitivity of the plurality of sound collecting means when the number of the objects is plural.

  In the imaging apparatus, the detection unit detects a range of the target in the image, and adjusts at least one directivity of the plurality of sound collection units based on the range of the target. 56, 60).

  In the imaging apparatus, when the number of the objects is plural, the sensitivity adjustment unit corresponds to the object so that the level of each sound signal output from the plurality of sound collecting units is within a predetermined range. At least one sensitivity of the plurality of sound collecting means may be adjusted.

  In the imaging apparatus, the detection unit detects a range of the target in the image, and the sensitivity adjustment unit is based on the range of the target and is at least one of the plurality of sound collecting units corresponding to the target. One sensitivity may be adjusted.

  In the imaging apparatus, the detecting unit detects a distance to the target, and the sensitivity adjusting unit is based on the distance to the target and at least one sensitivity of the plurality of sound collecting units corresponding to the target. May be adjusted.

  In the imaging apparatus, the detection unit may detect a face in the image and detect the number of the objects based on the number of the faces.

  In the imaging apparatus, the detection unit detects a focus state of the optical system with respect to a focus detection position set in an image plane of the optical system, and determines the number of the focus detection positions where the focus state is an in-focus state. Based on this, the number of the objects may be detected.

  The imaging apparatus includes a storage unit (34) for storing a pattern for adjusting sensitivity of the plurality of sound collecting units, and the sensitivity adjustment unit is configured to store the plurality of sound collecting units based on the pattern stored in the storage unit. The sensitivity of the means may be adjusted.

  ADVANTAGE OF THE INVENTION According to this invention, the sound which a some object emits can be collected appropriately.

FIG. 1A and FIG. 1B are diagrams illustrating an example of the appearance of the imaging apparatus according to the first embodiment. FIG. 2 is a block diagram of the imaging apparatus according to the first embodiment. FIG. 3A is a flowchart of a process of collecting sounds emitted from a plurality of objects by adjusting the sensitivity of the microphone according to the first embodiment. FIG. 3B is a flowchart of sub-processing for performing microphone selection and sensitivity adjustment in the first embodiment. FIG. 4 is a diagram illustrating an example of target display on the display panel according to the first embodiment. FIG. 5 is a diagram illustrating an example of a positional relationship on a plane between the imaging apparatus according to the first embodiment and a target. FIG. 6 is a flowchart of the sub-process for adjusting the sensitivity of the microphone according to the first embodiment. FIG. 7 is a flowchart of a process of collecting sounds emitted from a plurality of objects by adjusting the directivity and sensitivity of the microphone according to the second embodiment. FIG. 8 is a diagram illustrating an example of a target face range in a captured image according to the second embodiment. FIG. 9 is a flowchart of the sub-process for adjusting the directivity and sensitivity of the microphone according to the second embodiment. FIG. 10 is a diagram illustrating a relationship between the target range and the microphone directivity according to the second embodiment. FIG. 11A is a flowchart of a process for generating a pattern file according to the third embodiment. FIG. 11B is a flowchart of a process of collecting sounds emitted by the target based on the pattern according to the third embodiment.

  Embodiments of the present invention will be described below with reference to the drawings.

  An example of an imaging apparatus according to the first embodiment will be described with reference to FIGS. 1A and 1B are diagrams illustrating an example of the appearance of the camera 100, where FIG. 1A is a perspective view of the front of the camera 100, and FIG. FIG. The camera 100 is a device that captures an image of a target and collects sound generated by the target. As shown in FIG. 1A, the camera 100 includes a shutter switch 64, the optical system 10, and microphones 44, 46 and 48. As shown in FIG. 1B, the camera 100 includes a display panel 40, a REC button 66, and an operation unit 68 on the back surface. Details of each part of the camera 100 will be described later.

  The configuration of the camera 100 will be described with reference to FIG. FIG. 2 is a block diagram of the camera 100. 2, the same components as those in FIG. 1 are denoted by the same reference numerals and description thereof is omitted. As shown in FIG. 2, the camera 100 includes an optical system 10, a communication contact 14, a shutter curtain 16, an image sensor 18, an AF (Auto Focus) unit 22, a shutter unit 24, an image processing unit 26, a face detection unit 28, and a memory 34. , Display panel 40, microphones 44, 46 and 48, VCA (Voltage Controlled Amplifier) 50, 52 and 54, directivity control motor 56, MTX (Multiplexer) 58, sound control unit 60, sound recording unit 62, shutter switch 64, A REC button 66, an operation unit 68, a CPU (Central Processing Unit) 70, a power supply unit 80, and a housing 90 are provided.

  The optical system 10 includes a lens 11, a communication contact 12, an AF motor (not shown), and a diaphragm (not shown). By connecting the communication contact 12 of the optical system 10 and the communication contact 14 of the housing 90, the optical system 10 is supplied with power from the power supply unit 80 and communicates with the CPU 70. The optical system 10 transmits lens information to the CPU 70. The CPU 70 controls the AF motor and diaphragm of the optical system 10 based on the lens information.

  The shutter unit 24 controls the shutter curtain 16 to control exposure. The shutter unit 24 has a photometric sensor (not shown), and controls the opening / closing time of the shutter curtain 16 according to the shutter time calculated by the CPU 70. The exposure time for the image sensor 18 is determined by the opening / closing time of the shutter curtain 16.

  The AF unit 22 has a plurality of focus detection positions and controls focusing of the optical system 10. The AF unit 22 has a distance measuring sensor (not shown) that performs distance measurement, and drives the AF motor of the optical system 10. The AF unit 22 also has a tracking function for driving the optical system 10 according to the movement of the target to track the target.

  The image sensor 18 converts the optical image that has passed through the shutter curtain 16 into an electrical signal. The image sensor 18 is, for example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like.

  The face detection unit 28 checks the characteristics of an image captured by the image sensor 18 (hereinafter referred to as a captured image), and detects the face of the target 110, the position of the face, and the face range in the captured image. The face detection unit 28 detects a plurality of target faces in the captured image.

  The image processing unit 26 converts the captured image output from the image sensor 18 from an analog signal to a digital signal. The image processing unit 26 performs predetermined pixel interpolation processing and color conversion processing on the image signal. The image processing unit 26 converts color information (red, green, and blue component signals) of the image signal into luminance information and color difference information, and compresses the information into a predetermined format such as JPEG (Joint Photographic Experts Group). The image processing unit 26 expands the compressed image signal in a predetermined format.

  The microphones 44, 46, and 48 are microphones (gun microphones) having a single directivity, and collect sound generated by the target. The microphones 44, 46 and 48 collect sound in the right, front and left directions of the camera 100, respectively. The VCAs 50, 52 and 54 adjust the sensitivity of the microphones 44, 46 and 48 by changing the amplification factor according to the applied voltage, and adjust the level of the sound signal output from the microphones 44, 46 and 48. The sound control unit 60 detects the level of the sound signal output from the VCAs 50, 52, and 54 and adjusts the voltage applied to the VCAs 50, 52, and 54. The sound control unit 60 controls the directivity control motor 56. The directivity control motor 56 adjusts the directivity of the microphones 44, 46 and 48 based on the control of the sound control unit 60.

  The MTX 58 generates a sound signal having left and right components by adding a predetermined weight to each sound signal whose level is adjusted by the VCAs 50, 52, and 54 and adding them together. The sound recording unit 62 converts the sound signal output from the MTX 58 from an analog signal to a digital signal, and converts the sound signal into a sound signal in a predetermined format such as MP3 (Motion Picture Experts Group Audio Layer 3). The CPU 70 records a signal obtained by synchronizing the sound signal and the image signal in the memory 34.

  The memory 34 stores the image signal output from the image processing unit 26 and the sound signal output from the sound recording unit 62. The memory 34 stores a pattern file for adjusting the sensitivity and directivity of the microphones 44, 46 and 48. Details of the pattern file will be described later. The display panel 40 displays an image signal expanded by the image processing unit 26, an operation cursor, and the like.

  The shutter switch 64 is a switch that is turned on when the user captures a still image. The REC button 66 is a button that is turned on when the user starts capturing and collecting a moving image and turned off when the user ends. The operation unit 68 is a key or button for the user to operate the camera 100.

  The optical system 10, the shutter curtain 16, and the image sensor 18 capture an image. The face detection unit 28 and the AF unit 22 detect the position of the target in the captured image, the range of the target, the distance from the target, and the target face.

  With reference to Fig.3 (a), the process which adjusts the sensitivity of the microphone which concerns on Example 1 and collects the sound which a several object emits is demonstrated. FIG. 3A is a flowchart of a process of collecting sounds emitted from the target by adjusting the sensitivity of the microphone.

  First, the CPU 70 instructs the shutter unit 24 and the AF unit 22 to detect target position information in the captured image (step S10). The CPU 70 sets the focus state of the focus detection position set in the image plane of the optical system 10 to a position where the focus state is set to the in-focus state (hereinafter referred to as the focus position) or the position of the target face detected by the face detection unit 28. Based on this, the position of the target in the captured image is detected. Here, an example will be described in which the CPU 70 detects the in-focus position in the captured image and detects the position of the target in the captured image using the contrast detection AF method. First, a photometric sensor included in the shutter unit 24 detects target color information or luminance information. The AF unit 22 acquires the color information or luminance information of the target as needed while driving the optical system 10, and acquires the relationship between the focus state information of the optical system 10 and the target color information or luminance information. The CPU 70 detects the target position (distance) from the acquired relationship. The AF unit 22 acquires information on the target face from the face detection unit 28 as needed while driving the optical system 10, and acquires the relationship between the focus state information of the optical system 10 and the target face. The CPU 70 may detect the position of the target face from the acquired relationship. Further, the detected in-focus position may be used for moving image capturing processing.

  FIG. 4 is a rear view of the camera 100 when the objects A and B are imaged with the objects A and B as the targets of imaging and sound collection, and is an example of the display of the objects A and B on the display panel 40. The display on the display panel 40 matches the captured image. Frames 91 and 93 in FIG. 4 indicate the positions of the objects A and B detected by the CPU 70 in step S10, and correspond to the positions of the faces of the objects A and B, respectively.

  Returning to the description of FIG. The CPU 70 stores the target position information in the captured image detected in step S10 in the memory 34 as pre-REC position information (step S12). The CPU 70 recognizes the direction of the target with respect to the camera 100 based on the detected position information of the target in the captured image (step S14).

  Here, step S14 will be described with reference to FIG. FIG. 5 is a diagram illustrating a positional relationship between the camera 100 and the objects A and B on the plane, and is an example in which the camera 100 and the objects A and B are arranged on the XY plane. For example, when the objects A and B are displayed on the display panel 40 as shown in FIG. 4 and the CPU 70 detects the positions of the objects A and B, the CPU 70 recognizes the directions of the objects A and B with respect to the camera 100 as shown in FIG. To do. In FIG. 5, the camera 100 is located at the origin of the XY plane, the direction from left to right of the camera 100 is the positive direction of the X axis, and the direction from the back to the front of the camera 100 is the positive direction of the Y axis. Correspond to each. Areas 160, 162, and 164 indicated by broken lines indicate areas that can be collected by the microphones 44, 46, and 48, respectively. As illustrated in FIG. 5, the CPU 70 recognizes the directions of the objects A and B as being diagonally left front and right diagonally forward with respect to the camera 100, respectively. Objects A and B are located in regions 164 and 160, respectively.

  Returning to the description of FIG. The CPU 70 performs a sub process of selecting a microphone that collects the sound emitted by the target and adjusting the sensitivity of the selected microphone (step S16). Details of the sub-process corresponding to step S16 will be described later.

  The CPU 70 determines whether or not the REC button is turned on (step S18). The CPU 70 determines Yes when the REC button is turned on. If step S18 is No, the CPU 70 returns to step S10. When step S18 is Yes, CPU70 starts imaging of a moving image, and collects the sound which an object emits (step S19). Similar to step S10, the CPU 70 detects the position information of the target in the captured image (step S20). The CPU 70 stores the detected position information of the target in the memory 34 as post-REC position information (step S22).

  The CPU 70 determines whether or not the pre-REC position information and the post-REC position information match (step S24). In other words, the CPU 70 determines whether or not each of the objects has moved after the start of moving image capturing and sound collection. When none of the objects move, the pre-REC position information and the post-REC position information match, and when at least one of the objects moves, the pre-REC position information and the post-REC position information are different. The CPU 70 determines Yes when the pre-REC position information and the post-REC position information match. If step S24 is Yes, the CPU 70 proceeds to step S32. When step S24 is No, since the object has moved from the position corresponding to the pre-REC position information, the CPU 70 recognizes the direction of the object relative to the camera 100 based on the post-REC position information (step S26). The CPU 70 selects a microphone for collecting the sound emitted by the target, and performs sub-processing for adjusting the sensitivity of the selected microphone (step S28). The sub-process corresponding to step S28 is the same as step S16, and will be described in detail later.

  The CPU 70 updates the pre-REC position information to the post-REC position information (step S30). The CPU 70 determines whether or not the REC button is turned off (step S32). The CPU 70 determines Yes when the REC button is turned off. If step S32 is Yes, the CPU 70 ends the process. If step S32 is No, the CPU 70 returns to step S19 and repeats the process. The above is the description of FIG.

  With reference to FIG. 3B, sub-processing for performing microphone selection and sensitivity adjustment corresponding to steps S16 and S28 of FIG. 3A will be described. FIG. 3B is a flowchart of sub-processing for selecting a microphone and adjusting sensitivity.

  The CPU 70 selects one of the microphones 44, 46, and 48 based on the direction of the object with respect to the camera 100 recognized in step S14 or step S26 of FIG. 3A (step S34). For example, as illustrated in FIG. 5, when the objects A and B are located in the areas 164 and 160, the CPU 70 sets the microphone 48 whose sound collection area is the area 164 and the microphone 44 whose sound collection area is the area 160. select.

  The CPU 70 determines whether or not there are a plurality of targets (step S36). For example, the CPU 70 estimates the number of objects from the in-focus position detected by the contrast detection AF method and the number of faces detected by the face detection unit 28, and determines whether the number of objects is plural. The CPU 70 determines Yes when the number of objects is plural.

  If step S36 is Yes, the CPU 70 performs a sub process for adjusting the sensitivity of the selected microphone (step S38), and ends the process. CPU70 complete | finishes a process, when step S36 is No.

  With reference to FIG. 6, the sub-process for adjusting the sensitivity of the microphone corresponding to step S38 in FIG. 3B will be described. FIG. 6 is a flowchart of sub processing for adjusting the sensitivity of the microphone. Hereinafter, let X be a variable for storing a period (unit: frame) for averaging the levels of the detected sound signal. The variable X may be set to an arbitrary value by the user, or may be set in advance at the time of shipment.

  The CPU 70 confirms the variable X stored in the memory 34 and determines whether or not a value has been set (step S40). The CPU 70 determines Yes when a value is set in the variable X.

  When step S40 is Yes, the CPU 70 collects the sound emitted by the target with each selected microphone, and calculates the average value of the level of the sound signal detected in one frame period in the X frame section (step S42). . The average value of the sound signal level calculated for each microphone is stored in the memory 34. For example, when the variable X is 900, the section of the X frame is 30 seconds. The sound signal is detected for each frame for 30 seconds to obtain the sum, and the sum is divided by X to calculate the average value of the sound signal level per 30 seconds. Note that other methods may be used to calculate the average value of the sound signal levels. For example, the average value of the sound signal levels may be calculated by detecting the level of the sound signal in an X frame interval at an arbitrary frame period. Hereinafter, one of the average values of the sound signal levels stored for each microphone is referred to as a value Y.

  When Step S40 is No, the CPU 70 collects the sound emitted by the target with each selected microphone and detects the level of the sound signal in the first frame. The level of the sound signal detected for each microphone is stored in the memory 34. For example, when one second is 30 frames, the level of the sound signal corresponding to 2 to 30 frames is not detected, but only the level of the sound signal corresponding to the first frame is detected. Note that the level of the sound signal in a frame other than the first frame may be detected. Hereinafter, one of the levels of the sound signal stored for each microphone is set to a value Y as in step S42.

  The CPU 70 determines whether or not the value Y stored in the memory 34 is equal to a predetermined level (step S46), and determines Yes if the value Y is equal to the predetermined level. Here, as an example, the predetermined level is 78 dB corresponding to 60% of the maximum input level (130 dB) preset in the microphone. If step S46 is Yes, the CPU 70 proceeds to step S54. The CPU 70 determines whether or not the value Y is greater than 78 dB when Step S46 is No (Step S48), and determines Yes when the value Y is greater than 78 dB. When step S48 is Yes, the CPU 70 lowers the sensitivity of the microphone by controlling the corresponding VCA (step S50). When step S48 is No, the CPU 70 increases the sensitivity of the microphone (step S52). The CPU 70 determines whether or not all of the selected microphones have been adjusted (step S54). If step S54 is No, the process returns to step S46, and the sensitivity of each selected microphone is adjusted for the value Y corresponding to each microphone for which sensitivity adjustment has not been completed. If step S54 is Yes, the process ends. As described above, the sensitivity of each selected microphone can be adjusted, and the levels of the sound signals output from each microphone can be made the same.

  According to the first embodiment, when there are a plurality of objects as in step S36 of FIG. 3B, the sound control unit 60 and the VCAs 50, 52, and the like, as in step S50 or S52 of FIG. 54 adjusts the sensitivity of the microphones 44, 46 and 48. Thereby, when there are a plurality of objects, it is possible to appropriately collect sounds generated by the plurality of objects and obtain a clear sound. In steps S46, S48, S50, and S52 in FIG. 6, the example in which at least one sensitivity of the plurality of microphones is adjusted so that the level of the sound signal output from the microphones is the same as the predetermined level has been described. In addition, for example, at least one sensitivity of the plurality of microphones may be adjusted so that the level of the sound signal output from the plurality of microphones is within a predetermined range. Further, the same processing as the processing in steps S46, S48, S50, and S52 may be performed by setting any one of the sound signals of the plurality of selected microphones as a predetermined level.

  According to the first embodiment, as described in step S36 in FIG. 3B, the face detection unit 28 detects the number of faces in the captured image, and estimates the number of objects from the number of faces. , Detect the number of objects. Thereby, when an object is a plurality of people, a plurality of people can be recognized and the voice which a plurality of people utters can be collected appropriately. For example, when a plurality of people are arranged in front of and behind the imaging apparatus and have a conversation, the sensitivity of the microphone can be adjusted so that the level of the sound signal of the conversation is the same or within a predetermined range. Therefore, it is possible to collect sound accurately and easily to hear the conversation. Further, according to the first embodiment, as described in step S36 in FIG. 3B, the number of objects is detected based on the number of focus detection positions where the focus state is the in-focus state. Thereby, about an arbitrary object, a plurality of objects can be recognized and the sound which a plurality of objects emit can be collected appropriately. The contrast detection AF method has been described as an example of detecting the in-focus position. Alternatively, for example, a phase difference detection AF method may be used. The number of objects may be detected by combining face detection and in-focus position detection.

  According to the first embodiment, the level of the sound signal output from the microphone is the same as the predetermined level even when a plurality of objects move by the processes shown in FIGS. 3A, 3B, and 6. As described above, it is possible to appropriately collect sounds generated by a plurality of objects by adjusting at least one sensitivity of the plurality of microphones.

  In the first embodiment, the configuration of the camera 100 has been described with reference to FIG. The functions of the image processing unit 26, the face detection unit 28, the sound control unit 60, and the sound recording unit 62 illustrated in FIG. 2 may be configured by software executed by the CPU 70.

  With reference to FIG. 7, a process of collecting sounds emitted by a plurality of objects by adjusting the directivity and sensitivity of the microphone according to the second embodiment will be described. FIG. 7 is a flowchart of a process of collecting sounds emitted from a plurality of objects by adjusting the directivity and sensitivity of the microphone.

  Steps S60, S62, and S64 are the same processes as steps S10, S12, and S14 of FIG. The CPU 70 recognizes the target range in the captured image (step S66).

  Here, step S66 will be described with reference to FIG. As an example of recognizing the target range, a case of recognizing the target face range will be described. FIG. 8 is a diagram illustrating an example of the range of the target face in the captured image, and a rectangle indicating the range of each of the faces 150 and 152 detected by the face detection unit 28 in the display of the targets A and B shown in FIG. It is the figure which added. The CPU 70 recognizes the range of the face 150 as 6 when the face 150 of the target A is included in a rectangle having six vertical and horizontal pixels as shown in FIG. Similarly, the CPU 70 recognizes the range of the face 152 of the target B as 4. In this way, in FIG. 8, when the face range is included in a rectangular range having the same number of pixels on one side, the number of pixels on one side is defined as the face range. Note that other methods may be used to define the face range. For example, when the face range is included in a rectangular range having different vertical and horizontal pixel numbers, the total number of pixels in the rectangle may be defined as the face range. Further, instead of a rectangle, for example, a circle may be used, and the radius or diameter of the circle or the number of pixels in the circle may be defined as the face range.

  Returning to the description of FIG. The CPU 70 selects a microphone that collects the sound emitted from the target, and performs sub-processing for adjusting the directivity and sensitivity of the selected microphone (step S68). Details of the sub-process corresponding to step S68 will be described later.

  The CPU 70 determines whether or not the REC button is turned on (step S70). The CPU 70 determines Yes when the REC button is turned on. If step S70 is No, the CPU 70 returns to step S60. When step S70 is Yes, the CPU 70 performs the processes of steps S71, S72, S74, S76, and S78. Steps S71, S72, S74, S76, and S78 are the same processes as steps S19, S20, S22, S24, and S26 of FIG.

  Since the target has moved from the position corresponding to the pre-REC position information subsequent to step S78, the CPU 70 recognizes the target range again as in step S66 (step S80). The CPU 70 selects a microphone that collects the sound emitted by the object based on the direction and range of the re-recognized object, and performs sub-processing for adjusting the directivity and sensitivity of the selected microphone (step S82). The details of the sub-process corresponding to step S82 are the same as step S68 and will be described later.

  The CPU 70 updates the pre-REC position information to the post-REC position information (step S84). The CPU 70 determines whether or not the REC button is turned off (step S86). The CPU 70 determines Yes when the REC button is turned off. If step S86 is Yes, the CPU 70 ends the process. If step S86 is No, the CPU 70 returns to step S71 and repeats the process. The above is the description of FIG.

  With reference to FIG. 9, the sub-process for adjusting the directivity and sensitivity of the microphone corresponding to steps S68 and S82 will be described. FIG. 9 is a flowchart of sub-processing for adjusting the directivity and sensitivity of the microphone.

  CPU70 selects a microphone based on the direction of the object with respect to the camera 100 recognized by step S64 or step S78 of FIG. 7 (step S88). The CPU 70 adjusts the directivity of the selected microphone based on the target range recognized in step S66 or step S80 in FIG. 7 (step S90).

  Step S90 will be described with reference to FIG. FIG. 10 is a diagram illustrating the relationship between the target range and the microphone directivity. FIG. 10 shows an example in which the camera 100 and the objects A and B are arranged on the XY plane, similarly to FIG. Indicates the area where sound can be collected. The ranges represented by the angles θ1 and θ2 schematically show the directivity of the microphone 48 and can be adjusted by the directivity control motor. Similarly, the ranges represented by the angles θ3 and θ4 schematically show the directivity of the microphone 44. Since the range represented by the angle θ2 is wider than the range of the target A, the microphone 48 collects sounds around the target A within the range represented by the angle θ2 in addition to the sound emitted by the target A. . Therefore, the microphone 48 cannot accurately collect the sound generated by the object A. On the other hand, the range represented by the angle θ1 substantially coincides with the range of the object A. Therefore, by adjusting the directivity range of the microphone 46 to the range represented by the angle θ1, the sound emitted from the target A can be collected accurately. Similarly, since the range represented by the angle θ3 substantially coincides with the range of the target B, the sound emitted from the target B is adjusted by adjusting the directivity range of the microphone 44 to the range represented by the angle θ3. Sound can be collected accurately.

  Returning to the description of FIG. The CPU 70 determines whether or not the number of objects is plural (step S94), similarly to step S36 of FIG. The CPU 70 determines Yes when the number of objects is plural. CPU70 complete | finishes a process, when step S71 is No. When step S94 is Yes, the CPU 70 determines whether or not the detected target range is equal to a predetermined reference value (step S96). The predetermined reference value may be set by the user or may be set in advance. The CPU 70 determines Yes when the detected target range is equal to the predetermined reference value. When Step S96 is No, the CPU 70 determines whether or not the detected target range is larger than a predetermined reference value (Step S98). The CPU 70 determines Yes when the detected target range is larger than a predetermined reference value. When step S98 is Yes, the CPU 70 lowers the sensitivity of the microphone selected in step S88 by controlling the corresponding VCA (step S100). When step S74 is No, the CPU 70 increases the sensitivity of the microphone selected in step S68 by controlling the corresponding VCA (step S102).

  Here, steps S96, S98, S100, and S102 will be described with reference to FIG. For example, it is assumed that the user wants to record a sound emitted by a target whose target range is 5 at an appropriate level and sets a predetermined reference value as 5. Since the range of the target A is 6, which is larger than the predetermined reference value, the camera 100 estimates that the distance to the target A is short. In this case, by reducing the sensitivity of the microphone 48, it is possible to collect the sound emitted by the object A at a lower level. On the other hand, since the range of the target B is 4 which is smaller than the predetermined reference value, the camera 100 estimates that the distance to the target B is large. In this case, by increasing the sensitivity of the microphone 48, it is possible to collect sound generated by the target B at a higher level. In this way, the level of the sound signal collected and the level of the sound signal emitted by the object whose target range is the predetermined reference value can be made the same.

  Returning to the description of FIG. The CPU 70 determines whether or not the adjustment of the sensitivity of all the microphones selected in step S88 has been completed (step S104). CPU70 determines with Yes, when adjustment of the sensitivity of all the microphones selected by step S88 is complete | finished. If step S104 is No, the CPU 70 returns to step S96. CPU70 complete | finishes a process, when step S104 is Yes.

  According to the second embodiment, as shown in step S90 of FIG. 9 and FIG. 10, the sound control unit 60 and the directivity control motor 56 are arranged so that the target face range and the directivity control range of the microphone coincide with each other. The directivity of at least one of 44, 46 and 48 is adjusted. Thereby, since it is possible to suppress the collection of sounds around the object, it is possible to accurately collect the sound emitted by the object.

  In the second embodiment, when there are a plurality of objects as shown in Yes in step S94 in FIG. 9, the microphones are selected based on the range of the target face as in steps S96, S98, S100, and S102 in FIG. An example of adjusting at least one sensitivity has been described. That is, when the target face range is larger than the predetermined range, at least one sensitivity of the microphone is decreased, and when the target face range is smaller than the predetermined range, at least one sensitivity of the microphone is increased. As a result, even when the ranges of the plurality of target faces recognized by the imaging device are different from each other, the levels of the sound signals to be collected can be made the same by adjusting the sensitivity of the corresponding microphones. In addition, for example, the sensitivity of the corresponding microphone may be adjusted so that the level of the collected sound signal falls within a predetermined range. In the flowchart of FIG. 9, the example in which the sensitivity is adjusted by comparing the value of the target range with a predetermined reference value has been described. In addition, for example, increase the sensitivity of the microphone that can collect the sound of the target other than the target with the largest target range, and adjust the level of each sound signal output by the microphone to be the same or within a predetermined range. May be. Conversely, increase the sensitivity of the microphone that can collect the sound of the target other than the target with the smallest target range, and adjust the level of each sound signal output by the microphone to be the same or within the predetermined range. Also good.

  The size of the target face range recognized by the imaging device is inversely proportional to the distance between the imaging device and the target. That is, the distance between the imaging device and the target is close if the target face range recognized by the imaging device is large, and the distance between the imaging device and the target is long if the target face range recognized by the imaging device is small. Therefore, at least one sensitivity of the microphone may be adjusted based on the distance to the target instead of the target face range. For example, at least one sensitivity of the microphone is decreased when the distance to the target is larger than a predetermined distance, and at least one sensitivity of the microphone is increased when the distance to the target is smaller than the predetermined distance. The distance to the target may be estimated from the focus position detected by the AF unit.

  With reference to FIG. 11A, a process for generating a pattern file according to the third embodiment will be described. FIG. 10 is a flowchart of processing for generating a pattern file. The pattern file is data describing a pattern of control information for adjusting the sensitivity of the microphone based on the stored position information of the object. The format of the pattern file data need not be a file. The control information for adjusting the sensitivity of the microphone is a command transmitted from the CPU 70 to the sound control unit 60, a voltage value applied to the VCA, and the like.

  The CPU 70 confirms whether or not the REC button is on (step S110). The CPU 70 determines Yes when the REC button is on. If step S110 is No, the process ends. When Step S110 is Yes, the CPU 70 detects the target position information in the same manner as Steps S10 and S20 in FIG. 3A and Steps S60 and S72 in FIG. 7 (Step S112). The CPU 70 stores the target position information in the memory 34 (step S114). The CPU 70 confirms whether or not the REC button is off (step S116). If the REC button is off, the CPU 70 determines Yes. When step S116 is No, the CPU 70 returns to step S112 and repeatedly detects and stores the target position information until the REC button is turned off. When step S116 is Yes, the CPU 70 generates a pattern file based on the stored position information of the target (step S110), and ends the process.

  With reference to FIG.11 (b), the process which collects the sound which an object emits based on the pattern which concerns on Example 3 is demonstrated. FIG. 11B is a flowchart of the process of collecting the sound emitted by the target based on the pattern.

  The CPU 70 determines whether or not to reproduce the pattern file (step S120). The CPU 70 determines Yes when there is an instruction to start reproduction of the pattern file by the user. The instruction to start the reproduction of the pattern file by the user is performed by operating the operation unit 68 on an operation screen displayed on the display panel 40, for example. When step S120 is Yes, CPU70 displays a pattern on the display panel 40 (step S122). Here, the displayed patterns are frames 91 and 93 superimposed on the target position, for example, as shown in FIG. The CPU 70 collects the sound emitted by the object while adjusting the sensitivity of the microphone based on the pattern (step S124). The CPU 70 determines whether or not to end the reproduction of the pattern file (step S126). The CPU 70 determines Yes when there is an instruction to end the reproduction of the pattern file by the user. When Step S126 is No, the CPU 70 returns to Step S122 and continues the pattern display and the sound collection by the pattern. CPU70 complete | finishes a process, when step S126 is Yes.

  According to the third embodiment, the memory 34 stores a pattern for adjusting the sensitivity of the microphones 44, 46, and 48 as in step S114 in FIG. 11A, and as in step S124 in FIG. The sound control unit 60 and the VCAs 50, 52, and 54 adjust the sensitivities of the microphones 44, 46, and 48 based on the pattern. This makes it possible to perform sound collection efficiently without repeatedly detecting the target position when repeatedly collecting sound from a scene that emits sound while the target performs a predetermined operation or when the positional relationship of multiple targets is the same. Can do.

  In Embodiments 1 to 3, a camera has been described as an example of an imaging apparatus. The imaging device may be a video camera, a mobile phone with a camera, or the like.

  Although the embodiments of the present invention have been described in detail above, the present invention is not limited to such specific embodiments, and various modifications and changes can be made within the scope of the gist of the present invention described in the claims. It can be changed.

DESCRIPTION OF SYMBOLS 10 Optical system 18 Image pick-up element 22 AF unit 24 Shutter unit 26 Image processing part 28 Face detection part 34 Memory 40 Display panel 44, 46, 48 Microphone 50, 52, 54 VCA
56 Directivity control motor 60 Sound control unit 62 Sound recording unit 66 REC button 70 CPU
100 Imaging device

Claims (8)

An imaging means for capturing an image;
Detecting means for detecting the number of objects in the image;
A plurality of sound collecting means for collecting sounds emitted by the object;
A sensitivity adjusting means for adjusting the sensitivity of the plurality of sound collecting means when the number of objects is plural;
An imaging device comprising: The detecting means detects a range of the object in the image;
The imaging apparatus according to claim 1, further comprising directivity adjusting means for adjusting at least one directivity of the plurality of sound collecting means based on the target range.   When the number of the objects is plural, the sensitivity adjusting means includes the plurality of sound collecting means corresponding to the objects so that the level of each sound signal output from the plurality of sound collecting means is within a predetermined range. The image pickup apparatus according to claim 1, wherein at least one sensitivity is adjusted. The detecting means detects a range of the object in the image;
The said sensitivity adjustment means adjusts at least one sensitivity of the said several sound collection means corresponding to the said object based on the range of the said object, The Claim 1 characterized by the above-mentioned. Imaging device. The detecting means detects a distance to the object;
The said sensitivity adjustment means adjusts at least 1 sensitivity of the said several sound collection means corresponding to the said object based on the distance with the said object, The any one of Claim 1 to 3 characterized by the above-mentioned. Imaging device.   The imaging device according to claim 1, wherein the detection unit detects a face in the image and detects the number of the objects based on the number of the faces.   The detection means detects a focus state of the optical system with respect to a focus detection position set in an image plane of the optical system, and based on the number of the focus detection positions where the focus state is a focused state, the target The imaging device according to claim 1, wherein the number of the imaging devices is detected. Storing means for storing a pattern for adjusting sensitivity of the plurality of sound collecting means;
The imaging apparatus according to claim 1, wherein the sensitivity adjusting unit adjusts the sensitivity of the plurality of sound collecting units based on a pattern stored in the storage unit.

Images