JP2013131894A - Imaging apparatus, imaging environment discrimination method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily discriminate an imaging environment by a simple constitution.SOLUTION: An output sound signal generator 21 and a speaker 22 output extra-audio sounds. An extra-audio sound analyzer 25 detects the extra-audio sounds outputted from the speaker 22 from sounds collected by a microphone 23, and a time difference measurement unit 26 mesures a time difference until the outputted extra-audio sounds are collected. A discrimination unit 401 discriminates whether an imaging environment is, for example, underwater or in the air in accordance with the measured time difference and switches the signal processing operations of an image signal processor 13 and a sound signal processor 24 in accordance with the discrimination result.

Description

  This technique relates to an imaging apparatus, an imaging environment determination method, and a program. Specifically, the imaging environment can be easily determined with a simple configuration.

  In recent imaging apparatuses, a plurality of imaging modes are provided according to the imaging environment. For example, a normal mode corresponding to imaging in air and an underwater mode corresponding to imaging in water are provided. In such an imaging apparatus, optimal image quality control, audio control, and the like are performed for each imaging mode.

  Moreover, in patent document 1, whether an imaging environment is underwater by projecting infrared light and visible light with respect to a target object, detecting the reflected signal light from this target object, and calculating a level. Is being determined. Moreover, in patent document 2, the fall in water is detected by detecting the acceleration added to an imaging device.

JP-A-8-43724 JP 2010-118759 A

  By the way, when the user manually sets the imaging mode, there is a possibility that the imaging mode corresponding to the imaging environment is not set. For example, if you have forgotten to set the imaging mode according to the scene you have assumed in advance, or if you are not familiar with the operation and have not been set to the imaging mode that corresponds to the imaging environment, image quality adjustment suitable for the imaging environment In other words, the captured image and the sound are recorded without adjusting the sound or sound.

  Also, when projecting infrared light and visible light to determine the imaging environment based on reflected signal light, a light emitting unit that emits infrared light and visible light and a light receiving unit that receives each reflected signal light are required. Therefore, the imaging device cannot be configured at low cost. In addition, when the light emitting unit and the light receiving unit are built in the imaging apparatus, it is a bad effect for downsizing the imaging apparatus. Furthermore, when shooting an image in which the environment changes during imaging, light is always emitted to the object, which may hinder the original color or shadow of the object.

  In addition, the method of detecting the fall in water by detecting the acceleration applied to the image pickup device is intended to detect only the fall in water. Whether the image pickup environment is underwater or not while holding the image pickup device. Cannot determine whether in air.

  Accordingly, an object of the present technology is to provide an imaging apparatus, an imaging environment determination method, and a program that can easily determine an imaging environment with a simple configuration.

  A first aspect of this technology is that a sound output unit that outputs an audible out-of-band sound, a sound collection unit that collects sound, and a sound collected by the sound collection unit, An audible out-of-band sound analyzing unit for detecting the output audible out-of-band sound; a time difference measuring unit for measuring a time difference between the output of the audible out-of-band sound from the sound output unit and the detection of the audible out-of-band sound; and The imaging apparatus includes a determination unit that determines a use environment based on the time difference measured by the time difference measurement unit.

  In this technology, the audible out-of-band sound is output from the sound output unit, and the audible out-of-band sound output from the sound output unit is detected by the audible out-of-band sound analysis unit from the sound collected by the sound collection unit. Done. When the audible out-of-band sound cannot be detected, the sound output unit increases the volume level of the audible out-of-band sound. In addition, the frequency of the sound outside the audible band is changed. Furthermore, the audible out-of-band sound analysis unit analyzes the environmental sound before outputting the audible out-of-band sound, and the sound output unit sets the frequency and volume level of the audible out-of-band sound according to the analysis result of the environmental sound. Do. For example, the frequency of the environmental sound with a low volume level is set as the frequency of the sound outside the audible band.

  The audible out-of-band sound analysis unit sets an audible out-of-band sound analysis period based on the output timing of the audible out-of-band sound. Further, the determination unit validates the determination result when the determination result continues for a certain period. The signal processing according to the determination result of the determination unit is performed on at least one of the image signal and the sound signal generated by the sound collection unit. The determination unit determines whether or not the imaging environment is underwater based on the measured time difference when the mode for automatically switching the signal processing according to the imaging environment is selected.

  The second aspect of the present technology includes a step of outputting an audible out-of-band sound at the sound output unit, a step of collecting the sound at the sound collection unit, and the sound collected by the sound collection unit. A step of detecting an audible out-of-band sound output from the output unit, a step of measuring a time difference until the audible out-of-band sound output from the sound output unit is collected by the sound collection unit, and the measurement And a step of determining the imaging environment based on the time difference.

  A third aspect of this technique is a program for determining a use environment of an electronic device by a computer, and includes a procedure for outputting an audible out-of-band sound from a sound output unit, and a sound collected by the sound collection unit. A procedure for detecting an audible out-of-band sound output from the sound output unit, a procedure for measuring a time difference until the audible out-of-band sound output from the sound output unit is collected by the sound collection unit, and the measurement A program for causing the computer to execute a procedure for determining an imaging environment based on the time difference.

  Note that the program of the present technology is, for example, a storage medium or a communication medium provided in a computer-readable format to a general-purpose computer that can execute various program codes, such as an optical disk, a magnetic disk, or a semiconductor memory. It is a program that can be provided by a medium or a communication medium such as a network. By providing such a program in a computer-readable format, processing corresponding to the program is realized on the computer.

  According to this technique, the sound output unit outputs the audible out-of-band sound, and the sound collection unit collects the sound. In addition, the detection environment of the audible out-of-band sound output from the sound output unit from the sound collected by the sound collection unit is detected, and the imaging environment is determined based on the time difference until the output audible out-of-band sound is collected. For example, it is determined whether or not it is underwater. Therefore, it is possible to easily determine the imaging environment with a simple configuration.

It is a figure which shows the structure of an imaging device. It is a figure for demonstrating the principle of discrimination | determination of an imaging environment. It is a flowchart which shows the 1st operation | movement of an imaging device. It is a flowchart which shows the 2nd operation | movement of an imaging device.

Hereinafter, embodiments for carrying out the present technology will be described. The description will be given in the following order.
1. Configuration of imaging apparatus 2. Principle of discrimination of imaging environment First operation of imaging apparatus 4. Second operation of imaging apparatus <1. Configuration of Imaging Device>

  FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus according to the present technology. The imaging device 10 includes an imaging optical system block 11, an imaging unit 12, an image signal processing unit 13, an output sound signal generation unit 21, a speaker unit 22, a microphone unit 23, a sound signal processing unit 24, an audible out-of-band sound analysis unit 25, A time difference measuring unit 26 is provided. Further, the imaging apparatus 10 includes a compression / expansion unit 31, a recording / playback unit 32, a display unit 33, an external interface unit 34, a control unit 40, and an operation unit 41. The image signal processing unit 13, the output sound signal generation unit 21, the sound signal processing unit 24, the compression / decompression unit 31, the recording / playback unit 32, the display unit 33, the external interface unit 34, and the control unit 40 are connected via a bus 50. It is connected.

  The imaging optical system block 11 is configured using a focus lens, a zoom lens, and the like, and forms an optical image of a subject on an imaging surface of an imaging element provided in the imaging unit 12. In addition, the imaging optical system block 11 is provided with a diaphragm, a mechanical shutter, and the like, and adjusts the brightness of an optical image formed on the imaging surface of the imaging device and adjusts the light transmitted through the imaging optical system block 11. Perform the shutter operation.

  The imaging unit 12 includes, for example, an imaging element such as a charge coupled device (CCD) imager or a complementary metal oxide semiconductor (CMOS) sensor, and a drive unit that drives the imaging element. The imaging unit 12 performs photoelectric conversion and generates an analog image signal corresponding to the optical image. The imaging unit 12 performs noise removal, gain adjustment, analog-digital (A / D) conversion, and the like on the analog image signal, generates a digital image signal, and outputs the digital image signal to the image signal processing unit 13.

  The image signal processing unit 13 performs camera signal processing such as gamma correction processing, color correction processing, and white balance adjustment processing. Further, the image signal processing unit 13 switches camera signal processing based on the imaging mode signal from the control unit 40. For example, in water, light is gradually absorbed from light on the long wavelength side. For this reason, when an underwater image is taken under sunlight, the color becomes bluish. Therefore, when the imaging mode signal indicates that the underwater mode is set, the image signal processing unit 13 performs white balance adjustment processing so that the white subject is correctly displayed as white in the underwater mode. When the normal mode is indicated by the imaging mode signal, white balance adjustment processing is performed so that a white subject is correctly displayed as white under sunlight or various illumination lights. Further, the image signal processing unit 13 performs a resolution conversion process for converting the captured image into a resolution corresponding to the display size of the display unit.

  The sound output unit includes an output sound signal generation unit 21 and a speaker unit 22. The output sound signal generation unit 21 generates an output sound signal based on the control signal from the control unit 40. For example, when reproducing the recorded sound, the output sound signal generation unit 21 outputs the sound signal supplied from the compression / decompression unit 31 or the recording / reproduction unit 32 to the speaker unit 22 as an output sound signal. If the sound signal supplied from the compression / decompression unit 31 or the recording / reproducing unit 32 is a digital sound signal, it is converted into an analog sound signal. When determining the imaging environment, the output sound signal generation unit 21 generates an audible out-of-band sound signal based on the control signal from the control unit 40, and the speaker unit uses the audible out-of-band sound signal as an output sound signal. 22 to output. Further, the output sound signal generation unit 21 generates an output identification signal indicating the output of the audible out-of-band sound signal and outputs the output identification signal to the time difference measurement unit 26. The output sound signal generation unit 21 generates a sound signal indicating an operation sound or the like corresponding to a user operation based on the control signal from the control unit 40 and outputs the sound signal to the speaker unit 22 as an output sound signal. Further, the output sound signal generation unit 21 adjusts the signal level of the output sound signal, the frequency of the audible out-of-band sound signal, and the like based on the control signal from the control unit 40.

  The speaker unit 22 performs sound output based on the output sound signal supplied from the output sound signal generation unit 21. The sound output unit corresponds to the output sound signal generation unit 21 and the speaker unit 22.

  The microphone unit 23 collects sound and generates a sound signal. The microphone unit 23 outputs the generated sound signal to the sound signal processing unit 24 and the audible out-of-band sound analysis unit 25.

  The sound signal processing unit 24 performs signal processing of the sound signal supplied from the microphone unit 23. The sound signal processing unit 24 switches sound signal processing based on the imaging mode signal from the control unit 40. For example, it is known that human auditory characteristics are greatly different in water and in air, and in water, especially in the vicinity of 3 kHz to 8 kHz, the audibility is very poor. For this reason, the sound in the water becomes a sound in which the middle region is hard to hear, and such a sound is felt to be “underwater” for humans. Therefore, the sound signal processing unit 24, when the imaging mode signal indicates that it is the underwater mode, the sound signal so that the sound collected by the microphone unit 23 has frequency characteristics close to human auditory characteristics in water. Is corrected. The sound signal processing unit 24 also performs processing for converting an analog sound signal into a digital sound signal, noise removal processing for removing noise from the sound signal, and the like. The sound signal processing unit 24 outputs the processed sound signal to the compression / decompression unit 31 or the recording / reproducing unit 32.

  The audible out-of-band sound analyzing unit 25 analyzes the sound signal supplied from the microphone unit 23 and detects the audible out-of-band sound signal generated by the output sound signal generating unit 21. The audible out-of-band sound analysis unit 25 generates a detection signal indicating the detection result and outputs the detection signal to the time difference measurement unit 26.

  The time difference measuring unit 26 measures a time difference between the output of the audible out-of-band sound and the detection of the audible out-of-band sound. When the time difference measuring unit 26 determines the imaging environment, the time difference measuring unit 26 outputs the audible band from the speaker unit 22 based on the output identification signal supplied from the output sound signal generating unit 21 and the detection signal supplied from the audible out-of-band sound analyzing unit 25. The time difference between the timing at which the external sound is output and the timing at which the output audible out-of-band sound is collected by the microphone unit 23 and detected by the sound signal processing unit 24 is measured, and the time difference measurement result is measured by the control unit 40. Output to.

  The compression / decompression unit 31 performs compression processing on the image signal output from the image signal processing unit 13 and the sound signal output from the sound signal processing unit 24 to generate encoded data, and the recording / playback unit 32 and the external interface unit 34. The compression / decompression unit 31 performs a decompression process on the encoded data supplied from the recording / playback unit 32 or the encoded data supplied from an external device via the external interface unit 34, and the image signal after the expansion process is converted into an image. The signal is output to the signal processing unit 13 or the display unit 33. Further, the compression / decompression unit 31 outputs the sound signal obtained by performing the decompression process of the encoded data to the output sound signal generation unit 21.

  The recording / reproducing unit 32 records the image signal output from the image signal processing unit 13, the sound signal output from the sound signal processing unit 24, and the encoded data output from the compression / decompression unit 31 on a recording medium. In addition, a signal recorded on the recording medium is read and output to the external interface unit 34. In addition, when reading the encoded data recorded on the recording medium, the recording / reproducing unit 32 outputs the read encoded data to the compression / decompression unit 31. Further, the recording / reproducing unit 32 outputs the image signal read from the recording medium to the image signal processing unit 13 or the display unit 33, and outputs the read sound signal to the output sound signal generating unit 21.

  The display unit 33 performs image display based on the image signal supplied from the image signal processing unit 13, the compression / decompression unit 31, or the recording / reproducing unit 32.

  The external interface unit 34 is an interface for connecting an external device. The external interface unit 34 outputs the image signal, sound signal, or encoded data generated by the imaging device 10 to an external device. In addition, the image signal, the sound signal, or the encoded data supplied from the external device is taken into the imaging apparatus 10.

  An operation unit 41 is connected to the control unit 40. The operation unit 41 is configured using operation switches, operation buttons, a touch panel, and the like, and generates an operation signal corresponding to a user operation and outputs the operation signal to the control unit 40. In addition, the operation unit 41 includes, for example, a switch for manually or automatically setting the imaging mode, an underwater mode in which imaging is performed in water when the imaging mode is manually set, or a normal mode in which imaging is performed in the air. A switch or the like for selection is provided.

  The control unit 40 controls each unit based on the operation signal, thereby controlling each unit so that the operation of the imaging apparatus 10 becomes an operation corresponding to the user operation. The control unit 40 is provided with a determination unit 401. The discriminating unit 401 discriminates the imaging environment based on the time difference measurement result when the imaging mode is automatically set. The determination unit 401 sets the underwater mode or the normal mode based on the determination result of the imaging environment, and performs signal processing operations of the image signal processing unit 13 and the sound signal processing unit 24 according to the set imaging mode. And

<2. Principle of discrimination of imaging environment>
Next, the determination of the imaging environment will be described. The propagation speed of sound is about 340 m / s in the air, about 1500 m / s in the water, and the propagation speed in the water is about 4.5 times that in the air. It is known that Therefore, the time difference between when the audible out-of-band sound is output from the speaker unit 22, the audible out-of-band sound is collected by the microphone unit 23, and the audible out-of-band sound analyzing unit 25 detects the audible out-of-band sound is For example, as shown in FIG. 2, the difference is in water and in air. 2A shows a sound signal of an audible out-of-band sound supplied to the speaker unit 22. FIG. 2B is a sound signal output from the microphone unit 23 by collecting the audible out-of-band sound in the water, and FIG. 2C is a mic showing the audible out-of-band sound in the air. A sound signal collected by the unit 23 and output from the microphone unit 23 is shown.

  Thus, since the propagation speed of sound is different between air and water, the time difference measuring unit 26 measures the time difference from the output of the audible out-of-band sound to the detection of the audible out-of-band sound, and the measured time difference. Based on the above, the determination unit 401 can determine whether the imaging environment is in air or underwater. For example, the determination unit 401 compares the time difference measured by the time difference measurement unit 26 with a threshold, and when the time difference is shorter than the threshold, the imaging environment is “underwater”, and when the time difference is greater than or equal to the threshold, the imaging environment Is identified as “in the air”.

  Further, the imaging device 10 measures the time difference based on the direct sound of the audible out-of-band sound collected by the microphone unit 23. Thus, if the time difference is measured based on the direct sound, it is not necessary to consider the distance to the subject as in the case of using the reflected sound from the subject, and the imaging environment can be easily determined. become. Here, based on the distance (distance) between the speaker unit 22 and the microphone unit 23 provided in the imaging device 10, the propagation until the direct sound of the audible out-of-band sound output from the speaker unit 22 reaches the microphone unit 23. Time can be estimated for each imaging environment. Therefore, when measuring the time difference based on the direct sound, the audible out-of-band sound analysis period is set based on the output identification signal notified from the output sound signal generation unit 21 and the estimated propagation time for each imaging environment. Thus, it is possible to detect the sound outside the audible band while reducing the influence of the reflected sound.

  Further, if the frequency of the audible band is high, the directivity increases, and the audible band outside sound output from the speaker unit 22 provided in the imaging device 10 is transmitted by the microphone unit 23 provided in the imaging device 10. It becomes difficult to collect sound as a direct sound. Therefore, the frequency of the audible out-of-band sound is a frequency outside the audible band and is a frequency at which the audible out-of-band sound output from the speaker unit 22 reaches the microphone unit 23 as a direct sound.

<3. First Operation of Imaging Device>
FIG. 3 is a flowchart showing a first operation of the imaging apparatus. In step ST1, the imaging device 10 initializes the audible out-of-band sound. The imaging device 10 controls the output sound signal generation unit 21 by the control unit 40 to supply an audible out-of-band sound signal having a predetermined frequency and level to the speaker unit 22, and the audible out-of-band sound from the speaker unit 22. The output is performed and the process proceeds to step ST2. The output sound signal generation unit 21 generates an output identification signal indicating the output of the audible out-of-band sound signal and outputs the output identification signal to the time difference measurement unit 26.

  In step ST2, the imaging device 10 determines whether or not the audible out-of-band sound has been collected. The imaging apparatus 10 analyzes the sound signal from the microphone unit 23 in the audible out-of-band sound analyzing unit 25 and determines whether the audible out-of-band sound signal has been detected. If the audible out-of-band sound analysis unit 25 can detect the audible out-of-band sound signal, the imaging apparatus 10 proceeds to step ST3. If the audible out-of-band sound analyzing unit 25 cannot detect the audible out-of-band sound signal, the imaging apparatus 10 proceeds to step ST8.

  In step ST <b> 3, the imaging device 10 determines whether the sound is an audible out-of-band sound output from the speaker unit 22. The audible out-of-band sound analysis unit 25 analyzes the detected audible out-of-band sound signal and determines whether the detected audible out-of-band sound signal is a signal based on the audible out-of-band sound output from the speaker unit 22. For example, the audible out-of-band sound analysis unit 25 is an audible out-of-band sound output from the speaker unit 22 when the detected audible out-of-band sound signal has the same frequency as the audible out-of-band sound output from the speaker unit 22. Is determined. The imaging apparatus 10 proceeds to step ST4 when determining that the sound is an audible out-of-band sound output from the speaker unit 22, and proceeds to step ST8 when it is not determined that the sound is an audible out-of-band sound output from the speaker unit 22. . In addition, when the audible out-of-band sound analysis unit 25 determines that the detected audible out-of-band sound signal is an audible out-of-band sound output from the speaker unit 22, the audible out-of-band sound output from the speaker unit 22 is detected. Is output to the time difference measuring unit 26.

  In step ST4, the imaging apparatus 10 measures the time difference from the output of the audible out-of-band sound to the sound collection. The imaging device 10 measures the time difference between the output of the audible out-of-band sound and the detection of the audible out-of-band sound by the time difference measuring unit 26. For example, based on the output identification signal supplied from the output sound signal generation unit 21 and the detection signal supplied from the audible out-of-band sound analysis unit 25, the time difference between the output of the audible out-of-band sound and the detection of the audible out-of-band sound is calculated. Measure and proceed to step ST5. The time difference measuring unit 26 outputs a time difference signal indicating the measured time difference to the control unit 40.

  In step ST5, the imaging device 10 determines whether the time difference is smaller than the threshold value. The imaging device 10 compares the time difference indicated by the time difference signal supplied from the time difference measurement unit 26 with a preset threshold value by the determination unit 401 of the control unit 40. The imaging device 10 proceeds to step ST6 when the time difference is smaller than the threshold value, and proceeds to step ST7 when the time difference is not smaller.

  In step ST6, the imaging apparatus 10 sets the underwater mode. Since the time difference is smaller than the threshold, the imaging device 10 determines that the imaging environment is “underwater” by the determination unit 401, sets the imaging mode of the imaging device 10 to the underwater mode, and returns to step ST2.

  In step ST7, the imaging apparatus 10 sets the normal mode. Since the time difference is not smaller than the threshold value, the imaging device 10 determines that the imaging environment is “in the air” by the determination unit 401, sets the imaging mode of the imaging device 10 to the normal mode, and returns to step ST2.

  When the process proceeds from step ST2 or step ST3 to step ST8, the imaging apparatus 10 issues a manual setting instruction. Since the imaging device 10 cannot detect the audible out-of-band sound output from the speaker unit 22, the imaging device 10 manually instructs the user to set the imaging mode. For example, the display unit 33 displays an instruction so that the user manually sets the imaging mode, and the process proceeds to step ST9.

  In step ST9, the imaging apparatus 10 determines whether manual setting of the imaging mode has been performed. The imaging device 10 ends the imaging mode automatic setting operation when the user operation for setting the imaging mode is performed on the operation unit 41. If the user operation for setting the imaging mode is not performed, the process returns to step ST1.

  Further, the imaging apparatus 10 may end the imaging mode automatic setting operation by displaying that the imaging mode cannot be automatically set instead of the processing of step ST8 and step ST9.

  In this way, the imaging apparatus 10 can easily determine the imaging environment with a simple configuration, and the imaging mode can be automatically set to the underwater mode or the normal mode according to the imaging environment. Moreover, it is possible to avoid an increase in the size of the imaging device by outputting and collecting sound outside the audible band using a speaker unit and a microphone unit that are conventionally provided in the imaging device. In addition, the cost of the imaging device can be reduced. Further, since the audible out-of-band sound is used, it is possible to automatically determine the imaging environment without affecting the imaging and recording in the imaging device and without impairing the original function and photographing opportunity of the imaging device.

<4. Second Operation of Imaging Device>
By the way, when discriminating the imaging environment using the difference in sound propagation speed, for example, when the volume level of the environmental sound is high or when the environmental sound includes out-of-audible band sound, the audible band output from the speaker unit It becomes difficult to detect external sounds. Therefore, in the second operation, the frequency and volume level of the audible out-of-band sound output from the speaker unit 22 are changed to facilitate detection of the audible out-of-band sound output from the speaker unit, thereby determining the imaging environment. Can be performed more correctly and stably.

  FIG. 4 is a flowchart showing a second operation of the imaging apparatus 10. In step ST11, the imaging device 10 initializes the audible out-of-band sound. The imaging device 10 controls the output sound signal generation unit 21 by the control unit 40 to supply an audible out-of-band sound signal having a predetermined frequency and level to the speaker unit 22, and the audible out-of-band sound from the speaker unit 22. Output is performed and the process proceeds to step ST12. The output sound signal generation unit 21 generates an output identification signal indicating the output of the audible out-of-band sound signal and outputs the output identification signal to the time difference measurement unit 26. Here, as described above, the directivity increases when the frequency of the sound outside the audible band is high, and the sound outside the audible band output from the speaker unit 22 provided in the imaging device 10 is provided in the imaging device 10. It becomes difficult to collect the sound directly from the microphone 23. Therefore, in the initialization, for example, the frequency of the sound outside the audible band is a frequency outside the audible band and low. Further, the audible out-of-band sound is set to, for example, the minimum volume level within a preset volume level variable range so that the audible out-of-band sound having a large volume level is not output from the speaker unit 22 unnecessarily.

  In step ST12, the imaging device 10 determines whether or not the audible out-of-band sound has been collected. The imaging apparatus 10 analyzes the sound signal from the microphone unit 23 in the audible out-of-band sound analyzing unit 25 and determines whether the audible out-of-band sound signal has been detected. If the audible out-of-band sound analyzing unit 25 can detect the audible out-of-band sound signal, the imaging apparatus 10 proceeds to step ST13. If the audible out-of-band sound analyzing unit 25 cannot detect the audible out-of-band sound signal, the imaging apparatus 10 proceeds to step ST21.

  In step ST <b> 13, the imaging apparatus 10 determines whether the sound is an audible out-of-band sound output from the speaker unit 22. The audible out-of-band sound analysis unit 25 analyzes the detected audible out-of-band sound signal and determines whether the detected audible out-of-band sound signal is a signal based on the audible out-of-band sound output from the speaker unit 22. For example, the audible out-of-band sound analyzing unit 25 detects the audible out-of-band sound signal having the same frequency as the audible out-of-band sound output from the speaker unit 22 and is detected only during a period equivalent to the audible out-of-band sound output period. If it is detected, it is determined that the sound is out of the audible band output from the speaker unit 22. The imaging device 10 proceeds to step ST14 when it is determined that the sound is an audible out-of-band sound output from the speaker unit 22, and proceeds to step ST23 when it is not determined that the sound is an audible out-of-band sound output from the speaker unit 22. . In addition, when the audible out-of-band sound analysis unit 25 determines that the detected audible out-of-band sound signal is an audible out-of-band sound output from the speaker unit 22, the audible out-of-band sound output from the speaker unit 22 is detected. Is output to the time difference measuring unit 26.

  In step ST14, the imaging device 10 measures the time difference from the output of the audible out-of-band sound to the sound collection. The imaging device 10 measures the time difference between the output of the audible out-of-band sound and the detection of the audible out-of-band sound by the time difference measuring unit 26. For example, based on the output identification signal supplied from the output sound signal generation unit 21 and the detection signal supplied from the audible out-of-band sound analysis unit 25, the time difference between the output of the audible out-of-band sound and the detection of the audible out-of-band sound is calculated. Measure and proceed to step ST15. The time difference measuring unit 26 outputs a time difference signal indicating the measured time difference to the control unit 40.

  In step ST15, the imaging apparatus 10 determines whether the time difference is smaller than the threshold value. The imaging device 10 compares the time difference indicated by the time difference signal supplied from the time difference measurement unit 26 with a preset threshold value by the determination unit 401 of the control unit 40. The imaging device 10 proceeds to step ST16 when the time difference is smaller than the threshold value, and proceeds to step ST18 when the time difference is not smaller.

  In step ST16, the imaging apparatus 10 determines whether the determination has continued for a certain time. The imaging apparatus 10 validates the determination result when the determination result of step ST15 continues for a predetermined time, proceeds to step ST17, and returns to step ST12 until the determination result continues for a predetermined time.

  In step ST17, the imaging device 10 sets the underwater mode. Since the time difference is smaller than the threshold, the imaging apparatus 10 determines that the imaging environment is “underwater” by the determination unit 401, sets the imaging mode of the imaging apparatus 10 to the underwater mode, and returns to step ST12.

  When the process proceeds from step ST15 to step ST18, in step ST18, the imaging apparatus 10 determines whether the determination has continued for a certain time. The imaging apparatus 10 validates the determination result when the determination result of step ST15 continues for a predetermined time, proceeds to step ST19, and returns to step ST12 until the determination result continues for a predetermined time.

  In step ST19, the imaging device 10 sets the normal mode. Since the time difference is not smaller than the threshold, the imaging device 10 determines that the imaging environment is “in the air” by the determination unit 401, sets the imaging mode of the imaging device 10 to the normal mode, and returns to step ST12.

  When the process proceeds from step ST12 to step ST21, in step ST21, the imaging apparatus 10 determines whether the volume level is maximum. The imaging device 10 returns to step ST11 when the volume level of the audible out-of-band sound output from the speaker unit 22 is maximum, and proceeds to step ST22 when the volume level is not maximum.

  In step ST22, the imaging apparatus 10 increases the volume level. The imaging apparatus 10 increases the volume level of the audible out-of-band sound output from the speaker unit 22 by the output sound signal generation unit 21 by a predetermined amount, and returns to step ST12.

  When the process proceeds from step ST13 to step ST23, in step ST23, the imaging apparatus 10 determines whether the frequency is maximum. The imaging device 10 returns to step ST11 when the frequency of the audible out-of-band sound output from the speaker unit 22 is maximum, and proceeds to step ST24 when the frequency is not maximum.

  In step ST24, the imaging device 10 sets the frequency higher. The imaging device 10 sets the frequency of the audible out-of-band sound output from the speaker unit 22 by the output sound signal generation unit 21 higher by a predetermined frequency, and returns to step ST12.

  In this way, when the volume level of the environmental sound is high and it is difficult to detect the audible out-of-band sound output from the speaker unit 22, the volume level of the audible out-of-band sound is increased. It is easy to detect the audible out-of-band sound. In addition, if the frequency of the environmental sound approximates the frequency of the audible out-of-band sound output from the speaker unit 22, it becomes difficult to detect the audible out-of-band sound output from the speaker unit 22. However, when the audible out-of-band sound is not detected, the frequency of the audible out-of-band sound is changed, so that the environmental sound and the audible out-of-band sound can be separated, and the audible out-of-band sound output from the speaker unit 22 is detected. become able to. For this reason, in the second operation, the imaging environment can be determined more stably than in the first operation. Further, in the second operation, since the determination result is not valid until the determination result continues for a certain time, it is possible to prevent the imaging mode from being frequently switched when the imaging mode is automatically set.

  Further, in the initialization of the audible out-of-band sound, the imaging device 10 analyzes the environmental sound collected by the microphone unit 23, sets the audible out-of-band sound according to the analysis result, and outputs the audible out-of-band sound. May be performed. For example, the imaging device 10 analyzes the volume level for each frequency in the analysis of the environmental sound, and sets the frequency of the environmental sound having a low volume level as the frequency of the audible band based on the analysis result. In addition, the volume level of the sound outside the audible band is set to be larger than the volume level of the environmental sound having the set frequency. If initialization is performed in this way, the influence of environmental sound is less likely to be measured in time difference measurement, and the imaging environment can be automatically and correctly determined before the frequency change and volume level change are repeated.

  Further, as described above, the imaging device 10 may set the audible out-of-band sound analysis period based on the output identification signal indicating the output of the audible out-of-band sound and the propagation time for each imaging environment. In this case, it is possible to detect the sound outside the audible band while reducing the influence of the reflected sound.

  Note that the imaging apparatus 10 is not limited to a configuration that performs all changes to the volume level and frequency, processing that makes the determination result valid when the determination result continues for a certain period of time, setting of an audible out-of-band sound analysis period, and the like. It may be configured to be performed.

  The series of processes described above can be executed by hardware, software, or a combined configuration of both. When processing by software is executed, a program in which a processing sequence is recorded is installed and executed in a memory in a computer incorporated in dedicated hardware. Alternatively, the program can be installed and executed on a general-purpose computer capable of executing various processes.

  For example, the program can be recorded in advance on a hard disk or ROM (Read Only Memory) as a recording medium. Alternatively, the program is temporarily or permanently stored on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, or a semiconductor memory card. Can be stored (recorded). Such a removable recording medium can be provided as so-called package software.

  In addition to installing the program from the removable recording medium to the computer, the program may be transferred from the download site to the computer wirelessly or by wire via a network such as a LAN (Local Area Network) or the Internet. The computer can receive the program transferred in this way and install it on a recording medium such as a built-in hard disk.

  Note that the present technology should not be interpreted as being limited to the above-described embodiment. The embodiments of this technology disclose the present technology in the form of examples, and it is obvious that those skilled in the art can make modifications and substitutions of the embodiments without departing from the gist of the present technology. That is, in order to determine the gist of the present technology, the claims should be taken into consideration.

Moreover, the imaging device of this technique can also take the following structures.
(1) a sound output unit that outputs audible out-of-band sound;
A sound collection unit for collecting sounds;
An audible out-of-band sound analyzing unit for detecting an audible out-of-band sound output from the sound output unit from the sound collected by the sound collecting unit;
A time difference measuring unit for measuring a time difference between the output of the audible out-of-band sound from the sound output unit and the detection of the audible out-of-band sound;
An imaging apparatus comprising: a determination unit that determines an imaging environment based on a time difference measured by the time difference measurement unit.
(2) The sound output unit increases the volume level of the audible out-of-band sound when the audible out-of-band sound analysis unit cannot detect the audible out-of-band sound output from the sound output unit. Imaging device.
(3) The sound output unit changes the frequency of the audible out-of-band sound when the audible out-of-band sound analyzing unit cannot detect the audible out-of-band sound output from the sound output unit (1) or (2) The imaging device described in 1.
(4) The audible out-of-band sound analysis unit performs analysis of environmental sound before outputting the audible out-of-band sound,
The imaging apparatus according to any one of (1) to (3), wherein the sound output unit sets an audible out-of-band sound according to the analysis result of the environmental sound.
(5) The imaging device according to (4), wherein the sound output unit sets a frequency of the environmental sound with a low volume level as a frequency of the audible out-of-band sound.
(6) The imaging apparatus according to any one of (1) to (5), wherein the audible out-of-band sound analysis unit sets an audible out-of-band sound analysis period based on an output timing of the audible out-of-band sound.
(7) The imaging apparatus according to any one of (1) to (6), wherein the determination unit validates the determination result when the determination result continues for a certain period.
(8) a signal processing unit that performs signal processing of at least one of the image signal and the sound signal generated by the sound collecting unit;
The imaging apparatus according to any one of (1) to (7), wherein the signal processing unit performs signal processing according to a determination result of the determination unit.
(9) The determination unit determines an imaging environment based on the measured time difference when a mode for automatically switching signal processing according to the imaging environment is selected. Imaging device.

  In the imaging apparatus and imaging environment determination method and program of this technology, the sound output unit outputs the sound outside the audible band, and the sound collection unit collects the sound. In addition, the detection environment of the audible out-of-band sound output from the sound output unit from the sound collected by the sound collection unit is detected, and the imaging environment is determined based on the time difference until the output audible out-of-band sound is collected. For example, it is determined whether or not it is underwater. For this reason, it is suitable for an imaging device capable of performing an imaging operation in water and an imaging operation in the air, such as a digital camera, a video camera, a terminal device having an imaging function, and the like.

  DESCRIPTION OF SYMBOLS 10 ... Imaging device, 11 ... Imaging optical system block, 12 ... Imaging part, 13 ... Image signal processing part, 21 ... Output sound signal generation part, 22 ... Speaker part, 23・ ・ ・ Microphone unit, 24 ... sound signal processing unit, 25 ... audible out-of-band sound analysis unit, 26 ... time difference measurement unit, 31 ... compression / decompression unit, 32 ... recording / reproducing unit, 33 ... Display unit, 34 ... External interface unit, 40 ... Control unit, 41 ... Operation unit, 50 ... Bus, 401 ... Determination unit

Claims (11)

A sound output unit for outputting audible out-of-band sound;
A sound collection unit for collecting sounds;
An audible out-of-band sound analyzing unit for detecting an audible out-of-band sound output from the sound output unit from the sound collected by the sound collecting unit;
A time difference measuring unit for measuring a time difference between the output of the audible out-of-band sound from the sound output unit and the detection of the audible out-of-band sound;
An imaging apparatus comprising: a determination unit that determines an imaging environment based on a time difference measured by the time difference measurement unit.   The imaging apparatus according to claim 1, wherein the sound output unit increases a volume level of the audible out-of-band sound when the audible out-of-band sound analyzing unit cannot detect the audible out-of-band sound output from the sound output unit.   The imaging apparatus according to claim 1, wherein the sound output unit changes a frequency of the audible out-of-band sound when the audible out-of-band sound analyzing unit cannot detect the audible out-of-band sound output from the sound output unit. The audible out-of-band sound analysis unit performs environmental sound analysis before the output of the audible out-of-band sound,
The imaging apparatus according to claim 1, wherein the sound output unit sets an audible out-of-band sound according to an analysis result of the environmental sound.   The imaging apparatus according to claim 4, wherein the sound output unit sets a frequency of the environmental sound having a low volume level as a frequency of the audible out-of-band sound.   The imaging apparatus according to claim 1, wherein the audible out-of-band sound analysis unit sets an audible out-of-band sound analysis period based on an output timing of the audible out-of-band sound.   The imaging apparatus according to claim 1, wherein the determination unit validates the determination result when the determination result continues for a certain period. A signal processing unit that performs signal processing of at least one of an image signal and a sound signal generated by the sound collecting unit;
The imaging apparatus according to claim 1, wherein the signal processing unit performs signal processing according to a determination result of the determination unit.   The imaging apparatus according to claim 8, wherein the determination unit determines an imaging environment based on the measured time difference when a mode for automatically switching signal processing according to the imaging environment is selected. A step of outputting an audible out-of-band sound at the sound output unit;
Collecting sound at the sound collecting section;
Detecting the audible out-of-band sound output by the sound output unit from the sound collected by the sound collection unit;
Measuring the time difference until the audible out-of-band sound output from the sound output unit is collected by the sound collection unit;
And a step of determining an imaging environment based on the measured time difference. A program for determining the use environment of an electronic device by a computer,
The procedure to output audible out-of-band sound from the sound output unit,
A procedure for detecting an audible out-of-band sound output by the sound output unit from the sound collected by the sound collection unit;
A procedure for measuring a time difference until an audible out-of-band sound output from the sound output unit is collected by the sound collection unit;
A program for causing the computer to execute a procedure for determining an imaging environment based on the measured time difference.

Images