JP5768355B2 - Imaging apparatus, control method, and program - Google Patents

Description

  The present invention relates to an image capturing method using an imaging apparatus, and more particularly to an imaging method for causing an imaging apparatus to focus on a subject by emitting light or sound from the imaging apparatus.

  In recent years, a photographing function for causing an imaging device to pay attention to a subject has been considered. If the subject to be imaged is an adult who understands the language, there is no problem, but if the subject is a baby who does not understand the language yet, or an animal such as a dog or cat, the subject is instructed by the photographer. Therefore, even when the photographer points the image pickup device, the posture does not always take the image pickup device side.

  For example, in order to photograph the front of a dog's face, even if the photographer points the imaging device toward the front of the dog, the dog does not always point the front of the face toward the imaging device. Further, even when the photographer points the imaging device in front of the dog's face, there is a possibility that the dog may face in another direction. For this reason, for example, when photographing the front of an animal's face such as a dog or cat, it is important to face the front of the animal's face toward the imaging device.

  In Patent Document 1, in order to solve the above-described problem, when the release button is pressed halfway by the user, the user who outputs the sound that the pet that is the subject is interested from the camera and determines that the pet is suitable for the camera As one of the proposed cameras, the silver halide film exposes the subject image when the release button is fully pressed.

  Patent Document 2 discloses an imaging apparatus and a program. In this imaging apparatus and program, as described in paragraph <0003> and the like, the imaging apparatus and imaging apparatus capable of photographing at the optimum timing with the face of a subject such as a child or a pet facing the camera. A program for performing control is provided.

  Patent Document 3 discloses an imaging apparatus, a control method thereof, and a program. In this imaging apparatus, its control method, and program, as described in paragraph numbers and the like, a captured image of an object incapable of understanding an instruction from a photographer is appropriately recorded.

JP 2002-107807 A JP 2006-033367 A JP 2009-212980

  According to the invention disclosed in Patent Document 1, it is possible to increase the possibility that the pet's interest is directed to the camera side by outputting a sound in which the pet as the subject is interested. When the front of the pet faces the camera, the user can record a captured image of the pet facing the front by fully pressing the release button.

  Further, according to the invention disclosed in Patent Document 2, the imaging device captures an object and generates image data, and a specifying unit that identifies the object based on the image data generated by the imaging unit And an attention-calling unit that performs actions to alert the subject, so that the faces of subjects that are difficult to shoot, such as children and pets, are pointed toward the imaging device and shot at the optimal timing. Can do.

  Further, according to the invention disclosed in Patent Document 3, in order to photograph an object (specifically, an animal) incapable of understanding an instruction from a photographer, the appropriateness at the moment when the animal's face is directed to the lens side Captured images can be recorded at appropriate timing. Also, when the face of the animal is detected, audio information related to the animal is output and the animal's interest is directed to the imaging device side, so that the animal's face further faces the lens side. A captured image can be recorded. As a result, when a captured image of the front of the animal's face is recorded, the captured image can be recorded at an appropriate timing when the animal's face faces the imaging device.

  However, in the inventions disclosed in the above-mentioned Patent Documents 1 to 3, the warning sound for directing the subject to the lens side is determined by the user depending on what to photograph in advance (whether it is a baby or an animal). Although the selected sound can be reproduced, the subject is determined at the time of shooting, and the sound is not determined according to the subject and can be reproduced. There is a possibility that a photo opportunity may be missed during the selection of sound, and a function for smoothly discriminating a subject and photographing is desired for the user.

SUMMARY OF THE INVENTION An object of the present invention is to provide a mechanism for reproducing a turning sound according to the type of a subject while accepting a half-press operation from the user so that manual shooting can be performed at any timing of the user .

That is, the imaging apparatus of the present invention includes a turning sound setting means for setting a turning sound for alerting a subject to reproduce sound based on the type of the subject, and a half of a shutter button for focusing before shooting. When the first operation accepting unit that accepts the push operation, the subject recognizing unit that recognizes the subject of the image to be photographed, and the first operation accepting unit accept the half-press operation before the execution of the photographing, the subject Based on the type of subject recognized by the recognizing means, the reproducing means for reproducing the turning sound set by the turning sound setting means until the half-pressing operation is released, and the half-pressing operation before the shooting is released. In this case, the playback stop means for stopping the turning sound being played back by the playback means, and the shutter button full press operation for taking an image of the subject are accepted. The subject that is focused according to the half-pressing operation received by the first operation receiving means when the full pressing operation is received by the second operation receiving means and the second operation receiving means a photographing execution means for executing the photographing of an image, when recognizing a plurality of types of objects in front Symbol object recognition unit, among the set turning sound by the setting means, in favor of turning sound for any of the object Priority setting means for setting priority indicating whether or not to reproduce, and the priority setting means, when the plurality of types of subjects are recognized, and the turning sound priority is set, and the subject recognition means recognizes When there are a plurality of types of subjects, the turning sound for the subject to be reproduced with priority according to the priority setting set by the priority setting means is given to other subjects. Includes a priority reproducing means for reproducing in preference to turning sound, and the priority reproducing means, said at priority setting means, there in the case where the plurality of types of preferences of turning sound when it recognizes the object is Te, when the subject recognized by the object recognizing means is a plurality of types, the turning sound for a large number kinds of subjects of the subject, characterized that you play in preference to turning sound on other types of subjects .
In addition, a turning sound setting means for setting a turning sound for alerting the subject to reproduce sound based on the type of the subject, and a first pressing operation for half-pressing the shutter button for focusing before shooting is performed. When the operation accepting unit, the subject recognizing unit for recognizing the subject of the image to be photographed, and the first operation accepting unit accept the half-press operation before the photographing is performed, the subject recognizing unit recognizes Based on the type, reproduction means for reproducing the turning sound set by the turning sound setting means until the half-pressing operation is released, and when the half-pressing operation before performing the shooting is released, the reproducing means A reproduction stop means for stopping the turning sound during reproduction, and a second operation accepting means for accepting a full press operation of a shutter button for taking an image of the subject. When the second operation accepting unit accepts the full-pressing operation, the image of the subject that has been focused according to the half-pressing operation accepted by the first operation accepting unit is executed. Photographing execution means, wherein the reproduction means simultaneously reproduces the turning sound for the plurality of types of subjects when there are a plurality of types of subjects recognized by the subject recognition means.
Further, the reproducing means reproduces the turning sound until the half-press operation of the shutter button is released by repeatedly reproducing the turning sound set by the turning sound setting means .

According to the present invention, it is possible to provide a mechanism for reproducing a turning sound corresponding to the type of a subject while accepting a half-pressing operation of the user's key so as to manually shoot at an arbitrary timing of the user .

It is a figure which shows the hardware constitutions in embodiment of this invention. It is a figure which shows the function structure in embodiment of this invention. It is a figure which shows UI at the time of the setting in embodiment of this invention. It is a figure which shows UI at the time of the setting in embodiment of this invention. It is a figure which shows UI at the time of the setting in embodiment of this invention. It is a figure which shows UI at the time of the setting in embodiment of this invention. It is a figure which shows UI at the time of imaging | photography in embodiment of this invention. It is a figure which shows UI at the time of imaging | photography in embodiment of this invention. It is a figure which shows UI at the time of imaging | photography in embodiment of this invention. It is a figure which shows UI at the time of imaging | photography in embodiment of this invention. It is a figure which shows the data table of the audio | voice file used with the program in embodiment of this invention. It is a figure which shows the basic processing flow of the program in embodiment of this invention. It is a figure which shows the processing flow at the time of the imaging | photography mode of the program in embodiment of this invention. It is a figure which shows the processing flow at the time of the setting mode of the program in embodiment of this invention.

(First embodiment)
FIG. 1 is a block diagram showing a schematic configuration of a photographing apparatus according to the first embodiment of the present invention. In FIG. 1, the photographing apparatus includes a so-called digital camera, a photographing lens 101, an image pickup element (hereinafter referred to as “CCD”) 102, a camera signal processing unit (hereinafter referred to as “ADC”) 103, image processing. Unit 104, controller 110, buffer memory 111, flash ROM 112, interface circuit (hereinafter referred to as “I / F circuit”) 113, card holder 114, recording medium 115, display driver 116, and operation unit 120.

  FIG. 1 is a diagram illustrating a configuration of an imaging apparatus to which the information addition apparatus according to the present embodiment is applied. The imaging apparatus includes a lens 101, an imaging device (CCD) 102, a camera signal processing unit 103, an image processing unit 104, a recording medium 115, a lens control unit 127, a system controller 110, and an operation unit 120. Consists of including.

  The lens 101 is a lens or the like, and includes an objective lens, a zoom lens, a focus lens, and the like. The zoom lens and the focus lens are driven in the optical axis direction by a driving mechanism (not shown).

  The imaging element 102 is configured by a CCD image sensor that forms an image of imaging light incident from the lens 101, converts the imaging light into an electrical signal (analog signal), and outputs the electrical signal.

  The camera signal processing unit (ADC) 103 has a function of performing signal processing such as digital conversion and white balance adjustment on the electric signal received from the image sensor 102 and converting it into a digital signal.

  The controller 110 is connected to the image processing unit 104, buffer memory 111, flash ROM 112, I / F circuit 113, display driver 116, sound driver 118, LED driver 128, and operation unit 120.

  The image processing unit 104 includes a preprocessing unit 105, a YC processing unit 106, an electronic zoom processing unit 107, a compression unit 108, and an expansion unit 109, and generates image data from a digital signal output from the camera signal processing unit 103. Have a function of performing various image processing.

  The pre-processing unit 105 has a function of performing white balance processing for adjusting the white balance of an image based on input image data and image gamma correction processing. The white balance process is a process of adjusting the color of an image so as to be close to the actual color, or adjusting the color to an appropriate color that matches a light source (such as a fluorescent lamp or sunlight). The gamma correction process is a process for adjusting the contrast of an image. Note that the pre-processing unit 105 can also perform image processing other than white balance processing and gamma correction processing.

  The YC processor 106 separates an image based on input image data into luminance information “Y”, luminance signal and blue color difference information “Cb”, and luminance signal and red color difference information “Cr”. Have The electronic zoom processing unit 107 has a function of trimming a part of an image (for example, a central part) with a predetermined size and enlarging the trimmed image to the size of the original image by signal processing. The electronic zoom processing unit 107 can, for example, cut out a central 1024 × 768 dot image from a captured 1600 × 1200 dot image and enlarge it to a size of 1600 × 1200 dot while performing data interpolation.

  The compression unit 108 has a function of compressing image data in a compression format such as a JPEG (Joint Photographic Expert Group) method. The decompression unit 109 has a function of decompressing compressed image data. For example, when compressing image data using the JPEG method, first, a discrete cosine transform process is performed (DCT process) that digitizes the ratio of high-frequency components and low-frequency components of image data. Next, a quantization process is performed for expressing the gradation or gradation of the image by a numerical value (quantization bit number). Finally, the image data is compressed by the Huffman encoding process.

  Specifically, the signal character string of the image data is segmented every certain bit, and a shorter code is given to a character string having a high appearance frequency. In the case of a system that records image data without performing compression processing, the compression unit 108 and the expansion unit 109 can be omitted. Further, the image data compression format is not limited to the JPEG format, and the same processing can be performed even in a GIF (Graphical Interchange Format) format.

  The buffer memory 111 temporarily stores image data when the image processing unit 104 performs image processing. The flash ROM 112 stores various setting information of the photographing apparatus and user authentication information described later. The I / F circuit 113 converts the image data output from the controller 110 into a data format that can be recorded on the recording medium 115. The I / F circuit 113 converts image data read from the recording medium 115 into a data format that can be processed by the controller 110.

  The card holder 114 includes a mechanism that allows the recording medium 115 that is a storage medium to be attached to and detached from the photographing apparatus, and includes an electrical contact that enables data communication with the recording medium 115. The card holder 114 has a structure corresponding to the type of storage medium used in the photographing apparatus. The recording medium 115 is a card-type storage medium that incorporates a semiconductor storage element such as a flash memory and is detachable from the card holder 114. The recording medium 115 can record image data captured by the imaging device.

  The display driver 116 converts the image data output from the controller 110 into a signal that can be displayed on the liquid crystal display 117. Specifically, the display driver 116 performs processing for converting digital image data output from the controller 110 into an analog image signal, and then sets the image size to a size suitable for the size of the displayable area of the liquid crystal display 117. Perform the conversion process.

  The sound driver 118 performs a process of converting the audio data output from the controller 110 into a signal that can be sounded by the speaker 219. An LED (Light Emitting Diode) driver 128 controls the lamp 129 in accordance with a command output from the controller 110.

  The operation unit 120 includes a power switch 121, a mode dial 122, a shooting button 123, a cursor key 124, a zoom button 125, and a browse (playback) button 126. The operation unit 120 receives an operation input from the user and receives a signal corresponding to the operation content. Is output to the controller 110. The operation unit 120 includes operation buttons other than the illustrated operation buttons, but a description thereof is omitted.

  A mode dial (select button) 122 is a rotatable dial for switching the mode of the photographing operation. The user can select a plurality of shooting operation modes by operating the mode dial 122. In the embodiment of the present invention, the mode dial is described as a dial type mechanism. However, for example, a slide type button may be used instead of the dial. That is, the mechanism of the mode dial 122 is not limited to the dial, and it is essential to have a mechanism for switching the camera mode.

  The browsing button 126 is a button for switching to a browsing mode (playback mode) for browsing captured image data. When the browse button 126 is pressed, the shooting mode is changed to the browsing mode. Note that the method for switching to the viewing mode is not limited to pressing the viewing button 126, and may be a transition method using a touch panel (not shown) on the liquid crystal display 117 or the like.

  In the browsing mode, the controller 110 reads setting information and image data from the recording medium 115 attached to the card holder 114 via the I / F circuit 113. The setting information includes the number of images recorded on the currently loaded recording medium 115 and the capacity of the recorded image data. The read image data is, for example, image data or thumbnail data for one image. Note that the image data read from the recording medium 115 is compressed in a predetermined compression format as described above.

  The image data read from the recording medium 115 is input to the display driver 116 via the I / F circuit 113 and the controller 110. The display driver 116 displays the input image data on the liquid crystal display 117.

  The cursor key 124 is a key for the user to perform a predetermined instruction or function selection to the photographing apparatus. The user can perform operation inputs such as various setting information and user authentication information with respect to the photographing apparatus using the cursor key 124. The cursor key 124 can display a menu screen on the liquid crystal display 117 or select a predetermined function of the photographing apparatus. Furthermore, the cursor key 124 can display the image data photographed by the photographing apparatus on the liquid crystal display 117 as a review. The review display is a function of causing the liquid crystal display 117 to display an image photographed by the photographing apparatus 200 immediately after that.

  The review display is not limited to a configuration in which only one image taken on the liquid crystal display 117 is displayed, and a plurality of images including thumbnail images may be displayed. Further, the review display switching is not limited to the pressing of the cursor key 124 but may be switched using a general method such as pressing of another button. Further, the review display screen may be configured such that the review display image can be deleted or edited.

  The lens control unit 127 controls the lens 101 such as zoom, focus, and diaphragm. In addition, the photographing apparatus includes a photographing mode for capturing an image of a subject to obtain image data and a browsing (reproducing) mode for displaying the image data obtained in the photographing mode.

  Note that the sound can be recorded and reproduced in the same manner as the imaging apparatus by using a microphone or a speaker. Further, when recording video (moving image), normal audio recording is also performed at the same time, and video and audio are multiplexed in the compression unit 108 and the expansion unit 109.

  In addition, a photographing operation in the photographing apparatus 200 will be described with reference to FIG. First, the user operates the power switch 121 to turn on the photographing apparatus 200. Then, power is supplied to each circuit from a battery (not shown) built in the photographing apparatus 200, and activation processing of the photographing apparatus 200 (operation control for opening the lens barrier, reset processing of the microcomputer, etc.) is performed. The photographing apparatus 200 is configured such that when the power switch 121 is pressed when the power is turned off, the power is turned on and the photographing mode is automatically set. Further, when the viewing button is pressed when the power is turned off, the power is turned on and the viewing mode is automatically set.

  When the photographing apparatus 200 shifts to the photographing mode, an optical image enters the photographing apparatus through the lens 101 and is imaged on the image sensor (CCD) 102. The CCD 102 converts an incident optical image into an electric signal and outputs it to a camera signal processing unit (ADC) 103. The ADC 103 converts an input electric signal (analog signal) into a digital signal. A digital signal output from the ADC 103 is input to the image processing unit 104.

  A preprocessing unit 105 in the image processing unit 104 generates image data based on an input digital signal, and performs white balance processing, gamma correction processing, and the like. In the YC processing unit 106 in the image processing unit 104, the image data is separated into the luminance signal Y and the color difference signals Cr and Cb, and processing for reducing the information amount of the color difference signals Cr and Cb is performed. The information amount reduction processing for the color difference signals Cr and Cb is, for example, “4: 2: 2 downsampling processing” for thinning out color information in the main scanning direction of an image, or “4: 1” for thinning out color information in the vertical and horizontal directions of an image. : 1 downsampling process ". When image processing is performed in the preprocessing unit 105 and the YC processing unit 106, image data is temporarily stored in the buffer memory 111, and image processing is performed while reading the image data stored in the buffer memory 111 as needed. Is called.

  Image data (uncompressed) output from the image processing unit 104 is input to the controller 110. The controller 110 outputs the image data output from the image processing unit 104 to the display driver 116. The display driver 116 converts input image data (digital signal) into an analog image signal, and adjusts the size of the image based on the analog image signal to a size that can be displayed on the liquid crystal display 117.

  The display driver 116 controls the liquid crystal display 117 to display an image. At this time, the image displayed on the liquid crystal display 117 is an image (through image) generated by performing signal processing continuously in the CCD 102, the ADC 103, and the image processing unit 104.

  When the user operates the shooting button 123 at a desired timing while the through image is displayed on the liquid crystal display 117, the controller 110 outputs a control signal to the image processing unit 104. When a control signal is input to the image processing unit 104, the compression unit 108 stores the image data subjected to image processing in the preprocessing unit 105 and the YC processing unit 106 in the buffer memory 111, and performs compression processing.

  Specifically, discrete cosine transform processing (DCT processing) that digitizes the ratio of high-frequency components and low-frequency components of image data, and quantization that expresses the gradation and gradation of an image with the number of quantization bits Processing, Huffman coding processing for dividing a signal character string of image data into fixed bits and giving a shorter code to a character string having a high appearance frequency is performed. The compressed image data is displayed on the liquid crystal display 117 via the controller 110 and the display driver 116. The compressed image data is recorded on the memory card 115 via the card holder 114.

If the zoom button 125 is operated before the shooting button 123 is operated, the controller 110 can execute an optical zoom process or an electronic zoom process to enlarge or reduce the size of the image. When the shooting button 123 is operated after the zoom button 125 is operated, the image data of the enlarged or reduced image is recorded in the memory card 115.
The hardware configuration and the imaging function of the imaging apparatus that implements the present invention have been described above with reference to FIG.

  Next, the functional configuration of the imaging apparatus that implements the present invention will be described with reference to FIG. FIG. 2 is a diagram illustrating a functional configuration example of an imaging apparatus that implements the present invention.

  In FIG. 2, the photographing apparatus includes a power control unit 201, a mode control unit 202, a data acquisition unit 203, an image display control unit 204, a face detection unit 205, a face determination unit 206, an audio data input / output unit 207, and an audio ringing control unit. 208 and a lamp blinking control unit 209.

First, when the user gives an instruction to turn on the power switch 121, the power control unit 201 detects that the power is on. Further, when an instruction to turn OFF is given, the power supply control unit detects that the power supply is OFF.
Thereafter, the mode control unit 202 determines the mode set by the user operating the mode dial 122. Image data taken by the user is stored in the memory card 115 according to the set mode.

  When the photographing apparatus 200 is requested by the user to view (reproduce) image data stored in the memory card 115, the data acquisition unit 203 acquires the image data in the memory card, and the image display control unit 204 displays the image. I do.

  During shooting, the face detection unit 205 analyzes the through image, and displays an icon on the liquid crystal display 117 if there is a face. Furthermore, the face determination unit 206 determines the type of the face. In this embodiment, the types of faces that can be detected are “person” and “animal” faces. The method for determining which face is known is a known technique. For example, it is possible to determine the face of an animal by the method described in Japanese Patent Application Laid-Open No. 2010-15443. The voice data input / output unit 207 registers and cancels the alerting voice. The sounding sound and the lamp blinking are performed by the sound sounding control unit 208 and the lamp blinking control unit 209. The functional configuration of the imaging apparatus for carrying out the present invention has been described above with reference to FIG.

  Next, processing steps of the imaging apparatus according to the embodiment of the present invention will be described using the flowcharts of FIGS. FIG. 6 is a diagram showing a basic processing flow of a program in the embodiment of the present invention.

  First, the imaging apparatus 100 detects the pressing of the power switch 121 and determines whether the power is on or off (step S601). If the power is on, the process proceeds to step S602, and the state of the mode dial 122 is confirmed (step S602). When the mode dial 122 is in the menu mode, the imaging apparatus 100 switches to the setting mode process (step S604).

  If the mode dial 122 is set to the shooting mode, the imaging apparatus switches to the shooting mode process (step S603). Note that the processing of the shooting mode in step S603 will be described in detail with reference to FIG. Further, the processing of the setting mode in step S604 will be described in detail with reference to FIG.

  As described above, the imaging apparatus 100 is divided into processes described with reference to FIGS. 7 and 8 depending on whether the mode dial 122 is set to the shooting mode or the setting mode.

  First, the processing step in step S604 will be described with reference to FIG. FIG. 8 is a flowchart of the audio setting method executed by the imaging apparatus of the present invention. Note that the screen UI corresponding to each step in FIG. 8 will be described with reference to FIGS.

  First, in step S <b> 801, the imaging apparatus determines whether a menu button press has been received in the setting mode. When the pressing of the menu button is accepted (YES in step S801), the process proceeds to step S802 and a menu screen (not shown) is displayed. If an operation instruction other than pressing the menu button is received (NO in step S801), step S801 is continued in a loop process.

  In step S <b> 802, the imaging apparatus determines whether a selection of “selection of turning sound” based on a user operation instruction is received from a setting mode menu screen (not illustrated) displayed on the display 117. When the “selection of sound for turning” button is received, the process proceeds to step S803, the turning sound data table stored in a predetermined storage unit (specifically, the flash ROM 112) of the imaging apparatus is read, and the turning sound data is stored. Confirm whether or not. The turning direction voice data table will be described in detail with reference to FIG.

  Here, the items provided in the turn audio data table stored in the imaging apparatus according to the embodiment of the present invention will be described with reference to FIG. The turning direction voice data table of FIG. 5 includes “sound file name”, “file format”, “file size”, “registered flag (as a turning sound for infants)”, “registered (as a turning sound for animals)” It is desirable to have an item of “flag”.

  “Voice file name” is the file name of the turning sound displayed on the voice data list screen of FIG. 3-1, which will be described later. In this figure, “Voice of mother 1”, “Voice of mother 2”, “Voice of animal” "Scream" is memorized. As a method for setting an audio file name, a file name can be set by a software keyboard on a file name setting screen (not shown) displayed on the display 117 of the imaging apparatus. “File format” is represented by “mp3”. Indicates the file format of audio data. “File size” indicates the file capacity of audio data.

  The “registered flag” is a flag indicating that it is set as a turning sound for infants or animals in the “setting mode” described in the flowchart of FIG. If the value is “0”, it is not set as a turning sound, and if it is “1”, it indicates a state where it is set as a turning sound.

  Returning to the description of FIG. If the turning sound data is stored as a result of accessing the turning sound data table in step S804, the file name of the turning sound data stored in the data table is acquired (step S805), and the sound data is acquired. A list screen is displayed (step S806). If no audio data is stored, the process returns to the menu screen in step S801.

  FIG. 3A is a user interface example of the audio data list screen displayed on the display 117 in step S806. On the audio data list screen 301, the file name of the audio data acquired from the turning audio data table described in FIG. 5 described later is displayed on the display unit (302). The display unit 302 displays a “PLAY” button 303, a “SET” button 304, and a “MENU” button 305.

  When the imaging device accepts pressing of the “PLAY” button 303 in a state where specific audio data is selected, the imaging device reproduces the selected audio data. The audio data is reproduced by the sound driver 118 via the speaker 119.

  When the imaging device accepts pressing of the “SET” button 304 in a state where specific audio data is selected, the imaging device performs a process of setting the selected audio data as a turning sound.

  When the imaging apparatus accepts pressing of the “MENU” button 305, the imaging apparatus stops setting the turning sound and displays the menu screen in step S801 again. In addition, when a check is received in the “repeatedly play” check box 306, the audio data selected in FIG. 3A can be repeatedly played back at the time of shooting, and the subject can be effectively alerted.

  Subsequently, the description returns to FIG. In step S806, the imaging apparatus displays an audio data list screen on the display 117, and stands by in a pre-playback direction or setting acceptance state. First, when the voice data list screen is displayed, it is determined whether or not the “PLAY” button has been pressed (step S 807). If it is determined that the user has pressed the “PLAY” button, the selection is in progress. Is reproduced (step S808), and the process returns to step S807.

  If it is determined that the button pressed in step S807 is not the “PLAY” button, the process advances to step S809, and the imaging apparatus determines whether the “SET” button is also pressed. If it is determined that the user has pressed the “SET” button (YES in step S809), the imaging apparatus displays an application selection screen (FIG. 3-2) (step S810).

  If it is determined that the button pressed in step S809 is not the “SET” button, the process advances to step S811, and the imaging apparatus determines whether the “MENU” button is also pressed. If it is determined that the user presses the “MENU” button (YES in step S811), the process returns to step S802 to display the menu screen. In step S810, the imaging apparatus enters a standby state in a state where the use selection screen (FIG. 3-2) is displayed.

  FIG. 3-2 is an example of a user interface of a usage selection screen displayed on the display 117 in step S810. On the usage selection screen 311, an option for selecting the usage of the audio data set as the turning sound in step S <b> 809 is displayed on the display unit 312.

  For example, in this figure, “Mother's voice 1” is selected in step S809, and options 312 for “infant” and “animal” are displayed on 312. When the usage selection screen is displayed, the setting of the turning sound is executed by accepting 313 options. Note that if “cancel” is selected during the use selection screen display (step S812), the process returns to step S806 described above.

  Returning to the description of FIG. When the imaging apparatus receives selection of the option 313 while the application selection screen is displayed (step S813), the imaging apparatus checks whether a turning sound has already been set (steps S814 and S815). Specifically, the value of the set flag of each audio data in the turn audio data table, which is set and stored in the storage unit (flash ROM 112) of the imaging device, is read, and the option that has been selected in step S813 has been registered. It is confirmed whether there is audio data with a flag “1”. The turning direction voice data table of FIG. 5 includes registered flag items of “for infants” and “for animals”.

  In step S814, it is confirmed whether there is registered audio data. If there is registered audio data (YES in step S815), the imaging apparatus displays an overwriting confirmation screen (step S816). To accept the permission of overwriting registration. If there is no registered audio data (NO in step S815), the process proceeds to step S818, and a processing screen is displayed.

  If “Yes” is selected as an instruction to execute overwriting confirmation when the overwriting confirmation screen is displayed in step S816 (YES in step S817), a processing screen is displayed (step S818). If “No” is selected (NO in step S817), the process returns to S810 described above. In step S819, the imaging apparatus performs audio data registration processing and ends the setting mode.

  Specifically, the “registered flag (for infants or for animals)” of the corresponding audio data in the turning direction audio data table of FIG. 5 is set to “1” in the storage unit (flash ROM 112) of the imaging apparatus.

  According to the above processing, it is possible to register the turning sound data according to the photographing application (whether it is infant photographing or animal photographing).

  Next, the processing step in step S603 will be described with reference to FIG. The screen UI corresponding to each step in FIG. 7 will be described with reference to FIGS. FIG. 7 is a diagram illustrating a processing flow of a shooting mode executed by the imaging apparatus according to the embodiment of the present invention.

  First, the mode dial 122 is switched to the shooting mode and enters a standby state. In step S701, it is determined whether or not the menu button has been pressed. When pressing of the menu button is accepted (YES in step S701), the shooting mode is terminated (suspended) because the shooting setting screen is displayed.

  FIG. 4A is an example of an interface representing step S701. The mode dial 122 is rotated to set “Kids & Pets” in the shooting scene in the shooting mode.

  When not half-pressing the menu button (NO in step S701) but accepting half-pressing of the shooting button 123 (YES in step S702), automatic exposure, auto focus, and white balance ( AWB) is performed (step S703). FIG. 4B is an example of a user interface representing the state of step S702. In FIG. 4B, the image pickup apparatus is directed toward the subject and the shutter button is pressed halfway. At this time, face detection is performed together with processing such as AE, AF, and AWB.

  In step S <b> 704, the imaging apparatus checks the shooting scene while the shooting button 123 is half pressed. At this time, it is determined whether or not the set shooting scene is “Kids & Pets”. If the set shooting scene is “kids & pets” (YES in step S704), the imaging apparatus starts face detection (step S705).

  Subsequently, in step S706, the imaging apparatus determines the face detected by face detection in step S705. As a result of the determination, if it is determined that the face is an animal, the animal turn sound data (S707) is read to the buffer memory 111, and if it is determined that the face is an infant, the child turn sound data is read to the buffer memory 111 (step S708). Thereafter, the read voice is sounded, and at the same time, alerting is started by blinking the lamp (step S709). FIG. 4C shows an example of an interface representing the processing from step S704 to step S709 at this time.

  FIG. 4C illustrates a state in which the imaging device is directed toward the subject and the shutter button is half-pressed. When a face is detected in this state, an icon indicating the detection position is displayed on the LCD. If it is further determined that the detected face is a voice-registered subject, the registered alerting sound is started. At this time, when a plurality of faces are detected and it is determined that the types are different, it may be configured to simultaneously sound all of the warning sounds, or the priority warning sounds may be determined in advance. It is good also as a structure which rings, It is good also as a structure which can select these operation | movement.

  In addition, a specific method of animal face detection can be realized by using a currently known technique. For example, Japanese Patent Application Laid-Open No. 2010-15443 performs animal face detection by the same method. Therefore, this technique is a recognition of a known technique.

  In step S709, simultaneously with the start of reproduction of the turn audio data set in FIG. 8, the lamp on the front surface (lens side) of the imaging device casing is turned on to alert the subject. In step S710, when the imaging apparatus detects that the shutter button (shooting button 123) has been fully pressed (YES in step S710), the shooting sound and the recording process of the subject are performed after stopping the turning sound and the lamp (step S711). Is performed (step S712). If it is determined in step S710 that the shutter button has not been fully pressed (NO), the process proceeds to step S713, where it is determined whether the half-press has been released. If the half-press of the shutter button is released (YES in step S713), only the sound and the lamp are stopped in step S714.

  FIG. 4-4 is an example of an interface in steps S710 to S712. When the subject turns to the camera due to the turning sound, the shutter button is fully pressed by an operation instruction from the photographer. The alert sound is stopped and the shooting and recording process is performed as usual.

  As described above, according to the processing of the flowchart of FIG. 7, when the face of the subject is detected in a setting state for photographing an infant or an animal, the type of the subject (specifically, whether it is an animal or a person (infant)) is determined. Thus, the turning sound can be dynamically changed, and sound reproduction and lamp lighting control that are more interesting to the subject can be performed.

(Second embodiment)
According to the first embodiment described above, by setting the turning sound in advance, it is possible to discriminate the type of the subject at the time of shooting and execute sound reproduction and lamp lighting. However, since the first embodiment is a process assuming that the subject of the image is a single object, the second embodiment is a case where a plurality of subjects are photographed, and animals, persons (infants) A method of reproducing the turning sound when both are detected as subjects will be described.
In the setting mode shown in FIG. 8, steps S801 to S819 are the same as those in the first embodiment, and a description thereof will be omitted.

After the audio data is registered in the storage unit in step S819, the imaging apparatus displays the priority setting screen of FIG. 3-4 on the display 117 (not shown as a step). FIG. 3-4 is a priority setting screen for accepting selection of which of the registered audio data is preferentially reproduced. The priority setting screen 331 displays a message stating “Which priority should be given when there are multiple subjects?” On the display unit 332. Options 333 include “infant (for voice)”, “animal (for voice)”
, “Play audio alternately” and “Play audio of a subject with many detections” are displayed.

When the selection of “for infants” is accepted, the turning sound set as “for infants” is reproduced when a person (toddler) and an animal are simultaneously detected as subjects in the image. When the selection of “for animal” is accepted, the turning sound set as “for animal” is reproduced when a person (toddler) and an animal are simultaneously detected as subjects of the image. When the selection of “reproduce audio alternately” is received, audio data set for each type of subject in FIG. 8 is alternately reproduced.
When the selection of “play back the sound of a subject with a large number of detections” is accepted, when a half-press of the shutter button is accepted in steps S705 to S706 in FIG. If two faces are detected and the breakdown is “infant: animal = 1: 2,” it is determined that there are more animals as subjects, and the turning sound set for animals is reproduced.

  According to the second embodiment, by setting audio data to be preferentially reproduced when shooting a plurality of types (persons and animals) of subjects, priority is given to a subject to be more alerted. It becomes possible to reproduce the turning sound. Further, when shooting three or more subjects, it is possible to dynamically reproduce the turning sound of the subject (the person or the animal), whichever is greater, according to the breakdown of the subject.

  Above, description of the process performed with the imaging device of this invention is finished. In the embodiment of the present invention, if the display 117 of the imaging apparatus has a touch panel function, the instruction reception from the user can be made to the display 117 without using the cursor key 124 or the like of the operation unit. The control can be executed by directly accepting the pressing of.

  As described above, according to the present invention, it is possible to provide an imaging device that automatically determines the type of a subject by the face detection function provided in the imaging device, and alerts the user to take an image with an appropriate method according to the subject. It becomes. Specifically, in an imaging apparatus including an imaging unit that captures an image in response to a user operation, a storage unit (stored in the flash ROM 112) that stores a turning sound for alerting a subject is stored in the storage unit. A turning sound setting means (step S819 in FIG. 8) for setting the turning sound to reproduce the sound based on the type of the subject, and a subject recognition means (step in FIG. 7) for recognizing the subject of the image to be photographed according to the user operation S705), determination means for determining the type of subject recognized by the subject recognition means (step S706 in FIG. 7), and setting by at least the turning sound setting means based on the type of subject determined by the determination means Alerting means (step S707 in FIG. 7 or step) for performing alerting on the subject by playing the turning sound Characterized in that it comprises 708) and.

  As described above, the program according to the present invention is a program that can be executed by a computer as an imaging apparatus in accordance with the processing of the flowcharts shown in FIGS. 6 to 8, and the storage medium according to the present invention uses the processing method of FIGS. A program executable by the imaging apparatus is stored. Note that the program in the present invention may be a separate independent program for each processing method of each apparatus in FIGS.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by executing the reading. In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk or the like can be used.

  Further, by executing the program read by the imaging apparatus, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer is actually executed based on the instructions of the program. It goes without saying that a case where the function of the above-described embodiment is realized by performing a part or all of the process and the process is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network by a communication program, the system or apparatus can enjoy the effects of the present invention. In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

  In addition, each process realized by the above-described software can be realized as firmware or hardware configuration, and each process can be realized as each means. The technical scope of the present invention is realized by such firmware or hardware configuration. Is also included.

101 Optical system (lens)
102 Image sensor (CCD)
103 Camera Signal Processing Unit 110 System Controller 117 Display 120 Operation Unit

Claims (7)

A turning sound setting means for setting a turning sound for alerting a subject to be reproduced based on the type of the subject,
First operation accepting means for accepting a half-press operation of a shutter button for focusing before shooting;
Subject recognition means for recognizing the subject of the image to be shot;
When the first operation accepting unit accepts a half-press operation before performing the shooting, the turning sound set by the turning sound setting unit based on the type of the subject recognized by the subject recognizing unit, Playback means for playing until the half-press operation is released;
Playback stop means for stopping the turning sound being played back by the playback means when the half-press operation before the shooting is released;
Second operation accepting means for accepting a full press operation of a shutter button for taking an image of the subject;
When the second operation accepting unit accepts the full-pressing operation, the image of the subject that has been focused according to the half-pressing operation accepted by the first operation accepting unit is executed. Shooting execution means;
Priority setting means for performing priority setting indicating which of the turning sound sounds set by the setting means should be reproduced with priority when the object recognition means recognizes a plurality of types of subjects; ,
In the case where the priority setting unit is configured to prioritize the turning sound when the plurality of types of subjects are recognized, and there are a plurality of types of subjects recognized by the subject recognition unit, the priority setting unit Priority reproduction means for reproducing a turning sound for a subject to be preferentially reproduced according to the set priority setting in preference to a turning sound for another subject;
With
The priority reproduction means is a case where the priority setting means performs priority setting of the turning sound when the plurality of types of subjects are recognized, and there are a plurality of types of subjects recognized by the subject recognition means. the turning sound for a large number kinds of subjects of the subject, preferentially characterized imaging device to play the turning sound for other types of objects. A turning sound setting means for setting a turning sound for alerting a subject to be reproduced based on the type of the subject,
First operation accepting means for accepting a half-press operation of a shutter button for focusing before shooting;
Subject recognition means for recognizing the subject of the image to be shot;
When the first operation accepting unit accepts a half-press operation before performing the shooting, the turning sound set by the turning sound setting unit based on the type of the subject recognized by the subject recognizing unit, Playback means for playing until the half-press operation is released;
Playback stop means for stopping the turning sound being played back by the playback means when the half-press operation before the shooting is released;
Second operation accepting means for accepting a full press operation of a shutter button for taking an image of the subject;
When the second operation accepting unit accepts the full-pressing operation, the image of the subject that has been focused according to the half-pressing operation accepted by the first operation accepting unit is executed. Shooting execution means;
With
It said reproducing means, the object when recognized by the recognition means subject is a plurality of types, the plurality of types of you, wherein imaging device that simultaneously play the turning sound for said subject. 2. The reproduction means reproduces the turning sound until the half-press operation of the shutter button is released by repeatedly reproducing the turning sound set by the turning sound setting means. Or the imaging device of 2 . A method for controlling an imaging apparatus,
A turning sound setting step in which the turning sound setting means sets the turning sound for alerting the subject to be reproduced based on the type of the subject,
A first operation accepting step, wherein the first operation accepting means accepts a half-pressing operation of a shutter button for focusing before shooting;
Subject recognition means for subject recognition means for recognizing the subject of the image to be shot;
When the reproduction means accepts the half-press operation before the photographing execution in the first operation accepting step, based on the type of the subject recognized in the subject recognizing step, the turning direction set in the turning sound setting step A playback step of playing a sound until the half-press operation is released;
A reproduction stop step for stopping a turning sound being reproduced in the reproduction step when the halfway pressing operation before the execution of the shooting is released;
A second operation accepting step, wherein a second operation accepting means accepts a full press operation of a shutter button for taking an image of the subject;
When the photographing execution means receives the full-press operation in the second operation reception step, the subject image is focused according to the half-press operation received in the first operation reception step. A shooting execution step for performing the shooting of;
A priority setting step for performing priority setting indicating which of the turning sound sounds set in the setting step should be reproduced with priority when the plurality of kinds of subjects are recognized in the subject recognition step; ,
In the priority setting step, when priority is given to turning sound when the plurality of types of subjects are recognized, and there are a plurality of types of subjects recognized in the subject recognition step, A priority reproduction step of reproducing a turning sound for a subject to be preferentially reproduced according to the set priority setting in preference to a turning sound for another subject ;
Only including,
In the priority reproduction step, when the priority setting step is a priority setting of the turning sound when the plurality of types of subjects are recognized, and there are a plurality of types of subjects recognized in the subject recognition step. A control method for an imaging apparatus, wherein a turning sound for a subject of a type having a large number of subjects is reproduced in preference to a turning sound for another type of subject . The imaging device
A turning sound setting means for setting a turning sound for alerting a subject to be reproduced based on the type of the subject,
First operation accepting means for accepting a half-press operation of a shutter button for focusing before shooting;
Subject recognition means for recognizing the subject of the image to be shot;
When the first operation accepting unit accepts a half-press operation before performing the shooting, the turning sound set by the turning sound setting unit based on the type of the subject recognized by the subject recognizing unit, Playback means for playing until the half-press operation is released;
Playback stop means for stopping the turning sound being played back by the playback means when the half-press operation before the shooting is released;
Second operation accepting means for accepting a full press operation of a shutter button for taking an image of the subject;
When the second operation accepting unit accepts the full-pressing operation, the image of the subject that has been focused according to the half-pressing operation accepted by the first operation accepting unit is executed. Shooting execution means ;
Priority setting means for performing priority setting indicating which of the turning sound sounds set by the setting means should be reproduced with priority when the object recognition means recognizes a plurality of types of subjects; ,
In the case where the priority setting unit is configured to prioritize the turning sound when the plurality of types of subjects are recognized, and there are a plurality of types of subjects recognized by the subject recognition unit, the priority setting unit according to the set the priority setting, the turning sound with respect to the object to be reproduced in priority, to function as a priority reproducing means for reproducing in preference to turning sound to other subjects,
The priority reproduction means is a case where the priority setting means performs priority setting of the turning sound when the plurality of types of subjects are recognized, and there are a plurality of types of subjects recognized by the subject recognition means. the turning sound for a large number kinds of subjects of the subject, read a program executable by a computer, characterized that you play in preference to turning sound for other types of objects. A method for controlling an imaging apparatus,
A turning sound setting step in which the turning sound setting means sets the turning sound for alerting the subject to be reproduced based on the type of the subject,
A first operation accepting step, wherein the first operation accepting means accepts a half-pressing operation of a shutter button for focusing before shooting;
Subject recognition means for subject recognition means for recognizing the subject of the image to be shot;
When the reproduction means accepts the half-press operation before the photographing execution in the first operation accepting step, based on the type of the subject recognized in the subject recognizing step, the turning direction set in the turning sound setting step A playback step of playing a sound until the half-press operation is released;
A reproduction stop step for stopping a turning sound being reproduced in the reproduction step when the halfway pressing operation before the execution of the shooting is released;
A second operation accepting step, wherein a second operation accepting means accepts a full press operation of a shutter button for taking an image of the subject;
When the photographing execution means receives the full-press operation in the second operation reception step, the subject image is focused according to the half-press operation received in the first operation reception step. A shooting execution step for performing the shooting of
The method for controlling an image pickup apparatus, wherein, in the reproduction step, when there are a plurality of types of subjects recognized in the subject recognition step, a turning sound for the plurality of types of the subjects is simultaneously reproduced . The imaging device
A turning sound setting means for setting a turning sound for alerting a subject to be reproduced based on the type of the subject,
First operation accepting means for accepting a half-press operation of a shutter button for focusing before shooting;
Subject recognition means for recognizing the subject of the image to be shot;
When the first operation accepting unit accepts a half-press operation before performing the shooting, the turning sound set by the turning sound setting unit based on the type of the subject recognized by the subject recognizing unit, Playback means for playing until the half-press operation is released;
Playback stop means for stopping the turning sound being played back by the playback means when the half-press operation before the shooting is released;
Second operation accepting means for accepting a full press operation of a shutter button for taking an image of the subject;
When the second operation accepting unit accepts the full-pressing operation, the image of the subject that has been focused according to the half-pressing operation accepted by the first operation accepting unit is executed. Function as a shooting execution means,
A computer-readable and executable program characterized in that, when there are a plurality of types of subjects recognized by the subject recognition unit, the playback unit plays back the turning sound for the plurality of types of subjects at the same time.

Images