JP2001338303A - Device and method for picking up image, and computer- readable storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an image satisfying a user and a person to be imaged by notifying the user that the person to be imaged closes his/her eyes without displaying an image in the case of picking up the image of the person. SOLUTION: In a digital camera provided with an image recognition part 1, an audio data storage part 6, a mode switching part 12 and an alarming sound output part 13, an image data obtaining part 2 obtains picked-up image data, an image data judging part 3 recognizes an image from the obtained image data to judge whether the person to be imaged closes his/her eyes, an audio data obtaining part 4 obtains sound data, melody data or initial data from an audio data storage part 6 based on user's setting when it is judged that the user closes his/her eyes, and an audio data sending part 5 sends obtained audio data to a warning sound output part 13.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging apparatus such as a digital camera, a method, and a storage medium readable by a computer. In particular, when a person is imaged, a satisfactory image of a user or a person to be imaged is obtained. To be obtained.

[0002]

2. Description of the Related Art In recent years, digital cameras have been developed and marketed as electronic still cameras for the general public. The subject image captured by the digital camera is stored in a storage medium as image data through photoelectric conversion by a CCD or the like, signal conversion, signal processing, and the like.

Further, image information stored in a storage medium can be read and reproduced and displayed on a display device. Thus, the user can confirm the captured subject image by viewing the image displayed on the display device on the spot after the capturing.

[0004]

In an ordinary digital camera, image data is taken into a personal computer to check whether or not the subject has closed his / her eyes when a user releases a shutter. There is no method other than displaying the information and confirming it, or displaying it on the display device of the camera body and checking it as needed.

However, displaying and confirming an image as described above takes time.
Therefore, when the subject is confirmed to have closed eyes, it is difficult to take the same situation even if they try to take the picture again, and eventually the picture will be different from the one originally intended by the user. There are many.

In the case where a plurality of persons are imaged, even if the image is displayed and confirmed as described above, it is immediately determined that one of the imaged persons has closed their eyes. There are many things that you do not notice. For this reason, a satisfactory image of the user or the person to be imaged cannot be obtained, which may cause discomfort to both.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-described circumstances, and informs a user that a person to be imaged has closed his or her eyes without displaying an image when a person is imaged. It is an object of the present invention to obtain a satisfactory image of a user or a person to be imaged.

[0008]

An image pickup apparatus according to the present invention is an image pickup apparatus for picking up an image of a subject and obtaining image data. The image pickup apparatus recognizes an image from the image data and determines whether or not the subject has closed his / her eyes. It is characterized in that it comprises an image recognizing means for judging whether or not, and a warning means for giving a warning when the image recognizing means judges that the subject is closed.

Another feature of the image pickup apparatus of the present invention is that the warning means includes a sound generating means for emitting a warning sound. In addition, a sound data storage unit for storing the sound data for the warning is provided. Further, the sound data storage means stores a plurality of types of sound data. Further, the present invention is characterized in that a sound data acquisition unit for selecting and acquiring predetermined sound data from the plurality of kinds of sound data is provided. Further, the present invention is characterized in that the sound data is taken in from the outside and can be stored in the sound data storage means. In addition, a melody is created in accordance with a user operation, and a melody creating means for storing the created melody data in the sound data storage means is provided. It is also a digital camera.

An image pickup method according to the present invention is an image pickup method for picking up an image of a subject to obtain image data. The image recognition method includes recognizing an image from the image data to determine whether or not the imaged person has closed eyes. The method is characterized in that a procedure and a warning procedure for issuing a warning when the subject is determined to have closed his / her eyes by the image recognition procedure are performed.

A computer-readable storage medium according to the present invention is a computer-readable storage medium for storing a program for processing image data obtained by imaging an object, and recognizing an image from the image data. Executing an image recognition process of determining whether or not the subject has eyes closed, and a warning process of issuing a warning when the subject is determined to have eyes closed by the image recognition process. The feature is that a program to be executed is stored.

[0012]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of an imaging apparatus, a method and a computer-readable storage medium according to the present invention. FIG. 1 shows a configuration of a digital camera according to the present embodiment. The digital camera according to the present embodiment switches an image recognition unit 1 that recognizes whether or not the subject has closed his / her eyes from image data, an audio data storage unit 6 that stores audio data, and an audio mode setting. Mode switching unit 12
And a warning sound output unit 13 for outputting a warning sound.

The image recognizing unit 1 obtains image data obtained from the image pickup device and subjected to predetermined signal processing such as A / D conversion, and an image recognizing unit 2 for retrieving an image from the obtained image data. An image data determination unit 3 that recognizes and determines whether or not the subject has eyes closed, and obtains audio data from the audio data storage unit 6 when it is determined that the subject has eyes closed. And an audio data transmitting unit 5 for transmitting the obtained audio data to the alarm sound output unit 13.

The audio data storage section 6 comprises:
An audio data memory 7, a melody data memory 8, and an initial data memory 9 are provided. That is, in the present embodiment,
As the warning sound, any of a sound by voice data, a melody by melody data, a warning buzzer sound by initial data, and the like are used. The user can store any audio data in the audio data memory 7 via the audio data input unit 10, and the melody data input unit 11
Arbitrary melody data can be stored in the melody data memory 8 via.

Here, referring to FIG.
A specific example of the image recognition means in the image data determination unit 3 will be described. The image data obtained by the image data obtaining unit 2 is input to the image data determining unit 3 (image data input unit 301), and the image data converted into an electric signal is converted into a multi-valued image so that noise removal and feature extraction can be easily performed. Is performed to perform an operation such as conversion (binarization) from the image to a binary image (correction means 302).

The corrected image data is subjected to a feature extraction process for finding a feature pattern representing its shape from feature parameters that faithfully represent the features of the image (feature extraction means 303). By obtaining a feature pattern by this feature extraction, an eye portion of the subject is extracted.
As an extraction method, there is an extraction by region division or the like.

Based on the result of feature extraction, the input pattern and the standard pattern (closed eyes) are compared (identified) (identification means 304), and if both match (pattern matching), the information is output. Is transferred to the audio data acquisition section 4 (output means 305).

FIG. 3 is a rear view of the digital camera according to the present embodiment, and FIG. 4 is a side view. In the camera body 00,
As shown in FIG. 3, the microphone 21 and the LCD monitor 2
2, an audio mode changeover switch 23, and an operation button 24, as shown in FIG.
1 and an external input terminal 32 are provided.

The microphone 21 is used for inputting audio data, and is used for the audio data input unit 1 shown in FIG.
Corresponds to 0. The LCD monitor device 22 displays music score data when creating a melody. The audio mode switch 23 switches the audio mode between the audio mode, the melody mode, and the initial mode, and corresponds to the mode switching unit 12 shown in FIG.

The operation button 24 is used when a melody is created and melody data is input.
Corresponds to the melody data input unit 11 shown in FIG. The speaker 31 is for outputting a warning sound, and corresponds to the warning sound output unit 13 shown in FIG. The external input terminal 32
For example, it is connected to a playback device such as a CD or MD to input melody data from the outside, and corresponds to the melody data input unit 11 shown in FIG.

Next, the operation of the digital camera according to the present embodiment will be described. The flowchart of FIG. 5 shows a processing operation from the time when the user releases the shutter to acquire image data to the time when image recognition is performed and a warning sound is output. In addition, the user selects, via the mode switching unit 12, an audio mode regarding which of a voice, a melody, a warning buzzer sound, and the like is used as the warning sound.

The image data acquisition section 2 of the image recognition section 1 acquires the created image data (step S1), and the image data determination section 3 performs image recognition from the acquired image data, and It is determined whether or not the eyes are closed (step S2).

If it is determined that the subject has closed his / her eyes, an audio mode (voice mode, melody mode, initial mode) set in advance by the user is referred to (step S3). If it is determined that the subject has not closed his / her eyes, the processing shown in this flowchart ends.

If it is determined in step S3 to step S5 that the set audio mode is the audio mode, the audio data acquiring unit 4 of the image recognizing unit 1 stores the audio data in the audio data memory 7 of the audio data storage unit 6.
(Step S6). This audio data is input by the user via the audio data input unit 10 in advance.

If it is determined in step S3 to step S5 that the set audio mode is the melody mode, the audio data obtaining section 4 of the image recognizing section 1 stores the melody data in the melody data memory of the audio data storage section 6. Then, the melody data is obtained from Step 8 (Step S7). The melody data has been input by the user via the melody data input unit 11 in advance.

If it is determined in step S3 to step S5 that the set audio mode is the initial mode, the audio data acquiring section 4 of the image recognizing section 1 sets the initial data memory of the audio data storage section 6 in the initial data memory. 9 to obtain the initial data (step S8). The initial data is registered as an initial setting and is, for example, data such as a buzzer sound.

The audio data obtained in steps S6 to S8 is transferred to the audio data transmitting unit 5 of the image recognition unit 1, and the audio data transmitting unit 5
Is sent to the warning sound output unit 13. Warning sound output unit 13
When receiving the audio data, outputs a warning sound corresponding to the voice data, the melody data, and the initial data (step S9).

According to the above-described embodiment, when capturing an image of a person, it is possible to notify the user that the subject has closed his / her eyes without displaying the image. Therefore, the user can immediately retake the image in the same situation, and can obtain a satisfactory image of the user and the subject.

In addition to a warning buzzer or the like based on the initial data, a sound or a melody input by the user in advance can be used as the warning sound, so that a warning reflecting the personality of the user can be issued.

When the melody data is stored via the melody data input section 11, the CD is stored as described above.
In addition to inputting a favorite melody from a playback device of an MD or an MD, an incoming melody that has been rapidly spreading in mobile communication terminals in recent years may be applied. In this case, the melody data input unit 11 is provided with a melody creating unit, and the user operates the operation buttons 24 shown in FIG. 2 to input data, thereby creating a melody in the melody creating unit and storing the melody data. Is stored in the melody data memory 8 of the audio data storage unit 6. With this, CD
It is possible to input an original melody from the digital camera main body without using a playback device for an MD or MD.

(Other Embodiments) In order to operate various devices in order to realize the functions of the above-described embodiments, an apparatus connected to the various devices or a computer in a system is used in the above-described embodiments. Supply the software program code to realize the functions of
The present invention also includes those implemented by operating the various devices according to programs stored in a computer (CPU or MPU) of the system or apparatus.

In this case, the program code itself of the software realizes the functions of the above-described embodiment, and the program code itself and means for supplying the program code to the computer,
For example, a recording medium storing such a program code constitutes the present invention. As a recording medium for storing such a program code, for example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, C
D-ROM, magnetic tape, nonvolatile memory card, R
OM or the like can be used.

When the computer executes the supplied program code, not only the functions of the above-described embodiment are realized, but also the OS (operating system) or other operating system in which the program code runs on the computer. It goes without saying that such program codes are also included in the embodiments of the present invention when the functions of the above-described embodiments are realized in cooperation with the application software or the like.

Further, after the supplied program code is stored in a memory provided in a function expansion board of a computer or a function expansion unit connected to the computer, the function expansion board or the function expansion unit is specified based on the instruction of the program code. It is needless to say that the present invention also includes a case where the CPU or the like provided for performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

It should be noted that the shapes and structures of the respective parts shown in the above-described embodiments are merely examples of the embodiment for carrying out the present invention, and the technical scope of the present invention is thereby reduced. It should not be interpreted restrictively. That is, the present invention can be implemented in various forms without departing from the spirit or main features thereof.

[0036]

As described above, according to the present invention, when an image of a person is taken, it is possible to inform the user that the subject has closed his eyes without displaying the image. Therefore, the user can immediately retake the image in the same situation, and can obtain a satisfactory image of the user and the subject.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration of a digital camera according to an embodiment.

FIG. 2 is a diagram for explaining an image data judgment unit 3 of the image recognition unit 1;

FIG. 3 is a rear view of the digital camera according to the embodiment.

FIG. 4 is a side view of the digital camera according to the embodiment.

FIG. 5 is a diagram showing a state after image data is obtained by releasing a shutter.
9 is a flowchart illustrating a processing operation from performing image recognition to outputting a warning sound.

[Explanation of symbols]

 1 Image Recognition Unit 2 Image Data Acquisition Unit 3 Image Data Judgment Unit 4 Audio Data Acquisition Unit 5 Audio Data Transmission Unit 6 Audio Data Storage Unit 7 Audio Data Memory 8 Melody Data Memory 9 Initial Data Memory 10 Audio Data Input Unit 11 Melody Data Input Unit 12 Mode switching unit 13 Warning sound output unit 00 Camera body 21 Microphone 22 LCD monitor device 23 Audio mode switching switch 24 Operation button 31 Speaker 32 External input terminal

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) // H04N 101: 00 H04N 101: 00

Claims (10)

[Claims] 1. An image capturing apparatus that captures an image of a subject to obtain image data, comprising: an image recognition unit configured to recognize an image from the image data to determine whether a subject has closed his / her eyes; An image pickup apparatus comprising: a warning unit that warns when the recognition unit determines that the person to be imaged has closed his / her eyes. 2. The imaging apparatus according to claim 1, wherein the warning unit includes a sound generation unit that emits a sound for warning. 3. The imaging apparatus according to claim 2, further comprising a sound data storage unit that stores the sound data for the warning. 4. The apparatus according to claim 3, wherein said sound data storage means stores a plurality of types of sound data. 5. The imaging apparatus according to claim 4, further comprising sound data acquisition means for selecting and acquiring predetermined sound data from the plurality of types of sound data. 6. The imaging apparatus according to claim 3, wherein said sound data is taken in from the outside and can be stored in said sound data storage means. 7. The imaging apparatus according to claim 6, further comprising: a melody creating unit that creates a melody in response to a user operation and stores the created melody data in the sound data storage unit. 8. The imaging device according to claim 1, wherein the imaging device is a digital camera. 9. An imaging method for imaging a subject to obtain image data, comprising: an image recognition procedure for recognizing an image from the image data to determine whether or not a subject has closed his / her eyes; A warning procedure for issuing a warning when it is determined by the recognition procedure that the subject has closed his / her eyes. 10. A computer-readable storage medium for storing a program for processing image data obtained by capturing an image of a subject, wherein the computer recognizes an image from the image data and closes an eye of the subject. Storing a program for executing an image recognition process for determining whether or not the image capturing process has been performed, and a warning process for performing a warning when it is determined that the subject has closed his / her eyes by the image recognition process. Computer-readable storage medium.