JP5000242B2 - Imaging apparatus, imaging method, imaging program, and recording medium - Google Patents

Description

  The present invention relates to a photographing apparatus, a photographing method, a photographing program, and a recording medium for electronically photographing a subject.

  In recent years, the spread and use of so-called digital cameras that can photograph a subject electronically has been rapidly expanding. In particular, since digital cameras have been installed in mobile phones, this trend has been increasingly spurred.

  Under such circumstances, many techniques have been proposed in the past that can further enhance convenience and entertainment when using the photographing apparatus.

  For example, Patent Document 1 discloses a warning display device in which a warning given by looking at a bright subject is given by a buzzer and a warning given by looking at a dark subject is given by blinking the display. According to this configuration, it is possible to reliably recognize a warning for each of a bright subject and a dark subject when the photographing is inappropriate.

  Further, Patent Document 2 discloses a camera that generates sound corresponding to each shutter operation at the timing of performing each shutter operation. According to this configuration, in an electronic still camera or the like that does not have a mechanical shutter sound, the photographer can check various operations in the camera such as the shutter operation with pseudo sound at a timing related to the shutter operation.

  Further, Patent Document 3 discloses a digital camera that has a plurality of shutter sound data and selectively controls the shutter sound data according to a predetermined selection condition. According to this configuration, the photographing mode of the photographed image can be confirmed immediately.

  Patent Document 4 discloses a portable terminal device that receives audio data provided from an information providing apparatus and sets the shutter sound, and outputs the set shutter sound during imaging. According to this configuration, the shutter sound can be freely set, and the user's satisfaction can be improved.

  Further, Patent Document 5 discloses a portable wireless terminal that generates a shutter sound having a volume larger than the volume of the measured external sound. According to this configuration, it is possible to prevent voyeurism in a place where the external sound is loud.

Furthermore, Patent Document 6 discloses a captured image processing apparatus that controls output of sound according to sound data corresponding to a shooting condition that matches a captured image among a plurality of image conditions. According to this configuration, various elaborate effects can be achieved based on the photographed image and the photographing location.
JP 9-138457 (released May 27, 1997) JP 2000-307902 (released on November 2, 2000) JP 2001-69389 (released on March 16, 2001) JP 2004-135032 (April 30, 2004) JP2004-163563 (released on August 10, 2004) JP 2005-109995 (released on April 21, 2005)

  However, each of the above-described conventional techniques has a problem that entertainment at the time of shooting cannot be improved so much. Specifically, since it only makes a sound according to the brightness of the captured image, there are limited shutter sounds that are output for each shooting condition, and the user is quickly bored. End up.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a photographing apparatus, a photographing method, a photographing program, and a recording medium that can further enhance entertainment when the photographing apparatus is used. It is in.

(Basic configuration of the camera)
In order to solve the above-described problems, an imaging device according to the present invention provides
Photographing means for electronically photographing a subject;
Subject recognition means for recognizing the subject;
Voice output means for outputting a sound corresponding to the recognition result of the subject.

  According to said structure, an imaging | photography means image | photographs a to-be-photographed object. Thereby, the subject recognition means recognizes the subject. Thus, for example, the type (human, animal, plant) and state (number of people, facial expression, line of sight) of the subject are recognized by comparing various recognition images prepared in advance with the image of the subject.

  The sound output means outputs sound corresponding to the recognition result of the subject. For example, a voice representing the number of subjects, a voice representing the names of subjects, and the like are output. Therefore, various types of different sounds are output according to the type and state of the subject.

  As a result, the photographing apparatus has an effect of further enhancing entertainment when using the photographing apparatus.

(Shooting method)
In order to solve the above problems, a photographing method according to the present invention provides
A shooting step for electronically shooting the subject;
A subject recognition step for recognizing the photographed subject,
A voice output step of outputting a voice corresponding to the recognition result of the subject.

  According to said structure, there exists an effect similar to the imaging device which concerns on this invention.

(Outputs shooting sound)
In the photographing apparatus according to the present invention,
Preferably, the sound output means outputs a shooting sound corresponding to the recognition result of the subject as the sound according to a shooting operation by the user.

  According to said structure, an audio | voice output means outputs the imaging | photography sound according to the recognition result of the image | photographed subject as a sound according to the imaging operation by a user. That is, for example, a shooting sound indicating the name of the subject is output in accordance with the timing when the user presses the shooting button.

  As a result, the photographing apparatus has an effect of further enhancing amusement at the time of photographing operation by the user.

(Outputs sound representing the number of subjects)
In the photographing apparatus according to the present invention,
It is preferable that the sound output means outputs sound representing the number of subjects.

  According to the above configuration, the sound output means outputs sound representing the number of photographed subjects. For example, if the number of subjects is three, a sound such as “I photographed three people” is output.

  Thereby, there exists an effect which can improve the entertainment property at the time of imaging device use further.

(Outputs the sound representing the subject's name)
In the photographing apparatus according to the present invention,
The sound output means preferably outputs a sound representing the name of the subject.

  According to said structure, an audio | voice output means outputs the audio | voice showing the name of a to-be-photographed object. For example, if the subject is Mr. A, a sound such as “I photographed Mr. A” is output.

  Thereby, there exists an effect which can improve the entertainment property at the time of imaging device use further.

(Sound output according to the degree of camera shake)
In the photographing apparatus according to the present invention,
The subject recognition means measures the degree of vibration of the photographing device by recognizing the subject,
The sound output means preferably outputs a sound reflecting the degree of vibration.

  According to the above configuration, the subject recognition means measures the degree of vibration of the photographing apparatus by recognizing the photographed subject. Thereby, the sound output means outputs sound according to the measured degree of vibration. For example, if the degree of vibration is intense, a voice such as “I shake violently” is output.

  Thereby, there exists an effect which a user can utilize an imaging device more conveniently.

  Note that the photographing apparatus may be realized by a computer. In this case, an imaging program for realizing the imaging apparatus in the computer by operating the computer as each of the above means and a computer-readable recording medium on which the imaging program is recorded also fall within the scope of the present invention.

  As described above, since the imaging device according to the present invention includes the audio output unit that outputs the sound according to the recognition result of the photographed subject, there is an effect that the entertainment can be further improved when the imaging device is used. .

An embodiment of the present invention will be described below with reference to FIGS. 1 to 7 (Configuration of the photographing apparatus 1).
First, the configuration of the photographing apparatus 1 according to the present embodiment will be described below with reference to FIG. FIG. 1 is a block diagram showing the main configuration of the image capturing apparatus 1 according to one embodiment of the present invention. As shown in this figure, the photographing apparatus 1 includes a photographing button 2, a display 3, a speaker 4, a camera 5, a memory 6, and a control unit 10.

(Shooting button 2)
The shooting button 2 is a button that the user presses to cause the shooting apparatus 1 to take a picture of the subject. When sensing that the photographing button 2 is pressed, the photographing apparatus 1 photographs the subject using the camera 5.

(Display 3)
The display 3 is a device that displays information and presents it to the user. For example, it is realized as a liquid crystal display device or a plasma display device.

(Speaker 4)
The speaker 4 is a device that reproduces the sound represented by the input sound signal. This corresponds to a so-called stereo speaker or monaural speaker.

(Camera 5)
The camera 5 is an apparatus that captures an external subject (person or thing) and obtains an image including the captured subject. For example, it is realized as a digital camera. In the photographing apparatus 1 of this embodiment, the camera 5 is a digital camera module incorporated in the photographing apparatus 1.

(Memory 6)
The memory 6 stores various data used when the control unit 10 of the photographing apparatus 1 executes processing. This corresponds to a so-called nonvolatile memory or volatile memory.

(Control unit 10)
The control unit 10 is responsible for various processes (photographing, image recognition, audio output) that are performed internally by the photographing apparatus 1. More specifically, the control unit 10 includes a shooting instruction receiving unit 11, a display processing unit 12, a display processing unit 12, a subject recognition unit 13 (subject recognition unit), a shutter sound setting unit 14, and an audio processing unit 15 (audio output unit). And an imaging processing unit 16 (imaging means).

  The functions of these members and the processing to be executed will be described later.

(Outputs sound according to the recognition result of the subject)
The photographing apparatus 1 outputs sound corresponding to the recognition result of the photographed subject at the time of photographing, for example. This further enhances entertainment when using the photographing apparatus.

  Accordingly, processing when the photographing apparatus 1 photographs a subject will be described below with reference to FIG. FIG. 2 is a flowchart showing a processing flow when the photographing apparatus 1 photographs a subject.

  As shown in this figure, first, the control unit 10 activates the camera 5 (step S21). Next, the imaging processing unit 16 projects the subject through the camera 5 (step S22). At this time, since the user has not yet pressed the shooting button 2, the shooting processing unit 16 does not complete shooting of the subject. That is, at this time, image data including the image of the subject is not stored in the memory 6.

  The imaging processing unit 16 outputs the projected image to the subject recognition unit 13. Thereby, the subject recognition unit 13 recognizes the subject (step S23). Specifically, it is determined whether or not there is registration data that matches the captured image data by comparing the registration data for recognition stored in the memory 6 in advance with the generated captured image data. (Step S24).

  In the photographing apparatus 1, corresponding audio data is stored in the memory 6 in association with the registration data in advance. Therefore, when the result of the determination in step S24 is “true” (Yes), the shutter sound setting unit 14 uses the sound (shutter sound, shooting sound) associated with the registered data determined to match at the time of shooting. The voice to be output is set (step S25).

(Association between registered data and shutter sound)
The association between the image registration data and the shutter sound will be described below with reference to FIG. FIG. 4 is a diagram illustrating correspondence between captured image data and shutter sound.

  As shown in this figure, in the memory 6, registration data (that is, a recognition image) is stored as a table in association with audio data representing a shutter sound. For example, the image A is associated with sound data representing a sound of “eyes closed” in advance. Furthermore, the audio data representing the voice “I am not laughing” is associated with the image B in advance. Further, the image C is associated with audio data representing the audio “Ikuyo!” In advance. Furthermore, audio data representing the audio “Cheese!” Is associated with the image D in advance.

  As a result, when the subject recognition unit 13 determines that the photographed subject matches the image A, the shutter sound setting unit 14 sets the sound “eyes closed” as the shutter sound. Therefore, when the user presses the photographing button 2, the photographing apparatus 1 outputs a sound “eyes closed” as a shutter sound.

  On the other hand, when the determination result in step S is “false” (No), the shutter sound setting unit 14 outputs a sound indicating that there is no registration data corresponding to the photographed subject, that is, the subject is not registered. The shutter sound is set (step S26).

  As described above, the shutter sound setting unit 14 sets the sound corresponding to the recognition result of the subject by the subject recognition unit 13 as the shutter sound.

  Next, the shooting instruction receiving unit 11 determines whether or not the shooting button 2 has been pressed by the user (step S27). When the result of the determination in step S27 is “false” (No), the processing shown in FIG. 2 returns to step S23. In this way, the control unit 10 repeatedly executes the subject recognition process and the sound setting process corresponding to the recognition result until a “true” result is obtained in the process shown in step S27.

  On the other hand, when the result of determination in step S27 is “true” (Yes), that is, when the shooting instruction receiving unit 11 receives a press of the shooting button 2 by the user, the voice processing unit 15 sets the set shutter. Sound is output through the speaker 4 (step S28). At the same time, the photographing processing unit 16 photographs the subject through the camera 5. At this time, the photographing processing unit 16 generates image data representing the photographed image and stores it in the memory 6.

  When the output of the shutter sound and the generation of the photographed image data are completed, the control unit 10 determines whether the photographing is finished (Step S29). When the result of the determination in step S29 is “false” (No), the processing shown in FIG. 2 returns to step S22. In this manner, the control unit 10 repeatedly executes the subject photographing process until a “true” result is obtained in the process shown in step S29.

  On the other hand, when the result of the determination in step S29 is “true” (Yes), the control unit 10 stops the activation of the camera 5 (step S30).

  Through the above processing, the photographing apparatus 1 can further enhance the entertainment when the photographing apparatus 1 is used.

(Recognize after confirming shooting and output sound)
In the example of FIG. 2, the subject recognition unit 13 recognizes the subject before the photographing of the subject is finished, that is, before the photographed image data is stored in the memory 6. However, the present invention is not necessarily limited to this method. For example, as shown in FIG. 3, after the captured image data is stored in the memory 6, the subject may be recognized, and the corresponding sound may be set as the shutter sound based on the recognition result.

  Therefore, the flow of this process will be described below with reference to FIG. FIG. 3 is a flowchart illustrating another example of a processing flow when the photographing apparatus 1 photographs a subject.

  In FIG. 3, the processes in steps S31 and S32 are the same as steps S21 and S22 in FIG. After the process of step S32, the shooting instruction receiving unit 11 determines whether or not the shooting button 2 has been pressed by the user (step S33). When the result of the determination in step S33 is “false” (No), the processing shown in FIG. 3 returns to step S32. In this way, the control unit 10 repeatedly executes the process of projecting the subject and the determination of whether to accept the pressing of the shooting button 2 until a result of “true” is obtained in the process shown in step S27.

  On the other hand, when the result of the determination in step S33 is “true” (Yes), that is, when the shooting instruction receiving unit 11 receives pressing of the shooting button 2 by the user, the shooting processing unit 16 sets the subject to be shot. Captured image data including an image is generated and stored in the memory 6.

  Thereafter, the control unit 10 recognizes the photographed subject and sets a shutter sound based on the recognition result. Further, the set shutter sound is output through the speaker 4 (steps S34 to S38). The above processing is the same as steps S23 to S26 and S28 in FIG. Moreover, the process of step S39 and S40 is the same as step S29 and S30.

  Also by the above process, the imaging device 1 can further enhance the entertainment when the imaging device 1 is used.

(Correspondence between subject line of sight and shutter sound)
As described above, in the photographing apparatus 1, the subject recognition unit 13 recognizes the photographed subject. At this time, the subject recognition unit 13 can detect the viewing direction of the subject based on the recognition result of the subject. Therefore, the shutter sound setting unit 14 can set the sound corresponding to the line of sight of the subject as the shutter sound. In addition, since the detection method of a gaze direction is a well-known thing, detailed description is abbreviate | omitted.

  When the sound corresponding to the line of sight of the subject is set as the shutter sound, the shutter sound setting unit 14 uses a table stored in the memory 6 and indicating the correspondence between the line of sight of the subject and the sound. This table will be described below with reference to FIG. FIG. 5 is a diagram illustrating a table in which the line of sight of the subject is associated with the sound set as the shutter sound.

As shown in this figure, in the memory 6 of the photographing apparatus 1, a table in which the line of sight of the subject and the sound set as the shutter sound are associated with each other is stored in the memory 6 in advance. In the table of FIG. 5 , the line-of-sight directions (right, left, top, and bottom) and the sound indicating the line-of-sight direction are associated with each other. For example, the right gaze direction corresponds to a voice saying "I'm facing right"

  By using this table, the shutter sound setting unit 14 sets, as the shutter sound, the sound “I am facing right” when the subject's line of sight is recognized as being in the right direction. Therefore, when the user presses the shooting button 2, if the subject's line of sight is pointing to the right, a voice “turning to the right” flows as a shutter sound. Thereby, the entertainment property at the time of use of the imaging device 1 can further be improved.

(Relationship between barcode type and shutter sound)
In the photographing apparatus 1, the subject recognition unit 13 recognizes the photographed subject. At this time, the subject recognition unit 13 can specify the type of barcode as the subject based on the recognition result. Therefore, the shutter sound setting unit 14 can set the sound as the shutter sound for the type of the parcode.

When the sound corresponding to the barcode type is set as the shutter sound, the shutter sound setting unit 14 uses a table stored in the memory 6 and indicating the correspondence between the barcode type and the sound. This table will be described below with reference to FIG. FIG. 6 is a diagram illustrating a table in which the type of barcode is associated with the sound set as the shutter sound.

  As shown in this figure, in the memory 6 of the photographing apparatus 1, a table in which the type of barcode is associated with the sound set as the shutter sound is stored in the memory 6 in advance. In the table of FIG. 6, the barcode type (patterns A to D) and the voice (voices A to D) are associated with each other. For example, voice A corresponds to the barcode of pattern A.

  By using this table, the shutter sound setting unit 14 sets it as the voice A shutter sound even when the barcode type is recognized as the pattern A. Therefore, if the user presses the shooting button 2 and the pattern A barcode is shot, the sound A flows as the shutter sound. Thereby, the entertainment property at the time of use of the imaging device 1 can further be improved.

  By recognizing the type of barcode as a subject, the subject recognition unit 13 can analyze the contents of the barcode. For example, when the barcode encodes a web address (URL) or an e-mail address, the information can be read. Therefore, the shutter sound setting unit 14 may set the sound representing the content of the read barcode as the shutter sound. Thereby, for example, when a URL is read, it is possible to emit a sound for reading the URL.

(Correspondence between camera shake and shutter sound)
In the photographing apparatus 1, the subject recognition unit 13 recognizes the photographed subject. At this time, the subject recognizing unit 13 can specify the degree of vibration (the degree of camera shake) of the photographing apparatus 1 based on the recognition result. Therefore, the shutter sound setting unit 14 can set the sound corresponding to the degree of vibration as the shutter sound. Note that a method for specifying the degree of vibration of the apparatus based on the recognition result of the subject is already known, and thus detailed description thereof is omitted.

At this time, the shutter sound setting unit 14 uses a table stored in the memory 6 and indicating a correspondence relationship between the degree of vibration and sound. Therefore, this table will be described below with reference to FIG. FIG. 7 is a diagram illustrating a table in which the degree of vibration is associated with the sound set as the shutter sound.

As shown in this figure, in the memory 6 of the photographing apparatus 1, a table in which the degree of vibration is associated with the sound set as the shutter sound is stored in the memory 6 in advance. In the table of FIG. 7 , the degree of vibration (1 to 3) is associated with the voice. For example, the voice of “I am shaking a little” corresponds to the degree of vibration “1”.

  By using this table, when the degree of vibration is recognized as “1”, the shutter sound setting unit 14 sets a sound “shake a little” as the shutter sound. Therefore, when the user presses the shooting button 2, if the degree of vibration is “1”, “shake a little” flows as the shutter sound. Thereby, the user can use the imaging device 1 more conveniently.

  In addition, this invention is not limited to embodiment mentioned above, A various change is possible in the range shown to the claim. In other words, embodiments obtained by combining technical means appropriately changed within the scope of the claims are also included in the technical scope of the present invention.

(Outputs sound representing the number of subjects)
For example, the subject recognition unit 13 can identify the number of subjects by recognizing the subject to be photographed. At this time, a table in which the number of subjects and the sound set as the shutter sound are associated with each other is stored in the memory 6 in advance.

  Therefore, the shutter sound setting unit 14 sets a sound corresponding to the number of photographed subjects as a shutter sound by using the table. For example, if the number of subjects is three, a sound such as “three people have been photographed” is set. Therefore, when the user presses the shooting button 2, if the number of subjects is three, “three people have been shot” will flow as the shutter sound. Thereby, the user can use the imaging device 1 more conveniently.

(Outputs the sound representing the subject's name)
The subject recognition unit 13 can identify the name of the subject by recognizing the subject to be photographed. At this time, in the memory 6, a table in which the registered image data of the subject is associated with the sound set as the shutter sound is stored in advance.

  Therefore, the shutter sound setting unit 14 sets the sound corresponding to the name of the photographed subject as the shutter sound by using the table. For example, if the name of the subject is Mr. A, that is, if the subject image matches a registered image representing Mr. A, a voice such as “I photographed Mr. A” is set. Therefore, when the user presses the shooting button 2, if Mr. A is shot, “I shot Mr. A” flows as the shutter sound. Thereby, the user can use the imaging device 1 more conveniently.

  In addition, when the photographing apparatus 1 recognizes that the subject is an animal, for example, it may set the cry of the animal as a shutter sound. Alternatively, sound corresponding to the facial expression of the subject may be set as the shutter sound. In any case, if the recognition result of the subject and some sound are associated in advance as a table in the memory 6, the shutter sound setting unit 14 can set the sound according to the recognition result of the subject as the shutter sound. .

  Further, a combination of the above examples is also included in the technical scope of the present invention. For example, when the subject is recognized as a landscape, a shutter sound of “Kasha” is set. When the subject is recognized as an animal, the sound of the animal (“One” for a dog) is set as the shutter sound. If it is recognized, it is possible to set a shutter sound “Cheese!”.

  In addition, by setting different shutter sounds depending on the facial expression of the subject, it is possible to notify with sound that "eyes are closed", "looking away", "not laughing", etc. .

(Shooting program and recording medium)
Finally, each block included in the photographing apparatus 1 may be configured by hardware logic. Alternatively, it may be realized by software using a CPU (Central Processing Unit) as follows.

  That is, the photographing apparatus 1 includes a CPU that executes instructions of a control program for realizing each function, a ROM (Read Only Memory) that stores the control program, and a RAM (Random Access Memory) that expands the control program into an executable format. And a storage device (recording medium) such as a memory for storing the control program and various data.

  With this configuration, the object of the present invention can also be achieved by a predetermined recording medium. The recording medium only needs to record the program code (execution format program, intermediate code program, source program) of the control program of the photographing apparatus 1 which is software for realizing the above-described functions so as to be readable by a computer. This recording medium is supplied to the photographing apparatus 1. Thereby, the photographing apparatus 1 (or CPU or MPU) as a computer may read and execute the program code recorded on the supplied recording medium.

  The recording medium that supplies the program code to the photographing apparatus 1 is not limited to a specific structure or type. That is, the recording medium includes, for example, a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. System, a card system such as an IC card (including a memory card) / optical card, or a semiconductor memory system such as a mask ROM / EPROM / EEPROM / flash ROM.

  Even if the photographing apparatus 1 is configured to be connectable to a communication network, the object of the present invention can be achieved. In this case, the above program code is supplied to the photographing apparatus 1 via a communication network. The communication network is not limited to a specific type or form as long as it can supply the program code to the photographing apparatus 1. For example, the Internet, an intranet, an extranet, a LAN, an ISDN, a VAN, a CATV communication network, a virtual private network, a telephone line network, a mobile communication network, a satellite communication network, etc. may be used.

  The transmission medium constituting the communication network may be any medium that can transmit the program code, and is not limited to a specific configuration or type. For example, wired communication such as IEEE 1394, USB (Universal Serial Bus), power line carrier, cable TV line, telephone line, ADSL (Asymmetric Digital Subscriber Line) line, infrared light such as IrDA or remote control, Bluetooth (registered trademark), 802. 11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, etc. can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The present invention can be widely used as a photographing apparatus for photographing a subject electronically.

It is a block diagram which shows the principal part structure of the imaging device which concerns on one Embodiment of this invention. It is a flowchart which shows the flow of a process when an imaging device image | photographs a to-be-photographed object. It is a figure which shows matching with picked-up image data and a shutter sound. 10 is a flowchart illustrating another example of a processing flow when the photographing apparatus photographs a subject. It is a figure which shows the table which matched the eyes | visual_axis of a to-be-photographed object and the audio | voice set as a shutter sound. It is a figure which shows the table which matched the kind of barcode, and the audio | voice set as a shutter sound. It is a figure which shows the table which matched the degree of vibration and the audio | voice set as a shutter sound.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Shooting device 2 Shooting button 3 Display 4 Speaker 5 Camera 6 Memory 10 Control part 11 Shooting instruction reception part 12 Display processing part 13 Subject recognition part (Subject recognition means)
14 Shutter sound setting unit 15 Audio processing unit (audio output means)
16 Imaging processing unit (imaging means)

Claims (4)

Photographing means for electronically photographing a subject;
Subject recognition means for recognizing the type of subject,
An imaging apparatus comprising: audio output means for outputting a voice representing the name of the subject as a shooting sound in response to a shooting operation by a user according to the recognition result of the type of the subject. A shooting step for electronically shooting the subject;
A subject recognition step for recognizing the type of the photographed subject,
An imaging method comprising: an audio output step of outputting a voice representing the name of the subject as a shooting sound in response to a shooting operation by a user according to the recognition result of the type of the subject. An imaging program for operating the imaging apparatus according to claim 1 for causing a computer to function as each of the above means. A computer-readable recording medium in which the photographing program according to claim 3 is recorded.

Images