JP2002333652A - Photographing device and reproducing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically focus on a photographing object. SOLUTION: A photographing device is provided with: a photographing means; a face detecting means which detects the face of the photographing object from the data of an image photographed with the photographing means, a facial appearance information recording means which records in advance information about the facial appearance of the photographing object to be detected; and a photographing object detecting means which detects an object which is in agreement with predetermined facial appearance from the face detected with the face detecting means on the basis of information about the facial appearance of the photographing object to be detected. In this case, the information about the facial appearance of an object 11 photographed in advance is compared with information about the facial appearance of the newly photographed object 11. On the basis of the comparison result, a focal adjustment mechanism 13 is operated and the focusing on the photographing object is performed automatically.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a photographing device and a reproducing device.

[0002]

2. Description of the Related Art Conventionally, a photographing apparatus has a focus adjusting mechanism,
By operating the focus adjustment mechanism, the subject can be focused.

FIG. 2 is a schematic view of a conventional photographing apparatus.

In FIG. 1, reference numeral 10 denotes a photographing device, 11 denotes a subject photographed by the photographing device 10, and the photographing device 10 includes a lens 12, a focus adjusting mechanism 13, an image sensor 14 including a CCD and the like, and a control processor 15 , Memory element, recording medium 16 such as magnetic tape, display circuit 17, L
A display unit 20 including a display element such as a CD and an operation control circuit 21 are provided. Further, a is a focus adjustment signal, b is an imaging signal, and s is an operation signal.

Next, the operation of the photographing apparatus 10 having the above configuration will be described.

First, when an image is taken, when an image of the subject 11 is formed on the image sensor 14 by the lens 12, the image sensor 14 generates a digital image signal b and controls the image signal b. It is sent to the processor 15 as image data. The control processor 15 analyzes the image data to extract an outline in the image and uses an algorithm for adjusting the focus adjustment mechanism 13 so that the image data is optimized. A focus adjustment signal a is generated, and the focus adjustment mechanism 13 is adjusted to focus on the subject 11. Then, the image data is sent to a display circuit 17, which drives a display element to display an image of the subject 11 on a display unit 20. Therefore, the operator can check the image of the subject 11 captured by the imaging device 10 on the display unit 20.

In this case, the operator operates a shutter, a remote controller,
When a timer or the like is operated, the operation control circuit 21 outputs an operation signal s
Is sent to the control processor 15, and the control processor 15
Records image data on the recording medium 16 at the timing when the operation signal s is sent, that is, at the shooting timing.

[0008] When an operator operates a display switch or the like to display a captured image on the display unit 20, the operation control circuit 21 sends an operation signal s to the control processor 15. When receiving the operation signal s, the control processor 15 reads out image data from the recording medium 16 and sends it to the display circuit 17. The display circuit 17 drives a display element to display an image of the subject 11 on the display unit 20. Therefore, the operator can select and view a predetermined image of the subject 11 already photographed by the photographing device 10.

[0009]

However, in the conventional photographing apparatus 10, when a predetermined object in the object 11 is far from the center of the screen, the object can be automatically focused. However, since it is necessary to manually adjust the focus adjustment mechanism 13, the operation is troublesome.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a photographing apparatus and a reproducing apparatus which can solve the problems of the conventional photographing apparatus and can automatically focus on an object.

[0011]

For this purpose, in the photographing apparatus of the present invention, a photographing means, a face detecting means for detecting a face of an object from image data of an image photographed by the photographing means, A face information recording unit for pre-recording information on the appearance of the object to be detected, and a predetermined appearance from the face detected by the face detection unit based on the information on the appearance of the object to be detected. And an object detecting means for detecting the object.

[0012]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a schematic diagram of a photographing apparatus according to a first embodiment of the present invention, and FIG. 3 is a schematic diagram of a face recognition block according to the first embodiment of the present invention.

In FIG. 1, reference numeral 10 denotes a photographing device, 11 denotes a subject photographed by the photographing device 10, and the photographing device 10 includes a lens 1 for focusing an image of the subject 11.
2. Focus adjustment mechanism 1 for focusing on subject 11
3. Image capturing means for generating image data of the subject 11 by forming an image converged by the lens 12 and an image sensor 14 as an image generating means, a control processor 15, a memory element, and recording of image data on a magnetic tape or the like. It comprises a recording medium 16 as a means, a display circuit 17 as a display means, a display section 20 composed of a display element such as an LCD, an operation control circuit 21, and a face recognition block 25 as a face recognition processing means. The image sensor 14 includes, for example, a CCD. Further, a is a focus adjustment signal as an operation signal, b is an imaging signal, and s is an operation signal.

The face recognition block 25 includes a face detection section 26 as a face detection section and a face detection section, a face face coding section 27 as a face coding section, a target face code register 28 as a face information recording section, and A code comparison unit 29 is provided as an object detection unit. Further, c is image information, d is coordinate information, e is a face code as face information representing information on a face, and f is a matching rate.

Next, the operation of the photographing apparatus 10 having the above configuration will be described.

First, a predetermined object to be focused, for example, a face of a person is photographed in advance, and the photographed face is registered in the target face code register 28. For that purpose, the face image is captured by the lens 12 using the imaging sensor 1.
When the image is formed on 4, the image sensor 14 generates a digital image signal b and sends the image signal b to the control processor 15 as image data.

When the control processor 15 sends the image data as image information c to the facial appearance detecting unit 26, the facial appearance detecting unit 26 cuts out the face area from the image information c, thereby obtaining the face as the appearance of the object. That is, the face is detected. The face coding unit 27 statistically calculates the distribution of color, brightness, and the like for each pixel according to the image information c of the face area, generates a face code e corresponding to the face, and generates the face code e. Target face code register 2
8 is recorded as a recording code.

Thereafter, when an image of the subject 11 is taken, when the image of the subject 11 is formed on the image sensor 14 by the lens 12, the image sensor 14 generates a digital image signal b as image data. The image data is sent to the control processor 15. The control processor 15
Sends the image data as image information c to the facial appearance detecting unit 26, the facial appearance detecting unit 26 detects the facial appearance by cutting out the face area from the image information c. At this time, the face detection unit 26 calculates the coordinate information d based on the position of the face on the screen on the image sensor 14. The face coding unit 27 generates the face code e according to the image information c of the face area as described above, and sends the face code e to the code comparing unit 29 together with the coordinate information d.

The code comparing section 29 compares the recording code with the newly generated face code e, and determines the degree of coincidence indicating the degree of coincidence of the detected face with a predetermined face, that is, the matching rate f. If it is high, the matching rate f is sent to the control processor 15 together with the coordinate information d. Note that the code comparison unit 29 calculates a color for each pixel based on the recording code and the newly generated face code e.
The distribution of brightness or the like is statistically calculated. If the deviation of the distribution is equal to or less than a threshold value, it is determined that the matching ratio f is high. Judge as low.

The focus adjustment processing means as an operation signal generating means (not shown) of the control processor 15 includes:
A focus adjustment signal a is generated based on the comparison result of the code comparison unit 29 so that a portion corresponding to the coordinate information d in the screen on the image sensor 14 is most focused, and the focus adjustment signal a is focused. It is sent to the adjusting mechanism 13 to operate the focus adjusting mechanism 13.

As described above, in the present embodiment, the face is detected based on the registered face, and the focus adjustment mechanism 13 is operated based on the detection result, so that the face is automatically focused. Can be. Moreover, an optimal image can be always obtained regardless of the position of the face on the screen on the image sensor 14, the perspective relationship with other objects, and the like.

Next, a second embodiment of the present invention will be described. In addition, about what has the same structure as 1st Embodiment, the description is abbreviate | omitted by attaching the same code | symbol.

FIG. 4 is a schematic diagram of a photographing apparatus according to the second embodiment of the present invention, and FIG. 5 is a schematic diagram of a multi-face recognition block according to the second embodiment of the present invention.

In this case, as shown in FIG. 4, the photographing apparatus 10 includes a multi-face recognition block 3 as a face recognition processing means instead of the face recognition block 25 (FIG. 1).
1 is provided.

Next, the multi-face recognition block 31 will be described.

As shown in FIG. 5, a multi-face recognition unit 31 includes a face detection unit 26 as a face detection unit and a face detection unit, a face coding unit 27 as a face coding unit, and a face information recording unit. A target face code / priority table 32 and a code comparison unit 29 as object detection means. Also, c is image information,
d is coordinate information, e is a face code as face information, and f is a matching rate.

Next, the operation of the photographing apparatus 10 having the above configuration will be described.

First, a predetermined object to be focused, for example, a face of a person is photographed in advance, and the photographed face is registered in the target face code / priority table 32. For this purpose, when a face image is formed on the image sensor 14 by the lens 12, the image sensor 14 generates a digital image signal b and sends the image signal b to the control processor 15 as image data.

When the control processor 15 sends the image data as image information c to the face detection unit 26, the face detection unit 26 detects a face by extracting a face area from the image information c. Also, the face coding unit 27
Generates a face code e according to the image information c of the face area, and records the face code e in the target face code / priority table 32 together with the priority. In this case, the face code e is recorded in the target face code / priority table 32 as a recording code together with the priority for a plurality of persons.

Thereafter, when an image of the subject 11 is taken, when the image of the subject 11 is formed on the image sensor 14 by the lens 12, the image sensor 14 generates a digital image signal b as image data. The image data is sent to the control processor 15. The control processor 15
Sends the image data as image information c to the facial appearance detecting unit 26, the facial appearance detecting unit 26 detects the facial appearance by cutting out the face area from the image information c. At this time, the face detection unit 26 calculates the coordinate information d based on the position of the face on the screen on the image sensor 14. Further, the facial appearance coding unit 27 generates a facial appearance code e according to the image information c of the face area, and sends the facial appearance code e to the code comparing unit 29 together with the coordinate information d.

The code comparing section 29 compares the recording code and the newly generated face code e in descending order of priority, and if the matching rate f is high, controls the matching rate f together with the coordinate information d. Send to processor 15.

The focus adjustment processing means as an operation signal generating means (not shown) of the control processor 15 is provided in the code comparison section so that the portion corresponding to the coordinate information d in the screen on the image sensor 14 is most focused. 29
A focus adjustment signal a is generated based on the comparison result, and the focus adjustment signal a is sent to the focus adjustment mechanism 13 to operate the focus adjustment mechanism 13.

As described above, in the present embodiment, when there are a plurality of faces on the screen, the comparison is performed by the code comparing unit 29 on the face code e having a high priority. The corresponding face can be focused. In addition, an optimum image can always be obtained regardless of the position of a predetermined face in the screen on the image sensor 14 and the perspective relationship with other objects.

Next, a third embodiment of the present invention will be described. In addition, about what has the same structure as 1st Embodiment, the description is abbreviate | omitted by attaching the same code | symbol.

FIG. 6 is a schematic diagram of a photographing apparatus according to the third embodiment of the present invention, and FIG. 7 is a schematic diagram of a hand recognition block according to the third embodiment of the present invention.

In this case, as shown in FIG. 6, a hand recognition block 35 as a hand recognition processing means is provided in the photographing apparatus 10 in place of the facial appearance recognition block 25 (FIG. 1).
Is arranged. The hand recognition block 35 sends a shutter timing signal h as an operation signal to the operation control circuit 21.

Next, the hand recognition block 35 will be described.

As shown in FIG. 7, the hand recognition block 35 includes a hand detection unit 36 as a feature detection unit, a hand coding unit 37 as a feature coding unit, and a shape reference register 38 as a feature information recording unit. , And a code comparing section 39 as an object detecting means. Further, c is image information, i is a finger shape code as appearance information, and h is a shutter timing signal.

Next, the operation of the photographing apparatus 10 having the above configuration will be described.

First, a predetermined object of a person who has performed a pose (piece) operation, for example, a finger, is photographed in advance, and an image of the photographed finger is registered in the hand recognition block 35 as a shutter timing image. For this purpose, when the image of the finger is formed on the image sensor 14 by the lens 12, the image sensor 14 generates a digital image signal b and sends the image signal b to the control processor 15 as image data.

When the control processor 15 sends the image data as image information c to the hand detection unit 36, the hand detection unit 36 detects a finger shape as a feature by cutting out a hand area from the image information c. . In addition, the hand coding unit 37 generates a finger shape code i according to the finger image information c, and records the finger shape code i in the shape reference register 38 as a recording code.

Thereafter, when an image of the subject 11 is taken, when the image of the subject 11 is formed on the image sensor 14 by the lens 12, the image sensor 14 generates a digital image signal b as image data. The image data is sent to the control processor 15. The control processor 15
Sends image data to the hand detection unit 36 as image information c, the hand detection unit 36 detects a finger shape by cutting out a hand area from the image information c. Further, the hand coding unit 37 generates a finger shape code i according to the image information c of the hand area, and sends the finger shape code i to the code comparison unit 39.

The code comparing section 39 compares the recording code with the newly generated finger shape code i. If the matching rate is high, the code comparing section 39 functions as an operation signal generating means and uses the matching rate as a shutter timing signal h. To the operation control circuit 21.

When the operation control circuit 21 receives the shutter timing signal h, it sends a shooting timing signal g to the control processor 15, and the recording processing means (not shown) of the control processor 15 determines the timing at which the shooting timing signal g was sent. That is, at the photographing timing, the image data at that time is recorded on the recording medium 16 as image data recording means.
To record.

As described above, in the present embodiment, the photographing timing can be easily set by a general photographing operation such as a pause operation, so that the operator can operate the shutter, the remote controller, the timer, and the like. Without manipulation
The subject 11 can be photographed. Further, since there is no need to set a timer, not only can the photographing operation be simplified, but it is not necessary to carry a remote controller.

Next, a fourth embodiment of the present invention will be described. In addition, about what has the same structure as 1st and 3rd embodiment, the description is abbreviate | omitted by attaching | subjecting the same code | symbol.

FIG. 8 is a schematic diagram of a photographing apparatus according to the fourth embodiment of the present invention, and FIG. 9 is a schematic diagram of a hand recognition block according to the fourth embodiment of the present invention.

In this case, as shown in FIG. 8, the photographing apparatus 10 is provided with a hand recognition block 35 as hand recognition processing means in addition to the face recognition block 25 as appearance recognition processing means. In addition, face recognition block 2
5 sends a coordinate signal j to the hand recognition block 35.

Next, the operation of the photographing apparatus 10 having the above configuration will be described.

First, as described in the first embodiment, a predetermined object to be focused, for example, a face of a person is photographed in advance, and the photographed face is recorded in the first appearance information record. The target face code register 28 (FIG. 3) is registered as a means. Further, as described in the third embodiment, a predetermined target object of a person who has performed a pose operation, for example, a finger is photographed in advance, and an image of the photographed finger is used as a shutter timing image as a second image. The information is registered in the shape reference register 38 as the appearance information recording means. Accordingly, the face code e as the first face information is stored in the target face code register 28 in the second face information.
Is recorded in the shape reference register 38 as the first and second recording codes, respectively.

Thereafter, when an image of the subject 11 is taken, when the image of the subject 11 is formed on the image sensor 14 by the lens 12, the image sensor 14 generates a digital image signal b as image data. The image data is sent to the control processor 15. The control processor 1
Reference numeral 5 denotes a face detection unit serving as a first appearance detection unit and a face detection unit of the face appearance recognition block 25, and a hand detection unit serving as a second appearance detection unit of the hand recognition block 35, using the image data as image information c. Send to 36.

The face detection section 26 detects a face as a first appearance by cutting out a face area from the image information c. At this time, the face detection unit 26
The coordinate information d is calculated based on the position of the face on the screen on the image sensor 14. Also, the face coding unit 27
Generates a face code e as first face information in accordance with the image information c of the face area, and sends the face code e to the code comparison unit 29 as first object detection means together with the coordinate information d.

The code comparing section 29 compares the first recorded code with the newly generated face code e. If the matching rate f is high, the code comparing section 29 compares the matching rate f together with the coordinate information d. Send to

The first not shown of the control processor 15
The focus adjustment processing means as an operation signal generating means for the code comparison unit 2 is designed so that a portion corresponding to the coordinate information d in a screen on the image sensor 14 is most focused.
Based on the comparison result of No. 9, a focus adjustment signal a as a first operation signal is generated, the focus adjustment signal a is sent to the focus adjustment mechanism 13, and the focus adjustment mechanism 13 is operated.

On the other hand, the code comparing section 39 compares the second recording code with the newly generated finger shape code i, and when the matching rate is high, functions as a second operation signal generating means. The operation control circuit 21 sets the matching ratio as a shutter timing signal h as a second operation signal.
Send to

When the operation control circuit 21 receives the shutter timing signal h, it sends a photographing timing signal g to the control processor 15. Is recorded on a recording medium 16 as image data recording means.

Next, a fifth embodiment of the present invention will be described. In addition, about what has the same structure as 1st Embodiment, the description is abbreviate | omitted by attaching the same code | symbol.

FIG. 10 is a schematic diagram of a photographing apparatus according to the fifth embodiment of the present invention.

In this case, a signal line 41 for sending image data from the recording medium 16 as image data recording means to the facial appearance recognition block 25 as appearance recognition processing means is provided, and from the facial appearance recognition block 25 to the display circuit 17. The comparison result signal k is sent.

Next, the operation of the photographing apparatus 10 having the above configuration will be described.

First, as described in the first embodiment, a predetermined object to be focused, for example, a person's face is photographed in advance, and the photographed face is used as feature information recording means. It is registered in the target face code register 28 (FIG. 3).

When the photographing apparatus 10 is a digital camera, a plurality of image data recorded on the recording medium 16 are sent to the facial appearance recognition block 25, and the facial appearance is detected by the code comparing section 29 as a search processing means. The image data recorded on the recording medium 16 can be searched based on the facial appearance code e as the facial appearance information registered in the target facial appearance code register 28 corresponding to the above.

The search result is sent to the display circuit 17 as a display means by the comparison result signal k,
Displayed as 0. In this case, only the face of the image data with a high matching rate f can be displayed. When the photographing device 10 is a digital video, the matching rate f
The reproduction can be skipped until the image data has a higher value.

As described above, in the present embodiment, only the image data of the face code e registered in the target face code register 28 can be referred to at high speed.
In this case, the imaging device 10 functions as a playback device.

In each of the above embodiments, the photographing device 10
Is fixed, but, for example, a first support shaft extending in a vertical direction and a second support shaft extending in a horizontal direction are provided on a support base, and the imaging device is The first and second support shafts are arranged so as to be swingable, and a first drive motor as a first drive unit is driven to be rotated with respect to the first support shaft. By driving the second drive motor as the second drive means, the second drive motor can be rotated with respect to the second support shaft. Further, based on the detection result of the face by the face detection unit, the first,
By driving the second drive motor, the subject can be tracked as the subject moves.

The present invention is not limited to the above embodiment, but can be variously modified based on the gist of the present invention, and they are not excluded from the scope of the present invention.

[0068]

As described above in detail, according to the present invention, in a photographing apparatus, a face detecting device for detecting a face of a target object from image data of an image photographed by the photographing means. Means, a face information recording means for pre-recording information about the appearance of the object to be detected, and a predetermined face from the face detected by the face detection means based on the information on the face of the object to be detected. Object detecting means for detecting an object to be processed.

In this case, the information on the appearance of the object of the photographed subject in advance is compared with the information on the appearance of the object of the newly photographed object.

Therefore, based on the result of the comparison, for example, the focus adjusting mechanism is operated to automatically focus on the object. In addition, an optimal image can always be obtained regardless of the position of the target object, the perspective relationship with other target objects, and the like.

[Brief description of the drawings]

FIG. 1 is a schematic diagram of an imaging device according to a first embodiment of the present invention.

FIG. 2 is a schematic diagram of a conventional photographing apparatus.

FIG. 3 is a schematic diagram of a face recognition block according to the first embodiment of the present invention.

FIG. 4 is a schematic diagram of a photographing device according to a second embodiment of the present invention.

FIG. 5 is a schematic diagram of a multi-face recognition block according to the second embodiment of the present invention.

FIG. 6 is a schematic diagram of a photographing device according to a third embodiment of the present invention.

FIG. 7 is a schematic diagram of a hand recognition block according to a third embodiment of the present invention.

FIG. 8 is a schematic diagram of a photographing device according to a fourth embodiment of the present invention.

FIG. 9 is a schematic diagram of a hand recognition block according to a fourth embodiment of the present invention.

FIG. 10 is a schematic diagram of a photographing apparatus according to a fifth embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 Photographing apparatus 11 Subject 13 Focus adjustment mechanism 14 Image sensor 15 Control processor 16 Recording medium 17 Display circuit 21 Operation control circuit 26 Face detection unit 28 Target face code register 29, 39 Code comparison unit 32 Target face code / priority table 36 Hand Detector 38 Shape reference register a Focus adjustment signal e Face code h Shutter timing signal i Finger shape code

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/76 H04N 5/76 Z 5/78 5/78 B // H04N 101: 00 101: 00

Claims (7)

[Claims] 1. A photographing means, (b) a face detecting means for detecting a face of an object from image data of an image photographed by the photographing means, and (c) an appearance of the object to be detected And (d) an object for detecting an object matching a predetermined appearance from the face detected by the face detection means based on information on the appearance of the object to be detected. An imaging device comprising: object detection means. 2. The photographing apparatus according to claim 1, further comprising an operation signal generation unit that generates an operation signal based on a detection result by the object detection unit. 3. The photographing apparatus according to claim 2, wherein the operation signal is a focus adjustment signal for operating a focus adjustment mechanism to focus on a predetermined object. 4. The photographing apparatus according to claim 2, wherein said operation signal is a shutter timing signal for recording image data in image data recording means. 5. The operation signal serves as both a focus adjustment signal for operating a focus adjustment mechanism to focus on a predetermined object and a shutter timing signal for recording image data in image data recording means. The photographing device according to claim 2. 6. A feature information recording unit records information on the features of a plurality of objects to be detected together with their priorities, and b) the object detecting unit should perform the detection with a high priority. The photographing apparatus according to claim 1, wherein an object that matches information on a feature of the object is detected. 7. An image data recording means for recording image data of an image photographed by the photographing means, and (b)
A face detecting means for detecting a face of the object from the image data recorded in the image data recording means; (c) a face information recording means for pre-recording information relating to the face of the object to be detected; and (d) An object detection means for detecting an object matching a predetermined appearance from the face detected by the face detection means based on information on the appearance of the object to be detected; and (e) detecting the object by the object detection means. A display means for displaying the selected object.