JP2007535266A - Device for supporting electronic view finding - Google Patents

Abstract

A device with a camera function supports electronic view finding. The image sensor (100, 102) of the device is manually pointed at the scene. An inspection image obtained from the image sensor (100, 102) indicates whether the content of the inspection image satisfies a predetermined criterion for testing imaging of a predetermined type of object within the boundary range of the inspection image Electronically processed to generate a signal. The image sensor (100, 102) can be turned until the instruction signal indicates that the inspection image satisfies a predetermined criterion. Further processing operations are selectively applied to the captured image obtained when the image sensor is turned so that the indication signal indicates that the inspection image meets a predetermined criterion.

Description

  The present invention relates to an apparatus having an image sensor and supporting electronic view finding, and a method for capturing an image using electronic view finding.

  Many human-operated devices have image sensors that support camera functions. Traditionally, image sensors have been used in dedicated video cameras or CAM coders in which the camera is combined with a recorder. However, image sensors are also currently used in mobile phones, snapshot cameras, and the like. Theoretically, image sensors are also used to provide camera functionality to any other type of “apparatus” carried by a person, such as pens, clothes, shoes, briefcases, and the like.

  However, devices with camera functions that are operated by humans usually require a viewfinder that allows the operator to orient the camera. Conventionally, optical eyepieces that cooperate with a camera are used for this purpose, and the operator sees a scene that can be imaged thereby. Increasingly, electronic image display screens are used for this purpose and show images that are retrieved from an image sensor that captures the images. Usually a small liquid crystal screen is used for this purpose.

  Both the implementation of the optical eyepiece and the viewfinder as a display screen place various constraints on the device. Such viewfinders often require considerable space and can contribute significantly to the cost of the device. In the case of a display screen, the power consumption by the device can be significantly increased by the display screen.

  In particular, an object of the present invention is to provide an apparatus that has a camera function operated by a human and supports view finding without requiring an image display element such as an electronic display screen or an eyepiece.

  An apparatus according to the invention is described in claim 1. In accordance with the present invention, whether the apparatus meets a predetermined criterion, such as an image sensor and an image from the image sensor, such as a criterion corresponding to detection of whether a face is present in the image And an image processing circuit for testing whether or not. The user activates the device to function as a camera, after which the image processing circuit detects that the image meets the criteria, and the image processing circuit directs the device appropriately. In order to warn the person operating this, an instruction signal, for example, a signal that can be recognized by a human (for example, a sound or an indicator light) is started. The indication signal is not an image signal that can be controlled to cause the display to display an image, and typically the indication signal contains substantially less information than such an image signal. As an alternative, the triggered indication signal may cause automatic capture and storage or transmission of the image. Thus, the user can orient the camera without resorting to a display screen or eyepiece. The present invention applies to snapshot functions where individual images are captured in response to a signal and video shooting where the signal serves to allow the camera to continue to be aimed at the subject. sell.

  Any suitable type of criteria can be used. Face detection techniques are disclosed in, for example, IEEE trans pattern analysis and artificial intelligence in May 2002, vol. 24, no. 5, pages 696-706, Rein-Lien Hsu, Mohamed Abdel-Motalab and Anli K. et al. It is disclosed in a paper entitled “Face Detection in Color Images” by Jain. The image processing circuit may be arranged to use this technique to detect the presence of a face in the image.

  However, the present invention is not limited to this technique, i.e., actually the use of face detection. In a further embodiment, the image processing circuit is arranged to use one selectable from a plurality of different criteria to detect different types of objects in the image. Thus, the user may first select the image target before aiming the camera and waiting for a signal indicating that the camera image includes the selected type of target.

  Usually, the device is fixed to the device in a predetermined direction so that the user can direct the image sensor to any object by changing the direction of the device as a whole. At the same time, it can be carried by humans. However, in other embodiments, the image sensor may be directed to the target by directing the target to the device. In this case, the device is not portable.

  These and other objects and advantages of the present invention will be described with respect to embodiments using the accompanying drawings.

  FIG. 1 shows an apparatus with a camera function. The apparatus includes an image sensor 10, an image processing circuit 12, an indicator 14, and a capture control actuator 16. Furthermore, a further circuit 18 is provided. The image sensor 10 typically has a CCD chip 100 on the chip 100 with optics 102 for imaging a scene from a distance in front of the sensor. Typically, fixed focus optics are used to focus the object from substantially infinite to the minimum focal length, although adjustable focal lengths may be used as well. The indicator is, for example, LED light or a sound output device. The further circuit 18 is a circuit that realizes, for example, a mobile phone function or an image storage function.

  The image sensor 10 has an image signal output unit coupled to the image processing circuit 12. Image processing circuit 12 has an output coupled to indicator 14. Actuator 16 has an output coupled to image processing circuit 12 and further circuit 18. The further circuit 18 has an input coupled to the image signal output of the image sensor 10.

  In operation, the user activates the actuator 16 when the user wants to obtain one or more images of the subject. The actuator 16 is implemented as a button on the apparatus, for example. In response to this, the image processing circuit 12 receives an image from the image sensor 10 and tests whether the image satisfies a predetermined standard. If satisfied, the image processing circuit 12 activates the indicator 14 to generate an instruction signal recognizable by a human. When the user next activates the actuator 16, the further circuit 18 captures the image from the image sensor 10 and transmits, for example, via a mobile phone network or storage in a non-volatile memory. Respond by using the image for some predetermined purpose.

  Of course, without departing from the present invention, the image processing circuit 12 continuously tests the reference for incoming images, and the generation of a signal by the indicator 14 is enabled by actuation of the actuator 16.

  The image processing device 12 may be implemented as a suitably programmed processing device or dedicated hardware. Any suitable criteria may be implemented. For example, a technique for detecting a face in an image is disclosed in May 2002 by IEEE Trans Pattern Analysis and Artificial Intelligence, vol. 24, no. 5, pages 696-706, Rein-Lien Hsu, Mohamed Abdel-Motalab and Anli K. et al. It is disclosed in a paper entitled “Face Detection in Color Images” by Jain. This technique detects flesh-colored patches in an image, and detects face candidates when these patches appear in a required spatial arrangement. Regions in the image are assigned to face candidates based on the positions of patches associated with the face candidates and the range of their spatial distribution. The image processing circuit 12 has an allocation region that uses this technique and in which the technique is within an image boundary range or, in a further embodiment, within a predetermined or user selected sub-area within the image. It may be arranged to trigger a signal from the indicator 14 when detecting a face candidate.

  However, it should be understood that the present invention is not limited to this technique. There are many other face detection techniques. Similarly, other techniques exist for detecting other types of objects in an image. For example, a technique for detecting a human outline having a head, a torso, arms and legs may be used. Other examples include technology that detects pages printed with text within the image boundary, buildings with walls and roofs within the image boundary, plants with trunks and leaves within the image boundary, cars, etc. May be.

  In a further embodiment, a selection switch connected to the image processing circuit 12 may be provided to select a criterion to be used to trigger a signal from a number of available criteria. In this case, the user first sets the selection switch to the selected criterion, and then the image processing circuit 12 triggers a signal if the selected criterion is satisfied. The user selects a reference depending on the type of scene that the user wants to shoot.

  While on / off signaling from the indicator 14 is used in one embodiment, it should be appreciated that more gradual signaling depends on the position of the object to be detected relative to the image boundary, eg, audio volume and It may be used by changing the pitch and / or the color and / or intensity of the light. Therefore, for example, the instruction signal can be changed depending on the position of the face candidate with respect to the boundary. The first cognitive signal is output when, for example, the face candidate is incomplete because part of it is outside the image boundary, and the second, different cognitive signal is output when the face candidate is at the image boundary. Can be output if there is a whole in it. Alternatively or additionally, the cognitive signal may be perceptually modified as a function of the position of the face candidate from the center of the image. This helps the user in aiming the image sensor.

  The embodiment is used for the actuator 16 to enable signal transmission by the indicator 14 and to trigger subsequent capture and further use by further circuitry 18, but it should be understood that the present invention provides It is not limited to this embodiment.

  In a further embodiment, the further circuit 18 captures and uses successive images, for example as a video signal. In this case, the signal from the indicator 14 serves to allow the user to keep the image sensor directed at a predetermined object. Object detection as described in the previous example may be used to trigger a signal from the indicator 14. In a further embodiment, on a predetermined basis, the captured image should not be moved more than a predetermined distance relative to the selected image, eg, the first image in a series of consecutive images. For this purpose, the image processing circuit 12 may be arranged to determine different parts of the image from the image sensor 10 with a part of the selected image at various displacements. As long as the displacement to the minimum distance is below the threshold, the image processing circuit 12 signals the indicator 14 to output a first indication to verify proper aiming of the image sensor 10 and / or this displacement is If the threshold is exceeded, a second indication is output to indicate an aiming error.

  In other embodiments, the signal from indicator 14 is generated for a single image in response to actuation of actuator 16. Each time the user points the image sensor to a scene where the user activates the actuator 16 to capture the image and test whether the image contains the desired object. The user repeats this until a signal is obtained indicating that the image contains the desired object. Only the latter image needs to be handled by the further circuit 18, for example by storing it or transmitting it.

  Preferably, the image further allows for the user to wait for the subject person to laugh, for example, after receiving an indication that the image sensor 10 has been properly oriented. Therefore, it is used only when there is a specific activation signal from the user. However, in other embodiments, the additional circuitry 18 automatically captures and further uses the image when the image processing circuit 12 signals that the predetermined criteria have been met. Thus, the image is captured when the user properly directs the image sensor 10. In this case, a human perceivable signal (actually indicator 14) is not strictly required, only the internal electronic start signal. Preferably, however, indicator 14 is still present to provide confirmation to the user that the image has been captured.

  In yet another embodiment, the further circuit 18 automatically images the image within a predetermined delay range of, for example, between 0.5 seconds and 5 seconds after actuation of the actuator 16 allowing indication by the indicator 14. Captured and used further. Thus, the user is given a predetermined time interval within that range to direct the image sensor 10 under guidance from the indicator 14.

  Further circuitry 18 may perform any function. Typical functions include the storage of one or more selected images from an image sensor (eg for later viewing or printing) or the transmission of captured images eg via a mobile phone network or the Internet . The further circuit 18 may be, for example, a mobile phone circuit arranged to input and output voice speech signals and to exchange these signals via a wireless telephone network. In this case, the sound output of the mobile phone can be used for the indicator 14. Of course, such a mobile phone may have a display screen, but this screen needs to be used for view finding purposes, for example, because it is directed to the subject of the image. None or need to be appropriate.

  Although the generation of an output signal has been described for a single type of reference that indicates the presence of a predetermined type of image content, in particular the presence of a predetermined type of object inside the boundary, it should be understood that the present invention Without deviating from the device, the device provides other types of state signaling, such as the presence or absence of sufficient light to capture images of sufficient quality and whether a given object is in focus. You may do it. The criteria for detecting these conditions are known per se. However, it will be appreciated that in the apparatus, the signals for these situations are signal additions or additions that indicate the presence of a predetermined type of image object within the image boundary range.

  The image sensor 10 is easily coupled to the device so that the device as a whole should be newly oriented in the three-dimensional direction towards the object, and the required object is imaged within the image boundary range. Make sure. This is easily possible for portable devices such as mobile phones. In an embodiment, the image sensor 10 may be rotatably mounted on the device so that it is newly oriented at least over a predetermined range of directions regardless of the device. Thus, a device having a fixed direction may be used.

The apparatus with a camera function is shown.

Claims (11)

An image sensor having an image signal output capable of being freely oriented over at least a range of directions in the space towards an object in the space to be imaged by the image sensor;
Detect whether the content of the image coupled to the image signal output and sensed by the image sensor meets a predetermined criteria for testing imaging of a predetermined type of object within the boundary range of the image And an image processing circuit arranged to be coupled to the image processing circuit, the image processing circuit arranged to generate an indication signal indicating whether the image has detected that the image satisfies the predetermined criteria. Signal generation unit;
A device with a camera function.   The apparatus according to claim 1, wherein the instruction signal is a signal recognizable by a human.   Whether the predetermined type of object is detected or not, the signal generating unit is configured to detect at least one of the boundaries of the image, or a predetermined or user-selected subsection of the image, and a region of the image. The apparatus of claim 2, wherein the apparatus is arranged to adapt the indication signal in dependence on a detected distance between. A memory for storing a selected image from the image sensor;
Arranged to select the selected image upon or after detecting that the image meets the criteria;
The apparatus of claim 1. A transmission circuit for transmitting a selected image from the image sensor;
Arranged to transmit the selected image upon or after detecting that the image meets the criteria;
The apparatus of claim 1. The image processing circuit is selectable among a plurality of predetermined criteria for testing the presence of each predetermined type of object whose image content detected by the image sensor is within the boundary range of the image. Arranged to detect whether or not
The apparatus has a user selection input for detecting which of the criteria can be used to generate the indication signal.
The apparatus according to claim 1. Having a human control interface arranged to control image use by the first actuation when the second actuation continues;
The first operation enables the generation of the instruction signal;
The second actuation signals a predetermined use of the selected image from the image sensor;
The apparatus according to claim 1.   The apparatus of claim 1, wherein the predetermined type of object arranged for testing by the image processing circuit is a human face.   The apparatus of claim 1, wherein a display screen is not provided to display any image from the image sensor.   The device of claim 1, wherein the device is a handheld portable device. An image capturing method by a device having a camera function, comprising:
Manually directing the image sensor of the device to a scene;
Whether the inspection image obtained from the image sensor is electronically processed and the content of the inspection image satisfies a predetermined criterion for testing imaging of a predetermined type of object within a boundary range of the inspection image Generating an instruction signal indicative of
Manually redirecting the image sensor until the instruction signal indicates that the inspection image satisfies the predetermined criterion; and the instruction signal satisfies the predetermined criterion. To selectively apply further processing operations to the captured image obtained when the image sensor is newly oriented;
Having a method.

Images