JP2004153550A - Processing/imaging method and apparatus thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a processing/imaging method and an apparatus for processing an image of a subject and outputting the processed image, which can adjust the image to have a desired state and output it, in particular, when the subject is moving as in a TV telephone. <P>SOLUTION: The imaging apparatus includes at least a first lens system having a focusing point and an aperture mechanism and a light receiving unit. In the apparatus, a half mirror tilted to an optical path extended from the first lens system to the light receiving unit is provided, and an illumination unit is provided symmetrically with respect to the first lens system in front of the half mirror so that illumination light reflected by the half mirror is directed through the first lens system toward a first subject. An illumination mask means provided in an optical path extended from the illumination unit to the half mirror for adjusting transmitting part of the illumination light is controlled according to information about the first subject obtained by the focusing point and aperture mechanism of the first lens system to process the photographed image. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an imaging method and apparatus for processing and outputting an image of a subject, and more particularly, to an imaging apparatus used when the subject has motion.
[0002]
[Prior art]
Conventionally, there is a high demand for processing and outputting an image of a subject.
For example, there is a case where a person is desired to be imaged with a clear image, or character information is to be added and imaged.
In particular, when the subject has movement, it is useful if processing can be performed on the image in real time.
[0003]
A face image at the time of a video conference (TV phone) in which the user interacts via a communication line while facing each other can be said to be a typical example of such a moving subject.
The origin of TV phones is surprisingly old and begins with the history of TV technology. In 1924, the United States RCA conducted a wireless photographic transmission experiment. Just four years later, in 1928, a TV broadcast was launched in New York, which was broadcast three times a week in 30 minutes. Around 1930, the first TV telephone experiment was already conducted in New York. Subsequently, in 1935, Japan's first TV telephone experiment was conducted at the Yokohama Memorial Expo. Later, in the 1960s, the demand for telephones in developed countries became apparent, and TV telephone research was actively conducted in developed countries. It is not too old that TV phones in Japan were tried at the 1970 Osaka Expo to contact lost children. Certainly, it was a communication technology that many people have been waiting for.
[0004]
However, the spread has slowed since then. Initially, it was expected that commercialization would cost ten and several times more than telephone charges.
Now, however, the bandwidth of the lines has increased, and the technology of compressing and decompressing moving images in real time has also been prepared due to the increased performance of computers. At present, there are quite a few companies that use it as a video conference system. Phoenix, which can easily add a TV phone function by simply adding a TV conference board to a personal computer, has been released by NTT, but the penetration rate for each individual (consumer level) is not so high.
[0005]
One of the reasons why it has not spread is that it was difficult to find the "real reason" that is hard to appear.
In general, I agree with the spread of TV phones when first optimistic, but when it comes to using it, I think it's either a problem with the installation, or it's difficult to keep using it for a long time. It was necessary to be aware of the dual structure of the fact that the telephone was convenient.
[0006]
As a result of the research conducted by the present inventor, it was found that one of the causes of feeling uncomfortable with use is a kind of selfishness that "I want to see the other party but I do not want to see myself." It turned out that adults were trying to conceal their selfishness, and had just answered another excuse.
The answer to this other reasoning is also an excuse for resistance to answering machines. I often hear that even though I purchased a telephone with an answering machine and made a fancy guide message, most people who call me are silently cut off without blowing anything It is a story.
These phenomena are the result of differences between the users and the users.
[0007]
In actually using a TV phone, the following are examples of user's resistance.
I don't want to show my face to strangers or haters.
I do not want to see the background of the room.
It is not a face or clothing that can be used 24 hours a day.
There is a sense of incongruity because the eyes do not match.
I'm anxious because I don't know what kind of image is being shown to the other party.
I want to show not only the face but also the documents.
Just as other people (such as cohabitants) cannot hear the conversation content of the other party, they do not want to show the other party to the other party.
I don't want to bother others with light because of lighting.
[0008]
2. Description of the Related Art Various types of illumination have been used to image a subject.
For example, when the subject is a person, the impression is completely different depending on the lighting condition even if it is a mere identification photograph. Therefore, the lighting conditions for beautifully photographing are important. Even the mental resistance of not being able to look beautiful is the reason why TV phones are not popular.
[0009]
Even if illumination is performed using complex and expensive means, in the case of single-light illumination, the fundamental problem is that dark and undesired shadows will occur if the subject is not illuminated directly in front of the subject. There is.
Conventionally, a large number of illuminations are simultaneously applied from multiple directions, and cancel each other out so that the shadow caused by the artificial illumination does not unnaturally become dark.
As described above, in the related art, it is necessary to provide a plurality of lights in order to eliminate shadows accompanying the lights, and the lighting means and the imaging means including a lens and a light receiving unit are separated. Was independent. In addition, since the illumination is mainly fixed to a stand, it requires labor to adjust the positional relationship with the imaging device.
[0010]
[Problems to be solved by the invention]
Accordingly, the present invention provides an imaging method and apparatus for processing and outputting an image of a subject, and in particular, a processing method and apparatus for adjusting and outputting an image to a desired state when the subject moves, such as a TV phone. The task is to provide.
[0011]
[Means for Solving the Problems]
In order to solve the above problems, a processing and imaging method of the present invention includes the following configuration.
That is, in an image pickup apparatus including at least a first lens system having a focusing and aperture mechanism and a light receiving unit, an optical path from the first lens system to the light receiving unit is provided between the first lens system and the light receiving unit. And a lighting unit is installed in a direction symmetrical to the first lens system on the front surface of the half mirror, and illumination light reflected by the half mirror passes through the first lens system to the first lens system. An illumination configured to face an object and provided in an optical path from an illumination unit to a half mirror to adjust a transmission part of illumination light in accordance with information on the first object obtained by a focal point of a first lens system and an aperture mechanism. It is characterized in that the processing of the processed image is obtained by controlling the mask means.
[0012]
Further, in an image pickup apparatus including at least a first lens system having a focusing point and an aperture mechanism and a light receiving unit, an optical path from the first lens system to the light receiving unit is provided between the first lens system and the light receiving unit. And a lighting unit is installed in a direction symmetrical to the first lens system on the front surface of the half mirror, and illumination light reflected by the half mirror passes through the first lens system to the first lens system. A light receiving mask means is provided in front of the light receiving unit and configured to adjust a light transmitting portion in accordance with information on the first object obtained by the focusing mechanism of the first lens system and the aperture mechanism. Then, a similar effect can be obtained even if a processed captured image is obtained.
[0013]
An apparatus for performing these methods includes an image pickup apparatus including at least a first lens system having a focusing point and an aperture mechanism, and a light receiving unit, wherein the first lens system and the light receiving unit are disposed between the first lens system and the light receiving unit. A half mirror that is inclined with respect to the optical path leading to the light receiving unit is installed, and an illumination unit is installed in a front surface of the half mirror in a direction symmetrical to the first lens system, so that the illumination light reflected by the half mirror receives the first light. An illumination mask means for adjusting the transmission portion of the illumination light on an optical path from the illumination unit to the half mirror, and a focusing and aperture mechanism of the first lens system. Illumination mask control means for controlling the illumination mask means in accordance with the information on the first subject obtained by the above and processing the captured image.
[0014]
Alternatively, similarly, in an image pickup apparatus including at least a first lens system having a focusing point and an aperture mechanism and a light receiving unit, the first lens system and the light receiving unit are disposed between the first lens system and the light receiving unit. A half mirror inclined with respect to the optical path is installed, and an illumination unit is installed in a front surface of the half mirror in a direction symmetrical to the first lens system, so that the illumination light reflected by the half mirror passes through the first lens system. Light-receiving mask means for adjusting a light-transmitting portion at the front of the light-receiving unit, and information on the first object obtained by the focusing and aperture mechanism of the first lens system. And a light receiving mask control means for controlling the light receiving mask means to process the captured image.
[0015]
Here, the mask means may be constituted by a transmissive liquid crystal mask to contribute to fine processing in real time of imaging.
[0016]
The mask means may be provided with a light quantity adjusting means for adjusting the quantity of transmitted light to contribute to various conveniences such as prevention of glare.
[0017]
A waste light unit having a light absorbing unit may be attached to the rear surface of the half mirror in a direction symmetric to the light receiving unit to contribute to preventing light from the illumination unit from being mixed into the light receiving unit.
[0018]
A second lens system having a focal point and an aperture mechanism may be added to the rear surface of the half mirror in a direction symmetric to the light receiving unit to contribute to synthesis of an output image such as addition of character information.
[0019]
The second subject imaged by the second lens system is information related to the first subject, and a combined output control unit for combining and outputting the second subject and the first subject is provided to provide a useful image. May be contributed.
[0020]
It is also possible to provide a voice-to-text conversion output unit that converts the voice uttered by the first subject into text information and outputs the text information as the second subject, thereby contributing to the voice imaging.
[0021]
A translation function may be provided in the voice-to-text conversion output means to contribute to the elimination of a linguistic barrier.
[0022]
Illumination means for irradiating the first subject with light in a direction different from the direction in which the illumination unit irradiates the first subject with light may be provided to contribute to three-dimensional imaging.
[0023]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
1 and 2 are explanatory views showing the main part of the processing and imaging apparatus according to the present invention, and FIG. 2 shows a state in which a second lens system is provided in the basic configuration shown in FIG. FIG. 3 is an explanatory diagram of a system using the device of the present invention.
The processing and imaging device (20) is provided with a first lens system (21) having a focusing point and an aperture mechanism facing the first subject (10).
The first lens system (21) includes a mechanism for adjusting the optical system in order to form an appropriate image on the light receiving unit (22) according to the distance to the subject and the amount of light.
[0024]
A light receiving unit (22) is connected via a mount (23) in the traveling direction of the light received by the first lens system (21).
The light receiving unit (22) is provided with a film, a light receiving element such as a CCD or a CMOS. Preferably, an electronic and light receiving element is provided and connected to the control device (30) as shown.
[0025]
A half mirror (24) that is inclined with respect to the optical path from the first lens system (21) to the light receiving unit (22) is provided between the first lens system (21) and the light receiving unit (21). You.
The half mirror (24) is made of a material that reflects and transmits light at a predetermined ratio, but the ratio between reflection and transmission is not particularly limited here.
In addition, the inclination angle of the half mirror (24) with respect to the optical path from the first lens system (21) to the light receiving unit (22) is 45 ° in the illustrated example, but is arbitrary as long as the condition described later is satisfied. It is.
[0026]
An illumination unit (25) is installed in a direction symmetrical to the first lens system (21) on the front surface of the half mirror (24).
Therefore, the illumination light emitted from the illumination unit (25) is reflected by the half mirror (24), and is emitted to the first subject (10) through the first lens system (21).
[0027]
In the illustrated example, since the inclination angle of the half mirror (24) with respect to the optical path from the first lens system (21) to the light receiving unit (22) is 45 °, the half mirror (24) and the illumination unit (25) are connected. The inclination angle of the half mirror (24) with respect to the optical path to be connected is also set to 45 °, and the direction from the half mirror (24) to the first lens system (21) and from the half mirror (24) to the illumination unit (25). The direction is orthogonal.
However, the illumination unit (25) only needs to be positioned symmetrically with respect to the first lens system (21) on the front surface of the half mirror (24), so that the illumination unit (25) extends from the first lens system (21) to the light receiving unit (22). If the inclination angle of the half mirror (24) with respect to the optical path is, for example, 30 °, the inclination angle of the half mirror (24) with respect to the optical path connecting the half mirror (24) and the illumination unit (25) is also set to 30 °, The angle between the direction from the half mirror (24) to the first lens system (21) and the direction from the half mirror (24) to the illumination unit (25) is 60 °.
Thus, as long as the illumination unit (25) and the first lens system (21) are positioned in symmetrical directions with respect to the front surface of the half mirror (24), the light receiving unit (22) is moved from the first lens system (21). ) Can be set arbitrarily with respect to the optical path leading to the half mirror (24).
[0028]
The lighting unit (25) is preferably provided with a means for providing light that travels substantially straight and does not diffuse.
Since a mere light bulb produces diffused light, it is desired to provide an auxiliary member such as a concave lens for the light bulb. Further, it may be designed such that this portion is opened or a Fresnel lens or other light collecting device is attached to take in light from the outside.
Further, since it is an illuminating means for the first subject (10), it is desirable to use a member for softening an image such as a ground glass to make the light uniform without a pattern or the like.
[0029]
Similarly to the light receiving unit (22), the illumination unit (25) is made detachable via a mount, and the half mirror (24) is made detachable so that the setting can be changed to a form that does not use illumination. Is also good.
For this purpose, the half mirror (24) is simply flipped up, the opening of the illumination unit (25) is closed, and the optical path from the first lens system (21) to the light receiving unit (22) can be opened. May be.
[0030]
As described above, if the subject illumination is integrated into the imaging device, the first subject (10) can be illuminated from the front by using a single illumination, and the shadow accompanying the illumination can be eliminated. It becomes possible to do.
Further, since the illumination unit (25) is included in the simple configuration, the subject can be illuminated even in the case of close-up imaging.
Note that the addition of the half mirror (24) to the normal light receiving optical path increases the distance between the first lens system (21) and the light receiving unit (22). Design techniques can be diverted.
[0031]
The illumination light from the illumination unit (25) may pass through the half mirror (24) and enter the light receiving unit (22).
Therefore, a means for removing the illumination light transmitted through the half mirror (24) is provided.
On the rear surface of the half mirror (24), a waste light unit (26) having light absorbing means is attached in a direction symmetric to the light receiving unit (22).
Since the azimuth symmetrical to the light receiving unit (22) on the rear surface of the half mirror (24) is on the extension of the optical path from the illumination unit (25) to the half mirror (24), the illumination light transmitted through the half mirror (24) is Since the light reaches the waste light unit (26) straightly, it is possible to efficiently prevent light from the illumination unit (25) from being mixed into the light receiving unit.
As described above, the position of the waste light unit (26) is desirably adjusted according to the position of the illumination unit (25), in other words, in accordance with the inclination angle of the half mirror (24). There is no.
As the waste light unit (26), a material having low reflectance and high heat resistance, such as black flocking, malt plain, and felt, can be used.
[0032]
Here, a transmission liquid crystal mask (28) is provided as an illumination mask means between the illumination unit (25) and the half mirror (24).
The transmission liquid crystal mask (27) is made of liquid crystal that dynamically and partially changes the light transmittance in response to a signal from the control device (30).
Thereby, according to the image information of the first subject (10) obtained by the focal point of the first lens system (21) and the aperture mechanism, the transmission part and the transmission intensity of the illumination light from the illumination unit (25) are adjusted. The processed captured image is output.
[0033]
For example, when the focus of the first lens system (21) is on the face of the speaker as the first subject (10), the first lens system (21) passes through the transmissive liquid crystal mask (27) presenting a shape cut out in the shape of the speaker. The edge of the illuminated light is also focused, so that unnecessary light does not leak to the background or the like.
Further, by adjusting the transmissive liquid crystal mask (27) so that the light amount is reduced only in the eyes of the speaker, illumination that is not dazzling can be provided.
[0034]
When the movement of the first subject (10) is poor, a static mask means using an opaque and translucent material may be used instead of the transmissive liquid crystal mask (28).
[0035]
Such a mask means may be provided immediately before the light receiving unit (22).
That is, in accordance with the focal point of the first lens system (21) and the image information of the first subject (10) obtained by the aperture mechanism, the control device (30) is provided in front of the light receiving unit (22) by the control device (30). And controlling the light-receiving mask means for adjusting the transmission portion and transmission intensity of the image to provide a processed captured image.
[0036]
Further, a second lens system (28) having a focusing point and an aperture mechanism may be provided in a direction symmetric to the light receiving unit (22) on the rear surface of the half mirror (24).
Then, the control device (30) including the composite output control means converts the first subject (10) obtained by the first lens system (21) and the second subject (11) obtained by the second lens system (28). ) Through (31), it is possible to appropriately synthesize and output.
[0037]
It is useful that the second subject (11) imaged by the second lens system (28) is related to the image information of the first subject (10).
For example, character information that supplements the image information of the first subject (10) is presented as a second subject (11) on paper or a display.
Further, the control device (31) is provided with a voice / character conversion / output means for converting a voice uttered by a first subject (10) such as a person into character information and outputting the character as a second subject (11). May be contributed.
If a function of translating a foreign language or the like is added to the voice-to-character conversion output means, linguistic barriers can be removed and smooth communication can be achieved.
[0038]
According to the apparatus provided with such a second lens system (28), it can be used for the following TV phones and the like.
While the speaker as the first subject (10) is imaged by the first lens system (21), the hand is illuminated by the illumination unit (25), and the memo of the hand is imaged as the second subject (11). I do.
[0039]
Whether to image the speaker's face, image the contents of the memo, or combine them can also be adjusted by the aperture mechanism, lid, ND filter, etc. of each lens system (21) (28). If the memo is not imaged, the waste light unit (26) may be taken by taking measures such as closing or closing the aperture of the second lens system (28).
If the amount of light of the first lens system (21) is "large" and the amount of light of the second lens system (28) is "small", the memo content is superimposed thinly on the first subject (10). Can be displayed in an appropriate state.
Conversely, if the light amount of the first lens system (21) is "small" and the light amount of the second lens system (28) is "large", the first subject (10) is super-inlaid on the memo. It can be displayed as if paused.
Further, if the light amount of the first lens system (21) is set to “absent”, an image only for writing a memo is conversely, and if the light amount of the second lens system (28) is set to “absent”, the first object ( 10) Only images can be displayed.
[0040]
As described above, a plurality of lens systems capable of dynamic masking and including illumination means may be used.
That is, an illuminating means for irradiating the first subject (10) with light in a direction different from the direction in which the lighting unit (25) irradiates the first subject (10) with light is additionally provided.
For example, when two units are used, one unit is illuminated with a ratio of 7, and the other unit is illuminated with a ratio of 3, a three-dimensional image of the first subject (10) can be obtained.
In particular, when other lights are used indoors with the other lights turned off, there is an advantage that the first subject (10) can be three-dimensionally imaged without displaying the background.
[0041]
【The invention's effect】
The present invention has the following effects by providing the above configuration.
That is, according to the processing and imaging method according to the first aspect or the processing and imaging apparatus according to the third aspect, the illumination mask means causes the illumination unit to output the light from the illumination unit in accordance with the information on the first subject obtained by the first lens system. Is adjusted, so that the image of the subject can be processed and output. In particular, since the processing can be performed in real time, it is useful when the subject moves, such as a TV phone.
[0042]
According to the processing and imaging method according to claim 2 or the processing and imaging apparatus according to claim 4, similarly, the illumination unit according to the information on the first subject obtained by the first lens system by the light receiving mask means. Since the transmission part of the illumination light from is adjusted, it is possible to process and output an image of the subject. In particular, since the processing can be performed in real time, it is useful when the subject moves, such as a TV phone.
[0043]
According to the processing and imaging device of the fifth aspect, since the transmission liquid crystal mask is used, it is possible to process the captured image precisely in real time.
[0044]
According to the processing and imaging apparatus of the present invention, since the mask means includes the transmitted light amount adjusting means, consideration for the subject and workability of the image are improved.
[0045]
According to the processing imaging device of the seventh aspect, since the waste light unit is provided in the rear surface of the half mirror in a direction symmetric to the light receiving unit, it is possible to prevent light from the illumination unit from being mixed into the light receiving unit.
[0046]
According to the processing and imaging apparatus of the eighth aspect, since the second lens system having the focusing point and the aperture mechanism is provided in the direction symmetrical to the light receiving unit on the rear surface of the half mirror, an output image such as addition of character information is synthesized. be able to.
[0047]
According to the processing and imaging apparatus of the ninth aspect, since the related second subject and the first subject are synthesized and output, a useful image can be provided.
[0048]
According to the processing and imaging apparatus of the tenth aspect, since the sound is imaged, a useful image with a large amount of information can be provided.
[0049]
According to the processing and imaging apparatus of the eleventh aspect, since the voice / character conversion output means has a translation function, a linguistic barrier is removed.
[0050]
According to the processing and imaging apparatus of the twelfth aspect, since the first subject is irradiated with light from a plurality of directions, a captured image having a three-dimensional effect can be obtained.
[Brief description of the drawings]
FIG. 1 is an explanatory view of a main part of a processing and imaging apparatus according to the present invention; FIG. 2 is an explanatory view showing a state where a second lens system is provided in the basic configuration shown in FIG. 1; FIG. [Description of the symbols]
Reference Signs List 10 First subject 11 Second subject 20 Illuminated imaging device 21 First lens system 22 Light receiving unit 23 Mount 24 Half mirror 25 Illumination unit 26 Waste light unit 27 Transmission liquid crystal mask 28 Second lens system 30, 31 Control device

Claims (12)

In an imaging apparatus including at least a first lens system having a focusing point and an aperture mechanism and a light receiving unit,
A half mirror that is inclined with respect to the optical path from the first lens system to the light receiving unit is installed between the first lens system and the light receiving unit,
An illumination unit is installed in a direction symmetrical to the first lens system on the front surface of the half mirror,
The illumination light reflected by the half mirror is configured to travel toward the first subject through the first lens system,
In accordance with the information on the first subject obtained by the focal point and the aperture mechanism of the first lens system, the illumination mask means provided on the optical path from the illumination unit to the half mirror and adjusting the transmission part of the illumination light is controlled to perform processing. A processing and imaging method characterized by obtaining a captured image subjected to the following. In an imaging apparatus including at least a first lens system having a focusing point and an aperture mechanism and a light receiving unit,
A half mirror that is inclined with respect to the optical path from the first lens system to the light receiving unit is installed between the first lens system and the light receiving unit,
An illumination unit is installed in a direction symmetrical to the first lens system on the front surface of the half mirror,
The illumination light reflected by the half mirror is configured to travel toward the first subject through the first lens system,
In accordance with the information on the first subject obtained by the focal point of the first lens system and the aperture mechanism, the light receiving mask means provided at the front of the light receiving unit and adjusting the light transmitting portion is controlled, and the processed imaging is performed. A processing and imaging method characterized by obtaining an image. In an imaging apparatus including at least a first lens system having a focusing point and an aperture mechanism and a light receiving unit,
A half mirror that is inclined with respect to the optical path from the first lens system to the light receiving unit is installed between the first lens system and the light receiving unit,
An illumination unit is installed in a direction symmetrical to the first lens system on the front surface of the half mirror,
The illumination light reflected by the half mirror is configured to travel toward the first subject through the first lens system,
Further, in an optical path from the illumination unit to the half mirror, an illumination mask means for adjusting a transmission part of the illumination light,
A processing unit configured to control an illumination mask unit in accordance with information on a first subject obtained by a focusing mechanism and an aperture mechanism of a first lens system to perform processing on a captured image; apparatus. In an imaging apparatus including at least a first lens system having a focusing point and an aperture mechanism and a light receiving unit,
A half mirror that is inclined with respect to the optical path from the first lens system to the light receiving unit is installed between the first lens system and the light receiving unit,
An illumination unit is installed in a direction symmetrical to the first lens system on the front surface of the half mirror,
The illumination light reflected by the half mirror is configured to travel toward the first subject through the first lens system,
Further, in front of the light receiving unit, a light receiving mask means for adjusting a light transmitting portion and a light receiving mask means are controlled in accordance with information on the first subject obtained by the focusing mechanism of the first lens system and the aperture mechanism. And a light receiving mask control means for processing a captured image. 5. The processing and imaging apparatus according to claim 3, wherein the mask means is a transmission liquid crystal mask. 6. The processing and imaging apparatus according to claim 3, wherein the mask unit includes a light amount adjusting unit that adjusts a light amount of the transmitted light. 7. The illuminated image pickup apparatus according to claim 3, wherein a waste light unit having light absorbing means is provided in a direction symmetrical to the light receiving unit on the rear surface of the half mirror. 7. The illuminated imaging device according to claim 3, further comprising a second lens system having a focusing point and an aperture mechanism provided in a direction symmetric to the light receiving unit on the rear surface of the half mirror. 9. The composite output control means according to claim 8, wherein the second subject imaged by the second lens system is information related to the first subject, and the combined output control means combines and outputs the second subject and the first subject. Illuminated imaging device. 10. The illuminated imaging device according to claim 9, further comprising a voice / character conversion output unit that converts a voice uttered by the first subject into text information and outputs the text information as a second subject. 11. The illuminated imaging device according to claim 10, wherein the voice character conversion output means has a translation function. The illumination-equipped imaging device according to claim 3, further comprising an illumination unit configured to irradiate the first subject with light in a direction different from the direction in which the illumination unit irradiates the first subject with light.

Images