JPH11225319A - Image input output device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide the simple small-sized image input output device using a conventional display device at a low cost with high performance where coincidence of sight lines is realized. SOLUTION: A video image of a sender is photographed by a small-sized camera 21 and a video image of a recipient is displayed on a screen /LCD 22 as a display window 23. The small-sized camera 21 is placed at a prescribed place in a case 20 that acts like an outer frame of the image input output device. Then a relative position of the both is controlled by a control section in a direction so that the small-sized camera 21 and the display window 23 that represents a video image of the recipient displayed on the screen /LCD 22 approach.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to information transmission and processing means optimal for multi-point video or video telephones or telecommunications using information processing means such as personal computers, video terminals, and workstations. In addition, the present invention relates to a line-of-sight type display / imaging device that images and displays images by matching the line of sight of participants.

[0002]

2. Description of the Related Art Heretofore, a line-of-sight videophone apparatus has been developed which matches the line of sight of a viewer with a person (destination) person image displayed on the screen of a display device.

FIG. 37 to FIG. 41 show a schematic structure of a conventional line-of-sight video telephone apparatus.

FIG. 37 is a diagram showing a configuration according to the system disclosed in Japanese Patent Application Laid-Open No. 61-65683.
The display 1 and the camera 2 are aligned with the eyes 4 via the prism 3.

FIG. 38 is a diagram showing a configuration according to the method disclosed in Japanese Patent Application Laid-Open No. Hei 4-280582. FIG.
In the first embodiment, a grating lens 5 is arranged on the front surface of the CRT display 1, and a lens group 6 including a plurality of lenses is arranged between the grating lens 5 and the camera 2, and between the incident light and the reflected light. It has a predetermined angle φ. With such a configuration, gaze matching is performed.

FIG. 39 to FIG. 41 are diagrams showing the configuration of a simple device for performing eye-gaze matching.

FIG. 39 shows the structure of an apparatus disclosed in Japanese Patent Application Laid-Open No. Hei 4-977663. An image is received by a prism 8 attached to a transparent plate 7 on the screen of the CRT display 1, and the image is received. This is a mode in which an image is captured by the small camera 9 and processed via the imaging processing unit 9a. The small camera 9 is provided so as to be movable on the screen in the left-right direction.

FIG. 40 is a block diagram of the apparatus disclosed in Japanese Patent Application Laid-Open No. 2-58484. In FIG. 40, CR
Two small cameras 9 are arranged on the left and right sides of the screen of the T display 1. Images are taken by these small cameras 9 and displayed by the image processing in the control circuit 10 as if viewed from the front.

FIG. 41 is a diagram showing the configuration of the device disclosed in Japanese Patent Application Laid-Open No. 7-1111638. In FIG. 41, a plurality of sub-screens 11a to 11d and a small camera 9 are provided below the screen of the CRT display 1.
Placed and mounted. Then, the sub-screens 11a to 11d, the small camera 9, and the control circuit 1
The line of sight is matched by the processing of No. 2.

[0010]

However, none of the above-mentioned prior arts has achieved satisfactory performance using a special display device, a large-scale device, or an expensive device.

That is, the above-mentioned prior art requires a very large display device and a special screen. For this reason, special and expensive TV video conferencing systems,
It is impossible to take this configuration except for video messages.

In the apparatus shown in FIG. 37, the optical axis is located at the center of the television, so that when the display frame on the screen deviates from the center, it is not possible to obtain a line of sight.

In the case of the apparatus shown in FIG. 38, the prism is divided in a plane, but if the optical axis deviates from the screen, the image entering the camera 2 is lost or the image is distorted. Had issues.

[0014] For this reason, it has not been possible to respond to the demand for effectively using the conventional CRT or LCD of a computer, television, or home terminal and not to degrade image performance.

On the other hand, in the apparatus shown in FIG. 39, a minute prism is projected on the screen, but the line of sight can be matched only in the upper part of the screen as it is. A guide is required to match the line of sight inside the screen, but optical adjustment is required each time. For this reason, it is not suitable for practical use.

The apparatus shown in FIG. 40 matches the eyes with image processing. However, when a front image is generated from images obtained from the left and right cameras when the screen is enlarged, a sense of incongruity occurs. . In addition, computer generated images are often less familiar than actual images.

Further, the configuration of the apparatus shown in FIG. 41 is different from the screen in that other small sub-screens 11a to 11a are provided.
Since a TV phone having d is installed, the cost and the usability are not good.

Therefore, the prior art shown in FIGS. 39 to 41 makes effective use of the conventional CRT or LCD of a computer, television or home terminal, matches the eyes, and does not degrade the image performance. Was not able to respond to the request.

Such a conventional problem is that if the imaging device can be miniaturized, it can be installed on the screen or on the screen without any incongruity and can be moved. It can be realized at low cost using a TV and a terminal. However, such a small camera must be provided with an automatic exposure function, a zoom function, a focusing function, a tilt or a swing function, which are conventionally performed mechanically, reduced to a very small size.

Further, in order to move on the screen,
Using ultra-small micromachine technology for small cameras,
Near actuators must be provided.
Further, in order to achieve wireless communication and line saving, it is necessary to have communication means for communicating an image signal and means for supplying energy from the outside. In addition, an interface for controlling the display window on the screen is required.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and provides a simple, low-cost, high-performance, small-sized image input / output device capable of line-of-sight matching using a conventional display device. With the goal.

[0022]

That is, the present invention provides an image pickup means for photographing a picture of a sender, a display means for displaying a picture of a receiver, and a display means for displaying the picture of the receiver and the receiver displayed on the display means. And a position adjusting means for adjusting a relative position with respect to an image.

In the image input / output device of the present invention, the image of the sender is photographed by the imaging means, and the image of the receiver is displayed on the display means. Then, the relative positions of the image pickup unit and the receiver image displayed on the display unit are adjusted by the position adjustment unit in a direction in which the image approaches the receiver image.

[0024]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows a first embodiment of the image input / output device of the present invention.
(A) is a front view of the device, and (b) is a diagram of the device as viewed from above.

This image input / output device has a housing 2 which is an outer frame.
0, a small camera 21 attached to a predetermined position in the housing 20, and a screen or LC in the housing 20.
D (screen / LCD) 22 and this screen / L
A display window 23 is provided on the CD 22 for displaying images on the transmission side and the destination (destination) side.

The size of the small camera 21 is, for example, not more than 1 cm in diameter and not more than 2 cm in height, preferably not more than 5 mm in diameter and not more than 7 mm in height. The small camera 21 requires a lens group for focusing and an image sensor, but may have an automatic exposure, an automatic focus, a zoom function, and a swing function.

The small camera 21 and the screen / LC
The positional relationship with the display window 23 in D22
The distance L between the center of the lens and the center of the image display area of the other party (transmission destination) in the screen / LCD 22 is 5c.
m. However, in the case of a large screen, the numerical value of the distance L between them may be 7 to 8 cm.

In order to enable the above arrangement, the image input / output device has a display control unit.
Is written in the bitmap memory so that the image from the other party is displayed near the.

In such a configuration, by reducing the size of the image pickup device, the set position of the image pickup device, which has conventionally been difficult to attach to a free position, can be freely changed. Can be arranged very close to the image display area of the other party (transmission destination). Also,
By miniaturizing the small camera 21 serving as the image pickup device, the small camera 21 can be arranged on the screen / LCD 22 in a simple manner, and further, does not disturb the user and discomfort.

That is, the small camera 21 which is an image pickup device is arranged very close to the image display area, and the distance L from the center of the display screen can be arranged within 5 cm. The angle between the line of sight displayed on the screen of the user of the other party (destination) and the line of sight taken by the imaging device of the other party (destination) and the own (source) is the user M
Is less than 7.5 degrees when 50 cm away from the screen / LCD.

The user M enters the screen / LCD 22
50 cm away from the camera, the angle between the line of sight of the user M and the center of reading by the small camera 21 is 7.5 degrees or less, so that both lines of sight almost match, and the other party (destination) and the self (source) ) Can be felt as if they are talking face-to-face.

As described above, according to the first embodiment,
Videophone and video conferencing, where you can feel as if you (sender) and you (sender) are talking face-to-face without the need for conventional large-scale equipment or special devices, and at extremely low cost. The system can configure video messages.

It is to be noted that each configuration of the first embodiment of the present invention can of course be variously modified and changed.

Next, a second embodiment of the present invention will be described.

In the embodiments described below, the same portions will be denoted by the same reference numerals and description thereof will be omitted.

FIG. 2 is a diagram showing a configuration example of the second embodiment of the present invention.

In FIGS. 2A and 2B, the housing 20
A mounting device 24 is provided at a predetermined position, for example, above the screen / LCD 22. Then, the small camera 21 is attached from the attachment tool 24 via the support rod 25.

In this example, the support bar 25 has a constricted shape as shown in FIG. 2A or a broken line shape as shown in FIG. 2B in order to maintain strength.
Cylindrical or screen / LCD to maintain strength
A shape that is collapsed in the plane of 22 is desirable. Further, the mounting device 24 may be configured as a pivot so that the small camera 21 can jump up to the housing 20.

The size of the small camera 21 is, for example, not more than 1 cm in diameter and not more than 2 cm in height, preferably not more than 5 mm in diameter and not more than 7 mm in height. The miniature camera 21 requires a lens group for focusing and an image sensor as a minimum function. In addition, it is possible to have an automatic exposure, an automatic focus, a zoom function, and a swing function.

As described above, since the small camera 21 is used, even if the small camera 21 is arranged on the screen / LCD 22, there is no great discomfort. For this reason, the small camera 21 is connected to the housing 24 via the support bar 25.

In the second embodiment, the screen / LC
Even if the display window is set at the center of D22, the imaging device (small camera 21) can be arranged very close to the image display area by the support rod 25 and the distance can be arranged within 5 cm. The angle between the line of sight of the user (source) and the user of the other party (destination) displayed on the screen and the line of sight of the imaging device of the other party (destination) and the own (source) is The user selects the screen / LCD 22-5
When the distance is 0 cm, the angle is 7.5 degrees or less.

According to the second embodiment, the other party (destination) and the self (source) can talk directly from each other without any conventional large-scale device or special device and at extremely low cost. It is possible to compose a video phone, a video conferencing system, and a video message that can feel as if they are doing.

It is to be noted that each configuration in the second embodiment can of course be variously modified and changed.

Next, a third embodiment of the present invention will be described.

FIG. 3A is a front view of an image input / output device according to the third embodiment, and FIG. 3B is a sectional view of the device.

The small camera 21 is not the housing 20 but
It is arranged at a predetermined value on the surface of the screen / LCD 22.
Since the small camera 21 is small, a screen / LCD
Even if it is arranged on the surface of No. 22, there is no great discomfort. For this reason, the small camera 21 is bonded directly to the surface of the screen / LCD 22 using an adhesive or a detachable method.
Desirably, it is detachably adhered.

In this case, the small camera 21 and the screen /
Adhesion with the LCD 22 may use static electricity, use a soft adhesive, use a double-sided tape, or use a suction cup. When the small camera 21 is provided at the corner of the screen / LCD 22, it may be fixed and attached with an adhesive.

Since this small camera 21 is composed of only a lens and an image pickup chip, it is extremely lightweight, and this method has become possible.

In such a configuration, the screen / L
Even if the display window 23 is set in the center of the CD 22, the small camera 21 can be arranged very close to the image display area, and the distance L can be set within 5 cm. Therefore, in this image input / output device, the line of sight of the user (sender) and the other party (destination) displayed on the screen and the small camera 21 of the other party (destination) and the own (sender) are displayed. The angle with the line of sight taken is less than 7.5 degrees when the user is 50 cm away from the screen / LCD 22.

As described above, according to the third embodiment,
Videophone and video conferencing, where you can feel as if you (sender) and you (sender) are talking face-to-face without the need for conventional large-scale equipment or special devices, and at extremely low cost. System and video messages can be configured.

It should be noted that each configuration of the third embodiment can of course be variously modified and changed.

Next, a fourth embodiment of the present invention will be described.

FIG. 4A is a front view of an image input / output device according to a fourth embodiment, and FIG. 4B is a sectional view of the device.

In FIG. 4, a transparent sheet 27 is arranged on the front of the screen / LCD 22, and a small camera 21 is arranged on the transparent sheet 27. Small camera 2
Even if 1 is arranged on the surface of the screen / LCD 22, there is no great discomfort. For this purpose, the miniature camera 21 is glued directly onto the transparent sheet 27 on the screen / LCD 22 using an adhesive or a detachable method. In this case, the small camera 21 can be removed without damaging the screen / LCD 22 by removing the transparent sheet 27 even if it is attached with an adhesive.

In the fourth embodiment, even if the display window 23 is set at the center of the screen / LCD 22, the small camera 21 can be arranged very close to the image display area, and the distance L is set to be small. It can be placed within 5 cm. Therefore, the angle between the line of sight of the user of this apparatus (the transmission source) and the line of sight of the user of the other party (the destination) and the line of sight of the imaging device of the other party (the destination) and the imaging apparatus of the user (the source) are The user changes the screen / LCD 22-5
When the distance is 0 cm, the angle is 7.5 degrees or less.

As a result, it is possible to feel that the other party (destination) and the self (source) are talking directly from each other without any conventional large-scale device or special device and at extremely low cost. Can configure video calls, video conferencing systems, video messages that can.

It is to be noted that each configuration of the fourth embodiment of the present invention can of course be variously modified and changed.

Next, a fifth embodiment of the present invention will be described.

FIG. 5 is a front view of the image input / output device according to the fifth embodiment.

In FIG. 5, the small camera 21 is set so as to be freely movable on the screen / LCD 22 within its plane. For example, when the display window 23 moves to the position 23 ', the small camera 21 can also move to the position 21'.

The small camera 21 has a screen / LCD 2
Even if it is arranged on the surface of No. 2, there is no great discomfort. Also, since it is very small, it is extremely lightweight. For this reason,
Screen / LCD2 with low energy and simple method
2 can be moved on the surface.

In the fifth embodiment, the screen / LC
No matter where the display window 23 set in D22 is,
The small camera 21 is moved on the screen / LCD 22 surface. Thus, the small camera 21 can be arranged very close to the image display area, and the distance can be arranged within 5 cm.

Regardless of the position of the display window 23 or the position of the user, the small camera 21 moves on the screen / LCD 22 so that the imaging device is located very close to the image display area. And set the distance L to 5
cm. Further, even if the plurality of display windows are located at a plurality of different positions, the small camera 21 can be moved in the plane with the other party (destination) whose eyes are to be matched, so that the image pickup can be performed very close to the image display area. The device can be arranged such that its distance L is within 5 cm.

That is, in any case, the line of sight on the screen of the user of the present apparatus (the transmission source) and the user of the other party (the transmission destination), and the imaging of the other party (the transmission destination) and the self (the transmission source) The angle between the device and the line of sight taken by the
When it is 50 cm away from the CD 22, the angle is 7.5 degrees or less.

The advantage is that no matter how you use your videophone, videoconferencing system, video message or computer, or if you are interacting with more than one person (destination), you will have a very low cost It is possible to configure a video phone, a video conference system, and a video message in which it is possible to feel as if the (destination) and oneself (the source) are talking face-to-face.

Incidentally, each configuration of the fifth embodiment can of course be variously modified and changed.

Next, a sixth embodiment of the present invention will be described.

FIGS. 6A and 6B are front views showing a configuration example of the sixth embodiment.

Since the miniature camera 21 is very small, there is no great discomfort even if it is arranged on the surface of the screen / LCD 22. In addition, since the weight is extremely light, the upper surface of the screen / LCD 22 can be moved by a simple method.

In the sixth embodiment, a small camera 21 is supported by a support rod extending from a casing 20 which is an outer frame.
Is moved. When the small camera 21 is moved two-dimensionally, the movement in the first direction, in this case, the horizontal direction is performed by a linear actuator using a motor or the like attached to the housing 20, and the second direction, in this case, The vertical movement is performed by the linear actuator of the support rod.

The image input / output device shown in FIG.
A support rod 25 to which a small camera 21 is attached is movably provided on a guide section 28 formed in the housing 20 above the screen / LCD 22. In this case, the support bar 25 itself expands and contracts, and the screen /
It moves freely on the LCD 22 surface.

In the apparatus shown in FIG. 6B, the length of the support bar 25 is constant, and the small camera 21 attached to the support bar 25 moves.

Note that only one of these functions may be used. For example, the support bar 25 may be formed of a bar that can be freely bent, and its position may be set.

In such a configuration, the screen / L
Regardless of the position of the display window 23 set on the CD 22, the small camera 21 is moved in the plane by using the guide portion 28 and the support rod 25, so that the small camera 21 is located very close to the image display area. And set the distance L to 5
cm. Even if the display window 23 is moved to any position on the screen / LCD 22 or the user moves it, the small camera 21 is moved in the plane, so that the small camera 21 is very close to the image display area.
And the distance L can be made within 5 cm.

Further, even when the plurality of display windows 23 are located at a plurality of different positions, the other party (transmission destination) whose view is to be matched, that is, the display window 23 and the small camera 21 are connected to the screen / LCD.
Since it is moved in the plane of 22, the distance L between the display window 23 and the small camera 21 can be arranged within 5 cm.

That is, in any case, the line of sight on the screen where the user of the present apparatus (the transmission source) and the other party (the destination) is displayed, and the small size of the other party (the transmission destination) and the self (the transmission source) The angle with the line of sight taken by the camera 21 is 7.5 degrees or less when the user is 50 cm away from the screen / LCD 22.

As described above, according to the sixth embodiment,
Whether you are using a videophone, videoconferencing system, video message or computer, or interacting with more than one person (destination), you can communicate with yourself (the destination) at very low cost. A video phone, a video conferencing system, and a video message can be configured so that the sender can feel as if they are talking face-to-face.

Incidentally, each configuration of the sixth embodiment can of course be variously modified and changed.

Next, a seventh embodiment of the present invention will be described.

FIG. 7A is a front view of an image input / output device according to a seventh embodiment, and FIG. 7B is a sectional view of the device.

In FIG. 7, a transparent sheet 27 is arranged on the front of the screen / LCD 22, and a small camera 21 is arranged on the transparent sheet 27. Since the miniature camera 21 is very small, there is no great discomfort even if it is arranged on the surface of the screen / LCD 22.

In the seventh embodiment, the small camera 21 can be moved on the screen / LCD 22 by a simple method. The small camera 21
It is directly adhered on the transparent sheet 27 on the screen / LCD 22. The transparent sheet 27 is movable in two orthogonal directions by an actuator 29 attached to the surrounding housing 20. By moving the transparent sheet 27, the small camera 21 can be substantially moved.
Moves in a plane on the screen / LCD 22.

Although the transparent sheet 27 is used here, a transparent plate may be used. In the case of a transparent sheet, rollers are provided on the left and right or up and down, and the roll is moved by winding. In the case of a transparent plate, a thin wire may be used,
A transparent fishing line may be used. However, in this case, a guide is required to maintain the level.

In such a configuration, the screen / L
Regardless of the position of the display window 23 set on the CD 22, the transparent sheet 27 is moved in a desired direction to move the small camera 21 in the plane. As a result, the small camera 21 is arranged very close to the image display area, and the display window 23
Can be arranged within 5 cm.

Also, no matter where the display window 23 is moved or the user moves it, the small camera 21 is moved in the plane, so that the small camera 21 is arranged very close to the image display area. Thus, the distance L can be arranged within 5 cm.

Further, even if the plurality of display windows 23 are located at a plurality of different positions, the small camera 21 and the partner (transmission destination) whose eyes are to be matched can be moved in the plane. It is possible to arrange the small camera 21 very close and set the distance L within 5 cm.

That is, in any case, the line of sight on the screen of the user of the present apparatus (the sender (source)) and the user of the other party (destination) and the small size of the other party (the destination) and the user (the sender) The angle with the line of sight taken by the camera 21 is 7.5 degrees or less when the user is 50 cm away from the screen / LCD 22.

Thus, even if the mobile phone is used like a videophone, a video conference system, a video message, a computer or the like, or is interacting with a plurality of destinations (destinations), the destination (the destination) is extremely low-cost. A video phone, a video conferencing system, and a video message can be configured so that it is possible to feel that the (destination) and oneself (the source) are facing each other from the front.

Incidentally, each configuration of the seventh embodiment can of course be variously modified and changed.

Next, an eighth embodiment of the present invention will be described.

FIG. 8A is a configuration diagram of an image input / output device according to the eighth embodiment, and FIG. 8B is a schematic perspective view showing the same embodiment.

Also in the eighth embodiment, since the small camera 21a is used for the image pickup apparatus, even if it is arranged on the screen / LCD surface, there is no great discomfort. Also, since it is ultra-small and lightweight, it is possible to move the screen / LCD or over it by electrostatic attraction.

In the eighth embodiment, the small camera 21a
Is electrostatically adhered onto a transparent plate or sheet 27 on the screen / LCD surface. A transparent electric conductive thin film 30 is patterned on the transparent plate or sheet 27, and by applying potentials shifted to each other or pulses having different phases to adjacent electrodes of the transparent electric conductive thin film 30, Generating attractive and repulsive forces in two orthogonal directions, the miniature camera 21 moves substantially planarly over the screen / LCD.

Here, it is possible to move in one direction,
The small camera 21 is moved two-dimensionally by using orthogonal stripes. In this case, the small camera 21 is similar to a capacitor, and charges of the opposite polarity to the transparent electroconductive thin film 30 attached to the transparent plate or sheet 27 are stored on the screen / LCD side. A dielectric 31 is formed on the transparent sheet 27 so as to cover the transparent electrically conductive thin film 30.

On the other hand, a charge layer 34 is disposed on the bottom of the small camera 21 so as to face the transparent electrically conductive thin film 30 with the dielectric 31 interposed therebetween. The small camera 21 has a configuration in which a camera unit 32 and a driving unit 33 for driving the camera unit 32 are provided on the charge layer 34.

In the case of a stripe, the small camera 21 can move only in a direction perpendicular to the stripe.

FIG. 8B shows an example of the configuration of the present embodiment, in which the pattern of the transparent electrically conductive thin film 30 has a mesh shape on the screen. On the other hand, the small camera 21a
Four or more charge layers 34 are provided therein, and when potentials shifted from each other or pulses with different phases are applied to adjacent electrodes (charge layers 34), attractive forces are applied in two orthogonal directions. And a repulsive force is generated. Thereby, the small camera 21 moves substantially in a plane on the surface of the screen / LCD 22.

In such a configuration, the screen / L
Regardless of the position of the display window 23 set on the CD 22, the small camera 21a is moved in the plane,
The small camera 21a can be arranged very close to the image display area, and the distance L can be arranged within 5 cm.

No matter where the display window 23 is moved,
Alternatively, even if the user moves, the small camera 21a is moved in the plane, so that the camera can be arranged very close to the image display area and the distance L can be arranged within 5 cm.

Further, even if a plurality of display windows are located at a plurality of different positions, the small camera 21a is moved in the plane with the other party (transmission destination) whose sight line is to be matched, so that the small-sized camera 21a is very close to the image display area. The camera 21a is arranged, and the distance L is set to 5
cm.

That is, in any case, the line of sight of the user of the present apparatus (the sender) and the other party (destination) on the displayed screen, and the imaging of the other party (the destination) and himself (the sender) The angle between the device and the line of sight taken by the
When it is 50 cm away from the CD 22, the angle is 7.5 degrees or less.

Thus, no matter how the videophone, videoconferencing system, video message, or computer is used, or if the user is interacting with a plurality of destinations (destinations), the destinations (the destinations) are extremely low-cost. A video phone, a video conferencing system, and a video message can be configured so that it is possible to feel that the (destination) and oneself (the source) are facing each other from the front.

Incidentally, each configuration of the eighth embodiment of the present invention can of course be variously modified and changed.

Next, a ninth embodiment of the present invention will be described.

FIG. 9 is a diagram showing a configuration example of the ninth embodiment.

As described above, since the imaging device is a small camera, there is no great discomfort even if it is arranged on the screen / LCD 22 surface. Also, because it is small and lightweight,
It is possible to move on the screen / LCD 22 or the transparent plate or sheet 27 thereon by magnetic force.

In the ninth embodiment, the small camera 2
1b is magnetically adhered on a transparent plate or a transparent sheet 27 on the screen / LCD 22. The transparent sheet 27 is patterned with a transparent magnetic thin film 37, and a protective film 39 is formed so as to cover them. In the transparent magnetic thin film 37, a coercive force M whose phases are shifted from each other is magnetized by adjacent electrodes in advance. Next, a current whose phase is shifted is applied to two or more electromagnets 38 incorporated in the small camera 21b, and an attractive force and a repulsive force are generated in two orthogonal directions. Thereby, the small camera 21b substantially becomes the screen / L
It moves on the CD 22 in a plane.

In such a configuration, the screen /
Regardless of the position of the display window 23 set on the LCD 22, by moving the small camera 21 b in the plane,
The camera can be arranged very close to the image display area, and the distance L can be arranged within 5 cm.

Also, no matter where the display window 23 is moved or the user moves it, the small camera 21b moves in the plane. Therefore, the small camera 21b is arranged very close to the image display area. Thus, the distance L can be arranged within 5 cm.

Further, even if the plurality of display windows are located at a plurality of different positions, the small camera 21b is moved in the plane with the partner (transmission destination) whose sight line is to be matched, so that the camera is located very close to the image display area. And the distance L can be arranged within 5 cm.

That is, in any case, the line of sight of the user of the present apparatus (the transmission source) and the other party (the transmission destination) on the displayed screen, and the imaging of the other party (the transmission destination) and the self (the transmission source) The angle between the device and the line of sight taken by the
At a distance of 50 cm from the CD, the angle is 7.5 degrees or less.

Thus, no matter how the videophone, videoconferencing system, video message, or computer is used, or if the user is interacting with a plurality of destinations (destinations), the destination (the destination) can be extremely low in cost. It is possible to configure a video phone, a video conference system, and a video message in which it is possible to feel as if the (destination) and oneself (the source) are talking face-to-face.

Incidentally, each configuration of the ninth embodiment of the present invention can of course be variously modified and changed.

Next, a tenth embodiment of the present invention will be described.

FIG. 10 is a diagram showing a configuration of a small camera according to the tenth embodiment.

In order to achieve line-of-sight matching, the camera used must be a small camera. Heretofore, downsizing the camera has sometimes resulted in an increase in cost or a remarkably poor function. Conversely, adding a zoom function and a tilt (swinging) function increased the size and cost. This is because the mechanical movement of one or a plurality of lenses and the swing function about the central axis of the one or a plurality of lenses required the use of a motor, a gear, a cam, and the like in many cases.

The camera according to the tenth embodiment comprises:
As shown in FIG. 10, the imaging device 35 and the lens group 36
It is composed only of the above, and can be made very small.

The small camera 21c has a structure in which a glass 42 is provided on the surface of a light receiving area 41 on an image sensor 35 such as an area sensor, and a package 43 is formed around the glass 42. A signal line 44 and a power supply line 45 are provided outside. The mounting of various functions on the image sensor 35 will be described later.

FIG. 11A is a conceptual diagram of a moving image or a still image picked up by the small camera 21c on the user side (source). In the figure, 47 is an imaging area, 48
Is each pixel (pixel), and each pixel is given a number which is its address. Here, (n, m) means n rows and m columns.

As described above, FIG. 11A shows an arrangement of element pixels of the small camera 21c of the user (source). This number is, for example, 512 × 512.
It is. By combining this with a lens having a relatively wide angle of view, it is possible to capture a considerable angle of view.

However, when communicating with the other party (transmission destination), some of the pixels are used. FIG. 11B is a conceptual diagram of an image sensor showing an example in which some of the pixels are thinned out over the entire surface. That is, the sending screen is (1,
1), (1, 5),... Are composed of thinned pixels 49. This is equivalent to using a wide-angle lens.

FIG. 11C is a conceptual diagram of an image pickup device showing an example in which only a certain range of the image pickup area 47 is transmitted. When only the center of the pixel 50 is used, the telephoto function is obtained, and when the pixel 50 is moved to the periphery, the function of swinging is obtained.

In such a configuration, FIG.
It is possible to capture a considerable angle of view with the element of the small camera of the user (source) shown in FIG. However, when communicating with the other party (destination), some of the pixels are used, so that the zoom function and the camera swing function can be substantially electrically configured.

As a result, it is possible to realize a camera that does not require a mechanical zoom function and a swing function. In addition, this makes it possible to supply a high-performance small camera at low cost. Further, since the camera is very small, there is no sense of discomfort even if the camera is placed on the screen. Therefore, gaze matching is realized,
It is possible to configure a videophone, a video conference system, and a video message in which it is possible to feel that the other party (destination) and oneself (source) are talking face-to-face at extremely low cost.

Incidentally, each configuration of the tenth embodiment of the present invention can of course be variously modified and changed.

Next, an eleventh embodiment of the present invention will be described.

As described above, in order to realize eye-gaze matching, the camera to be used must be a small camera.
Conventionally, adding a zoom function and a tilt (swinging) function has increased the size. However, in the eleventh embodiment, since the zoom function and the swing function are performed electronically, the camera body is constituted only by the image pickup device and the lens group, so that the structure can be made very small.

FIG. 12A is a conceptual diagram showing a method of capturing a moving image or a still image captured by the small camera 21 on the transmitting side. In the small camera 21 including the imaging element 35 and the lens group 36, the lens group 36 is set to a relatively wide angle side.

FIG. 12B shows an area 47 imaged by the small camera 21 of FIG. The screen on the sending side is captured in a wide range.

FIGS. 12C to 12E show images to be transmitted. FIG. 12C illustrates an example of an image in which the screen of the area 47 is roughly captured by the pixel thinning operation. FIG. 12D is an example showing an image in which only the central area 50 of the area 47 in FIG. 12B has been sent.
This is a zoom function. FIG. 12E shows an example of an image in which only the periphery of the area 51 shown in FIG. 12B is sent, and shows the functions of swinging and zooming.

Here, the number of pixels of the image sensor of the transmitting camera is determined to be 512 × 512 or 102
It is desirable to be about 4 × 1024, and considering the communication cost and considering moving image transmission, the number of transmission pixels is 128 × 1
It is considered to be about 28 to 256 × 256. For this reason,
Pixel reduction or thinning ratio is 1/4 to 1/16
Is desirable.

For example, assuming that the ratio of pixel reduction or thinning is 1/16, the zoom function corresponds to 4 times and the swing function corresponds to 4 times the angle of view. This is enough for normal video-video conferencing systems and video messages. This is because, in the case of a TV video conferencing system or a video message, the position and direction of the camera are substantially fixed, and the position of the user is also substantially constant. In addition, even when two or three persons perform the operation, it is possible to capture most of the angle of view with a wide-angle lens.

In such a configuration, if the ratio of reduction or thinning of the pixels to be transmitted is set to 1/4 or less based on the number of pixels of the image sensor 35 of the transmission source, the self (transmission source) shown in FIG. The element of the small camera 21) makes it possible to capture a considerable angle of view. In addition, when communicating with the other party (destination), since some of the pixels are used, the zoom function and the camera swing function can be substantially electrically configured, and the communication cost is greatly reduced. It can be realized at present.

As a result, a mechanical zoom function and a swing function are not required, and an electronic camera having the same zoom function and swing function can be realized. As a result, a high-performance compact camera can be supplied at low cost.

Since the camera is very small, there is no uncomfortable feeling even when the camera is placed on the screen. Therefore, gaze matching is realized,
It is possible to configure a videophone, a video conference system, and a video message in which the other party (destination) and oneself (source) can feel as if they are talking face-to-face at extremely low cost.

Incidentally, each configuration of the eleventh embodiment of the present invention can of course be variously modified and changed.

Next, a twelfth embodiment of the present invention will be described.

FIGS. 13A and 13B show the configuration of the twelfth embodiment. FIG. 13A shows the configuration of the entire image input / output device, and FIG. 13B shows the block configuration of a control system. .

The image input / output device includes a computer device 55 having a small input camera 21 for realizing eye-gaze matching, a display window 23, and the like, and a television (TV) device 56.
, A video telephone device 57 and the like, and these devices are connected via a communication function device 60 to a telephone line 61, INS,
High-speed data line 62 such as ISDN 64, a local area network (Local area network)
k; LAN) 63, global area network (G
global area network (GAN) 64
Connected to.

Here, the normal analog telephone line 61 is 2
8.8 kbit per sec, INS (ISDN6
4) In 62, it is 128 kbit per sec.
In a corporate LAN, 10 Mbits per second is standard.

The control system includes the image pickup device 35 of each device.
Is sent to the communication function unit 60 via the pixel number thinning block unit 66 and the image compression unit 67, and is supplied to the above-mentioned communication line, and the control signal reading unit 6
8 The system controller 70 controls the operations of the image sensor 35, the pixel number thinning block unit 66, the image compression device 67, and the control signal reading unit 68.

This communication requires a transfer rate of 163 KB / sec when transmitting 128 × 128 pixels, for example, at 8 bits, in consideration of moving picture transmission at 10 frames / sec.
For this reason, the image compression device 67 uses 1/30 to 1/40
Compress below. That is, 20Kb / sec to 100K
b / sec.

Next, the operation of the twelfth embodiment will be described.

According to an instruction from the system controller 70,
The process of reducing or thinning out the pixels to be transmitted based on the number of pixels of the image sensor 35 of the transmission source is processed by the pixel number thinning block unit 66. At the same time, by using standard means such as MPEG or MPEG2, or using a more advanced image compression technique, the communication rate is set to about 20 Kb / sec by the image compression device 67 and can be transmitted from the communication function device 60. Become.

While substantially realizing the zoom function and the camera swing function, the conventional telephone lines 61 and I
By using the NS 62 and the in-house LAN 63, the cost of communication can be greatly reduced, and the communication can be realized with the current communication infrastructure.

Therefore, the telephone line 61, the INS 62,
Using the corporate LAN 63, communication costs are greatly reduced,
Further, it is possible to realize a camera having an electronic zoom function and a swing function provided with communication means that can be realized with the current communication infrastructure. As a result, a high-performance compact camera can be supplied at low cost.

Further, since the camera is very small, there is no sense of incongruity even if the camera is placed on the screen. Therefore, eye-gaze matching is realized, and a videophone, videoconferencing system, and video message can be made at a very low cost so that the other party (destination) and oneself (source) can feel as if they are talking face-to-face. It is possible.

Incidentally, each configuration of the twelfth embodiment is as follows.
Naturally, various modifications and changes are possible.

Next, a thirteenth embodiment of the present invention will be described.

FIG. 14A is a block diagram showing a schematic configuration of the entire image input / output device according to the thirteenth embodiment.

In the figure, an image pickup device 3 driven by a drive circuit 72 of an input camera device for realizing eye-gaze matching.
The output of 5 is supplied to a frame memory 75 having a memory controller 74 via an 8-bit A / D converter 73, for example.
Is stored in The output is converted by a skip / block read unit 76 that performs skip read or block read, and is displayed on the screen / LCD 22 of the own (source) display device via the image memory 77, while the skip / block read unit is used. From 76, it is communicated to another party (transmission destination) via the communication function device 60 having the image compression device 67. The communication function device 6
0, a drive circuit 72, an A / D converter 73, a memory controller 74, a frame memory 75, a skip / block reading unit 76, and an image memory 77 are controlled by a control unit 71.

FIG. 14B shows an example of a configuration for realizing such a function, and is a block diagram of the memory controller 74 and the frame memory 75. As shown in FIG.

The output from the A / D converter 73 enters the memory cell array 79 from the input / output device 82 in byte units.
Here, the address is selected in order from the end by the shift register 80. The memory cell array 67 includes:
The light output information of all the pixels corresponding to the image sensor 35 is stored as, for example, an 8-bit digital signal. The register controller 81 is used for causing the skip / block reading section 76 to perform skip reading or block reading at high speed. The shift register 80 has a function of skipping lines to be read in order and skipping, or reading only certain lines at a time.

In such a configuration, the total number of pixels of the transmission source imaging device 35 driven by the driving circuit 72 is A
The pixels stored in the frame memory 75 having the memory controller 74 via the / D converter 73 are thinned out or the range is reduced by the skip / block reading unit 76. By this operation, while substantially realizing the zoom function and the camera swing function electrically, the cost of communication is significantly reduced, and the communication function can be realized with the current communication infrastructure.

As a result, even if a conventional image sensor is used,
It is possible to realize a camera having an electronic zoom function and a swing function, which significantly reduces communication costs and includes communication means that can be realized with the current communication infrastructure. This makes it possible to supply a high-performance small camera at low cost.

Further, since the camera is very small, there is no sense of incongruity even if the camera is placed on the screen. Therefore, gaze coincidence is realized, and at a very low cost, the other party (destination) and the self (source) can feel as if they are facing each other from front,
Video messages are configurable.

Incidentally, each configuration of the thirteenth embodiment of the present invention can of course be variously modified and changed.

Next, a fourteenth embodiment of the present invention will be described.

FIG. 15 is a diagram showing an example of the configuration of a small camera for explaining the focus matching method.

FIG. 15A shows a configuration example in the case of a fixed focus. This small camera 21c comprises an image pickup device 35, a light receiving area 41, a glass 42, a package 43, and a lens group 3.
6. The small camera 21c is designed to increase the depth of focus. That is, the aperture is stopped down to increase the depth of focus. It is desirable that the distance between the lens group 36 and the image sensor 35 is also small. Further, an infrared or ultraviolet filter may be provided, but in order to eliminate the filter, the light receiving area 41 of the image sensor 35 may be modified.

FIG. 15B shows the configuration of a small camera 21 d using a focusing ring 84 around the lens group 36.

FIG. 15C shows a configuration example of a small camera 21d in which an actuator 85 using a coil for focusing and a permanent magnet is arranged around the lens group 36.

FIG. 15D shows an example of the configuration of a small camera in which an automatic focus control function comprising a translucent mirror 86a, a focus sensor 86b and an actuator control circuit 86c is added to the configuration of FIG. Is shown. The actuator 85 moves the lens back and forth, up and down, left and right,
You can change your posture.

In such a configuration, the focus of the imaging camera of the transmission source is matched. As a result, while electronically achieving the zooming function and the camera-swinging function electrically, the cost of communication can be significantly reduced and the present communication infrastructure can be used.

Therefore, a small electronic zoom function,
A camera having a swing function can be realized. As a result, a high-performance compact camera can be supplied at low cost.

Further, since the camera is very small, there is no uncomfortable feeling even when the camera is placed on the screen. Therefore, eye-gaze matching is realized, and a videophone, videoconferencing system, and video message can be made at a very low cost so that the other party (destination) and oneself (source) can feel as if they are talking face-to-face. can do.

Incidentally, each configuration of the fourteenth embodiment of the present invention can of course be variously modified and changed.

Next, a fifteenth embodiment of the present invention will be described.

The fifteenth embodiment relates to a camera exposure method.

It is necessary to avoid the mechanical structure of a small camera as much as possible. For this reason, an electric shutter is used. The shutter is performed by a charge reset switch provided in each pixel or a combination of a read charge storage capacitor and its transfer switch.

FIG. 16A is a diagram showing a first configuration example. This small camera has a photodiode 88
And a reading capacitor 89, a shutter switch 90 is added. Further, a selection circuit 91 in the row (horizontal) direction and a selection circuit 92 in the column (vertical) direction are further provided so that an output from the amplifier 93 can be obtained.

FIG. 16B is a diagram showing a second configuration example of a small camera using an electric shutter. This camera includes a photodiode 88 and a reset switch 94 for electric charge provided for each pixel, a shutter switch 90 added between a read capacitor 89, a row (horizontal) direction selection circuit 91, and a column ( A vertical (direction) selection circuit 92 and an amplifier 93 are provided.

FIG. 16C is a diagram showing a third configuration example of a small camera using an electric shutter. This camera includes a photodiode 88, a reading capacitor 89 provided for each pixel, and a charge reset switch 9.
4, reading capacitor 89 and photodiode 8
8, a shutter switch 90 is arranged, and a row (horizontal) direction selection circuit 91 and a column (vertical) direction selection circuit 9 are arranged.
2 and an amplifier 93.

FIG. 16D shows a fourth configuration example of a small camera using an electric shutter, and is a diagram showing a configuration example of an exposure signal processing circuit for determining the accumulation time. The output of the image sensor 35 is used as a video output, and is supplied to an integration circuit 96 via an attenuator 95. The integration value is supplied to a lookup table 9 via an A / D converter 97.
8 is fed back to the image sensor 35.

FIG. 16E shows a fifth configuration example of a small camera using an electric shutter, and is a diagram showing a configuration example of an exposure signal processing circuit for determining an accumulation time. In this case, the integrated value obtained by the integration circuit 96 is compared with the reference value of the reference unit 99 by the comparator 100, and
The result is fed back to the image sensor via the timing generator 101.

As described above, if the exposure correction of the image sensor 35 of the small camera of the transmission source is electronically performed, no extra mechanical parts are required and the image sensor 35 can be integrated in the image sensor 35, so that it is very compact. Become. While electronically realizing the functions of exposure and zoom and the function of swinging the camera electronically, the cost of communication can be greatly reduced, and it can be realized with the current communication infrastructure.

Thus, a camera having a small electronic exposure function, a zoom function, and a swing function can be realized. This makes it possible to supply a high-performance small camera at low cost.

Further, since the camera is very small, there is no uncomfortable feeling even when the camera is placed on the screen. Therefore, gaze matching is realized, and a video phone, a video conference system, and a video message can be used at a very low cost, in which the other party (destination) and the self (source) can feel as if they are talking face-to-face. Can be configured.

Incidentally, each configuration of the fifteenth embodiment of the present invention can of course be variously modified and changed.

Next, a sixteenth embodiment of the present invention will be described with reference to FIGS. The sixteenth embodiment relates to the structure and configuration of the image sensor, and is closely related to the most important skip reading and block reading.

In this small camera, it is necessary to avoid a mechanical system as much as possible, so that it is necessary to adopt a specific reading system that is suitable for the characteristics of the image sensor.

FIG. 17A shows a charge transfer device (CCD)
FIG. 3 is a diagram showing the configuration of FIG. Photodiode 8 for each pixel
8 is characterized by having a transfer element 104. Therefore, an electric shutter is used. The shutter includes a photodiode 88 of each pixel and a reset switch 94 of electric charge provided between the transfer elements 104.

FIG. 17B is a diagram showing the configuration of the simplest random-access pixel image pickup device.
The random access driving method is very convenient in this embodiment because skip reading and block reading can be performed by adding circuits to peripheral shift registers in the row (horizontal) direction and the column (vertical) direction.

That is, each pixel has a photodiode 88 as a light receiving element and a selection element 91, and each column (vertical) has a selection circuit 92. The shift register 105 and the light receiving element 88 in the row (horizontal) direction are provided with a normal pn.
It is preferable that the selection element 92 be a type photodiode and a normal MOS type FET, and the selection circuit 92 in each column (vertical) be a vertical scanning circuit.

FIG. 18A shows a CMD (Charge Modula) which can be randomly accessed with the simplest element.
FIG. 2 is a diagram illustrating a configuration of a T.D. device (charge modulation element).

The CMD can be configured by one element for reset, amplification, and row (horizontal) selection, can be integrated at low cost, can be randomly accessed, and can perform skip reading and block reading. This embodiment is extremely convenient. In the figure, shift register 1
05 is connected to the gate 106 of the CMD.
06 is connected to the Y selection circuit 92y.

FIG. 18B shows the CMD10 of FIG.
6 is a sectional view showing the structure of FIG.

An N-channel layer 108 is formed on a P-type substrate 107, and a drain 109 and a source 111 are formed on the surface thereof.
Is formed. Then, a gate 110 is formed between the drain 109 and the source 111 on the N-channel layer 108.

Selection and reset are performed by the gate 110,
Photocharges are accumulated immediately below the gate 110. At the time of selection, the source 111 and the drain 10
9 is modulated to generate an amplified signal.

FIG. 18C is a configuration diagram of the simplest randomly accessible pixel and its peripheral portion.

In the random access driving method, circuits are added to the peripheral shift registers in the row (horizontal) direction and the column (vertical) direction, and skip reading and block reading are possible. Is good.

Each pixel has a photodiode 88 and a MOS-type selection element 90. Each column (vertical) has a selection circuit 92.
y.

FIG. 18D is a configuration diagram of the simplest randomly accessible pixel having a reset function and its peripheral portion.

In the random access driving method, a circuit is added to the peripheral shift register in the row (horizontal) direction and the column (vertical) direction to enable skip reading and block reading. Therefore, this embodiment is extremely convenient. good.

Each pixel has a photodiode 88, a MOS type selection element 90 and a reset element 94, and each column (vertical).
Has a Y selection circuit 92y. In this type of imaging device, the electric charge accumulated in the parasitic capacitance of the photodiode 88 at the time of reading is reset, but a time difference occurs between the devices. Therefore, when the reset element 94 is added, higher performance can be achieved.

FIG. 18 (e) is a diagram showing the configuration of the simplest randomly accessible pixel having a shutter function and a reset function and its peripheral portion.

In the random access driving method, a circuit is added to the peripheral shift register in the row (horizontal) and column (vertical) directions to enable skip reading and block reading. Therefore, this embodiment is extremely convenient. good.

Each pixel is provided with a photodiode 88 and a MOS.
Type selection element 91, reset element 90, shutter element 90
And each column (vertical) has a Y selection circuit 92y. The read capacitance of the read capacitor 89 is reset in advance by the reset element 94 and the shutter element 90
Is open, the read capacitance is stored in the read capacitor 89. This data is stored in the MOS type selection element 9
It is read out when selected at 1.

FIG. 19A is a configuration diagram of a random access amplification type pixel having a shutter function and a reset function and its peripheral portion.

In the random access driving method, circuits are added to the peripheral shift registers in the row (horizontal) direction and the column (vertical) direction to enable skip reading and block reading, so that this embodiment is extremely convenient. Is good.

Each pixel has a photodiode 88, an amplifying element 114, a MOS type selecting element 91, a reset element 94, and a shutter element 90. Each column (vertical) has a Y selecting circuit 92.
y. The read capacitance of the read capacitor 89 is reset in advance by the reset element 94, and the read capacitance is accumulated in the read capacitor 89 while the shutter of the shutter element 90 is open. This charge is supplied to an amplifying element 114 composed of an amplifying transistor.
And is read out when selected by the MOS type selection element 91 on the horizontal line. Since the amplification type element is basically non-destructive, it must be completely reset.

FIG. 19 (b) shows a fixed pattern noise (FPN; Fixed
FIG. 11 is a configuration diagram when a circuit for reducing Pattern Noise is added.

In the random access driving method, circuits are added to peripheral shift registers in the row (horizontal) direction and the column (vertical) direction to enable skip reading and block reading. Is good. However, there are variations in processing of the area of the light receiving element of each pixel, minute defects of each pixel, and variations between pixels due to processing variations of the amplifying element, which causes a problem of determining a dynamic range as an imaging element. This is likely to limit the downsizing and high functionality of the imaging device.

For this reason, as shown in FIG. 19B, a plurality of switches 115 and 116 and read capacitors 117 and 118 are provided. The reading capacitor 118 is charged, and on the other hand, the photoelectric charge is accumulated in the reading capacitor 117 as a signal capacity, and is read by the differential amplifier 119. By taking this difference, fixed pattern noise can be reduced.

In such a configuration, the electronic shutter, automatic exposure, block reading,
An imaging device that has been skipped is selected. This eliminates the need for extra mechanical parts, greatly reduces the cost of communication while achieving the extremely small electronic exposure and zoom functions and the camera swing function. It can be realized with infrastructure.

Therefore, a camera having a small electronic exposure function, a zoom function, and a swing function can be realized by the above operation. As a result, a high-performance small camera can be supplied at low cost.

Further, since the camera is very small, there is no uncomfortable feeling even when the camera is placed on the screen. Therefore, gaze matching is realized,
It is possible to configure a videophone, a video conference system, and a video message in which the other party (destination) and oneself (source) can feel as if they are talking face-to-face at extremely low cost.

Incidentally, each configuration of the sixteenth embodiment of the present invention can of course be variously modified and changed.

Next, a seventeenth embodiment of the present invention will be described with reference to FIGS. These all show examples relating to skip reading and block reading which form the basis of the present invention.

FIG. 20A is a configuration diagram showing an example using pixels that can be randomly accessed. This pixel has a cell configuration corresponding to FIGS. 17 to 19 of the sixteenth embodiment described above.

This pixel is used for random access.
Lines in each row (horizontal) direction and column (vertical) direction are controlled completely independently. In a charge transfer device (CCD), this method is not so easy because all pixels arranged in a row (horizontal) direction and a column (vertical) direction are sequentially output.
However, by using randomly accessible pixels,
This can be easily achieved at low cost.

Row (horizontal) scanning circuit 1 in each row (horizontal) direction
05 and a row (horizontal) scanning control circuit 122 form a pair, and a column (vertical) scanning circuit 123 and a column (vertical) scanning circuit control 124 also form a pair in each column (vertical) direction. Row (horizontal)
The scanning control circuit 122 selects a scanning method of the row (horizontal) scanning circuit 105 according to a necessary function, and controls each line 12.
5 is directly controlled. In the column (vertical) direction, control is similarly performed for each line 126. Therefore, processing can be performed in real time. still,
127 is a unit pixel including a photodiode.

FIG. 20B shows another column of the scanning control circuit.

The scanning circuit 105 has a control circuit 122 and a position recording circuit 128. This position recording circuit 128
Is the first or last position currently being scanned,
Alternatively, information on all positions to be scanned is included. If the position information is recorded, the start position and the stop position are set, and scanning can be performed only during this period. That is, once the position recording circuit 128 records, the scanning range is determined only within the image sensor, so that an output signal is output and the load on the control device is reduced.

Thus, a high-speed and low-cost system is provided. Although the circuit to be used is not particularly specified, usually a CMOS
The position of the line is recorded by a latch circuit or a flip-flop circuit formed by a pair of inverters.

FIG. 21A is a timing chart showing an example of the skip read operation.

In the figure, times t _{1 to} t ₈ indicate time in units of a certain clock. X1 to X5 are:
This shows a pulse train in the row (horizontal) direction or column (vertical) direction.

Here, in the 1/2 skip method, X1, X
In the order of 3, X5, a drive pulse is applied with the same clock at a rate of one out of two, and read out at a rate of one out of two. In the 1/4 skip method, one of four lines X1 and X5 is selected, a driving pulse is applied with the same clock, and one out of four lines is read out.

The circuit to be used is not specified, but usually
This function is realized by changing the combination of the inversion by the MOS inverter and the latch circuit or the flip-flop circuit by the pair, and changing the number of the inverters and the latches. Since it can be processed at the same timing, even if the skip ratio is constant, the same frame transfer rate and
You may output with a different clock.

FIG. 21B is a timing chart showing an example of a block read operation.

In the figure, times t ₁ to t ₈ indicate time in units of a certain clock. X1 to X5 are:
This shows a pulse train in the row (horizontal) direction or column (vertical) direction.

Here, START and STOP are timings at which the position recording circuit 128 first records the first and last line positions of block reading. After recording, after the start of reading, no drive signal is output for unnecessary X1 to X2,
X3 to X7 are repeatedly selected and driven according to the clock, and corresponding output signals are obtained. Thereby, block reading is possible.

FIG. 22A is a timing chart showing an example of a block read operation.

Times t _{1 to} t ₈ indicate time in units of a certain clock. X1 to X5 indicate pulse trains in a row (horizontal) direction or a column (vertical) direction.

Here, ACTIVE is the position recording circuit 12 first.
Reference numeral 8 denotes a pulse for recording the first and last line positions of block reading. After recording, after starting reading,
No drive signals are output from the unnecessary X1 to X3, and X6 to X7 are repeatedly selected and driven according to the clock, and corresponding output signals are obtained. Thereby, block reading is possible.

FIG. 22B is a timing chart showing another example of the block read operation.

Times t _{1 to} t ₈ indicate time in units of a certain clock. X1 to X5 indicate pulse trains in a row (horizontal) direction or a column (vertical) direction.

Here, ACTIVE is the position recording circuit 12 first.
Record the first line position of block reading in 8
ACTIVE is a pulse that causes the position recording circuit 128 to first record the last line position of block reading. After the recording, after the start of reading, no drive signal is output for unnecessary X1 to X2, and X3 to X7 are repeatedly selected and driven according to the clock, and a corresponding output signal is obtained. Thereby, block reading is possible.

FIG. 23A is a configuration diagram showing another example of a method of skip reading and block reading when a CCD image pickup device is used.

Since random access is impossible in the case of a CCD, data output by the CCD clock of the CCD clock section 131 is output as serial data of all pixels. For this reason, a skip operation unit 132 and a block operation unit 133 are provided as post-processing, and the output is A / D-converted by an A / D conversion unit 134, and further, the parallel-serial data is output by a parallel-serial conversion unit 135. Are subjected to parallel-serial conversion according to the new clock frequency from the new clock unit 136. In this case, it is important to adjust the timing of the clock.

FIG. 23B is a timing chart showing an example of skip reading and block reading operations when a CCD image pickup device is used.

Since random access is not possible in the case of a CCD, data output by the clock of the CCD as the image sensor 35 is output as serial data of all pixels. Therefore, the skip selection signal and C
An AND of the CD output is obtained to obtain a skip output. Alternatively, as a post-processing, an AND of the block selection signal and the CCD output is obtained to obtain a block output. In this case, since the video signal is output at the clock and timing of the first video signal, it is necessary to reconfigure the clock and timing at the time of transmission or display.

As described above, the electronic shutter, the automatic exposure, the block reading, and the skip reading of the source imaging camera are configured in accordance with the imaging device. The randomly accessible image pickup device is directly built in a peripheral circuit as a control unit of a scanning circuit in a row (horizontal) direction and a column (vertical) direction. In the case of a CCD, it is configured as post-processing of CCD output.

As a result, no extra mechanical parts are required, and a very small electronic exposure and zoom function and a camera swing function are realized electrically, while the communication cost is greatly reduced. It can be realized with the current communication infrastructure.

Therefore, a small electronic exposure function is provided.
A camera having a zoom function and a swing function can be realized. As a result, a high-performance compact camera can be supplied at low cost. Because the camera is very small, there is no discomfort even if the camera is placed on the screen. Therefore, gaze coincidence is realized, and at a very low cost, the other party (destination) and the self (source) can feel as if they are facing each other from front,
Video messages can be composed.

Incidentally, each configuration of the seventeenth embodiment of the present invention can of course be variously modified and changed.

Next, an eighteenth embodiment of the present invention will be described.

FIG. 24 shows the structure of the eighteenth embodiment of the present invention, and is a block diagram in the case of using randomly accessible pixels. This pixel has a cell configuration corresponding to FIGS. 17 to 19 of the sixteenth embodiment described above.

The eighteenth embodiment relates to a reduction in size and cost of an imaging camera of the image input / output device.

This pixel is used for random access.
Lines in each row (horizontal) direction and column (vertical) direction are controlled completely independently. A pair of a row (horizontal) scanning circuit 105 and a row (horizontal) scanning control circuit 122, and a column (vertical) scanning circuit 12
3 and a column (vertical) scanning control circuit 124, a skip reading and a block reading are performed. On-chip A / D conversion circuits 137 are mounted on some of the column (vertical) lines. You. This allows the camera to directly output a parallel or serial digital output.

The on-chip A / D conversion circuit 137
Does not require high speed because one or more of them are mounted on one chip and signal processing can be performed in parallel. Also T
For applications such as V-video conferencing systems and video messages, a relatively low number of quantization bits is sufficient because the quality of the image is determined by the amount of digital data that can be communicated. Therefore, A /
The on-chip implementation of the D conversion circuit 137 is optimal.

Further, in order to cope with the skip reading and the block reading, in addition to the parallel output in accordance with the clock of the clock unit 139, an optimum configuration suitable for the skip reading and the block reading is required.

For example, in skip reading, only the thinned output signal enters the A / D conversion circuit 137. Therefore, the signal is immediately converted and digitally output in that order, and the digital output is temporarily stored in the latch circuit 138. Will be saved. Desirably, after one frame, a digital signal for one frame of the skipped line is output in parallel or serial in accordance with the order specified by the blocking / skipping control system 140.

In the block reading, only the output signal of the necessary column (vertical) direction line enters the A / D conversion circuit 137. Therefore, the signal is immediately converted, and digital output is performed in that order. At 138, it is temporarily stored. Preferably, after one frame, according to the order specified by the blocking / skipping control system 140,
A digital signal for one frame of the designated line is output in parallel or serially.

In such a configuration, the size and cost can be further reduced by incorporating an analog-to-digital converter around the imaging camera capable of reading the source block and skipping. Further, by incorporating a random access image sensor capable of block reading and skip reading and an analog-to-digital converter adapted to block reading and skip reading, a small camera suitable for the purpose of the present proposal can be realized at lower cost. .
In other words, there is no need for extra mechanical parts, and it is extremely compact and low-cost, while electronically realizing the electronic exposure and zooming function and the function of swinging the camera. Communication infrastructure.

Therefore, a small electronic exposure function,
A camera with a zoom function and a swing function can be realized.
As a result, a high-performance compact camera can be supplied at low cost. Because it is so small, there is no discomfort even if the camera is placed on the screen. Therefore, gaze matching is realized, and at a very low cost, the other party (destination) and the self (source) can feel as if they are talking face-to-face in front of each other. Can be configured.

Incidentally, each configuration of the eighteenth embodiment of the present invention can of course be variously modified and changed.

Next, a nineteenth embodiment of the present invention will be described with reference to FIGS.

The nineteenth embodiment relates to the miniaturization, line elimination, and wireless communication of a photographic camera in an image input / output device. An object of the present invention is to construct a video-video conference system and a video message capable of matching eyes by using a small camera. However, higher functionality can be achieved by using wireless communication.

In FIG. 25, the screen / LCD 22
Small camera 2 installed adjacent to display window 23 above
1 is an antenna 143 embedded in the casing 20 of the outer frame.
Perform wireless communication with. In this case, a means for transmitting a signal and a means for supplying power are required.

The signal wireless communication means has a function of wirelessly communicating an analog or digital output of an image with a high frequency or a microwave or a spread spectrum method using the frequency. This is a configuration provided with transmission / reception means for this communication function.

FIG. 26 shows that the most resistant among them and which can be used by a plurality of models and users at the same time.
FIG. 3 is a block diagram illustrating a configuration example using a spread spectrum method.

In FIG. 26A, first, the direct digital output of the image sensor or the digital output after A / D conversion is primary-modulated by the primary modulator 144 using a carrier wave. The primary modulated signal is then converted to a spread code unique to this system by a spread code generator 146 and secondarily modulated by a secondary modulator 145 to form an antenna 14.
7 is transmitted.

On the other hand, the reception side mixes the signal received from the antenna 143 via the RF filter 148 with the spread code of the spread code generator 150 by the mixer 149, as shown in FIG. , And the output is demodulated by the demodulator 153 via the BPF 151. Incidentally, 152 is a synchronous circuit.

In this example, the direct modulation type spread spectrum method is used, but the method is not limited.
Also, a technique for reducing the size of the antenna is required. In consideration of low power, miniaturization, and a communication distance of about 1 m, it is desirable to use a spread spectrum of 1 MHz or more. Furthermore,
Considering low cost, it is desirable to configure a high frequency circuit with a CMOS circuit.

FIG. 27A is a block diagram showing a complete configuration of a small camera according to the nineteenth embodiment.

In particular, power supply is important for complete wireless communication. When wireless communication such as a spread spectrum method is used, the carrier is used as an energy source for short-range communication. That is, a part of the high frequency is detected and charged by the detection circuit 156 in the direct current (DC) generation circuit 155, and is generated by being boosted by the booster circuit 157. The imaging device 35, the control circuit 159, and the radio signal generation Is supplied to the container 158 and the like.

In this case, since the available energy is limited, the image pickup device 35 has a random access C
CMOS for peripheral circuits such as MD, MOS, CMOS, APS
It is desirable to use. It is also desirable to integrate AD converters that perform parallel processing.

FIG. 27B is a sectional view showing another structure of the miniature camera according to the nineteenth embodiment.

Small cameras always have a bright screen / L
In this example, the voltage is generated by a solar cell because the voltage is on the CD 22.

A small camera 21g is a screen / LCD2
A solar cell 160 is used in a portion that comes into contact with 2. The output generated by the solar cell 160 is boosted by the booster circuit 157, and the image sensor 35 and the signal processing circuit 16
1. It is supplied to the radio signal generator 158 and the like.

FIG. 27 (c) is a diagram showing a complete device configuration when the above-mentioned solar cell (photodiode) is used.

In particular, power supply is important for complete wireless communication. The light is used as an energy source to place the small camera on a bright screen at all times.

That is, when the solar cell 160 is used,
The output generated by the booster circuit 157 is supplied to the image sensor 35, the control circuit 159, the wireless signal generator 158, and the like.
In this case, the available energy is limited,
The imaging device 35 is a CMD or MO that can be randomly accessed.
It is desirable to use CMOS for peripheral circuits such as S, CMOS and APS. It is also desirable to integrate AD converters that perform parallel processing.

FIG. 28 (a) is a cross-sectional view showing the structure of the wireless communication means using light such as infrared light as the communication means.

The image pickup signal drives the infrared light emitting diode 163 disposed around the image pickup device 35 through the signal processing circuit 161 and the light emitting diode communication circuit 162. Here, a solar cell 160 is used in a portion in contact with the screen / LCD 22, and the output of the solar cell 160
, And is supplied to the image sensor 35, the control circuit 159, the light emitting diode communication circuit 162, and the like.

FIG. 28 (b) is a diagram showing the overall configuration of a wireless communication means using light such as infrared light as communication means.

The image pickup signal is transmitted to the infrared light emitting diode 1 through the signal processing circuit 161 and the light emitting diode communication circuit 162.
63 is driven. Here, the output generated by the booster circuit 157 from the solar cell 160 is supplied to the image sensor 35, the control circuit 159, the light emitting diode communication circuit 162, and the like.

In such a configuration, by incorporating a wireless power supply and a wireless signal transmitting means in a small-sized imaging camera capable of reading a source block and skipping, the degree of freedom of the set position is further increased, and And cost reduction can be achieved. Further, by performing a spread spectrum method or an infrared communication that can be used by a plurality of adjacent devices described in the embodiment or by a user, and by effectively using a high frequency or light energy of a screen, a further lowering is achieved. It is possible to significantly reduce the communication cost while electrically realizing the function of swinging the small camera, which is an object of the present invention, at the cost, and to realize the present communication infrastructure.

According to the nineteenth embodiment, it is possible to realize a wireless, small-sized camera having an electronic exposure function, a zoom function, and a swing function, in which a power line is eliminated. As a result, a high-performance compact camera can be supplied at low cost.

Further, since the camera is very small, even if the camera is placed on the screen, the camera is wireless, so that there is no strange feeling, and the camera can be freely moved on the screen by means of a micro machine or a linear actuator. Therefore, eye-gaze matching is realized, and a videophone, videoconferencing system, and video message can be made at a very low cost so that the other party (destination) and oneself (source) can feel as if they are talking face-to-face. It is possible to do.

Incidentally, each configuration of the nineteenth embodiment of the present invention can of course be variously modified and changed.

Next, a twentieth embodiment of the present invention will be described with reference to FIGS.

The twentieth embodiment relates to a user, an interface and usability of the image input / output device.

According to the present invention, a television video conference system and a video message that can be matched with each other by using a small camera are constructed. However, the wireless communication can further enhance the functions.

FIGS. 29 and 30 show a case where a plurality of other parties (transmission destinations) display a screen on their own (transmission source) screen / LCD around their own (transmission source) small camera. FIG. 4 is a diagram showing an example of a configuration in which a display window is generated in the case of (1).

FIG. 29A is a diagram showing an example of a case where two partner (destination) stations are particularly displayed. In the figure, display windows 23a and 23b of the other party (destination) are arranged on the left and right of the small camera 21 attached to the tip of the support rod 25 of the own (source).

FIG. 29B is a diagram showing an example in which four partner (transmission destination) stations are displayed. In this case, the small camera 2 attached to the tip of the support rod 25
Four recipient (destination) display windows 2 centered on 1
3a, 23b, 23c and 23d are arranged and displayed.

FIG. 30A is a diagram showing another example of the display of two partner (destination) stations. In this case, display windows 23a and 23b of the other party (destination) are arranged on the left and right sides of the small camera 21 installed on the screen / LCD 22 of the own (source).

FIG. 30B is a diagram showing still another example of the display of two partner (destination) stations. In this case, your own (source) screen / LCD2
Display windows 23a and 23b of the other party (destination) are arranged above and below the small camera 21 installed on the camera 2. In addition, the display frame can be moved on the screen by specifying and moving a display frame (not shown) with a mouse.

FIGS. 31 (a) and 31 (b) show examples of the display window 23 when an image taken by the small camera 21 of the user (source) or the partner (destination) is displayed on the screen / LCD 22. FIG.

[0283] The display window 23 has a display frame 166 and displays an image of the user (source) or the other party (destination). An instruction unit 167 enlarges / reduces the display window 23.

The size of the display window 23 is screen / LC
Although it depends on the size of D, it is preferably about 5 cm × 5 cm. The size of the display window 23 is displayed in a set size. This size can be enlarged to a multiple of that, or enlarged using the predicted value between pixels, or enlarged to any size and displayed, and the enlargement instruction can be selected on the screen such as the screen or with the mouse or key It is.

FIG. 32 (a) shows a case where an image picked up by a small camera of a user (source) or a partner (destination) is displayed on a screen, and all pixels of the image sensor are skip-read. An example is shown in which a part is thinned out and transmitted, and the whole image is displayed on the screen / LCD of the other party (destination), in whole or in a window.

A portion of the screen in the display window 23 to be enlarged by using a mouse or a touch screen is specified. In the example shown in FIG. 28, two points 168 and 169 are designated. Then
Correspondingly, using the function of block reading that displays a part of the screen in detail, only the part that you want to enlarge is
As shown in FIG. 32 (b), the image is displayed on the entire screen / LCD of the partner (destination) or in a window. Reference numerals 166 'and 167' denote a display frame and an instruction portion of the enlarged image, respectively.

When the enlarged display is clicked with a mouse or a touch screen, for example, in this case, clicking the zoom switch 171 with the mouse returns to the original display shown in FIG. Alternatively, by selecting two points and designating a portion to be reduced, the entire image can be displayed on the entire screen / LCD or in a window.

FIG. 33 (a) shows a case where an image picked up by a small camera of the user (source) or the other party (destination) is displayed on a screen, and all pixels of the image sensor are skip-read. FIG. 11 is a diagram showing an example in which a part is thinned out and the whole image is displayed on the screen / LCD of the other party (destination), in whole or in a window.

An operation of enlarging and displaying this screen as shown in FIG. 33B is performed using a mouse, keys or a touch screen. If you do not specify anything at this time, specify the center of the first image or the part you want to enlarge using the mouse, key or touch screen, and display a part of the screen in detail corresponding to this By using the block reading function, the portion to be enlarged is displayed at a certain set rate on the screen of the user (source) / partner (destination) / the entire LCD or in a window.
Alternatively, by operating the zoom switch 171, the image is enlarged around the center part 172 of the screen or a point designated in advance.
When the zoom switch 171 is operated using a mouse or a touch screen, the display returns to the original display.

FIGS. 34 (a) and 34 (b) show an image taken by a small camera of oneself (source) or another party (destination) on the screen when the other party (destination) or oneself (transmission) is displayed. FIG. 13 is a diagram showing an example in which the number of pixels to be transmitted can be freely controlled using a skip reading method in accordance with the request of (source).

Using the skip reading method, a part of all the pixels of the image sensor are thinned out and transmitted, and the whole image is displayed on the screen / LCD of oneself (source) or oneself (source) and the other party (destination). After that, the type of display is switched using the switch 173 using a mouse, a key, or a touch screen.

In this way, although it takes time to display, the image in the normal mode shown in FIG. 34A is converted into a high-definition display in the quasi-stationary mode of high detail as shown in FIG. Switching is possible. In this case, depending on the transmission speed of the communication means, if the frame rate is high, the frame rate drops and the image becomes close to a still image.

With the above-described configuration, the user can effectively use the apparatus as a means for a TV conference or a video message. If the transmitting side can set this function in advance to the angle of view of the transmission source, a TV conference or video message can be transmitted to the other party (transmission destination) in an ideal state by the electronic zoom or swing function.

Also, by transmitting an image of a quality that matches the intention of the transmitting side, an original TV conference or video message can be made. Further, by setting the angle of view and the resolution according to the request of the other party (destination), a TV conference or a video message with high customer satisfaction is possible.

As a result, it is possible to have a user-friendly interface, achieve eye-gaze matching, and speak at a very low cost with the other party (destination) and yourself (source) facing directly from each other. You can compose a video phone, video conferencing system, video message that you can feel.

Next, a twenty-first embodiment of the present invention will be described. These relate to the interface with the user and the usability of the apparatus.

According to the present invention, a television video conference system and a video message capable of matching eyes are constructed by using a small camera. By further improving the interface with the user, higher functions can be achieved. be able to.

The user (the sender and the receiver) can use the display window 2
Screen / L of partner (destination) displayed in part of 3
When displaying in the window on the CD 22, there is a case where the position of the screen / LCD 22 of the other party (destination) is desired to be moved.

That is, in FIG. 35A, an example is shown in which the display window 23 is moved to the position 23 'on the screen / LCD 22. For example, as shown in FIG. 35B, there is a case where it is desired to display the memo board 175 for writing the result of the meeting and the display window 23 together. Also in this case, the small camera 21 on the screen / LCD 22 is
Move from 1 _o, 5cm from the center position in the window
Is moved so that it always exists in the position within or within the vicinity of the window. In this case, it is desirable to use the present invention for the moving means.

FIG. 36 shows an example in which a screen is displayed on a screen of a user (source) or a CRT from a plurality of destinations (transmission destinations).

In FIG. 36 (a), the screen / LC
A plurality of display windows 23a, 23b, 23c are displayed on D22. Since only one person is actually talking, the small camera 21 of his / her own (source) has a display window of the other party (destination) with which the user is talking, that is, the display window 23 in this case.
A is moved so that it always exists at a position within 5 cm from the center position in the window or near the window.

[0302] The display window of the party (destination) in conversation is 2
If switched to 23c from 3a, as shown in FIG. 36 (b), a small camera 21 is located in the vicinity of the display window 23a is moved to the vicinity of the display windows 23c from the position of 21 _0. Which screen to move to may be specified each time using a mouse, key, or touch screen switch, or may be automatically selected.

In such a configuration, the user can effectively use the device as a means for a TV conference or a video message. The user can match the line of sight no matter where the small camera is placed on the screen. For this reason, work restrictions on the computer are reduced. Also, when a conference is held with a plurality of parties (transmission destinations), the eyes are always matched. TV conferences and video messages with high customer satisfaction are possible.

[0304] Therefore, the user has an interface that is satisfactory to the user, and eye-gaze matching can be realized regardless of the position of the display window on the screen or even if there are a plurality of members.
It is possible to configure a videophone, a video conference system, and a video message that make it possible to feel that the other party (destination) and oneself (source) are talking face-to-face at extremely low cost.

Incidentally, each configuration of the twentieth embodiment of the present invention can of course be variously modified and changed.

According to the above embodiment of the present invention, the following configuration can be obtained.

[0307] (1) Imaging means for photographing the image of the sender, display means for displaying the image of the receiver, and the image from the receiver displayed on the imaging means and the display means And a position adjusting means for adjusting a relative positional relationship of the image input / output device.

(2) The image input / output device according to (1), wherein the position adjusting means controls the position of the image pickup means.

(3) The position adjusting means controls the display position of the image from the receiver side displayed on the display means, wherein any one of (1) and (2)
An image input / output device according to claim 1.

(4) The image according to (2), wherein the position adjusting means is rotatably attached to the display means and has an imaging means supporting member for supporting the imaging means. I / O device.

(5) The image input / output device according to the above (2), wherein the position adjusting means has a detachable member which enables detachment from the display means.

(6) The image input / output device according to (5), wherein the imaging means is fixed on the display screen of the display means via the detachable member.

(7) The image input / output device according to (6), wherein the detachable member and the display means are fixed via a transparent sheet.

(8) The position adjusting means has a horizontal moving means for moving the imaging means in the horizontal direction, and a vertical moving means for moving the imaging means in the vertical direction. The image input / output device according to the above (2).

(9) The position adjusting means has a transparent sheet disposed in front of the display surface of the display means, and a transparent sheet moving means for moving the transparent sheet along the display surface. The image input / output device according to (2), wherein the imaging unit is fixed to the transparent sheet.

(10) The position adjusting means is provided so as to cover the transparent sheet disposed in front of the display surface of the display means, the conductive thin film provided on the transparent sheet, and the conductive thin film. The image input / output device according to the above (2), further comprising a dielectric and a charge layer provided on the imaging unit.

(11) The position adjusting means has a transparent sheet disposed in front of the display surface of the display means, a magnetic thin film provided on the transparent sheet, and an electromagnet provided in the imaging means. The image input / output device according to the above (2), wherein:

(12) The image input / output apparatus according to the above (1), further comprising transmission control means for transmitting a part of the image picked up by the image pickup means.

(13) The image input / output device according to the above (12), wherein the imaging means uses a solid-state imaging device.

(14) The image input / output device according to any one of (1) to (13), wherein the image from the receiver displayed on the display means is an image of the receiver.

(15) The image input / output device according to the above (12), wherein the imaging means is constituted by a solid-state imaging device having a charge transfer device.

(16) The image input / output device according to the above (12), wherein the image pickup means is constituted by a solid-state image pickup device capable of random access.

(17) The above (1), wherein a charge modulation element is used as a unit pixel in the solid-state imaging device.
The image input / output device according to 6).

(18) The image input / output device according to (16), wherein one or more MOS devices and one or more photodiodes are used as unit pixels in the solid-state imaging device.

(19) The image input / output device according to (16), wherein one or more amplifying devices and one or more photodiodes are used as unit pixels in the solid-state imaging device.

(20) The device according to (16), wherein one or more MOS devices, one or more amplifying devices, and one or more photodiodes are used as unit pixels in the solid-state imaging device. Image input / output device.

(21) The image input / output device according to (16), wherein a canceler for fixed pattern noise is provided in the solid-state imaging device.

(22) Rows and / or
Alternatively, the image input / output device according to (16), further including a selection circuit for selecting one of a plurality of lines in each line of the column and performing skip reading.

(23) In the solid-state imaging device, rows and / or
Alternatively, the image input / output device according to the above (16), further comprising a selection circuit for reading a required group of pixels starting from a line position in each line of the column as a start point.

(24) The image input / output according to the above (15) or (16), wherein an analog-digital converter for converting one or more analog values into digital is provided in the solid-state imaging device. apparatus.

(25) The solid-state imaging device according to (15) or (16), further including an analog-digital converter for converting an analog value into a digital value for each of a plurality of rows and / or columns. The image input / output device according to (1).

(26) The solid-state image pickup device has a function of wirelessly communicating an analog or digital output of an image in a high frequency or microwave, or a spread spectrum method, and a TV phone or a computer receives the communication function. The image input / output device according to the above (15) or (16), wherein the image input / output device has a configuration including a transmission unit.

(27) The solid-state imaging device has a function of wirelessly communicating an analog or digital output of an image with visible light or infrared light, and a TV phone or a computer has transmission / reception means for this communication function. (15) or (16) above,
An image input / output device according to claim 1.

(28) In the solid-state imaging device,
Or microwave supply, or screen or L
The image input / output device according to (15) or (16), further comprising a function of receiving power or energy by supplying light energy from the CD and omitting a power supply line.

(29) When displaying a screen from a plurality of destinations on the screen or CRT of the transmission source, a transmission destination screen area is generated around the imaging means of the transmission source, and the transmission destination screen area becomes 2 In the case of three, two destination screens are displayed on the left and right or up and down of the imaging means of the source, and in the case of three destination screen areas, the three screen areas constitute a triangle. The above-mentioned (1) is characterized in that the imaging means is set at the center, and when there are four destination screen areas, four partner (transmission destination) screens are displayed on the left, right, top and bottom of the imaging means.
The image input / output device according to 2).

(30) An image picked up by the image pickup means of the transmission source or the transmission destination is displayed on the screen when
Or, when displaying on the screen with a pixel size that communicates with both, display it in a display window of a preset size, or expand and reduce to multiples according to settings and instructions, or display to enlarge to any size The image input / output device according to the above (12), wherein the enlarged display is selectable on a screen or by a mouse or a key.

(31) When an image captured by the above-mentioned image capturing means of the transmission source or the transmission destination is displayed on the screen,
A part of all the pixels of the imaging unit are thinned out and transmitted using the skip reading method, and the whole image is transmitted to the screen / L of the transmission destination.
(12) The image input / output device according to (12), wherein the image is displayed on a CD or in a window.

(32) When displaying an image taken by the above-mentioned image pickup means of a transmission source or a transmission destination on a screen,
Using the mouse or the touch screen, specify the part of the image displayed on the screen / LCD of the transmission destination displayed on the entire screen or the window to be enlarged using the mouse or the touch screen. Using the block reading function to be displayed, only the portion to be enlarged can be displayed on the entire screen / LCD of the transmission destination or in the window, and the display can be displayed by using the mouse or the touch screen. The above (12), wherein the whole image is displayed on the screen / LCD or in the window by designating the part to be reduced.
An image input / output device according to claim 1.

(33) When displaying an image picked up by the image pickup means of the transmission source or the transmission destination on the screen,
A part of all pixels of the image sensor is thinned out and transmitted using the skip reading method, and the whole image is displayed on the screen / LCD of the source or the source and the destination, and the mouse, keys or touch screen is used. When zooming, use the mouse,
Using a key or a touch screen, set the area to be enlarged by using a block read function that displays a part of the screen in detail in response to the setting. (12) The image input / output device according to the above (12), wherein the image can be displayed on the entire LCD or in a window, and the display is originally displayed using a mouse or a touch screen.

(34) When displaying an image picked up by the image pickup means of the transmission source or the transmission destination on the screen,
The number of pixels to be transmitted and the number of frames to be displayed can be freely controlled by using the skip reading method in accordance with the request of the transmission destination or the transmission source. All pixels of the image sensor using the above skip reading method can be controlled. It is possible to switch to high-definition display using a mouse, key or touch screen after displaying a whole image on the screen / LCD of the source or the source and the destination by transmitting a part of the data. The image input / output device according to the above (12).

(35) When displaying an image taken by the above-mentioned image pickup means of a transmission source or a transmission destination on a screen,
When only the portion to be enlarged is displayed on the entire screen or window of the transmission destination or transmission source or in the window, the number of pixels for transmission and display can be freely controlled according to the request of the transmission destination or transmission source. The image input / output device according to any one of (28) to (33), wherein:

[0342]

As described above, according to the present invention, it is possible to provide a simple, low-cost, high-performance, small-sized image input / output device capable of line-of-sight matching using a conventional display device.

[Brief description of the drawings]

FIGS. 1A and 1B show a first embodiment of an image input / output device of the present invention, wherein FIG. 1A is a front view of the device, and FIG.

FIG. 2 is a diagram illustrating a configuration example according to a second embodiment of the present invention;

FIGS. 3A and 3B are diagrams illustrating a third embodiment of the present invention, wherein FIG. 3A is a front view of an image input / output device according to the third embodiment, and FIG. 3B is a cross-sectional view of the device.

FIGS. 4A and 4B are diagrams illustrating a fourth embodiment of the present invention, wherein FIG. 4A is a front view of an image input / output device according to the fourth embodiment, and FIG. 4B is a cross-sectional view of the device.

FIG. 5 is a front view of an image input / output device according to a fifth embodiment.

FIG. 6 is a front view showing a configuration example of a sixth embodiment of the present invention.

FIGS. 7A and 7B are views for explaining a seventh embodiment of the present invention, wherein FIG. 7A is a front view of an image input / output device according to the seventh embodiment, and FIG. 7B is a cross-sectional view of the device.

FIGS. 8A and 8B are views for explaining an eighth embodiment of the present invention, wherein FIG. 8A is a front view of an image input / output device according to the eighth embodiment, and FIG. FIG. 2 is a schematic perspective view showing a configuration example of FIG.

FIG. 9 is a diagram showing a configuration example of a ninth embodiment of the present invention.

FIG. 10 is a diagram showing a configuration of a small camera according to a tenth embodiment of the present invention.

FIG. 11 (a) is a small camera 2 on the user side (transmission source).
1c is a conceptual diagram of an image pickup device for a moving image or a still image,
(B) is a conceptual diagram of an image sensor showing an example in which some pixels are thinned out over the entire surface, and (c) is an image pickup area 47.
FIG. 5 is a conceptual diagram of an image sensor showing an example in which only a certain range is sent.

12A and 12B are diagrams illustrating an eleventh embodiment of the present invention, in which FIG. 12A is a conceptual diagram of a moving image or a still image captured by a small camera 21 on the transmission side, and FIG. (A) is a diagram illustrating an area 47 captured by the small camera 21, (c) is a diagram illustrating an example of an image of a transmitted image in which a screen of the area 47 is roughly captured by a pixel thinning operation, and (d). () Shows an example of an image to be transmitted, in which only an area 50 at the center of the area 47 in FIG. (B) is transmitted, and (e) shows an image to be transmitted, which is an area in FIG. It is the figure which showed the example of the image to which only the peripheral part of 51 was sent.

13A and 13B show a configuration of a twelfth embodiment of the present invention, in which FIG. 13A shows the configuration of the entire image input / output device, and FIG. 13B shows the block configuration of a control system. is there.

FIG. 14A is a block diagram showing a schematic configuration of an entire image input / output device according to a thirteenth embodiment of the present invention, and FIG. 14B is a diagram for realizing the function of FIG. FIG. 3 is a block diagram illustrating a configuration example of a memory controller 74 and a frame memory 75, illustrating an example of the configuration.

FIG. 15 is a view for explaining a fourteenth embodiment of the present invention, and is a view showing a configuration example of a small camera for explaining a focus matching method.

FIG. 16 is a diagram showing a configuration example for explaining a fifteenth embodiment of the present invention.

FIGS. 17A and 17B are diagrams illustrating a sixteenth embodiment of the present invention, in which FIG. 17A shows the configuration of a charge transfer device (CCD), and FIG. FIG. 2 is a diagram illustrating a configuration of an imaging element.

FIGS. 18A and 18B illustrate a sixteenth embodiment of the present invention, in which FIG. 18A shows the configuration of a CMD (charge modulation element) which is the simplest element and can be accessed randomly, and FIG. Sectional drawing which shows the structure of CMD106 of FIG.
Is a configuration diagram of the simplest randomly accessible pixel and its peripheral portion, (d) is a configuration diagram of the simplest random accessible pixel having a reset function and its peripheral portion,
(E) is a diagram showing the sum of the configuration of the simplest randomly accessible pixel having a shutter function and a reset function and its peripheral portion.

19A and 19B are diagrams illustrating a sixteenth embodiment of the present invention, in which FIG. 19A is a configuration diagram of a random access amplification type pixel having a shutter function and a reset function and its peripheral portion,
FIG. 2B is a configuration diagram in a case where a fixed pattern noise (FPN) reduction circuit is added to a randomly accessible imaging device.

FIGS. 20A and 20B are diagrams illustrating a seventeenth embodiment of the present invention, wherein FIG. 20A is a configuration diagram illustrating an example using randomly accessible pixels, and FIG. 20B is another column of a scanning control circuit; FIG.

FIGS. 21A and 21B are diagrams illustrating a seventeenth embodiment of the present invention, in which FIG. 21A is a timing chart illustrating an example of a skip read operation, and FIG. 21B is a timing chart illustrating an example of a block read operation. .

FIGS. 22A and 22B are diagrams illustrating a seventeenth embodiment of the present invention, in which FIG. 22A is a timing chart showing an example of a block read operation, and FIG. 22B is a timing chart showing another example of a block read operation. It is.

23A and 23B are diagrams illustrating a seventeenth embodiment of the present invention, in which FIG. 23A is a configuration diagram illustrating another example of a method of skip reading and block reading when using a CCD image pickup device, and FIG. 6 is a timing chart showing an example of skip reading and block reading operations when a CCD image pickup device is used.

FIG. 24 is a block diagram showing a configuration of an eighteenth embodiment of the present invention, in which pixels that can be randomly accessed are used.

FIG. 25 is a diagram showing a configuration example of a nineteenth embodiment of the present invention.

FIG. 26 is a block diagram showing a configuration example by a spread spectrum method which is the most resistant to noise and can be used simultaneously by a plurality of models and users, for explaining a nineteenth embodiment of the present invention; It is.

27A is a block diagram showing a complete configuration of a small camera according to the nineteenth embodiment, FIG. 27B is a cross-sectional view showing another configuration of the small camera according to the nineteenth embodiment,
(C) is a diagram showing a complete device configuration when using a solar cell (photodiode).

FIGS. 28 (a) and 28 (b) illustrate a nineteenth embodiment of the present invention, wherein FIG. 28 (a) is a cross-sectional view showing a configuration of a wireless unit using light such as infrared light as a communication unit, and FIG. It is a figure showing the whole composition of the wireless means using light, such as infrared rays.

FIGS. 29A and 29B are diagrams for explaining a twentieth embodiment of the present invention, wherein FIG. 29A is a diagram showing an example in which two partner (destination) stations are displayed, and FIG. It is the figure which showed the example which displayed the (transmission destination) station.

FIGS. 30A and 30B are diagrams for explaining a twentieth embodiment of the present invention, wherein FIG. 30A shows another example of display of two partner (destination) stations, and FIG. Destination)
It is the figure which showed another example of the display of a station.

FIG. 31 is a view for explaining a twentieth embodiment of the present invention, in which an image taken by a small camera 21 of a user (source) or a partner (destination) is displayed on a screen / LCD 22. FIG. 3 is a diagram illustrating an example of a window 23.

FIGS. 32A and 32B illustrate a twentieth embodiment of the present invention. FIG. 32A illustrates a case where an image captured by a small camera of a user (source) or a partner (destination) is displayed on a screen. FIG. 9 is a diagram showing an example in which a part of all pixels of an image sensor is thinned out and transmitted by using a skip reading method, and the whole image is displayed on the screen / LCD of the other party (destination) in the whole or in a window. FIG. 2B is a diagram showing only a portion to be enlarged by using a block reading function for displaying a part of the screen of FIG.

FIG. 33 illustrates a twentieth embodiment of the present invention. FIG. 33 (a) shows a case where an image captured by a small camera of the user (source) or the partner (destination) is displayed on a screen. FIG. 9 is a diagram showing an example in which a part of all pixels of an image sensor is thinned out and transmitted using a skip reading method, and the entire image is displayed on the screen / LCD of the other party (destination) in the whole or in a window. FIG. 2B is a diagram showing an example in which the screen of FIG. 1A is enlarged and displayed using a mouse, a key, or a touch screen.

FIG. 34 is a view for explaining a twentieth embodiment of the present invention, in which an image taken by a small camera of a user (source) or a partner (destination) is displayed on a screen when the partner (transmission destination) is displayed. ) Or an example in which the number of pixels to be transmitted can be freely controlled using a skip readout method in accordance with the request of the user (source), (a) is a diagram showing an image in a normal mode, and (b) is a diagram showing an image in a normal mode. It is the figure which showed the image of the quasi-static mode of high detail.

FIG. 35 is a structural example of a twenty-first embodiment of the present invention,
FIG. 4 is a diagram showing an example in which a display window 23 is moved to a position 23 ′ on a screen / LCD 22.

FIG. 36 is a configuration example of a twenty-first embodiment of the present invention,
FIG. 9 is a diagram illustrating an example of displaying a screen on a screen of a user (source) or a CRT from a plurality of destinations (transmission destinations).

FIG. 37 is a diagram showing a schematic configuration of a conventional line-of-sight videophone device.

FIG. 38 is a view showing a schematic configuration of a conventional line-of-sight video phone device.

FIG. 39 is a diagram showing a schematic configuration of a conventional line-of-sight videophone device.

FIG. 40 is a diagram showing a schematic configuration of a conventional line-of-sight videophone device.

FIG. 41 is a diagram showing a schematic configuration of a conventional line-of-sight video phone device.

[Explanation of symbols]

 Reference Signs List 20 housing, 21, 21a to 21h small camera, 22 screen / LCD, 23 display window, 24 mounting device, 25 support rod, 27 transparent sheet, 28 guide portion, 29 actuator, 30 transparent electric conductive thin film, 31 dielectric, 32 camera unit, 33 drive unit, 34 charge layer, 35 image sensor, 36 lens group, 55 computer device, 56 television (TV) device, 57 videophone device, 60 communication function device, 70 system controller, 71 control unit.

Claims (3)

[Claims] 1. An image pickup means for photographing an image of a sender, a display means for displaying an image of a receiver, and adjusting a relative position between the image pickup means and an image of a receiver displayed on the display means. An image input / output device comprising: 2. The image input / output apparatus according to claim 1, wherein said position adjusting means adjusts a position of said imaging means. 3. The image input / output apparatus according to claim 1, wherein said position adjusting means adjusts a display position of a receiver image displayed in a display of said display means.