JP2020005226A - Image communication apparatus and image communication method - Google Patents

Abstract

To provide an image communication apparatus and an image communication method which allow remote persons to look straight ahead by a simple configuration without requiring complex control or special image processing, not using a half mirror, allow for smooth dialog by eye-contact or gesture, and excellent in operability and compactness.SOLUTION: In an image communication apparatus 10b having display means 15 for receiving an image signal and displaying the image of a person A, flat optical image formation means 16 for forming the image of the person A, displayed by the display means 15, as a real image 26 in the free space, imaging means 18 for imaging a person B making a conversation with the real image 26 in the free space, and image signal output means 20 for sending the image signal of the image of the person B, captured by the imaging means 18, to the person A, the imaging means 18 is attached to the light-emission side central part of the optical image formation means 16.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image communication apparatus and an image communication method capable of real-time remote conference (teleconference) or video chat between a plurality of points via images (real images).

2. Description of the Related Art Conventionally, a video conference system, a video phone system, and the like are known as techniques for allowing persons (communicators) in remote locations to have a conversation through images (video). In these systems, an image including the face of each person is bidirectionally captured at each point by a video camera or the like, and transmitted to a remote point to be displayed on display means (display device, display). This enables conversation between remote points. Such a two-way communication system with a remote place is rapidly progressing with an increase in communication line capacity typified by broadband in recent years and an increase in the performance of a control device. It is capable of two-way communication, especially for use in the business field.

However, in these conventional systems, for example, a configuration in which an imaging device such as a video camera or a web camera is installed above a display device as in Patent Literature 1 is adopted. From above. On the other hand, a communicator has a conversation while watching an image of a communication partner displayed mainly on a display device, not on the imaging device. Therefore, the imaging direction of the imaging device is different from the direction of the line of sight of the communication person (the line of sight), and the image of the communication partner is displayed on the display device with the line of sight facing downward. As a result, there is a problem in that the communication parties cannot match their eyes, and the conversation tends to be uncomfortable, it is difficult to communicate, and lacks a sense of realism and tension.

As a solution to this problem, for example, in Patent Document 2, when the height at which the imaging device is installed and the eye height detected by the height detection unit are different, the three-dimensional video generation unit uses Based on the difference and the distance between the imaging device and the user (communicator), to obtain a 3D image of the user when viewed from a virtual viewpoint at the eye level detected by the height detection unit A video display system that performs a rendering process has been proposed.
Patent Document 3 proposes a video conference system including a display device that displays an image of a partner and a camera that captures an image of a user. In this video conference system, as shown in FIG. 7, an image of the other party displayed on the display device 81 is formed as an aerial image 82 in a space using a reflective imaging element (an example of optical imaging means) 80. The user 83 who observes the aerial image 82 is imaged by a camera 84 provided on the reflection type imaging device 80, and the imaged image is transmitted to the other party's video conference system together with the sound using communication means. ing.

JP 2006-93883 A JP-A-2006-192688 International Publication No. 2011/108139 JP-A-5-161135

However, in Patent Document 2, in order to ensure that the heights of the eyes of the communicating parties who communicate with each other during the operation are consistently extracted, the height detecting unit always extracts the images of the communicating parties and uses the height detecting unit to set the height of the eyes of the communicating parties. Every time the height of the communicator's eyes or the distance between the imaging device and the communicator changes, the 3D video generator creates a 3D video and switches the video on the display screen. No. Since these controls are complicated and require time for processing, it is difficult to match the actual movement of the communicator with the image displayed on the display device, and the time difference may cause a sense of incongruity. In addition, since the heights of the eyes of the correspondents are only virtually matched, it is impossible to cope with the movement of the eyes of the correspondents up, down, left and right, and the eyes of the correspondents completely match. I can't let that happen. Therefore, for example, when a material image (a common image) such as a photograph or a document is displayed on the display device together with the communicating party, even if one communicating party shifts his / her gaze to the material image, the other communicating party cannot communicate with the other party. Can't judge where they are looking and cannot respond to the conversation immediately. In other words, because it is not possible to send eye gaze or make an eye contact and make eye contact like a face-to-face conversation, it is difficult to achieve sufficient communication, and a smooth conversation does not hold There was a problem.

The video conference system described in the embodiment of Patent Document 3 does not use optical elements such as a half mirror and a polarizing beam splitter, and directly shoots a user 83 with a camera 84 as shown in FIG. Assuming that the camera 84 for photographing the user 83 is arranged at a position farther from the user 83 than the aerial image 82, the deviation angle θ between the line of sight of the user 83 and the photographing direction of the camera 84. Is reduced to such an extent that the inconsistency of the line of sight is not substantially felt. Therefore, the distance from the user 83 to the aerial image 82 and the distance from the user to the camera 84 must be properly managed. That is, in order to reduce the deviation angle θ between the line of sight of the user 83 and the shooting direction of the camera 84 to such a degree that the line of sight does not substantially match, the distance between the user 83 and the camera 84 is increased. However, if the distance from the user 83 to the aerial image 82 becomes too long, the finger of the user 83 does not reach the aerial image 82, and the user 83 may point to the aerial image 82 or perform a touch input. There was a problem that it would be difficult to perform. When the user 83 comes too close to the aerial image 82 to touch the aerial image 82 with a finger or the like, the distance to the camera 84 also becomes short, and the deviation angle θ between the line of sight of the user 83 and the photographing direction of the camera 84. And the line of sight becomes inconsistent with the communication partner, and in some cases, the face of the user 83 cannot be clearly captured by the camera 84, which causes a problem of lack of versatility and operability. Also, in order to extend only the distance from the user 83 to the camera 84 without changing the distance from the user 83 to the aerial image 82, only the camera 84 is used without moving the position of the formation unit of the aerial image 82. When the user is kept away from the person 83, the size of the apparatus in the depth direction increases and a wide installation space is required, and thus there is a problem that the compactness and the installation flexibility are lacking.

Furthermore, Patent Document 3 proposes a video conference system using a half mirror as a conventional technique. An example of this video conference system is shown in FIG. 8 (A). The image of the other party displayed on the display device 86 is observed through a half mirror 87 arranged at an angle of 45 degrees, and the user is connected via the half mirror 87. An image 88 is captured by the camera 89 and sent to the other party's video conference system. According to Patent Document 3, since an optical element such as a half mirror 87 generally has wavelength dependency, an image captured by a camera 89 has an unnatural color, and the image quality of an image displayed to the other party is low. It states that there is an issue.

Therefore, the result of the inventor's intensive study on the problem when the half mirror 87 is used will be described below.
FIG. 8B shows a partial cross section of the half mirror 87. A reflection surface 91 having a light transmittance of 40 to 60% by a metal layer forming the half mirror 87 is formed on the back surface of the transparent plate material 90 having a thickness. ing. Light D1 from the display device 86 enters the plate member 90 as indicated by D2, and exits to the user side as indicated by D3. Further, as shown at D4, there is light that repeatedly reflects on the back side of the front surface of the plate member 90 and reaches the user 88. On the other hand, the light E1 from the user 88, which has been separately illuminated, is reflected toward the camera by the reflection surface 91 as shown by E2, but a part of the light E3 enters the plate member 90 and enters the plate member 90. In addition to the light emitted from the front side of the plate member 90 as F1, the light reflected from the back side of the plate member 90 to reach the camera 89 as E4 and E5, and further, as shown at E6, the light repeatedly reaches the camera 89. . Therefore, there is a problem that images are photographed in a multiplex manner and clear images cannot be obtained. The above problem is a problem that occurs remarkably when the thickness of the half mirror 87 is large. Such a problem is the same in, for example, Japanese Patent Application Laid-Open No. H10-163873, and is a problem that commonly occurs when a half mirror having a thickness is used at an angle. In addition, F1 and F2 indicate unnecessary light emitted from the plate member 90 to the outside.

The present invention has been made in view of such circumstances, and does not need to perform complicated control or special image processing, etc., and enables a remote person to directly face and match eyes with a simple configuration that does not use a half mirror. It is an object of the present invention to provide an image communication device and an image communication method that can communicate smoothly by eye contact and gestures, can perform conversation smoothly, and are excellent in operability and compactness.

According to a first aspect of the present invention, there is provided an image communication apparatus, comprising: display means for receiving an image signal to display an image of a conversation partner; and connecting the image of the conversation partner displayed on the display means to a free space as a real image. Planar optical imaging means for imaging, imaging means for imaging a person interacting with the real image of the free space, image signal output means for sending an image signal of the image of the person imaged by the imaging means to the other party In the image communication device having
The imaging means is attached to a central portion on the light emission side of the optical imaging means.
Here, the central part on the light emission side of the optical imaging means can image a person who interacts with the real image of the free space (the conversation partner) from the front, and sets the distance between the line of sight of the person and the imaging direction of the imaging means. Any range may be used as long as it does not cause a large displacement and the line of sight of the person and the conversation partner is in line. In particular, it is preferable to install the imaging means in accordance with the position (height) of the eyes of the person using the image communication device. In order to hold a video conference using this image communication device, an image communication device B on the other side is required in addition to the image communication device A on the user side. The image communication device B does not need to have the same configuration as the image communication device A, and it suffices to have a camera for imaging the other party and a display device for displaying the image data of the user captured by the camera on the user side. .

In the image communication device according to the first aspect, it is preferable that a mounting hole for mounting the imaging unit is formed in a central portion of the optical imaging unit.
In the image communication device according to the first invention, it is preferable that the optical imaging means is arranged so that the light output side faces obliquely upward, obliquely downward, or obliquely laterally.
In the image communication device according to the first aspect, the image signal output unit includes a common image creation unit, and combines the image of the conversation partner with the common image created by the common image creation unit, and combines the combined image with the display unit. It is preferable that the common image signal of the common image be superimposed on the image signal to be sent to the conversation partner while being displayed. In this case, it is preferable that the image of the person sent to the conversation partner by the image signal output means is horizontally inverted.
Further, in the image communication device according to the first aspect of the present invention, the image communication device may further include a detection unit configured to detect the operation of the person, wherein the image signal output unit operates the common image based on the operation detected by the detection unit. You can also.

An image communication method according to a second aspect of the present invention is to form an image of a conversation partner displayed on a display means as a real image in free space by a planar optical imaging means, and to capture a person interacting with the real image in the free space. In an image communication method for imaging by means and sending an image signal of an image of a person imaged by the imaging means to the conversation partner,
The imaging unit is attached to a central portion on the light emission side of the optical imaging unit, and images a person interacting with the real image of the free space from the front.

In the image communication method according to a second aspect, the image of the conversation partner and the common image are combined and displayed on the display unit, and the common image signal of the common image is also superimposed on the image signal sent to the conversation partner. Is preferred.

The image communication device according to the first invention and the image communication method according to the second invention can form an image of a conversation partner displayed on the display means as a real image in free space by the optical imaging means. A person who interacts with the real image can have a conversation as if the other party is in front of him. At this time, since the imaging means is attached to the central portion on the light emission side of the optical imaging means, the optical imaging means and the imaging means are integrated, so that the work of separately positioning and installing the imaging means and the imaging means It is excellent in practicality without the need for a means for retaining. In addition, since a half mirror is not required, a person can be directly imaged by the imaging means from the front, and an image signal of the captured image can be sent to the conversation partner, so that the conversation partner and the person can match their eyes with an extremely simple configuration. Can communicate in real time, and can communicate smoothly by eye contact and gestures. Furthermore, when a person is imaged by the imaging means, it is possible to always directly image the person from the front, and even if the distance between the person and the real image changes, the gaze direction of the person and the imaging direction of the imaging means do not change and remain constant. Maintained, clear images and excellent operability.

In the image communication apparatus according to the first invention, when a mounting hole for mounting the imaging unit is formed in the center of the optical imaging unit, the imaging unit can be easily attached to the optical imaging unit. And excellent in assembly workability and handleability.

In the image communication apparatus according to the first invention, when the optical imaging means is arranged with the light output side obliquely upward, obliquely downward or obliquely horizontal, the angle of the real image to be imaged is inclined with respect to the display means. In particular, if the inclination angle of the optical imaging means is selected so that the real image is in a vertical plane in accordance with the arrangement (installation angle) of the display means, the person can correct the image (real image) of the conversation partner. Therefore, distortion of an image is small and visibility can be improved.

In the image communication apparatus according to the first invention and the image communication method according to the second invention, the image of the conversation partner and the common image are combined and displayed on the display unit, and the image signal sent to the conversation partner is also included in the image signal. When the common image signal is superimposed, the conversation partner and the person can have a smooth conversation while simultaneously viewing the common image. Also, on the other side of the conversation, the received image signal and the common image signal can be displayed on the display means as they are, no special image processing means or image processing steps are required, and a general-purpose portable terminal or personal computer or the like can be used. Communication (dialogue) with the other person easily. Here, when the image of the person is inverted left and right and sent to the conversation partner, the image signal is received on the screen (display) of a general-purpose portable terminal or personal computer without performing image processing or the like. Can be displayed.

In the image communication device according to the first invention, when a motion (gesture) of a person is detected and the common image is operated based on the detected motion, enlargement, reduction, movement, Various operations such as rotation can be performed intuitively and easily, and the operability is excellent.

FIG. 1 is an explanatory diagram illustrating a configuration of an image communication device according to a first embodiment of the present invention. FIG. 2 is a block diagram illustrating a configuration of the image communication device. FIG. 4 is an explanatory diagram illustrating a use state of the image communication apparatus. 3A and 3B are a front sectional view and a side sectional view, respectively, of an optical imaging unit in the image communication apparatus. FIG. 11 is an explanatory diagram illustrating a configuration of an image communication device according to a second embodiment of the present invention. FIG. 11 is an explanatory diagram illustrating a configuration of an image communication device according to a third embodiment of the present invention. It is an explanation of a video conference system according to a conventional example. (A), (B) is an explanatory view of the operation of the half mirror according to the conventional example.

Next, embodiments of the present invention will be described with reference to the accompanying drawings to provide an understanding of the present invention.
As shown in FIG. 1, the image communication devices 10a and 10b according to the first embodiment of the present invention are arranged at respective points, and persons A and B existing at the respective points are arranged by the image communication devices 10a and 10b. A conversation is performed via images.
As shown in FIGS. 1 and 2, each of the image communication devices 10 a and 10 b has a display unit 15 in which a display surface 14 is arranged horizontally with the display surface 14 facing upward, and a display surface 14 of the display unit 15 above the display unit 15. The optical imaging means 16 has a planar optical imaging means 16 inclined at an inclination angle of 45 degrees and the light output side is inclined upward, and an imaging means 18 attached to the central part of the optical imaging means 16 on the light emission side. . A high-brightness monitor is preferably used as the display unit 15, and a small video camera such as a web camera is suitably used as the imaging unit 18. At this time, since the mounting hole 19 for mounting the imaging means 18 is formed at the center of the optical imaging means 16, the imaging means 18 can be easily attached to the optical imaging means 16 and integrated. it can. Each of the image communication devices 10a and 10b has an image signal output unit 20 that transmits and receives image signals and displays an image on the display unit 15 based on the image signal received from the conversation partner. As the image signal output means 20, a conventionally known arithmetic unit (that is, a computer) having a RAM, a CPU, a ROM, an I / O, and a bus connecting these elements is preferably used. Then, the processing in the image signal output means 20 is realized by the CPU executing a predetermined program. Note that a speaker 21 and a microphone 22 are connected to the image signal output means 20, and conversation can be performed by transmitting and receiving audio signals.
The optical imaging means 16 forms an image displayed on the display means 15 as a real image in a free space on the front side of the optical imaging means 16 (on the imaging surface 23 having no substance). The details of the optical imaging means 16 will be described later.

Hereinafter, a case where the person A and the person B communicate with each other among a plurality of points will be described.
First, the image communication device 10a captures an image of the person A in front of the optical imaging unit 16 with the imaging unit 18. Then, the image signal output unit 20 transmits the image signal of the captured image to the image signal output unit 20 of the image communication device 10b connected via the communication network 24, and the image signal is output by the image capturing unit 18 of the image communication device 10b. The received image signal of the image of the person B (the conversation partner of the person A) can be received and displayed on the display unit 15.
Similarly, the image communication device 10 b uses the imaging unit 18 to image the person B in front of the optical imaging unit 16. Then, the image signal output unit 20 transmits the image signal of the captured image to the image signal output unit 20 of the image communication device 10a connected via the communication network 24, and captures the image signal by the imaging unit 18 of the image communication device 10a. The received image signal of the image of the person A (the conversation partner of the person B) can be received and displayed on the display unit 15.
Note that the image (real image) formed on the imaging surface 23 cannot be seen from each imaging unit 18, and clear images can be obtained by directly imaging the persons A and B from the front, respectively. Also, the mounting holes 19 formed in each optical imaging means 16 are small and are closed by mounting each imaging means 18, so that light does not pass through each mounting hole 19 and the person A, It does not affect the image on the image plane 23 viewed by B.

As described above, the image displayed on the display unit 15 of the image communication devices 10a and 10b is formed as a real image in free space by the optical imaging unit 16 (light of the image passes through the optical imaging unit 16). As shown in FIG. 3, an image (real image) 25 of a person B to be a conversation partner is displayed in front of the person A on the image communication device 10a side (the left side in FIG. 3), as shown in FIG. In front of the person B on the communication device 10b side (the right side in FIG. 3), an image (real image) 26 of the person A as a conversation partner is displayed.
At this time, as shown in FIG. 1, the display surface 14 of the display means 15 is arranged horizontally, and the light emitting side of the optical imaging means 16 is arranged obliquely upward at an inclination angle of 45 degrees above the display means 15. As a result, the imaging plane 23 is in a vertical plane. The imaging direction of the imaging means 18 attached to the mounting hole 19 of the optical imaging means 16 is horizontal, and is inclined by 45 degrees with respect to the surface of the optical imaging means 16. Is vertical. Therefore, the persons A and B interacting directly with the images 25 and 26 on the imaging plane 23 can be directly imaged from the front by the imaging means 18 and displayed on each display means 15 and displayed on the display means 15. Accordingly, the image 25 of the person B and the image 26 of the person A to be imaged have less discomfort and the direction of the line of sight can be easily checked.

As shown in FIG. 2, each image signal output unit 20 has a common image creation unit 27, and can create a common image 28 that is commonly displayed on each display unit 15. If necessary, the common image 28 is combined with the image 25 of the person B and the image 26 of the person A and displayed on each display unit 15, and as shown in FIG. The common image 28 can be superimposed and displayed at the same position and in the same direction on the image 25 and the image 26 of the person A. Note that the common image 28 is mainly a material image such as a photograph or a document. The common image creation unit 27 includes, for example, an image signal output unit 20 in addition to input devices such as a camera, a keyboard, a touch pen, and a scanner. The program to be executed is also included. The creation of the common image 28 by the common image creation means 27 means, for example, storing a photograph taken by a camera, a document or illustration input from a keyboard or a touch pen in a RAM or the like of the image signal output means 20, And images are captured by a scanner as an image and stored in a RAM or the like of the image signal output means 20. Not only can various types of processing be performed on the image, but also a photograph or a document created in advance and stored in a storage medium such as a USB memory can be used. Data selection and reading (copying) are included.

The creation of the common image 28 and the synthesis of the image 26 of the person A and the image 25 of the person B with the common image 28 are selectively performed by any one of the common image creation means 27. For example, when the person B on the image communication device 10b creates (selects) an image to be displayed as the common image 28 by the common image creating unit 27, the image 26 of the person A and the common image 28 received by the image signal output unit 20 are combined. The image is synthesized and displayed on the display means 15 of the image communication device 10b, and the common image signal of the common image 28 is also superimposed on the image signal to be sent to the conversation partner (the person A). The image 25 of the person B and the common image 28 are combined and displayed on the display means 15. At this time, in order to match the positional relationship between the persons A and B and the common image 28, the image 26 of the person A and the image 25 of the person B are horizontally reversed as necessary. In this case, the image signal output means 20 (transmitting side) inverts the image 26 of the person A and the image 25 of the person B in advance left and right, and transmits the image signals to the image signal output means 20 of the other party. Alternatively, after transmitting the image signals of the image A of the person A and the image 25 of the person B from each image signal output means 20 to the image signal output means 20 of the other party, the image signal output of the other party (receiving side) may be performed. The means 20 may be reversed.

As shown in FIG. 3, when the common image 28 is displayed at the same position on each imaging plane 23, the persons A and B face each other as if facing each other with the common image 28 interposed therebetween. You can talk and observe each other's actions from the front. Then, the actions performed by the persons A and B on the common image 28 on each image plane 23 are displayed in accordance with the position and orientation of the common image 28 displayed on the image plane 23 of the conversation partner. This makes it possible to reliably confirm the common image 28 and the like by following the eyes movements and gestures of the conversation partners with each other. For example, as shown in FIG. 3, the person A can easily confirm on the image plane 23 where the person B is pointing in the common image 28, and smoothly make eye contact. Can talk. Further, the persons A and B can point at the same position on the imaging plane 23 from both sides, and can confirm the state on the imaging plane 23, so that the communication can be performed with gestures. Can be planned. The common images 28 are displayed like small windows, and the number, size, and arrangement of the common images 28 can be appropriately selected.

As shown in FIGS. 1 and 2, each of the image communication devices 10a and 10b has a detection unit 29 that detects the operation of the person A or B at each point (own point). Then, the image signal output unit 20 can operate (process) the common image 28 based on the operation detected by the detection unit 29 and display it on the display unit 15. For example, when the person A performs an operation of enlarging the common image 28, the detection unit 29 of the image communication device 10a detects the operation, and the image signal output unit 20 of the image communication device 10a converts the common image 28. Perform the operation (processing) to enlarge. Then, the enlarged common image 28 is displayed on the display unit 15 of the image communication device 10a, and the common image signal is superimposed on the image signal of the image 26 of the person A, and the image of the image communication device 10a is The signal is output from the signal output unit 20 to the image signal output unit 20 on the image communication device 10b side, and is displayed on the display unit 15 on the image communication device 10b side. Thus, the persons A and B at each point can proceed with the conversation while viewing the common image 28 which is similarly enlarged.
In particular, the detection means 29 that focuses on the images (real images) 25 and 26 and detects the position and movement of the hand or finger of the person A or B on the imaging plane 23 has excellent movement detection performance. The size and position of the common image 28 can be adjusted by the signal output means 20 and displayed on the display means 15, and the operability is excellent. As such a detecting means 29, an infrared motion sensor or the like is suitably used. Note that the processing in the image signal output unit 20 is realized by the CPU executing a predetermined program. However, the operation of the hand or the finger is associated with the image operation command in advance, and the enlargement of the common image 28 is performed. , Operations such as reduction, movement, and rotation can be performed. Thereby, conversation can be smoothly advanced using the common image 28.

Next, the optical imaging means 16 will be described.
As shown in FIGS. 4A and 4B, the optical imaging means 16 includes a first light control unit 31 having a plurality of light reflecting surfaces 30 and a second light having a plurality of light reflecting surfaces 32. The first and second light control units 31 and 33 are superposed and arranged (integrated) in the thickness direction such that the light reflection surfaces 30 and 32 are orthogonal to each other in a plan view. It is a thing.
The first light control unit 31 includes a plurality of triangular grooves 37 having an inclined surface 35 and a vertical surface 36 on one side of the first transparent plate member 34, and a cross section formed between adjacent grooves 37. A plurality of triangular protrusions 38 are arranged at a predetermined pitch, and the light reflection surface 30 formed of a mirror surface (metal reflection surface) is formed only on the vertical surface 36 of each groove 37. The bottom of the groove 37 (between the lower end of the inclined surface 35 and the lower end of the vertical surface 36) and the top of the ridge 38 (between the upper end of the inclined surface 35 and the upper end of the vertical surface 36) Plane portions 39 and 40 are formed.

Further, the second light control unit 33 is formed on the other side of the second transparent plate member 41 between a plurality of grooves 44 having a triangular cross section having an inclined surface 42 and a vertical surface 43 and between adjacent grooves 44. A plurality of ridges 45 each having a triangular cross section are arranged at a predetermined pitch, and the light reflection surface 32 formed of a mirror surface (metal reflection surface) is formed only on the vertical surface 43 of each groove 44. The bottom of the groove 44 (between the lower end of the inclined surface 42 and the lower end of the vertical surface 43) and the top of the ridge 45 (between the upper end of the inclined surface 42 and the upper end of the vertical surface 43) Flat portions 46 and 47 are formed.

The grooves 37 and 44 arranged opposite to each other are filled with a transparent resin 48.
The refractive indices η1 and η2 of the first and second transparent plate members 34 and 41 are the same, and the refractive index η3 of the transparent resin 48 filled therebetween is the refractive index of the first and second transparent plate members 34 and 41. It is preferable that the ratio is in the range of 0.8 to 1.2 times (more preferably 0.9 to 1.1 times, more preferably 0.95 to 1.05 times) the ratios η1 and η2.
Examples of the transparent resin as a raw material of the first and second transparent plate members 34 and 41 include cycloolefin polymer, polymethyl metal crate (acrylic resin), amorphous fluororesin, PMMA, polycarbonate for optical use, fluorene polyester, Although a thermoplastic resin such as polyethersulfone can be used, a resin having a high melting point and high transparency is particularly preferably used.

As a method of forming a mirror surface (metal reflection surface), a method of directly performing sputtering, metal deposition, spraying of metal fine particles, irradiation of an ion beam, application of a metal paste, and the like to the vertical surfaces 36 and 43 of the grooves 37 and 44 is used. Is preferably used, but a resin film having a reflective film formed thereon by sputtering, metal evaporation, or the like may be attached to the vertical surfaces 36, 43 of the grooves 37, 44. In the case where sputtering, metal deposition, spraying of metal fine particles, ion beam irradiation, or the like is performed directly on the vertical surfaces 36, 43 of the grooves 37, 44, the vertical surfaces 36, 43 are obliquely placed from above in vacuum or under low pressure. The metal particles are irradiated toward 43. At this time, since the minute flat portions 39 and 46 are formed at the bottoms of the grooves 37 and 44, respectively, the metal particles are prevented from adhering to the inclined surfaces 35 and 42 while reducing or eliminating the adhesion to the lower ends of the vertical surfaces 36 and 43. Irradiation of metal particles can be performed without spots. In addition, instead of forming the inclined surfaces 35 and 42 of the grooves 37 and 44 in a planar shape, a polygonal surface having a polygonal cross section depressed inside the ridges 38 and 45, a concave surface having an arc cross section, or a large number of minute surfaces on the surface. As an uneven surface having irregularities (flaws), adhesion of metal particles may be prevented.

As a method of integrating the first and second light control units 31 and 33 by filling the grooves 37 and 44 with the transparent resin 48, one side of the first light control unit 31 and the second light control unit In the state where the other side of 33, that is, the side on which the respective grooves 37 and 44 are formed is arranged so as to face each other, the first and second transparent plate members 34 and 41 have a melting point between them. May be sandwiched, and heated and pressed in a vacuum state to dissolve and solidify only the transparent resin. Alternatively, a transparent adhesive made of a transparent resin may be separately applied to each of the grooves 37 and 44. The transparent adhesive may be cured by filling and facing the grooves 37 and 44 of the first and second light control units 31 and 33 and abutting each other. As the transparent adhesive, a thermosetting adhesive or a two-component adhesive can be used in addition to a photocuring adhesive which is cured by irradiating ultraviolet rays or the like. In particular, in order to make the refractive index η3 close to the refractive indexes η1 and η2, an optical adhesive made of a refractive index adjusting resin whose refractive index has been adjusted is preferably used.
When the inclined surface of each groove is a polygonal surface, a concave surface, an uneven surface, or the like, the adhesion between the inclined surface and the transparent resin filled in the groove is increased by the anchor effect, and the inside of the groove is transparent with the transparent resin. Filling can eliminate irregularities. As a result, light can be transmitted without generating irregular reflection (scattering) at the interface between the inclined surface and the transparent resin, and refraction can be minimized to obtain a bright and clear three-dimensional image.

Next, the operation of the optical imaging means 16 will be described.
In FIG. 1, when an image is displayed on the display means 15, the light is emitted toward the optical imaging means 16. As shown in FIGS. 4A and 4B, when the light L1 enters the second light control unit 33 of the optical imaging unit 16 at the position P1, the light L1 is reflected on the light reflecting surface 32. And enters the first light control unit 31. Then, after being reflected at the position P3 of the light reflecting surface 30, the light goes out of the first light control unit 31 into the air at the position P4 to form an image. Here, light enters the transparent resin 48 from the second transparent plate member 41 in Q1 of FIG. 4A and enters the first transparent plate member 34 from the transparent resin 48 in Q2 in FIG. 4A. , 41 have the same refractive index η1 and η2 and are close to (substantially equivalent to) the refractive index η3 of the transparent resin 48, so that phenomena such as total reflection and spectral separation do not occur. Also, in S1 of FIG. 4B, light enters the transparent resin 48 from the second transparent plate 41 and from the transparent resin 48 to the first transparent plate 34 in S2. Since the refractive indices η1 and η2 of 41 are the same and approximate (substantially equivalent) to the refractive index η3 of the transparent resin 48, phenomena such as total reflection and spectral separation do not occur.
Although refraction occurs at the positions of P1 and P4, the refraction of P1 and P4 cancels out. The light reflecting surfaces 30 and 32 can be made to function as light reflecting surfaces on both front and rear surfaces (left and right in FIGS. 4A and 4B).

In the process of forming the first and second light control units 31 and 33, a metal reflection film is formed on the minute plane portions 40 and 47 formed on the tops of the vertical surfaces 36 and 43. When this metal reflection film is formed, a minute light reflecting surface exists in the optical imaging means 16, and the imaging performance of the optical imaging means deteriorates. Therefore, the metal reflection film formed on the minute plane portions 40 and 47 is removed, or the front and back surfaces of the metal reflection film are colored black (an example of a light absorbing color) so that the light reflection surface is not formed. Is preferred.

Next, an image communication method using the image communication devices 10a and 10b according to the first embodiment of the present invention will be described.
In the image communication method, as shown in FIGS. 1 to 3, persons A and B existing at each point use an image communication device 10 a or 10 b arranged at each point to have a conversation via an image. Is what you do. That is, the person A uses the image communication device 10a to convert the image of the conversation partner (person B) displayed on the display unit 15 into a real image on the imaging surface 23 in free space by the planar optical imaging unit 16. A person A interacting with the real image of the free space is imaged by the imaging means 18 attached to the central part on the light emission side of the optical imaging means 16, and an image signal of the captured image is transmitted to the other party (person B). To the image communication device 10b. Similarly, the person B uses the image communication device 10b to display the image of the conversation partner (person A) sent from the image communication device 10a on the display unit 15, and displays the displayed image on a planar optical imaging unit. 16, an image is formed as an actual image on an image forming surface 23 of the free space, and a person B interacting with the real image of the free space is imaged by the imaging means 18 attached to the central part on the light emission side of the optical imaging means 16. The image signal of the image is sent to the image communication device 10a on the side of the conversation partner (person A). As described above, the image 25 of the person B and the image 26 of the person A are mutually transmitted and received, and the real image and each of the persons A and B interact with each other. , It is possible to have a conversation with eyes, and to achieve smooth communication by eye contact or gesture.
In FIG. 1, the display unit 15, the imaging unit 18, the speaker 21, the microphone 22, the detection unit 29, and the image signal output unit 20 are connected by necessary cables 50 to 54, such as signal cables. However, if wireless connection is possible, the cable can be omitted.

In the present embodiment, as shown in FIG. 1, the optical imaging means is arranged above the display surface 14 such that the light-emitting side is obliquely upward. The position of the display unit 15, the optical imaging unit 16, the imaging unit 18, and the detection unit 29 is turned upside down (rotated by 180 degrees) so that the light output side of the optical imaging unit 16 is obliquely downward. It may be arranged as follows. Further, the positional relationship of the above configuration is rotated by 90 degrees about the axis of the imaging unit 18 (the rotation direction may be clockwise or counterclockwise), and the display surface of the display unit is disposed in the vertical direction. On the other hand, the optical imaging means may be arranged so that the light output side is obliquely horizontal.

Next, with reference to FIG. 5, image communication apparatuses 55a and 55b according to a second embodiment of the present invention will be described. The same components as those in the first embodiment are denoted by the same reference numerals, and description thereof will be omitted.
The image communication devices 55a and 55b are different from the first embodiment in that the display means 15 and the detection means 29 are arranged upside down, and the optical imaging means 16a is displayed below the display means 15. The light emitting side is obliquely arranged at an inclination angle of 45 degrees with respect to the display surface 14 of the means 15 so as to be inclined downward, and the mounting surface is not formed at the central part of the light emitting side of the optical imaging means 16a. This is the point that the imaging means 18a is attached to the (light emission side), and the operation, the obtained operation, and the effect are the same as those of the first embodiment. At this time, the cable 51 connected to the imaging unit 18a can be hung downward as it is, or can be arranged along the surface or the outer surface of the optical imaging unit 16a. This does not hinder the formation of a real image on the image plane 23, and the persons A and B can visually recognize the real image formed on the image plane 23. However, when the cable 51 is hung downward, when the detecting means 29 detects the position and movement of the hand or finger of the person A or B on the image plane 23, the detection is performed so that the cable 51 is not in the way. The positional relationship between the means 29 and the cable 51 is considered. For example, the detecting means 29 may be shifted in the width direction (left-right direction) of the optical imaging means 16a so that the cable 51 does not overlap the front of the detecting means 29, or the detecting means 29 may be arranged on the front side (forming side) of the cable 51. (The image plane 23 side).

In particular, when the imaging unit 18a is small (thin), the imaging unit 18a can be attached to the surface of the optical imaging unit 16a where no attachment hole is formed as in the present embodiment. In the present embodiment, the light output side of the optical imaging means 16a is disposed obliquely downward below the display surface 14 with respect to the display means 15 in which the display surface 14 is disposed horizontally downward. 15. The positional relationship among the optical imaging means 16a, the imaging means 18a, and the detection means 29 is turned upside down (rotated by 180 degrees), and the light exit side of the optical imaging means 16a is directed obliquely upward as in the first embodiment. May be arranged. Further, the positional relationship of the above configuration is rotated by 90 degrees around the axis of the imaging unit 18a (the rotation direction can be clockwise or counterclockwise), and the display surface of the display unit is arranged in the vertical direction. On the other hand, the optical imaging means may be arranged so that the light output side is obliquely horizontal.

Next, image communication devices 56a and 56b according to a third embodiment of the present invention will be described with reference to FIG.
The difference between these image communication devices 56a and 56b from the first embodiment is that the installation angle of the display means 15 is inclined with respect to the horizontal plane, and the inclination angle of the optical imaging means 16b is changed accordingly. A mounting hole 19a for inserting the cable 51 of the imaging means 18a is formed in the central part on the light emission side of the optical imaging means 16b, and the imaging means 18a is mounted on the surface (light emission side). The operation and the operation and effect obtained are the same as in the first embodiment. As described above, even when the installation angle of the display unit 15 is not horizontal but is inclined, the imaging plane 23 can be made vertical by appropriately selecting the inclination angle of the optical imaging unit 16b. Further, the cable 51 of the imaging means 18a is inserted through the mounting hole 19a and taken out from the rear side (light incident side) of the optical imaging means 16b, so that the cable 51 is located on the front side (light emission side) of the optical imaging means 16b. It is not exposed and has excellent handleability. At this time, the cable 51 taken out from the mounting hole 19a can be pulled out backward or downward as it is, or can be arranged along the back surface or the outer side surface of the optical imaging means 16b. 16b does not hinder the formation of the real image on the image plane 23, and the persons A and B can visually recognize the real image formed on the image plane 23. The mounting hole 19a through which only the cable 51 is inserted is small, and processing can be easily performed.

In the present embodiment, the display means 15 is arranged such that the display surface 14 is upward and inclined with respect to the horizontal plane. However, as in the first embodiment, the display surface 14 is directed upward and horizontal. The display means 15 may be disposed on the display surface 14, and the optical imaging means 16 b may be disposed obliquely above the display surface 14 so that the light exit side is obliquely upward, or the display surface 14 may be disposed similarly to the second embodiment. The display means 15 may be arranged so that the image is downward and horizontal, and the optical imaging means 16b may be arranged obliquely below the display surface 14 so that the light exit side is obliquely downward. In addition, the positional relationship between the display unit 15, the optical imaging unit 16b, the imaging unit 18a, and the detection unit 29 in the present embodiment can be inverted upside down (rotated 180 degrees) around the axis of the imaging unit 18a. It can also be rotated by degrees (rotation can be clockwise or counterclockwise).

As described above, the embodiments of the present invention have been described. However, the present invention is not limited to the configurations described in the above embodiments, and can be considered within the scope of the matters described in the claims. Other embodiments and modifications are also included.
In the above embodiment, the case where the image communication device according to the present invention is installed at both of the two points where communication is performed has been described. However, it is not always necessary to install the image communication device at both, and one device is Display means (display) for receiving an image signal sent from the other image communication device and displaying an image of a person to be a conversation partner; imaging means (camera) for imaging a person looking at the display means; What is necessary is just to have only the image signal output means for transmitting the image signal of the image captured in the above to the image communication device via the communication network. As such a device, for example, a portable terminal such as a smartphone with a general-purpose camera or a personal computer can be used.

Further, in the above-described embodiment, the case where communication is performed between two points has been described, but communication can be performed between three or more points. When communication is performed between three or more points, it is necessary to appropriately select and switch an image of a person at another point displayed on the display means at each point. For example, when persons A, B, and C communicate at three points, when the person A is speaking, it is preferable to display an image of the person A on the display means on the persons B and C side. At this time, the person A who is speaking or the persons B and C who are listening to the speech may be manually selected and switched so that the image of the person A is displayed. When the voice of A is detected, the image of the person A is transmitted from the image signal output means on the person A side to the image signal output means on the persons B and C side, and displayed on the respective display means. Can also be automated. It is preferable that an image of the person B or C is displayed on the display means on the side of the person A. At this time, the image of the person B or C to be displayed may be automatically or periodically switched by the image signal output means on the person A side, or the person A The image of the person B or C may be manually selected and switched.

In the above embodiment, the installation angle of the display unit and the inclination angle of the optical imaging unit are set so that the image forming plane on which the real image is formed is vertical. However, according to the posture of the person (the direction of the line of sight), The actual image (imaging plane) may be tilted, and the installation angle of the display means and the tilt angle of the optical imaging means can be appropriately selected. Further, between the display means and the optical imaging means, if necessary, a magnifying means using a convex lens or another lens may be arranged. Since the image displayed on the display means can be enlarged by the enlargement means and then formed as a real image by the optical imaging means, the size of the display means can be reduced.
Further, in the above-described embodiment, the detection means (infrared motion sensor or the like) that focuses on a real image and detects the position and movement of a person's hand or finger on an imaging surface has been described. As a detecting means, an optical sensor provided with a sensor element for detecting only light from the front side is arranged on a surface (display surface) of the display means, and a light from a hand or a finger touching the imaging surface is provided. The reflected light forms a real image on the display means via the optical imaging means, and the position of the real image can be detected by an optical sensor. Further, as a detecting means, a means for detecting a voice or a sound can be used in addition to a means for detecting a motion of a finger or a hand of a person.

Further, in the above-described embodiment, the optical imaging unit is arranged such that the front sides (the surfaces on which the grooves are formed) of the first and second light control units are in contact with each other. It is only necessary that the light reflecting surfaces of the first and second light control units are orthogonally arranged in a plan view. Therefore, the first and second light control units may be arranged so that the front side and the back side are in contact with each other, or the first and second light control units may be arranged so that the back sides are in contact with each other. Further, instead of separately forming and joining the first and second light control units to two transparent plate members, the first and second light control units may be formed on both surfaces of one transparent plate member. it can.
Instead of forming a mirror surface (metal reflection surface) on the vertical surface of each groove of the first and second light control units, a gas such as air is sealed in the groove, or the inside of the groove is evacuated. If the total reflection of light is utilized, the vertical surface of each groove can be used as it is as a light reflecting surface.
Further, in the above embodiment, the optical imaging means is described in which the plurality of light reflecting surfaces of the first and second light control units are respectively arranged in a straight line (parallel). It is also possible to use one having a first light control unit whose surfaces are radially arranged and a second light control unit whose plurality of light reflecting surfaces are arranged concentrically. In this case, the radial light reflecting surface of the first light control unit is provided linearly around the reference point X, whereas the concentric light reflecting surface of the second light control unit is viewed in plan. The light reflecting surfaces are curved along a concentric circle centered on the reference point Y overlapping the reference point X, but are orthogonal to each other at a point where the light reflection surfaces intersect in plan view. Therefore, a three-dimensional image can be formed as in the above embodiment.
Further, as an optical imaging means, for example, as described in Japanese Patent No. 5437436, a first having a large number of strip-shaped reflective surfaces formed side by side (for example, at the same pitch) perpendicular to one surface. Alternatively, an optical imaging unit in which the second light control units are arranged so as to overlap each other so that the respective strip-shaped reflecting surfaces are orthogonal to each other in a plan view can be used.

Advantageous Effects of Invention The image communication apparatus and the image communication method according to the present invention are capable of communicating with each other in a distant place by adjusting their eyes when communicating with each other through an image, and allowing the conversation to proceed smoothly. It can be used effectively in meetings) and video chats.

10a, 10b: image communication device, 14: display surface, 15: display means, 16, 16a, 16b: optical imaging means, 18, 18a: imaging means, 19, 19a: mounting hole, 20: image signal output means, 21: speaker, 22: microphone, 23: image plane, 24: communication network, 25, 26: image (real image), 27: common image creation unit, 28 common image, 29: detection unit, 30: light reflection surface, 31: first light control unit, 32: light reflection surface, 33: second light control unit, 34: first transparent plate material, 35: inclined surface, 36: vertical surface, 37: groove, 38: convex stripe 39, 40: minute plane portion, 41: second transparent plate material, 42: inclined surface, 43: vertical surface, 44: groove, 45: convex stripe, 46, 47: minute plane portion, 48: transparent resin, 50 -54: cable, 55a, 55b: image communication device, 56a, 56b Image communication device, 80: reflective imaging element, 81: display device, 82: aerial image, 83: user, 84: camera, 86: display device, 87: half mirror, 88: user, 89: camera, 90: plate material, 91: reflective surface

Claims (8)

Display means for receiving an image signal and displaying an image of the conversation partner; planar optical imaging means for forming the conversation partner image displayed on the display means as a real image in free space; and In an image communication device having an imaging unit that captures a person interacting with a real image and an image signal output unit that sends an image signal of an image of a person captured by the imaging unit to the conversation partner,
The image communication device is characterized in that the imaging means is attached to a central part on the light emission side of the optical imaging means. 2. The image communication apparatus according to claim 1, wherein a mounting hole for mounting said image pickup means is formed in a central portion of said optical image formation means. 3. The image communication apparatus according to claim 1, wherein the optical imaging means is arranged with the light output side obliquely upward, obliquely downward, or obliquely horizontal. 4. The image communication apparatus according to claim 1, wherein the image signal output unit has a common image creation unit, and combines the image of the conversation partner with the common image created by the common image creation unit. An image communication device for displaying on the display means, and superimposing a common image signal of the common image on an image signal to be sent to the conversation partner. 5. The image communication apparatus according to claim 4, wherein the image of the person sent to the conversation partner by the image signal output unit is horizontally inverted. The image communication device according to claim 4, further comprising a detection unit configured to detect a motion of the person, wherein the image signal output unit operates the common image based on the motion detected by the detection unit. Characteristic image communication device. The image of the conversation partner displayed on the display means was formed as a real image in free space by the planar optical imaging means, and a person interacting with the real image of the free space was imaged by the imaging means, and imaged by the imaging means. An image communication method for transmitting an image signal of a person image to the conversation partner,
The image communication method according to claim 1, wherein the imaging unit is attached to a central portion on the light emission side of the optical imaging unit, and images a person interacting with the real image of the free space from the front. 8. The image communication method according to claim 7, wherein an image of the conversation partner and a common image are combined and displayed on the display unit, and a common image signal of the common image is superimposed on an image signal sent to the conversation partner. An image communication method comprising:

Images