WO2019138592A1 - Dispositif de transmission d'image et procédé de transmission d'image - Google Patents

Dispositif de transmission d'image et procédé de transmission d'image Download PDF

Info

Publication number
WO2019138592A1
WO2019138592A1 PCT/JP2018/017451 JP2018017451W WO2019138592A1 WO 2019138592 A1 WO2019138592 A1 WO 2019138592A1 JP 2018017451 W JP2018017451 W JP 2018017451W WO 2019138592 A1 WO2019138592 A1 WO 2019138592A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
person
displayed
half mirror
common
Prior art date
Application number
PCT/JP2018/017451
Other languages
English (en)
Japanese (ja)
Inventor
尚文 田中
康弘 大西
Original Assignee
株式会社アスカネット
株式会社メディアタージ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社アスカネット, 株式会社メディアタージ filed Critical 株式会社アスカネット
Priority to JP2018550492A priority Critical patent/JP6450893B1/ja
Publication of WO2019138592A1 publication Critical patent/WO2019138592A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to an image communication apparatus and an image communication method capable of performing teleconferencing (video conference), video chat, and the like in real time through a plurality of points via an image (real image).
  • a video conference system a video telephone system, etc. are known as a technique for people (communicators) who exist in a remote place to have a conversation through an image (video).
  • an image including the face of each person is taken interactively at each point by a video camera or the like, transmitted to a remote point, and displayed on a display means (display device, display) Enables conversation between remote points.
  • Such a two-way communication system with a remote location is rapidly advancing along with the recent increase in communication line capacity represented by broadband and improvement in performance of control devices, and high-quality color images along with voice in real time. Two-way communication is possible, and in particular, use in the business field is becoming common.
  • Patent Document 1 a configuration in which an imaging device such as a video camera or a web camera is installed above the display device is adopted, and the communicator in conversation is upward I'm looking down from the image.
  • the correspondent talks while looking at the image of the other party of communication mainly displayed on the display device, not the imaging device. Therefore, the imaging direction by the imaging device and the direction (line of sight) of the line of sight of the communicator are different, and the image of the communication partner is displayed on the display device with the line of sight facing downward.
  • the correspondents can not line up their eyes with each other, which makes the conversation unnatural, makes it difficult to communicate, and lacks realism and tension.
  • Patent Document 2 when the height at which the imaging apparatus is installed and the height of the eye detected by the height detection unit differ, the three-dimensional video generation unit In order to acquire a three-dimensional image of the user when viewed from a virtual viewpoint at the eye height detected by the height detection unit based on the difference and the distance between the imaging apparatus and the user (communicator) There has been proposed a video display system that performs rendering processing of Further, Patent Document 3 proposes a video conference system having a display for displaying an image of the other party and a camera for capturing an image of a user. In this video conference system, as shown in FIG.
  • the image of the other party displayed on the display device 81 is formed as an aerial image 82 in space using a reflective imaging element (an example of an optical imaging means) 80.
  • the user 83 who observes the aerial image 82 is imaged by the camera 84 provided on the reflective imaging element 80, and the imaged image is sent to the other party's video conference system using the communication means along with the voice. ing.
  • Patent Document 2 in order to ensure that the eye heights of the communicators who talk with each other in motion are matched with each other, the height of the communicator eyes is extracted by the height detection unit while constantly extracting the video of the communicator.
  • the 3D video generation unit Each time the height of the communicator's eyes or the distance between the imaging device and the communicator changes, the 3D video generation unit must create a 3D video and switch the video on the display screen. It does not. Since these controls are complicated and time-consuming, it is difficult to match the movement of the actual correspondent with the image displayed on the display device, and the time difference may cause discomfort.
  • the teleconferencing system described in the embodiment of Patent Document 3 assumes that the user 84 is photographed directly by the camera 84 without using an optical element such as a half mirror or a polarization beam splitter, By disposing the camera 84 for capturing the image 83 at a position farther from the user 83 than the aerial image 82, the deviation angle ⁇ between the viewing direction of the user 83 and the capturing direction of the camera 84 I try to make it as small as I can not feel. For this reason, the distance from the user 83 to the aerial image 82 and the distance from the user to the camera 84 must be properly managed.
  • the distance from the user 83 to the camera 84 is long
  • the finger of the user 83 does not reach the aerial image 82, pointing to the aerial image 82, or touch input. There was a problem that it was difficult to do.
  • the distance to the camera 84 also becomes close, and the deviation angle ⁇ between the viewing direction of the user 83 and the shooting direction of the camera 84 As a result, the communication partner and the line of sight of the user become out of line, and in some cases, the face of the user 83 can not be clearly captured by the camera 84, which causes a problem of lack of versatility and operability.
  • only the camera 84 is used without moving the position of the formation portion of the aerial image 82. In the case of moving away from the person 83, the dimension in the depth direction of the device increases and a large installation space is required, which causes a problem of lack of compactness and ease of installation.
  • Patent Document 3 proposes a video conference system using a half mirror.
  • An example of this video conference system is shown in FIG. 9A, and the image of the other party displayed on the display device 86 is observed through a half mirror 87 arranged at an inclination of 45 degrees, and the user is viewed through the half mirror 87.
  • the image 88 is taken by the camera 89 and sent to the other party's video conference system.
  • the optical element such as the half mirror 87 generally has wavelength dependency, the color of the image taken by the camera 89 becomes unnatural, and the image quality of the image displayed on the other party is low. It is stated that there is a problem.
  • a partial cross section of the half mirror 87 is shown in FIG. 9B, but a reflective surface 91 having a light transmittance of 40 to 60% is formed by the metal layer forming the half mirror 87 on the back surface of the transparent plate 90 having a thickness. ing.
  • the light D1 from the display device 86 enters the plate member 90 as indicated by D2, and is emitted to the user side as indicated by D3. Furthermore, as indicated by D 4, there is also light that is repeatedly reflected on the back side of the surface of the plate 90 and reaches the user 88.
  • the light E1 from the user 88 which is separately illuminated, is reflected to the camera side by the reflecting surface 91 as shown at E2, but a part thereof becomes light E3 and enters the plate 90, and the plate 90
  • the plate 90 In addition to light exiting from the surface side of the plate as F1, there are also those that are reflected on the back side of the surface of the plate 90 and become E4 and E5 to reach the camera 89, and further, as shown at E6, those that are reflected repeatedly and reach the camera 89 . Therefore, there is a problem that images are taken in multiples and a clear image can not be obtained.
  • the above problem is a problem that occurs notably when the half mirror 87 is thick. Such a problem is, for example, the same as in Patent Document 4, and is a problem commonly occurring if a thick half mirror is used in an inclined manner. Note that F1 and F2 indicate unnecessary light that exits the plate 90 to the outside.
  • An object of the present invention is to provide an image communication apparatus and an image communication method which can communicate smoothly by contacts and gestures and can perform conversation smoothly and is excellent in operability and compactness.
  • an image communication apparatus comprising: display means for receiving an image signal and displaying an image of the other party; and displaying an image of the other party displayed on the display as a real image in free space.
  • image communication apparatus having A half mirror is laminated 1) through a transparent film or 2) directly on the light output side of the optical imaging means, and the image of the interactive partner displayed on the display means is displayed by the optical imaging means
  • the image is displayed in the free space via the half mirror, and the imaging of the person by the imaging unit is performed via the half mirror.
  • the image communication device B does not have to have the same configuration as the image communication device A, and it is sufficient if there is a camera for capturing the other party and a display device for displaying the image data of the user captured by the user's camera. .
  • the optical imaging means is disposed with the light output side obliquely upward, obliquely downward, or obliquely lateral.
  • the image signal output unit has a common image creation unit, and the display unit combines the image of the conversation partner with the common image created by the common image creation unit. It is preferable to superimpose the common image signal of the common image on the image signal sent to the conversation partner while being displayed. In this case, it is preferable that the image of the person sent to the conversation partner by the image signal output unit is horizontally reversed.
  • the image communication apparatus may further include detection means for detecting the movement of the person, and the image signal output means may manipulate the common image based on the movement detected by the detection means.
  • the image of the other party displayed on the display means is formed as a real image in free space by the planar optical imaging means, and the person interacting with the real image in the free space is imaged
  • the image of the conversation partner and the common image are combined and displayed on the display means, and the common image signal of the common image is also superimposed on the image signal sent to the conversation partner. Is preferred.
  • the half mirror is also referred to as a beam splitter.
  • the transmittance and the reflectance of the half mirror do not necessarily have to be equal. For example, one having a transmittance of 40 to 60% can be used.
  • An image communication apparatus according to a first aspect of the invention and an image communication method according to the second aspect form an image of a conversation partner displayed on a display means as a real image in a free space via an optical imaging means and a half mirror. Therefore, the person who interacts with the real image can have a conversation as if the other party of the dialogue exists in front of the eyes.
  • the image pickup means can pick up an image of the person from the front through the half mirror disposed on the light exit side of the optical image formation means, and can send the image signal of the picked up image to the conversation partner, A person and a person can meet each other's eyes and can talk in real time, and can aim at smooth communication by eye contact and a gesture.
  • the view direction of the person and the image pickup direction by the image pickup means do not change and are kept constant even if the distance between the person and the real image changes.
  • a person can always be imaged from the front, and has excellent versatility and operability.
  • the half mirror is 1) through the transparent film or 2) directly on the light output side of the optical imaging means Unlike the half mirror using a thick transparent plate, the double reflection from the non-mirror surface is also reduced because the layers are stacked.
  • the thickness of the transparent film is preferably thin, but 10 nm to 10 ⁇ m (more preferably 0.2 ⁇ m to 6 ⁇ m) is practical. Such thin transparent films can be planarized by laminating them on one side of the optical imaging means.
  • the half mirror is directly formed on the surface of the optical imaging means by vapor deposition or the like, the thickness of the half mirror is substantially eliminated, so that a clearer image can be obtained.
  • the imaging of the person by the imaging means is performed via the half mirror disposed on the light output side of the optical imaging means, so the light path is bent and the horizontal from the person to the imaging means
  • the image communication device can be made compact by shortening the directional distance, and space saving and installation freedom are also excellent.
  • the angle of the real image to be formed can be inclined to the display means, and in particular, depending on the arrangement (the installation angle) of the display means If the inclination angle of the optical imaging means is selected so that the real image is a vertical plane, the person can face the image (real image) of the conversation partner, there is little distortion of the image, and the visibility can be improved. it can.
  • the conversation partner and the common image are combined and displayed on the display means, and the common image signal of the common image is also superimposed on the image signal sent to the conversation partner, the conversation partner and the person are smooth while viewing the common image simultaneously You can have a conversation.
  • the received image signal and the common image signal can be displayed as they are on the display means, and no special image processing means or image processing step is required, and a general-purpose portable terminal or personal computer is used. Communication with the person at the other end.
  • the side receiving the image signal does not perform image processing or the like, and the image is displayed as it is on a screen (display) of a general-purpose mobile terminal or personal computer. Can be displayed.
  • FIG. 1 is an explanatory view showing a configuration of an image communication apparatus according to a first embodiment of the present invention.
  • (A), (B), (C) is an expanded sectional view of the arrow D part of FIG. 1, respectively. It is a block diagram which shows the structure of the same image communication apparatus. It is explanatory drawing which shows the use condition of the same image communication apparatus.
  • (A) and (B) are respectively a front sectional view and a side sectional view of an optical imaging means in the image communication apparatus. It is an explanatory view showing the composition of the picture communication device concerning the 2nd example of the present invention. It is explanatory drawing which shows the structure of the image communication apparatus based on the 3rd Example of this invention. It is description of the video conference system based on a prior art example.
  • (A), (B) is each operation
  • each of the image communication devices 10a and 10b has a display unit 15 with the display surface 14 facing upward and arranged horizontally, and a display surface 14 of the display unit 15 above the display unit 15.
  • a planar optical imaging means 16 disposed obliquely upward on the light exit side at an inclination angle of 45 degrees, and a half mirror 17 disposed laminated on the light exit side (upper surface) of the optical imaging means 16;
  • the imaging unit 18 is disposed vertically above the display surface 14 so as to face the display surface 14 with the half mirror 17 (optical imaging unit 16) interposed therebetween.
  • a high brightness monitor is preferably used as the display unit 15, and a web camera or the like is preferably used as the imaging unit 18.
  • Each of the image communication apparatuses 10a and 10b has an image signal output unit 20 that transmits and receives an image signal and displays an image on the display unit 15 based on the image signal received from the other party.
  • a RAM As the image signal output unit 20, a RAM, a CPU, a ROM, an I / O, and a conventionally known computing unit (i.e., a computer) having a bus for connecting these elements are preferably used. Then, the CPU executes a predetermined program, whereby the processing of the image signal output unit 20 is realized.
  • a speaker 21 and a microphone 22 are connected to the image signal output unit 20, and conversation can be performed by transmitting and receiving an audio signal.
  • the optical image forming means 16 forms an image displayed on the display means 15 as a real image in a free space (on an image forming surface 23 without substance) on the front side of the half mirror 17.
  • the details of the optical imaging means 16 will be described later.
  • the configuration of the half mirror 17 will be described in more detail with reference to FIG.
  • the half mirror 17 according to the first example shown in FIG. 2A is formed on the upper surface (surface) of a transparent film 17a having a very small thickness (for example, 10 nm to 10 ⁇ m).
  • the half mirror 17 is laminated on the light output side of the optical imaging means 16 via the transparent film 17 a.
  • the half mirror 17 which concerns on the 2nd example shown to FIG.
  • the transparent film 17a having the half mirror 17 formed on one side is laminated on the light output side of the optical imaging means 16 with the front side or the back side.
  • the half mirror 17 is formed directly on the light output side of the optical imaging means 16.
  • the half mirror 17 is formed on the surface of the optical imaging means 16 by chemical reaction, for example, by performing metal deposition on the surface of the optical imaging means 16. Since the half mirror 17 according to the third example does not have a transparent film, it does not cause reflection inside the film, and a clearer image can be captured through the half mirror 17.
  • the image communication apparatus 10 a captures an image of the person A in front of the half mirror 17 (including the first to third examples) with the imaging unit 18 via the half mirror 17. Then, the image signal output unit 20 transmits an image signal of the captured image to the image signal output unit 20 of the image communication apparatus 10b connected via the communication network 24, and the image pickup unit 18 of the image communication apparatus 10b performs half.
  • An image signal of an image of a person B (a person with whom the person A interacts) captured through the mirror 17 can be received and displayed on the display means 15.
  • the image communication apparatus 10 b captures an image of the person B in front of the half mirror 17 with the imaging unit 18 via the half mirror 17. Then, the image signal output unit 20 transmits the image signal of the captured image to the image signal output unit 20 of the image communication apparatus 10a connected via the communication network 24, and the image pickup unit 18 of the image communication apparatus 10a performs half.
  • An image signal of an image of a person A (a person with whom the person B interacts) captured through the mirror 17 can be received and displayed on the display means 15.
  • the image displayed on the display means 15 of the image communication apparatus 10a, 10b is imaged as a real image in a free space via the half mirror 17 by the optical imaging means 16 as described above (the light of the image is Since it passes through the half mirror 17 when it passes through the image means 16 and forms an image, as shown in FIG. 4, the other side of the dialogue is on the front of the person A on the image communication apparatus 10a side (left side in FIG. An image (real image) 25 of the person B as an image of the person B is displayed, and an image (real image) 26 of the person A as a conversation partner is displayed in front of the person B on the image communication apparatus 10b side (right side in FIG. 4).
  • the display surface 14 of the display means 15 is arranged horizontally, and the light exit side of the optical image forming means 16 is arranged obliquely upward at an inclination angle of 45 degrees above the display means 15.
  • the imaging direction of the imaging means 18 disposed vertically above the display surface 14 is vertically downward, inclined 45 degrees with respect to the surface of the half mirror 17, and parallel to the imaging surface 23. Therefore, the persons A and B respectively facing the images 25 and 26 on the imaging surface 23 can be reflected by the half mirror 17 and imaged from the front by the imaging means 18 and displayed on each display means 15,
  • the image 25 of the person B and the image 26 of the person A formed by the optical imaging means 16 have less discomfort, and it becomes easier to confirm the direction of the line of sight.
  • each image signal output unit 20 has a common image creation unit 27 and can create a common image 28 to be displayed in common to each display unit 15.
  • the common image 28 is combined with the image 25 of the person B and the image 26 of the person A and displayed on each display means 15 as needed, as shown in FIG.
  • the common image 28 can be superimposed and displayed at the same position in the same position with respect to the image 25 and the image 26 of the person A.
  • the common image 28 is mainly a document image such as a photograph or a document, and the common image creation unit 27 may be an image signal output unit 20 in addition to input devices such as a camera, a keyboard, a touch pen, and a scanner. It also includes the program to be executed.
  • creation of the common image 28 by the common image creation means 27 includes, for example, saving a picture taken with a camera, a document or an illustration, etc. inputted from a keyboard or a touch pen in the RAM of the image signal output means 20
  • Documents and the like are captured as images by a scanner and stored in the RAM or the like of the image signal output unit 20, and various processing on the images, as well as photographs and documents created in advance and stored in a storage medium such as a USB memory It includes data selection and reading (copying).
  • the creation of the common image 28 and the combination of the image 26 of the person A and the image 25 of the person B with the common image 28 are selectively performed by one of the common image creation means 27.
  • the common image creation means 27 For example, when the person B on the side of the image communication apparatus 10b creates (selects) an image to be displayed as the common image 28 by the common image creation means 27, the image 26 of the person A received by the image signal output means 20 and the common image 28 are The common image signal of the common image 28 is superimposed also on the image signal to be synthesized and displayed on the display means 15 on the image communication device 10b side and sent to the other party of conversation (person A side), thereby the image communication device 10a side The image 25 of the person B and the common image 28 are combined and displayed on the display means 15 of FIG.
  • the image 26 of the person A and the image 25 of the person B are horizontally reversed as necessary.
  • the image signal output means 20 (transmission side) reverses the image 26 of the person A and the image 25 of the person B horizontally in advance, and transmits the image signal to the image signal output means 20 of the other party.
  • the image signals of the image 26 of the person A and the image 25 of the person B may be transmitted from the image signal output means 20 to the image signal output means 20 of the other side, and then the image signal output of the other side (reception side) It may be reversed by means 20.
  • the person A can easily confirm where on the common image 28 the person B is pointing on the imaging surface 23, and while taking eye contact, it can be smoothly performed. I can talk. Furthermore, the persons A and B can point at the same position on the imaging surface 23 from both sides, and the situation can be confirmed on the imaging surface 23 with each other. Can be The common image 28 is displayed like a small window, and the number, size, and arrangement of the common image 28 can be selected as appropriate.
  • each of the image communication apparatuses 10a and 10b has a detection unit 29 that detects an operation of the person A or B at each point (own point). Then, the image signal output unit 20 can operate (process) the common image 28 based on the operation detected by the detection unit 29 and display it on the display unit 15. For example, when the person A performs an operation to magnify the common image 28, the detection unit 29 on the image communication device 10 a detects the operation, and the image signal output unit 20 on the image communication device 10 a detects the common image 28. Perform an operation (process) to expand.
  • the enlarged common image 28 is displayed on the display means 15 on the image communication device 10a side, and the common image signal is superimposed on the image signal of the image 26 of the person A to display the image communication device 10a side It is sent from the signal output means 20 to the image signal output means 20 on the image communication device 10b side and displayed on the display means 15 on the image communication device 10b side.
  • the detection unit 29 focusing on the images (real images) 25 and 26 and detecting the position and movement of the hands and fingers of the persons A and B on the imaging surface 23 is excellent in the detection performance of the movement.
  • the size, position, and the like of the common image 28 can be adjusted by the signal output means 20 and displayed on the display means 15, and the operability is excellent.
  • detection means 29 an infrared motion sensor or the like is suitably used.
  • the processing by the image signal output unit 20 is realized by the CPU executing a predetermined program, but the operation of the hand or finger is associated in advance with the image operation instruction, and the enlargement of the common image 28 is performed. , Reduction, movement, rotation, etc. can be performed. Thus, the conversation can be smoothly advanced using the common image 28.
  • the optical imaging unit 16 includes a first light control unit 31 having a plurality of light reflection surfaces 30 and a second light having a plurality of light reflection surfaces 32.
  • the first and second light control units 31 and 33 are arranged (integrated) in the thickness direction such that the light reflecting surfaces 30 and 32 are orthogonal to each other in plan view. It is
  • the first light control unit 31 is formed on one side of the first transparent plate 34 between a plurality of grooves 37 having a triangular cross section having an inclined surface 35 and a vertical surface 36 and an adjacent groove 37.
  • a plurality of triangular ridges 38 are arranged at a predetermined pitch, and a light reflecting surface 30 formed of a mirror surface (metal reflecting surface) is formed only on the vertical surface 36 of each groove 37.
  • the bottom of the groove 37 (between the lower end of the inclined surface 35 and the lower end of the vertical surface 36) and the top of the ridge 38 (between the upper end of the inclined surface 35 and the upper end of the vertical surface 36) are minute Flat portions 39, 40 are formed.
  • the second light control unit 33 is formed on the other side of the second transparent plate 41 between the plurality of grooves 44 having the inclined surface 42 and the vertical surface 43 and the adjacent grooves 44.
  • a plurality of ridges 45 each having a triangular cross section are disposed at a predetermined pitch, and the light reflecting surface 32 formed of a mirror surface (a metal reflecting surface) is formed only on the vertical surface 43 of each groove 44.
  • the bottom of the groove 44 (between the lower end of the inclined surface 42 and the lower end of the vertical surface 43) and the top of the ridge 45 (between the upper end of the inclined surface 42 and the upper end of the vertical surface 43) are minute Flat portions 46 and 47 are formed.
  • the transparent resin 48 is filled in the grooves 37 and 44 disposed facing each other.
  • the refractive indexes ⁇ 1 and 412 of the first and second transparent plates 34 and 41 are the same, and the refractive index ⁇ 3 of the transparent resin 48 filled therebetween is the refraction of the first and second transparent plates 34 and 41.
  • the ratio ⁇ 1 or ⁇ 2 is preferably in the range of 0.8 to 1.2 times (more preferably 0.9 to 1.1 times, more preferably 0.95 to 1.05 times).
  • transparent resins to be used as the raw materials of the first and second transparent plates 34 and 41 include cycloolefin polymers, polymethylmetallate (acrylic resin), amorphous fluorine resin, PMMA, polycarbonate for optics, fluorene polyester, although thermoplastic resins such as polyether sulfone can be used, those having a high melting point and high transparency are preferably used.
  • a method of forming a mirror surface As a method of forming a mirror surface (metal reflection surface), sputtering, metal deposition, spraying of metal fine particles, irradiation of ion beam, coating of metal paste, etc. are performed directly on the vertical surfaces 36, 43 of the grooves 37, 44
  • a resin film on which a reflective film is formed by sputtering or metal deposition may be attached to the vertical surfaces 36, 43 of the grooves 37, 44.
  • the vertical surface 36 from diagonally above in vacuum or under low pressure. Irradiate the metal particles towards 43.
  • the minute flat portions 39 and 46 are respectively formed at the bottoms of the grooves 37 and 44, the lower end of the vertical surfaces 36 and 43 is reduced or reduced while the metal particles are not attached to the inclined surfaces 35 and 42.
  • the metal particles can be irradiated without spots.
  • the inclined surfaces 35 and 42 of the grooves 37 and 44 are not flat but formed in a polygonal shape having a polygonal cross section which is recessed inward of the ridges 38 and 45, a concave surface having a circular arc shape, or a large number of minute surfaces.
  • the adhesion of the metal particles may be prevented as the uneven surface having the unevenness (ridge).
  • a sheet-like transparent resin having a low viscosity may be sandwiched, heated and pressed in a vacuum state, and only the transparent resin may be dissolved and solidified, or a transparent adhesive made of transparent resin separately in each groove 37, 44
  • the grooves 37 and 44 of the first and second light control portions 31 and 33 may be filled, and the transparent adhesive may be cured by facing and abutting the grooves 37 and 44.
  • thermosetting adhesive or a two-component mixture adhesive can be used in addition to a photo-curing adhesive that is cured by irradiation with ultraviolet light or the like.
  • an optical adhesive made of a refractive index adjusting resin whose refractive index is adjusted is preferably used.
  • the inclined surface of each groove is a polygonal surface, a concave surface, a concavo-convex surface, etc.
  • the adhesion between the inclined surface and the transparent resin filled in the groove is enhanced by the anchor effect, and the groove is transparent resin without a gap.
  • the unevenness can be eliminated by filling.
  • light can be allowed to pass without generating irregular reflection (scattering) at the interface between the inclined surface and the transparent resin, and refraction can also be minimized, and a bright and clear three-dimensional image can be obtained.
  • FIG. 1 when an image is displayed on the display means 15, the light is emitted toward the optical imaging means 16.
  • FIGS. 5A and 5B when the light L1 enters the second light control unit 33 of the optical imaging unit 16 at the position P1, the light L1 is on the light reflection surface 32. The light is reflected at the position of P2 and enters the first light control unit 31. Then, the light is reflected at the position P3 of the light reflecting surface 30, and then it exits from the first light control unit 31 into the air at the position P4 and forms an image.
  • light is incident from the second transparent plate 41 to the transparent resin 48 at Q1 in FIG.
  • the first and second transparent plate 34 Since the refractive indices ⁇ 1 and ⁇ 2 of 41 are the same and approximate to (approximately equal to) the refractive index ⁇ 3 of the transparent resin 48, phenomena such as total reflection and spectroscopy do not occur.
  • the second transparent plate 41 enters the transparent resin 48, and the transparent resin 48 enters the first transparent plate 34 in S2, the first and second transparent plates 34, Since the refractive indexes ⁇ 1 and ⁇ 2 of 41 are the same and approximate to (approximately equal to) the refractive index ⁇ 3 of the transparent resin 48, phenomena such as total reflection and spectroscopy do not occur.
  • refraction occurs at the positions of P1 and P4, the refraction of P1 and P4 cancels out.
  • the light reflecting surfaces 30, 32 can function as light reflecting surfaces either on the front or back (left or right in FIGS. 4A and 4B).
  • a metal reflection film is formed on the minute flat portions 40 and 47 formed on top of the vertical surfaces 36 and 43.
  • a minute reflection film will be present in the optical image forming means 16, and the image forming property of the optical image forming means will be deteriorated. Therefore, the metal reflection film formed on the minute flat portions 40 and 47 is removed, or the front and back surfaces of the metal reflection film are colored black (an example of a light absorbing color) so as not to form a light reflection surface. Is preferred.
  • An image of the person A who is imaged as a real image on the image plane 23 and who interacts with the real image in free space is imaged by the imaging means 18 through the half mirror 17, and the image signal of the imaged image is the image on the conversation partner (person B) side It sends to the communication device 10b.
  • the image of the other party (person A) sent from the image communication device 10a is displayed on the display means 15, and the displayed image is a planar optical imaging means
  • An image obtained by imaging the person B interacting with the real image in free space via the half mirror 17 via the half mirror 17 while forming an image as a real image on the imaging surface 23 in free space via the half mirror 17 Is sent to the image communication apparatus 10a on the side of the conversation partner (person A).
  • the image 25 of the person B and the image 26 of the person A are mutually transmitted and received, and the real image and each person A, B interact with each other, so that the other party of the dialogue exists in front of the eyes It is possible to make a line of sight and have a conversation, and to achieve smooth communication by eye contact and gestures.
  • the image communication apparatus 50a, 50b differs from the first embodiment in that the display means 15, the optical imaging means 16, the half mirror 17, the imaging means 18, and the detection means 29 are arranged upside down. It is a point, and its operation and the obtained action and effect are the same as those of the first embodiment. As long as the detection means 29 focuses on the real image and can detect the position and operation of the hands and fingers of the person A or B on the imaging surface 23, as in the first embodiment, the optical imaging is performed. It may be located above the means 16.
  • the optical imaging means 16 is disposed obliquely upward, whereas in the present embodiment, the display means 15, the optical imaging means 16, the half mirror 17, the imaging means 18, and the detection means 29.
  • the light emitting side of the optical image forming means 16 is disposed obliquely downward by turning upside down (180 degree rotation) of the position relation of the optical image forming means 16, but the position relation of the above configuration in the first embodiment is rotated 90 degrees
  • the display surface can be arranged in the vertical direction, and the optical imaging means can be arranged on the side of the display means so that the light output side is obliquely oriented.
  • the image communication apparatus 51a, 51b differs from the first embodiment in that the installation angle of the display means 15 is inclined with respect to the horizontal plane, and the inclination angle of the optical imaging means 16 is changed accordingly. That is the point.
  • the imaging surface 23 can be made to be a vertical plane by appropriately selecting the inclination angle of the optical imaging unit 16. Further, the operation of the image communication apparatuses 51a and 51b and the obtained operation and effects are the same as in the first embodiment.
  • a display means for receiving an image signal sent from the image communication device and displaying an image of a person who is a dialog partner
  • an imaging means for imaging a person looking at the display means
  • a portable terminal such as a smartphone with a general-purpose camera or a personal computer can be used.
  • the said Example demonstrated the case where it communicated between two points, it is also possible to communicate between three or more points.
  • the person A who is speaking or the person B or C who is listening to the utterance may be manually selected and switched so that the image of the person A is displayed.
  • the image of the person A is transmitted from the image signal output means on the person A side to the image signal output means on the person B, C side, and displayed on each display means. Can also be automated. It is preferable to display the image of the person B or C on the display means on the person A side. At this time, the image of the person B or C to be displayed may be automatically switched periodically or irregularly by the image signal output means of the person A side, for example, according to the contents of the statement by the person A, etc. The image of the person B or C may be selected and switched manually.
  • the installation angle of the display means and the inclination angle of the optical imaging means are set so that the image forming plane on which the real image is formed is vertical, but according to the posture of the person (direction of sight line)
  • the real image (imaging surface) may be inclined, and the installation angle of the display means and the inclination angle of the optical imaging means can be selected appropriately.
  • the installation position of the imaging means can be appropriately changed according to the arrangement and the installation angle of.
  • the detection means one that focuses on a real image and detects the position and operation of a person's hand or finger on an imaging surface (such as an infrared motion sensor) has been described.
  • an optical sensor provided with sensor elements for detecting only light from the front side is installed on the surface (display surface) of the display means, and reflection from the hand or finger touching the imaging surface Light can be formed as a real image on the display means through an optical imaging means, and the position of the real image can be detected by an optical sensor.
  • the detection means in addition to one that detects the movement of a person's finger or hand, one that detects voice or sound can also be used.
  • the optical imaging means one in which the front sides of the first and second light control portions (surfaces on which the grooves are formed) are in contact with each other is used.
  • the light reflecting surfaces of the first and second light control units may be orthogonally disposed in plan view. Therefore, the front and back sides of the first and second light control units may be disposed in contact with each other, or the back sides of the first and second light control units may be disposed in contact with each other.
  • the first and second light control portions instead of separately forming and joining the first and second light control portions to the two transparent plate members, it is also possible to form the first and second light control portions on both sides of one transparent plate member. it can.
  • a gas such as air is sealed in the groove or the inside of the groove is evacuated. If the total reflection of light is used, the vertical surface of each groove can be used as the light reflection surface as it is.
  • the optical imaging means one in which the plurality of light reflecting surfaces of the first and second light control sections are arranged linearly (parallelly) has been described, but a plurality of light reflecting surfaces It is also possible to use one having a first light control unit in which the light emitting devices are arranged radially and a second light control unit in which a plurality of light reflecting surfaces are arranged concentrically.
  • the radial light reflection surface of the first light control unit is provided in a straight line centering on the reference point X, while the concentric light reflection surface of the second light control unit is viewed in plan. And although it curves along the concentric circle centering on the reference point Y which overlaps with the reference point X, both are orthogonally crossed in the point which light-reflecting surfaces intersect in planar view. Therefore, a three-dimensional image can be formed as in the above embodiment.
  • the first, the first, and the second have a large number of strip-shaped reflecting surfaces formed vertically (for example, at the same pitch) on one surface. It is also possible to use an optical imaging means in which the two light control sections are arranged so as to be orthogonal to each other so that the respective strip reflecting surfaces are planarly viewed.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

L'invention concerne un dispositif (10b) de transmission d'image possédant: un moyen (15) d'affichage destiné à recevoir un signal d'image et à afficher une image d'une personne A; un moyen (16) d'imagerie optique plat formant en tant qu'image réelle (26) dans un espace libre, une image d'une personne A, affichée par le moyen (15) d'affichage; un moyen (18) de capture d'image destiné à capturer une image d'une personne B conversant avec l'image réelle (26) de l'espace libre; et un moyen (20) de sortie de signal d'image destiné à envoyer à la personne A un signal d'image d'une image de la personne B telle que capturée par le moyen (18) de capture d'image. Un demi-miroir (17) est disposé côté émission du moyen (16) d'imagerie optique. L'image de la personne A affichée par le moyen (15) d'affichage est affichée dans un espace libre à l'aide du moyen (16) d'imagerie optique et par l'intermédiaire du demi-miroir (17), et la capture d'image de la personne B par le moyen (18) de capture d'image est effectuée par l'intermédiaire du demi-miroir (17).
PCT/JP2018/017451 2018-01-12 2018-05-01 Dispositif de transmission d'image et procédé de transmission d'image WO2019138592A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018550492A JP6450893B1 (ja) 2018-01-12 2018-05-01 画像通信装置及び画像通信方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PCT/JP2018/000664 WO2019138541A1 (fr) 2018-01-12 2018-01-12 Dispositif de transmission d'image et procédé de transmission d'image
JPPCT/JP2018/000664 2018-01-12

Publications (1)

Publication Number Publication Date
WO2019138592A1 true WO2019138592A1 (fr) 2019-07-18

Family

ID=67219437

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/JP2018/000664 WO2019138541A1 (fr) 2018-01-12 2018-01-12 Dispositif de transmission d'image et procédé de transmission d'image
PCT/JP2018/017451 WO2019138592A1 (fr) 2018-01-12 2018-05-01 Dispositif de transmission d'image et procédé de transmission d'image

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/000664 WO2019138541A1 (fr) 2018-01-12 2018-01-12 Dispositif de transmission d'image et procédé de transmission d'image

Country Status (1)

Country Link
WO (2) WO2019138541A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113194175B (zh) * 2021-04-29 2022-12-09 上海闻泰信息技术有限公司 一种移动终端及移动终端的屏下摄像方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05161135A (ja) * 1991-12-09 1993-06-25 Nippon Telegr & Teleph Corp <Ntt> 表示・撮像装置
JP2005287004A (ja) * 2004-03-03 2005-10-13 Canon Inc 画像表示方法、プログラム、画像表示装置及び画像表示システム
WO2011108139A1 (fr) * 2010-03-03 2011-09-09 シャープ株式会社 Système de téléconférence

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05161135A (ja) * 1991-12-09 1993-06-25 Nippon Telegr & Teleph Corp <Ntt> 表示・撮像装置
JP2005287004A (ja) * 2004-03-03 2005-10-13 Canon Inc 画像表示方法、プログラム、画像表示装置及び画像表示システム
WO2011108139A1 (fr) * 2010-03-03 2011-09-09 シャープ株式会社 Système de téléconférence

Also Published As

Publication number Publication date
WO2019138541A1 (fr) 2019-07-18

Similar Documents

Publication Publication Date Title
US10241344B1 (en) Advanced retroreflecting aerial displays
US8384760B2 (en) Systems for establishing eye contact through a display
US9360671B1 (en) Systems and methods for image zoom
US8908008B2 (en) Methods and systems for establishing eye contact and accurate gaze in remote collaboration
CN101213487B (zh) 投影图像显示装置
JP4076090B2 (ja) 画像表示システム
WO2011108139A1 (fr) Système de téléconférence
CN108474956A (zh) 具有可变聚焦的增强现实显示系统
KR20140140063A (ko) 광 가이드 디스플레이 및 시야각
JP2010505146A (ja) 構成要素を照射するための装置及び／又はシステム
Kakeya Realization of undistorted volumetric multiview image with multilayered integral imaging
CN108495103A (zh) 一种电子设备
CN112180607A (zh) 图像显示装置及可穿戴设备
KR20150091902A (ko) 이동 단말기
WO2019138592A1 (fr) Dispositif de transmission d&#39;image et procédé de transmission d&#39;image
JP6336223B1 (ja) 双方向通信システム
JP6450893B1 (ja) 画像通信装置及び画像通信方法
JP2022113411A (ja) 空間浮遊映像表示装置
JP2022100561A (ja) 空間浮遊映像表示装置
JP7101062B2 (ja) 画像通信装置及び画像通信方法
Fujii et al. Aerial video-calling system with eye-matching feature based on polarization-modulated aerial imaging by retro-reflection (p-AIRR)
JP5963637B2 (ja) 撮像装置付き表示装置
Tan et al. Connectboard: Enabling genuine eye contact and accurate gaze in remote collaboration
WO2018149266A1 (fr) Procédé et dispositif de traitement d&#39;informations basés sur la réalité augmentée
JP2012058581A (ja) 電子機器

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2018550492

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18899894

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18899894

Country of ref document: EP

Kind code of ref document: A1