WO2019138541A1 - Dispositif de transmission d'image et procédé de transmission d'image - Google Patents

Dispositif de transmission d'image et procédé de transmission d'image Download PDF

Info

Publication number
WO2019138541A1
WO2019138541A1 PCT/JP2018/000664 JP2018000664W WO2019138541A1 WO 2019138541 A1 WO2019138541 A1 WO 2019138541A1 JP 2018000664 W JP2018000664 W JP 2018000664W WO 2019138541 A1 WO2019138541 A1 WO 2019138541A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
person
imaging means
optical imaging
displayed
Prior art date
Application number
PCT/JP2018/000664
Other languages
English (en)
Japanese (ja)
Inventor
尚文 田中
康弘 大西
Original Assignee
株式会社アスカネット
株式会社メディアタージ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社アスカネット, 株式会社メディアタージ filed Critical 株式会社アスカネット
Priority to PCT/JP2018/000664 priority Critical patent/WO2019138541A1/fr
Priority to JP2018550492A priority patent/JP6450893B1/ja
Priority to PCT/JP2018/017451 priority patent/WO2019138592A1/fr
Publication of WO2019138541A1 publication Critical patent/WO2019138541A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to an image communication apparatus and an image communication method capable of performing teleconferencing (video conference), video chat, and the like in real time through a plurality of points via an image (real image).
  • a video conference system a video telephone system, etc. are known as a technique for people (communicators) who exist in a remote place to have a conversation through an image (video).
  • an image including the face of each person is taken interactively at each point by a video camera or the like, transmitted to a remote point, and displayed on a display means (display device, display) Enables conversation between remote points.
  • Such a two-way communication system with a remote location is rapidly advancing along with the recent increase in communication line capacity represented by broadband and improvement in performance of control devices, and high-quality color images along with voice in real time. Two-way communication is possible, and in particular, use in the business field is becoming common.
  • Patent Document 1 a configuration in which an imaging device such as a video camera or a web camera is installed above the display device is adopted, and the communicator in conversation is upward I'm looking down from the image.
  • the correspondent talks while looking at the image of the other party of communication mainly displayed on the display device, not the imaging device. Therefore, the imaging direction by the imaging device and the direction (line of sight) of the line of sight of the communicator are different, and the image of the communication partner is displayed on the display device with the line of sight facing downward.
  • the correspondents can not line up their eyes with each other, which makes the conversation unnatural, makes it difficult to communicate, and lacks realism and tension.
  • Patent Document 2 when the height at which the imaging apparatus is installed and the height of the eye detected by the height detection unit differ, the three-dimensional video generation unit In order to acquire a three-dimensional image of the user when viewed from a virtual viewpoint at the eye height detected by the height detection unit based on the difference and the distance between the imaging apparatus and the user (communicator) There has been proposed a video display system that performs rendering processing of Further, in Patent Document 3, an aerial image forming unit for forming an image of the other party image displayed on the display device as an aerial image in space is provided, and the camera for photographing the user is at a position farther from the user than the aerial image. A teleconferencing system has been proposed.
  • Patent Document 2 in order to ensure that the eye heights of the communicators who talk with each other in motion are matched with each other, the height of the communicator eyes is extracted by the height detection unit while constantly extracting the video of the communicator.
  • the 3D video generation unit Each time the height of the communicator's eyes or the distance between the imaging device and the communicator changes, the 3D video generation unit must create a 3D video and switch the video on the display screen. It does not. Since these controls are complicated and time-consuming, it is difficult to match the movement of the actual correspondent with the image displayed on the display device, and the time difference may cause discomfort.
  • Patent Document 3 assumes that a camera directly shoots a user without using an optical element such as a half mirror or a polarizing beam splitter, and therefore, a camera for shooting a user is more suitable than an aerial image.
  • an optical element such as a half mirror or a polarizing beam splitter
  • the user's face can not be clearly captured by the camera, and there is a problem of lack of versatility and operability.
  • the device in order to increase the distance from the user to the camera without changing the distance from the user to the aerial image, the device is moved only from the camera without moving the position of the aerial image forming unit. Since the dimension in the depth direction increases and a large installation space is required, there is also a problem of lack of compactness and ease of installation.
  • An object of the present invention is to provide an image communication apparatus and an image communication method which can perform conversation smoothly and have excellent operability and compactness.
  • an image communication apparatus comprising: display means for receiving an image signal and displaying an image of the other party; and displaying an image of the other party displayed on the display as a real image in free space.
  • Planar optical imaging means for imaging; imaging means for imaging a person interacting with a real image in the free space; image signal output means for transmitting an image signal of an image of a person imaged by the imaging means to the conversation partner
  • image communication apparatus having A half mirror is disposed on the light exit side of the optical imaging means, and the image of the other party displayed on the display means is further displayed in the free space by the optical imaging means via the half mirror. The imaging of the person by the imaging means is performed via the half mirror.
  • the half mirror is also referred to as a beam splitter.
  • the transmittance and the reflectance of the half mirror do not necessarily have to be equal.
  • the optical imaging means is arranged to be inclined with respect to the display surface of the display means, and the inclination angle of the optical imaging means depends on the combination of the installation angle of the display means and the angle for forming a real image. And can be selected as appropriate. For example, when the installation angle of the display means is horizontal and the inclination angle of the optical imaging means is 45 degrees, the real image is a vertical plane, but the installation angle of the display means is not horizontal but inclined. The real image can be made a vertical plane by appropriately selecting the tilt angle of the optical imaging means.
  • the real image is a vertical plane, but according to the posture of the person
  • the real image may be inclined so that the direction of the image and the real image are orthogonal to each other, in which case the installation angle of the display means and the inclination angle of the optical imaging means are appropriately selected and combined according to the angle forming the real image.
  • the imaging angle (the installation angle of the imaging means) is appropriately selected to obtain a real image (interactive person Since it is possible to capture an image of the person who is interacting with the person from the front, the person and the other party of the conversation can face each other, and the line of sight can be reliably matched and the conversation can be performed without a sense of discomfort.
  • the half mirror is disposed parallel to the optical imaging means.
  • the optical imaging apparatus be disposed at an angle with respect to the display means.
  • the optical imaging unit is disposed such that the light output side is obliquely upward, obliquely downward, or obliquely horizontal.
  • the image of the person sent to the conversation partner by the image signal output unit is horizontally reversed.
  • the image signal output unit has a common image creation unit
  • the display unit combines the image of the conversation partner with the common image created by the common image creation unit. It is preferable to superimpose the common image signal of the common image also on the image signal sent to the conversation partner while being displayed.
  • the image communication apparatus further includes a detection unit that detects an operation of the person, and the image signal output unit manipulates the common image based on the operation detected by the detection unit. .
  • the image of the conversation partner displayed on the display means is imaged as a real image on the free space by the planar optical imaging means, and the dialogue with the real image of the free space is made
  • an image of a person being photographed is imaged by an imaging unit, and an image signal of an image of the person imaged by the imaging unit is transmitted to the conversation partner
  • a half mirror is disposed on the light exit side of the optical imaging means, and the image of the conversation partner displayed on the display means is further displayed by the optical imaging means in the free space via the half mirror, The imaging of the person by the imaging means is performed via the half mirror.
  • the half mirror in parallel to the optical imaging means.
  • the optical imaging device be disposed at an angle with respect to the display means.
  • the optical imaging means be disposed such that the light output side is obliquely upward, obliquely downward or obliquely sideways.
  • the image of the conversation partner and the common image are combined and displayed on the display means, and the common image signal of the common image is also superimposed on the image signal sent to the conversation partner. Is preferred.
  • the image communication method it is preferable that an operation of the person is detected, and the common image is operated based on the detected operation.
  • An image communication apparatus according to a first aspect of the invention and an image communication method according to the second aspect form an image of a conversation partner displayed on a display means as a real image in a free space via an optical imaging means and a half mirror. Therefore, the person who interacts with the real image can have a conversation as if the other party of the dialogue exists in front of the eyes.
  • the image pickup means can pick up an image of the person from the front through the half mirror disposed on the light exit side of the optical image formation means, and can send the image signal of the picked up image to the conversation partner, A person and a person can meet each other's eyes and can talk in real time, and can aim at smooth communication by eye contact and a gesture.
  • the image communication apparatus since the imaging of the person by the imaging means is performed through the half mirror disposed on the light exit side of the optical imaging means, the horizontal distance from the person to the imaging means is shortened. As a result, the image communication apparatus can be made compact, and space saving and installation ease are also excellent.
  • the assembly operation and positioning can be easily performed.
  • the angle of the real image to be formed can be inclined to the display means, and in particular, depending on the arrangement (setting angle) of the display means If the inclination angle of the optical imaging means is selected so that the real image is a vertical plane, the person can face the image (real image) of the conversation partner, there is little distortion of the image, and the visibility can be improved. it can.
  • the image signal reception side will not perform image processing etc., but the screen of a general-purpose portable terminal or personal computer
  • the image can be displayed as it is on the (display).
  • the conversation partner and the common image are combined and displayed on the display means, and the common image signal of the common image is also superimposed on the image signal sent to the conversation partner, the conversation partner and the person are smooth while viewing the common image simultaneously You can have a conversation.
  • the received image signal and the common image signal can be displayed as they are on the display means, and no special image processing means or image processing step is required, and a general-purpose portable terminal or personal computer is used. Communication with the person at the other end.
  • FIG. 1 is an explanatory view showing a configuration of an image communication apparatus according to a first embodiment of the present invention. It is a block diagram which shows the structure of the same image communication apparatus. It is explanatory drawing which shows the use condition of the same image communication apparatus. (A) and (B) are respectively a front sectional view and a side sectional view of an optical imaging means in the image communication apparatus. It is an explanatory view showing the composition of the picture communication device concerning the 2nd example of the present invention. It is explanatory drawing which shows the structure of the image communication apparatus based on the 3rd Example of this invention.
  • each of the image communication apparatuses 10 a and 10 b has a display unit 15 with the display surface 14 facing upward and arranged horizontally, and a display surface 14 of the display unit 15 above the display unit 15.
  • a planar optical imaging means 16 disposed obliquely upward on the light exit side at an inclination angle of 45 degrees, and a half mirror 17 disposed laminated on the light exit side (upper surface) of the optical imaging means 16;
  • the imaging unit 18 is disposed vertically above the display surface 14 so as to face the display surface 14 with the half mirror 17 (optical imaging unit 16) interposed therebetween.
  • a high brightness monitor is preferably used as the display unit 15, and a web camera or the like is preferably used as the imaging unit 18.
  • Each of the image communication apparatuses 10a and 10b has an image signal output unit 20 that transmits and receives an image signal and displays an image on the display unit 15 based on the image signal received from the other party.
  • the image signal output unit 20 As the image signal output unit 20, a RAM, a CPU, a ROM, an I / O, and a conventionally known computing unit (i.e., a computer) having a bus for connecting these elements are preferably used. Then, the CPU executes a predetermined program, whereby the processing of the image signal output unit 20 is realized. A speaker 21 and a microphone 22 are connected to the image signal output unit 20, and conversation can be performed by transmitting and receiving an audio signal.
  • the optical image forming means 16 forms an image displayed on the display means 15 as a real image in a free space (on an image forming surface 23 without substance) on the front side of the half mirror 17. The details of the optical imaging means 16 will be described later.
  • the form of the half mirror 17 is not particularly limited, but the one formed in a film shape (sheet shape) is suitably used because it is lightweight and can be easily attached to the surface of the optical imaging means 16 .
  • the image communication apparatus 10 a captures an image of the person A in front of the half mirror 17 with the imaging unit 18 via the half mirror 17. Then, the image signal output unit 20 transmits an image signal of the captured image to the image signal output unit 20 of the image communication apparatus 10b connected via the communication network 24, and the image pickup unit 18 of the image communication apparatus 10b performs half. An image signal of an image of a person B (a person with whom the person A interacts) captured through the mirror 17 can be received and displayed on the display means 15. Similarly, the image communication apparatus 10 b captures an image of the person B in front of the half mirror 17 with the imaging unit 18 via the half mirror 17.
  • the image signal output unit 20 transmits the image signal of the captured image to the image signal output unit 20 of the image communication apparatus 10a connected via the communication network 24, and the image pickup unit 18 of the image communication apparatus 10a performs half.
  • An image signal of an image of a person A (a person with whom the person B interacts) captured through the mirror 17 can be received and displayed on the display means 15.
  • the image displayed on the display means 15 of the image communication apparatus 10a, 10b is imaged as a real image in a free space via the half mirror 17 by the optical imaging means 16 as described above (the light of the image is Since it passes through the half mirror 17 when it passes through the image means 16 and forms an image, as shown in FIG.
  • the other side of the dialogue is on the front of the person A on the image communication apparatus 10a side (left side in FIG. 3).
  • An image (real image) 25 of the person B as an image of the person B is displayed, and an image (real image) 26 of the person A as a conversation partner is displayed in front of the person B on the image communication apparatus 10b side (right side in FIG. 3).
  • the display surface 14 of the display means 15 is arranged horizontally, and the light exit side of the optical image forming means 16 is arranged obliquely upward at an inclination angle of 45 degrees above the display means 15. Is a vertical plane.
  • the imaging direction of the imaging means 18 disposed vertically above the display surface 14 is vertically downward, inclined 45 degrees with respect to the surface of the half mirror 17, and parallel to the imaging surface 23. Therefore, the persons A and B respectively facing the images 25 and 26 on the imaging surface 23 can be reflected by the half mirror 17 and imaged from the front by the imaging means 18 and displayed on each display means 15, The image 25 of the person B and the image 26 of the person A formed by the optical imaging means 16 have less discomfort, and it becomes easier to confirm the direction of the line of sight.
  • Each image signal output unit 20 has a common image creation unit 27 as shown in FIG. 2 and can create a common image 28 to be displayed in common to each display unit 15. As shown in FIG. 3, by combining the common image 28 with the image 25 of the person B and the image 26 of the person A as necessary, the common image 28 is displayed on each display means 15. The common image 28 can be superimposed and displayed at the same position in the same position with respect to the image 25 and the image 26 of the person A.
  • the common image 28 is mainly a document image such as a photograph or a document, and the common image creation unit 27 may be an image signal output unit 20 in addition to input devices such as a camera, a keyboard, a touch pen, and a scanner. It also includes the program to be executed.
  • creation of the common image 28 by the common image creation means 27 includes, for example, saving a picture taken with a camera, a document or an illustration, etc. inputted from a keyboard or a touch pen in the RAM of the image signal output means 20
  • Documents and the like are captured as images by a scanner and stored in the RAM or the like of the image signal output unit 20, and various processing on the images, as well as photographs and documents created in advance and stored in a storage medium such as a USB memory It includes data selection and reading (copying).
  • the creation of the common image 28 and the combination of the image 26 of the person A and the image 25 of the person B with the common image 28 are selectively performed by one of the common image creation means 27.
  • the common image creation means 27 For example, when the person B on the side of the image communication apparatus 10b creates (selects) an image to be displayed as the common image 28 by the common image creation means 27, the image 26 of the person A received by the image signal output means 20 and the common image 28 are The common image signal of the common image 28 is superimposed also on the image signal to be synthesized and displayed on the display means 15 on the image communication device 10b side and sent to the other party of conversation (person A side), thereby the image communication device 10a side The image 25 of the person B and the common image 28 are combined and displayed on the display means 15 of FIG.
  • the image 26 of the person A and the image 25 of the person B are horizontally reversed as necessary.
  • the image signal output means 20 (transmission side) reverses the image 26 of the person A and the image 25 of the person B horizontally in advance, and transmits the image signal to the image signal output means 20 of the other party.
  • the image signals of the image 26 of the person A and the image 25 of the person B may be transmitted from the image signal output means 20 to the image signal output means 20 of the other side, and then the image signal output of the other side (reception side) It may be reversed by means 20.
  • the person A can easily confirm where on the common image 28 the person B is pointing on the imaging surface 23, and while taking eye contact, it can be smoothly performed. I can talk. Furthermore, the persons A and B can point at the same position on the imaging surface 23 from both sides, and the situation can be confirmed on the imaging surface 23 with each other. Can be The common image 28 is displayed like a small window, and the number, size, and arrangement of the common image 28 can be selected as appropriate.
  • each of the image communication apparatuses 10a and 10b has a detection unit 29 that detects an operation of the person A or B at each point (own point). Then, the image signal output unit 20 can operate (process) the common image 28 based on the operation detected by the detection unit 29 and display it on the display unit 15. For example, when the person A performs an operation to magnify the common image 28, the detection unit 29 on the image communication device 10 a detects the operation, and the image signal output unit 20 on the image communication device 10 a detects the common image 28. Perform an operation (process) to expand.
  • the enlarged common image 28 is displayed on the display means 15 on the image communication device 10a side, and the common image signal is superimposed on the image signal of the image 26 of the person A to display the image communication device 10a side It is sent from the signal output means 20 to the image signal output means 20 on the image communication device 10b side and displayed on the display means 15 on the image communication device 10b side.
  • the detection unit 29 focusing on the images (real images) 25 and 26 and detecting the position and movement of the hands and fingers of the persons A and B on the imaging surface 23 is excellent in the detection performance of the movement.
  • the size, position, and the like of the common image 28 can be adjusted by the signal output means 20 and displayed on the display means 15, and the operability is excellent.
  • detection means 29 an infrared motion sensor or the like is suitably used.
  • the processing by the image signal output unit 20 is realized by the CPU executing a predetermined program, but the operation of the hand or finger is associated in advance with the image operation instruction, and the enlargement of the common image 28 is performed. , Reduction, movement, rotation, etc. can be performed. Thus, the conversation can be smoothly advanced using the common image 28.
  • the optical imaging means 16 includes a first light control unit 31 having a plurality of light reflection surfaces 30 and a second light having a plurality of light reflection surfaces 32.
  • the first and second light control units 31 and 33 are arranged (integrated) in the thickness direction such that the light reflecting surfaces 30 and 32 are orthogonal to each other in plan view. It is
  • the first light control unit 31 is formed on one side of the first transparent plate 34 between a plurality of grooves 37 having a triangular cross section having an inclined surface 35 and a vertical surface 36 and an adjacent groove 37.
  • a plurality of triangular ridges 38 are arranged at a predetermined pitch, and a light reflecting surface 30 formed of a mirror surface (metal reflecting surface) is formed only on the vertical surface 36 of each groove 37.
  • the bottom of the groove 37 (between the lower end of the inclined surface 35 and the lower end of the vertical surface 36) and the top of the ridge 38 (between the upper end of the inclined surface 35 and the upper end of the vertical surface 36) are minute Flat portions 39, 40 are formed.
  • the second light control unit 33 is formed on the other side of the second transparent plate 41 between the plurality of grooves 44 having the inclined surface 42 and the vertical surface 43 and the adjacent grooves 44.
  • a plurality of ridges 45 each having a triangular cross section are disposed at a predetermined pitch, and the light reflecting surface 32 formed of a mirror surface (a metal reflecting surface) is formed only on the vertical surface 43 of each groove 44.
  • the bottom of the groove 44 (between the lower end of the inclined surface 42 and the lower end of the vertical surface 43) and the top of the ridge 45 (between the upper end of the inclined surface 42 and the upper end of the vertical surface 43) are minute Flat portions 46 and 47 are formed. Then, the transparent resin 48 is filled in the grooves 37 and 44 disposed facing each other.
  • the refractive indexes ⁇ 1 and 412 of the first and second transparent plates 34 and 41 are the same, and the refractive index ⁇ 3 of the transparent resin 48 filled therebetween is the refraction of the first and second transparent plates 34 and 41.
  • the ratio ⁇ 1 or ⁇ 2 is preferably in the range of 0.8 to 1.2 times (more preferably 0.9 to 1.1 times, more preferably 0.95 to 1.05 times).
  • transparent resins to be used as the raw materials of the first and second transparent plates 34 and 41 include cycloolefin polymers, polymethylmetallate (acrylic resin), amorphous fluorine resin, PMMA, polycarbonate for optics, fluorene polyester, although thermoplastic resins such as polyether sulfone can be used, those having a high melting point and high transparency are preferably used.
  • a method of forming a mirror surface As a method of forming a mirror surface (metal reflection surface), sputtering, metal deposition, spraying of metal fine particles, irradiation of ion beam, coating of metal paste, etc. are performed directly on the vertical surfaces 36, 43 of the grooves 37, 44
  • a resin film on which a reflective film is formed by sputtering or metal deposition may be attached to the vertical surfaces 36, 43 of the grooves 37, 44.
  • the vertical surface 36 from diagonally above in vacuum or under low pressure. Irradiate the metal particles towards 43.
  • the minute flat portions 39 and 46 are respectively formed at the bottoms of the grooves 37 and 44, the lower end of the vertical surfaces 36 and 43 is reduced or reduced while the metal particles are not attached to the inclined surfaces 35 and 42.
  • the metal particles can be irradiated without spots.
  • the inclined surfaces 35 and 42 of the grooves 37 and 44 are not flat but formed in a polygonal shape having a polygonal cross section which is recessed inward of the ridges 38 and 45, a concave surface having a circular arc shape, or a large number of minute surfaces.
  • the adhesion of the metal particles may be prevented as the uneven surface having the unevenness (ridge).
  • a sheet-like transparent resin having a low viscosity may be sandwiched, heated and pressed in a vacuum state, and only the transparent resin may be dissolved and solidified, or a transparent adhesive made of transparent resin separately in each groove 37, 44
  • the grooves 37 and 44 of the first and second light control portions 31 and 33 may be filled, and the transparent adhesive may be cured by facing and abutting the grooves 37 and 44.
  • thermosetting adhesive or a two-component mixture adhesive can be used in addition to a photo-curing adhesive that is cured by irradiation with ultraviolet light or the like.
  • an optical adhesive made of a refractive index adjusting resin whose refractive index is adjusted is preferably used.
  • the inclined surface of each groove is a polygonal surface, a concave surface, a concavo-convex surface, etc.
  • the adhesion between the inclined surface and the transparent resin filled in the groove is enhanced by the anchor effect, and the groove is transparent resin without a gap.
  • the unevenness can be eliminated by filling.
  • light can be allowed to pass without generating irregular reflection (scattering) at the interface between the inclined surface and the transparent resin, and refraction can also be minimized, and a bright and clear three-dimensional image can be obtained.
  • FIG. 1 when an image is displayed on the display means 15, the light is emitted toward the optical imaging means 16.
  • FIGS. 4A and 4B when the light L1 enters the second light control unit 33 of the optical imaging unit 16 at the position P1, the light L1 is on the light reflection surface 32. The light is reflected at the position of P2 and enters the first light control unit 31. Then, the light is reflected at the position P3 of the light reflecting surface 30, and then it exits from the first light control unit 31 into the air at the position P4 and forms an image.
  • light is incident from the second transparent plate 41 to the transparent resin 48 at Q1 in FIG.
  • the first and second transparent plate 34 Since the refractive indices ⁇ 1 and ⁇ 2 of 41 are the same and approximate to (approximately equal to) the refractive index ⁇ 3 of the transparent resin 48, phenomena such as total reflection and spectroscopy do not occur.
  • the second transparent plate 41 enters the transparent resin 48, and the transparent resin 48 enters the first transparent plate 34 in S2, the first and second transparent plates 34, Since the refractive indexes ⁇ 1 and ⁇ 2 of 41 are the same and approximate to (approximately equal to) the refractive index ⁇ 3 of the transparent resin 48, phenomena such as total reflection and spectroscopy do not occur.
  • refraction occurs at the positions of P1 and P4, the refraction of P1 and P4 cancels out.
  • the light reflecting surfaces 30, 32 can function as light reflecting surfaces either on the front or back (left or right in FIGS. 4A and 4B).
  • An image of the person A who is imaged as a real image on the image plane 23 and who interacts with the real image in free space is imaged by the imaging means 18 through the half mirror 17, and the image signal of the imaged image is the image on the conversation partner (person B) side It sends to the communication device 10b.
  • the image of the other party (person A) sent from the image communication device 10a is displayed on the display means 15, and the displayed image is a planar optical imaging means
  • An image obtained by imaging the person B interacting with the real image in free space via the half mirror 17 via the half mirror 17 while forming an image as a real image on the imaging surface 23 in free space via the half mirror 17 Is sent to the image communication apparatus 10a on the side of the conversation partner (person A).
  • the image 25 of the person B and the image 26 of the person A are mutually transmitted and received, and the real image and each person A, B interact with each other, so that the other party of the dialogue exists in front of the eyes It is possible to make a line of sight and have a conversation, and to achieve smooth communication by eye contact and gestures.
  • the image communication apparatus 50a, 50b differs from the first embodiment in that the display means 15, the optical imaging means 16, the half mirror 17, the imaging means 18, and the detection means 29 are arranged upside down. It is a point, and its operation and the obtained action and effect are the same as those of the first embodiment. As long as the detection means 29 focuses on the real image and can detect the position and operation of the hands and fingers of the person A or B on the imaging surface 23, as in the first embodiment, the optical imaging is performed. It may be located above the means 16.
  • the optical imaging means 16 is disposed obliquely upward, whereas in the present embodiment, the display means 15, the optical imaging means 16, the half mirror 17, the imaging means 18, and the detection means 29.
  • the light emitting side of the optical image forming means 16 is disposed obliquely downward by turning upside down (180 degree rotation) of the position relation of the optical image forming means 16, but the position relation of the above configuration in the first embodiment is rotated 90 degrees
  • the display surface can be arranged in the vertical direction, and the optical imaging means can be arranged on the side of the display means so that the light output side is obliquely oriented.
  • the image communication apparatus 51a, 51b differs from the first embodiment in that the installation angle of the display means 15 is inclined with respect to the horizontal plane, and the inclination angle of the optical imaging means 16 is changed accordingly. That is the point.
  • the imaging surface 23 can be made to be a vertical plane by appropriately selecting the inclination angle of the optical imaging unit 16. Further, the operation of the image communication apparatuses 51a and 51b and the obtained operation and effects are the same as in the first embodiment.
  • a display means for receiving an image signal sent from the image communication device and displaying an image of a person who is a dialog partner
  • an imaging means for imaging a person looking at the display means
  • a portable terminal such as a smartphone with a general-purpose camera or a personal computer can be used.
  • the said Example demonstrated the case where it communicated between two points, it is also possible to communicate between three or more points.
  • the person A who is speaking or the person B or C who is listening to the utterance may be manually selected and switched so that the image of the person A is displayed.
  • the image of the person A is transmitted from the image signal output means on the person A side to the image signal output means on the person B, C side, and displayed on each display means. Can also be automated. It is preferable to display the image of the person B or C on the display means on the person A side. At this time, the image of the person B or C to be displayed may be automatically switched periodically or irregularly by the image signal output means of the person A side, for example, according to the contents of the statement by the person A, etc. The image of the person B or C may be selected and switched manually.
  • the installation angle of the display means and the inclination angle of the optical imaging means are set so that the image forming plane on which the real image is formed is vertical, but according to the posture of the person (direction of sight line)
  • the real image (imaging surface) may be inclined, and the installation angle of the display means and the inclination angle of the optical imaging means can be selected appropriately.
  • the optical imaging means has been described in which the half mirror is laminated. However, the optical imaging means and the half mirror do not necessarily have to be in close contact with each other. When the optical imaging means and the half mirror are spaced apart, the optical imaging means and the half mirror may be arranged in parallel or may be inclined.
  • the person reflected by the half mirror can be further reflected by the mirror and then imaged.
  • the installation position of the imaging means can be appropriately changed according to the arrangement and installation angle of the mirror.
  • the detection means one that focuses on a real image and detects the position and operation of a person's hand or finger on an imaging surface (such as an infrared motion sensor) has been described.
  • an optical sensor provided with sensor elements for detecting only light from the front side is installed on the surface (display surface) of the display means, and reflection from the hand or finger touching the imaging surface Light can be formed as a real image on the display means through an optical imaging means, and the position of the real image can be detected by an optical sensor.
  • the detection means in addition to one that detects the movement of a person's finger or hand, one that detects voice or sound can also be used.
  • the optical imaging means one in which the front sides of the first and second light control portions (surfaces on which the grooves are formed) are in contact with each other is used.
  • the light reflecting surfaces of the first and second light control units may be orthogonally disposed in plan view. Therefore, the front and back sides of the first and second light control units may be disposed in contact with each other, or the back sides of the first and second light control units may be disposed in contact with each other.
  • the first and second light control units instead of separately forming and joining the first and second light control units to the two transparent plate members, it is also possible to form the first and second light control units on both sides of one transparent plate member. it can.
  • a gas such as air is sealed in the groove or the inside of the groove is evacuated. If the total reflection of light is used, the vertical surface of each groove can be used as the light reflection surface as it is.
  • the optical imaging means one in which the plurality of light reflecting surfaces of the first and second light control sections are arranged linearly (parallelly) has been described, but a plurality of light reflecting surfaces It is also possible to use one having a first light control unit in which the light emitting devices are arranged radially and a second light control unit in which a plurality of light reflecting surfaces are arranged concentrically.
  • the radial light reflection surface of the first light control unit is provided in a straight line centering on the reference point X, while the concentric light reflection surface of the second light control unit is viewed in plan. And although it curves along the concentric circle centering on the reference point Y which overlaps with the reference point X, both are orthogonally crossed in the point which light-reflecting surfaces intersect in planar view. Therefore, a three-dimensional image can be formed as in the above embodiment.

Abstract

L'invention concerne un dispositif (10b) de transmission d'image possédant: un moyen (15) d'affichage destiné à recevoir un signal d'image et à afficher une image d'une personne A; un moyen (16) d'imagerie optique plat formant en tant qu'image réelle (26) dans un espace libre, une image d'une personne A, affichée par le moyen (15) d'affichage; un moyen (18) de capture d'image destiné à capturer une image d'une personne B conversant avec l'image réelle (26) de l'espace libre; et un moyen (20) de sortie de signal d'image destiné à envoyer à la personne A un signal d'image d'une image de la personne B telle que capturée par le moyen (18) de capture d'image. Un demi-miroir (17) est disposé côté émission du moyen (16) d'imagerie optique. L'image de la personne A affichée par le moyen (15) d'affichage est affichée dans un espace libre à l'aide du moyen (16) d'imagerie optique et par l'intermédiaire du demi-miroir (17), et la capture d'image de la personne B par le moyen (18) de capture d'image est effectuée par l'intermédiaire du demi-miroir (17).
PCT/JP2018/000664 2018-01-12 2018-01-12 Dispositif de transmission d'image et procédé de transmission d'image WO2019138541A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/JP2018/000664 WO2019138541A1 (fr) 2018-01-12 2018-01-12 Dispositif de transmission d'image et procédé de transmission d'image
JP2018550492A JP6450893B1 (ja) 2018-01-12 2018-05-01 画像通信装置及び画像通信方法
PCT/JP2018/017451 WO2019138592A1 (fr) 2018-01-12 2018-05-01 Dispositif de transmission d'image et procédé de transmission d'image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/000664 WO2019138541A1 (fr) 2018-01-12 2018-01-12 Dispositif de transmission d'image et procédé de transmission d'image

Publications (1)

Publication Number Publication Date
WO2019138541A1 true WO2019138541A1 (fr) 2019-07-18

Family

ID=67219437

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/JP2018/000664 WO2019138541A1 (fr) 2018-01-12 2018-01-12 Dispositif de transmission d'image et procédé de transmission d'image
PCT/JP2018/017451 WO2019138592A1 (fr) 2018-01-12 2018-05-01 Dispositif de transmission d'image et procédé de transmission d'image

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/017451 WO2019138592A1 (fr) 2018-01-12 2018-05-01 Dispositif de transmission d'image et procédé de transmission d'image

Country Status (1)

Country Link
WO (2) WO2019138541A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113194175A (zh) * 2021-04-29 2021-07-30 上海闻泰信息技术有限公司 一种移动终端及移动终端的屏下摄像方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05161135A (ja) * 1991-12-09 1993-06-25 Nippon Telegr & Teleph Corp <Ntt> 表示・撮像装置
JP2005287004A (ja) * 2004-03-03 2005-10-13 Canon Inc 画像表示方法、プログラム、画像表示装置及び画像表示システム
WO2011108139A1 (fr) * 2010-03-03 2011-09-09 シャープ株式会社 Système de téléconférence

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05161135A (ja) * 1991-12-09 1993-06-25 Nippon Telegr & Teleph Corp <Ntt> 表示・撮像装置
JP2005287004A (ja) * 2004-03-03 2005-10-13 Canon Inc 画像表示方法、プログラム、画像表示装置及び画像表示システム
WO2011108139A1 (fr) * 2010-03-03 2011-09-09 シャープ株式会社 Système de téléconférence

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113194175A (zh) * 2021-04-29 2021-07-30 上海闻泰信息技术有限公司 一种移动终端及移动终端的屏下摄像方法

Also Published As

Publication number Publication date
WO2019138592A1 (fr) 2019-07-18

Similar Documents

Publication Publication Date Title
US8384760B2 (en) Systems for establishing eye contact through a display
US10750210B2 (en) Three-dimensional telepresence system
US8908008B2 (en) Methods and systems for establishing eye contact and accurate gaze in remote collaboration
US9360671B1 (en) Systems and methods for image zoom
KR101795644B1 (ko) 투영 캡쳐 시스템, 투영 캡쳐 프로그래밍, 및 투영 캡쳐 방법
JP5839427B2 (ja) アイコンタクトが可能な３次元遠隔会議装置およびこれを用いた方法
US8638354B2 (en) Immersive video conference system
US8624954B2 (en) Methods and systems for sharing content via a collaboration screen
WO2011108139A1 (fr) Système de téléconférence
US8976219B2 (en) Studio and conference system for life-size videoconferencing
CN108495103A (zh) 一种电子设备
JP2018156368A (ja) 電子情報ボードシステム、画像処理装置、及びプログラム
KR20150091902A (ko) 이동 단말기
JP2011242458A (ja) 表示装置および表示方法
JP6336223B1 (ja) 双方向通信システム
WO2019138541A1 (fr) Dispositif de transmission d&#39;image et procédé de transmission d&#39;image
JP6450893B1 (ja) 画像通信装置及び画像通信方法
JP7101062B2 (ja) 画像通信装置及び画像通信方法
Tan et al. Connectboard: Enabling genuine eye contact and accurate gaze in remote collaboration
WO2018149266A1 (fr) Procédé et dispositif de traitement d&#39;informations basés sur la réalité augmentée
US11972505B2 (en) Augmented image overlay on external panel
CN213693932U (zh) 一种基于透明显示器的视频会议系统
JP2012058581A (ja) 電子機器
JPH09107534A (ja) テレビ会議装置及びテレビ会議システム
CN116457719A (zh) 空间悬浮影像显示装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18900253

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18900253

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP