WO2022231482A1 - Transport virtuel et procédé de fonctionnement - Google Patents

Transport virtuel et procédé de fonctionnement Download PDF

Info

Publication number
WO2022231482A1
WO2022231482A1 PCT/RU2022/050143 RU2022050143W WO2022231482A1 WO 2022231482 A1 WO2022231482 A1 WO 2022231482A1 RU 2022050143 W RU2022050143 W RU 2022050143W WO 2022231482 A1 WO2022231482 A1 WO 2022231482A1
Authority
WO
WIPO (PCT)
Prior art keywords
screens
virtual transport
video cameras
vehicle
receiving
Prior art date
Application number
PCT/RU2022/050143
Other languages
English (en)
Russian (ru)
Inventor
Хальдун Саид Аль-Зубейди
Саина Геннадьевна АЛЬ-ЗУБЕЙДИ
Али Хальдун АЛЬ-ЗУБЕЙДИ
Ахмед Хальдун АЛЬ-ЗУБЕЙДИ
Амин Хальдун АЛЬ-ЗУБЕЙДИ
Original Assignee
Хальдун Саид Аль-Зубейди
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from RU2021112419A external-priority patent/RU2785201C2/ru
Application filed by Хальдун Саид Аль-Зубейди filed Critical Хальдун Саид Аль-Зубейди
Publication of WO2022231482A1 publication Critical patent/WO2022231482A1/fr

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B30/00—Camera modules comprising integrated lens units and imaging units, specially adapted for being embedded in other devices, e.g. mobile phones or vehicles

Definitions

  • the invention relates to the field of electronic engineering and can be used as a device for transmitting, receiving and reproducing information in the form of images and sound using multiple screens, video cameras, stereo speakers and microphones, and a method for their operation.
  • VRD virtual retinal display
  • small lasers or LEDs are used as a radiation source, from which radiation enters a dynamic MEMS element.
  • the beam hits a volumetric holographic optical element located in the region of the spectacle lens, which allows light from the environment to pass unobstructed, providing normal vision for the user and redirecting the scanned light from the projector to the user's eye to display an image passing through the center of the pupil of the eye, and projected onto the posterior retina of the eye.
  • This solution has the following disadvantages. Low resolution generated image.
  • VRD technology requires mandatory adjustment of the system to the physical characteristics of the user for accurate positioning of the pupil of the eye and the projection system.
  • An invention is known in the form of personal computer hardware and stereo television systems, designed to reproduce three-dimensional video information through two screens and separate field of view glasses (RF patent N°2413388, 2009).
  • the device operates in two modes: in the first one, stereo pairs are played from a PC video adapter or a TV set of a stereo television system, in the second - ordinary mono frames from the same equipment.
  • the right and left frames of the stereopairs are reproduced synchronously on two adjacent right and left screens (two eyes - two screens), the images of which are perceived by the user as three-dimensional through glasses of a separate field of view.
  • the disadvantage of this device is the lack of a direct connection in panoramic and surround view.
  • a well-known invention involves the use of a binocular scanner mounted on a helmet, put on the user's head, which creates the illusion of entering the virtual space by forming a three-dimensional image on the retina of the eye (the closest analogue).
  • the disadvantage of the known inventions is the obligatory use of special glasses and systems, the use of which creates discomfort for the user and does not correspond to the natural movement of the head and body of a person when observing circular, panoramic images.
  • the disadvantages of the well-known inventions of similar devices can also be attributed to the fact that they have a limited scope, mainly associated only with the receipt by the user of the finished video image without the ability to control the search and transmission of the image.
  • the task to be solved by the claimed technical solution is to expand the arsenal of technical means in this area for receiving, transmitting and playing information (video, photo, sound information) in the form of a panoramic video image at a qualitatively new level with the effect of the presence of teleportation using several video cameras, screens, microphones and stereo speakers and how it works.
  • the problem to be solved is the creation of virtual teleport devices in the form of vehicles as a transmitting - receiving device and a receiving - transmitting room of a virtual transport, consisting of a structure: a vehicle, several screens, video cameras, microphones and stereo speakers, interconnected by hardware and software, an interface for ensuring the effect of full presence installed on the outside and inside of the vehicle and on the inside of the virtual transport room.
  • Virtual transport is designed to receive and transmit information (video image, sound) from the scene using a modified vehicle for transmission and playback of information (video image, sound) to another modified vehicle, also to the place of reception in the virtual transport room, with the effect of real presence, as well as playback of information (video image and sound) transmitted from several video cameras or external sources, synchronously and simultaneously in a 360-degree panoramic view and a 360-by-180-degree surround view, including in real time through modern means of communication and telecommunications also in the recording mode, to implement its way of functioning.
  • the technical result achieved in the implementation of the invention is to create comfortable conditions for the user for the natural movements of his head and body when observing circular, panoramic and three-dimensional images, as well as to expand the scope of application due to the reception and transmission of video and sound by the user with the ability to control the search, reception , transmission and playback of the image live and in recording mode, to create the effect of teleportation.
  • Virtual transport it consists in creating a modified vehicle located at the scene of an event with several screens (displays) installed on it "instead of windows” and several video cameras located on all sides outside, inside above all screens “windows” of the vehicle, interconnected hardware and software, interface in the form of a set of means for ensuring the interaction of systems with each other;
  • Virtual transport it consists in creating a virtual transport room, with the help of which the video image and sound from the event are received, equipped with screens (displays, projection screens) and several video cameras located inside from all sides, above all screens of the room, connected by equipment and software, interface in the form of a set of means for ensuring the interaction of systems with each other;
  • the method of functioning is communication through a system of orbiting space satellites, fiber optic cables, high-speed Internet, high-speed communication channels, and also through external communication interfaces;
  • the essential difference between the proposed technical solution and the previously known ones is the presence of a set of several video cameras and screens with interactive control of their operation, with the possibility of receiving and transmitting images from several video cameras located outside the vehicle, with different viewing angles on the internal screens of another vehicle or on the receiving screens virtual transport rooms.
  • a significant difference is also the display of information on several screens, both from outside the vehicle and inside the virtual transport room with synchronously and simultaneously, with a circular view of 360 degrees and a three-dimensional view of 360 by 180 degrees, by organizing a programmed automatic transmission of images from all video cameras.
  • FIG. Figure 1 shows a diagram of a virtual transport, where you can see the vehicle 1 in the form of a passenger car (side view), with ultra-wide-angle video cameras 2 installed on it, high-resolution screens 3, external communication interfaces 4, a passenger seat 5, a microphone 6, a seat of the vehicle manager tool 7, stereo speaker 11.
  • Figure 2 shows a diagram of a virtual transport, which shows the vehicle 1 in the form of a passenger car (rear view) with super wide-angle video cameras 2 installed on it, high-resolution screens 3, external communication interfaces 4, passenger seat 5, microphone 6.
  • Figure 3 shows a diagram of a virtual transport, where you can see the vehicle 1 in the form of a car (front view) with ultra-wide-angle video cameras 2 installed on it, high-resolution screens 3, external communication interfaces 4, passenger seat 5, microphone 6, manager's seat vehicle 7.
  • Figure 4 shows a diagram of a virtual transport, which shows the vehicle 1 in the form of a bus (side view) with located on top of it wide-angle video cameras 2, high-resolution screens 3, external communication interfaces 4, microphone 6, driver's seat 7.
  • Figure 5 shows a diagram of a virtual transport, which shows the vehicle 1 in the form of a space shuttle (side view) with super wide-angle video cameras 2 located on it, external communication interfaces 4, microphone 6.
  • Figure 6 shows a diagram of a virtual transport, where a virtual transport room 2 is visible with super-wide-angle video cameras 2 installed inside, high-resolution screens 3, a seat for passengers 5, a microphone 6, a stereo speaker 11 and external communication interfaces 4, a seat for passengers 8.
  • FIG. 7 shows a scheme for receiving and transmitting information in the form of a video image and sound from vehicle 1 to a virtual transport room 9 through systems of orbital space satellites, fiber optic cables, high-speed Internet, high-speed communication channels 10.
  • FIG. 8 shows the scheme for receiving and transmitting information in the form of a video image and sound from vehicle 1 to another vehicle 1 through systems of orbital space satellites, fiber optic cables, high-speed Internet, high-speed communication channels 10.
  • “Virtual transport and method of its operation” for transmitting, receiving and displaying information on multiple screens, synchronously and simultaneously with a 360-degree all-round view and a 360-degree volumetric view of 180 degrees, including the use of a virtual transport room 9 in the form square or rectangle (Fig.6 and Fig.7) with screens 3 (Fig.6 and Fig.7) on all walls (surfaces) inside the virtual transport room and with video cameras 2 (Fig.6 and Fig.7), microphones 6 (Fig.6 and Fig.7) and stereo speaker 11 (Fig.6 Fig.7).
  • Virtual teleport room 9 can be used to display information in video images and sound from multiple cameras 2 located on the surface of the vehicle 1 (figure 1, figure 2, figure 3, figure 4, figure 5) on the screens 3 (Fig. 6) of the virtual teleport room 9 (Fig. 6) located inside to create a 360-degree all-round view and a 360-by-180-degree surround view using external communication tools (High-speed wired and wireless communication channels and the Internet) 10 ( Fig.7).
  • external communication tools High-speed wired and wireless communication channels and the Internet
  • Reception, transmission and playback of information from the transmitting vehicle 1 (figure 1, figure 2, figure 3, figure 4, figure 5) to another receiving vehicle 1 (figure 1, figure 2, figure 3 , Fig.4, Fig.5) and to the virtual room 9 (Fig.6) is carried out using multiplexed signals with the ability to compress, synchronize and stitch the video image, as a result, the illusion of the recipient entering the virtual space is created by forming a three-dimensional image on the retina of his eye and the recipient of the information is provided with the effect of full presence with a sound field and a 360-degree video review.
  • the transmitting-receiving vehicle 1 is made in the form of a light car, bus, space shuttle, it can also have a different type and size of vehicles with video cameras 2, screens 3, sound speakers 11, microphones 6 and an external communication interface 4 installed on them, virtual transport receiving room 9 platform is designed as a square room, a light car, a bus and a space shuttle also, it can have a different look and size with video cameras installed inside 2, screens (display, projection) 3, stereo speakers 11 and microphones 6, external communication interfaces 4 to create the effect of presence at the scene of the event live and in recording mode.
  • the achieved technical result of the invention is also provided by modifications of the features of the proposed device, in which the transmitting - receiving vehicle 1 for transmitting and receiving information from the receiving - transmitting room of the virtual transport 9 carried out by means of a repeater satellite or through high-speed wireless and wired communication channels or via the Internet ten.
  • Virtual transport room 9 can optionally be equipped with a screen
  • Virtual transport room 9 with the help of video cameras 2 and microphones 6 located inside can display information on external screens 3 and stereo speakers 11 of the vehicle 1.
  • Information in the form of a video image and sound from external video cameras 2 and from external microphones 6 on vehicle 1 can be displayed on internal screens 3 and on internal stereo speakers 11 of another vehicle 1.
  • Information in the form of a video image and sound from internal video cameras 2 and from internal microphones 6 on vehicle 1 can be displayed on external screens 3 and on external stereo speakers 11 of another vehicle 1.
  • the proposed device is designed to record, store, receive and transmit information with a 360-degree viewing angle, using known elements, nodes and software corresponding the current level of science and technology, in particular in the field of three-dimensional images, and possible for production.
  • known existing means of communication offered for receiving and transmitting information between devices have been created and are successfully operating, covering the whole world. Therefore, this technical solution is suitable for industrial and commercial applications.
  • the “Virtual Transport” device was not identified, as devices with video cameras and screens of the said proposed invention by the entire set of essential features, therefore this technical solution meets the “novelty” criterion.
  • the vehicle as a device for receiving and transmitting information in the form of video and sound, using high-resolution screens and super-wide-angle video cameras, microphones and stereo speakers to obtain a more efficient result with a panoramic and three-dimensional view;

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'invention se rapporte au domaine des techniques électroniques et peut être utilisée comme dispositif de transmission et de réception d'informations sous forme d'image et d'accompagnement sonore en utilisant plusieurs écrans, des caméras vidéo, des enceintes stéréo et des microphones; l'invention concerne également un procédé de fonctionnement de ces derniers. Ce transport virtuel comprend un système d'enregistrement, de traitement, de stockage et de transmission d'informations, selon un procédé de création de dispositif émetteur-récepteur sous forme d'un moyen de transport sur lequel sont installés de tous les côtés, à l'intérieur comme à l'extérieur, des écrans et des caméras vidéo sur tous les côtés ainsi que des microphones, et des enceintes stéréo. Lors de la création de la chambre de réception-transmission du moyen de transport virtuel, le dispositif comprend également des écrans disposés à l'intérieur de tous les côtés ainsi que des caméras vidéo sur tous les côtés sur le dessus.
PCT/RU2022/050143 2021-04-29 2022-04-28 Transport virtuel et procédé de fonctionnement WO2022231482A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
RU2021112419 2021-04-29
RU2021112419A RU2785201C2 (ru) 2021-04-29 Устройства для приема и передачи информации на базе транспортного средства

Publications (1)

Publication Number Publication Date
WO2022231482A1 true WO2022231482A1 (fr) 2022-11-03

Family

ID=83848472

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/RU2022/050143 WO2022231482A1 (fr) 2021-04-29 2022-04-28 Transport virtuel et procédé de fonctionnement

Country Status (1)

Country Link
WO (1) WO2022231482A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030194683A1 (en) * 2002-04-11 2003-10-16 The Boeing Company Visual display system and method for displaying images utilizing a holographic collimator
US20100020075A1 (en) * 2003-03-06 2010-01-28 Xydne, Inc. Apparatus and method for creating a virtual three-dimensional environment, and method of generating revenue therefrom
US20110214072A1 (en) * 2008-11-05 2011-09-01 Pierre-Alain Lindemann System and method for creating and broadcasting interactive panoramic walk-through applications
US20180146121A1 (en) * 2016-11-22 2018-05-24 Pixvana, Inc. Variable image data reduction system and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030194683A1 (en) * 2002-04-11 2003-10-16 The Boeing Company Visual display system and method for displaying images utilizing a holographic collimator
US20100020075A1 (en) * 2003-03-06 2010-01-28 Xydne, Inc. Apparatus and method for creating a virtual three-dimensional environment, and method of generating revenue therefrom
US20110214072A1 (en) * 2008-11-05 2011-09-01 Pierre-Alain Lindemann System and method for creating and broadcasting interactive panoramic walk-through applications
US20180146121A1 (en) * 2016-11-22 2018-05-24 Pixvana, Inc. Variable image data reduction system and method

Similar Documents

Publication Publication Date Title
US6774869B2 (en) Teleportal face-to-face system
JP3744002B2 (ja) 表示装置、撮像装置、および撮像／表示システム
US6583808B2 (en) Method and system for stereo videoconferencing
EP3531244A1 (fr) Procédé, appareil et système fournissant un environnement de réalité alternatif
US20070182812A1 (en) Panoramic image-based virtual reality/telepresence audio-visual system and method
EP1846798A1 (fr) Dispositif d'affichage pour la production d'images quasi tridimensionnelles
JPH09508765A (ja) 合成立体画像処理システムおよび方法
JP3817020B2 (ja) 仮想空間における画像生成方法及び装置並びに撮像装置
WO2000031974A2 (fr) Systeme ameliore de teleconference
KR20050004764A (ko) 표시장치 및 표시방법
US20060203363A1 (en) Three-dimensional image display system
EP0871055A2 (fr) Dispositif d'affichage et procede d'affichage
Naimark Elements of real-space imaging: a proposed taxonomy
CN108989784A (zh) 虚拟现实设备的图像显示方法、装置、设备及存储介质
KR20200115631A (ko) 멀티뷰잉 가상 현실 사용자 인터페이스
EP0592652A1 (fr) Systeme integral et perfectionne d'enregistrement, projection-visualisation-audition d'images et/ou realite virtuelle
CN210605808U (zh) 一种三维图像重构系统
US8717425B2 (en) System for stereoscopically viewing motion pictures
RU2785201C2 (ru) Устройства для приема и передачи информации на базе транспортного средства
WO2022231482A1 (fr) Transport virtuel et procédé de fonctionnement
McKay et al. Membrane-mirror-based autostereoscopic display for tele-operation and teleprescence applications
JP2557406B2 (ja) ３次元画像表示装置
WO2022220707A1 (fr) Chambre de téléportation virtuelle
JP2002027419A (ja) 画像端末装置及びそれを用いる通信システム
JP4148252B2 (ja) 画像処理装置および画像処理方法、並びにプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22796266

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22796266

Country of ref document: EP

Kind code of ref document: A1