WO2022225499A1 - Information transmission method and system for its implementation - Google Patents

Information transmission method and system for its implementation Download PDF

Info

Publication number
WO2022225499A1
WO2022225499A1 PCT/UA2022/000015 UA2022000015W WO2022225499A1 WO 2022225499 A1 WO2022225499 A1 WO 2022225499A1 UA 2022000015 W UA2022000015 W UA 2022000015W WO 2022225499 A1 WO2022225499 A1 WO 2022225499A1
Authority
WO
WIPO (PCT)
Prior art keywords
optical
receiver
data
sensitive element
transmitter
Prior art date
Application number
PCT/UA2022/000015
Other languages
French (fr)
Inventor
Dmytro Vitalijovych TRETIAKOV
Original Assignee
Tretiakov Dmytro Vitalijovych
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tretiakov Dmytro Vitalijovych filed Critical Tretiakov Dmytro Vitalijovych
Publication of WO2022225499A1 publication Critical patent/WO2022225499A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B10/00Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/11Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
    • H04B10/114Indoor or close-range type systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B19/00Condensers, e.g. light collectors or similar non-imaging optics
    • G02B19/0004Condensers, e.g. light collectors or similar non-imaging optics characterised by the optical means employed
    • G02B19/0009Condensers, e.g. light collectors or similar non-imaging optics characterised by the optical means employed having refractive surfaces only
    • G02B19/0014Condensers, e.g. light collectors or similar non-imaging optics characterised by the optical means employed having refractive surfaces only at least one surface having optical power
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B19/00Condensers, e.g. light collectors or similar non-imaging optics
    • G02B19/0033Condensers, e.g. light collectors or similar non-imaging optics characterised by the use
    • G02B19/0076Condensers, e.g. light collectors or similar non-imaging optics characterised by the use for use with a detector
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/10Scanning systems

Definitions

  • the beam steering system may include additional beam steering systems.
  • the receiver may bear a mark, which is a retro-reflector, illuminated in the side the transmitter.
  • the system may have a deflecting element of the steering system.
  • Micro-electromechanical mirrors can be used as a deflecting element.
  • a matrix of photosensitive elements can be used as a sensitive data element, each of which has the ability to be switched to an amplifier.
  • One of the key features is the ability to "transparently" extend the standard wired interface, such that neither the host computer nor the virtual reality headset has information about the existence of the wireless system, or perceive it as a standard extender/retransmitter or its simulator.
  • the system it is possible to use the system as an independent accessory that may be used with any headset of any brand if it has a compatible standard interface (such as USB or HDMI/DisplayPort + USB, etc.), and this is exactly the case with the vast majority of existing products.
  • Fig. 4 shows the concentration at a wide angle, the matrix element, a variant of the multibeam system which shows the principle of concentration of the beam that comes to the optical system of the receiver 10 or the additional optical system 21 which has a multi- lobed directivity pattern and uses a matrix optical element.
  • the field of view of the sensitive element 11 of the receiver showing that the system has a sensitivity at a wide angle relative to the axis of the sensitive element.
  • HMD virtual reality headset/head mounted display
  • the optical beam 9 for high-speed data transmission is collimated, small in diameter (for example, 2 mm) and precisely aimed at the receiver optical system 10, which focuses/concentrates it into a small point on the surface of the data sensitive element 11, which may be, for example 100- 400 pm or even smaller in size.
  • the optical system 10 of the receiver ensures that the focused optical beam 9 or a sufficient part of it hits the sensor regardless of the angle to the optical axis of such a system, or rotates this system so that the angle between the optical axis and the beam is small, or adjusts the system by electromechanical methods so that the focused beam 9 hits the sensor, that is, the data sensitive element 11.
  • FIG. 7 An example of the operation of a multi-lobed optical system with a moving part (which can be driven electromechanically) is Fig. 7.
  • the optical system of the receiver can be branched (Fig. 2), thus providing additional paths of the beam 27, by which a connection can be formed.
  • the system can be built in such a way that hitting any of its branches ensures data transmission, for example, for a virtual reality headset it can be two lenses, objectives or other optical elements that transmit the signal to the optically sensitive element: one part of the optical system 10 is located, for example, on the user's head, and the other part (additional optical system 21) on the user's back or elsewhere.
  • additional optical system 21 on the user's back or elsewhere.
  • the system can transfer the beam to another one, thus maintaining the connection (Fig.8).
  • Such additional optical elements can be conveniently connected by means of optical fiber to the corresponding optional optical connectors 14, which allows to have optical sensors only in one place in the system without duplicating them.
  • the optical emitter 7 and the steering system 8 can be implemented using lasers, galvanometers, MEMS mirrors or a phased array of optical emitters (https://doi.org/10.1364/QL.39.004575) or a holographic optical beam control system, such as Holographic Optical Beam-Steering (HOBS).
  • HOBS Holographic Optical Beam-Steering
  • An additional method of improving the quality of signal transmission can be differential signal transmission at two wavelengths with separation on the receiver and differential amplification of signals from the corresponding optical sensors. Differential transmission will reduce the impact of broadband interference emitters such as the sun.
  • Independent control of the beams for targeting and data transmission is also not excluded, so that only the targeting beam has the modulated angle. This allows to have a more stable data transmission beam, which may be required to achieve the highest data transmission rates.
  • a controlled optical system of the receiver (Fig. 7) the same error vector can be used to direct the optical system 10 of the receiver to the transmitter 24, in which case it is desirable to spread the operation speed (operating frequency range) of both control systems to simplify the control task.
  • the targeting system of the receiver 47 may have a significantly lower cutoff frequency than the system targeting the optical beam 9 from the transmitter 24 due to the lower angular sensitivity of the optical system 10 compared to the angular sensitivity of the transmitter 24.
  • the optical system 10 of the receiver separates the beam. A part of the beam is directed to the sensitive position element 5 which can detect the signal intensity.
  • the signal from this sensor is used for the targeting system of the transmitter 24.
  • the angular steering of the optical beam can be amplified to provide better tracking, as illustrated in Fig.12 (53).
  • the signal from this sensor is used for the targeting system of the transmitter 24 and the receiver 47, if it exists (the receiver 47 requires a targeting system for the transmitter 24 if the directional pattern of the receiving optical system 10 is not wide enough for satisfactory practical application).

Abstract

The utility model relates to the field of information transmission in telecommunications systems, in particular to the method of data transmission from the transmitting device to the receiving device, namely, to wireless data transmission systems by optical radiation in free space, and can be applied to portable devices and virtual reality headsets. The method is claimed for transmitting information by optical and/or radio emission, which includes data transmission from the transmitter, where the optical emitter emits a modulated optical beam which is directed by a steering system to a data sensitive element on the receiver where the controllers process the data obtained via the beam, using the steering system in its interaction with the receiver optical system to bypass the obstacles that stand in the way of the beam from transmitter to receiver, and the beam targeting and retention on the receiver are carried out by means of a signal from a position sensitive element or a data sensitive element sent to the transmitter and the steering system via an auxiliary radio or optical channel. Additionally, the system is claimed for information transmission to a virtual reality headset using optical and/or radio radiation, which includes a transmitter, a receiver, controllers, an optical emitter, a data sensitive element, interfaces for external communication, a receiver optical system, auxiliary interfaces, a beam position sensitive element, and a beam steering system. The data transmission method ensures connection to both static and moving objects wirelessly with the ability to bypass obstacles, low latency and high data transmission rates. The system of information transmission to a virtual reality headset is wireless and ensures data transmission to a moving or stationary object, bypassing of obstacles, low latency and high data transmission rates.

Description

INFORMATION TRANSMISSION METHOD AND SYSTEM FOR ITS
IMPLEMENTATION
The utility model relates to the field of information transmission in telecommunications systems, in particular to the method of data transmission from the transmitting device to the receiving device, namely, to wireless data transmission systems by optical radiation in free space, and can be applied to portable devices and virtual reality headsets.
At present, media devices require high-speed connection for data transmission, this especially concerns simulators and gaming devices, monitors, projectors, TVs, virtual and augmented reality devices and the like. For example, the virtual reality headset Oculus Quest, Oculus Rift and others. In the case where the image should reflect the actions of the user in real time, an important additional parameter is the frame transmission delay. This is of critical importance for educational or gaming simulations using a virtual reality headset, as the slightest delay in response to a head turn leads to user disorientation and often even dizziness or nausea. Attention should be drawn to the large flow of video data due to the high resolution of the displays and their high refresh rate. For example, it amounts for HTC Vive Pro to 2,880x 1 ,600 pixels at a frequency of 90 Hz and 24 bit color, i.e. about 10 Gbps. Such rate is unattainable for most common consumer radio interfaces, such as WiFi. Especially so given that the slightest communication instability will result in the bad user experience described above. Communication instability is characteristic of radio interfaces as it depends on the environment and the influence of other emitters.
Image quality requirements have led to development of the HDMI 2.1 standard that ensures rates of up to 48 Gbps. Accordingly, there are reasons to expect the same data channel requirements for the aforementioned virtual reality headsets and gaming or other monitors and TVs. This makes it even more impossible to use WiFi, LiFi, WiGig (60 GHz WiFi) standards and similar common means of user data transmission. Even with the transmission of a compressed video signal, the issues of stability, dependence on third party emitters and response delay still remain unresolved. Besides, the compression rate of lossless real-time compression cannot change the requirement for channel speed rates so radically that the use of the above-mentioned radio interfaces becomes possible. In any case, technology is evolving, and headsets with dual 8k displays are already being announced, refresh rates are rising and exceed 120 Hz for many models, and so far there are no signs of slowing down the technology development and reducing the need for bandwidth. Therefore, the technology should be able to operate at higher speeds such as 40, 100, 400 Gbps to meet the needs of future hardware generations. Known optical data transmission methods that utilize radiation not collimated in a narrow beam, such as LiFi technology, to achieve an acceptable signal-to-noise ratio require the modulation methods that reduce the data transmission rate.
There are data transmission methods using directed laser beams in free space, these are well-known systems for data transmission between buildings, but the disadvantage of such a system is the inability to use it to transmit data directly to the user moving actively within the room. Especially so with a large angular displacement.
Moreover, some approaches relying on high frequency radio, such as 24 GHz or more [(Omid Abari et al. 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI Ί7). - 2017. P. 531 - 544), ISBN 978-1-931971-37-9] not only have lower bandwidth than HDMI 2.1, but also have additional disadvantages, requiring direct visibility between the transmitter and the receiver and not penetrating the user's body, thus creating the possibility of blocking direct visibility with the hands or body during movements, although the latter issue has solutions [ISBN 978-1-931971-37-9], but it complicates design without addressing the problem of insufficient data transmission rate.
The practical limitation of the speed and possibility of actual implementation of known inventions [WO2015169626 Al, .US6,630,915B1, US2007/0058987 Al, KR20130116452A, KR20160054441 A] is the restriction on the maximum allowed power of the emitter that is safe for users, such as "class 1" for lasers under IEC 60825-1, as well as the high cost and technical complexity of wide-angle high-power high-speed emitters. The operation speed of an optical sensor is proportional to the ratio of the power that reaches the sensitive surface to its area, because the larger the area, the larger the capacity, and therefore its recharging with a fixed radiation power is longer. Therefore, all patents that do not contain an additional optical system on the receiver focusing/concentrating the beam on a small area of the crystal suffer from the fundamental disadvantage of low maximum transmission rate. Although the use of the most sensitive and high-speed sensors can somewhat compensate for this deficiency, the principle itself remains that the maximum optical transmission speed corresponding to the technological state of the art can be achieved only with a system that concentrates radiation on the sensor. When it comes to ultra-sensitive sensors, it should be kept in mind that high sensitivity and low signal levels make the system sensitive to noise, including ambient light noise.
In some of these systems, it is proposed to direct the beam immediately to the sensor, which cannot give the required speed, namely, to surpass HDMI2.1 and have the potential for further development. Due to the combination of the described reasons, the diameter of the collimated beam cannot be arbitrarily small. This is due to the fact that only a point source can be perfectly collimated, and the size of a real emitter is not zero. This leads to significant limitations in the beam diameter and angle of divergence [https://www.newport.eom/n/focusing-and-collimating]. In practice, this makes practical beams to have a diameter of about 2-5 mm at distances of about 1-10 m, but not 0.1 mm, which corresponds to the diameter of a typical 10 Gbps optical sensor. Even if the assumed beam diameter is 0.1 mm, jitter in the tracking modules of slave systems will be a significant technical problem for maintaining a stable connection, since it has the same order of magnitude, i.e. 0.1 mm or more [DOI 10.1177/2041669517708205, DOI 10.1109/IROS.2018.8593707, http://doc-ok.org/?p=14781. And such a small sensor area increases the accuracy requirements to the beam steering system.
There are systems (ACM ISBN 978-1-4503-5842-2/18/06) that have significantly limited beam reception and transmission angles, as well as imperfect target search and tracking systems that do not have the ability to constantly know the error vector for the low- latency control system. The article declares a delay in determining the error vector of 20 ms, which is due to the delay in processing and reading the RSSI level from the SFP module. Assuming a common walking speed of 5 km/h, in 20 ms the receiver will move away from the beam by 27 mm. No doubt that a good target retention result is achievable only given the possibility make at least a few iterations when the beam leaves the sensitivity zone, which means the need to have a collimator with a diameter several times more than 5 cm and a galvanometer on the receiver with the same mirror width and proportionally greater length. Obviously, this results in the corresponding size and weight of the galvanometer motor, vibration levels and high energy consumption. In this case, the receiver will approach in its linear dimensions the size of the user's head, which is obviously not practical. It should be noted that all these values are calculated for normal walking and not for running or jumping, and there is a need to simultaneously target both the transmitter to the receiver and the receiver to the transmitter, as both elements use collimators which have a narrow directional pattern. This means an increase in the system dimensionality to 4 dimensions, which makes the practical task of coordinating its parts much more difficult, if at all achievable. There are systems that in order to bypass obstacles in the line of direct visibility use mirrors to reflect optical radiation with its subsequent entry into the receiver by a different trajectory (US 2018/0294877 Al). Although this method may be suitable for communication between server racks in a specially equipped room, it is not practical for home use, as it requires a flat mirror on the entire surface of the ceiling or a large part of it. This means a significant alteration of living space. This is also a problem for commercial applications.
The above-mentioned systems that use galvanometers or other similar aiming devices (such as MEMS mirrors) are not able to provide satisfactory steering angles, because galvanometers due to their basic geometry and actual technical constraints cannot provide the steering angles wide enough to meet user needs (namely to allow free movement around the room).
The closest to the claimed invention is a virtual reality system comprising a main display (head mounted display, HMD), a server and a beam control device that utilizes optical data transmission from the server to the HMD. The data transmission rates / bandwidths ensured by optical data transmission make it possible to reduce the compression ratio required for data transmission (and latency associated with compression) on the HMD. Efficient load transfer of processing tasks from the HMD to the server reduces HMD power consumption and ensures video delivery with high resolution, frame rate and quality. When a HMD user moves and the HMD posture (position and orientation) changes, the position is communicated to the server and the beam control device. Based on the posture, the server visualizes image frames for transmission to the HMD, and the beam control device directs the optical beam to the HMD to ensure the transmission of image frames from the server to the HMD [US 2019/0155372 Al, G06F 3/01 1 , H04B 10/11, 2018]
The known system does not have the means to ensure relatively longtime bypass of obstacles that apparently may emerge in the direct line of sight of the beam when using a virtual reality headset, for which it is enough to raise one's hand blocking thus the path of the beam, or to bend oneself. The workaround offered in this system applies only to short interruptions and consists of distributed rendering of the image, with the transfer of a full panorama of the environment image to the headset and sequential drawing of moving objects thereon. Thus, when the connection is lost, the last available panorama is used and it is assumed that the loss of detail will be invisible to the user if the connection loss occurred during a sudden movement of the head. Accordingly, the disadvantage is the loss of image parts and the ability to compensate by this method only a short interruption. Also, there is the need for a fairly deep integration of such system with gaming or simulation software, which is not universal for all systems, but quite unique to this system. In other words, this communication method requires use of a large number of unique adjustments, as it cannot be a "transparent" extension of a standard interface or video channel.
Simplified options are also offered, such as the transfer of only the last successful frame, however, the picture freezing has a certain negative impact on the person using the headset (loss of balance, nausea).
The headset tracking method (6-dimensional, 3-axis rotation and 3 Cartesian coordinates) proposed in this system, which is usually provided for orientation in the simulation, has an absolute position accuracy of about 1 cm, and some problems with tracking loss, inclinations of the reference plane relative to the actual floor level, etc. This creates additional technical difficulties. It is proposed to address these problems with a matrix of small-sized sensors, such that they can be combined in parallel to maintain the connection in the presence of a displacement by increasing the effective area and accordingly reducing the operating frequency of such a combined sensor. The disadvantage of this approach is accordingly the unstable channel bandwidth or the actual reduction of its maximum speed, as the position jitter can reach 0.1-1 mm, which at a nominal sensor size of 0.1 mm means a reduction in speed by several or dozens of times. Another disadvantage is that such a component is non-standard and has a potentially high cost. The same applies to the option with the determination of the beam steering using a matrix of additional elements located around the main receiving sensor. Another problem is that the error correction signal appears after the decrease in the intensity of the information signal.
The task on which the invention is based is creating a method of data transmission ensuring connection to both static and moving objects wirelessly with the ability to bypass obstacles, low latency and high data transmission rates limited only by the capabilities of modern optical modulators/demodulators and the frequency of light waves.
The second task that serves as the invention base is to create a system for transmitting information to a virtual reality headset or other media device that would be wireless, would allow data transmission to a moving or stationary object, bypassing of obstacles and would have low latency and high data transmission speed.
The set task is solved by means of the method for transmitting information by optical and/or radio emission, which includes data transmission from the transmitter, where the optical emitter emits a modulated optical beam which is directed by a steering system to a data sensitive elementon the receiver where the controllers process the data obtained via the beam, according lo the invention, using the steering system in its interaction with the optical system of the receiver to bypass the obstacles that stand in the way of the beam from transmitter to receiver, and the beam targeting and retention on the receiver are carried out by means of a signal from a sensitive element of the position or a sensitive element of the data sent to the transmitter and the steering system via an auxiliary radio or optical channel. For one of the options of the method to guide the transmitter to the receiver and vice versa, modulation of the angular position of the beam and/or of the directional pattern of the optical system of the receiver with low amplitude is used, and the phase and form of the intensity signal from the sensitive position element or the data sensitive elementrelative to the phase and form of the modulating signal are used to determine the error vector to adjust the steering system.
The modulation amplitude can be varied depending on the distance between the transmitter and the receiver. Controllers may have a data buffer. The buffered controller data is used in the event of a sudden beam interruption by an obstacle for a period of time before the connection is restored by switching to another trajectory or due to the disappearance of the obstacle.
When the buffer is emptied, the lost data of the video frames in some realizations are replaced by the data of the corresponding black frames. The beam can have a temporal division of its position, so that all the trajectories on which the beam is present form a connection suitable for data transmission.
During system operation in some realizations, the location of mirrors and retransmitters or additional steering systems is memorized, and this information is used to speed up the restoration of communication via alternative trajectories. The initial targeting of the steering system can be performed by scanning the space with Lissajous figures with a variable phase or non-multiple harmonic frequencies, or without phase change and on multiple harmonics.
By means of the steering system the trajectory of the beam is changed in case of its interruption by an obstacle or for other reasons to ensure that the beam reaches the optical system of the receiver or one of the additional optical systems of the receiver in its composition.
The steering system can use mirrors and retransmitters or additional steering systems to create an alternative beam path to bypass the obstacle.
In some realizations, the beam is separated by means of the optical system of the receiver, and a part of it is directed to an additional optical beam position sensor.
The directional pattern of the receiver's optical system is controlled, for example, by an electromechanical element, if the pattern is controllable.
In some realizations of the method, two or more rays are used simultaneously, traveling on different trajectories. In this case, the transmitter and its steering system emit and direct two or more beams simultaneously on different trajectories.
With the help of an optical emitter, a multiplexed signal can be emitted at several wavelengths at once, and the receiver can accordingly receive them.
The second of the set tasks is achieved by that the system for information transmission to a virtual reality headset using optical and/or radio radiation, which includes a transmitter, a receiver, controllers, an optical emitter, a sensitive data element, interfaces for external communication, according to the invention, has an optical receiver system, auxiliary interfaces, a sensitive beam position element, and a beam steering system.
The optical system of the receiver may be branched, having additional optical systems for transmitting the signal to the data sensitive elementusing a connecting cable (fiber optic or a cable for transmitting electrical signals, or a combination thereof).
The beam steering system may include retransmitters.
The beam steering system may include external mirrors.
The beam steering system may include additional beam steering systems.
An optical filter that passes through only the wavelength band corresponding to the wavelength of the optical emitter can be applied to the sensitive data element.
The optical emitter may represent a source of differential signal at two wavelengths, and the data sensitive elementof the receiver, respectively, may be a differential sensor with appropriate optical filters.
The system may contain an additional optical beam position sensor which is a matrix or a four-quadrant sensor.
The system may contain a beam splitter based on wavelengths, which splits the beam into a part that goes to the data sensitive elementand to the sensitive position element. The optical system of the receiver may have an electromechanical system for concentrating the beam on the optically sensitive data element.
The optical system of the receiver may contain an optical element having a multi- lobed directional pattern.
The transmitter and/or receiver may have a mark and a corresponding sensor, the mark being an additional source of radiation or a retro-reflector illuminated by the receiver or transmitter, respectively.
The receiver may have an additional source to provide the primary beam targeting from the transmitter to the receiver, and there is a corresponding optical system on the transmitter and a sensitive element for its detection.
The receiver may bear a mark, which is a retro-reflector, illuminated in the side the transmitter.
Controllers may include a buffer for buffering the data stream.
The system may have a deflecting element of the steering system.
Galvanometers with mirrors can be used as a deflecting element.
Micro-electromechanical mirrors can be used as a deflecting element.
The steering system may have in addition to galvanometers and micro electromechanical mirrors an additional mechanical drive to provide an additional beam steering angle. This drive can use stepper motors, servomotors or collectorless motors.
A matrix of photosensitive elements can be used as a sensitive data element, each of which has the ability to be switched to an amplifier.
The system may have a switched group of several photosensitive elements connected in parallel and connected to a single amplifier.
A matrix of photosensitive elements can be used as a sensitive data element, each of which is connected to a separate amplifier.
The optical system of the receiver may use a diffuse or dissipative element to transmit optical radiation to a data sensitive elementor a sensitive position element with approximately the same intensity regardless of the angle of incidence.
An integrating sphere can be used as the dissipative element.
The data sensitive elementmay include an optical amplifier. An example of such an optical amplifier is a semiconductor optical amplifier or an erbium-doped fiber amplifier (EDFA). The system has an external communication interface that includes a fiber optic data line.
The optical emitter and the steering system can be implemented using a phased array of optical emitters or a holographic optical beam control system. The steering system, if implemented using galvanometers or MEMS mirrors, may have a resonant mode for one or both axes.
The claimed system and method due to the narrow direction of the beam have a high signal-to-noise ratio already due to the high brightness of the beam relative to ambient light.
One of the key features is the ability to "transparently" extend the standard wired interface, such that neither the host computer nor the virtual reality headset has information about the existence of the wireless system, or perceive it as a standard extender/retransmitter or its simulator. Thus, it is possible to use the system as an independent accessory that may be used with any headset of any brand if it has a compatible standard interface (such as USB or HDMI/DisplayPort + USB, etc.), and this is exactly the case with the vast majority of existing products.
A single sensor in a standard housing commonly used in popular SFP/SFP + modules can be used to obtain data. And for the targeting and feedback system, some small part of the beam is branched off to a separate single sensor or a multi-segment sensor, or a standard CMOS matrix. For a standard CMOS matrix, the beam may have a separate wavelength used for tracking, which allows the use of standard silicon matrices that have no sensitivity at wavelengths such as 1,550 nm, which are common in network technology. This also provides additional opportunities for building the optics and separating the tasks of tracking and data transmission. Independent control of position tracking and data beams is not excluded. In the case of a single beam position sensor, there is no need to determine the spatial orientation of the headset, and the beam may have a weakly modulated angle, which will give it, for example, a circular trajectory. Due to the presence of a certain gradient of beam intensity from its center to the edge, any deviation of the rotation center from the sensor center results in demodulation of the intensity signal on the sensor, forming corresponding harmonics with certain phases and amplitudes. Since the phase of the signal modulating the angle is known to the system, the signal phase on the sensor unambiguously gives the direction of the 2-dimensional error vector, and its amplitude determines the error vector module for the targeting system. An important feature of this approach (with separation of the beam for feedback and for data exchange) is that the optical system can increase the angle sensitivity of the part of the beam used for feedback. Therefore, a small beam displacement on the data sensor will correspond to a large beam displacement on the position sensor, in other words, an error signal will already exist, even when the data beam is still in place. This is a qualitative, fundamental difference with the prototype, since the adjustment is performed prior to the loss of signal intensity and not after it.
The system allows the user to move freely, turn, bend and move without losing connection.
The system uses non-flat, spherical or aspherical mirrors or mirrors of complex shape and small size, located at the corners of the room. This makes a fundamental difference in the system acceptability for home use and reduces installation costs. It also assumes more than one alternative beam path and ensures more incidence angles from which the receiver can be reached. Such a mirror can be placed even in the corner near the floor, getting an extra path from the bottom up.
The system allows effective steering angles exceeding simultaneously 90 degrees vertically and 180 degrees horizontally (is resolved with the help of an additional mechanical steering system, relatively rough and slow).
The invention is explained by illustrations.
Fig. 1 shows the system for data transmission. The structural schematic of the system supports implementation of the method for transmitting information, which forms a wireless connection of interfaces.
1 - connectors
2 - interfaces
3 - controller 4 - auxiliary wireless interface
5 - position sensitive element
6 - steering system driver
7 - optical transmitter
8 - beam steering system 9 - beam
10 - receiver optical system
11 - data sensitive element
12 - power supply
13 - radio waves or optical radiation 14 - optional additional sensors optical connectors
15 - optional additional sensors electrical connectors
Fig. 2 shows an example of the arrangement of a branched optical system of the receiver, which demonstrates a variant of location of additional optical systems. 20 - receiver housing
21 - additional optical system of the receiver 22 - connecting cable (fiber optic and/or electric)
23 - a user using a virtual reality headset.
Fig. 3 shows an example of using a system with a virtual reality headset 50, mirrors 25 and additional optical systems of the receiver 21. The image shows interaction between these components, which allows the user to move freely, turn and adopt any posture while maintaining the connection.
24 - transmitter
25 - mirror
26 - a beam traveling by a straight trajectory to the main optical system of the receiver
27 - a beam that bypasses an obstacle in direct line of sight between the transmitter and the optical system of the receiver by means of reflecting in a mirror
28 - a beam traveling by a straight trajectory to the additional optical system of the receiver.
Fig. 4 shows the concentration at a wide angle, the matrix element, a variant of the multibeam system which shows the principle of concentration of the beam that comes to the optical system of the receiver 10 or the additional optical system 21 which has a multi- lobed directivity pattern and uses a matrix optical element. The field of view of the sensitive element 11 of the receiver showing that the system has a sensitivity at a wide angle relative to the axis of the sensitive element.
29 - matrix optical element
30 - sensitive area
31 - field of view / beam of optical radiation traveling at a normally to the plane of the sensitive element
32 - divergence angle of the field of view 33 - field of view / beam of optical radiation traveling at an angle to the plane of the sensitive element
Fig. 5 shows the concentration at a wide angle, the matrix element, a variant of the multibeam system with an increased angle of divergence of the directional pattern. The image shows the principle of concentration of the beam that comes to the optical system of the receiver 10 or the additional optical system 21 which has a multi-lobed directivity pattern, uses a matrix optical element and has an improved ability to concentrate the beam into a small-sized area while maintaining wide-angle directional sensitivity pattern. The image shows the field of view of the sensitive element 1 1 of the receiver showing that the system has a sensitivity at a wide angle relative to the axis of the sensitive element.
34 - optical fiber
35 - fiber optic bundle holder
36 - lens 37 - effective field of view of the fiber optic bundle,
Fig. 6 shows the beam movement on the lens surface + concentration at a narrow angle, which shows the principle of concentration of the beam coming to the optical system 10 of the receiver or the additional optical system 21 which has a relatively narrow directional sensitivity pattern and uses an optical element enabling the rays that came from different angles to be focused in the same area, due to the proper choice of the beam location on the lens surface relative to its axis. The image shows the path of the beam coming to the sensitive element 11 of the receiver.
38 - lens.
Fig. 7 shows an example of a controlled optical system of the receiver with a matrix optical element, which demonstrates a controlled optical system of the receiver that has movable elements and uses matrix optical elements. The beam coming at an angle does not fall properly on the sensitive element without proper adjustment of the position of one of the optical elements in the system.
39 - static matrix optical element
40 - movable matrix optical element in the home position 41 - collimating lens
42 - movable matrix optical element in the displaced position,
43 - field of view / beam of optical radiation that goes at an angle to the axis of the collimating lens outside the system and hits the sensitive element due to the fact that the system has the element 42 in the displaced position 44 - field of view / beam of optical radiation that goes parallel to the axis of the collimating lens outside the system which is in the home position,
45 - focus point (field of view / beam of optical radiation that goes at an angle to the axis of the collimating lens outside the system and does not hit the sensitive element due to the fact that the system is in home position). Fig. 8 shows targeting and bypassing of obstacles. Block diagram of an example of the system operation in the presence of an obstacle, which demonstrates the use of mirrors to bypass the obstacle.
46 - obstacle
47 - receiver 48 - line of sight of the receiver.
Fig. 9 shows the block diagram of a system application example. Block diagram of an example of the system application in conjunction with a computer or gaming console 49, a virtual reality headset 50 and optional mirrors or retransmitters, or external beam steering systems 51. 49 - computer or gaming console
50 - virtual reality headset/head mounted display (HMD) 51 - mirror or retransmitter or additional beam steering system.
Fig. 10 shows a retransmitter used to bypass obstacles that block direct line of sight between the receiver and the transmitter.
Fig. 11 shows an additional beam steering system used to bypass obstacles that block direct line of sight between the receiver and the transmitter.
Fig. 12 shows separation of the beam into the sensitive element of the data receiver and the sensitive element of the beam position. Explanation is given for principle of operation of the part of the optical system of the receiver that divides the beam into two: the one concentrating on the data sensitive element 11 and the one coming to the position sensitive element 5, whereby the angular sensitivity of the beam on the position sensitive element 5 is greater than the angular sensitivity of the beam on the data sensitive element 11.
52 - beam of optical radiation traveling normally to the plane of the sensitive element 53 - beam of optical radiation traveling at an angle to the plane of the sensitive element
54 - a branched part of the beam 52 leading to the position sensitive element 5
55 - beam separator
56 - optical system that concentrates the beam on the data sensitive element of the receiver
57 - optical system that increases the angular sensitivity of the beam for the position sensitive element 5.
The system can perform duplex data transmission, and therefore both parts of it, the one on the side of the computer or other host, and the one on the side of the user 23 who uses the virtual reality headset 50, are simultaneously receivers and transmitters, however, there is a difference between them, which is that the system transmits a large amount of data from the host side, mainly video stream, for which the optical emitter 7 is used. Accordingly, the system on the user side 23 receives it and transmits to the host mainly telemetry, information about the headset position and orientation, the status of controllers, acknowledgment of packets acceptance and similar information, which has a smaller volume and therefore does not require high bandwidth of the optical system. That is, the duplex data transmission system is not symmetric. Because of this, we will conditionally call the part on the host side “the transmitter” 24, and the system on the user side “the receiver” 47.
The data sensitive element 11 of the receiver is regarded as a complete set of components that converts the modulated optical radiation which enters it into an electrical data signal that can be perceived by the controller. It is somewhat different from the position sensitive element 5 of the beam, which is not intended for high-speed data flow perception, but is only used to determine the beam position relative to the target ideal position and serves to form feedback for position of the optical beam 9. Moreover, they (the optical system of the receiver and the position sensitive element) can be formed by a set of individual components sensitive to optical radiation.
The beam steering system 8 is regarded as a set of all optical elements that provide control over the position in space, regardless of the number of individual elements it consists of and where these elements are located. The optical system of the receiver 10 is regarded similarly but it ensures that the beam 9 hits the data sensitive elements 11 and/or the position sensitive elements 5.
Optics
The creation of the proposed system has a non-obvious problem which arises due to a combination of two factors:
- the user is in the area of radiation and it can get into the eyes, which imposes significant restrictions on the power of this optical radiation, such as a "class 1" laser according to IEC 60825-1;
- the operation speed of an optical sensor is proportional to the ratio of the power that reaches the sensitive surface to its area, because the larger the area, the larger the capacity, and therefore its recharging with a fixed radiation power is longer. Since the power and other parameters of the emitter are limited by user safety requirements (such as "class 1" for lasers under IEC 60825-1), high operation speed can only be achieved by reducing the sensor size and concentrating all available beam power on a small area of its surface. This is a key principle for obtaining a working device, and it is used in the system and distinguishes it from other known ones. That is, the optical beam 9 for high-speed data transmission is collimated, small in diameter (for example, 2 mm) and precisely aimed at the receiver optical system 10, which focuses/concentrates it into a small point on the surface of the data sensitive element 11, which may be, for example 100- 400 pm or even smaller in size. The optical system 10 of the receiver, in turn, ensures that the focused optical beam 9 or a sufficient part of it hits the sensor regardless of the angle to the optical axis of such a system, or rotates this system so that the angle between the optical axis and the beam is small, or adjusts the system by electromechanical methods so that the focused beam 9 hits the sensor, that is, the data sensitive element 11.
The small displacement of the focused beam depending on the angle of incidence is one of the main differences in the invention, as well as for some variants of implementing and retaining a sufficient part of it on the receiver by means of an optical system with a wide or multi-lobed directivity pattern (Fig. 4, Fig. 5, Fig. 7) in terms of the sensitivity of the system 'optics + sensor'. Electromechanical systems on the receiver side, if any, should be compact and, for example, arranged using MEMS mirrors or small galvanometers, should simplify the task of adjusting to one-dimensional, perform displacement in only one plane, or be compact for other reasons. The receiver optical system 10 ensures signal reception when the beam falls on it at different angles. This is one of the most difficult tasks, because a beam that is not collinear to the optical axis of the system focuses accordingly outside the optical axis and not at the focal point 45, in other words, it deviates from the center and can go beyond the sensor - the data sensitive element 11. To receive the beam on the small data sensitive element 11, the system must ensure an acceptable signal level regardless of the angle of incidence. This is not an obvious task as, for example, wide-angle and so-called "fisheye" lenses which may seem like a good option to achieve this result, although reducing the angular sensitivity of the system, have a high efficiency of the beam concentration on the sensor only at small angles and with a beam diameter approaching zero, which is impossible.
To achieve this result, optical systems with multi-lobed directional patterns or controlled systems and systems using the matrix optical element 29 can be used. An example of such a system are the systems shown in Fig.4, Fig.5, Fig.7. Each of the shown systems has the following feature: for each of them such positioning of the beam 33 exists (which goes at an angle to the plane of the sensitive element), in which the beam 33 would be concentrated on the sensitive element 11 and not outside it, which would lead to signal loss.
One of the factors that allows concentration of the beam in the sensor area is that at relatively large distances from the transmitter to the receiver (compared to the size of the receiving optical system) significant movement on the lens surface of the optical system of the receiver 10 is achieved by small angle changes. This allows to compensate for the displacement of the point formed by the beam coming at an angle, as shown in Fig. 6 - both rays 31, 33 (field of view / beam of optical radiation) fall on the sensitive element 11, despite the fact that the beam 33 coming at an angle focuses quite far from the optical axis. This is an example of a system with a narrow directional pattern of the receiving optical element.
For practical use as a data transmission system for a virtual reality headset, such an optical receiver system with a narrow directional pattern (Fig.6) must either have a targeting system (electromechanical, electro-optical, magneto-optical, controlled otherwise, which ensures achievement of a similar result), which directs it to transmitter 24 so that it is in the range of sensitivity of the receiver 47, or must have movable optical elements to compensate for the displacement of the point into which the beam 9 is concentrated, or move the sensor so that a concentrated beam falls onto it. In other words, it is necessary to have a possibility to control the directional pattern of the receiver. One of the variants of solution to this problem is to use a diffusive or dissipative element which is guaranteed to lead a part of the beam to the sensor, regardless of the angle of incidence of the beam on its outer or inner surface. Such an element may be an integrating sphere or other structure with similar properties and its combination with other optical elements. An optical amplifier in front of the sensor can be used in the system to compensate for losses on such a dissipative element, although this is not the only case where the optical amplifier makes sense, it can be used in any case and any implementation variant to restore lost power or to reduce system sensitivity to the quality of concentration of the beam on the sensitive element 11. For example, such an amplifier may be EDFA (erbium-doped fiber amplifier) or a semiconductor optical amplifier.
To achieve a more radical improvement, it is possible to use a matrix or other complex optical element 29, which allows focusing the beam on the sensitive element 11. Fig. 4 and Fig. 5 schematically show such an element and its effect on the rays 31, 33 that came from different angles. In practice, it may be an array of Fresnel lenses located on a certain surface, an optical system with a variable refractive index or other optical system. It is also a variant of the optical system with a multi-lobed directional pattern. The "multi- lobed" optical element is good in that it bypasses the limitations imposed by geometric optics when working with only one lens (the inevitable deviation of the beam focus point from the optical axis, the greater the beam angle deviation, the further deviates its concentration point). Such a complex optical element allows to maximize the utilization of the above relationship (significant movement on the surface of the lens 29 is achieved by a small change in the angle).
Another solution variant is to use a matrix of sensitive elements and connect the most illuminated element or group of the most illuminated elements to the signal amplifier. This can be combined with using a matrix / multi-lobe optical element (Fig. 4, Fig. 5, Fig. 7) to reduce the required density and number of such sensors. This has an effect similar to moving the sensor mechanically to the point into which the beam has been concentrated (or the beam position has been adjusted by some system so that it hits the sensor). The advantage of this method is that no electromechanical systems are required. However, the use of electromechanical systems is not excluded and they can be used to get the best results with multi-lobed or matrix optical systems.
An example of the operation of a multi-lobed optical system with a moving part (which can be driven electromechanically) is Fig. 7.
The optical system of the receiver can be branched (Fig. 2), thus providing additional paths of the beam 27, by which a connection can be formed. The system can be built in such a way that hitting any of its branches ensures data transmission, for example, for a virtual reality headset it can be two lenses, objectives or other optical elements that transmit the signal to the optically sensitive element: one part of the optical system 10 is located, for example, on the user's head, and the other part (additional optical system 21) on the user's back or elsewhere. When one of the optical elements is blocked, the system can transfer the beam to another one, thus maintaining the connection (Fig.8). Such additional optical elements can be conveniently connected by means of optical fiber to the corresponding optional optical connectors 14, which allows to have optical sensors only in one place in the system without duplicating them.
At the same time, the use of additional sensitive elements for each additional optical system 10 or the use of a combination of the two approaches is not excluded. For example, the additional optical system 21 splits the beam into two and directs one part to the optical fiber, and the other to the sensitive element 5 of the beam position, the data from which is transmitted to the receiver 47 electrically. Alternatively, both beams are concentrated on the respective sensitive elements, and the received data is transmitted to the receiver 47 via the connecting cable 22.
The retransmitters 51 (Figs. 10, 51) may be implemented as a combination of the above-described receiver 47 and transmitter 24 or as an optical system that uses the primary transmitter beam directly, redirecting it to the receiver 47 via its own steering and feedback system 8. The latter variant is called here an additional steering system (Fig. 11). Such retransmitters can use the auxiliary interface 4 to obtain a feedback signal for targeting.
The optical emitter 7 and the steering system 8 can be implemented using lasers, galvanometers, MEMS mirrors or a phased array of optical emitters (https://doi.org/10.1364/QL.39.004575) or a holographic optical beam control system, such as Holographic Optical Beam-Steering (HOBS).
A combination of active optical media and structures that can vary the beam steering angle depending on its parameters such as wavelength and polarization, or depending on the fields or mechanical stresses applied to them can also be used, and in the case of wavelength sensitivity, an optical emitter 7 with modulated wavelength is used. (Examples of such structures: DOI: 10.1109/JLT.2018.2832200 and https://doi.org/10.1364/OE.399376).Sensorics
The smaller the beam divergence angle, the less power is required to achieve a high signal-to-noise ratio. The use of collimated laser radiation makes it possible to obtain a signal which significantly exceeds in amplitude the noise from ambient illumination.
To improve the signal-to-noise ratio even more, an optical filter can be used that passes through only the wavelength band corresponding to the wavelength of the optical emitter 7.
For group use of many transmitters and receivers in one room, paired transmitters 24 and receivers 47 having different wavelengths of the optical emitter 7 and corresponding optical filters on the receivers can be used.
An additional method of improving the quality of signal transmission can be differential signal transmission at two wavelengths with separation on the receiver and differential amplification of signals from the corresponding optical sensors. Differential transmission will reduce the impact of broadband interference emitters such as the sun.
Data transmission can be carried out on many wavelengths at once on one beam 9 and can be spatially divided by wavelengths on the corresponding sensitive elements 11 on the receiver 47. In SFP modules for fiber-optic networks, this technology is called WDM (wavelength-division multiplexing), but the difference for this system is that there is no need to place the working wavelengths in the so-called optical fiber transparency windows, because the transmission is carried out through free space.
An optical amplifier, such as an EDFA (erbium-doped fiber amplifier), a semiconductor optical amplifier, or another optical amplifier may be used to further amplify the signal.
To ensure at the same time the protection of user's eyes and a higher signal level, the optical emitter 7 may have controlled variable power, while the transmitter 24 maintains a safe power level until optical communication is established, which allows long-term exposure of the organs of vision without adversely affecting them. The optical emitter 7 increases the power level above this safe level in the presence of information from the receiver 47 that the beam has hit the optical system 10 of the receiver, and in case of communication loss, quickly reduces the power level back to a safe level. Power level reduction should occur during the time that is safe for exposure of the eyes at increased power.
Organization of data flows
The system has an auxiliary radio, optical or other channel 13 of one/two-way communication for transmitting data that does not require high bandwidth and can be used to synchronize the receiver 47 and the transmitter 24 (coordination of targeting systems), as well as for transmission of duplex interfaces. This channel can be represented by any interface the bandwidth of which is sufficient to transmit data from the receiver to the transmitter with an acceptable delay. For example, it can be a radio channel with ODFM, QAM or other modulation, or an optical communication channel that can operate without the need for beam collimation and targeting (due to lower speed requirements). Preference should be given to a channel that is less sensitive to interference and has less delay. Here, such a channel is called the auxiliary interface 4.
The system has a limited speed of response to the appearing obstacle 46 which blocks the beam 9 and hence the data flow. Data buffering can be used to prevent the user from noticing the switching time. Accordingly, it is desirable that the buffer size be such that it does not get empty out during the reconnection time. Of course, the larger the buffer, the greater the delay, but the system should aim for a reconnection time so that the delay caused by buffering would be unnoticeable to the user 23.
If the buffer gets empty, video frames can be replaced simply by black frames which minimize the negative impact on the user experience, as they cause less disorientation than the "frozen" picture.
An option to replace black frames can be frames with a color that matches the most common, medium color, or the one perceived as the overall or background color of the scene. The system may have a possibility to operate as a "transparent" extension of the standard interfaces of virtual reality headsets and to work regardless of their model. Such a system may also identify itself as a repeater, retransmitter, hub, or a media converter, extension or other intermediate device used to extend the distance, branch, or restore signal quality of the respective interfaces, as it does not interfere with the logic of software on the computer or console 49 and with their interaction with the virtual reality headset 50.
The ability of the system to be used as an independent and universal, "transparent" system that extends standard interfaces gives a very big advantage in that such a system does not require software integration to work with it, and does not depend on specific software and hardware solutions of the virtual reality headset to which it applies.
A fiber optic data line or its combination with other interfaces can be used as interface 2, and the use of an optical data line makes it possible to use this data without further conversion into electrical pulses and radiation by means of an optical emitter 7. Optical radiation from the interface can be directly or indirectly output to the beam steering system 8 without the additional step of detecting and reading data in a form available for processing by the controller 3 and radiating the data stream using the optical emitter 7.
Targeting
To ensure uninterrupted communication, the steering system 8 forms a collimated beam 9 and controls it, directing it to the optical system 10 of the receiver or to the additional optical system 21. To achieve this, the steering system 8 has feedback from the receiver 47, which can be transmitted through the auxiliary interface 4.
The feedback system can operate at a different wavelength of optical radiation than the main channel, so the receiver 47 can use a separate sensitive element 5 for beam position and the sensitive element 11 for data transmission after spatial separation of rays in the optical system of the receiver 47. In addition, the optical beam 9 that transmits data can also be split by the optical system 10 of the receiver to be used both for targeting and for data transmission. In any case, the receiving optical system 10 will be advantageous if a certain beam displacement on the sensitive position element 5 would correspond to a smaller displacement on the data sensitive element 11 used to receive data from the transmitter 24. This principle is shown on Fig. 12.
The feedback system directs the beam so that it always hits the receiver (the optical system 10 of the receiver or the additional optical system 21), regardless of whether it is at rest, rotating or moving.
The primary hit of the beam 9 into the receiver is ensured by scanning (sweeping) throughout the entire reachable space or throughout the pre-known locations with priority. Lissajous figures with a sliding phase can be used as the sweeping for initial scan and reconnection.
This method ensures more optimal use of the frequency characteristic of the deflecting system. This is due to the smaller influence of the upper harmonics of the spectrum of such a signal on its shape than in the case of using rectangular and sawtooth pulses for raster or similar sweeping. However, the use of common raster sweeping is not excluded. If a modulated beam angle is used, it is advisable to increase the modulation amplitude to facilitate the search.
One of the methods of primary targeting is to un-collimate the optical beam 9 so that the error signal would exist in a significant area around the axis of the optical beam 9.
To recover the connection, scanning can take place in a certain area around the point where the connection was lost with a gradual increase in the size of that area in the event of a failed recovery.
During the initial scan, as soon as the optical beam 9 hits the optical system 10 of the receiver or the additional optical system 21, the feedback system begins to hold it on the receiver 47. The feedback system can forcibly modulate the angular position of the optical beam 9 to obtain the error signal.
And for the targeting and feedback system, some small part of the optical beam 9 can be branched off to a separate single sensor or a multi-segment sensor, or a CMOS or similar matrix. Such a sensor is called here the position sensitive element 5. An important feature of this approach (with separation of the beam into two, for feedback and for data exchange) is that the optical system 10 can increase the angular sensitivity of the part of the beam used for feedback. Therefore, a small beam displacement on the data sensitive element 11 will correspond to a large beam displacement on the sensitive position element 5, in other words, an error signal from the position sensitive element 5 will already exist, even when the data beam is still completely on the data sensitive element 11. This is a qualitative and a fundamental improvement, since the adjustment is performed prior to the loss of signal intensity and not after it. This is shown on Fig. 12.
However, this does not preclude the use of the data sensitive element 11 to obtain a signal of beam intensity corresponding to its position.
An example of a modulated signal used to aim the optical beam 9 at the optical system 10 of the receiver may be a sine-shaped signal shifted 90 degrees on one axis relative to another. Thus, it will perform circular rotations around the middle position. Let us assume that the angular sensitivity (directional pattern) of the optical receiver and the shape of the intensity distribution of the optical beam has axial symmetry (is a figure of rotation, for example, the distribution of beam intensity can be assumed to have the form of a two- dimensional Gaussian function).
Then, when the beam rotates in a circular trajectory, the center of which is on the axis of the respective distributions, the signal intensity on the sensor will be constant. But when the rotation center deviates from the axis (sensitivity peak), this signal will begin to demodulate, forming harmonics. Accordingly, the first harmonic will have its minimum amplitude at the point of the trajectory that has the lowest value of sensitivity in the directional sensitivity pattern of the receiver. Likewise for the maximum. In other words, the phase of the received signal will provide information about the direction of displacement of the rotation center from the peak of the sensor sensitivity. Its amplitude will accordingly tell about the displacement distance. That is, it gives an error vector for the control system, so that we get a control system that does not depend on the relative position, orientation, inclination of the receiver 47 and the transmitter 24 and the specific features of the design of its optical system 10, 21. Having this error vector, it is possible to use one of the many control methods to achieve the desired technical result.
A simplified control system can also be used, such as a gradient descent that uses the signal from the sensor and is not based on modulation and the error vector obtained by it, or another algorithm with the same or similar result.
When using galvanometers or MEMS mirrors as a steering element of the steering system 8, the mirror can have a resonant mode for one or both axes, which has a high quality factor and a feedback system to control the amplitude and phase of oscillations and allows to impose on the target steering angle the angular modulation with a small amplitude. This approach reduces the losses for high frequency modulation and increases the modulation frequency compared to a similar system, which is completely damped at high frequencies.
To improve the dynamic characteristics of the system, the targeting system can assume that the receiver continues to move in a straight line at the speed that has been determined, and adjusts the signal relative to the forecast that was made under this assumption.
Independent control of the beams for targeting and data transmission is also not excluded, so that only the targeting beam has the modulated angle. This allows to have a more stable data transmission beam, which may be required to achieve the highest data transmission rates. If a controlled optical system of the receiver is used (Fig. 7), the same error vector can be used to direct the optical system 10 of the receiver to the transmitter 24, in which case it is desirable to spread the operation speed (operating frequency range) of both control systems to simplify the control task. The targeting system of the receiver 47 may have a significantly lower cutoff frequency than the system targeting the optical beam 9 from the transmitter 24 due to the lower angular sensitivity of the optical system 10 compared to the angular sensitivity of the transmitter 24.
To direct the receiver 47 to the transmitter 24, radiation can be used that is emitted from the optical system 10 of the receiver at a wide angle and registered by a sensor on the transmitter 24. An active or passive optical mark (such as retro-reflector) illuminated by the relevant part of the system can be used as the emitter. The same approach for targeting can be used vice versa: to guide the receiver 47 to the transmitter 24.
Since the angle of steering of the optical beam 9 by the beam steering system 8 can be significantly limited by the capabilities of the steering element (galvanometers or MEMS mirrors), the transmitter 24, additional steering systems 51 (Fig. 11 ), retransmitters 51 (Fig. 10) or the optical system 10 of the receiver can have an additional mechanical drive using motors for example, for rough rotation of the beam steering system 8 or the optical system 10 of the receiver, or a part of the receiver housing 47, the retransmitter 51 (Fig. 10), additional system 51 of the optical beam steering (Fig. 11), or transmitter 24. This rough mechanical drive must operate in such a way that the position of the receiver 47 is averaged in the center of the field of view of the beam steering system or the optical system 10 of the receiver. That is, a rough mechanical drive has much less requirements to speed and accuracy, and the main purpose of its existence is to expand the effective field of view of the system.
Obstacles 46 are bypassed by mirrors 25 or retransmitters 51 (Fig. 10) or additional steering systems 51 (Fig. 11) located at other points than the main transmitter 24. If the connection is interrupted due to loss of direct line of sight behind the obstacle 46, the system starts scanning similar to that used for the initial finding of the receiver 47. During scanning, the beam hits the mirrors 25 or retransmitters 51 and thus can reach the receiver 47 on a different trajectory, thus bypassing the obstacle 46. The number of such retransmitters 51, mirrors 25 or additional steering systems 51 is not limited. It is proposed to use not flat mirrors but mirrors that have, for example, a spherical shape. Such a mirror forms an image with a much larger viewing angle compared to a flat mirror, and the size of such a mirror can be small without deteriorating the viewing angle. The desirable reconnection time is the one during which the buffer on the receiver side, if any, does not get empty.
It is possible to speed up such a search for a new trajectory after the current trajectory is interrupted by the obstacle 46 by calibrating the system or using the information on location of the mirror 25 or the retransmitter 51. If such information is available, the transmitter 24 does not have to scan the entire space, but can start immediately with the mirrors 25 or retransmitters 51.
If the location of the mirrors 25 and repeaters 51 is remembered, their position in space and / or geometry can be further determined, which allows to determine or make initial assumptions about the correct direction of the optical beam 9 to reach the optical system 10 of the receiver on an alternate trajectory 27 knowing the last relevant trajectory. This allows to change the trajectory faster and with less error.
It is possible to simultaneously transmit two or more optical beams 9 on two or more trajectories 26, 27 or to perform time division of the beam position to ensure continuous data transmission in the event of emergence of an obstacle 46 in the beam path. The time division of the beam position means that it regularly changes its trajectory from one to another, which leads it to the optical system 10 of the receiver or auxiliary optical systems 21 using mirrors 25 or retransmitters 51 or additional steering systems 51. Blocking of one trajectory 26, 27 with the obstacle 46 does not cause a temporary complete loss of channel bandwidth, and with this strategy the transmitter always knows the most relevant directions in which the beam can reach the receiving optical system 10 or the auxiliary optical system 21.
The method is implemented as follows.
Information between the computer or gaming console 49 and the virtual reality headset 50 is transmitted from the transmitter 24 and received by the receiver 47 using optical and radio radiation. In this case, the receiver sends to the transmitter 24 through the auxiliary interfaces 4 the information necessary for targeting the optical beam 9 and synchronization. On the transmitter 24 or the receiver 47 (or both), by means of the controller 3 the operation of the transmitter 24 and the receiver 47 is coordinated, data streams are processed and sent via the appropriate interfaces 2 to the target device 49, 50. In this case, the rate of data transmission from the transmitter 24 to the receiver 47 and vice versa may be asymmetric, and for high-speed data transmission the optical emitter 7 is used and by means of the steering system 8 the optical beam 9 is formed and directed to the receiving optical system 10 of the receiver and held thereon orienting by data / level of the signal transmitted via the auxiliary interface 4. Using the wide-angle receiving optical system 10, the beam is transmitted to the optical receiver 11 and then to the controller 3 of the receiver.
The received data is sent after processing through interfaces 2 to the virtual reality headset 50. Auxiliary interfaces 4 are used for low-speed transmission. The controllers 3 divide the data from the interfaces 2 into that which requires high-speed transmission using the optical emitter 7 and that which can be transmitted via auxiliary interfaces 4.
Additional non-flat mirrors 25 are used to bypass the obstacles 46 which block direct visibility between the transmitter 24 and the receiver 47, and in the presence of mirrors 25 the optical beam 9 is directed by means of the steering system 8 either directly to the receiving optical system 10 or to its image in the mirror 25 located in a place other than the transmitter 24, or retransmitters 51 (Fig. 10) are used instead of mirrors 25 or additional beam steering systems 51 (Fig. 11).
The optical system 10 of the receiver separates the beam. A part of the beam is directed to the sensitive position element 5 which can detect the signal intensity. The signal from this sensor is used for the targeting system of the transmitter 24. The angular steering of the optical beam can be amplified to provide better tracking, as illustrated in Fig.12 (53). The signal from this sensor is used for the targeting system of the transmitter 24 and the receiver 47, if it exists (the receiver 47 requires a targeting system for the transmitter 24 if the directional pattern of the receiving optical system 10 is not wide enough for satisfactory practical application).
The receiving optical system 10 may be branched and is capable of transmitting a signal to the optical emitter 7 or controller 3 from any additional optical system 21 of the receiver. Thus, the transmitter 24 can establish communication via any of the branches. If this method is used to connect to the virtual reality headset 50, additional optical systems 21 may be located in different places on the user's body 23, including head, arms, back, backpack, abdomen, or elsewhere (Fig. 2). This possibility reduces the problem of blocking the receiver 47 with the hands / body of the user 23, with a successful placement making the blocking unlikely or completely impossible (Fig. 3).
The receiver 47 may be powered by an external power source or battery, accumulators or other stand-alone source.

Claims

1. A method for transmitting information by optical and/or radio emission, which includes data transmission from the transmitter, where the optical emitter emits a modulated optical beam which is directed by a steering system to a data sensitive element on the receiver where the controllers process the data obtained via the beam, wherein the steering system is used in its interaction with the receiving optical system to bypass the obstacles that stand in the way of the beam from transmitter to receiver, and the beam steering and retention on the receiver are carried out by means of a signal from a position sensitive element or a data sensitive element sent to the transmitter and the steering system via an auxiliary radio or optical channel.
2. The method according to claim 1, wherein to direct the transmitter to the receiver and vice versa modulation of the angular position of the beam and/or of the directivity pattern of the receiver optical system with low amplitude is used, and the phase and form of the intensity signal from the position sensitive element or the data sensitive element relative to the phase and form of the modulating signal are used to determine the error vector to adjust the steering system.
3. The method according to either of the claims 1-2, wherein the modulation amplitude is variable depending on the distance between the transmitter and receiver.
4. The method according to claim 1, wherein the buffered data is used in the event of a sudden beam interruption by an obstacle for a period of time before the connection is restored by switching to another trajectory or due to the disappearance of the obstacle.
5. The method according to claim 4, wherein in that when the buffer is emptied, the lost video frames data is replaced by the corresponding black frames data.
6. The method according to claim 1, wherein the beam has a time division of its position, so that all the trajectories on which the beam is present form a connection suitable for data transmission.
7. The method according to claim 1, wherein is distinctive in that during system operation, the location of mirrors and retransmitters or additional steering systems is memorized, and this information is used to speed up the restoration of communication via alternative trajectories.
8. The method according to claim 1, wherein the initial targeting of the steering system is performed by scanning the space with Lissajou figures with a variable phase or non-multiple harmonic frequencies, or without phase change and on multiple harmonics.
9. The method according to claim 1, wherein by means of the steering system the trajectory of the beam is changed in case of its interruption by an obstacle or for other reasons to ensure that the beam reaches the receiver optical system or one of the additional optical systems of the receiver in its composition.
10. The method according to claim 1, wherein the steering system uses mirrors and retransmitters or additional steering systems to create an alternative beam path to bypass the obstacle.
11. The method according to claim 1, wherein the steering system uses two or more beams simultaneously that travel on different trajectories.
12. The method according to claim 1, wherein the beam is separated by means of the receiver optical system, and a part of it is directed to an additional optical beam position sensor.
13. The method according to claim 1, wherein the receiver optical system is controlled, for example, by an electromechanical element.
14. The method according to claim 1, wherein the transmitter and its steering system emit and direct two or more beams simultaneously on different trajectories.
15. The method according to claim 1, wherein by means of an optical emitter a multiplexed signal is emitted at several wavelengths at once, and the receiver accordingly receives them.
16. A system for information transmission to a virtual reality headset using optical and/or radio radiation, which includes a transmitter, a receiver, controllers, an optical emitter, a data sensitive element, interfaces for external communication, wherein the system has a receiving optical system, auxiliary interfaces, a beam position sesitive element, and a beam steering system.
17. The system according to claim 16, wherein the receiver optical system is branched, having additional optical systems for transmitting the signal to the data sensitive element using a connecting cable (fiber optic or a cable for transmitting electrical signals, or a combination thereof).
18. The system according to claim 16, wherein the beam steering system includes retransmitters.
19. The system according to claim 16, wherein the beam steering system includes external mirrors.
20. The system according to claim 16, wherein the beam steering system includes additional beam steering systems.
21. The system according to claim 16, wherein an optical filter is used on the data sensitive element, which passes through only the wavelength band corresponding to the wavelength of the optical emitter.
22 The system according to claim 16, wherein the optical emitter has a source of differential signal at two wavelengths, and the data sensitive element of the receiver, respectively, may be a differential sensor with appropriate optical filters.
23. The system according to claim 16, wherein it contains an additional optical beam position sensor which is a matrix or a four-quadrant sensor.
24. The system according to claim 16, wherein it contains a beam splitter based on wavelengths, which splits the beam into a part that goes to the data sensitive element and to the position sensitive element.
25. The system according to claim 16, wherein the system uses a beam that includes two wavelengths, and only one of the wavelengths gets angular modulation.
26. The system according to claim 16, wherein the receiver optical system splits the beam directing its part to an additional optical beam position sensor.
27. The system according to claim 16, wherein the receiver optical system has an electromechanical system for the concentration of the beam on the optically sensitive data sensitive element.
28. The system according to claim 16, wherein the receiver optical system contains an optical element having a multi-lobed directional pattern.
29. The system according to claim 16, wherein the transmitter and/or receiver has a mark and a corresponding sensor, the mark being an additional source of radiation or a retroreflector illuminated by the receiver or transmitter, respectively.
30. The system according to claim 16, wherein there is an additional source on the receiver to provide the primary beam targeting from the transmitter to the receiver, and there is a corresponding optical system on the transmitter and a sensitive element for its detection.
31. The system according to claim 16, wherein the receiver has a mark which is a retroreflector illuminated from the side of the transmitter.
32. The system according to claim 16, wherein the controllers include a buffer for buffering the data stream.
33. The system according to claim 16, wherein it has a deflecting element of the steering system.
34. The system according to claim 33, wherein galvanometers with mirrors are used as a steering element.
35. The system according to claim 33, wherein microelectromechanical mirrors are used as the steering element.
36. The system according to claim 16, wherein the steering system has an additional mechanical drive to ensure an additional beam steering angle.
37. The system according to claim 36, wherein stepper motors, servomotors or brushless motors are used as mechanical drive.
38. The system according to claim 16, wherein a matrix of photosensitive elements is used as a data sensitive element, each of which has the ability to be switched to an amplifier.
39. The system according to claim 16, wherein it has a switched group of several photosensitive elements joined in parallel and connected to a single amplifier.
40. The system according to claim 16, wherein it has a switched group of several photosensitive elements, each of which is connected to a separate amplifier.
41. The system according to claim 16, wherein a matrix of photosensitive elements is used as a data sensitive element, each of which is connected to a separate amplifier.
42. The system according to claim 16, wherein the receiver optical system uses a diffuse or dispersive element to transmit optical radiation to a data sensitive element or a position sensitive element with approximately the same intensity regardless of the angle of incidence.
43. The system according to claim 42, wherein an integrating sphere is used as the dispersive element.
44. The system according to claim 1, wherein the data sensitive element includes an optical amplifier.
45. The system according to claim 44, wherein a semiconductor optical amplifier or an erbium-doped fiber amplifier (EDFA) as the optical amplifier.
46. The system according to claim 16, wherein it has an external communication interface that includes a fiber optic data line.
47. The system according to claim 16, wherein the optical emitter and the steering system are implemented using a phased array of optical emitters or a holographic optical beam control system.
48. The system according to claim 16, wherein the steering system which is implemented by means of galvanometers or MEMS mirrors has a resonant mode for one or both axes.
49. The system according to claim 16, wherein the auxiliary interfaces use modulated optical radiation for communication.
50. The system according to claim 16, wherein the transmitter and its steering system are able by design to emit and direct two or more beams simultaneously on different trajectories.
51. The system according to claim 16, wherein the system has duplex optical data transmission.
PCT/UA2022/000015 2021-04-22 2022-04-06 Information transmission method and system for its implementation WO2022225499A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
UAA202102113 2021-04-22
UAA202102113 2021-04-22

Publications (1)

Publication Number Publication Date
WO2022225499A1 true WO2022225499A1 (en) 2022-10-27

Family

ID=83722498

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/UA2022/000015 WO2022225499A1 (en) 2021-04-22 2022-04-06 Information transmission method and system for its implementation

Country Status (1)

Country Link
WO (1) WO2022225499A1 (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4867560A (en) * 1987-04-13 1989-09-19 Nec Corporation Optical alignment system
WO2002086555A2 (en) * 2001-04-20 2002-10-31 Texas Instruments Incorporated Method and apparatus for aligning optical wireless links
US6630915B1 (en) 1999-01-26 2003-10-07 Lsa. Inc. Wireless transmission system for transmitting data to a simulation system user
US20070058987A1 (en) 2005-09-13 2007-03-15 Kabushiki Kaisha Toshiba Visible light communication system and method therefor
EP1952562B1 (en) * 2005-08-02 2010-03-17 ITT Manufacturing Enterprises, Inc. Acquisition, pointing, and tracking architecture for laser communication
KR20130116452A (en) 2012-03-27 2013-10-24 숭실대학교산학협력단 Device and method for changing lighting angle of optical transmitter in visible light communication systems
WO2015169626A1 (en) 2014-05-09 2015-11-12 Thales Head visualization system with "wireless" communication
KR20160054441A (en) 2016-04-26 2016-05-16 울산대학교 산학협력단 Radio Data Transmission and Reception System for Virtual Reality
US20180294877A1 (en) 2014-11-06 2018-10-11 The Research Foundation For The State University Of New York Reconfigurable wireless data center network using free-space optics
US20190155372A1 (en) 2017-11-17 2019-05-23 Microsoft Technology Licensing, Llc Mixed reality offload using free space optics

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4867560A (en) * 1987-04-13 1989-09-19 Nec Corporation Optical alignment system
US6630915B1 (en) 1999-01-26 2003-10-07 Lsa. Inc. Wireless transmission system for transmitting data to a simulation system user
WO2002086555A2 (en) * 2001-04-20 2002-10-31 Texas Instruments Incorporated Method and apparatus for aligning optical wireless links
EP1952562B1 (en) * 2005-08-02 2010-03-17 ITT Manufacturing Enterprises, Inc. Acquisition, pointing, and tracking architecture for laser communication
US20070058987A1 (en) 2005-09-13 2007-03-15 Kabushiki Kaisha Toshiba Visible light communication system and method therefor
KR20130116452A (en) 2012-03-27 2013-10-24 숭실대학교산학협력단 Device and method for changing lighting angle of optical transmitter in visible light communication systems
WO2015169626A1 (en) 2014-05-09 2015-11-12 Thales Head visualization system with "wireless" communication
US20180294877A1 (en) 2014-11-06 2018-10-11 The Research Foundation For The State University Of New York Reconfigurable wireless data center network using free-space optics
KR20160054441A (en) 2016-04-26 2016-05-16 울산대학교 산학협력단 Radio Data Transmission and Reception System for Virtual Reality
US20190155372A1 (en) 2017-11-17 2019-05-23 Microsoft Technology Licensing, Llc Mixed reality offload using free space optics

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
MD SHAIFUR RAHMAN ET AL: "FSO-VR", WEARABLE SYSTEMS AND APPLICATIONS, ACM, 2 PENN PLAZA, SUITE 701NEW YORKNY10121-0701USA, 10 June 2018 (2018-06-10), pages 11 - 15, XP058414089, ISBN: 978-1-4503-5842-2, DOI: 10.1145/3211960.3211971 *
OMID ABARI ET AL., 14TH USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION (NSDI '17, 2017, pages 531 - 544

Similar Documents

Publication Publication Date Title
RU2728799C2 (en) Eye projection system and method
JP6367273B2 (en) Scan depth engine
KR20200060712A (en) Method and apparatus for light field imaging for projected 3D light field generation
US7292788B2 (en) Multi-beam laser communications system and method
US20020131121A1 (en) Transceiver, system, and method for free-space optical communication and tracking
US10983344B2 (en) System for optical wireless communication to extended reality immersion device
JP2004535120A (en) Atmospheric optical data transmission system
JP2007219562A (en) Virtual retinal display with fiber optic point source
US9083893B2 (en) Projector capable of suppressing deterioration of irradiated projection while improving brightness
US20040042798A1 (en) Optical transceiver with a dual-axis tilt mirror for pointing and tracking free space communication signals
Bekkali et al. New generation free-space optical communication systems with advanced optical beam stabilizer
US6944403B2 (en) MEMS based over-the-air optical data transmission system
JP2023512879A (en) Spatial/temporal polarization correction optical system for scanning beam system
EP1394494B1 (en) Precision optical alignment system
Glushko et al. MEMS-based tracking for an indoor optical wireless communication bidirectional link
WO2022225499A1 (en) Information transmission method and system for its implementation
US11774737B2 (en) Folded-beam, low-obliquity beam scanner
JP2023512873A (en) Polarization multiplexing optics for head-mounted display systems
Cai et al. Experimental demonstration of an underwater wireless optical link employing orbital angular momentum (OAM) modes with fast auto-alignment system
JP2006310913A (en) Optical transmission apparatus and optical space transmission system
CN112596173B (en) Optical signal transmitter
CN107209332B (en) Optical transmission apparatus, optical reception apparatus, and optical cable
US11956021B1 (en) Communication system and method for cloud-assisted free-space optical backhaul
JPH01226228A (en) Optical space transmission equipment
CN113557715B (en) Multifunctional three-dimensional scanner

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22722912

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE