WO2022242704A1 - 用于刷新头戴式显示设备的屏幕的方法和头戴式显示设备 - Google Patents

用于刷新头戴式显示设备的屏幕的方法和头戴式显示设备 Download PDF

Info

Publication number
WO2022242704A1
WO2022242704A1 PCT/CN2022/093762 CN2022093762W WO2022242704A1 WO 2022242704 A1 WO2022242704 A1 WO 2022242704A1 CN 2022093762 W CN2022093762 W CN 2022093762W WO 2022242704 A1 WO2022242704 A1 WO 2022242704A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
data
moment
pose
user
Prior art date
Application number
PCT/CN2022/093762
Other languages
English (en)
French (fr)
Inventor
吕宪伟
张宇
Original Assignee
闪耀现实(无锡)科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 闪耀现实(无锡)科技有限公司 filed Critical 闪耀现实(无锡)科技有限公司
Priority to EP22804024.2A priority Critical patent/EP4343407A1/en
Publication of WO2022242704A1 publication Critical patent/WO2022242704A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/18—Timing circuits for raster scan displays
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39—Control of the bit-mapped memory
    • G09G5/393—Arrangements for updating the contents of the bit-mapped memory
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39—Control of the bit-mapped memory
    • G09G5/399—Control of the bit-mapped memory using two or more bit-mapped memories, the operations of which are switched in time, e.g. ping-pong buffers
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2310/00—Command of the display device
    • G09G2310/06—Details of flat display driving waveforms
    • G09G2310/061—Details of flat display driving waveforms for resetting or blanking
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/04—Display device controller operating with a plurality of display units

Definitions

  • the present disclosure relates to the technical field of image display, and in particular to a method for refreshing a screen of a head-mounted display device, a head-mounted display device, and a non-transitory computer-readable storage medium storing computer instructions.
  • Head-mounted display devices such as augmented reality (Augmented Reality, AR), virtual reality (Virtual Reality, VR) or mixed reality (Mixed Reality, MR) glasses usually have two screens, respectively corresponding to the user's left eye and right eye.
  • the above-mentioned head-mounted display device is usually connected to the smart terminal through a Type-c interface, so that the two screens of the head-mounted display device display the data transmitted by the smart terminal.
  • common screen refresh methods include roller illumination and global illumination. If the rolling shutter lighting refresh method is used, the two screens of the head-mounted display device need to be refreshed at the same time. Usually, the rolling shutter lighting refresh method is realized by progressive exposure. The start and end display times of each line on the screen are inconsistent, which may easily lead to distortion of the displayed image, that is, the jelly effect. If the global illumination refresh method is used to avoid the jelly effect, it is necessary to make all the pixels of the screen light up and turn off at the same time.
  • Embodiments of the present disclosure propose a method and apparatus for refreshing a screen of a head-mounted display device.
  • the embodiments of the present disclosure provide a method for refreshing the first screen and the second screen of the head-mounted display device.
  • the method includes: from the first moment to the second moment, sending first data to both the first screen and the second screen, writing the first data into the first screen to configure the first screen as a black screen, and the second screen at least Part of the time is a bright screen state; and from the second moment to the third moment, sending second data to both the first screen and the second screen, and writing the second data to the second screen to configure the second screen as a black screen state,
  • the first screen is in a bright screen state at least part of the time to display the first data.
  • inventions of the present disclosure provide an apparatus for refreshing a first screen and a second screen of a head-mounted display device, and the first screen and the second screen respectively correspond to two eyes of a user.
  • the device includes: a data sending unit configured to send first data to both the first screen and the second screen from the first moment to the second moment, write the first data into the first screen, and configure the first screen as In a black screen state, the second screen is in a bright screen state at least part of the time; and from the second moment to the third moment, the second data is sent to both the first screen and the second screen, and the second data is written into the second screen to configure
  • the second screen is in a black state, and the first screen is in a bright state at least part of the time to display the first data.
  • an embodiment of the present disclosure provides a wearable device, including the device for refreshing the first screen and the second screen of the head-mounted display device according to the second aspect.
  • an embodiment of the present disclosure provides an electronic device, including: one or more processors; a storage device, on which one or more programs are stored, and when one or more programs are processed by one or more executed by a processor, so that one or more processors implement the method in the first aspect.
  • embodiments of the present disclosure provide a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the method in the first aspect.
  • embodiments of the present disclosure provide a computer program product, including computer programs/instructions, where the computer program/instructions implement the method in the first aspect when executed by a processor.
  • FIG. 1 is a schematic flowchart of an implementation of a method for refreshing a first screen and a second screen of a head-mounted display device according to an embodiment of the present disclosure.
  • FIG. 2 is a schematic diagram of a connection between a main device and a head-mounted display device according to an embodiment of the present disclosure.
  • Fig. 3 is a schematic diagram of an implementation flow for time synchronization provided by an embodiment of the present disclosure.
  • Fig. 4 is a schematic structural diagram of first data and second data provided by an embodiment of the present disclosure.
  • FIG. 5 is a schematic diagram of an application process of the method provided by the embodiment of the present disclosure in practice.
  • FIG. 6 is a schematic diagram of another practical application flow of the method provided by the embodiment of the present disclosure.
  • FIG. 7A to 9C are schematic flowcharts of a method for reducing display delay of image data based on asynchronous time warping provided by an embodiment of the present disclosure.
  • FIG. 10 is a schematic structural diagram of an apparatus for refreshing a first screen and a second screen of a head-mounted display device according to an embodiment of the present disclosure.
  • FIG. 11 is a schematic structural diagram of an electronic device for refreshing a first screen and a second screen of a head-mounted display device according to an embodiment of the present disclosure.
  • the term “comprising” and its variants represent open terms, meaning “including but not limited to”.
  • the term “based on” means “based at least in part on”.
  • the terms “one embodiment” and “an embodiment” mean “at least one embodiment.”
  • the term “another embodiment” means “at least one other embodiment.”
  • the terms “first”, “second”, etc. may refer to different or the same object. The following may include other definitions, either express or implied. Unless the context clearly indicates otherwise, the definition of a term is consistent throughout the specification.
  • an embodiment of the present disclosure provides a method for refreshing the first screen and the second screen of a head-mounted display device, when the user wears the head-mounted display device , the first screen and the second screen respectively correspond to the user's eyes.
  • the first screen corresponds to the user's left eye
  • the second screen corresponds to the user's right eye
  • the first screen corresponds to the user's right eye
  • the second screen corresponds to the user's left eye.
  • the "corresponding" here means that when the user wears the head-mounted display device, for example, the user's left eye views the displayed content through the first screen, and the user's right eye views the displayed content through the second screen.
  • first screen and second screen are the screens of the head-mounted display device, which is only an exemplary description of the embodiment of the present disclosure, and does not impose any limitation on the embodiment of the present disclosure.
  • the execution subject of the method may be various types of computing devices, or may be an application program or an application (Application, APP) installed on the computing device.
  • the computing device for example, may be a user terminal such as a mobile phone, a tablet computer, or a head-mounted display device, or may be a server or the like.
  • a head-mounted display device may be connected to other devices for receiving, displaying or processing data from the device, such as data from an application of the device.
  • the device connected to the head-mounted display device may be other terminals such as a mobile phone or a computer, and is referred to as a main device in this document.
  • the head-mounted display device and the main device can be connected through a USB interface, so as to transmit the data of the main device to the head-mounted display device.
  • Data described herein includes, but is not limited to, audio data, video data, image data, and the like.
  • the head-mounted display device may not be connected with other devices, the head-mounted display device may have components for storing the above data, and the data may be directly transmitted from the internal components of the head-mounted display device itself.
  • the main device and the head-mounted display device can be connected through a Type-c interface.
  • the video data of the main device can be transmitted to the screen control chip of the head-mounted display device through the DisplayPort (DP) protocol, and the screen control The chip can transmit video data to the first screen and the second screen through low-voltage differential signal (LVDS) technology, and the screen control chip can also send signals to the first screen and the second screen through lines to control other functions of the screen.
  • DP DisplayPort
  • LVDS low-voltage differential signal
  • a buffer area (Buffer) is usually required, so that the central processing unit (CPU) or graphics processing unit (GPU) is required to generate an image in the buffer area in advance, and then the screen control chip reads the image from the buffer area. Get the image and transfer it to the screen.
  • this method is prone to transmission delays.
  • data transmission may be performed in a manner that does not separately set a buffer area. For example, only a small buffer area is set on the screen control chip, and this buffer area can only buffer a few lines of data, but cannot buffer the data of a whole frame of image. In other words, the image data that can be stored in the buffer area is less than a whole frame of image data. That is, data transferred from the master device needs to be transferred to the screen immediately, thereby reducing latency.
  • the data can be written to the screen in advance, the screen is controlled to be in a black state during the process of writing data to the screen, and then the screen is lit to display the data that has been written to the screen.
  • the refresh rate supported by the screen of the head-mounted display device is usually 60Hz, 90Hz, 120Hz and 144Hz, etc.
  • the upper limit of the image data transmitted by the Type-c interface through the DP protocol is less than 1920*1200*2*120Hz. Therefore, when using related technologies, when the transmission bandwidth is limited, it is impossible to transmit high frame rate and high resolution images, such as 1920*1200*2*144, 3840*1200*2*120 or 3840*1200*2*144 .
  • the usual practice is to refresh the image data corresponding to the two screens at the same time, so that the data is transmitted from the main device to the two screens through the Type-c interface.
  • a whole frame of image data is 3840*1200*60Hz or 1920*2400*60Hz
  • the time for two screens to write a whole frame of image data is 16.666...ms
  • the delay time is 16.666...ms+screen lighting time/2. Since the two screens need to be refreshed at the same time, the delay of each screen is also 16.666...ms+screen lighting time/2, and the refresh delay is relatively large.
  • the present disclosure adopts a manner of refreshing two screens in turn, so as to reduce the refresh delay of each screen.
  • the time to write data to a screen only needs 8.333...ms, that is, the delay time is only 8.333...ms+screen lighting time/ 2.
  • the refresh delay of each screen can be reduced.
  • a method for refreshing the first screen and the second screen of the display device of the present disclosure will be specifically described as follows.
  • the first data and the second data may include image data for refreshing the first screen and the second screen.
  • the first data and the second data may be, for example, image data sent by a master device connected to the head-mounted display device.
  • the "black screen state” in the present disclosure means that the screen does not display any content, for example, the screen may not display image data. For example the screen can appear black.
  • the "bright screen state” in the present disclosure refers to a state where the screen is turned on and data has been written. During the time interval from the first moment to the second moment or from the second moment to the third moment, the screen may always be in the bright state, or may be in the bright state for part of the time, and in the black screen state for part of the time. In the present disclosure, when data is written into the screen, the screen can be controlled to be in a black state.
  • the screen may display written data. It should be noted that, if during the time interval from the first moment to the second moment or from the second moment to the third moment, the control screen is in the bright screen state for part of the time and is in the black screen state for part of the time, then in this time interval, even if The screen is in a black state for part of the time, and the data transmitted at this time will not be written to the screen.
  • the first screen and the second screen may be controlled to be in a black screen state or a bright screen state by sending signals to the first screen and the second screen.
  • the screen control chip continuously sends signals to the first screen and the second screen, and may continuously send the first signal to the first screen and the second screen between the first moment and the second moment, and the first signal indicates that the first screen is The screen is in a black state, and the second screen is in a bright state.
  • the screen control chip sends signals to the first screen and the second screen at intervals, and may send a second signal to the first screen and the second screen at the first moment, and the second signal indicates that the second signal between the first moment and the second moment One screen is in a black state, and the second screen is in a bright state.
  • the screen control chip sends a third signal to the first screen and the second screen at the initial moment, such as the first moment, and the third signal indicates that the first screen and the second screen are in a preset period (such as the above-mentioned first screen). time interval, the second moment, the third moment... until the time interval divided by the nth moment) is in a bright screen state or a black screen state.
  • the first screen and the second screen can be set to be in a black screen state or a bright screen state according to a predetermined period.
  • the first screen and the second screen can be set to be in the bright screen state or the black screen state according to the time interval divided by the first moment, the second moment, the third moment... until the nth moment, without sending the first screen and the second screen
  • the second screen sends a signal.
  • the first moment may be the initial moment, and may be the moment when the first vertical synchronization signal of the first screen and the second screen is obtained. At this time, neither the first screen nor the second screen starts to display images. .
  • the screen control chip sends the first data to both the first screen and the second screen, within this time interval, the first data can be written into the first screen, and the first screen Configure it as a black screen state, and configure the second screen as a bright screen state at least part of the time.
  • the first moment is the initial moment, since no data is transmitted and written into the first screen or the second screen before this moment, although the second screen is in the on-screen state at least part of the time, the second The screen does not display image data.
  • the screen control chip sends the second data to both the first screen and the second screen.
  • the second data can be written into the second screen, and the second screen
  • the configuration is in a black screen state, and the first screen is in a bright screen state at least part of the time to display the first data.
  • the first screen can be written in the time interval between the second moment and the third moment. It is configured as a bright screen state to display the first data. It can be understood that if the first moment is not the initial moment and data has been written on the second screen, then between the first moment and the second moment, the second screen can be in the bright screen state at least part of the time and display the previous The data written.
  • the data can only be written to one of the screen A in any time interval, and the control screen A is in a black screen state, and the other screen B is at least part of the time
  • the screen is turned on to display the data (if any) that has been written in the previous time interval.
  • only data can be written into screen B, and the screen B is controlled to be in a black state, and the screen A is in a bright state at least part of the time to display the data written in the previous time interval. That is, the two screens are refreshed in turn, so that the two screens can alternately write data and display data in turn, thereby reducing the refresh delay of each screen.
  • the time interval between the first moment and the second moment may be equal to the time interval between the second moment and the third moment. For example, if each of the aforementioned moments is the moment when the vertical synchronization signal is obtained, then the time interval between any two vertical synchronization signals is the same. In this way, the time for each screen to write data is equal, which facilitates the preparation of data for transmission to the head-mounted display device.
  • the number of frames per second (Frames Per Second, FPS) of the screen can be synchronized with the refresh rate of the screen.
  • the first moment, the second moment and the third moment can be the moment of obtaining the vertical synchronization (Vertical synchronization, Vsync) signal of the first screen and the second screen of the head-mounted display device, or the first moment and the third moment
  • the moment may be the moment of obtaining the Vsync signals of the first screen and the second screen of the head-mounted display device
  • the second moment may be the moment between the moments of obtaining the two Vsync signals, for example, the middle of the moments of obtaining the two Vsync signals time. It can be understood that at least one of the first moment, the second moment and the third moment is the moment at which the vertical synchronization signals of the first screen and the second screen are acquired.
  • the Vsync signal is used to indicate the end of the previous frame of data and the start of the next frame of data.
  • the time stamp of the Vsync of the screen may be transmitted to the master device through the MCU.
  • the head-mounted display device is connected to the main device through a Type-c interface to display the data of the App of the main device.
  • the App of the main device can obtain the Vsync of the screen of the head-mounted display device through the main device. If the main device is not authorized, the App of the main device needs to obtain the Vsync of the screen through the MCU. It is necessary to align the system time of the head-mounted display device with the system time of the main device through the system time synchronization method. At the same time, you can also know the current refresh status of the screen, such as which screen to write data to next, and control Which screen is in the bright state.
  • the method for refreshing the screen of the present disclosure further includes:
  • S210 Receive a time synchronization request sent by a master device connected to the head-mounted display device, where the time synchronization request includes a first time of the master device and a time synchronization protocol.
  • the time deviation between the main device connected to the head-mounted display device and the head-mounted display device can be calibrated, thereby ensuring the accuracy of data transmission.
  • the head-mounted display device is connected to the main device through the Type-c interface, and the main device initiates a time synchronization request, then the system time t h1 of the main device and the time synchronization protocol are transmitted to the MCU through the USB protocol, and the MCU receives the time synchronization request.
  • the system time t g1 of the MCU is obtained immediately, and t h1 and t g1 are sent back to the master device, and the master device receives the MCU time synchronization protocol response, and immediately obtains the system time t h2 of the master device.
  • t h1 -t g1 includes the difference delta_t between the system time of the master device and the system time of the head-mounted display device and the time t_usb transmitted through USB. Then delta_t can be obtained by the following calculation.
  • delta_t (t h1 -t g1 +t h2 -t g1 )/2
  • the time synchronization protocol can be executed every once in a while, and the delta_t obtained each time is weighted and averaged to obtain the filtered delta_t, so that the change of delta_t is more stable, and it can also handle the frequency between the two systems The change in delta_t due to the offset.
  • the first data may include first full frame data
  • the second data may include second full frame data.
  • the first entire frame of data and the second entire frame of data may be configured as the same image data; or the first entire frame of data may be configured as left-eye image data, and the second entire frame of data may be configured as right-eye image data.
  • the "whole frame of data" in the present disclosure refers to the data of a complete frame of image.
  • the first data and the second data may also include partial data of a whole frame of data.
  • the first data includes the first partial data of the third full frame of data
  • the second data includes the second partial data of the third full frame of data as an example, wherein the first partial data and the second partial data constitute the third full frame of data.
  • the first data may include a part of data of a complete frame of image, for example, it may be one-half, one-third, or one-fourth of one frame of complete image.
  • the second data may include the remaining one-half, two-thirds or three-quarters data of the complete frame of the image, so that the first data and the second data form the complete frame of the image. It can be understood that when the first data and the second data are not half of the data of the whole frame, the time interval between the first moment, the second moment and the third moment should be adjusted accordingly.
  • first data and second data are schematic structural diagram of first data and second data provided in an embodiment of the present disclosure.
  • first data may include the left half data of the third full frame data
  • second data may include The right half data of the third full frame data.
  • first data may include data in the upper half of the third full frame of data
  • second data may include data in the lower half of the third full frame of data.
  • the first data and the second data are configured as the same image data, and when the user wears the head-mounted display device, only a picture with a two-dimensional display effect can be viewed.
  • the first data and the second data may be configured as different image data, for example, the first full frame data is configured as left eye image data, and the second full frame data is configured as right eye image data.
  • the "left-eye image data" mentioned in this disclosure refers to the data configured to be transmitted to the screen (such as the first screen) corresponding to the user's left eye.
  • the image data for the left eye and the image data for the right eye may be configured as image data with parallax to achieve a stereoscopic display effect.
  • the user wears the head-mounted display device he can watch a picture with a three-dimensional display effect.
  • left-eye image data and right-eye image data are configured as image data with parallax
  • the parallax between the left-eye image data and right-eye image data is such that the user can produce a stereoscopic effect after viewing with both eyes.
  • the first data is configured as left-eye image data
  • the second data is configured as right-eye image data
  • the first data and the second data are configured as different data
  • the left-eye image data and the right-eye image data If there is no parallax between the eye images, the two-dimensional display effect can still be achieved when using this method.
  • the first data and the second data may be different in areas where the visual fields of the left and right eyes overlap.
  • FIG. 5 shows an embodiment of the screen refreshing method of the present disclosure.
  • the nth data can be sent to both the first screen and the second screen, and the nth data can be written into the first screen. screen, to configure the first screen to be in a black state, and the second screen to be in a bright state at least part of the time.
  • the second screen is configured as a bright screen, it can display the data written earlier.
  • n may refer to positive integers such as 1, 2, 3, . . . .
  • n refers to 1, it can be understood as the initial state. It should be noted that since no data is written to the second screen before the first Vsync signal is acquired, the time interval between the acquisition of the first Vsync signal and the acquisition of the second Vsync signal , although the second screen is on at least part of the time, it does not display data.
  • the n+1th data can be sent to both the first screen and the second screen, and the n+1th data can be written into the second screen
  • the screen is configured to configure the second screen to be in a black screen state, and the first screen to be in a bright screen state at least part of the time, wherein, when the first screen is configured to be in a bright screen state, the nth data that has been written can be displayed.
  • the operations of continuously transmitting data, writing data in turn, and displaying data in turn are performed.
  • the explanation about the nth data and the n+1th data can refer to the above explanation about the first data and the second data, for example, the nth data and the n+1th data can be whole frame data.
  • FIG. 6 shows an embodiment of the screen refreshing method of the present disclosure.
  • the nth data can be sent to both the first screen and the second screen.
  • Any moment between the acquisition of the nth Vsync signal and the acquisition of the n+1th Vsync signal may be used as a dividing point, for example, the middle moment of the time interval between acquiring two Vsync signals.
  • the time when the nth Vsync signal is acquired is T n
  • the time when the n+1th Vsync signal is acquired is T n+1
  • the above intermediate time may be T n +1/2(T n+1 -T n ).
  • the first part of data of the nth data can be written into the first screen to configure the first screen as a black screen, and the second screen as a bright screen at least part of the time state.
  • the second screen When the second screen is configured as a bright screen, it can display the data written earlier.
  • the second part of the nth data can be written into the second screen to configure the second screen as a black screen, and the first screen is at least part of the time In bright screen state.
  • the first screen is configured as a bright screen state, it can display the first part of the written nth data.
  • the operations of continuously transmitting data, writing data in turn, and displaying data in turn are performed.
  • the first part of the nth data can be one-half of the entire frame of data
  • the second part of the nth data can be the remaining half of the entire frame of data
  • the first part of the data and the second part of the data constitute whole frame of data.
  • an asynchronous time warp (Asynchronous Timewarp, ATW) technology may be used in the embodiments of the present disclosure.
  • the "pose” referred to in the following embodiments of the present disclosure may refer to the user's position and posture, for example, may be the user's 6-degree-of-freedom (6dof) pose.
  • 6dof 6-degree-of-freedom
  • the real pose of the user at a preset moment such as position, motion direction, speed, acceleration, etc., can be obtained.
  • the estimation operation in the following embodiments can be based on the acquired real pose of the user, or can calculate the estimated pose of the user at a preset moment based on the historical data of the real pose of the user.
  • the data can be transformed based on the deviation between different estimated poses. For example, all the rendered data can be transformed, or a part of the rendered data can be transformed.
  • the transformed data can correspond to the pose of the user at the preset moment, where the preset moment refers to the moment when the screen display has written data, so that the pose of the user at this moment is the same as the picture displayed on the screen at this moment Correspondingly, the display delay problem is avoided.
  • data may be rendered within a time interval between the first preset moment and the second preset moment.
  • the second preset moment may be the moment when the data is rendered, or may be a moment after a period of time after the rendering is completed.
  • ATW operations may be performed on the master device to transmit the transformed data to the head-mounted display device.
  • an embodiment of the present disclosure provides a method for reducing display delay of image data based on asynchronous time warping.
  • the first preset moment T1 and the second preset moment T2 are before the first moment t1
  • the third preset moment T3 is between the second moment t2 and the third moment t3, which is Displays the time when data has been written.
  • the first data includes the first full frame of data (for example, the nth full frame of data in FIG. 7B ), before the first moment t1 of transmitting the nth full frame of data, it may be Render the nth full frame of data between a preset moment and the second preset moment, obtain the first pose of the user at the first preset moment T1, and calculate the user's pose at the third preset moment T3 based on the first pose The first estimated pose.
  • the second pose of the user at the second preset moment T2 is obtained, and the second estimated pose of the user at the third preset moment T3 is calculated based on the second pose.
  • the pose of T3 corresponds.
  • the first data may include the first partial data of the third full frame of data (for example, the nth full frame of data in FIG. 7C ), and the first partial data of the nth full frame of data is transmitted.
  • the first part of data of the nth full frame of data can be rendered between the first preset moment and the second preset moment, and the first pose of the user at the first preset moment T1 can be obtained, based on the first
  • a pose calculates the first estimated pose of the user at the third preset moment T3.
  • the second pose of the user at the second preset moment T2 is obtained, and the second estimated pose of the user at the third preset moment T3 is calculated based on the second pose.
  • the first partial data of the n-th full frame data is transformed, so that the transformed first data is consistent with the user at the third preset moment T3 corresponding to the pose.
  • the method shown in this embodiment can similarly perform rendering and transformation operations on the second data, and the timing of performing each operation can be deduced similarly according to the foregoing embodiments.
  • the second data may be rendered between two preset moments before the second moment t2, and the user's estimate at the estimated moment of displaying the second data is calculated based on the user's pose acquired at the two preset moments pose, and then transform at least a portion of the second data before a second time instant t2.
  • this embodiment adopts the operation of separately rendering and transforming the first data and the second data in the corresponding data transmission. This method enables the user to watch through each screen, and the displayed data is consistent with the data displayed by the user. corresponding to the pose at the time.
  • Figure 8A shows another alternative embodiment.
  • the main difference between the embodiment shown in FIG. 8B and the embodiment shown in FIG. 7B is that, between the first preset time T1 and the second preset time T2, the nth full frame data and the n+1th full frame are rendered data.
  • the data corresponding to the two screens are all rendered before the first time t1, and before the first time t1, the nth full frame data and the n+1th full frame data are transformed.
  • this method calculates the user's estimated pose at a data display time based on the user's pose collected at the first preset time T1 and the second preset time T2, in order to take into account the nth whole frame data and the n+1th Of the two moments displayed by the entire frame of data, the third preset moment T3 will be closer to the third moment t3, and may even be the third moment t3, so as to take into account the above two moments.
  • the main difference between the embodiment shown in FIG. 8C and the embodiment shown in FIG. 7C is that, between the first preset time T1 and the second preset time T2, rendering the nth full frame of data will correspond to the The data is all rendered before the first moment t1, and before the first moment t1, the nth whole frame of data is transformed.
  • this embodiment reference may be made to the description of the above-mentioned embodiment 8B, which will not be repeated here.
  • rendering and transformation operations are performed on the first data and the second data before the first time t1.
  • the estimated pose of the user at a data display moment (the third preset moment T3) is calculated, and the third preset moment T3 takes into account the first preset moment T3
  • the third preset time T3 will be closer to the third time t3, and may even be the third time t3.
  • the embodiment shown in FIG. 8A adopts the method of rendering and transforming the data displayed on the two screens together, and this method is easy to operate.
  • Figure 9A shows yet another alternative embodiment.
  • time interval between the third moment and the fourth moment will be the next period of data transmission, writing data and displaying data.
  • the understanding of the third moment and the fourth moment can refer to the description of the first moment and the second moment.
  • the first data includes the first full frame data (for example, the nth full frame data shown in FIG. 9B ), and the second data includes the second full frame data (for example, the nth full frame data shown in FIG. 9B ).
  • n+1 whole frame data before the first moment t1 of transmitting the nth whole frame data, the nth whole frame data and the n+1th whole frame data can be jointly rendered between the first preset moment and the second preset moment frame data.
  • Obtain the first pose of the user at the first preset moment T1 and calculate the first estimated pose of the user at the third preset moment T3 and the third estimated pose of the user at the fifth preset moment T5 based on the first pose. Estimation pose.
  • the third preset time T3 is the time when the nth whole frame of data is displayed between the second time t2 and the third time t3
  • the fifth preset time T5 is the time when the nth whole frame of data is displayed between the third time t3 and the fourth time t4.
  • Two estimated poses at the second preset time T2 (before the first moment t1 when the nth full frame of data is transmitted), based on the first estimated pose and the second estimated pose, transform at least the nth full frame of data Part of it, so that the transformed nth whole frame data corresponds to the pose of the user at the third preset time T3.
  • the third pose of the user at the fourth preset moment T4 between the first moment t1 and the second moment t2 is obtained, and the fourth estimated pose of the user at the fifth preset moment T5 is calculated based on the third pose.
  • At the fourth preset moment T4 (before the second moment t2 when the n+1th full frame of data is transmitted), at least a part of the n+1th full frame of data is transformed based on the third estimated pose and the fourth estimated pose, In order to make the transformed n+1th whole frame data correspond to the pose of the user at the fifth preset moment.
  • this embodiment reference may be made to the description about the embodiment in FIG. 5 .
  • the first data may include the first partial data of the third full frame of data (for example, the nth full frame of data shown in FIG. 9C), and the second data may include the third full frame of data ( For example, the second partial data of the nth full frame data shown in FIG. 9C ), the first partial data and the second partial data constitute the third full frame data.
  • the nth full frame of data Before the first moment t1 when the first partial data of the nth full frame of data is transmitted, the nth full frame of data may be rendered between the first preset moment and the second preset moment.
  • the first data and the second data are jointly rendered before the first time t1, but the first data and the second data are respectively rendered before the time when the first data and the second data are transmitted.
  • the transformation operation is performed on the two data, and the transformation operation is performed based on the estimated pose of the user at the display time of the corresponding data.
  • the rendering operation of this method is simple, and when the user watches through each screen, the displayed data is consistent with the user at the time of the display. Corresponds to the pose when the data is displayed.
  • the image data to be rendered can be predicted based on the asynchronous time warping technology, and when the user's pose changes at the moment to be displayed, it can be real-time based on the change of the user's pose At least part of the first data and/or the second data is changed, so that the changed first data and/or the second data match the changed pose, thereby reducing the delay.
  • the present disclosure further provides a method for refreshing the first screen and the second screen of a head-mounted display device, wherein when the user wears the head-mounted display device, the image displayed on the first screen falls into the The visual range of one eye of the user, and the image displayed on the second screen falls into the visual range of the other eye of the user.
  • the method includes: Sending the first image data, writing the first image data into the first screen, to configure the first screen not to display the image data, and the second screen to display the written image data; and from the second moment to the third moment, to the second Both the first screen and the second screen send the second image data, write the second image data into the second screen to configure the second screen not to display image data, and the first screen displays the written first image data, the first moment At least one of , the second moment and the third moment is a moment for acquiring vertical synchronization signals of the first screen and the second screen.
  • An embodiment of the present disclosure also provides a device for refreshing the first screen and the second screen of a head-mounted display device.
  • the specific structural diagram of the device is shown in FIG. 10 , including a data sending unit configured to From the first moment to the second moment, the first data is sent to both the first screen and the second screen, and the first data is written into the first screen to configure the first screen as a black screen, and the second screen is at least part of the time Bright screen state; and from the second moment to the third moment, send the second data to both the first screen and the second screen, and write the second data into the second screen to configure the second screen as a black screen state, and the first screen
  • the screen is in a bright state at least part of the time to display the first data.
  • the device provided by the embodiment of the present disclosure, it is possible to control the first screen and the second screen to refresh the screen in turn in different time periods, so that the refresh delay of a single screen can be reduced, thereby reducing the gap between the smart terminal and the wearable display device. refresh delay.
  • an electronic device includes a processor, and optionally an internal bus, a network interface, and a memory.
  • the memory may include internal memory, such as high-speed random-access memory (Random-Access Memory, RAM), and may also include nonvolatile memory (nonvolatile memory), such as at least one disk memory.
  • RAM Random-Access Memory
  • nonvolatile memory such as at least one disk memory.
  • the electronic device may also include hardware required by other services.
  • the processor, the network interface and the memory can be connected to each other through an internal bus, which can be an ISA (Industry Standard Architecture, industry standard architecture) bus, a PCI (Peripheral Component Interconnect, peripheral component interconnection standard) bus or an EISA (Extended Industry Standard Architecture, extended industry standard architecture) bus, etc.
  • the bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one double-headed arrow is used in FIG. 11 , but it does not mean that there is only one bus or one type of bus.
  • Memory for storing programs.
  • the program may include program code, and the program code includes computer operation instructions.
  • Storage which can include internal memory and nonvolatile storage, provides instructions and data to the processor.
  • the processor reads the corresponding computer program from the non-volatile memory into the memory and runs it, forming a method device for refreshing the first screen and the second screen of the head-mounted display device on a logical level.
  • the processor executes the program stored in the memory, and is specifically used to perform the following operations:
  • the above-mentioned method for refreshing the first screen and the second screen of the head-mounted display device as provided in this specification may be applied to a processor or implemented by the processor.
  • a processor may be an integrated circuit chip with signal processing capabilities.
  • each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software.
  • the above-mentioned processor can be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processor, DSP), a dedicated integrated Circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • a general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.
  • the steps of the method disclosed in the embodiments of this specification may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register.
  • the storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware.
  • the embodiment of this specification also proposes a computer-readable storage medium, the computer-readable storage medium stores one or more programs, and the one or more programs include instructions, and when the instructions are executed by an electronic device including a plurality of application programs , the electronic device can be made to execute a method for refreshing the first screen and the second screen of the head-mounted display device, and is specifically used to execute:
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions
  • the device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
  • a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • Memory may include non-permanent storage in computer-readable media, in the form of random access memory (RAM) and/or nonvolatile memory such as read-only memory (ROM) or flash RAM. Memory is an example of computer readable media.
  • RAM random access memory
  • ROM read-only memory
  • flash RAM flash random access memory
  • Computer-readable media including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information.
  • Information may be computer readable instructions, data structures, modules of a program, or other data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Optics & Photonics (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

本公开公开了用于刷新头戴式显示设备的屏幕的方法、头戴式显示设备及存储有计算机指令的非瞬时计算机可读存储介质。具体实现方案为：从第一时刻到第二时刻，向第一屏幕和第二屏幕均发送第一数据，将第一数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态；和从第二时刻到第三时刻，向第一屏幕和第二屏幕均发送第二数据，将第二数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态以显示第一数据。

Description

用于刷新头戴式显示设备的屏幕的方法和头戴式显示设备 技术领域
本公开涉及图像显示技术领域，尤其涉及一种用于刷新头戴式显示设备的屏幕的方法、头戴式显示设备及存储有计算机指令的非瞬时计算机可读存储介质。
背景技术
随着移动便携设备的发展，智能终端和可穿戴显示设备的交互使用已经比较常见。头戴显示设备，例如增强现实(Augmented Reality，AR)、虚拟现实(Virtual Reality，VR)或混合现实(Mixed Reality,MR)眼镜通常具有两个屏幕，分别对应用户的左眼和右眼。上述头戴显示设备通常通过Type-c接口与智能终端连接，以便头戴显示设备的两个屏幕显示该智能终端传输的数据。
目前，常见的屏幕刷新方式包括卷帘照明(roller illumination)和全局照明(global illumination)两种。如采用卷帘照明刷新方式，则需要同时刷新头戴显示设备的两个屏幕。通常卷帘照明刷新方式是通过逐行曝光的方式实现的。屏幕每一行开始显示和结束显示的时间是不一致的，容易导致显示的图像出现扭曲，即果冻效应。如为了避免果冻效应采用全局照明刷新方式，则需要使屏幕所有的像素同时点亮和同时熄灭。
因此，如何降低智能终端和可穿戴显示设备之间的刷新延迟成为本领域亟需解决的技术问题。
发明内容
本公开的实施例提出了用于刷新头戴式显示设备的屏幕的方法和装置。
第一方面，本公开的实施例提供了一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的方法，在用户佩戴头戴式显示设备时，第一屏幕和第二屏幕分别对应用户的双眼。该方法包括：从第一时刻到第二时刻，向第一屏幕和第二屏幕均发送第一数据，将第一数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态；和从第二时刻到第三时刻，向第一屏幕和第二屏幕均发送第二数据，将第二数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态以显示第一数据。
第二方面，本公开的实施例提供了一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的装置，第一屏幕和第二屏幕分别对应用户的双眼。该装置包括：数据发送单元，被配置成从第一时刻到第二时刻，向第一屏幕和第二屏幕均发送第一数据，将第一数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态；和从第二时刻到第三时刻，向第一屏幕和第二屏幕均发送第二数据，将第二数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态以显示第一数据。
第三方面，本公开的实施例提供了一种可穿戴设备，包括第二方面内容的用于刷新头戴式显示 设备的第一屏幕和第二屏幕的装置。
第四方面，本公开的实施例提供了一种电子设备，包括：一个或多个处理器；存储装置，其上存储有一个或多个程序，当一个或多个程序被一个或多个处理器执行，使得一个或多个处理器实现第一方面内容的方法。
第五方面，本公开的实施例提供了一种存储有计算机指令的非瞬时计算机可读存储介质，其中，计算机指令用于使计算机执行第一方面内容的方法。
第六方面，本公开的实施例提供了一种计算机程序产品，包括计算机程序/指令，其中，该计算机程序/指令被处理器执行时实现第一方面内容的方法。
附图说明
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述，本公开的其它特征、目的和优点将会变得更明显。
图1为本公开实施例提供的一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的方法的实现流程示意图。
图2为本公开实施例提供的主设备与头戴式显示设备的连接示意图。
图3为本公开实施例提供的一种用于对时的实现流程示意图。
图4为本公开实施例提供的一种第一数据和第二数据的结构示意图。
图5为本公开实施例提供的方法在实际中的一种应用流程的示意图。
图6为本公开实施例提供的方法在实际中的另一种应用流程的示意图。
图7A～9C为本公开实施例提供的一种基于异步时间扭曲降低图像数据的显示延迟的方法的实现流程示意图。
图10为本公开实施例提供一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的装置的具体结构示意图。
图11为本公开实施例提供一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的电子设备的具体结构示意图。
具体实施方式
为使本公开的目的、技术方案和优点更加清楚，下面将结合本公开具体实施例及相应的附图对本公开技术方案进行清楚、完整地描述。可以理解的是，此处所描述的具体实施例仅仅用于解释相关申请，而非对该申请的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与有关申请相关的部分。
本文中使用的，术语“包括”及其变型表示开放的术语，含义是“包括但不限于”。术语“基于”表示“至少部分地基于”。术语“一个实施例”和“一实施例”表示“至少一个实施例”。术语“另一个实施例”表示“至少一个其他实施例”。术语“第一”、“第二”等可以指代不同的或相同的对象。下 面可以包括其他的定义，无论是明确的还是隐含的。除非上下文中明确地指明，否则一个术语的定义在整个说明书中是一致的。
需要说明的是，在不冲突的情况下，本公开中的实施例及实施例中的特征可以相互组合。下面将参考附图并结合实施例来详细说明本公开。
为解决相关技术中存在的屏幕刷新存在延迟的问题，本公开实施例提供一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的方法，在用户佩戴该头戴式显示设备时，第一屏幕和第二屏幕分别对应用户的双眼。例如，第一屏幕对应用户的左眼，第二屏幕对应用户的右眼，或者第一屏幕对应用户的右眼，第二屏幕对应用户的左眼。此处的“对应”指的是当用户佩戴该头戴显示设备时，例如，用户的左眼通过第一屏幕观看显示内容，用户的右眼通过第二屏幕观看显示内容。
需要说明的是，上述例举的第一屏幕和第二屏幕为头戴式显示设备的屏幕，仅是本公开实施例的一种示例性说明，并不对本公开实施例造成任何限定。
该方法的执行主体，可以是各种类型的计算设备，或者，可以是安装于计算设备上的应用程序或应用(Application，APP)。所述的计算设备，比如可以是手机、平板电脑、头戴式显示设备等用户终端，也可以是服务器等。
头戴式显示设备可以与其它设备相连接，用于接收、显示或处理来自该设备的数据，例如来自该设备的应用的数据。与头戴式显示设备相连接的设备可以为手机或电脑等其它终端，在本文中称之为主设备。头戴式显示设备与主设备之间通常可以通过USB接口相连接，以将主设备的数据传输到头戴式显示设备。本文所述的数据包括但不限于音频数据、视频数据和图像数据等。
需要说明的是，头戴式显示设备也可以不与其它设备相连接，头戴式显示设备可以具有存储上述数据的元件，数据可以直接从头戴式显示设备自身内部的元件之间进行传输。
例如，如图1所示，主设备和头戴式显示设备可以通过Type-c接口连接，例如主设备的视频数据可以通过DisplayPort(DP)协议传输至头戴显示设备的屏幕控制芯片，屏幕控制芯片可以通过低电压差分信号(LVDS)技术将视频数据传输至第一屏幕和第二屏幕，屏幕控制芯片还可以通过线路向第一屏幕和第二屏幕发送信号，以控制屏幕的其它功能。
需要说明的是，通常采用LVDS传输技术的话，不管屏幕处于什么状态(显示图像或黑屏等)，均需要持续的将数据传输给屏幕。一旦传输中断，则需要重新建立连接。
相关技术中，向屏幕传输数据时，通常需要缓存区(Buffer)，这样需要中央处理器(CPU)或图形处理器(GPU)预先在缓存区中生成图像，然后由屏幕控制芯片从缓存区中获取图像，再传输给屏幕。然而该方式容易出现传输延迟，在本公开中为了降低延迟，可以采取不单独设置缓存区的方式进行数据传输。例如仅在屏幕控制芯片上设置一个较小的缓存区，该缓存区仅能缓存几行数据，而不能缓存一整帧图像的数据。换言之，缓存区所能存储的图像数据少于一整帧图像数据。即，从主设备传输过来的数据需要立即传输给屏幕，从而降低延迟。
例如，将数据传输给屏幕并显示的过程，可以预先将数据写入屏幕，在数据写入屏幕的过程中控制屏幕为黑屏状态，然后将屏幕点亮并显示已经写入屏幕的数据。
通常，头戴显示设备的屏幕支持的刷新率通常为60Hz、90Hz、120Hz和144Hz等，而Type-c接口通过DP协议传输的图像数据上限小于1920*1200*2*120Hz。因此，采用相关技术时，在传输带宽受限时，无法传输高帧率和高分辨率的图像，比如1920*1200*2*144，3840*1200*2*120或者3840*1200*2*144。例如采用全局照明方式，以60Hz的刷新率刷新头戴显示设备的两个屏幕，通常的做法是同时刷新对应两个屏幕的图像数据，这样，通过Type-c接口从主设备传输至两个屏幕的一整帧图像数据为3840*1200*60Hz或者1920*2400*60Hz，则两个屏幕写入一整帧图像数据的时间为16.666…ms，延迟时间为16.666…ms+屏幕点亮时间/2。由于两个屏幕需要同时刷新，则每个屏幕的延迟也为16.666…ms+屏幕点亮时间/2，刷新延迟较大。为了降低刷新延迟，本公开采用轮流刷新两个屏幕的方式，以降低每一个屏幕的刷新延迟。沿用上例，仍以屏幕刷新频率为60Hz为例，采用本公开提供的方法，一个屏幕写入数据的时间只需要8.333...ms，也就是延迟时间仅是8.333…ms+屏幕点亮时间/2，相对于相关技术而言，可以降低每一个屏幕的刷新延迟。
如下将具体描述用于刷新本公开的显示设备的第一屏幕和第二屏幕的方法。
在一个实施例中，本公开实施例提供的该方法的实现流程如图2所示，包括如下步骤：
S110，从第一时刻到第二时刻，向第一屏幕和第二屏幕均发送第一数据，将第一数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态。
S120，从第二时刻到第三时刻，向第一屏幕和第二屏幕均发送第二数据，将第二数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态以显示第一数据。
第一数据和第二数据可以包括用于对第一屏幕和第二屏幕进行刷新的图像数据。本公开实施例中，第一数据和第二数据比如可以是与头戴式显示设备连接的主设备发送的图像数据。
本公开中“黑屏状态”指的是屏幕并不显示任何内容，例如屏幕可以不显示图像数据。例如屏幕可以呈现为黑色。本公开中的“亮屏状态”指的是屏幕点亮并显示已经写入数据的状态。从第一时刻到第二时刻或从第二时刻到第三时刻的时间间隔，屏幕可以一直为亮屏状态，也可以为部分时间为亮屏状态，部分时间为黑屏状态。本公开中在将数据写入屏幕中时，可以控制屏幕为黑屏状态。从第一时刻到第二时刻或从第二时刻到第三时刻的时间间隔内，在将屏幕控制为亮屏状态时，屏幕可以显示已经写入的数据。需要说明的是，若从第一时刻到第二时刻或从第二时刻到第三时刻的时间间隔内，控制屏幕部分时间为亮屏状态，部分时间为黑屏状态，则在该时间间隔，即使屏幕在部分时间内为黑屏状态，也不将此时传输的数据写入屏幕。
可选的，可以通过向第一屏幕和第二屏幕发送信号以控制第一屏幕和第二屏幕为黑屏状态或亮屏状态。例如，屏幕控制芯片向第一屏幕和第二屏幕持续发送信号，可以在第一时刻到第二时刻之间持续向第一屏幕和第二屏幕发送第一信号，第一信号指示第一屏幕为黑屏状态，第 二屏幕为亮屏状态。例如，屏幕控制芯片向第一屏幕和第二屏幕间隔发送信号，可以在第一时刻向第一屏幕和第二屏幕发送第二信号，第二信号指示在第一时刻到第二时刻之间第一屏幕为黑屏状态，第二屏幕为亮屏状态。在第三时刻、第四时刻……直至第n时刻均可以采取上述两种方式向屏幕发送信号以控制屏幕状态。还可以是屏幕控制芯片在初始时刻，例如第一时刻，向第一屏幕和第二屏幕发送第三信号，第三信号指示第一屏幕和第二屏幕在预设的周期(例如上述的第一时刻、第二时刻、第三时刻……直至第n时刻划分的时间间隔)内为亮屏状态或黑屏状态。
可选的，通过将第一屏幕和第二屏幕设置为根据预定周期为黑屏状态或亮屏状态。例如，可以将第一屏幕和第二屏幕设置为根据第一时刻、第二时刻、第三时刻……直至第n时刻划分的时间间隔为亮屏状态或黑屏状态，而无需向第一屏幕和第二屏幕发送信号。
在一个实施例中，第一时刻可以为初始时刻，可以为获得第一屏幕和第二屏幕的第一个垂直同步信号的时刻，此时，第一屏幕和第二屏幕可以均未开始显示图像。在第一时刻和第二时刻之间，屏幕控制芯片向第一屏幕和第二屏幕均发送第一数据，在此时间间隔内，可以将第一数据写入第一屏幕，并将第一屏幕配置为黑屏状态，第二屏幕至少部分时间配置为亮屏状态。当第一时刻为初始时刻时，由于在该时刻之前并没有数据传输并写入第一屏幕或第二屏幕，因此，虽然第二屏幕至少部分时间为亮屏状态，但是该部分时间内第二屏幕并没有显示图像数据。在第二时刻到第三时刻之间，屏幕控制芯片向第一屏幕和第二屏幕均发送第二数据，在此时间间隔内，可以将第二数据写入第二屏幕，并将第二屏幕配置为黑屏状态，第一屏幕至少部分时间为亮屏状态以显示第一数据。并且，由于在第一时刻和第二时刻之间的时间间隔内，已经将第一数据写入第一屏幕，因此在第二时刻到第三时刻之间的时间间隔内，可以将第一屏幕配置为亮屏状态以显示第一数据。可以理解的是，如果第一时刻不是初始时刻，已经在第二屏幕写入过数据，则在第一时刻和第二时刻之间，第二屏幕可以至少部分时间为亮屏状态并显示在先写入的数据。
采用本公开实施例提供的上述方法，虽然数据一直传输至两个屏幕，但是在任一个时间间隔内可以仅将数据写入其中一个屏幕A，控制屏幕A为黑屏状态，另一个屏幕B至少部分时间为亮屏状态以显示在上一个时间间隔内已经写入的数据(如有)。而在下一个时间间隔内，则可以仅将数据写入屏幕B，控制屏幕B为黑屏状态，屏幕A至少部分时间为亮屏状态以显示在上一个时间间隔内已经写入的数据。即采用轮流刷新两个屏幕的方式，这样，两个屏幕可以交替写入数据，轮流显示数据，从而可以降低每一个屏幕的刷新延迟。
在一种可选的实施方式中，第一时刻和第二时刻之间的时间间隔可以与第二时刻与第三时刻之间的时间隔相等。例如，若上述每个时刻都是获得垂直同步信号的时刻，则任意两个垂直同步信号之间的时间间隔相同。这样可以使得每个屏幕写入数据的时间都是相等的，便于准备向头戴式显示设备传输的数据。
在一种可选的实施方式中，为了避免显示画面的“撕裂”现象，可以将画面每秒传输帧数 (Frames Per Second，FPS)与屏幕的刷新率同步。此时，第一时刻、第二时刻和第三时刻可以为获取头戴式显示设备的第一屏幕和第二屏幕的垂直同步(Vertical synchronization，Vsync)信号的时刻，或者第一时刻和第三时刻可以为获取头戴式显示设备的第一屏幕和第二屏幕的Vsync信号的时刻，第二时刻可以为获取两个Vsync信号的时刻之间的时刻，例如获取两个Vsync信号的时刻的中间时刻。可以理解为第一时刻、第二时刻和第三时刻中的至少一个为获取第一屏幕和第二屏幕的垂直同步信号的时刻。
例如，如图1中头戴式显示设备的微控制单元(MCU)获取Vsync信号的时刻，Vsync信号用于指示前一帧数据的结束和下一帧数据的开始。为了得到准确的时间戳，例如，可以通过MCU将屏幕的Vsync(头戴式显示设备的DP的Vsync)的时间戳传输到主设备。例如，头戴式显示设备与主设备通过Type-c接口相连接，以显示主设备的App的数据。在主设备授权的情况下，主设备的App可以通过主设备获取头戴式显示设备的屏幕的Vsync。如果主设备不授权，则主设备的App需要通过MCU获取屏幕的Vsync。则需要通过系统对时的方式，将头戴式显示设备的系统时间与主设备的系统时间对齐，同时也可以得知目前屏幕的刷新状态，例如接下来需要将数据写入哪一个屏幕，控制哪一个屏幕为亮屏状态。
在一种可选的实施方式中，如图3所示，在向第一屏幕和第二屏幕均发送第一数据，将第一数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态之前，和/或，向第一屏幕和第二屏幕均发送第二数据，将第二数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态以显示第一数据之前，本公开的刷新屏幕的方法还包括：
S210，接收与头戴式显示设备连接的主设备发送的对时请求，对时请求包括主设备的第一时间和对时协议。
S220，获取头戴式显示设备的第二时间。
S230，将第一时间以及第二时间发送至主设备。
S240，获取主设备的第三时间，以基于第一时间、第二时间以及第三时间获得主设备的系统时间和头戴式显示设备的系统时间之间的差值。
采用本公开实施例提供的对时方式，可以校准与头戴式显示设备连接的主设备和头戴式显示设备的时间偏差，从而保证数据传输的准确性。
例如，头戴式显示设备与主设备通过Type-c接口相连接，主设备发起对时请求，则通过USB协议将主设备的系统时间t h1和对时协议传输到MCU，MCU接收到对时协议后，立即获取MCU的系统时间t g1，并将t h1和t g1一起发送回主设备，主设备收到MCU对时协议回应，立即获取主设备的系统时间t h2。其中t h1-t g1包含主设备的系统时间和头戴式显示设备的系统时间之间的差值delta_t和通过USB传输的时间t_usb。则可以通过如下计算得到delta_t。
t h1-t g1＝delta_t-t_usb
t h2-t g1＝delta_t+t_usb
delta_t＝(t h1-t g1+t h2-t g1)/2
可选的，对时协议可以每隔一段时间执行一次，将每次得到的delta_t做加权平均，得到滤波后的delta_t，以使delta_t变化更平稳，同时也能处理对两个系统之间的频率偏移导致的delta_t变化。
可选的，第一数据可以包括第一整帧数据，第二数据可以包括第二整帧数据。第一整帧数据和第二整帧数据可以配置为相同的图像数据；或第一整帧数据可以配置为左眼图像数据，第二整帧数据可以配置为右眼图像数据。本公开中的“整帧数据”指的是一帧完整图像的数据。
可选的，第一数据和第二数据还可以包括一整帧数据的部分数据。例如，第一数据包括第三整帧数据的第一部分数据，第二数据包括第三整帧数据的第二部分数据为例，其中，第一部分数据和第二部分数据构成第三整帧数据。以第一数据为例，第一数据可以包括一帧完整图像的一部分数据，例如可以是一帧完整图像的二分之一、三分之一或四分之一的数据等。反之，第二数据可以包括该一帧完整图像的剩余二分之一、三分之二或四分之三数据等，以使的第一数据和第二数据组成该帧完整图像。可以理解的，当第一数据和第二数据不是整帧数据的二分之一数据时，第一时刻，第二时刻和第三时刻之间的时间间隔要随之调整。
如图4中的(a)和(b)所示，为本公开实施例中提供的一种第一数据和第二数据的结构示意图。如图4中的(a)所示，以第三帧整帧数据为1920*1080的图像数据为例，则第一数据可以包括第三整帧数据的左半部分数据，第二数据可以包括第三整帧数据的右半部分数据。或者，如图4中的(b)所示，第一数据可以包括第三整帧数据的上半部分数据，第二数据可以包括第三整帧数据的下半部分数据。
在一个示例中，第一数据和第二数据配置为相同的图像数据，在用户佩戴头戴式显示设备时，仅能观看到二维显示效果的画面。
在另一个示例中，第一数据和第二数据可以配置为不相同的图像数据，比如第一整帧数据配置为左眼图像数据，第二整帧数据配置为右眼图像数据。需要说明的是，本公开中提及的“左眼图像数据”指的是配置为传输至对应用户的左眼的屏幕(例如第一屏幕)的数据，当用户佩戴该头戴显示设备时，用户的左眼通过第一屏幕观看左眼图像数据，“右眼图像数据”反之亦然。可选地，左眼图像数据和右眼图像数据可以配置为具有视差的图像数据，以实现立体显示效果。在用户佩戴头戴式显示设备时，则能观看到三维显示效果的画面。
需要说明的是，因为人的左、右眼有间距，造成两眼的视角存在细微的差别，而这样的差别会让两只眼睛分别观察的景物有位移。因此，人能够产生有空间感的立体视觉效果。因此，上述“左眼图像数据和右眼图像数据配置为具有视差的图像数据”可以理解为左眼图像数据和右眼图像数据之间的视差为能让用户双眼观看后产生立体视觉效果。
需要说明的是，若第一数据配置为左眼图像数据，第二数据配置为右眼图像数据，也即第一数据和第二数据被配置为不相同的数据，但是左眼图像数据和右眼图像之间无视差，则采用 该方法时，仍然可以实现二维显示效果。例如，第一数据和第二数据可以为在左右眼视野重合的区域不同。
图5示出了本公开刷新屏幕方法的一个实施例。
本实施例中，在获取到第nVsync信号到获取到第n+1Vsync信号之间的时间间隔内，可以向第一屏幕和第二屏幕均发送第n数据，并将第n数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态。第二屏幕被配置为亮屏状态时，可以显示在先写入的数据。
在本公开中，n可以指代1、2、3……等正整数。当n指代1时，可以理解为初始状态，需要说明的是，由于在获取第1Vsync信号之前并没有数据写入第二屏幕，因此在获取第1Vsync信号到获取第2Vsync信号之间的时间间隔内，虽然第二屏幕至少部分时间在亮屏状态，但是并不显示数据。
在获取到第n+1Vsync信号到获取到第n+2Vsync信号之间的时间间隔内，可以向第一屏幕和第二屏幕均发送第n+1数据，将第n+1数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态，其中，第一屏幕被配置为亮屏状态时，可以显示已经写入的第n数据。在后续获取到任意两个Vsync信号之间的时间间隔内，以此类推，进行持续传输数据，轮流写入数据和轮流显示数据的操作。关于第n数据和第n+1数据的解释可以参照上述关于第一数据和第二数据的解释，例如第n数据和第n+1数据可以为整帧数据。
图6示出了本公开刷新屏幕方法的一个实施例。
本实施例中，在获取到第nVsync信号到获取到第n+1Vsync信号之间的时间间隔内，可以向第一屏幕和第二屏幕均发送第n数据。在获取到第nVsync信号到获取到第n+1Vsync信号之前的任一时刻可以作为分界点，例如获取两个Vsync信号的时间间隔的中间时刻。例如，获取到第nVsync信号的时刻为T n，获取到第n+1Vsync信号的时刻为T n+1，则上述中间时刻可以为T n+1/2(T n+1-T n)。在获取到第nVsync信号到上述中间时刻之间的时间间隔内，可以将第n数据的第一部分数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态。第二屏幕被配置为亮屏状态时，可以显示在先写入的数据。
在上述中间时刻到获取到第n+1Vsync信号之间的时间间隔内，可以将第n数据的第二部分数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态。第一屏幕被配置为亮屏状态时，可以显示已经写入的第n数据的第一部分数据。在后续获取到任意两个Vsync信号之间的时间间隔内，以此类推，进行持续传输数据，轮流写入数据和轮流显示数据的操作。关于第n数据的第一部分数据和第n数据的第二部分数据的解释可以参照上述关于第一数据和第二数据的解释。例如第n数据的第一部分数据可以为整帧数据的二分之一数据，第n数据的第二部分数据可以为整帧数据的剩余二分之一数据，第一部分数据和第二部分数据构成整帧数据。
为了减少显示画面的颤动和延迟问题，本公开实施例中可以采用异步时间扭曲(Asynchronous Timewarp，ATW)技术。
本公开下述实施例中所指的“位姿”可以指用户的位置和姿态，例如可以是用户的6自由度(6dof)的位姿。本公开中，例如可以通过分析例如加速度传感器、陀螺仪等运动传感器反馈的运动数据，从而获取在预设时刻的用户的真实位姿，例如位置、运动方向、速度、加速度等。
下述实施例中的预估操作可以通过获取的用户的真实位姿，也可以再根据用户真实位姿的历史数据，计算预设时刻的用户的预估位姿。下述实施例中的变换数据的操作，可以基于不同的预估位姿之间的偏差来进行数据的变换，例如可以变换渲染的数据的全部，也可以变换渲染的数据的一部分。变换后的数据可以与用户在预设时刻的位姿相对应，此处的预设时刻指的是屏幕显示已经写入数据的时刻，使得用户在该时刻的位姿与该时刻屏幕显示的画面相对应，避免了显示延迟问题。可以理解的，下述实施例相关附图中的“预设时刻”的标记位置仅仅是示例的，具体的预设时刻是可以根据具体方案选择的时刻，图中的标记位置并不是对“预设时刻”的具体限定。
可选的，下述实施例中，可以在第一预设时刻和第二预设时刻之间的时间间隔内渲染数据。例如，第二预设时刻可以为渲染完数据的时刻，也可以为渲染完成后一段时间间隔后的某一时刻。
可选的，可以在主设备执行ATW的操作，将变换后的数据传输给头戴式显示设备。
如图7A所示，为本公开实施例提供的一种基于异步时间扭曲降低图像数据的显示延迟的方法。
S402，获取在第一预设时刻的用户的第一位姿，基于第一位姿计算第三预设时刻的用户的第一预估位姿，其中，第一预设时刻在第一时刻之前，第三预设时刻在第二时刻和第三时刻之间。
S404，获取在第二预设时刻的用户的第二位姿，基于第二位姿计算第三预设时刻的用户的第二预估位姿，其中，第二预设时刻在第一预设时刻和第一时刻之间。
S406，在第二预设时刻，基于第一预估位姿和第二预估位姿变换第一数据的至少一部分，以使变换后的第一数据与用户在第三预设时刻的位姿相对应。
如图7B和7C的实施例中，第一预设时刻T1和第二预设时刻T2在第一时刻t1之前，第三预设时刻T3在第二时刻t2和第三时刻t3之间，为显示已经写入数据的时刻。
在图7B所示实施例中，例如第一数据包括第一整帧数据(例如，图7B中的第n整帧数据)，在传输第n整帧数据的第一时刻t1之前，可以在第一预设时刻和第二预设时刻之间渲染第n整帧数据，获取在第一预设时刻T1的用户的第一位姿，基于第一位姿计算第三预设时刻T3的用户的第一预估位姿。获取在第二预设时刻T2的用户的第二位姿，基于第二位姿计算第三预设时刻T3的用户的第二预估位姿。在第二预设时刻T2，基于第一预估位姿和第二预估位姿变换第n整帧数据的至少一部分，以使变换后的第n整帧数据与用户在第三预设时刻T3的位姿相对应。关于该实施例的其它解释说明可以参照关于图5实施例的说明。
在图7C所示实施例中，例如第一数据可以包括第三整帧数据(例如，图7C中第n整帧数据)的第一部分数据，在传输第n整帧数据的第一部分数据的第一时刻t1之前，可以在第一预 设时刻和第二预设时刻之间渲染第n整帧数据的第一部分数据，获取在第一预设时刻T 1的用户的第一位姿，基于第一位姿计算第三预设时刻T3的用户的第一预估位姿。获取在第二预设时刻T2的用户的第二位姿，基于第二位姿计算第三预设时刻T3的用户的第二预估位姿。在第二预设时刻T2，基于第一预估位姿和第二预估位姿变换第n整帧数据的第一部分数据，以使变换后的第一数据与用户在第三预设时刻T3的位姿相对应。关于该实施例的其它解释说明可以参照关于图6实施例的说明。
可以理解的是，本实施例所示的方法同理可以对第二数据进行渲染和变换操作，执行各个操作的时刻可以根据上述实施例同理地推出。例如，可以在第二时刻t2之前的两个预设时刻之间渲染第二数据，通过在该两个预设时刻获取的用户的位姿计算显示第二数据的预估时刻的用户的预估位姿，然后在第二时刻t2之前变换第二数据的至少一部分。综上，本实施例采取对第一数据和第二数据在相应数据传输进行单独渲染和单独变换的操作，该方法能使用户通过每个屏幕进行观看时，显示数据均与用户在该数据显示时的位姿相对应。
图8A显示了另一种可选的实施方式。
S412，获取在第一预设时刻的用户的第一位姿，基于第一位姿计算第三预设时刻的用户的第一预估位姿，其中，第一预设时刻在第一时刻之前，第三预设时刻在第二时刻和第三时刻之间或为第三时刻。
S414，获取在第二预设时刻的用户的第二位姿，基于第二位姿计算第三预设时刻的用户的第二预估位姿，其中，第二预设时刻在第一预设时刻和第一时刻之间；和
S416，在第二预设时刻，基于第一预估位姿和第二预估位姿变换第一数据的至少一部分和第二数据的至少一部分，以使变换后的第一数据和第二数据与用户在第三预设时刻的位姿相对应。
图8B所示的实施例与图7B所示的实施例的主要区别在于，在第一预设时刻T1和第二预设时刻T2之间，渲染第n整帧数据和第n+1整帧数据。将对应两个屏幕的数据均在第一时刻t1前渲染，并且在第一时刻t1前，变换第n整帧数据和第n+1整帧数据。由于本方法基于第一预设时刻T1和第二预设时刻T2采集的用户的位姿计算一个数据显示时刻的用户的预估位姿，因此，为了兼顾第n整帧数据和第n+1整帧数据显示的两个时刻，第三预设时刻T3会更向第三时刻t3靠近，甚至可以为第三时刻t3，以兼顾上述两个时刻。
图8C所示的实施例与图7C所示的实施例的主要区别在于，在第一预设时刻T1和第二预设时刻T2之间，渲染第n整帧数据，将对应两个屏幕的数据均在第一时刻t1前渲染，并且在第一时刻t1前，变换第n整帧数据。关于该实施例其它描述可以参照上述8B实施例的描述，在此不再赘述。
可以理解的是，本实施例所示的方法在第一时刻t1之前对第一数据和第二数据进行渲染和变换操作。基于第一预设时刻T1和第二预设时刻T2采集的用户的位姿计算一个数据显示时刻(第三预设时刻T3)的用户的预估位姿，该第三预设时刻T3兼顾第一数据显示的时刻和第二数据显示的时刻，因此第三预设时刻T3会更向第三时刻t3靠近，甚至可以为第三时刻t3。综 上，图8A所示的实施例采取对两个屏幕显示的数据一起渲染和变换的方式，该方法操作简单。
图9A显示了又一种可选的实施方式。
从第三时刻到第四时刻，配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态以显示第二数据。
S420，获取在第一预设时刻的用户的第一位姿，基于第一位姿计算第三预设时刻的用户的第一预估位姿和第五预设时刻的用户的第三预估位姿，其中，第一预设时刻在第一时刻之前，第三预设时刻在第二时刻和第三时刻之间，第五预设时刻在第三时刻和第四时刻之间。
S422，获取在第二预设时刻的用户的第二位姿，基于第二位姿计算第三预设时刻的用户的第二预估位姿，其中，第二预设时刻在第一预设时刻和第一时刻之间。
S424，在第二预设时刻，基于第一预估位姿和第二预估位姿变换第一数据的至少一部分，以使变换后的第一数据与用户在第三预设时刻的位姿相对应。
S426，获取在第四预设时刻的用户的第三位姿，基于第三位姿计算第五预设时刻的用户的第四预估位姿，其中，第四预设时刻在第一时刻和第二时刻之间；和
S428，在第四预设时刻，基于第三预估位姿和第四预估位姿变换第二数据的至少一部分，以使变换后的第二数据与用户在第五预设时刻的位姿相对应。
可以理解的是，第三时刻到第四时刻之间的时间间隔将进行下一个数据传输，写入数据和显示数据的周期。对第三时刻和第四时刻的理解可以参照对第一时刻和第二时刻的描述。
图9B所示的实施例中，第一数据包括第一整帧数据(例如，图9B所示第n整帧数据)，第二数据包括第二整帧数据(例如，图9B所示的第n+1整帧数据)，在传输第n整帧数据的第一时刻t1之前，可以在第一预设时刻和第二预设时刻之间共同渲染第n整帧数据和第n+1整帧数据。获取在第一预设时刻T1的用户的第一位姿，基于第一位姿计算第三预设时刻T3的用户的第一预估位姿和第五预设时刻T5的用户的第三预估位姿。此处的第三预设时刻T3为第二时刻t2和第三时刻t3之间显示第n整帧数据的时刻，第五预设时刻T5为第三时刻t3和第四时刻t4之间显示第n+1整帧数据的时刻。共同渲染完第n整帧数据和第n+1整帧数据后，获取在第二预设时刻T2的用户的第二位姿，基于第二位姿计算第三预设时刻T3的用户的第二预估位姿，在第二预设时刻T2(传输第n整帧数据的第一时刻t1之前)，基于第一预估位姿和第二预估位姿变换第n整帧数据的至少一部分，以使变换后的第n整帧数据与用户在第三预设时刻T3的位姿相对应。获取第一时刻t1和第二时刻t2之间的第四预设时刻T4的用户的第三位姿，基于第三位姿计算第五预设时刻T5的用户的第四预估位姿。在第四预设时刻T4(传输第n+1整帧数据的第二时刻t2之前)，基于第三预估位姿和第四预估位姿变换第n+1整帧数据的至少一部分，以使变换后的第n+1整帧数据与用户在第五预设时刻的位姿相对应。关于该实施例的其它解释说明可以参照关于图5实施例的说明。
图9C所示的实施例中，第一数据可以包括第三整帧数据(例如，图9C中所示的第n整帧数据)的第一部分数据，第二数据可以包括第三整帧数据(例如，图9C中所示的第n整帧数据)的第二部分数据，第一部分数据和第二部分数据构成第三整帧数据。在传输第n整帧数据 的第一部分数据的第一时刻t1之前，可以在第一预设时刻和第二预设时刻之间渲染第n整帧数据。在传输第n整帧数据的第一部分数据的第一时刻t1之前，变换第n整帧数据的第一部分数据，在传输第n整帧数据的第二部分数据的第二时刻t2之前，变换第n整帧数据的第二部分数据。关于本实施例的其它描述可以参考图9B所示的实施例的描述。关于该实施例的其它解释说明可以参照关于图6实施例的说明。可以理解的是，本实施例中的第二时刻的理解可以为两个Vsync信号之间的中间时刻。
可以理解的是，本实施例所示的方法在第一时刻t1之前对第一数据和第二数据共同进行渲染，但是在传输第一数据和第二数据的时刻之前分别对第一数据和第二数据进行变换操作，而且变换操作基于相应数据的显示时刻的用户的预估位姿进行，该方法的渲染操作简单，而且能使用户通过每个屏幕进行观看时，显示数据均与用户在该数据显示时的位姿相对应。
采用本公开实施例提供的上述几种方式，由于可以基于异步时间扭曲技术对待进行渲染的图像数据进行预测，并且当待显示时刻的用户位姿发生改变时，可以实时地根据用户位姿的变化改变第一数据和/或第二数据的至少部分数据，以使改变后的第一数据和/或第二数据与改变后的位姿相匹配，从而可以减少延迟。
在一个示例中，本公开还提供一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的方法，其中，在用户佩戴头戴式显示设备时，第一屏幕显示的图像落入用户的一只眼睛的可视范围，第二屏幕显示的图像落入用户的另一只眼睛的可视范围，方法包括：从第一时刻到第二时刻，向第一屏幕和第二屏幕均发送第一图像数据，将第一图像数据写入第一屏幕，以配置第一屏幕不显示图像数据，第二屏幕显示已写入的图像数据；和从第二时刻到第三时刻，向第一屏幕和第二屏幕均发送第二图像数据，将第二图像数据写入第二屏幕，以配置第二屏幕不显示图像数据，第一屏幕显示已写入的第一图像数据，第一时刻、第二时刻和第三时刻中的至少一个为获取第一屏幕和第二屏幕的垂直同步信号的时刻。
本公开实施例还提供一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的装置，该装置的具体结构示意图如图10所示，包括数据发送单元，该数据发送单元被配置成从第一时刻到第二时刻，向第一屏幕和第二屏幕均发送第一数据，将第一数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态；和从第二时刻到第三时刻，向第一屏幕和第二屏幕均发送第二数据，将第二数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态以显示第一数据。
采用本公开实施例提供的该装置，可以控制第一屏幕和第二屏幕在不同时间段内进行轮流刷新屏幕，这样，可以缩减单个屏幕的刷新延迟，从而降低智能终端和可穿戴显示设备之间的刷新延迟。
本公开的实施例涉及一种电子设备，如图11所示。在硬件层面，电子设备包括处理器，可选地还包括内部总线、网络接口、存储器。存储器可能包含内存，例如高速随机存取存储器(Random-Access Memory，RAM)，也可能还包括非易失性存储器(nonvolatile memory)，例如至少1个磁盘存储器等。当然，该电子设备还可能包括其他业务所需要的硬件。
处理器、网络接口和存储器可以通过内部总线相互连接，该内部总线可以是ISA(Industry Standard Architecture，工业标准体系结构)总线、PCI(Peripheral Component Interconnect，外设部件互连标准)总线或EISA(Extended Industry Standard Architecture，扩展工业标准结构)总线等。所述总线可以分为地址总线、数据总线、控制总线等。为便于表示，图11仅用一个双向箭头表示，但并不表示仅有一根总线或一种类型的总线。
存储器，用于存放程序。具体地，程序可以包括程序代码，所述程序代码包括计算机操作指令。存储器可以包括内存和非易失性存储器，并向处理器提供指令和数据。
处理器从非易失性存储器中读取对应的计算机程序到内存中然后运行，在逻辑层面上形成用于刷新头戴式显示设备的第一屏幕和第二屏幕的方法装置。处理器，执行存储器所存放的程序，并具体用于执行以下操作：
从第一时刻到第二时刻，向第一屏幕和第二屏幕均发送第一数据，将第一数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态；和
从第二时刻到第三时刻，向第一屏幕和第二屏幕均发送第二数据，将第二数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态以显示第一数据。
上述如本说明书提供的一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的方法可以应用于处理器中，或者由处理器实现。处理器可能是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器可以是通用处理器，包括中央处理器(Central Processing Unit，CPU)、网络处理器(Network Processor，NP)等；还可以是数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现场可编程门阵列(Field－Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本说明书实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
结合本说明书实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器，处理器读取存储器中的信息，结合其硬件完成上述方法的步骤。
本说明书实施例还提出了一种计算机可读存储介质，该计算机可读存储介质存储一个或多个程序，该一个或多个程序包括指令，该指令当被包括多个应用程序的电子设备执行时，能够使该电子设备执行一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的方法，并具体用于执行：
从第一时刻到第二时刻，向第一屏幕和第二屏幕均发送第一数据，将第一数据写入第一屏幕，以配置第一屏幕为黑屏状态，第二屏幕至少部分时间为亮屏状态；和
从第二时刻到第三时刻，向第一屏幕和第二屏幕均发送第二数据，将第二数据写入第二屏幕，以配置第二屏幕为黑屏状态，第一屏幕至少部分时间为亮屏状态以显示第一数据。
上述实施例阐明的系统、装置、模块或单元，具体可以由计算机芯片或实体实现，或者由具有某种功能的产品来实现。一种典型的实现设备为计算机。
为了描述的方便，描述以上装置时以功能分为各种单元分别描述。当然，在实施本说明书时可以把各单元的功能在同一个或多个软件和/或硬件中实现。
本领域内的技术人员应明白，本说明书的实施例可提供为方法、装置、或计算机程序产品。因此，本说明书可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本说明书可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本说明书是参照根据本说明书实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
在一个典型的配置中，计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。
内存可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。
还需要说明的是，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制时，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。
本说明书中的各个实施例均采用递进的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于系统实施例而言， 由于其基本相似于方法实施例，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本公开的实施例中所涉及的申请范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述申请构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开的实施例中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。

Claims (15)

  1. 一种用于刷新头戴式显示设备的第一屏幕和第二屏幕的方法，其中，在用户佩戴所述头戴式显示设备时，所述第一屏幕显示的图像落入所述用户的一只眼睛的可视范围，所述第二屏幕显示的图像落入所述用户的另一只眼睛的可视范围，所述方法包括：
    从第一时刻到第二时刻，向所述第一屏幕和所述第二屏幕均发送第一数据，将所述第一数据写入所述第一屏幕，以配置所述第一屏幕为黑屏状态，所述第二屏幕至少部分时间为亮屏状态；和
    从所述第二时刻到第三时刻，向所述第一屏幕和所述第二屏幕均发送第二数据，将所述第二数据写入所述第二屏幕，以配置所述第二屏幕为黑屏状态，所述第一屏幕至少部分时间为亮屏状态以显示所述第一数据。
  2. 根据权利要求1所述的方法，其中，所述第一时刻和所述第二时刻之间的时间间隔与所述第二时刻与所述第三时刻之间的时间隔相等。
  3. 根据权利要求1所述的方法，其中，所述第一数据和所述第二数据配置为图像数据，所述图像数据每秒传输帧数与所述第一屏幕和所述第二屏幕的刷新率同步，所述第一时刻、所述第二时刻和所述第三时刻中的至少一个为获取所述第一屏幕和所述第二屏幕的垂直同步信号的时刻。
  4. 根据权利要求1或2所述的方法，其中，所述第一数据包括第一整帧数据，所述第二数据包括第二整帧数据，所述第一整帧数据和所述第二整帧数据配置为如下两者中的一者：
    所述第一整帧数据和所述第二整帧数据配置为相同的图像数据；和
    所述第一整帧数据配置为左眼图像数据，所述第二整帧数据配置为右眼图像数据。
  5. 根据权利要求1或2所述的方法，其中，所述第一数据包括第三整帧数据的第一部分数据，所述第二数据包括所述第三整帧数据的第二部分数据，所述第一部分数据和所述第二部分数据构成所述第三整帧数据，所述第一部分数据和所述第二部分数据配置为如下两者中的一者：
    所述第一部分数据和所述第二部分数据配置为相同的图像数据；和
    所述第一部分数据配置为左眼图像数据，所述第二部分数据配置为右眼图像数据。
  6. 根据权利要求4或5所述的方法，其中，所述左眼图像数据和所述右眼图像数据配置为具有视差的图像数据，以实现立体显示效果。
  7. 根据权利要求1-6中任一项所述的方法，还包括：
    获取在第一预设时刻的用户的第一位姿，基于所述第一位姿计算第三预设时刻的用户的第一预估位姿，其中，所述第一预设时刻在所述第一时刻之前，所述第三预设时刻在所述第二时刻和所述第三时刻之间；
    获取在第二预设时刻的用户的第二位姿，基于所述第二位姿计算所述第三预设时刻的用户的第二预估位姿，其中，所述第二预设时刻在所述第一预设时刻和所述第一时刻之间；和
    在所述第二预设时刻，基于所述第一预估位姿和所述第二预估位姿变换所述第一数据的至少一部分，以使变换后的第一数据与所述用户在所述第三预设时刻的位姿相对应。
  8. 根据权利要求1-6中任一项所述的方法，还包括：
    获取在第一预设时刻的用户的第一位姿，基于所述第一位姿计算第三预设时刻的用户的第一预估位姿，其中，所述第一预设时刻在所述第一时刻之前，所述第三预设时刻在所述第二时刻和所述第三时刻之间或为所述第三时刻；
    获取在第二预设时刻的用户的第二位姿，基于所述第二位姿计算所述第三预设时刻的用户的第二预估位姿，其中，所述第二预设时刻在所述第一预设时刻和所述第一时刻之间；和
    在所述第二预设时刻，基于所述第一预估位姿和所述第二预估位姿变换所述第一数据的至少一部分和所述第二数据的至少一部分，以使变换后的第一数据和第二数据与所述用户在所述第三预设时刻的位姿相对应。
  9. 根据权利要求1-6中任一项所述的方法，还包括：
    从所述第三时刻到第四时刻，配置所述第一屏幕为黑屏状态，所述第二屏幕至少部分时间为亮屏状态以显示所述第二数据，
    获取在第一预设时刻的用户的第一位姿，基于所述第一位姿计算第三预设时刻的用户的第一预估位姿和第五预设时刻的用户的第三预估位姿，其中，所述第一预设时刻在所述第一时刻之前，所述第三预设时刻在所述第二时刻和所述第三时刻之间，所述第五预设时刻在所述第三时刻和所述第四时刻之间；
    获取在第二预设时刻的用户的第二位姿，基于所述第二位姿计算所述第三预设时刻的用户的第二预估位姿，其中，所述第二预设时刻在所述第一预设时刻和所述第一时刻之间；
    在所述第二预设时刻，基于所述第一预估位姿和所述第二预估位姿变换所述第一数据的至少一部分，以使变换后的第一数据与所述用户在所述第三预设时刻的位姿相对应；
    获取在第四预设时刻的用户的第三位姿，基于所述第三位姿计算第五预设时刻的用户的第四预估位姿，其中，所述第四预设时刻在所述第一时刻和所述第二时刻之间；和
    在所述第四预设时刻，基于所述第三预估位姿和所述第四预估位姿变换所述第二数据的至少一部分，以使变换后的第二数据与所述用户在所述第五预设时刻的位姿相对应。
  10. 根据权利要求1-9中任一项所述的方法，其中，在如下两者中的至少一者之前包括：
    接收与头戴式显示设备连接的主设备发送的对时请求，所述对时请求包括所述主设备的第一时间和对时协议；
    获取头戴式显示设备的第二时间；
    将第一时间以及第二时间发送至主设备；
    获取主设备的第三时间，以基于第一时间、第二时间以及第三时间获得主设备的系统时间和头戴式显示设备的系统时间之间的差值，
    其中，所述两者包括：
    向所述第一屏幕和所述第二屏幕均发送第一数据，将所述第一数据写入所述第一屏幕，以 配置所述第一屏幕为黑屏状态，所述第二屏幕至少部分时间为亮屏状态，和
    向所述第一屏幕和所述第二屏幕均发送第二数据，将所述第二数据写入所述第二屏幕，以配置所述第二屏幕为黑屏状态，所述第一屏幕至少部分时间为亮屏状态以显示所述第一数据。
  11. 根据权利要求1-10中任一项所述的方法，还包括如下两者的一者：
    通过向所述第一屏幕和所述第二屏幕发送信号以控制所述第一屏幕和所述第二屏幕为黑屏状态或亮屏状态；和
    通过将所述第一屏幕和所述第二屏幕设置为根据预定周期为黑屏状态或亮屏状态。
  12. 一种头戴式显示设备，包括：
    第一屏幕和第二屏幕，所述第一屏幕和所述第二屏幕分别对应用户的双眼；和
    屏幕控制芯片，所述屏幕控制芯片与所述第一屏幕和所述第二屏幕藕接，被配置成：
    从第一时刻到第二时刻，向所述第一屏幕和所述第二屏幕均发送第一图像数据，将所述第一图像数据写入所述第一屏幕，以配置所述第一屏幕不显示图像数据，所述第二屏幕显示已写入的图像数据；和
    从所述第二时刻到第三时刻，向所述第一屏幕和所述第二屏幕均发送第二图像数据，将所述第二图像数据写入所述第二屏幕，以配置所述第二屏幕不显示图像数据，所述第一屏幕显示已写入的所述第一图像数据。
  13. 根据权利要求12所述的头戴式显示设备，其中，所述屏幕控制芯片包括缓存区，所述缓存区所能存储的图像数据少于一整帧图像数据。
  14. 根据权利要求12所述的头戴式显示设备，包括：
    USB接口，所述USB接口配置为用于与主设备连接以接收所述主设备的数据，所述数据经由所述USB接口传输给所述屏幕控制芯片，所述数据包括所述第一图像数据和所述第二图像数据。
  15. 一种存储有计算机指令的非瞬时计算机可读存储介质，其中，所述计算机指令用于使所述计算机执行权利要求1-11中任一项所述的方法。
PCT/CN2022/093762 2021-05-19 2022-05-19 用于刷新头戴式显示设备的屏幕的方法和头戴式显示设备 WO2022242704A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22804024.2A EP4343407A1 (en) 2021-05-19 2022-05-19 Method for refreshing screen of head-mounted display device and head-mounted display device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110546795.6A CN113219668B (zh) 2021-05-19 2021-05-19 用于刷新头戴式显示设备的屏幕的方法、装置及电子设备
CN202110546795.6 2021-05-19

Publications (1)

Publication Number Publication Date
WO2022242704A1 true WO2022242704A1 (zh) 2022-11-24

Family

ID=77093144

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/093762 WO2022242704A1 (zh) 2021-05-19 2022-05-19 用于刷新头戴式显示设备的屏幕的方法和头戴式显示设备

Country Status (3)

Country Link
EP (1) EP4343407A1 (zh)
CN (1) CN113219668B (zh)
WO (1) WO2022242704A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113219668B (zh) * 2021-05-19 2023-09-08 闪耀现实(无锡)科技有限公司 用于刷新头戴式显示设备的屏幕的方法、装置及电子设备
CN113835526A (zh) * 2021-09-28 2021-12-24 青岛歌尔声学科技有限公司 显示设备的控制方法、显示设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150341624A1 (en) * 2011-02-10 2015-11-26 Seiko Epson Corporation Head-mounted display device and control method for the head-mounted display device
CN106998409A (zh) * 2017-03-21 2017-08-01 华为技术有限公司 一种图像处理方法、头戴显示器以及渲染设备
CN110221432A (zh) * 2019-03-29 2019-09-10 华为技术有限公司 头戴式显示器的图像显示方法及设备
CN111885265A (zh) * 2020-07-31 2020-11-03 Oppo广东移动通信有限公司 屏幕界面调整方法及相关装置
CN113219668A (zh) * 2021-05-19 2021-08-06 闪耀现实(无锡)科技有限公司 用于刷新头戴式显示设备的屏幕的方法、装置及电子设备

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8421807B2 (en) * 2010-06-03 2013-04-16 Chimei Innolux Corporation Display device
CN112015264B (zh) * 2019-05-30 2023-10-20 深圳市冠旭电子股份有限公司 虚拟现实显示方法、虚拟现实显示装置及虚拟现实设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150341624A1 (en) * 2011-02-10 2015-11-26 Seiko Epson Corporation Head-mounted display device and control method for the head-mounted display device
CN106998409A (zh) * 2017-03-21 2017-08-01 华为技术有限公司 一种图像处理方法、头戴显示器以及渲染设备
CN110221432A (zh) * 2019-03-29 2019-09-10 华为技术有限公司 头戴式显示器的图像显示方法及设备
CN111885265A (zh) * 2020-07-31 2020-11-03 Oppo广东移动通信有限公司 屏幕界面调整方法及相关装置
CN113219668A (zh) * 2021-05-19 2021-08-06 闪耀现实(无锡)科技有限公司 用于刷新头戴式显示设备的屏幕的方法、装置及电子设备

Also Published As

Publication number Publication date
CN113219668B (zh) 2023-09-08
CN113219668A (zh) 2021-08-06
EP4343407A1 (en) 2024-03-27

Similar Documents

Publication Publication Date Title
JP6465946B2 (ja) 分散型ビデオ表示用のシステム、制御装置及び制御方法
WO2022242704A1 (zh) 用于刷新头戴式显示设备的屏幕的方法和头戴式显示设备
US10049642B2 (en) Sending frames using adjustable vertical blanking intervals
US10997929B2 (en) Display scene processing method and device and storage medium
EP2622454B1 (en) Image synchronization for multiple displays
CN109819232B (zh) 一种图像处理方法及图像处理装置、显示装置
TWI420503B (zh) 立體顯示器
WO2022089046A1 (zh) 虚拟现实显示方法、装置及存储介质
WO2015161574A1 (zh) 用于led电视的数据处理方法、装置及led电视
US20120154559A1 (en) Generate Media
TWI524735B (zh) 三維影像產生方法及裝置
TW201228385A (en) Displaying method of screen display information
RU2647664C1 (ru) Способ обработки видеосигнала
Löffler et al. Networked Displays for VR Applications: Display as a Service.
US20120163700A1 (en) Image processing device and image processing method
KR20080006902A (ko) 비동기 양안 카메라에서 생성되는 출력 데이터의 동기화를수행하는 시스템, 방법 및 기록 매체
CN115174883A (zh) 基于平面oled屏幕的主动式3d效果显示方法、系统及设备
TWI520577B (zh) 立體影像輸出裝置與相關的立體影像輸出方法
TW201406151A (zh) 用於產生子母畫面（ｐｉｐ）影像之設備及方法
JP5700998B2 (ja) 立体映像表示装置及びその制御方法
CN106681674A (zh) 一种虚拟现实显示器的显示控制方法及系统
WO2021042661A1 (zh) 一种显示设备及图像输出方法
TWI489856B (zh) Dimensional image processing method
US20240007612A1 (en) Virtual reality display method, device and storage medium
CN113747139A (zh) 基于移动平台的高清3d实现方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22804024

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18557592

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2022804024

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022804024

Country of ref document: EP

Effective date: 20231219