WO2017185622A1

WO2017185622A1 - Display method and target device

Info

Publication number: WO2017185622A1
Application number: PCT/CN2016/100180
Authority: WO
Inventors: 吕铁汉; 孙庆安
Original assignee: 上海乐相科技有限公司
Priority date: 2016-04-29
Filing date: 2016-09-26
Publication date: 2017-11-02
Also published as: CN105892683A

Abstract

Related to the technical field of virtual reality (VR), specifically related to a display method and a target device, comprising: a first image processing unit in a target device renders, on the basis of acquired location information of a VR device, to produce an image frame to be displayed and copies the image frame to be displayed to a shared storage space (201); and, a second image processing unit in the target device adjusts the image frame in the shared storage space on the basis of current location information of the VR device when displaying and displays the adjusted image frame in the VR device (202). The method implements the first image processing unit producing the rendered image frame and storing in the shared storage space, and then the second image processing unit adjusting the image frame in the shared space on the basis of the current location information of the VR device when displaying so as to allow the image frame being displayed in the VR device to correspond to the current location, thus preventing a user from experiencing the phenomenon of image blurring and dizziness as a result of seeing an image frame identical to the image frame seen at a preceding position.

Description

Display method and target device

The present application claims priority to Chinese Patent Application No. 201610285647. 2, entitled "A Display Method and Target Device", filed on April 29, 2016, the entire contents of which is incorporated herein by reference. .

Technical field

The present invention relates to the field of virtual reality technologies, and in particular, to a display method and a target device.

Background technique

In the field of virtual reality, users use VR (Virtual Reality) devices to observe virtual scenes, but because people's head movements tend to be faster, and the rendering ability of computers or game consoles is limited, it will cause delays in scene rendering. That is, the person's head has already passed, but the image corresponding to the computer or game console has not been rendered in time, so the image of the previous frame is displayed in the VR device, so that the screen shakes and the vertigo feeling is affected. User's VR experience.

In view of the above problems, there is still no good way to solve them.

In summary, in the prior art, when the VR device is worn, if the head moves too fast, the picture may be shaken, thereby causing a technical problem of vertigo.

Summary of the invention

The present invention provides a display method and a target device for solving the problem that when the VR device is worn in the prior art, if the head moves too fast, the picture may be shaken and the vertigo feeling may be generated.

In one aspect, an embodiment of the present invention provides a display method, including:

The first image processing unit in the target device generates and generates an image frame to be displayed according to the acquired virtual reality VR device location information, and copies the image frame to be displayed to the shared storage space;

a second image processing unit in the target device according to a current bit of the VR device at the time of display The information is adjusted to adjust the image frame in the shared storage space, and the adjusted image frame is displayed on the VR device.

According to the method provided by the embodiment of the present invention, the first image processing unit in the target device generates and generates an image frame to be displayed according to the acquired virtual reality VR device location information, and copies the image frame to be displayed to the shared storage space. And the second image processing unit in the target device adjusts the image frame in the shared storage space according to the current location information of the VR device at the time of display, and displays the adjusted image frame on the VR device. The method realizes that the rendered image frame is generated by the first image processing unit and stored in the shared storage space, and then the second image processing unit adjusts the image frame in the shared space according to the current position information of the VR device during display, so that The image frame displayed in the VR device corresponds to the current position, so that the user does not cause the smear phenomenon and the stun feeling due to the same image frame of the previous position, so the method can realize the user. When the head is moving fast, you can also see clear images without vertigo.

Optionally, the second image processing unit of the target device adjusts the image frame in the shared storage space according to the current location information of the VR device during display, including:

Determining, according to the current location information of the VR device, whether the image frame in the shared storage space is generated according to the current location rendering;

If the second image processing unit determines that the image frame in the shared storage space is generated according to the current location rendering, the image frame in the shared storage space is used as the adjusted image frame;

If the second image processing unit determines that the image frame in the shared storage space is not generated according to the current location rendering, generating an intermediate according to current location information of the VR device and image frames in the shared storage space The frame is used as the adjusted image frame.

Optionally, the second image processing unit generates an intermediate frame according to the current location information of the VR device and the image frame in the shared storage space, including:

The second image processing unit determines a rotation amount and a translation amount of the VR device from a previous position to the current position, and performs rotation and translation operations on the image frame according to the rotation amount and the translation amount. The intermediate frame.

Optionally, the first image processing unit is created by a first thread, and the second image processing unit is created by a second thread;

The copying the image frame to be displayed to the shared storage space includes:

The first thread copies the image frame to be displayed to the shared storage space by using the first image processing unit;

The second image processing unit of the target device, before adjusting the image frame in the shared storage space according to the current location information of the VR device at the time of display, further includes:

The second thread transmits an image frame in the shared storage space to the second image processing unit.

Optionally, the first image processing unit includes a first texture and a second texture, where the second texture is the shared storage space;

Before the first thread copies the image frame to be displayed to the shared storage space by using the first image processing unit, the method further includes:

The first image processing unit stores the image frame to be displayed generated by the rendering in the first texture;

The first thread copies the image frame to be displayed to the shared storage space, including:

The first thread copies the image frame in the first texture to the second texture.

Optionally, the second thread is created by the first thread;

The first image processing unit is a DirectX device, and/or the second image processing unit is a DirectX device.

In another aspect, an embodiment of the present invention provides a target device, including:

The first image processing unit generates and generates an image frame to be displayed according to the acquired virtual reality VR device location information, and copies the image frame to be displayed to the shared storage space;

The second image processing unit adjusts an image frame in the shared storage space according to current position information of the VR device during display, and displays the adjusted image frame on the VR device.

Optionally, the second image processing unit is specifically configured to:

Determining, according to current location information of the VR device, an image frame in the shared storage space No is generated according to the current position rendering;

If it is determined that the image frame in the shared storage space is generated according to the current location, the image frame in the shared storage space is used as the adjusted image frame;

If it is determined that the image frame in the shared storage space is not generated according to the current location rendering, generating an intermediate frame according to current location information of the VR device and an image frame in the shared storage space, and the middle The frame is used as an adjusted image frame.

Optionally, the second image processing unit is specifically configured to:

Determining a rotation amount and a translation amount of the VR device from a previous position to the current position, and performing rotation and translation operations on the image frame according to the rotation amount and the translation amount to obtain the intermediate frame.

The first image processing unit is further configured to: before the first thread copies the image frame to be displayed to the shared storage space by using the first image processing unit, the generated image frame to be displayed is to be rendered Stored in the first texture;

The first thread is specifically configured to: copy the image frame in the first texture to the second texture.

Optionally, the second thread is created by the first thread;

The embodiment of the invention further provides a target device, which includes:

The first processor generates, to be displayed, the rendering according to the acquired virtual reality VR device location information Image frame and copy the image frame to be displayed to a memory;

The second processor adjusts an image frame in the memory according to current position information of the VR device at the time of display, and displays the adjusted image frame on the VR device.

Optionally, the second processor is specifically configured to:

Determining, according to current location information of the VR device, whether an image frame in the memory is generated according to the current location rendering;

If it is determined that the image frame in the memory is generated according to the current position rendering, the image frame in the memory is used as the adjusted image frame;

If it is determined that the image frame in the memory is not generated according to the current location rendering, generating an intermediate frame according to current location information of the VR device and an image frame in the memory, and using the intermediate frame as an adjustment Image frame.

Optionally, the second processor is specifically configured to:

Optionally, the first processor is created by a first thread, and the second processor is created by a second thread;

The first thread copies the image frame to be displayed to the memory by using the first processor;

The second thread transmits an image frame in the memory to the second processor.

Optionally, the first processor includes a first texture and a second texture, where the second texture is the memory;

The first processor is further configured to: before the first thread copies the image frame to be displayed to the memory by using the first processor, storing the image frame to be displayed generated by the rendering in the In the first map;

Optionally, the second thread is created by the first thread;

The first processor is a DirectX device, and/or the second processor is a DirectX device.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention, Those skilled in the art can also obtain other drawings based on these drawings without paying for inventive labor.

1 is a schematic diagram of a display method applied to an embodiment of the present invention;

2 is a flowchart of a display method according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a display method according to an embodiment of the present disclosure;

4 is a detailed flowchart of a display method according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a target device according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a target device according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail with reference to the accompanying drawings, in which FIG. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

As shown in FIG. 1 , it is a schematic diagram of a display method according to an embodiment of the present invention, wherein two target image processing units are respectively a first image processing unit 101 and a second image processing unit 102, wherein the target device The VR device may be a computer device connected to the VR device in a wired or wireless manner. The first image processing unit 101 is mainly configured to generate an image frame according to the position information of the VR device, and then generate the image. The frame is stored in the shared storage space 103, and the image frame is acquired from the shared storage space 103 by the second image processing unit 102, and the display screen of the VR device is refreshed and displayed according to the image frame.

Wherein, when the target device is the VR device itself, the VR device can complete all work of image rendering to image frame refresh display, at which time the VR device is a device with independent image processing capability; when the target device is a computer device, then The VR device connects to the computer through wired or wireless means, and then the image rendering work is completed by the computer device, and the image frame is generated and sent to the VR device for refresh display. At this time, the VR device is only responsible for receiving the image continuously sent by the computer device. Frame, display, and not responsible for rendering work.

The embodiments of the present invention are further described in detail below with reference to the accompanying drawings.

As shown in FIG. 2, the display method provided by the embodiment of the present invention includes:

Step 201: The first image processing unit in the target device generates an image frame to be displayed according to the acquired VR device location information, and copies the image frame to be displayed to the shared storage space.

Step 202: The second image processing unit in the target device adjusts an image frame in the shared storage space according to current location information of the VR device during display, and displays the adjusted image frame on the VR device.

The first image processing unit generates and generates an image frame to be displayed according to the acquired VR device location information, and then copies the image frame to the shared storage space, and the second image processing unit acquires the image frame from the shared storage space and then on the VR device. Displaying, but since the frequency at which the first image processing unit generates the image frame is not the same as the second image processing display image frame (ie, the frequency at which the VR device displays the image frame), for example, when the first image processing unit generates the image frame at a low frequency When the image frame is displayed in the second image processing, it is possible that the image frame acquired by the second image processing unit from the shared storage space is the image frame that has been acquired last time, that is, the image frame of the shared storage space is not updated. At this time, by the method of the above steps 201 to 202 of the present invention, the adjusted image frame can be displayed on the VR device.

Specifically, the first image processing unit is responsible for generating an image frame according to the VR device location information and storing it in the shared storage space, and in the above step 202, the second image processing unit adjusts the shared storage according to the current location information of the VR device. An image frame in space, and the adjusted image frame is displayed on the VR device.

Specifically, the image frames in the shared storage space acquired by the second image processing unit are divided into the following two situations:

Case 1: The image frame is generated according to the current position of the VR device.

If the second image processing unit determines that the image frame in the shared storage space is generated according to the current position rendering, the image frame is directly used as the adjusted image frame, and then the adjusted image frame is displayed on the VR device.

In this case, when the user's head rotates, a new position is reached, at which time the first image processing unit renders a new image frame according to the new position, and the image frame is shared by the first image processing unit. Before the storage space acquires the image frame, it is already stored in the shared storage space. Therefore, when the first image processing unit acquires the image frame from the shared storage space, an image frame corresponding to the current new position is acquired, and thus the image frame is directly The image frame is displayed.

Case 2, the image frame is not generated according to the current position of the VR device.

In this case, the image frame in the shared storage space acquired by the first image processing is not generated according to the current position rendering, that is, generated according to the previous VR position, because the frequency of the new image frame is rendered by the first image processing unit. Lower than the rate at which the second image processing unit displays the image frame, so when the second image processing unit wants to display one frame of image, the image frame obtained from the shared storage space is still displayed before, if directly Displaying the image frame will cause the image frame that the user sees at the current moment to be the same as the image frame seen at the previous moment, resulting in smear phenomenon and even a dizziness of the user.

Therefore, in order to solve the problem, when the second image processing unit determines that the image frame in the shared storage space is not generated according to the current location rendering, the intermediate frame is generated according to the current location information of the VR device and the image frame in the shared storage space, and The intermediate frame is used as the adjusted image frame. That is, according to the current location information of the VR device and the acquired image frame, an intermediate frame is generated, and then the intermediate frame is used as the adjusted image frame, and the adjusted image frame is displayed, optionally, the The second image processing unit generates an intermediate frame according to the current location information of the VR device and the image frame in the shared storage space, including: the second image processing unit determines that the VR device is from the previous location to the location The amount of rotation and the amount of translation of the current position, according to the amount of rotation and the amount of translation The image frame is rotated and translated to obtain the intermediate frame.

For example, when the user wears the VR device, the current position of the head is A. When the user makes a quick turn of the head to reach B, the first image processing unit is too late to be up-to-date because the user's head rotates too fast. A frame of image frame is rendered. At this time, the second image processing unit obtains the rotation amount and the translation amount of the user (that is, the VR device) according to the current position A of the user and the previous position B, thereby based on the obtained rotation amount and the amount of translation. An intermediate frame is obtained by performing an appropriate rotation and translation operation on the image frame in the shared storage space (the image frame has been displayed at least once before).

In practice, one frame of image may be larger than the display of the VR device, or it may be the same size as the display of the VR device.

When one frame of image is larger than the display screen of the VR device, only part of the information is displayed on the VR device. When the intermediate frame is generated, what is actually seen is image information that is not displayed before the image frame, for example, A picture shows a river in the left position, a character in the middle position, and an animal in the right position. Then only one character can be seen on the VR device, and the river in the left position and the animal in the right position. It will not be displayed on the VR device at the same time. When the intermediate frame is generated by the above method, if the user's head is turned to the left, then the generated intermediate frame actually displays the content of the river. If the user's head turns to the right, then The generated intermediate frame actually shows the content of the animal. That is, the intermediate frame is obtained after rotating and translating based on the existing image frame; when one frame image is equal in size to the display screen of the VR device, the generated intermediate frame may be part of the content of the previous frame image, and then filled. Part of the black image, generating an intermediate frame.

Optionally, the first image processing unit is created by a first thread, and the second image processing unit is created by a second thread; after the first image processing unit generates an image frame, the first image is processed by the first thread. The unit copies the image frames to be displayed to the shared storage space, and the second thread sends the image frames in the shared storage space to the second image processing unit.

In a practical application, the first image processing unit and the second image processing unit may be units having image processing capabilities, such as some image processing software modules, etc., optionally, the second thread is by the first Thread created; and the first image processing unit is a DirectX device, and/or the second image processing unit is a DirectX device.

Among them, DirectX (Direct eXtension, referred to as DX) is a multimedia programming interface created by Microsoft Corporation. Implemented by the C++ programming language and widely used in video game development, DirectX is a set of technologies designed to make Windows-based computers run and display with rich multimedia elements such as full-color graphics, video, 3D animation and rich audio. ) The ideal platform for the app.

3 is a schematic diagram of a display method according to an embodiment of the present invention, wherein a first image processing unit is a DirectX device, and includes a first texture and a second texture, wherein the second texture is the shared storage space; An image processing unit stores the image frame to be displayed generated by the rendering in the first texture, and then the image frame in the first texture is copied into the second texture by the first thread.

In Figure 3, the image frame is rendered by the first thread through the game engine, and then the image frame is output to the texture 1 (ie, the first texture) in the DirectX device, and then the image frame in the texture image is copied to the texture by the first thread. 2 (ie, the second map), wherein the second map is the shared storage space in FIG. 1, and then the second thread obtains the shared image frame from the map 2, and sends the image frame to the second image processing unit, and the second image The processing unit displays the acquired image frame on the VR device, or displays the intermediate frame on the VR device after processing the intermediate frame. Among them, the first map and the second map can be understood as a storage space, and can store image frames.

Furthermore, the version of the DirectX device (ie the first image processing unit) in the first thread and the second DirectX device (ie the second image processing unit) in the second thread may be the same or different, for example The DirectX device version in the first thread is DirectX11, the DirectX device version in the second thread is 11, or the DirectX device version in the first thread is DirectX9, the DirectX device version in the second thread is 11 and so on. Not limited.

According to the method provided by the embodiment of the present invention, the first image processing unit in the target device generates and generates an image frame to be displayed according to the acquired virtual reality VR device location information, and copies the image frame to be displayed to the shared storage space. And the second image processing unit in the target device adjusts the image frame in the shared storage space according to the current location information of the VR device at the time of display, and displays the adjusted image frame on the VR device. The method realizes that the rendered image frame is generated by the first image processing unit and stored in the shared storage space, and then the second image processing unit adjusts the image frame in the shared space according to the current position information of the VR device during display, so that Displayed in the VR device The image frame corresponds to the current position, so that the user does not cause the smear phenomenon and the stun feeling due to the same image frame of the previous position, so the method can realize the rapid movement of the user's head. You can also see clear images without vertigo.

The display method provided by the embodiment of the present invention is described in detail below. As shown in FIG. 4, it is a detailed flowchart of the display method provided by the embodiment of the present invention, including:

Step 401: The first image processing unit in the target device generates and generates an image frame to be displayed according to the acquired virtual reality VR device location information, and copies the image frame to be displayed to the shared storage space.

Step 402: The second image processing unit in the target device determines, according to the current location information of the VR device, whether an image frame in the shared storage space is generated according to the current location, and if yes, proceeds to step 403. If not, go to step 404.

Step 403: The second image processing unit uses an image frame in the shared storage space as the adjusted image frame.

Step 404: The second image processing unit determines a rotation amount and a translation amount of the VR device from a previous position to a current position, and performs rotation and translation operations on the image frame according to the rotation amount and the translation amount. An intermediate frame is obtained, and the intermediate frame is taken as an adjusted image frame.

Based on the same technical concept, an embodiment of the present invention further provides a target device. Implementation of the invention The target device provided in the example is shown in Figure 5, including:

The first image processing unit 501 is configured to generate an image frame to be displayed according to the acquired virtual reality VR device location information, and copy the image frame to be displayed to the shared storage space;

The second image processing unit 502 adjusts an image frame in the shared storage space according to current position information of the VR device during display, and displays the adjusted image frame on the VR device.

Optionally, the second image processing unit 502 is specifically configured to:

Determining, according to current location information of the VR device, whether an image frame in the shared storage space is generated according to the current location rendering;

Optionally, the second image processing unit 502 is specifically configured to:

Determining a rotation amount and a translation amount of the VR device from the previous position to the current position, and performing rotation and translation operations on the image frame according to the rotation amount and the translation amount to obtain the intermediate frame.

Optionally, the first image processing unit 501 is created by a first thread, and the second image processing unit 502 is created by a second thread;

The first thread copies the image frame to be displayed to the shared storage space by using the first image processing unit 501;

The second thread transmits an image frame in the shared storage space to the second image processing unit 502.

Optionally, the first image processing unit 501 includes a first texture and a second texture, where the second texture is the shared storage space;

The first image processing unit 501 is further configured to: before the first thread copies the image frame to be displayed to the shared storage space by using the first image processing unit 501, the first image processing unit 501 The image frame to be displayed is stored in the first texture;

Optionally, the second thread is created by the first thread;

The first image processing unit 501 is a DirectX device, and/or the second image processing unit 502 is a DirectX device.

In the embodiment of the present invention, the first image processing unit in the target device generates an image frame to be displayed according to the acquired virtual reality VR device location information, and copies the image frame to be displayed to the shared storage space; The second image processing unit in the target device adjusts the image frame in the shared storage space according to the current location information of the VR device at the time of display, and displays the adjusted image frame on the VR device. The embodiment of the present invention implements that the rendered image frame is generated by the first image processing unit and stored in the shared storage space, and then the second image processing unit adjusts the image frame in the shared space according to the current position information of the VR device during display. Therefore, the image frame displayed in the VR device is corresponding to the current position, so that the user does not cause the smear phenomenon and the stun feeling due to the same image frame of the previous position, so the method can be When you achieve rapid movement of the user's head, you can also see clear images without vertigo.

Based on the same technical concept, an embodiment of the present invention provides a target device. The target device provided by the embodiment of the present application is as shown in FIG. 6. The headset mode switching device includes: a first processor 601, a second processor 602, a memory 603, and a bus system 604;

Wherein, the memory 603 is used to store the program. In particular, the program can include program code, the program code including computer operating instructions. The memory 603 may be a random access memory (RAM) or a non-volatile memory, such as at least one disk storage. Only one memory is shown in the figure, of course, the memory can also be set to a plurality as needed. The memory 603 may also be a memory in the first processor 601, and the memory 603 may also be a memory in the second processor 602.

The memory 603 stores the following elements, executable modules or data structures, or a subset thereof, or an extended set thereof:

Operation instructions: include various operation instructions for implementing various operations.

Operating system: Includes a variety of system programs for implementing various basic services and handling hardware-based tasks.

The first processor 601 and the second processor 602 control the operation of the apparatus for determining the motion information of the object to be tested, and the first processor 601 and the second processor 602 may also be referred to as a CPU (Central Processing Unit). In a specific application, the components of the device for determining the motion information of the object to be tested are coupled together by a bus system 604. The bus system 604 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 604 in the figure. For ease of representation, only the schematic drawing is shown in FIG.

The method disclosed in the foregoing embodiment of the present application may be applied to the first processor 601 and the second processor 602, or implemented by the first processor 601 and the second processor 602. The first processor 601 and the second processor 602 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the first processor 601 and the second processor 602 or an instruction in a form of software. The first processor 601 and the second processor 602 described above may be general purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete Gate or transistor logic, discrete hardware components. The methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor. The software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage medium is located in the memory 603, and the first processor 601 and the second processor 602 read the information in the memory 603, and perform the following steps in conjunction with the hardware thereof:

Through the first processor 601, the acquired virtual reality VR device location information is rendered to generate an image frame to be displayed, and the image frame to be displayed is copied to the memory 603;

Adjusting the current location information of the VR device at the time of display by the second processor 602 The image frame of 603 is displayed, and the adjusted image frame is displayed on the VR device.

Optionally, the second processor 602 is specifically configured to:

Determining, according to current location information of the VR device, whether an image frame in the memory 603 is generated according to the current location rendering;

If it is determined that the image frame in the memory 603 is generated according to the current position rendering, the image frame in the memory 603 is used as the adjusted image frame;

If it is determined that the image frame in the memory 603 is not generated according to the current location rendering, the intermediate frame is generated according to the current location information of the VR device and the image frame in the memory 603, and the intermediate frame is used as the adjusted image. frame.

Optionally, the second processor 602 is specifically configured to:

Optionally, the first processor 601 is created by the first thread, and the second processor 602 is created by the second thread;

The first thread copies the image frame to be displayed to the memory 603 through the first processor 601;

The second thread transmits the image frame in the memory 603 to the second processor 602.

Optionally, the first processor 601 includes a first texture and a second texture, the second texture is a memory 603;

The first processor 601 is further configured to: before the first thread copies the image frame to be displayed to the memory 603 by using the first processor 601, storing the image frame to be displayed generated by the rendering in the first texture in;

Optionally, the second thread is created by the first thread;

The first processor 601 is a DirectX device, and/or the second processor 602 is a DirectX device.

The present invention is directed to a method, apparatus (system), and computer program according to an embodiment of the present invention. The flow chart and/or block diagram of the product is described. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Although the preferred embodiment of the invention has been described, it will be apparent to those skilled in the < Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention

Claims

A display method, comprising:

The first image processing unit in the target device generates and generates an image frame to be displayed according to the acquired virtual reality VR device location information, and copies the image frame to be displayed to the shared storage space;

The second image processing unit in the target device adjusts an image frame in the shared storage space according to current location information of the VR device at the time of display, and displays the adjusted image frame on the VR device.
The method according to claim 1, wherein the second image processing unit of the target device adjusts the image frame in the shared storage space according to the current location information of the VR device during display, including:

Determining, according to the current location information of the VR device, whether the image frame in the shared storage space is generated according to the current location rendering;

If the second image processing unit determines that the image frame in the shared storage space is generated according to the current location rendering, the image frame in the shared storage space is used as the adjusted image frame;

If the second image processing unit determines that the image frame in the shared storage space is not generated according to the current location rendering, generating an intermediate according to current location information of the VR device and image frames in the shared storage space The frame is used as the adjusted image frame.
The method according to claim 2, wherein the second image processing unit generates an intermediate frame according to the current location information of the VR device and the image frame in the shared storage space, including:

The second image processing unit determines a rotation amount and a translation amount of the VR device from a previous position to the current position, and performs rotation and translation operations on the image frame according to the rotation amount and the translation amount. The intermediate frame.
The method of any of claims 1-3, wherein the first image is The unit is created by the first thread, and the second image processing unit is created by the second thread;

The copying the image frame to be displayed to the shared storage space includes:

The first thread copies the image frame to be displayed to the shared storage space by using the first image processing unit;

The second image processing unit of the target device, before adjusting the image frame in the shared storage space according to the current location information of the VR device at the time of display, further includes:

The second thread transmits an image frame in the shared storage space to the second image processing unit.
The method of claim 4, wherein the first image processing unit comprises a first texture and a second texture, the second texture being the shared storage space;

Before the first thread copies the image frame to be displayed to the shared storage space by using the first image processing unit, the method further includes:

The first image processing unit stores the image frame to be displayed generated by the rendering in the first texture;

The first thread copies the image frame to be displayed to the shared storage space, including:

The first thread copies the image frame in the first texture to the second texture.
The method of claim 5 wherein said second thread is created by said first thread;

The first image processing unit is a DirectX device, and/or the second image processing unit is a DirectX device.
A target device, comprising:

The first image processing unit generates and generates an image frame to be displayed according to the acquired virtual reality VR device location information, and copies the image frame to be displayed to the shared storage space;

The second image processing unit adjusts an image frame in the shared storage space according to current position information of the VR device during display, and displays the adjusted image frame on the VR device.
The target device according to claim 7, wherein the second image processing unit is specifically configured to:

Determining, according to current location information of the VR device, whether an image frame in the shared storage space is generated according to the current location rendering;

If it is determined that the image frame in the shared storage space is generated according to the current location, the image frame in the shared storage space is used as the adjusted image frame;

If it is determined that the image frame in the shared storage space is not generated according to the current location rendering, generating an intermediate frame according to current location information of the VR device and an image frame in the shared storage space, and the middle The frame is used as an adjusted image frame.
The target device according to claim 8, wherein the second image processing unit is specifically configured to:

Determining a rotation amount and a translation amount of the VR device from a previous position to the current position, and performing rotation and translation operations on the image frame according to the rotation amount and the translation amount to obtain the intermediate frame.
The target device according to any one of claims 7 to 9, wherein the first image processing unit is created by a first thread, and the second image processing unit is created by a second thread;

The first thread copies the image frame to be displayed to the shared storage space by using the first image processing unit;

The second thread transmits an image frame in the shared storage space to the second image processing unit.
The target device according to claim 10, wherein the first image processing unit comprises a first texture and a second texture, and the second texture is the shared storage space;

The first image processing unit is further configured to: before the first thread copies the image frame to be displayed to the shared storage space by using the first image processing unit, the generated image frame to be displayed is to be rendered Stored in the first texture;

The first thread is specifically configured to: copy the image frame in the first texture to the second texture.
The target device of claim 11, wherein the second thread is created by the first thread;

The first image processing unit is a DirectX device, and/or the second image processing unit is DirectX device.
A target device, comprising:

The first processor generates, according to the acquired virtual reality VR device location information, an image frame to be displayed, and copies the image frame to be displayed to a memory;

The second processor adjusts an image frame in the memory according to current position information of the VR device at the time of display, and displays the adjusted image frame on the VR device.
The target device according to claim 13, wherein the second processor is specifically configured to:

Determining, according to current location information of the VR device, whether an image frame in the memory is generated according to the current location rendering;

If it is determined that the image frame in the memory is generated according to the current position rendering, the image frame in the memory is used as the adjusted image frame;

If it is determined that the image frame in the memory is not generated according to the current location rendering, generating an intermediate frame according to current location information of the VR device and an image frame in the memory, and using the intermediate frame as an adjustment Image frame.
The target device according to claim 14, wherein the second processor is specifically configured to:

Determining a rotation amount and a translation amount of the VR device from a previous position to the current position, and performing rotation and translation operations on the image frame according to the rotation amount and the translation amount to obtain the intermediate frame.
The target device according to any one of claims 13 to 15, wherein the first processor is created by a first thread and the second processor is created by a second thread;

The first thread copies the image frame to be displayed to the memory by using the first processor;

The second thread transmits an image frame in the memory to the second processor.
The target device according to claim 16, wherein the first processor comprises a first texture and a second texture, and the second texture is the memory;

The first processor is further configured to: the first thread passes the first processor to display the to-be-displayed Before the image frame shown is copied to the memory, the image frame to be displayed generated by the rendering is stored in the first texture;

The first thread is specifically configured to: copy the image frame in the first texture to the second texture.
The target device of claim 17, wherein the second thread is created by the first thread;

The first processor is a DirectX device, and/or the second processor is a DirectX device.