WO2019085109A1

WO2019085109A1 - Image writing control method and apparatus, and electronic device

Info

Publication number: WO2019085109A1
Application number: PCT/CN2017/113567
Authority: WO
Inventors: 王明
Original assignee: 歌尔科技有限公司
Priority date: 2017-10-31
Filing date: 2017-11-29
Publication date: 2019-05-09
Also published as: CN107743223A

Abstract

An image writing control method and apparatus, and an electronic device. The method comprises: a display assembly triggers a read operation on an Nth frame of image in a cache queue, and simultaneously generates a first read state; then, a head-mounted display device responds to the first read state, so as to obtains the triggering time corresponding to the first read state, and updates a time variable value corresponding to the first read state to the triggering time (S101); according to a precedence relationship between the updated time variable corresponding to the first read state and a time variable corresponding to a current second read state, determining whether a head-mounted virtual-reality device completes the reading of the Nth frame of image (S102); and, only when the read operation of the image is completed, the head-mounted virtual-reality device starts to write an (N+1)th frame of image into the cache queue (S103). In this way, it is ensured that the image is separately read and written, the reading and writing do not conflict, and the image is prevented from being torn, thereby improving the image display quality.

Description

Image writing control method, device and electronic device

Technical field

The present invention relates to the field of data processing technologies, and in particular, to an image writing control method, apparatus, and electronic device.

Background technique

In recent years, virtual reality technology has been widely used in many fields, such as architecture, medical, media, film and television. Users can view images with virtual reality devices to achieve an immersive feel.

In the prior art, a cache queue is usually set in the virtual reality device, and the application installed on the virtual reality device writes the image to be displayed into the cache queue. Then, the display component in the virtual reality device reads the image to be displayed from the cache queue, and finally renders the image to be displayed onto the screen of the virtual reality device. However, since the writing and reading of the image to be displayed are controlled by mutually independent control signals, for example, the writing of the image to be displayed is controlled by the image writing signal, and the reading of the image to be displayed is controlled by the image reading signal, wherein This image read signal may be a vertical sync signal (V-SYNC signal). Therefore, the writing and reading of the image to be displayed are prone to conflicts, which causes tearing of the image displayed on the screen, which seriously degrades the quality of the image display.

Summary of the invention

In view of this, an embodiment of the present invention provides an image writing control method, apparatus, and electronic device, which prevent image writing and reading from colliding by controlling image writing time, thereby avoiding image tearing and improving image display. the quality of.

An embodiment of the present invention provides an image writing control method, including:

And updating a time variable corresponding to the first read state to a trigger time corresponding to the first read state, in response to the first read state generated by the read operation triggered by the display component triggering the image of the Nth frame in the cache queue ;

Determining whether the image of the Nth frame is read according to a time-order relationship between a time variable value corresponding to the first read state and a time variable value corresponding to the current second read state;

If the image of the Nth frame is read, the image of the (N+1)th frame is written into the buffer queue.

Optionally, if the first read state is a read start state, the second read state is a read end state; and if the first read state is a read end state, the first The second read state is the read start state.

Optionally, the determining, according to the time-order relationship between the time variable value corresponding to the first read state and the time variable value corresponding to the current second read state, determining whether the image of the Nth frame is read, includes:

If the time variable value corresponding to the read start state is smaller than the time variable value corresponding to the read end state, The image of the Nth frame is read.

Optionally, the cache queue includes a first space for storing a left eye image and a second space for storing a right eye image, and the Nth frame image is an Nth frame left eye image or an Nth frame right eye image;

Writing the image of the (N+1)th frame to the cache queue includes:

If the Nth frame image is the Nth frame left eye image, the N+1th frame left eye image is written into the first space of the buffer queue;

If the Nth frame image is the Nth frame right eye image, the N+1th frame right eye image is written into the second space of the buffer queue.

Optionally, before the writing the (N+1)th frame image into the cache queue, the method further includes:

Obtaining the posture data of the user;

Determining an object located within a field of view of the user according to the posture data and a position of each object in the virtual reality scene;

Generating the (N+1)th left eye image and the (N+1)th right eye image corresponding to the object located within the user's field of view.

An embodiment of the present invention provides an image writing control apparatus, including:

And an update module, configured to update a first read state corresponding to the read operation triggered by the Nth frame image in the cache queue by the display component, and update a time variable value corresponding to the first read state to the first read The trigger time corresponding to the state;

a state determining module, configured to determine, according to a time-order relationship between a time variable value corresponding to the first read state and a time variable value corresponding to the current second read state, whether the image of the Nth frame is read;

The writing module is configured to write the N+1th frame image into the buffer queue if the image of the Nth frame is read.

An embodiment of the present invention provides an electronic device, including: a memory, and a processor connected to the memory;

The memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor;

The processor is configured to execute the one or more computer instructions in any one of the above image writing control methods.

The image writing control method and device and the electronic device provided by the embodiments of the present invention, the display component of the head mounted virtual reality device triggers a read operation on the Nth frame image in the buffer queue and simultaneously generates a first read state. Then, the head-mounted display device responds to the first read state generated by the read operation, thereby obtaining the trigger time of the read operation, that is, the trigger time corresponding to the first read state, and correspondingly using the first read state. The trigger time updates the value of the time variable corresponding to the first read state. Determining whether the head-mounted virtual reality device has read the image of the Nth frame according to the sequential relationship between the time variable corresponding to the updated first read state and the time variable corresponding to the current second read state. Head-mounted The writing operation of the image by the virtual reality device is controlled by the completion of the image reading. If the image reading operation has been completed, the head mounted virtual reality device will start to write the N+1th frame image into the buffer queue; if the image reading operation is not completed, the head mounted virtual reality device will be in Waiting state, no image is written. In this way, it can ensure that the reading and writing of the image are completed separately, and there is no case of reading and writing conflicts, which avoids tearing of the screen and improves the quality of the image display.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

FIG. 1 is a flowchart of Embodiment 1 of an image writing control method according to an embodiment of the present invention;

2 is a flowchart of Embodiment 2 of an image writing control method according to an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of Embodiment 1 of an image writing control apparatus according to an embodiment of the present disclosure;

4 is a schematic structural diagram of Embodiment 2 of an image writing control apparatus according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of Embodiment 1 of an electronic device according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of an internal configuration structure of a head mounted virtual reality device according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The terms used in the embodiments of the present invention are for the purpose of describing particular embodiments only and are not intended to limit the invention. The singular forms "a", "the", "the" and "the" Generally, at least two types are included, but the case of including at least one is not excluded.

It should be understood that the term "and/or" as used herein is merely an association describing the associated object, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists separately, while A and B, there are three separate B Kind of situation. In addition, the character "/" in this article generally indicates that the contextual object is an "or" relationship.

It should be understood that although the terms first, second, third, etc. may be used to describe XXX in embodiments of the invention, these XXX should not be limited to these terms. These terms are only used to distinguish XXX from each other. For example, the first XXX may also be referred to as a second XXX without departing from the scope of the embodiments of the present invention. Similarly, the second XXX may also be referred to as a first XXX.

Depending on the context, the words "if" and "if" as used herein may be interpreted to mean "when" or "when" or "in response to determining" or "in response to detecting." Similarly, depending on the context, the phrase "if determined" or "if detected (conditions or events stated)" may be interpreted as "when determined" or "in response to determination" or "when detected (stated condition or event) "Time" or "in response to a test (condition or event stated)".

It should also be noted that the terms "including", "comprising" or "comprising" or any other variations thereof are intended to encompass a non-exclusive inclusion, such that the item or system comprising a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such goods or systems. An element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the item or system including the element, without further limitation.

Generally, the head-mounted virtual reality device first writes the image to be displayed into the cache queue, and then the display component in the head-mounted display device reads and renders the image to be displayed from the cache queue, and the user then The image in the virtual scene can be viewed through the display screen of the head mounted virtual reality device. In order to enable the user to see the image in the virtual scene normally, FIG. 1 is a flowchart of Embodiment 1 of the image writing control method according to the embodiment of the present invention, and the execution body of the image writing control method provided by the embodiment may be As a head mounted virtual reality device, as shown in FIG. 1, the method includes the following steps:

S101. In response to the first read state generated by the read operation triggered by the display component triggering the image of the Nth frame in the cache queue, the time variable corresponding to the first read state is updated to be a trigger time corresponding to the first read state.

After the head mounted virtual reality device is turned on, the display component in the head mounted virtual reality device periodically issues an image read signal. The display component can control the start and end of reading of the image according to the image read signal. Alternatively, in practical applications, the commonly used image read signal can be a vertical sync signal.

The display component triggers a read operation on the Nth frame image in the buffer queue in response to the image read control signal, and the display component also generates a first read state while triggering the read operation. Optionally, the triggered read operation may be an operation indicating that the image reading is started or an operation indicating that the image reading is ended. Correspondingly, the first read state may be a read start state, indicating the Nth frame image. Start reading; also can be the reading end state, indicating that the Nth frame image has been read.

The head mounted virtual reality device can obtain a trigger for reading the image of the Nth frame in response to the first read state The trigger time of the operation, that is, the trigger time corresponding to the first read state generated by the read operation. Afterwards, the head-mounted virtual reality device may update the time variable value corresponding to the first read state according to the trigger time corresponding to the acquired first read state. As described in the above description, since the first read state may be the read start state or the read end state, the time variable value corresponding to the updated first read state may represent the Nth frame. The reading start time of the image may also indicate the reading end time of the image of the Nth frame.

S102: Determine, according to a time-order relationship between a time variable value corresponding to the first read state and a time variable value corresponding to the current second read state, whether the image of the Nth frame is read.

S103. If the image of the Nth frame is read, the image of the (N+1)th frame is written into the buffer queue.

The head mounted virtual reality device may determine whether the image of the Nth frame is read according to the time variable value corresponding to the updated first read state and the time variable value corresponding to the current second read state, where the current The time variable value corresponding to the second read state is a time variable value that exists before updating the time variable value corresponding to the first read state. It should be noted that, in practical applications, the first read state and the second read state are two different read states. Optionally, if the first read state is a read start state, the second read state is a read end state; if the first read state is a read end state, the second read state is a read start state. status.

When the time variable value corresponding to the first read state indicates the time when the image reading of the Nth frame starts, and the time variable value corresponding to the second read state indicates the time when the image reading of the N-1th frame ends, the first read The value of the time variable corresponding to the state is greater than the value of the time variable corresponding to the second read state. At this time, it indicates that the image of the Nth frame is being read. At this time, the head mounted virtual reality device maintains the current waiting state and does not read the N+1th frame image from the buffer queue.

When the time variable value corresponding to the first read state indicates the time when the image reading of the Nth frame starts, and the time variable value corresponding to the second read state indicates the time when the image reading of the Nth frame ends, the first read state corresponds to The time variable value is smaller than the time variable value corresponding to the second read state. At this time, it indicates that the Nth frame image has been read. At this time, the head mounted virtual reality device can continue to write the N+1 frame image into the buffer queue. in.

In this embodiment, the display component of the head mounted virtual reality device triggers a read operation on the Nth frame image in the buffer queue and simultaneously generates a first read state. Then, the head-mounted display device responds to the first read state generated by the read operation, thereby obtaining the trigger time of the read operation, that is, the trigger time corresponding to the first read state, and correspondingly using the first read state. The trigger time updates the value of the time variable corresponding to the first read state. Determining whether the head-mounted virtual reality device has read the image of the Nth frame according to the sequential relationship between the time variable corresponding to the updated first read state and the time variable corresponding to the current second read state. That is, the write operation of the image by the head-mounted virtual reality device is controlled by the completion of the image reading. If the image reading operation has been completed, the head mounted virtual reality device will start to write the N+1th frame image into the buffer queue; if the image reading operation is not completed, the head mounted virtual reality device will be in Waiting state, no image is written. This will ensure that the image is read and written separately and will not appear. The situation of reading and writing conflicts avoids tearing of the picture and improves the quality of image display.

FIG. 2 is a flowchart of Embodiment 2 of an image writing control method according to an embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:

S201. In response to the first read state generated by the read operation triggered by the display component triggering the image of the Nth frame in the cache queue, updating the time variable corresponding to the first read state is a trigger time corresponding to the first read state.

The process of the foregoing step S201 is similar to the corresponding steps of the foregoing embodiment. For details, refer to the related description in the embodiment shown in FIG. 1 , and details are not described herein again.

S202. Determine, according to a time-order relationship between a time variable value corresponding to the first read state and a time variable value corresponding to the current second read state, whether the image of the Nth frame is read.

According to the related description in the first embodiment, the first read state and the second read state are two different read states. It is easy to think that the following two situations will occur: the first read state is the read start state, the second read state is the read end state; the first read state is the read end state, the second read state The status is taken as the read start status.

At this time, when the first read state is the read start state and the second read state is the read end state, the time variable value corresponding to the first read state is the time variable value corresponding to the read start state, The time variable value corresponding to the second read state is the time variable value corresponding to the read end state. According to the related description in the first embodiment, if the time variable value corresponding to the read start state is smaller than the time variable value corresponding to the read end state, it is determined that the Nth frame image is read.

When the first read state is the read end state and the second read state is the read start state, the time variable value corresponding to the first read state is the time variable value corresponding to the read end state, and the second read The time variable value corresponding to the state is the time variable value corresponding to the read start state. Similarly, according to the related description in the first embodiment, it can be obtained that if the time variable value corresponding to the read start state is greater than the time variable value corresponding to the read end state, it is determined that the Nth frame image is being read.

S203: If the image of the Nth frame is read, the image of the (N+1)th frame is generated.

Unlike viewing ordinary images, the scenes that users view in pre-built, 360° virtual scenes are closely related to the user's posture. Therefore, after the image of the Nth frame is read, the N+1th frame image to be written needs to be generated in real time according to the current posture of the user.

Optionally, after the image of the Nth frame is read, the head mounted virtual reality device may generate the image of the (N+1)th frame by:

First, the user's posture data is acquired.

Further, an object located within the visual field of the user is determined based on the posture data and the position of each object in the virtual reality scene.

Finally, an N+1th frame image corresponding to the object located within the user's field of view is generated.

Specifically, the nine-axis sensor disposed in the head-mounted virtual reality device may collect the posture data of the user at a preset collection interval. Optionally, the gesture data can be stored in a fixed storage space. The head-mounted virtual reality device can obtain the current posture data of the user from the storage space. Optionally, the collected posture data can be the posture data of the user's head, such as the pitch angle, the deflection angle, and the heading of the user's head. angle.

In a 360° virtual reality scene, the user's field of view is limited, and the field of view can be measured by the size of the angle of view. The adult's binocular angle is generally about 110°. At the same time, after the virtual reality scene is set up, the head-mounted virtual reality device can know the position coordinates of each object in the virtual reality scene. Optionally, the position coordinates of each object in the virtual scene can be written into a file. Therefore, the head-mounted virtual reality device can determine the coordinate range corresponding to the user's field of view according to the current posture data of the user, and filter out objects belonging to the user's field of view from the file. Finally, the head-mounted virtual reality device can generate an N+1th frame image based on the filtered object.

S204. Write an image of the (N+1)th frame into the buffer queue.

After the image of the Nth frame is read, the head-mounted virtual reality device can write the generated image of the (N+1)th frame into the buffer queue.

In addition, the images displayed in the head-mounted virtual reality device all have a stereoscopic effect, which is produced by synthesizing two left-eye images and right-eye images having parallax. In order to normally display one frame of a stereoscopic image, it is necessary to separately read and render the left eye image and the right eye image, that is, it is necessary to accurately control the timing of writing the left eye image and the right eye image, respectively.

In order to accurately control the timing of the left eye image and the right eye image writing, the buffer queue may be optionally divided into two spaces, that is, a first space for storing a left eye image and a second for storing a right eye image. Two spaces. The Nth frame image and the N+1th frame image referred to above and below may be both a left eye image and a right eye image.

If the read Nth frame image is the Nth frame left eye image, the N+1th left eye image is written into the first space of the buffer queue. If the read Nth frame image is the Nth frame right eye image, the N+1th frame right eye image is written into the second space of the buffer queue.

It should be noted that the present invention does not limit the order of image reading. In the process of reading the left eye image and the right eye image corresponding to one frame image, the left eye image may be read first. Read the right eye image first.

In this embodiment, the image for performing the write control needs to be generated in real time according to the posture data of the user, so that the content viewed by the user through the head-mounted virtual reality device and the posture data of the user are matched. Then, the left-eye image and the right-eye image generated in real time are respectively written into the cache queue. At the same time, the cache queue is spatially divided, that is, the cache queue is divided into a first space and a second space, and the first space and the second space are used to store a left eye image and a right eye image, respectively. This avoids the occurrence of an image reading error that is likely to occur when the left-eye image and the right-eye image are co-cached in a cache queue that is not divided into spaces. For example, the left-eye image should be read incorrectly. The right eye image enables the head mounted virtual reality device to control the writing timing of the image more independently and accurately.

FIG. 3 is a schematic structural diagram of Embodiment 1 of an image writing control apparatus according to an embodiment of the present invention. As shown in FIG. 3, the image writing control apparatus includes: an updating module 11, a state determining module 12, and a writing module 13.

The update module 11 is configured to: in response to the first read state generated by the read operation triggered by the display component triggering the Nth frame image in the cache queue, update the time variable value corresponding to the first read state to correspond to the first read state Trigger time.

The state determining module 12 is configured to determine whether the image of the Nth frame is read according to a time-order relationship between the time variable value corresponding to the first read state and the time variable value corresponding to the current second read state.

The writing module 13 is configured to write the N+1th frame image into the buffer queue if the image of the Nth frame is read.

The apparatus shown in FIG. 3 can perform the method of the embodiment shown in FIG. 1. For the parts not described in detail in this embodiment, reference may be made to the related description of the embodiment shown in FIG. 1. For the implementation process and technical effects of the technical solution, refer to the description in the embodiment shown in FIG. 1, and details are not described herein again.

4 is a schematic structural diagram of Embodiment 2 of an image writing control apparatus according to an embodiment of the present invention. As shown in FIG. 4, based on the embodiment shown in FIG. 3, an adjustment module 12 in the image writing control apparatus is used. : If the time variable value corresponding to the read start state is smaller than the time variable value corresponding to the read end state, it is determined that the Nth frame image is read.

Optionally, the buffer queue includes a first space for storing a left eye image and a second space for storing a right eye image, and the Nth frame image is an Nth frame left eye image or an Nth frame right eye image;

The writing module 13 in the image writing control device is specifically configured to:

If the image of the Nth frame is the left eye image of the Nth frame, the image of the left eye of the (N+1)th frame is written into the first space of the buffer queue, and if the image of the Nth frame is the image of the right eye of the Nth frame, The N+1 frame right eye image is written into the second space of the buffer queue.

Optionally, the image writing control device further includes: an obtaining module 21, an object determining module 22, and a generating module 23.

The obtaining module 21 is configured to acquire posture data of the user.

The object determining module 22 is configured to determine an object located within a visual field of the user according to the posture data and the position of each object in the virtual reality scene.

The generating module 23 is configured to generate an N+1th left eye image and an N+1th right eye image corresponding to the object located in the visual field of the user.

The apparatus shown in FIG. 4 can perform the method of the embodiment shown in FIG. 2. For the parts not described in detail in this embodiment, reference may be made to the related description of the embodiment shown in FIG. 2. For the implementation process and technical effects of the technical solution, refer to the description in the embodiment shown in FIG. 2, and details are not described herein again.

The internal functions and structures of the image writing control device have been described above. In one possible design, the structure of the image writing control device can be implemented as an electronic device such as a head mounted virtual reality device. 5 is a schematic structural diagram of Embodiment 1 of an electronic device according to an embodiment of the present invention. As shown in FIG. 5, the electronic device includes: a memory 31, and a processor 32 connected to the memory, where the memory 31 is used to store the electronic device to perform the above. The program of the image write control method provided in any of the embodiments, the processor 32 is configured to execute a program stored in the memory 31.

The program includes one or more computer instructions, wherein one or more computer instructions are executed by the processor 32 to:

And in response to the first read state generated by the read operation triggered by the display component triggering the image of the Nth frame in the cache queue, updating the time variable corresponding to the first read state is a trigger time corresponding to the first read state;

Determining whether the image of the Nth frame is read according to a time-order relationship between the value of the time variable corresponding to the first read state and the value of the time variable corresponding to the current second read state;

Optionally, the processor 32 is further configured to perform all or part of the foregoing method steps.

The structure of the electronic device may further include a communication interface 33 for the electronic device to communicate with other devices or a communication network.

The display unit 401 may include a display panel disposed on a side surface of the head mounted virtual display device 400 facing the user's face, and may be a whole panel or a left panel and a right panel corresponding to the left and right eyes of the user respectively. . The display panel may be an electroluminescent (EL) component, a liquid crystal display or a microdisplay having a similar structure, or a laser-scanned display in which the retina can be directly displayed or similar.

The virtual image optical unit 402 photographs the image displayed by the display unit 401 in an enlarged manner and allows the user to observe the displayed image in the enlarged virtual image. As the display image outputted to the display unit 401, it may be an image of a virtual scene supplied from a content reproduction device (a Blu-ray disc or a DVD player) or a streaming server, or an image of a real scene photographed using an external camera 410. In some embodiments, virtual image optical unit 402 can include a lens unit, such as a spherical lens, an aspheric lens, a Fresnel lens, and the like.

The input operation unit 403 includes at least one operation member for performing an input operation, such as a button, a button, a switch, or other similarly functioned component, receives a user instruction through the operation member, and outputs an instruction to the control unit 407.

The status information acquiring unit 404 is configured to acquire status information of the user wearing the head mounted virtual display device 400. The status information acquisition unit 404 may include various types of sensors for detecting status information by itself, and may acquire status information from the external device such as a smartphone, a wristwatch, and other multi-function terminals worn by the user through the communication unit 405. Status information obtained The fetching unit 404 can acquire location information and/or posture information of the user's head. The status information acquisition unit 404 may include one or more of a gyro sensor, an acceleration sensor, a Global Positioning System (GPS) sensor, a geomagnetic sensor, a Doppler effect sensor, an infrared sensor, and a radio frequency field intensity sensor. Further, the state information acquisition unit 404 acquires state information of the user wearing the head-mounted virtual display device 400, for example, acquiring an operation state of the user (eg, whether the user wears the head-mounted virtual display device 400), an action state of the user (such as still, Walking, running, and the like, the posture of the hand or fingertip, the open or closed state of the eye, the direction of the line of sight, the size of the pupil, the mental state (whether the user is immersed in the image displayed by the observation, and the like), and even the physiological status.

The communication unit 405 performs communication processing, modulation and demodulation processing with an external device, and encoding and decoding processing of the communication signal. In addition, the control unit 407 can transmit transmission data from the communication unit 405 to an external device. The communication method may be wired or wireless, for example, Mobile High-Definition Link (MHL) or Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), Wireless Fidelity (Wi-Fi), Bluetooth communication or Bluetooth low energy communication, and the mesh network of the IEEE802.11s standard. In addition, the communication unit 405 may be a cellular radio transceiver that operates according to Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and the like.

In some embodiments, the head mounted virtual display device 400 may further include a storage unit, and the storage unit 406 is a mass storage device configured to have Solid State Drives (SSD) or the like. In some embodiments, storage unit 406 can store applications or various types of data. For example, content viewed by a user using the head mounted virtual display device 400 may be stored in the storage unit 406.

In some embodiments, the head mounted virtual display device 400 may further include a control unit, and the control unit 407 may include a Central Processing Unit (CPU) or other device having similar functions. In some embodiments, control unit 407 can be used to execute an application stored by storage unit 406, or control unit 407 can also be used to perform the methods, functions, and operations disclosed in some embodiments of the present application.

The image processing unit 408 is for performing signal processing such as image quality correction related to the image signal output from the control unit 407, and converting its resolution into a resolution according to the screen of the display unit 401. Then, the display driving unit 404 sequentially selects each line of pixels of the display unit 401, and sequentially scans each line of pixels of the display unit 401 line by line, thereby providing a pixel signal based on the signal-processed image signal.

In some embodiments, the head mounted virtual display device 400 can also include an external camera. The external camera 410 may be disposed on the front surface of the main body of the head-mounted virtual display device 400, and the external camera 410 may be one or more. The external camera 410 can acquire three-dimensional information and can also be used as a distance sensor. In addition, a Position Sensitive Detector (PSD) or other type of distance sensor that detects a reflected signal from an object may be combined with the external camera 410. use. The external camera 410 and the distance sensor can be used to detect the body position, posture, and shape of the user wearing the head mounted virtual display device 400. In addition, under certain conditions, the user can directly view or preview the real scene through the external camera 410.

In some embodiments, the head mounted virtual display device 400 may further include a sound processing unit 411 that may perform sound quality correction or sound amplification of the sound signal output from the control unit 407, signal processing of the input sound signal, and the like. Then, the sound input/output unit 412 outputs the sound to the outside and the sound from the microphone after the sound processing.

It should be noted that the structure or components shown by the thick line frame in FIG. 6 may be independent of the head mounted virtual display device 400, for example, may be disposed in an external processing system, such as a computer system, and a head mounted virtual display device. The 400 is used in conjunction; or the structure or component shown by the dashed box may be disposed inside or on the surface of the head mounted virtual display device 400.

The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Through the description of the above embodiments, those skilled in the art can clearly understand that the embodiments can be implemented by adding a necessary general hardware platform, and can also be implemented by a combination of hardware and software. Based on such understanding, the above-described technical solutions may be embodied in the form of products in essence or in the form of products, which may be stored in a computer readable storage medium such as a ROM/RAM, a disk, An optical disk or the like includes a number of instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.

It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not limited thereto; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments are modified, or the equivalents of the technical features are replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

An image writing control method, comprising:

And updating a time variable corresponding to the first read state to a trigger time corresponding to the first read state, in response to the first read state generated by the read operation triggered by the display component triggering the image of the Nth frame in the cache queue ;

Determining whether the image of the Nth frame is read according to a time-order relationship between a time variable value corresponding to the first read state and a time variable value corresponding to the current second read state;

If the image of the Nth frame is read, the image of the (N+1)th frame is written into the buffer queue.
The method according to claim 1, wherein if the first read state is a read start state, the second read state is a read end state; if the first read state is When the end state is read, the second read state is a read start state.
The method according to claim 2, wherein the determining the Nth according to a time-order relationship between a time variable value corresponding to the first read state and a time variable value corresponding to a current second read state Whether the frame image has been read, including:

If the time variable value corresponding to the read start state is smaller than the time variable value corresponding to the read end state, it is determined that the Nth frame image is read.
The method according to any one of claims 1 to 3, wherein the buffer queue includes a first space for storing a left eye image and a second space for storing a right eye image, the Nth The frame image is an Nth frame left eye image or an Nth frame right eye image;

Writing the image of the (N+1)th frame to the cache queue includes:

If the Nth frame image is the Nth frame left eye image, the N+1th frame left eye image is written into the first space of the buffer queue;

If the Nth frame image is the Nth frame right eye image, the N+1th frame right eye image is written into the second space of the buffer queue.
The method according to claim 4, further comprising: before the writing the (N+1)th frame image into the buffer queue,

Obtaining the posture data of the user;

Determining an object located within a field of view of the user according to the posture data and a position of each object in the virtual reality scene;

Generating the (N+1)th left eye image and the (N+1)th right eye image corresponding to the object located within the user's field of view.
An image writing control device, comprising:

And an update module, configured to: in response to the first read state triggered by the display component to the image of the Nth frame in the cache queue, update a time variable corresponding to the first read state to a trigger time corresponding to the first read state ;

a state determining module, configured to determine, according to a time-order relationship between a time variable value corresponding to the first read state and a time variable value corresponding to the current second read state, whether the image of the Nth frame is read;

The writing module is configured to write the N+1th frame image into the buffer queue if the image of the Nth frame is read.
An electronic device, comprising: a memory, and a processor coupled to the memory;

The memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor;

The processor is configured to execute the one or more computer instructions to implement the image writing control method according to any one of claims 1 to 5.
A computer readable storage medium storing a computer program, wherein the computer program causes the computer to execute the image writing control method according to any one of claims 1 to 5.