CN109696959B - Picture display method, equipment and storage medium - Google Patents
Picture display method, equipment and storage medium Download PDFInfo
- Publication number
- CN109696959B CN109696959B CN201811457520.XA CN201811457520A CN109696959B CN 109696959 B CN109696959 B CN 109696959B CN 201811457520 A CN201811457520 A CN 201811457520A CN 109696959 B CN109696959 B CN 109696959B
- Authority
- CN
- China
- Prior art keywords
- head
- speed
- head rotation
- mounted display
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application provides a picture display method, picture display equipment and a storage medium. In some exemplary embodiments of the present application, head rotation parameters of a user wearing the head-mounted display device are collected; adjusting the image output speed of the head-mounted display equipment according to the head rotation parameters of the user; and controlling the head-mounted display equipment to output the picture according to the adjusted picture output speed. In some exemplary embodiments of the present application, the picture output speed of the head-mounted display device is adjusted according to the head rotation parameter of the user, and the improvement is made from the display end, so that the head rotation speed of the user is matched with the picture output speed, thereby alleviating the vertigo when the user wears the head-mounted display device, and improving the user experience.
Description
Technical Field
The present application relates to the field of head-mounted smart devices, and in particular, to a method and an apparatus for displaying a picture, and a storage medium.
Background
Virtual Reality technology shows the increase of geometric number in recent years, and whether medical treatment, sports, movie and television, live broadcasting, shooting and the like, VR is one of the opportunities for future development, which is also the reason for the accumulation of outbreaks in the current market situation, and is also increasingly developed in the fields of real estate, games and the like. At present, the relevant VR virtual reality equipment of VR virtual reality technique, like VR intelligence glasses, VR helmet, VR head-mounted device etc..
At present, VR in the market basically has a problem that vertigo occurs, which results in poor user experience.
Disclosure of Invention
Aspects of the present application provide a picture display method, device and storage medium, so as to reduce the vertigo problem of the current VR device and improve user experience.
The embodiment of the application provides a picture display method, which is suitable for a head-mounted display device and comprises the following steps: acquiring head rotation parameters of a user wearing the head-mounted display device; adjusting the image output speed of the head-mounted display equipment according to the head rotation parameters of the user; and controlling the head-mounted display equipment to output the picture according to the adjusted picture output speed.
The embodiment of the present application further provides a head-mounted display device, including: the device comprises a device body, one or more processors arranged on the device body, and one or more memories for storing computer programs; the one or more processors to execute the computer program to: collecting head rotation parameters of a user wearing the head-mounted display device; adjusting the image output speed of the head-mounted display equipment according to the head rotation parameters of the user; and controlling the head-mounted display equipment to output the picture according to the adjusted picture output speed.
An embodiment of the application provides a computer-readable storage medium storing a computer program, which when executed by one or more processors causes the one or more processors to perform actions comprising: collecting head rotation parameters of a user wearing the head-mounted display device; adjusting the image output speed of the head-mounted display equipment according to the head rotation parameters of the user; and controlling the head-mounted display equipment to output the picture according to the adjusted picture output speed.
In some exemplary embodiments of the present application, the picture output speed of the head-mounted display device is adjusted according to the head rotation parameter of the user, and the improvement is made from the display end, so that the head rotation parameter of the user is matched with the picture output speed, thereby alleviating the vertigo when the user wears the head-mounted display device, and improving the user experience.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic flowchart of a picture displaying method according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a specific picture displaying method according to another embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a head-mounted display device according to an exemplary embodiment of the present disclosure;
fig. 4 is a schematic diagram of an internal configuration structure of a head-mounted display device according to an exemplary embodiment of the present application
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, and "a" and "an" generally include at least two, but do not exclude at least one, unless the context clearly dictates otherwise.
The words "if", as used herein, may be interpreted as "at … …" or "when … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.
To the problem that the existing VR device is dizzy, in some exemplary embodiments of the present application, the picture output speed of the head-mounted display device is adjusted according to the head rotation parameter of the user, and the improvement is made from the display end, so that the head rotation parameter of the user is matched with the picture output speed, thereby alleviating the dizzy feeling of the user when wearing the head-mounted display device, and improving the user experience.
The technical solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.
Fig. 1 is a schematic flowchart of a picture displaying method according to an embodiment of the present disclosure. As shown in fig. 1, the method includes:
s101: collecting head rotation parameters of a user wearing the head-mounted display equipment;
s102: adjusting the picture output speed of the head-mounted display equipment according to the head rotation parameters of the user;
s103: and controlling the head-mounted display equipment to output the picture according to the adjusted picture output speed.
In this embodiment, the execution subject is a head-mounted display device, such as a VR helmet, VR glasses, AR glasses, and the like. The embodiment of the application does not limit the type of the head-mounted display device. The picture of the head-mounted display device in the embodiment of the application may be video or picture content played by the head-mounted display device.
The user wears the in-process that head mounted display device watched the broadcast picture, probably bring dizzy problem when picture and head slew velocity are asynchronous, in this embodiment, at first, gather the head slew parameter of the user who wears head mounted display device, then, according to user's head slew parameter, adjust head mounted display device's picture output speed, improve from the display end, make user's head slew parameter and picture output speed phase-match, and finally, control head mounted display device is according to the picture output speed output picture after the adjustment, thereby alleviate the dizzy sense when the user wears head mounted display device, promote user experience.
In the above embodiment, the head rotation parameter includes a head rotation angular velocity, and an optional embodiment of collecting the head rotation angular velocity of the user wearing the head-mounted display device is to collect the head rotation angular velocity of the head-mounted display device by using a gyroscope of the head-mounted display device; the head rotation angular velocity of the user is determined from the rotation angular velocity of the head mounted display device. The utility model provides a can realize the mode be, set up the gyroscope on wearing display device, the user is after wearing this wear display device, and in the head rotation process, the rotation speed of wearing display device that the gyroscope gathered, the main control IC who wears display device acquires this rotation speed through data bus to carry out the unit conversion with this rotation speed and acquire wear display device's rotational angular velocity. In practical cases, the rotation angular velocity of the head-mounted display device is not equal to the head rotation angular velocity of the user, and different angular velocities are acquired by the rotation angular velocity of the head-mounted display device according to different positions of the sensor.
In another embodiment, the head rotation parameters include a head rotation angular velocity and a head rotation angular acceleration, and there are two ways to acquire the head rotation angular velocity of the user wearing the head-mounted display device:
in the first mode, the rotation angular velocity acquired by the gyroscope of the head-mounted display device is directly used as the head rotation angular velocity of the user.
Acquiring the rotation angular velocity of the head-mounted display device by utilizing a gyroscope of the head-mounted display device; the head rotation angular velocity of the user is determined from the rotation angular velocity of the head mounted display device. Namely, after the rotation angular velocity of the head-mounted display device is calculated, the head rotation angular velocity of the user is obtained.
The following methods are used to collect the angular acceleration of the head rotation of the user wearing the head-mounted display device:
the first method is as follows: and directly using the angular acceleration acquired by the angular acceleration sensor of the head-mounted display equipment as the head rotation angular acceleration of the user.
The second method comprises the following steps: and determining the head rotation angular acceleration of the user according to the angular acceleration of the head-mounted display equipment by utilizing the angular acceleration of the head-mounted display equipment acquired by the angular acceleration sensor of the head-mounted display equipment. That is, the angular acceleration of the head rotation of the user is obtained by calculating the angular acceleration of the head-mounted display device.
The third method comprises the following steps: after the rotation angular velocity acquired by the gyroscope of the head-mounted display device is acquired, the head rotation angular acceleration of the user is calculated through the head rotation angular velocity of the user.
In the above embodiment, one way to obtain the rotation angular velocity and the angular acceleration of the head-mounted display device may be that a gyroscope and an angular acceleration sensor are disposed on the head-mounted display device, after the user wears the head-mounted display device, during the head rotation process, the rotation speed of the head-mounted display device collected by the gyroscope is obtained by the main control IC of the head-mounted display device through a data bus, and the rotation angular velocity of the head-mounted display device is obtained after unit conversion is performed on the rotation speed, and similarly, the angular acceleration of the head-mounted display device is obtained. In the embodiment of the present application, the rotation angular velocity of the head-mounted display device acquired by the gyroscope is used as the head rotation angular velocity of the user, and the angular acceleration acquired by the angular acceleration sensor is used as the head rotation angular acceleration of the user.
In the above embodiment, the user presets the mapping relationship between the head rotation speed gear and the picture output speed in advance, determines the head rotation speed gear to which the head rotation speed belongs after acquiring the current head rotation angular speed of the user, queries the mapping relationship between the head rotation speed gear and the picture output speed, obtains the picture output speed adapted to the currently acquired head rotation angular speed of the user, and controls the head-mounted display device to output the picture according to the adjusted picture output speed. Different head slew velocity gears are divided according to the embodiment of the application, and according to different head slew velocity gears, the display device is worn to control and the picture is output according to the picture output speed corresponding to the head slew velocity gears, so that balance is made between the visual experience of a user and the vertigo of the user.
In the above-described embodiment, when the head rotation parameter is excessively large, the screen output speed of the head-mounted display apparatus needs to be reduced. And adjusting the picture output speed of the head-mounted display equipment according to the head rotation parameters of the user.
An optional embodiment is that, if the head rotation angular speed of the user is greater than the set first angular speed threshold, the screen output speed of the head-mounted display device is reduced, and if the head rotation angular speed of the user is less than or equal to the set first angular speed threshold, the screen output speed of the head-mounted display device is not adjusted. In this embodiment, a first angular velocity threshold is set, and only when the head rotation angular velocity of the user is greater than the first angular velocity threshold, the screen output speed of the head-mounted display device is reduced to reduce the vertigo of the user, and when the head rotation angular velocity of the user is less than or equal to the set first angular velocity threshold, the screen output speed of the head-mounted display device is not adjusted, so that the occupancy rate of the internal resources of the CPU is reduced, and the data processing speed is increased. The first angular velocity threshold is not limited in the embodiment of the application, and the user can correspondingly adjust the first angular velocity threshold according to actual conditions.
In the above embodiment, the screen output speed of the head-mounted display device is reduced, and an optional embodiment is to determine that the head rotation angular speed of the user is greater than the first angular speed threshold and less than the set second angular speed threshold, and reduce the screen output speed of the head-mounted display device to the first speed value; if the head rotation angular speed of the user is larger than a second angular speed threshold value, reducing the picture output speed of the head-mounted display equipment to a second speed value; wherein the first angular velocity threshold is less than the second velocity threshold; the first speed value is greater than the second value. The second angular velocity threshold value, the first velocity value and the second velocity value are not limited by the method, and the user can correspondingly adjust the second angular velocity threshold value, the first velocity value and the second velocity value according to actual conditions. The first speed value and the second speed value may be calculated as a percentage of speed reduction output for a normal screen of the head-mounted display device, or may be speed values set in advance for a user. According to the head rotation angular speed of the user, the image output speed of the head-mounted display equipment can be reduced to the first speed value and the second speed value in a grading mode, the image output speed of the head-mounted display equipment can be controlled more accurately, and user experience is improved.
Another optional embodiment is that, it is determined whether the head rotation angular velocity of the user is greater than a set third angular velocity threshold, and whether the head rotation angular acceleration of the user is greater than a set first angular acceleration threshold; if yes, reducing the picture output speed of the head-mounted display device. In this embodiment, the third angular velocity threshold and the first angular acceleration threshold are set, and only when the head rotation angular velocity of the user is greater than the first angular velocity threshold and the head rotation angular acceleration of the user is greater than the first angular acceleration threshold, the screen output speed of the head-mounted display device is reduced, so as to reduce the vertigo of the user, reduce the occupancy rate of internal resources of the CPU, and improve the data processing speed. The third angular velocity threshold and the first angular acceleration threshold are not limited in the embodiment of the application, and the user can correspondingly adjust the third angular velocity threshold and the first angular acceleration threshold according to actual conditions.
In the above embodiment, the image output speed of the head-mounted display device is reduced, and if the head rotation angular speed of the user is greater than the third angular speed threshold and less than the set fourth angular speed threshold, and the head rotation angular acceleration of the user is greater than the set first angular acceleration threshold and less than the set second angular acceleration threshold, the image output speed of the head-mounted display device is reduced to a third speed value; if the head rotation angular speed of the user is greater than the fourth angular speed threshold and the head rotation angular acceleration of the user is greater than a set second angular acceleration threshold, reducing the image output speed of the head-mounted display device to a fourth speed value; wherein the third angular velocity threshold is less than the fourth angular velocity threshold; the first angular acceleration threshold is smaller than the second angular acceleration threshold, and the third speed value is larger than the fourth speed value. The fourth angular velocity threshold and the second angular acceleration threshold are not limited by the method, and the user can correspondingly adjust the fourth angular velocity threshold and the second angular acceleration threshold according to actual conditions. According to the method and the device, the image output speed is controlled through the head rotation angular speed and the head rotation angular acceleration of the user, the image output speed of the head-mounted display device can be reduced to the first speed value and the second speed value in a grading mode, the image output speed of the head-mounted display device is controlled more accurately, and the user experience is improved.
The following describes, with reference to fig. 2, an example of playing a video by a head mounted display device, where a head rotation parameter includes a head rotation angular velocity, and an example of a picture displaying method provided in this embodiment of the present application is described.
The user wears the head-mounted display device, and the user triggers the head-mounted display device to play the video content. Wherein the head mounted display device outputs the video content at a default video output speed. The triggering methods include, but are not limited to, the following:
during the viewing of the video, the user's head may rotate. When the user's head is rotated too fast, a dizziness problem may occur. In order to measure the head rotation parameters of the user, two speed thresholds of 9rad/s and 17rad/s are set in the embodiment.
When the head rotation parameter is less than 9rad/s, the head rotation of the user is normal, and under the condition, the head-mounted display equipment plays at the original normal video output speed;
when the head rotation parameter is more than 9rad/s and less than 17rad/s, the head of the user rotates faster, and under the condition, the head-mounted display device plays at 30% of the video output speed, namely, plays at 70% of the normal video output speed, so that the user can see clear images and the vertigo of the user is reduced;
when the head rotation parameter is larger than 17rad/s, it indicates that the head rotation action of the user is fast, in this case, the head-mounted display device plays at 60% of the slow video output speed, namely, plays at 40% of the normal video output speed.
Wherein, the faster the head movement speed of the user, the less clear the image seen in the movement process, and the video output speed of the screen is reduced to the minimum by the embodiment to reduce the vertigo feeling of the user.
Fig. 3 is a block diagram of a structure of a head-mounted display device according to an exemplary embodiment of the present application, and as shown in fig. 4, the head-mounted display device includes: the device comprises a device body 301, one or more processors 302 arranged on the device body 301, and one or more memories 303 for storing computer programs.
Further, the apparatus body 301 is provided with a gyroscope in addition to one or more processors 302 and one or more memories 303 storing computer programs. Optionally, the head mounted display device may also be provided with some basic components, such as audio components 304, power components 305, communication components, and the like.
The power supply component 305 provides power to the various components of the device in which the power supply component is located. The power components may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device in which the power component is located.
An audio component 304 may be configured to output and/or input audio signals. For example, the audio component includes a Microphone (MIC) configured to receive an external audio signal when the device in which the audio component is located is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in a memory or transmitted via a communication component. In some embodiments, the audio assembly further comprises a speaker for outputting audio signals.
Optionally, the one or more processors 302, the head rotation parameters including head rotation angular velocity and head rotation angular acceleration, acquire the head rotation angular velocity of the user wearing the head mounted display device for: determining a head rotation angular velocity of the user using data collected by a gyroscope of the head mounted display device; acquiring a head rotation angular acceleration of a user wearing the head-mounted display device for: and determining the head rotation angular acceleration of the user by utilizing the data collected by the angular acceleration sensor of the head-mounted display equipment.
Optionally, the one or more processors 302 determine a head rotation angular acceleration of the user according to an angular acceleration of the head-mounted display device, the head rotation parameter includes a head rotation angular velocity, and adjust a screen output speed of the head-mounted display device according to the head rotation parameter of the user, so as to: and judging whether the head rotation angular speed of the user is greater than a set first angular speed threshold value, and if so, reducing the picture output speed of the head-mounted display equipment.
Optionally, one or more processors 302, the reducing the picture output speed of the head mounted display device to: if the head rotation angular speed of the user is greater than the first angular speed threshold and less than a set second angular speed threshold, reducing the image output speed of the head-mounted display device to a first speed value; if the head rotation angular speed of the user is greater than the second angular speed threshold, reducing the image output speed of the head-mounted display device to a second speed value; wherein the first angular velocity threshold is less than the second angular velocity threshold; the first speed value is greater than the second speed value.
Optionally, the one or more processors 302, before reducing the picture output speed of the head mounted display device to the first speed value or the second speed value, may be further configured to: and inquiring the mapping relation between the head rotation speed gear and the picture output speed to obtain the picture output speed matched with the head rotation angular speed of the user, wherein the picture output speed is used as the first speed value or the second speed value.
Optionally, the one or more processors 302, the head rotation parameter includes a head rotation angular velocity and a head rotation angular acceleration, and according to the head rotation parameter of the user, the screen output speed of the head-mounted display device is adjusted to be used for: judging whether the head rotation angular speed of the user is greater than a set third angular speed threshold value or not, and whether the head rotation angular acceleration of the user is greater than a set first angular acceleration threshold value or not; and if so, reducing the picture output speed of the head-mounted display equipment.
Optionally, one or more processors 302, the reducing the picture output speed of the head mounted display device to: if the head rotation angular speed of the user is greater than the third angular speed threshold and less than a set fourth angular speed threshold, and the head rotation angular acceleration of the user is greater than a set first angular acceleration threshold and less than a set second angular acceleration threshold, reducing the image output speed of the head-mounted display device to a third speed value; if the head rotation angular speed of the user is greater than the fourth angular speed threshold value, and the head rotation angular acceleration of the user is greater than a set second angular acceleration threshold value, reducing the picture output speed of the head-mounted display device to a fourth speed value; wherein the third angular velocity threshold is less than the fourth angular velocity threshold; the first angular acceleration threshold is smaller than the second angular acceleration threshold, and the third speed value is larger than the fourth speed value.
In the embodiment of the head-mounted display device, the image output speed of the head-mounted display device is adjusted according to the head rotation parameters of the user, improvement is made from the display end, the dizziness problem of the VR device is reduced, and the user experience is improved.
Correspondingly, the embodiment of the application also provides a computer readable storage medium storing the computer program. The computer-readable storage medium stores a computer program, and the computer program, when executed by one or more processors, causes the one or more processors to perform the steps in the respective method embodiments illustrated in fig. 1.
Some embodiments of the present disclosure provide a head-mounted display device that can be an external head-mounted display device or an integrated head-mounted display device, wherein the external head-mounted display device needs to be used with an external processing system (e.g., a computer processing system).
Fig. 4 is a schematic diagram showing an internal configuration of the head-mounted display device 100 in some embodiments.
The display unit 101 may include a display panel, which is disposed on a side surface of the head-mounted display device 100 facing the face of the user, and may be a single panel, or a left panel and a right panel corresponding to the left eye and the right eye of the user, respectively. The display panel may be an Electroluminescence (EL) element, a liquid crystal display or a micro display having a similar structure, or a laser scanning type display in which the retina can directly display or the like.
The virtual image optical unit 102 captures an image displayed by the display unit 101 in an enlarged manner, and allows the user to observe the displayed image as an enlarged virtual image. As the display image output onto the display unit 101, an image of a virtual scene provided from a content reproduction apparatus (blu-ray disc or DVD player) or a streaming server, or an image of a real scene photographed using the external camera 110 may be possible. In some embodiments, the virtual image optical unit 102 may include a lens unit, such as a spherical lens, an aspherical lens, a fresnel lens, or the like.
The input operation unit 103 includes at least one operation section such as a key, a button, a switch, or other like section having a similar function for performing an input operation, receives a user instruction through the operation section, and outputs the instruction to the control unit 107.
The state information acquisition unit 104 is used to acquire state information of a user wearing the head-mounted display apparatus 100. The state information acquisition unit 104 may include various types of sensors for detecting state information by itself, and may acquire the state information from an external device (e.g., a smartphone, a wristwatch, and other multi-function terminals worn by the user) through the communication unit 105. The state information acquisition unit 104 may acquire position information and/or posture information of the head of the user. The state information acquisition unit 104 may include one or more of a gyro sensor, an acceleration sensor, a Global Positioning System (GPS) sensor, a geomagnetic sensor, a doppler effect sensor, an infrared sensor, and a radio frequency field intensity sensor. Further, the state information acquisition unit 104 acquires state information of the user wearing the head mounted display device 100, for example, acquires, for example, an operation state of the user (whether the user is wearing the head mounted display device 100), an action state of the user (a moving state such as still, walking, running, and the like, a posture of a hand or a fingertip, an open or closed state of an eye, a line of sight direction, a pupil size), a mental state (whether the user is immersed in viewing a displayed image, and the like), and even a physiological state.
The communication unit 105 performs communication processing with an external device, modulation and demodulation processing, and encoding and decoding processing of a communication signal. In addition, the control unit 107 can transmit transmission data from the communication unit 105 to an external device. The communication means may be in a wired or wireless form, such as mobile high definition link (MHL) or Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), wireless fidelity (Wi-Fi), bluetooth communication or bluetooth low energy communication, and mesh network of ieee802.11s standard, etc. Additionally, the communication unit 105 may be a cellular radio transceiver operating in accordance with wideband code division multiple access (W-CDMA), Long Term Evolution (LTE), and similar standards.
In some embodiments, the head mounted display device 100 may further include a storage unit, and the storage unit 106 is a mass storage device configured with a Solid State Drive (SSD) or the like. In some embodiments, the storage unit 106 may store applications or various types of data. For example, content viewed by a user using the head mounted display device 100 may be stored in the storage unit 106.
In some embodiments, the head mounted display device 100 may further include a control unit, and the control unit 107 may include a Computer Processing Unit (CPU) or other device with similar functionality. In some embodiments, the control unit 107 may be used to execute applications stored by the storage unit 106, or the control unit 107 may also be used to execute circuits that perform the methods, functions, and operations disclosed in some embodiments of the present application.
The image processing unit 108 is used to perform signal processing such as image quality correction related to the image signal output from the control unit 107, and to convert the resolution thereof into a resolution according to the screen of the display unit 101. Then, the display driving unit 109 sequentially selects each row of pixels of the display unit 101 and sequentially scans each row of pixels of the display unit 101 row by row, thus providing pixel signals based on the signal-processed image signals.
In some embodiments, head mounted display device 100 may also include an external camera. The external camera 110 may be disposed on a front surface of the body of the head-mounted display device 100, and the external camera 110 may be one or more. The external camera 110 may acquire three-dimensional information and may also function as a distance sensor. Additionally, a Position Sensitive Detector (PSD) or other type of distance sensor that detects reflected signals from objects may be used with the external camera 110. The external camera 110 and distance sensor may be used to detect the body position, pose, and shape of a user wearing the head-mounted display device 100. In addition, the user may directly view or preview the real scene through the external camera 110 under certain conditions.
In some embodiments, the head-mounted display apparatus 100 may further include a sound processing unit, and the sound processing unit 111 may perform sound quality correction or sound amplification of the sound signal output from the control unit 107, signal processing of the input sound signal, and the like. Then, the sound input/output unit 112 outputs sound to the outside after sound processing and inputs sound from a microphone.
It should be noted that the structure or components shown in the dashed box in fig. 1 may be independent from the head-mounted display device 100, and may be disposed in an external processing system (e.g., a computer system) for use with the head-mounted display device 100; alternatively, the structures or components shown in dashed boxes may be disposed within or on the surface of the head mounted display device 100.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage 403, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both permanent and non-permanent, removable and non-removable media, may implement the information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art to which the present application pertains. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (7)
1. A picture display method is suitable for a head-mounted display device, and is characterized by comprising the following steps:
acquiring head rotation parameters of a user wearing the head-mounted display device;
adjusting the image output speed of the head-mounted display equipment according to the head rotation parameters of the user;
the adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user comprises: determining a head rotation speed gear to which the head rotation parameter belongs, and inquiring a mapping relation between the head rotation speed gear and the picture output speed to obtain a picture output speed matched with the currently acquired head rotation speed of the user;
controlling the head-mounted display equipment to output the picture according to the adjusted picture output speed;
wherein the head rotation parameter comprises a head rotation angular velocity;
the adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user comprises: determining a head rotation speed gear to which the head rotation parameter belongs, and inquiring a mapping relation between the head rotation speed gear and the picture output speed to obtain a picture output speed matched with the currently acquired head rotation angular speed of the user, wherein the picture output speed is used as a first speed value or a second speed value;
if the head rotation angular speed of the user is greater than a set first angular speed threshold and less than a set second angular speed threshold, reducing the picture output speed of the head-mounted display device to a first speed value;
if the head rotation angular speed of the user is larger than the second angular speed threshold, reducing the picture output speed of the head-mounted display device to a second speed value;
wherein the first angular velocity threshold is less than the second angular velocity threshold; the first speed value is greater than the second speed value.
2. The method of claim 1, wherein the head rotation parameters further comprise head rotation angular acceleration,
collecting a head rotation angular velocity of a user wearing the head-mounted display device, comprising:
determining a head rotation angular velocity of the user using data collected by a gyroscope of the head mounted display device;
collecting head rotation angular acceleration of a user wearing the head-mounted display device, comprising:
and determining the head rotation angular acceleration of the user by utilizing the data collected by the angular acceleration sensor of the head-mounted display equipment.
3. The method of claim 1, wherein the head rotation parameters comprise a head rotation angular velocity and a head rotation angular acceleration, and wherein adjusting the frame output speed of the head-mounted display device according to the head rotation parameters of the user comprises:
judging whether the head rotation angular speed of the user is greater than a set third angular speed threshold value or not, and whether the head rotation angular acceleration of the user is greater than a set first angular acceleration threshold value or not;
if yes, reducing the picture output speed of the head-mounted display device.
4. The method according to claim 3, wherein the reducing the picture output speed of the head-mounted display device comprises:
if the head rotation angular speed of the user is greater than the third angular speed threshold and less than a set fourth angular speed threshold, and the head rotation angular acceleration of the user is greater than a set first angular acceleration threshold and less than a set second angular acceleration threshold, reducing the image output speed of the head-mounted display device to a third speed value;
if the head rotation angular speed of the user is greater than the fourth angular speed threshold value and the head rotation angular acceleration of the user is greater than a set second angular acceleration threshold value, reducing the image output speed of the head-mounted display device to a fourth speed value;
wherein the third angular velocity threshold is less than the fourth angular velocity threshold; the first angular acceleration threshold is less than the second angular acceleration threshold, and the third velocity value is greater than the fourth velocity value.
5. A head-mounted display device, comprising: the device comprises a device body, one or more processors arranged on the device body, and one or more memories for storing computer programs;
the one or more processors to execute the computer program to:
collecting head rotation parameters of a user wearing the head-mounted display device;
adjusting the picture output speed of the head-mounted display equipment according to the head rotation parameters of the user;
the adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user comprises: determining a head rotation speed gear to which the head rotation parameter belongs, and inquiring a mapping relation between the head rotation speed gear and the picture output speed to obtain a picture output speed matched with the currently acquired head rotation speed of the user; controlling the head-mounted display equipment to output the picture according to the adjusted picture output speed;
wherein the head rotation parameter comprises a head rotation angular velocity;
the adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user comprises: determining a head rotation speed gear to which the head rotation parameter belongs, and inquiring a mapping relation between the head rotation speed gear and the picture output speed to obtain a picture output speed matched with the currently acquired head rotation angular speed of the user as a first speed value or a second speed value;
if the head rotation angular speed of the user is larger than a set first angular speed threshold value and smaller than a set second angular speed threshold value, reducing the picture output speed of the head-mounted display equipment to a first speed value;
if the head rotation angular speed of the user is larger than the second angular speed threshold, reducing the picture output speed of the head-mounted display device to a second speed value;
wherein the first angular velocity threshold is less than the second angular velocity threshold; the first speed value is greater than the second speed value.
6. The head-mounted display device of claim 5, further comprising: the gyroscope acquires the rotation angular velocity of the head-mounted display device, and the angular acceleration sensor acquires the angular acceleration of the head-mounted display device;
the one or more processors to execute the computer program to:
determining a head rotation angular velocity of the user using data collected by a gyroscope of the head mounted display device;
and determining the head rotation angular acceleration of the user by utilizing the data collected by the angular acceleration sensor of the head-mounted display equipment.
7. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by one or more processors, causes the one or more processors to perform acts comprising:
collecting head rotation parameters of a user wearing the head-mounted display equipment;
adjusting the picture output speed of the head-mounted display equipment according to the head rotation parameters of the user;
the adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user comprises: determining a head rotation speed gear to which the head rotation parameter belongs, and inquiring a mapping relation between the head rotation speed gear and the picture output speed to obtain a picture output speed matched with the currently acquired head rotation speed of the user; controlling the head-mounted display equipment to output the picture according to the adjusted picture output speed;
wherein the head rotation parameter comprises a head rotation angular velocity;
the adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user comprises: determining a head rotation speed gear to which the head rotation parameter belongs, and inquiring a mapping relation between the head rotation speed gear and the picture output speed to obtain a picture output speed matched with the currently acquired head rotation angular speed of the user, wherein the picture output speed is used as a first speed value or a second speed value;
if the head rotation angular speed of the user is larger than a set first angular speed threshold value and smaller than a set second angular speed threshold value, reducing the picture output speed of the head-mounted display equipment to a first speed value;
if the head rotation angular speed of the user is larger than the second angular speed threshold, reducing the picture output speed of the head-mounted display device to a second speed value;
wherein the first angular velocity threshold is less than the second angular velocity threshold; the first speed value is greater than the second speed value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811457520.XA CN109696959B (en) | 2018-11-30 | 2018-11-30 | Picture display method, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811457520.XA CN109696959B (en) | 2018-11-30 | 2018-11-30 | Picture display method, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109696959A CN109696959A (en) | 2019-04-30 |
| CN109696959B true CN109696959B (en) | 2022-09-27 |
Family
ID=66230224
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811457520.XA Active CN109696959B (en) | 2018-11-30 | 2018-11-30 | Picture display method, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109696959B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111736708B (en) * | 2020-08-25 | 2020-11-20 | 歌尔光学科技有限公司 | Head-mounted device, picture display system and method thereof, detection system and method thereof |
| CN115150555B (en) * | 2022-07-15 | 2023-12-19 | 北京字跳网络技术有限公司 | Video recording method, device, equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106354256A (en) * | 2016-08-28 | 2017-01-25 | 杭州勺子网络科技有限公司 | Moving control method of virtual reality |
| CN106598252A (en) * | 2016-12-23 | 2017-04-26 | 深圳超多维科技有限公司 | Image display adjustment method and apparatus, storage medium and electronic device |
| CN106990848A (en) * | 2017-04-10 | 2017-07-28 | 河南中医药大学 | A kind of virtual reality anti-dazzle method and system |
| KR101807601B1 (en) * | 2017-07-13 | 2017-12-11 | 주식회사 이모션허브 | System for providing virtual reality contents service applied to attraction of theme park |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9110582B2 (en) * | 2010-11-03 | 2015-08-18 | Samsung Electronics Co., Ltd. | Mobile terminal and screen change control method based on input signals for the same |
-
2018
- 2018-11-30 CN CN201811457520.XA patent/CN109696959B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106354256A (en) * | 2016-08-28 | 2017-01-25 | 杭州勺子网络科技有限公司 | Moving control method of virtual reality |
| CN106598252A (en) * | 2016-12-23 | 2017-04-26 | 深圳超多维科技有限公司 | Image display adjustment method and apparatus, storage medium and electronic device |
| CN106990848A (en) * | 2017-04-10 | 2017-07-28 | 河南中医药大学 | A kind of virtual reality anti-dazzle method and system |
| KR101807601B1 (en) * | 2017-07-13 | 2017-12-11 | 주식회사 이모션허브 | System for providing virtual reality contents service applied to attraction of theme park |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109696959A (en) | 2019-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12105870B2 (en) | Method for controlling display screen according to eye focus and head-mounted electronic device | |
| US11024083B2 (en) | Server, user terminal device, and control method therefor | |
| US10534428B2 (en) | Image processing device and image processing method, display device and display method, and image display system | |
| EP3671408B1 (en) | Virtual reality device and content adjusting method therefor | |
| WO2018223663A1 (en) | Vr image processing method, device, and apparatus | |
| WO2019037365A1 (en) | Virtual reality panoramic video stream projection method and device | |
| CN109002164B (en) | Display method and device of head-mounted display equipment and head-mounted display equipment | |
| WO2019015249A1 (en) | Virtual-reality-based image display method and apparatus, and virtual reality helmet device | |
| WO2019019232A1 (en) | Method for playing video based on vr head-mounted device, and vr head-mounted device | |
| CN109696959B (en) | Picture display method, equipment and storage medium | |
| CN109997171A (en) | Display device and program | |
| WO2018233459A1 (en) | Panoramic image display method and display control method, computing device, and storage medium | |
| JP2015005809A (en) | Information processing device, information processing method, and program | |
| CN107491171A (en) | Virtual reality helmet eyeshield control method and virtual reality helmet | |
| US11113379B2 (en) | Unlocking method and virtual reality device | |
| JP2021180426A (en) | Remote work device and program therefor | |
| CN109327519B (en) | Stream data synchronization method, device, equipment and storage medium | |
| US20210082088A1 (en) | Image processor, imaging processing method, and program | |
| CN107844177A (en) | Device parameter method of adjustment, device and electronic equipment | |
| WO2018214492A1 (en) | Method and apparatus for processing user experience data, electronic device, and computer storage medium | |
| CN107844197A (en) | Virtual reality scenario display methods and equipment | |
| US12019795B2 (en) | Motion blur compensation through eye tracking | |
| CN114374832B (en) | Control method and device for virtual reality experience, user equipment and network equipment | |
| CN107958478B (en) | Rendering method of object in virtual reality scene and virtual reality head-mounted equipment | |
| CN108965859B (en) | Projection mode identification method, video playing method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201030 Address after: 261061 north of Yuqing East Street, east of Dongming Road, Weifang High tech Zone, Weifang City, Shandong Province (Room 502, Geer electronic office building) Applicant after: GoerTek Optical Technology Co.,Ltd. Address before: 266104 Laoshan Qingdao District North House Street investment service center room, Room 308, Shandong Applicant before: GOERTEK TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| CB02 | Change of applicant information |
Address after: 261061 east of Dongming Road, north of Yuqing East Street, high tech Zone, Weifang City, Shandong Province (Room 502, Geer electronics office building) Applicant after: GoerTek Optical Technology Co.,Ltd. Address before: 261061 east of Dongming Road, north of Yuqing East Street, Weifang High tech Zone, Weifang City, Shandong Province (Room 502, Geer electronics office building) Applicant before: GoerTek Optical Technology Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221219 Address after: 266104 No. 500, Songling Road, Laoshan District, Qingdao, Shandong Patentee after: GOERTEK TECHNOLOGY Co.,Ltd. Address before: 261061 east of Dongming Road, north of Yuqing East Street, high tech Zone, Weifang City, Shandong Province (Room 502, Geer electronics office building) Patentee before: GoerTek Optical Technology Co.,Ltd. |
|
| TR01 | Transfer of patent right |