CN109696959B - Picture display method, equipment and storage medium - Google Patents

Abstract

Embodiments of the present application provide a screen display method, device, and storage medium. In some exemplary embodiments of the present application, the head rotation parameters of the user wearing the head-mounted display device are collected; the picture output speed of the head-mounted display device is adjusted according to the head rotation parameters of the user; The head mounted display device outputs a picture according to the adjusted picture output speed. In some exemplary embodiments of the present application, the picture output speed of the head-mounted display device is adjusted according to the user's head rotation parameters, and improvements are made from the display end so that the user's head rotation speed matches the picture output speed, thereby reducing the user's workload. Dizziness when wearing a head-mounted display device, improving user experience.

Description

A screen display method, device and storage medium

technical field

The present application relates to the field of head-mounted smart devices, and in particular, to a screen display method, device and storage medium.

Background technique

Virtual Reality virtual reality technology has shown geometric growth in recent years. Whether it is medical treatment, sports, film and television, live broadcast, or filming, VR is regarded as one of the opportunities for future development, which also leads to the accumulation of current market conditions. The reasons for the outbreak, especially in real estate, games and other fields, are also intensifying. At present, VR virtual reality technology-related VR virtual reality equipment, such as VR smart glasses, VR helmets, VR headsets, etc.

Currently, VR in the market basically has a problem, that is, vertigo will occur, resulting in a poor user experience.

SUMMARY OF THE INVENTION

Various aspects of the present application provide a picture display method, device, and storage medium, so as to reduce the dizziness problem of current VR devices and improve user experience.

An embodiment of the present application provides a screen display method, which is suitable for a head-mounted display device, the method includes: collecting a head rotation parameter of a user wearing the head-mounted display device; The picture output speed of the head mounted display device; the head mounted display device is controlled to output the picture according to the adjusted picture output speed.

Embodiments of the present application further provide a head-mounted display device, including: a device body, one or more processors disposed on the device body, and one or more memories storing computer programs; the one or more processors, is used for executing the computer program, so as to: collect the head rotation parameters of the user wearing the head-mounted display device; adjust the picture output speed of the head-mounted display device according to the head rotation parameters of the user; The head mounted display device is controlled to output a picture according to the adjusted picture output speed.

An embodiment of the present application is a computer-readable storage medium storing a computer program. When the computer program is executed by one or more processors, the one or more processors are caused to perform an action including the following: collecting a wearable location adjusting the head rotation parameters of the user of the head-mounted display device; adjusting the picture output speed of the head-mounted display device according to the user's head rotation parameters; controlling the head-mounted display device to output the output speed according to the adjusted picture output speed screen.

In some exemplary embodiments of the present application, the picture output speed of the head-mounted display device is adjusted according to the user's head rotation parameters, and improvements are made from the display side so that the user's head rotation parameters match the picture output speed, thereby reducing the user's Dizziness when wearing a head-mounted display device, improving user experience.

Description of drawings

The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The schematic embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the attached image:

FIG. 1 is a schematic flowchart of a screen display method provided by an embodiment of the present application;

2 is a schematic diagram of a specific screen display method provided by an embodiment of the present application;

FIG. 3 is a schematic structural diagram of a head-mounted display device according to an exemplary embodiment of the present application;

FIG. 4 is a schematic diagram of an internal configuration structure of a head-mounted display device according to an exemplary embodiment of the present application

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be clearly and completely described below with reference to the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a," "the," and "the" as used in the embodiments of the present invention and the appended claims are intended to include the plural forms as well, unless the context clearly dictates otherwise, "a plurality" Generally, at least two kinds are included, but the case of including at least one kind is not excluded.

Depending on the context, the words "if", "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, the phrases "if determined" or "if detected (the stated condition or event)" can be interpreted as "when determined" or "in response to determining" or "when detected (the stated condition or event)," depending on the context )" or "in response to detection (a stated condition or event)".

It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a commodity or system comprising a list of elements includes not only those elements, but also includes not explicitly listed other elements, or elements inherent to the commodity or system. Without further limitation, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the article or system that includes the element.

In view of the above-mentioned problem of vertigo in existing VR devices, in some exemplary embodiments of the present application, the picture output speed of the head-mounted display device is adjusted according to the user's head rotation parameters, and the display side is improved so that the user's head The rotation parameter matches the screen output speed, thereby reducing the dizziness of the user when wearing the head-mounted display device and improving the user experience.

The technical solutions provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

FIG. 1 is a schematic flowchart of a screen display method provided by an embodiment of the present application. As shown in Figure 1, the method includes:

S101: Collect head rotation parameters of a user wearing a head-mounted display device;

S102: Adjust the picture output speed of the head-mounted display device according to the user's head rotation parameter;

S103: Control the head mounted display device to output a picture according to the adjusted picture output speed.

In this embodiment, the execution subject is a head-mounted display device, such as a VR helmet, VR glasses, AR glasses, and the like. This embodiment of the present application does not limit the type of the head-mounted display device. The picture of the head-mounted display device in the embodiment of the present application may be video or picture content played by the head-mounted display device.

When the user wears the head-mounted display device to watch the playback screen, when the screen and the head rotation speed are not synchronized, the problem of dizziness may be caused. In this embodiment, first, the head rotation of the user wearing the head-mounted display device is collected. Then, according to the user's head rotation parameters, adjust the screen output speed of the head-mounted display device, and make improvements from the display side to make the user's head rotation parameters match the screen output speed. Finally, control the head-mounted display device according to the adjustment. The image output speed after the image is output, so as to reduce the dizziness of the user when wearing the head-mounted display device, and improve the user experience.

In the above embodiment, the head rotation parameter includes the head rotation angular velocity. An optional embodiment of collecting the head rotation angular velocity of the user wearing the head-mounted display device is to use the gyroscope of the head-mounted display device to collect the head-mounted display device. The rotational angular velocity of the device; according to the rotational angular velocity of the head-mounted display device, determine the rotational angular velocity of the user's head. One possible way is to set the gyroscope on the head-mounted display device. After the user wears the head-mounted display device, during the head rotation process, the rotation speed of the head-mounted display device collected by the gyroscope will be displayed on the head-mounted display device. The main control IC of the device obtains the rotation speed through the data bus, and obtains the rotation angular speed of the head-mounted display device after converting the rotation speed into units. In actual situations, the rotational angular velocity of the head-mounted display device is not the same as the rotational angular velocity of the user's head, and the rotational angular velocity of the head-mounted display device will collect different angular velocities according to the different positions of the sensors, which are implemented in this application. In an example, the rotational angular velocity of the head-mounted display device collected by the gyroscope is taken as the rotational angular velocity of the user's head.

In another embodiment, the head rotation parameters include head rotation angular velocity and head rotation angular acceleration, and there are two ways to collect the head rotation angular velocity of the user wearing the head-mounted display device:

In a first way, the rotational angular velocity collected by the gyroscope of the head-mounted display device is used as the rotational angular velocity of the user's head directly.

In a second manner, the gyroscope of the head-mounted display device is used to collect the rotational angular velocity of the head-mounted display device; the rotational angular velocity of the user's head is determined according to the rotational angular velocity of the head-mounted display device. That is, after calculating the rotational angular velocity of the head-mounted display device, the rotational angular velocity of the user's head is obtained.

There are several ways to collect the angular acceleration of the head rotation of the user wearing the head-mounted display device:

Manner 1: The angular acceleration collected by the angular acceleration sensor of the head-mounted display device is used directly as the angular acceleration of the user's head rotation.

Manner 2: Using the angular acceleration of the head-mounted display device collected by the angular acceleration sensor of the head-mounted display device, and determining the rotational angular acceleration of the user's head according to the angular acceleration of the head-mounted display device. That is, the angular acceleration of the user's head rotation is obtained by calculating the angular acceleration of the head-mounted display device.

Method 3: After the user's head rotation angular velocity is obtained by using the rotation angular velocity collected by the gyroscope of the head-mounted display device, the user's head rotation angular acceleration is obtained by calculating the user's head rotation angular velocity.

In the above embodiment, a possible way to obtain the rotational angular velocity and angular acceleration of the head-mounted display device is to set a gyroscope and an angular acceleration sensor on the head-mounted display device, and the user wears the head-mounted display device after wearing the head-mounted display device. , During the head rotation process, the rotation speed of the head-mounted display device collected by the gyroscope, the main control IC of the head-mounted display device obtains the rotation speed through the data bus, and converts the rotation speed to the unit to obtain the head-mounted display device. Rotational angular velocity, similarly to obtain the angular acceleration of the head-mounted display device. In the embodiment of the present application, the rotational angular velocity of the head-mounted display device collected by the gyroscope is taken as the angular velocity of the user's head rotation, and the angular acceleration collected by the angular acceleration sensor is taken as the angular acceleration of the user's head rotation.

In the above embodiment, the user presets the mapping relationship between the head rotation speed gear and the screen output speed in advance, and after collecting the user's current head rotation angular velocity, the head rotation speed gear to which the head rotation speed belongs is determined , query the mapping relationship between the head rotation speed gear and the screen output speed, obtain the screen output speed suitable for the currently collected user's head rotation angular speed, and control the head-mounted display device to output the screen according to the adjusted screen output speed. In the embodiment of the present application, different head rotation speed gears are divided, and according to different head rotation speed gears, the head-mounted display device is controlled to output the picture according to the picture output speed corresponding to the head rotation speed gear. Balance between the user's sense of vertigo.

In the above embodiment, when the head rotation parameter is too large, the picture output speed of the head mounted display device needs to be reduced. Adjust the screen output speed of the head-mounted display device according to the user's head rotation parameters.

An optional embodiment is that if the angular velocity of the user's head rotation is greater than the set first angular velocity threshold, the screen output speed of the head-mounted display device is reduced, and if the angular velocity of the user's head rotation is less than or equal to the set first angular velocity threshold , the picture output speed of the head-mounted display device will not be adjusted. In this embodiment, the first angular velocity threshold is set, and only when the angular velocity of the user's head turning is greater than the first angular velocity threshold, the screen output speed of the head-mounted display device is reduced to reduce the user's dizziness. When the angular velocity of the head rotation is less than or equal to the set first angular velocity threshold, the picture output speed of the head-mounted display device is not adjusted, which reduces the occupancy rate of internal CPU resources and improves the data processing speed. The embodiment of the present application does not limit the first angular velocity threshold, and the user can adjust the first angular velocity threshold according to the actual situation.

In the above embodiment, the picture output speed of the head-mounted display device is reduced. The screen output speed of the device is reduced to the first speed value; if the user's head rotation angular velocity is greater than the second angular velocity threshold, the screen output speed of the head-mounted display device is reduced to the second speed value; wherein, the first angular velocity threshold is smaller than the second angular velocity threshold Speed threshold; the first speed value is greater than the second value. The application does not limit the second angular velocity threshold, the first velocity value and the second velocity value, and the user can make corresponding adjustments to the second angular velocity threshold, the first velocity value and the second velocity value according to the actual situation. The first speed value and the second speed value may be calculated from the percentage reduction of the normal image output speed of the head-mounted display device, or may be speed values set in advance by the user. According to the angular speed of the user's head rotation, the picture output speed of the head-mounted display device can be graded down to the first speed value and the second speed value. experience.

Another optional embodiment is to determine whether the rotational angular velocity of the user's head is greater than the set third angular velocity threshold, and whether the angular acceleration of the user's head is greater than the set first angular acceleration threshold; if yes , reducing the picture output speed of the head-mounted display device. In this embodiment, the third angular velocity threshold and the first angular acceleration threshold are set, and only when the user's head turning angular velocity is greater than the first angular velocity threshold and the user's head turning angular acceleration is greater than the first angular acceleration threshold, the To reduce the screen output speed of the head-mounted display device, to reduce the user's dizziness, reduce the CPU internal resource occupancy rate, and improve the data processing speed. The third angular velocity threshold and the first angular acceleration threshold are not limited in the embodiment of the present application, and the user can adjust the third angular velocity threshold and the first angular acceleration threshold according to the actual situation.

In the above-mentioned embodiment, the picture output speed of the head-mounted display device is reduced, if the rotational angular velocity of the user's head is greater than the third angular velocity threshold and less than the set fourth angular velocity threshold, and the user's head turns The rotation angular acceleration is greater than the set first angular acceleration threshold and less than the set second angular acceleration threshold, and the screen output speed of the head-mounted display device is reduced to the third speed value; if the user's head rotation angular velocity is greater than the fourth angular velocity threshold, and the rotational angular acceleration of the user's head is greater than the set second angular acceleration threshold, the screen output speed of the head-mounted display device is reduced to the fourth speed value; wherein, The third angular velocity threshold is smaller than the fourth angular velocity threshold; the first angular acceleration threshold is smaller than the second angular acceleration threshold, and the third velocity value is greater than the fourth velocity value. This application does not limit the fourth angular velocity threshold and the second angular acceleration threshold, and the user can make corresponding adjustments to the fourth angular velocity threshold and the second angular acceleration threshold according to the actual situation. The present application controls the screen output speed through the user's head rotation angular velocity and head rotation angular acceleration at the same time. The screen output speed is more precisely controlled and the user experience is improved.

In the following, with reference to FIG. 2 , taking the head-mounted display device playing a video as an example, and taking the head rotation parameter including the head rotation angular velocity as an example, the screen display method provided by the embodiment of the present application will be exemplarily described.

The user wears the head-mounted display device, and the user triggers the head-mounted display device to play video content. The head-mounted display device outputs video content according to the default video output speed. Trigger methods include but are not limited to the following:

While watching the video, the user's head will turn. When the user's head turns too fast, vertigo problems can occur. In order to measure the user's head rotation parameter, two speed thresholds of 9rad/s and 17rad/s are set in this embodiment.

When the head rotation parameter is less than 9rad/s, it means that the user's head rotates normally. In this case, the head-mounted display device plays at the original normal video output speed;

When the head rotation parameter is greater than 9rad/s and less than 17rad/s, it means that the user's head rotates quickly. In this case, the head-mounted display device will play at 30% of the video output speed, that is, according to the normal video output speed. 70% playback, so that users can see clear images and reduce users' dizziness;

When the head rotation parameter is greater than 17rad/s, it means that the user's head rotation is very fast. In this case, the head-mounted display device plays at 60% of the video output speed, that is, at 40% of the normal video output speed.

The faster the user's head moves, the less clear the image seen during the movement. In this embodiment, the video output speed of the screen is reduced to the lowest level to reduce the dizziness of the user.

FIG. 3 is a structural block diagram of a head-mounted display device according to an exemplary embodiment of the present application. As shown in FIG. 4 , the head-mounted display device includes: a device body 301 and one or more processors disposed on the device body 301 302, and one or more memories 303 that store computer programs.

In addition, in addition to one or more processors 302 and one or more memories 303 storing computer programs, the device body 301 is also provided with a gyroscope. Optionally, the head-mounted display device may also be provided with some basic components, for example, an audio component 304, a power supply component 305, a communication component, and the like.

The power supply assembly 305 provides power for various components of the device where the power supply assembly is located. A power supply assembly may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the equipment in which the power supply assembly is located.

Audio component 304, which may be configured to output and/or input audio signals. For example, the audio component includes a microphone (MIC) that is configured to receive external audio signals when the device in which the audio component is located is in operating modes, such as call mode, recording mode, and speech recognition mode. The received audio signal may be further stored in memory or transmitted via the communication component. In some embodiments, the audio assembly further includes a speaker for outputting audio signals.

For example, the processor 302 stores a computer program in one or more memories 303, and the one or more processors 302 can execute the computer program, which can be used to: collect the head rotation parameters of the user wearing the head-mounted display device; Rotate the parameters to adjust the picture output speed of the head-mounted display device; control the head-mounted display device to output the picture according to the adjusted picture output speed.

Optionally, the one or more processors 302, the head rotation parameters include head rotation angular velocity and head rotation angular acceleration, collect the head rotation angular velocity of the user wearing the head-mounted display device, so as to: Using the data collected by the gyroscope of the head-mounted display device to determine the angular velocity of the head rotation of the user; and collecting the angular acceleration of the head of the user wearing the head-mounted display device, for: using the head-mounted display device The data collected by the angular acceleration sensor of the device determines the rotational angular acceleration of the user's head.

Optionally, one or more processors 302 determine the angular acceleration of the user's head rotation according to the angular acceleration of the head-mounted display device, and the head rotation parameter includes a head rotation angular velocity, according to the user's angular acceleration. The head rotation parameter of the head-mounted display device is adjusted to adjust the picture output speed of the head-mounted display device, so as to: determine whether the head rotation angular velocity of the user is greater than the set first angular velocity threshold, and if so, reduce the head-mounted display device. The screen output speed of the device.

Optionally, the one or more processors 302 reduce the picture output speed of the head-mounted display device, so as to be used for: if the angular velocity of the head rotation of the user is greater than the first angular velocity threshold and less than a set value If the angular velocity of the head-mounted display device is greater than the second angular velocity threshold, the picture output speed of the head-mounted display device is reduced to the first speed value; if the angular velocity of the user's head rotation is greater than the second angular velocity threshold The output velocity is reduced to a second velocity value; wherein the first angular velocity threshold is less than the second angular velocity threshold; and the first velocity value is greater than the second velocity value.

Optionally, before reducing the picture output speed of the head-mounted display device to the first speed value or the second speed value, one or more processors 302 may be further configured to: query the head rotation speed gear and the picture The mapping relationship of the output speed is used to obtain a picture output speed adapted to the angular speed of the user's head rotation as the first speed value or the second speed value.

Optionally, one or more processors 302, the head rotation parameters include head rotation angular velocity and head rotation angular acceleration, and adjust the screen output of the head-mounted display device according to the user's head rotation parameters. to determine whether the user's head turning angular velocity is greater than the set third angular velocity threshold, and whether the user's head turning angular acceleration is greater than the set first angular acceleration threshold; if so, reduce all The picture output speed of the head-mounted display device.

Optionally, the one or more processors 302 reduce the picture output speed of the head-mounted display device, so as to be used for: if the angular velocity of the head rotation of the user is greater than the third angular velocity threshold and less than a set value and the angular acceleration of the head rotation of the user is greater than the set first angular acceleration threshold and less than the set second angular acceleration threshold, the screen output speed of the head-mounted display device is reduced to The third velocity value; if the angular velocity of the user's head rotation is greater than the fourth angular velocity threshold, and the angular acceleration of the user's head rotation is greater than the set second angular acceleration threshold, the headset will display the The screen output speed of the device is reduced to a fourth speed value; wherein, the third angular velocity threshold is smaller than the fourth angular velocity threshold; the first angular acceleration threshold is smaller than the second angular acceleration threshold, and the third velocity value is greater than the fourth speed value.

In the embodiment of the head-mounted display device of the present application, the screen output speed of the head-mounted display device is adjusted according to the user's head rotation parameters, and improvements are made from the display side to reduce the dizziness problem of the VR device and improve the user experience.

Correspondingly, the embodiments of the present application further provide a computer-readable storage medium storing a computer program. When the computer-readable storage medium stores a computer program, and the computer program is executed by one or more processors, the one or more processors are caused to execute each step in the corresponding method embodiment shown in FIG. 1 .

The head-mounted display device provided by some embodiments of the present application may be an external head-mounted display device or an integrated head-mounted display device, wherein the external head-mounted display device needs to cooperate with an external processing system (eg, a computer processing system).

FIG. 4 shows a schematic diagram of the internal configuration structure of the head-mounted display device 100 in some embodiments.

The display unit 101 may include a display panel disposed on the side surface of the head-mounted display device 100 facing the user's face, which may be a whole panel, or a left panel and a right panel corresponding to the user's left and right eyes, respectively. The display panel may be an electroluminescent (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a retinal direct display or similar laser scanning type display.

The virtual image optical unit 102 captures the image displayed by the display unit 101 in an enlarged manner, and allows the user to observe the displayed image as the enlarged virtual image. As the display image output on the display unit 101 , it may be an image of a virtual scene provided from a content reproduction device (Blu-ray disc or DVD player) or a streaming server, or an image of a real scene captured using the external camera 110 . In some embodiments, the virtual image optical unit 102 may include a lens unit, such as a spherical lens, an aspherical lens, a Fresnel lens, and the like.

The input operation unit 103 includes at least one operation component for performing input operation, such as keys, buttons, switches or other components with similar functions, receives user instructions through the operation component, and outputs the instructions to the control unit 107 .

The state information obtaining unit 104 is configured to obtain state information of a user wearing the head-mounted display device 100 . The status information acquisition unit 104 may include various types of sensors for detecting status information by itself, and may acquire status information from external devices (eg, smart phones, wrist watches, and other multifunctional terminals worn by users) through the communication unit 105 . The state information acquisition unit 104 may acquire position information and/or posture information of the user's head. The state information acquisition unit 104 may include one or more of a gyroscope sensor, an acceleration sensor, a global positioning system (GPS) sensor, a geomagnetic sensor, a Doppler effect sensor, an infrared sensor, and a radio frequency field strength sensor. In addition, the state information acquisition unit 104 acquires state information of the user wearing the head-mounted display device 100, for example, acquires, for example, the user's operation state (whether the user is wearing the head-mounted display device 100), the user's action state (such as stationary, walking, running and the like, the posture of the hand or fingertips, the open or closed state of the eyes, the direction of the gaze, the pupil size), the mental state (whether the user is immersed in looking at the displayed image and whatnot), and even the physiological state.

The communication unit 105 performs communication processing with external devices, modulation and demodulation processing, and encoding and decoding processing of communication signals. In addition, the control unit 107 can transmit transmission data from the communication unit 105 to an external device. The communication method can be wired or wireless, such as Mobile High Definition Link (MHL) or Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), Wireless Fidelity (Wi-Fi), Bluetooth communication or Bluetooth Low Energy communication, And IEEE802.11s standard mesh network and so on. Additionally, the communication unit 105 may be a cellular wireless transceiver operating in accordance with Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and similar standards.

In some embodiments, the head mounted display device 100 may also include a storage unit, the storage unit 106 being a mass storage device configured with a solid state drive (SSD) or the like. In some embodiments, the storage unit 106 may store application programs or various types of data. For example, content viewed by the user using the head mounted display device 100 may be stored in the storage unit 106 .

In some embodiments, the head mounted display device 100 may further include a control unit, and the control unit 107 may include a computer processing unit (CPU) or other devices with similar functions. In some embodiments, the control unit 107 may be used to execute the application program stored in the storage unit 106, or the control unit 107 may also be used to execute the methods, functions and circuits of the operations disclosed in some embodiments of the present application.

The image processing unit 108 is used to perform signal processing such as image quality correction related to the image signal output from the control unit 107 and to convert its resolution into a resolution according to the screen of the display unit 101 . Then, the display driving unit 109 sequentially selects each row of pixels of the display unit 101 and sequentially scans each row of pixels of the display unit 101 row by row, thereby providing pixel signals based on the signal-processed image signals.

In some embodiments, the head mounted display device 100 may also include an external camera. The external camera 110 may be disposed on the front surface of the main body of the head-mounted display device 100 , and there may be one or more external cameras 110 . The external camera 110 can acquire three-dimensional information, and can also function as a distance sensor. Additionally, a position sensitive detector (PSD) or other type of distance sensor that detects reflected signals from objects may be used with the external camera 110 . The external camera 110 and the distance sensor may be used to detect the body position, posture and shape of the user wearing the head mounted display device 100 . In addition, under certain conditions, the user can directly watch or preview the real scene through the external camera 110 .

In some embodiments, the head mounted display device 100 may further include a sound processing unit, and the sound processing unit 111 may perform sound quality correction or sound amplification of the sound signal output from the control unit 107, signal processing of the input sound signal, and the like. Then, the sound input/output unit 112 outputs the sound to the outside and inputs the sound from the microphone after the sound processing.

It should be noted that the structures or components shown by the dotted box in FIG. 1 may be independent of the head-mounted display device 100, for example, may be set in an external processing system (such as a computer system) to be used in conjunction with the head-mounted display device 100; or , the structures or components shown by the dotted box may be disposed inside or on the surface of the head-mounted display device 100 .

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied therein, including but not limited to disk storage 403, CD-ROM, optical storage, and the like.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or which are inherent to such a process, method, article of manufacture, or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture, or device that includes the element.

The above descriptions are merely examples of the present application, and are not intended to limit the present application. Various modifications and variations of this application are possible for those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the scope of the claims of this application.

Claims (7)

1. A screen display method, suitable for a head-mounted display device, wherein the method comprises: collecting head rotation parameters of the user wearing the head-mounted display device; adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user; The adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user includes: determining the head rotation speed gear to which the head rotation parameter belongs, and querying the head rotation speed gear and the picture. The mapping relationship of the output speed is obtained to obtain the screen output speed adapted to the currently collected user's head rotation speed; controlling the head-mounted display device to output a picture according to the adjusted picture output speed; Wherein, the head rotation parameter includes the head rotation angular velocity; The adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user includes: determining the head rotation speed gear to which the head rotation parameter belongs, and querying the head rotation speed gear and the picture. The mapping relationship of the output speed, so as to obtain the screen output speed adapted to the currently collected angular speed of the user's head rotation, as the first speed value or the second speed value; If the rotational angular velocity of the user's head is greater than the set first angular velocity threshold and less than the set second angular velocity threshold, reducing the screen output speed of the head-mounted display device to the first speed value; If the rotational angular velocity of the user's head is greater than the second angular velocity threshold, reducing the image output speed of the head-mounted display device to a second velocity value; Wherein, the first angular velocity threshold is smaller than the second angular velocity threshold; the first velocity value is greater than the second velocity value. 2. The method according to claim 1, wherein the head rotation parameter further comprises head rotation angular acceleration, Collecting the head rotation angular velocity of the user wearing the head-mounted display device, including: Determine the angular velocity of the head rotation of the user by using the data collected by the gyroscope of the head-mounted display device; Collecting the head rotation angular acceleration of the user wearing the head-mounted display device, including: The angular acceleration of the user's head rotation is determined by using the data collected by the angular acceleration sensor of the head-mounted display device. 3. The method according to claim 1, wherein the head rotation parameters include head rotation angular velocity and head rotation angular acceleration, and the head-mounted display device is adjusted according to the user's head rotation parameters screen output speed, including: Determine whether the user's head turning angular velocity is greater than the set third angular velocity threshold, and whether the user's head turning angular acceleration is greater than the set first angular acceleration threshold; If so, reduce the picture output speed of the head-mounted display device. 4. The method according to claim 3, wherein the reducing the picture output speed of the head-mounted display device comprises: If the user's head turning angular velocity is greater than the third angular velocity threshold and less than the set fourth angular velocity threshold, and the user's head turning angular acceleration is greater than the set first angular acceleration threshold and less than the set the second angular acceleration threshold, reducing the picture output speed of the head-mounted display device to a third speed value; If the rotation angular velocity of the user's head is greater than the fourth angular velocity threshold, and the angular acceleration of the user's head rotation is greater than the set second angular acceleration threshold, reduce the screen output speed of the head-mounted display device to the fourth speed value; Wherein, the third angular velocity threshold is smaller than the fourth angular velocity threshold; the first angular acceleration threshold is smaller than the second angular acceleration threshold, and the third velocity value is greater than the fourth velocity value. 5. A head-mounted display device, comprising: a device body, one or more processors arranged on the device body, and one or more memories for storing computer programs; the one or more processors for executing the computer program for: collecting head rotation parameters of the user wearing the head-mounted display device; adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user; The adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user includes: determining the head rotation speed gear to which the head rotation parameter belongs, and querying the head rotation speed gear and the picture. The mapping relationship of the output speed is to obtain a picture output speed adapted to the currently collected user's head rotation speed; the head-mounted display device is controlled to output the picture according to the adjusted picture output speed; Wherein, the head rotation parameter includes the head rotation angular velocity; The adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user includes: determining the head rotation speed gear to which the head rotation parameter belongs, and querying the head rotation speed gear and the picture. The mapping relationship of the output speed, so as to obtain the screen output speed adapted to the currently collected angular speed of the user's head rotation, as the first speed value or the second speed value; If the rotational angular velocity of the user's head is greater than the set first angular velocity threshold and less than the set second angular velocity threshold, reducing the screen output speed of the head-mounted display device to the first speed value; If the rotational angular velocity of the user's head is greater than the second angular velocity threshold, reducing the image output speed of the head-mounted display device to a second velocity value; Wherein, the first angular velocity threshold is smaller than the second angular velocity threshold; the first velocity value is greater than the second velocity value. 6 . The head-mounted display device according to claim 5 , further comprising: a gyroscope and an angular acceleration sensor, wherein the gyroscope collects the rotational angular velocity of the head-mounted display device, and the angular acceleration sensor collects the angular acceleration of the head-mounted display device. 7 . the angular acceleration of the head-mounted display device; the one or more processors for executing the computer program for: Determine the angular velocity of the head rotation of the user by using the data collected by the gyroscope of the head-mounted display device; The angular acceleration of the user's head rotation is determined by using the data collected by the angular acceleration sensor of the head-mounted display device. 7. A computer-readable storage medium storing a computer program, wherein, when the computer program is executed by one or more processors, the one or more processors are caused to perform the following actions: Collect the head rotation parameters of the user wearing the head-mounted display device; adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user; The adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user includes: determining the head rotation speed gear to which the head rotation parameter belongs, and querying the head rotation speed gear and the picture. The mapping relationship of the output speed is to obtain a picture output speed adapted to the currently collected user's head rotation speed; the head-mounted display device is controlled to output the picture according to the adjusted picture output speed; Wherein, the head rotation parameter includes the head rotation angular velocity; The adjusting the picture output speed of the head-mounted display device according to the head rotation parameter of the user includes: determining the head rotation speed gear to which the head rotation parameter belongs, and querying the head rotation speed gear and the picture. The mapping relationship of the output speed, so as to obtain the screen output speed adapted to the currently collected angular speed of the user's head rotation, as the first speed value or the second speed value; If the rotational angular velocity of the user's head is greater than the set first angular velocity threshold and less than the set second angular velocity threshold, reducing the screen output speed of the head-mounted display device to the first speed value; If the rotational angular velocity of the user's head is greater than the second angular velocity threshold, reducing the image output speed of the head-mounted display device to a second velocity value; Wherein, the first angular velocity threshold is smaller than the second angular velocity threshold; the first velocity value is greater than the second velocity value.

Images