CN111679739A - Readable storage medium, virtual reality device and control method and control device thereof - Google Patents

Readable storage medium, virtual reality device and control method and control device thereof Download PDF

Info

Publication number
CN111679739A
CN111679739A CN202010498696.0A CN202010498696A CN111679739A CN 111679739 A CN111679739 A CN 111679739A CN 202010498696 A CN202010498696 A CN 202010498696A CN 111679739 A CN111679739 A CN 111679739A
Authority
CN
China
Prior art keywords
processing unit
virtual reality
unit
frame rate
current frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010498696.0A
Other languages
Chinese (zh)
Other versions
CN111679739B (en
Inventor
李茜
彭金豹
王龙辉
刘梓荷
苗京花
王雪丰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Beijing BOE Optoelectronics Technology Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Beijing BOE Optoelectronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd, Beijing BOE Optoelectronics Technology Co Ltd filed Critical BOE Technology Group Co Ltd
Priority to CN202010498696.0A priority Critical patent/CN111679739B/en
Publication of CN111679739A publication Critical patent/CN111679739A/en
Application granted granted Critical
Publication of CN111679739B publication Critical patent/CN111679739B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H5/00Exercisers for the eyes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3055Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3058Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Quality & Reliability (AREA)
  • Epidemiology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Pain & Pain Management (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Rehabilitation Therapy (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The disclosure relates to a readable storage medium, a virtual reality device, a control method and a control device thereof, and relates to the technical field of virtual reality. The virtual reality equipment comprises a processing unit and a fan unit, wherein the processing unit comprises a graphic processing unit; the control method comprises the following steps: determining a current frame rate according to the running time of a current frame of the target video; acquiring the temperature of a processing unit, the rotating speed of a fan unit, the processing frequency of a graphic processing unit and the position of virtual reality equipment; when the current frame rate is less than the target frame rate, executing a frame rate adjusting step; the frame rate adjusting step comprises: if the temperature of the processing unit is not less than the temperature threshold, the rotating speed of the fan unit is not less than the rotating speed threshold, and the processing frequency of the graphic processing unit is not less than the frequency threshold, determining the displacement of the position of the virtual reality device when the current frame is operated and the position of the virtual reality device when the previous frame is operated; and if the displacement is smaller than the displacement threshold, taking the image of the current frame as the image of the next frame.

Description

Readable storage medium, virtual reality device and control method and control device thereof
Technical Field
The present disclosure relates to the field of virtual reality technologies, and in particular, to a readable storage medium, a virtual reality device, a control method of a virtual reality device, and a control apparatus of a virtual reality device.
Background
At present, Virtual Reality (VR) technology is widely used in the fields of video entertainment, medical treatment, and the like, for example, a myopia training instrument can use Virtual display technology to realize the auxiliary treatment of myopia through the adjustment of the image distance of images. However, when playing video, unsmooth phenomena such as stuttering often occur, which affects the display effect.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The disclosure aims to provide a readable storage medium, a virtual reality device, a control method of the virtual reality device and a control device of the virtual reality device, which can improve the fluency of videos.
According to an aspect of the present disclosure, there is provided a method of controlling a virtual reality device, the virtual reality device including a processing unit and a fan unit, the processing unit including a graphics processing unit; the control method comprises the following steps:
determining a current frame rate according to the running time of a current frame of the target video;
acquiring the temperature of the processing unit, the rotating speed of the fan unit, the processing frequency of the graphic processing unit and the position of the virtual reality device;
when the current frame rate is less than the target frame rate, executing a frame rate adjusting step;
the frame rate adjusting step comprises: if the temperature of the processing unit is not less than the temperature threshold, the rotating speed of the fan unit is not less than the rotating speed threshold, and the processing frequency of the graphic processing unit is not less than the frequency threshold, determining the displacement of the position of the virtual reality device when the virtual reality device runs in the current frame and the position of the virtual reality device when the virtual reality device runs in the previous frame; and if the displacement is smaller than the displacement threshold value, taking the image of the current frame as the image of the next frame.
In an exemplary embodiment of the present disclosure, the frame rate adjusting step further includes:
and if the displacement is not smaller than the displacement threshold, determining the rendering resolution of the next frame according to the rendering resolution of the current frame, wherein the rendering resolution of the next frame is smaller than that of the current frame.
In an exemplary embodiment of the present disclosure, the frame rate adjusting step further includes:
and if the temperature of the processing unit is not less than the temperature threshold value and the rotating speed of the fan unit is less than the rotating speed threshold value, increasing the rotating speed of the fan unit.
In an exemplary embodiment of the present disclosure, the number of the fan units is plural; increasing the rotational speed of the fan unit, comprising:
increasing the rotational speed of at least one of the fan units having a rotational speed less than the rotational speed threshold.
In an exemplary embodiment of the present disclosure, the frame rate adjusting step further includes:
if the temperature of the processing unit is greater than the temperature threshold, the rotating speed of the fan unit is not less than the rotating speed threshold, and the processing frequency of the graphics processing unit is less than the frequency threshold, the processing frequency of the graphics processing unit is increased.
In an exemplary embodiment of the present disclosure, determining a current frame rate according to a running time of a current frame of a target video includes:
detecting the running duration of the current frame;
and dividing one second by the running duration of the current frame to obtain the current frame rate.
In an exemplary embodiment of the present disclosure, the target frame rate is 75fps or 90 fps.
According to an aspect of the present disclosure, there is provided a control apparatus of a virtual reality device, the virtual reality device including a processing unit and a fan unit, the processing unit including a graphics processing unit; the control device includes:
the frame rate detection unit is used for determining the current frame rate according to the running time of the current frame of the target video;
the execution unit is used for acquiring the temperature of the processing unit, the rotating speed of the fan unit, the processing frequency of the graphic processing unit and the position of the virtual reality equipment in real time; and, when the current frame rate is less than the target frame rate, performing a frame rate adjustment step; the frame rate adjusting step comprises: if the temperature of the processing unit is not less than the temperature threshold, the rotating speed of the fan unit is not less than the rotating speed threshold, and the processing frequency of the graphic processing unit is not less than the frequency threshold, determining the displacement of the position of the virtual reality device when the virtual reality device runs in the current frame and the position of the virtual reality device when the virtual reality device runs in the previous frame; and if the displacement is smaller than the displacement threshold value, taking the image of the current frame as the image of the next frame.
According to an aspect of the present disclosure, a virtual reality device is provided, which includes a processing unit, a fan unit, a temperature detecting unit, a rotation speed detecting unit, a position sensing unit, and any one of the above control devices, wherein the processing unit includes a graphic processing unit, the temperature detecting unit is configured to detect a temperature of the processing unit, the rotation speed detecting unit is configured to detect a rotation speed of the fan unit, the frequency detecting unit is configured to detect a processing frequency of the graphic processing unit, and the position sensing unit is configured to sense a position of the virtual reality device.
According to an aspect of the present disclosure, there is provided a readable storage medium having stored thereon a computer program which, when executed, implements the control method of any one of the above.
The readable storage medium, the virtual reality device, the control method and the control device of the virtual reality device can improve the frame rate and improve the fluency of videos. Specifically, if the temperature of the processing unit is not less than the temperature threshold, the rotation speed of the fan unit is not less than the rotation speed threshold, and the processing frequency of the graphics processing unit is not less than the frequency threshold, which indicates that it is difficult to increase the frame rate by lowering the temperature and increasing the processing frequency of the graphics processing unit, at this time, the displacement amount of the virtual reality device at the position of the previous frame and the current frame can be determined, and if the displacement amount is less than the displacement threshold, it indicates that the position of the virtual reality device does not change much, i.e., the user's head does not move significantly, so that the frame does not need to change significantly.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
Fig. 1 is a flowchart of an embodiment of a control method of the present disclosure.
Fig. 2 is a schematic diagram of an embodiment of the control method of the present disclosure.
Fig. 3 is a block diagram of an embodiment of a control apparatus according to the present disclosure.
Fig. 4 is a block diagram of an embodiment of a virtual reality device according to the present disclosure.
FIG. 5 is a schematic diagram of an embodiment of a storage medium readable by the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and the like. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The terms "a," "an," "the," and "said" are used to indicate the presence of one or more elements/components/etc.; the terms "comprising" and "having" are intended to be inclusive and mean that there may be additional elements/components/etc. other than the listed elements/components/etc.
The disclosed embodiment provides a control method of a virtual reality device, as shown in fig. 4, the virtual reality device may be a helmet-type, glasses-type or other wearable structure, and may include a processing unit 1 and a fan unit 2, the processing unit 1 includes a graphics processing unit 11, and the graphics processing unit 11 is configured to construct and render input image information to output image data. The fan unit 2 has a fan, and heat dissipation is achieved by rotation of the fan. Meanwhile, the virtual reality apparatus may further include a display unit 3 and a lens unit 4, the display unit 3 being configured to receive image data output from the display graphic processing unit 11 to display an image. Lens unit 4 can set up with display element 3 relatively, and after the user wore, lens unit 4 was located between display element 3 and the user's eyes for see through the light that display element 3 sent, and form the virtual image that can supply the user's eyes to watch. The basic principles of virtual reality display will not be described in detail herein.
As shown in fig. 1, the control method of the embodiment of the present disclosure includes steps S110 to S130, in which:
step S110, determining the current frame rate according to the running time of the current frame of the target video.
And step S120, acquiring the temperature of the processing unit, the rotating speed of the fan unit, the processing frequency of the graphic processing unit and the position of the virtual reality device.
Step S130, when the current frame rate is less than the target frame rate, executing a frame rate adjusting step; the frame rate adjusting step comprises: if the temperature of the processing unit is not less than the temperature threshold, the rotating speed of the fan unit is not less than the rotating speed threshold, and the processing frequency of the graphic processing unit is not less than the frequency threshold, determining the displacement of the position of the virtual reality device when the virtual reality device runs in the current frame and the position of the virtual reality device when the virtual reality device runs in the previous frame; and if the displacement is not larger than the displacement threshold, taking the image of the current frame as the image of the next frame.
The control method of the embodiment of the disclosure can improve the frame rate and improve the fluency of the video. Specifically, if the temperature of the processing unit is not less than the temperature threshold, the rotation speed of the fan unit is not less than the rotation speed threshold, and the processing frequency of the graphics processing unit is not less than the frequency threshold, which indicates that it is difficult to increase the frame rate by lowering the temperature and increasing the processing frequency of the graphics processing unit 11, at this time, the displacement amount of the virtual reality device at the position of the previous frame and the current frame can be determined, and if the displacement amount is less than the displacement threshold, it indicates that the position of the virtual reality device does not change much, that is, the user head does not move significantly, so that the frame does not need to change significantly.
The following describes the control method of the embodiment of the present disclosure in detail:
in step S110, a current frame rate is determined according to a running time of a current frame of the target video.
The target video may be a video displayed on the display unit 3 after the virtual reality device runs the application program, that is, a video displayed according to the image data output by the graphics processing unit 11, and the specific content thereof is not particularly limited herein.
In some embodiments of the present disclosure, the current frame rate may be a quotient of 1 second divided by the operation duration of the current frame, for example, the operation duration of the current frame is 0.013 second, and the current frame rate is about 76 fps. Determining the current frame rate according to the running time of the current frame of the target video, i.e. step S110, may include step S1110 and step S1120, where:
step S1110, detecting the operation duration of the current frame.
Step S1120, dividing one second by the running duration of the current frame to obtain the current frame rate.
In step S120, the temperature of the processing unit, the rotation speed of the fan unit, the processing frequency of the graphic processing unit, and the position of the virtual reality device are acquired.
As shown in fig. 4, the virtual reality apparatus may further include a temperature detection unit 5, a rotation speed detection unit 6, a frequency detection unit 7, and a position sensing unit 8, wherein:
in some embodiments of the present disclosure, the temperature detecting unit 5 may be a temperature sensor, which may be disposed on the same circuit board as the processing unit 1, or may be integrated in the processing unit 1, and may detect the temperature of the processing unit 1 in real time.
If the processing unit 1 includes only the gpu 11, the temperature of the processing unit 1 is the temperature of the gpu 11.
The rotation speed detection unit 6 may be connected to the fan unit 2 for detecting the rotation speed of the fan unit 2 in real time. The frequency detection unit 7 may be used to detect the processing frequency of the graphics processing unit 11 in real time.
In step S130, the current frame rate may be compared with the target frame rate, and if the current frame rate is less than the target frame rate, it is determined that the video may be jammed, at this time, a frame rate adjustment step may be performed to increase the frame rate, avoid the video from being jammed, and increase the smoothness. The target frame rate may be predetermined, for example, the target frame rate may be 75fps or 90 fps.
The frame rate adjusting step may comprise: if the temperature of the processing unit 1 is not less than the temperature threshold, the rotation speed of the fan unit 2 is not less than the rotation speed threshold, and the processing frequency of the graphic processing unit 11 is not less than the frequency threshold, it indicates that the frame rate cannot be increased by cooling and raising the frequency, so that the displacement of the virtual reality device between the current frame and the previous frame can be determined, and the displacement is compared with the displacement threshold; if the displacement is not greater than the displacement threshold, it indicates that the change of the position of the virtual reality device when the virtual reality device operates the previous frame and the current frame is not large, and it can be inferred that the change of the position of the next frame and the current frame is not large accordingly.
The displacement threshold may be an empirical value or a value set by the user, and the specific value is not particularly limited herein.
The movement of the virtual reality device may include translation and rotation, causing a change in the position of the virtual reality device. For example, the coordinates of the virtual reality device in a coordinate system may be generated according to the data sensed by the position sensing unit 8, and the coordinates may be used to represent the position of the virtual reality device, and the displacement of the virtual reality device may be determined by determining the change of the coordinates in the same coordinate system. The position sensing unit 8 may be one or more, and may be a position sensor or other devices capable of sensing a position change, and the specific number, position and structure thereof are not particularly limited as long as they can be used for sensing the position of the virtual reality device.
It should be noted that the movement of the virtual reality device is represented by a signal generated by the movement of the position sensing unit 8, that is, the position of the virtual reality device can be represented by the position of the position sensing unit 8, if the position sensing unit 8 senses a change in position, it is determined that the position of the virtual reality device has changed, and if the position sensing unit 8 does not sense a change in position, it is determined that the position of the virtual display device has not changed.
Further, in some embodiments of the present disclosure, the frame rate adjusting step may further include:
and if the displacement is larger than the displacement threshold, determining the rendering resolution of the next frame according to the rendering resolution of the current frame, wherein the rendering resolution of the next frame is smaller than that of the current frame.
If the displacement is greater than the displacement threshold, it can be considered that the displacement amplitude of the virtual reality device is large, and the image seen by the user should be changed correspondingly, and at this time, the rendering resolution can be reduced on the basis of the rendering resolution of the current frame as the rendering resolution of the next frame, so that the amount of calculation is reduced, and the frame rate is improved.
In some embodiments of the present disclosure, if the displacement amount is greater than the displacement threshold, a difference obtained by subtracting a fixed value from the rendering resolution of the current frame may be used as the rendering resolution of the next frame, so as to implement the rendering resolution of the next frame. Of course, in another embodiment of the present disclosure, if the displacement amount is greater than the displacement threshold, the rendering resolution of the current frame may be reduced according to a predetermined ratio to be used as the rendering resolution of the next frame.
In some embodiments of the present disclosure, the image distance of the virtual reality device is the distance between the virtual image and the lens unit 4. If the displacement is greater than the displacement threshold, whether the image distance of the virtual reality device is smaller than a preset appropriate distance can be further judged, if so, the person is in an appropriate viewing distance, at this time, for the case of a low frame rate, the reduction amplitude of the rendering resolution can be determined according to the distance difference between the appropriate distance and the image distance, and if the distance difference is larger, the reduction amplitude of the rendering resolution can be smaller. If the image distance is greater than the suitable distance, the rendering resolution may be reduced directly by a predetermined magnitude.
In some embodiments of the present disclosure, the frame rate may also be increased by lowering and raising the frequency, and lowering the frequency is prior to raising the frequency, and raising the frequency is prior to the above-mentioned alternate frame rendering. Specifically, as shown in fig. 2, steps S200 to S300 in fig. 2 illustrate a detailed principle of an execution sequence of operations in an embodiment of step S130, where if the current frame rate is less than the target frame rate, the temperature of processing unit 1 is compared with a temperature threshold, if the temperature of processing unit 1 is not less than the temperature threshold, the rotation speed of fan unit 2 is compared with a rotation speed threshold, and if the rotation speed of fan unit 2 is less than the rotation speed threshold, the rotation speed of fan unit 2 is increased, and the heat dissipation performance is improved, so that the frame rate is increased; if the rotation speed of the fan unit 2 is not less than the rotation speed threshold, the rotation speed of the fan unit 2 cannot be increased, the processing frequency of the graphic processing unit 11 may be compared with the frequency threshold, and if the processing frequency of the graphic processing unit 11 is less than the frequency threshold, the processing frequency of the graphic processing unit 11 may be increased, the computing capability may be improved, and the frame rate may be increased.
The specific value of the temperature threshold is not particularly limited, and may be 66 ℃ or less, for example, up to 115 ℃.
In some embodiments of the present disclosure, the number of the fan units 2 may be multiple, each fan unit 2 may include a fan blade and a motor for driving the fan blade to rotate, and each fan unit 2 may rotate independently. If the rotation speed of the fan unit 2 is less than the threshold rotation speed, the rotation speed of at least one fan unit 2 with the rotation speed less than the threshold rotation speed may be increased when the rotation speed of the fan unit 2 is increased.
The principle of adjusting the rotational speed of the fan unit 2 is exemplified below:
take fan unit 2 to include flabellum and drive the motor that the flabellum rotated, and the motor is for example direct current: the operating frequency of the motor can be adjusted according to the relationship between the operating voltage interval of the motor and the temperature, so that the rotating speed of the fan blades, namely the rotating speed of the fan unit 2, can be adjusted. For a dc motor: rotational speed
Figure BDA0002523864550000091
Where U is the armature voltage, I is the armature current, R is the resistance of the armature circuit,
Figure BDA0002523864550000092
is the excitation flux, and k is the induced electromotive force constant.
The method of adjusting the rotational speed of a motor may include: in the field control method for controlling the field magnetic flux Φ and the armature voltage control method for controlling the armature voltage U, the armature voltage is controlled by, for example, approximating n to kU, that is, n to kU, since the higher the voltage is, the higher the rotation speed is, and the load is constant, and the rated range is2Wherein k is a constant value coefficient.
For example, the motor operating voltage interval is 1.8v-3.3v, and n is 3.24k-10.89k according to the relationship between the voltage and the rotation speed of the motor, so that under the condition that the load of the fan unit 2 is constant, the rotation speed of the motor can be controlled by an execution unit, which can be a microprocessor, and the execution unit can be connected with the motor through a general purpose input/output port (GPIO), so that the rotation speed of the motor can be adjusted by controlling the output voltage of the general purpose input/output port of the execution unit.
Furthermore, in some embodiments of the present disclosure, the performing the frame rate adjustment step may further include:
if the temperature of the processing unit 1 is less than the temperature threshold, the processing frequency of the graphic processing unit 11 is compared with the frequency threshold, and if the processing frequency is less than the frequency threshold, the processing frequency of the graphic processing unit 11 is increased. Thereby improving the processing capacity and the frame rate.
It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.
The embodiment of the present disclosure further provides a control apparatus of a virtual reality device, as shown in fig. 3 and 4, the virtual reality device includes a processing unit 1 and a fan unit 2, the processing unit 1 includes a graphics processing unit 11; the control apparatus 100 includes a frame rate detection unit 101 and an execution unit 102, in which:
the frame rate detection unit 101 is configured to determine a current frame rate according to a running time of a current frame of the target video.
The execution unit 102 is configured to obtain a temperature of the processing unit 1, a rotation speed of the fan unit 2, a processing frequency of the graphic processing unit 11, and a position of the virtual reality device; and, when the current frame rate is less than the target frame rate, performing a frame rate adjustment step; the frame rate adjusting step comprises: if the temperature of the processing unit 1 is not less than the temperature threshold, the rotating speed of the fan unit 1 is not less than the rotating speed threshold, and the processing frequency of the graphic processing unit 11 is not less than the frequency threshold, determining the displacement of the position of the virtual reality device when running the current frame and the position of the virtual reality device when running the previous frame; and if the displacement is not larger than the displacement threshold, taking the image of the current frame as the image of the next frame.
The present disclosure also provides a virtual reality device, as shown in fig. 4, the virtual reality device may include a processing unit 1, a fan unit 2, a temperature detecting unit 5, a rotation speed detecting unit 6, a frequency detecting unit 7, a position sensing unit 8, and a control apparatus 100, wherein:
the processing unit 1 includes a graphics processing unit 11. The temperature detecting unit 5 is used for detecting the temperature of the virtual reality device, for example, the temperature detecting unit 5 may include a temperature sensor, which may be disposed on the same circuit board of the virtual reality device as the processing unit 1.
The rotation speed detecting unit 6 is used for detecting the rotation speed of the fan unit 2, for example, the fan unit 2 may include fan blades and a motor for driving the fan blades to rotate, and the rotation speed detecting unit 6 may detect the rotation speed of the motor, so as to detect the rotation speed of the fan unit 2.
The frequency detection unit 7 is used for detecting the processing frequency of the graphic processing unit 11, and the position sensing unit 8 is used for sensing the position of the virtual reality device.
The control device 100 may be the control device of the virtual reality apparatus, and will not be described in detail here.
As shown in fig. 4, in some embodiments of the present disclosure, the execution unit 102 of the control device 100 may be integrated with the graphics processing unit 11 in the processing unit 1, i.e., the processing unit 1 may include the graphics processing unit 11 and the execution unit 102. Further, the GPU 11 may be a Graphics Processing Unit (GPU), the execution unit 102 may be a Central Processing Unit (CPU), and the GPU 11 and the execution unit 102 may be integrated into the same processor.
In another embodiment of the present disclosure, the frame rate detection unit 101 may also be integrated into the processing unit 1, and further, the entire control device 100 may be integrated into the processing unit 1.
In other embodiments of the present disclosure, the control device 100 may be located in a different processor from the processing unit 1.
In addition, the virtual reality apparatus may further include a display unit 3 and a lens unit 4, the display unit 3 being configured to receive image data output from the display graphic processing unit 11 to display an image. Lens unit 4 can set up with display element 3 relatively, and after the user wore, lens unit 4 was located between display element 3 and the user's eyes for see through the light that display element 3 sent, and form the virtual image that can supply the user's eyes to watch.
In some embodiments of the present disclosure, the virtual reality device of the present disclosure may be a myopia training apparatus, which forms an image for a myopic user to watch by controlling an image distance, may be used to correct myopia, and may also be used to make the myopic user watch a clear image.
It should be noted that although in the above detailed description several units of the device for action execution are mentioned, this division is not mandatory. Indeed, the features and functionality of two or more of the units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, one of the unit features and functions described above may be further divided into embodiments by a plurality of modules or units.
The specific details of each unit in the virtual reality device and the control apparatus may refer to the implementation of the corresponding control method, and therefore, the details are not described herein again.
The disclosed embodiments also provide a readable storage medium on which a computer program is stored, the computer program, when executed, implementing the control method of the virtual reality device of any of the above embodiments, or implementing the control method of any of the above embodiments. In some embodiments, various aspects of the present disclosure may also be implemented in the form of a program product including program code for causing a virtual reality device to perform the steps according to various exemplary embodiments of the present disclosure described in the above-mentioned control method of the present specification, when the program product is run on a terminal device.
As shown in fig. 5, a program product for implementing the above-described control method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program codes, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and in this document, the readable storage medium 400 may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims (10)

1. The control method of the virtual reality equipment is characterized in that the virtual reality equipment comprises a processing unit and a fan unit, wherein the processing unit comprises a graphic processing unit; the control method comprises the following steps:
determining a current frame rate according to the running time of a current frame of the target video;
acquiring the temperature of the processing unit, the rotating speed of the fan unit, the processing frequency of the graphic processing unit and the position of the virtual reality device;
when the current frame rate is less than the target frame rate, executing a frame rate adjusting step;
the frame rate adjusting step comprises: if the temperature of the processing unit is not less than the temperature threshold, the rotating speed of the fan unit is not less than the rotating speed threshold, and the processing frequency of the graphic processing unit is not less than the frequency threshold, determining the displacement of the position of the virtual reality device when the virtual reality device runs in the current frame and the position of the virtual reality device when the virtual reality device runs in the previous frame; and if the displacement is smaller than the displacement threshold value, taking the image of the current frame as the image of the next frame.
2. The control method according to claim 1, wherein the frame rate adjusting step further comprises:
and if the displacement is not smaller than the displacement threshold, determining the rendering resolution of the next frame according to the rendering resolution of the current frame, wherein the rendering resolution of the next frame is smaller than that of the current frame.
3. The control method according to claim 1, wherein the frame rate adjusting step further comprises:
and if the temperature of the processing unit is not less than the temperature threshold value and the rotating speed of the fan unit is less than the rotating speed threshold value, increasing the rotating speed of the fan unit.
4. The control method according to claim 3, wherein the number of the fan units is plural; increasing the rotational speed of the fan unit, comprising:
increasing the rotational speed of at least one of the fan units having a rotational speed less than the rotational speed threshold.
5. The control method according to claim 1, wherein the frame rate adjusting step further comprises:
if the temperature of the processing unit is greater than the temperature threshold, the rotating speed of the fan unit is not less than the rotating speed threshold, and the processing frequency of the graphics processing unit is less than the frequency threshold, the processing frequency of the graphics processing unit is increased.
6. The control method according to any one of claims 1 to 5, wherein determining the current frame rate according to the running time of the current frame of the target video comprises:
detecting the running duration of the current frame;
and dividing one second by the running duration of the current frame to obtain the current frame rate.
7. The control method according to any one of claims 1 to 5, wherein the target frame rate is 75fps or 90 fps.
8. The control device of the virtual reality equipment is characterized in that the virtual reality equipment comprises a processing unit and a fan unit, wherein the processing unit comprises a graphic processing unit; the control device includes:
the frame rate detection unit is used for determining the current frame rate according to the running time of the current frame of the target video;
the execution unit is used for acquiring the temperature of the processing unit, the rotating speed of the fan unit, the processing frequency of the graphic processing unit and the position of the virtual reality equipment in real time; and, when the current frame rate is less than the target frame rate, performing a frame rate adjustment step; the frame rate adjusting step comprises: if the temperature of the processing unit is not less than the temperature threshold, the rotating speed of the fan unit is not less than the rotating speed threshold, and the processing frequency of the graphic processing unit is not less than the frequency threshold, determining the displacement of the position of the virtual reality device when the virtual reality device runs in the current frame and the position of the virtual reality device when the virtual reality device runs in the previous frame; and if the displacement is smaller than the displacement threshold value, taking the image of the current frame as the image of the next frame.
9. A virtual reality device, comprising a processing unit, a fan unit, a temperature detecting unit, a rotation speed detecting unit, a position sensing unit and the control device of claim 8, wherein the processing unit comprises a graphic processing unit, the temperature detecting unit is used for detecting the temperature of the processing unit, the rotation speed detecting unit is used for detecting the rotation speed of the fan unit, the frequency detecting unit is used for detecting the processing frequency of the graphic processing unit, and the position sensing unit is used for sensing the position of the virtual reality device.
10. A readable storage medium on which a computer program is stored, characterized in that the computer program, when executed, implements the control method of any one of claims 1-7.
CN202010498696.0A 2020-06-04 2020-06-04 Readable storage medium, virtual reality device, control method and control device thereof Active CN111679739B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010498696.0A CN111679739B (en) 2020-06-04 2020-06-04 Readable storage medium, virtual reality device, control method and control device thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010498696.0A CN111679739B (en) 2020-06-04 2020-06-04 Readable storage medium, virtual reality device, control method and control device thereof

Publications (2)

Publication Number Publication Date
CN111679739A true CN111679739A (en) 2020-09-18
CN111679739B CN111679739B (en) 2024-04-09

Family

ID=72453361

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010498696.0A Active CN111679739B (en) 2020-06-04 2020-06-04 Readable storage medium, virtual reality device, control method and control device thereof

Country Status (1)

Country Link
CN (1) CN111679739B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112451969A (en) * 2020-12-04 2021-03-09 腾讯科技(深圳)有限公司 Virtual object control method and device, computer equipment and storage medium
CN112684873A (en) * 2021-03-12 2021-04-20 北京润尼尔网络科技有限公司 VR resource hardware adaptation method
CN113516782A (en) * 2021-07-29 2021-10-19 中移(杭州)信息技术有限公司 VR game rendering optimization method, device, equipment and computer-readable storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106127843A (en) * 2016-06-16 2016-11-16 福建数博讯信息科技有限公司 The rendering intent of three-dimensional virtual scene and device
CN106658170A (en) * 2016-12-20 2017-05-10 福州瑞芯微电子股份有限公司 Method and device for reducing virtual reality latency
CN108876700A (en) * 2018-06-01 2018-11-23 福州瑞芯微电子股份有限公司 A kind of method and circuit promoting VR display effect
CN108921951A (en) * 2018-07-02 2018-11-30 京东方科技集团股份有限公司 Virtual reality image display methods and its device, virtual reality device
CN108961173A (en) * 2018-05-17 2018-12-07 成都明镜视觉科技有限公司 A kind of optimization method based on the end h5 augmented reality
CN110166758A (en) * 2019-06-24 2019-08-23 京东方科技集团股份有限公司 Image processing method, device, terminal device and storage medium
CN110152291A (en) * 2018-12-13 2019-08-23 腾讯科技(深圳)有限公司 Rendering method, device, terminal and the storage medium of game picture
US20190371264A1 (en) * 2018-05-30 2019-12-05 Ati Technologies Ulc Frame refresh synchronization with synchronization boundary

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106127843A (en) * 2016-06-16 2016-11-16 福建数博讯信息科技有限公司 The rendering intent of three-dimensional virtual scene and device
CN106658170A (en) * 2016-12-20 2017-05-10 福州瑞芯微电子股份有限公司 Method and device for reducing virtual reality latency
CN108961173A (en) * 2018-05-17 2018-12-07 成都明镜视觉科技有限公司 A kind of optimization method based on the end h5 augmented reality
US20190371264A1 (en) * 2018-05-30 2019-12-05 Ati Technologies Ulc Frame refresh synchronization with synchronization boundary
CN108876700A (en) * 2018-06-01 2018-11-23 福州瑞芯微电子股份有限公司 A kind of method and circuit promoting VR display effect
CN108921951A (en) * 2018-07-02 2018-11-30 京东方科技集团股份有限公司 Virtual reality image display methods and its device, virtual reality device
CN110152291A (en) * 2018-12-13 2019-08-23 腾讯科技(深圳)有限公司 Rendering method, device, terminal and the storage medium of game picture
CN110166758A (en) * 2019-06-24 2019-08-23 京东方科技集团股份有限公司 Image processing method, device, terminal device and storage medium

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112451969A (en) * 2020-12-04 2021-03-09 腾讯科技(深圳)有限公司 Virtual object control method and device, computer equipment and storage medium
CN112684873A (en) * 2021-03-12 2021-04-20 北京润尼尔网络科技有限公司 VR resource hardware adaptation method
CN112684873B (en) * 2021-03-12 2021-06-25 北京润尼尔网络科技有限公司 VR resource hardware adaptation method
CN113516782A (en) * 2021-07-29 2021-10-19 中移(杭州)信息技术有限公司 VR game rendering optimization method, device, equipment and computer-readable storage medium
CN113516782B (en) * 2021-07-29 2023-09-05 中移(杭州)信息技术有限公司 VR game rendering optimization method, device, equipment and computer readable storage medium

Also Published As

Publication number Publication date
CN111679739B (en) 2024-04-09

Similar Documents

Publication Publication Date Title
CN111679739B (en) Readable storage medium, virtual reality device, control method and control device thereof
JP4181039B2 (en) Portable virtual reality system
CN109934041B (en) Information processing method, information processing system, medium, and computing device
US9877018B2 (en) Managing a display
JP4384242B1 (en) Information processing apparatus and image processing method
KR20150083880A (en) Systems and methods for configuring the display resolution of an electronic device based on distance
US11245887B2 (en) Electronic device and operation method therefor
CN109885176A (en) Display control method, device, medium and electronic equipment
US11182953B2 (en) Mobile device integration with a virtual reality environment
CN108776544B (en) Interaction method and device in augmented reality, storage medium and electronic equipment
US20230394618A1 (en) Hemisphere cube map projection format in imaging environments
US20170256094A1 (en) Displaying of augmented reality objects
US20240005625A1 (en) Image processing method and apparatus, electronic device and storage medium
KR102291257B1 (en) Apparatus and method for virtual reality sickness reduction based on virtual reality sickness assessment
US10831266B2 (en) Personalized adaptation of virtual reality content based on eye strain context
CN111726666A (en) Video display control method and device
CN108665498B (en) Image processing method, device, electronic equipment and storage medium
CN110597432B (en) Interface control method, device, computer readable medium and electronic equipment
KR20190083464A (en) Electronic device controlling image display based on scroll input and method thereof
US7737981B2 (en) Information processing apparatus
US11861157B2 (en) Methods, systems, and media for presenting offset content
US11315211B2 (en) Methods and apparatus for efficient motion estimation
US9787962B2 (en) Accelerated super-resolution processing method for TV video images, accelerated super-resolution processing device for TV video images that is used in same method, first to sixth accelerated super-resolution processing programs, and first to second storage media
CN112007357A (en) Client-side delay improvement method, main processor, processing circuit and cloud game server
US20230360175A1 (en) Video display systems, portable video display apparatuses and video enhancement methods

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant