CN115396655A - VR image playing method, device and system - Google Patents
VR image playing method, device and system Download PDFInfo
- Publication number
- CN115396655A CN115396655A CN202211322333.7A CN202211322333A CN115396655A CN 115396655 A CN115396655 A CN 115396655A CN 202211322333 A CN202211322333 A CN 202211322333A CN 115396655 A CN115396655 A CN 115396655A
- Authority
- CN
- China
- Prior art keywords
- image
- data
- user
- playing
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the invention relates to the technical field of VR (virtual reality), and particularly discloses a VR image playing method, device and system. The embodiment of the invention loads VR image data by receiving VR image selection and bearing grade selection of a user, and carries out initialization setting on the VR image data; performing visual playing on VR image setting data, and performing bearing tracking monitoring on a user in the playing process; according to the borne tracking monitoring data, real-time adjustment is carried out on VR image setting data to generate VR image adjustment data; and adjusting the visual playing in real time according to the VR image adjustment data. Can carry out the initialization setting of VR image data according to user's selection to at the visual broadcast in-process of VR image, bear in real time and track the monitoring, follow tracks monitoring data according to bearing, carry out the real-time adjustment of VR image broadcast, avoid the user to appear dizzy, uncomfortable feelings such as nausea, create good VR experience process for the user.
Description
Technical Field
The invention belongs to the technical field of VR (virtual reality), and particularly relates to a VR image playing method, device and system.
Background
VR, also known as virtual reality technology, is the combination of virtual and real, as the name implies. Theoretically, virtual reality technology is a computer simulation system that can create and experience a virtual world, with a computer creating a simulated environment into which a user is immersed. The virtual reality technology is to combine electronic signals generated by computer technology with data in real life to convert the electronic signals into phenomena capable of being felt by people, wherein the phenomena can be true and true objects in reality or substances invisible to the naked eyes, and the phenomena can be expressed by a three-dimensional model.
The user carries out the VR image broadcast in VR equipment through wearing VR equipment for user's eyes and health can both perceive the scene that the VR image broadcast, thereby can immerse in the VR world. However, different people experience different VR experiences, and because VR images are usually scenes that are thrilling and irritating for users to experience, some users may experience discomfort such as dizziness and nausea, and the existing VR image playing device cannot play and adjust according to the experiences of different users, so that many users feel daunting to VR experiences.
Disclosure of Invention
An embodiment of the invention provides a VR image playing method, device and system, and aims to solve the problems in the background art.
In order to achieve the above purpose, the embodiments of the present invention provide the following technical solutions:
a VR image playback method, wherein said method comprises the steps of:
receiving VR image selection and bearing grade selection of a user, loading VR image data according to the VR image selection and the bearing grade selection, and carrying out initialization setting on the VR image data to generate VR image setting data;
visually playing the VR image setting data, and carrying out bearing tracking monitoring on a user in the playing process to generate bearing tracking monitoring data;
according to the borne tracking monitoring data, real-time adjustment is carried out on the VR image setting data to generate VR image adjustment data;
and adjusting the visual playing in real time according to the VR image adjustment data.
As a further limitation of the technical solution of the embodiment of the present invention, the receiving a VR image selection and a bearing level selection of a user, loading VR image data according to the VR image selection and the bearing level selection, and performing initialization setting on the VR image data to generate VR image setting data specifically includes the following steps:
receiving VR image selection of a user, and loading VR image data according to the VR image selection;
receiving the bearing grade selection of a user, and determining the VR bearing grade according to the bearing grade selection;
and initializing and setting the VR image data according to the VR bearing grade to generate VR image setting data.
As a further limitation of the technical solution of the embodiment of the present invention, the visually playing the VR image setting data, and performing tracking monitoring on the user during playing, and generating tracking monitoring data specifically includes the following steps:
performing visual playing on the VR image setting data;
in the playing process, heart rate tracking monitoring is carried out on the user to generate heart rate tracking monitoring data;
in the playing process, palm humidity monitoring is carried out on the user, and palm humidity monitoring data are generated;
in the playing process, the user is subjected to voice calling tracking monitoring to generate voice calling tracking monitoring data;
and synthesizing the heart rate tracking monitoring data, the palm humidity monitoring data and the cry tracking monitoring data to generate bearing tracking monitoring data.
As a further limitation of the technical solution of the embodiment of the present invention, the visually playing the VR image setting data specifically includes the following steps:
performing VR equipment wearing monitoring on a user, and generating wearing monitoring data in real time;
judging whether the user finishes wearing VR equipment or not according to the wearing monitoring data;
when the user finishes wearing the VR equipment, a playing signal is generated;
and performing visual playing according to the playing signal and the VR image setting data.
As a further limitation of the technical solution of the embodiment of the present invention, the adjusting the VR image setting data in real time according to the tracking monitoring data, and the generating of the VR image adjustment data specifically includes the following steps:
analyzing the tracking monitoring data in real time to generate real-time adjustment data;
and adjusting the VR image setting data in real time according to the real-time adjustment data to generate VR image adjustment data.
A VR video playback system, said system comprising:
the device comprises an initialization setting unit, a receiving unit and a processing unit, wherein the initialization setting unit is used for receiving VR image selection and bearing grade selection of a user, loading VR image data according to the VR image selection and the bearing grade selection, and carrying out initialization setting on the VR image data to generate VR image setting data;
the playing tracking monitoring unit is used for visually playing the VR image setting data, and carrying out bearing tracking monitoring on a user in the playing process to generate bearing tracking monitoring data;
a VR real-time adjusting unit, configured to adjust the VR image setting data in real time according to the tracking-subject monitoring data, and generate VR image adjustment data;
and the VR adjustment playing unit is used for adjusting the visual playing in real time according to the VR image adjustment data.
As a further limitation of the technical solution of the embodiment of the present invention, the initialization setting unit specifically includes:
the image selection receiving module is used for receiving VR image selection of a user and loading VR image data according to the VR image selection;
the grade selection module is used for receiving the bearing grade selection of a user and determining the VR bearing grade according to the bearing grade selection;
and the initialization setting module is used for carrying out initialization setting on the VR image data according to the VR bearing grade to generate VR image setting data.
As a further limitation of the technical solution of the embodiment of the present invention, the play tracking monitoring unit specifically includes:
the visual playing module is used for visually playing the VR image setting data;
the heart rate monitoring module is used for tracking and monitoring the heart rate of the user in the playing process to generate heart rate tracking and monitoring data;
the humidity monitoring module is used for monitoring the palm humidity of the user in the playing process to generate palm humidity monitoring data;
the system comprises a calling monitoring module, a calling tracking module and a calling tracking module, wherein the calling monitoring module is used for carrying out calling tracking monitoring on a user in the playing process to generate calling tracking monitoring data;
and the monitoring data generation module is used for integrating the heart rate tracking monitoring data, the palm humidity monitoring data and the cry tracking monitoring data to generate bearing tracking monitoring data.
As a further limitation of the technical solution of the embodiment of the present invention, the visual playing module specifically includes:
the wearing monitoring sub-module is used for carrying out VR equipment wearing monitoring on a user and generating wearing monitoring data in real time;
the wearing judgment sub-module is used for judging whether the user finishes wearing the VR equipment according to the wearing monitoring data;
the signal generation sub-module is used for generating a playing signal when the user finishes wearing the VR equipment;
and the visual playing submodule is used for carrying out visual playing according to the playing signal and the VR image setting data.
A VR image playback device, said device comprising:
at least one processor;
at least one memory for storing at least one program;
when the at least one program is executed by the at least one processor, the at least one processor is enabled to implement the VR image playing method as described above.
Compared with the prior art, the invention has the beneficial effects that:
the embodiment of the invention loads VR image data by receiving VR image selection and bearing grade selection of a user, and carries out initialization setting on the VR image data; performing visual playing on VR image setting data, and performing bearing tracking monitoring on a user in the playing process; according to the borne tracking monitoring data, real-time adjustment is carried out on VR image setting data to generate VR image adjustment data; and adjusting the visual playing in real time according to the VR image adjustment data. Can carry out the initialization setting of VR image data according to user's selection to at the visual broadcast in-process of VR image, bear in real time and track the monitoring, according to bearing and track monitoring data, carry out the real-time adjustment of VR image broadcast, avoid user's discomfort such as dizzy, nausea to appear, create good VR experience process for the user.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention.
Fig. 1 shows a flow chart of a method provided by an embodiment of the invention.
Fig. 2 shows a flowchart of initialization setting in the method provided in the embodiment of the present invention.
Fig. 3 shows a flow chart of the survivor tracking monitoring in the method provided by the embodiment of the invention.
Fig. 4 shows a flowchart of performing visual playing in the method provided by the embodiment of the present invention.
Fig. 5 is a flowchart illustrating the VR image adjustment data generation method according to an embodiment of the invention.
Fig. 6 shows an application architecture diagram of a system provided by an embodiment of the invention.
Fig. 7 shows a block diagram of an initialization setting unit in the system according to the embodiment of the present invention.
Fig. 8 shows a block diagram of a play tracking monitoring unit in the system according to an embodiment of the present invention.
Fig. 9 shows a block diagram of a structure of a visual playing module in the system according to the embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It can be understood that, in the prior art, because a VR image is usually a scene in which a user experiences thrill, some users may experience discomfort such as dizziness and nausea, and the existing VR image playback device cannot perform playback adjustment according to experiences of different users, which results in that many users feel daunting on VR experiences.
In order to solve the above problems, in the embodiments of the present invention, VR image data is loaded by receiving a selection of a VR image and a selection of a bearing level of a user, and the VR image data is initialized; performing visual playing on VR image setting data, and performing bearing tracking monitoring on a user in the playing process; according to the borne tracking monitoring data, real-time adjustment is carried out on VR image setting data to generate VR image adjustment data; and adjusting the visual playing in real time according to the VR image adjustment data. Can carry out the initialization setting of VR image data according to user's selection to at the visual broadcast in-process of VR image, bear in real time and track the monitoring, follow tracks monitoring data according to bearing, carry out the real-time adjustment of VR image broadcast, avoid the user to appear dizzy, uncomfortable feelings such as nausea, create good VR experience process for the user.
Fig. 1 shows a flow chart of a method provided by an embodiment of the invention.
Specifically, a VR image playing method includes the following steps:
step S101, receiving VR image selection and bearing grade selection of a user, loading VR image data according to the VR image selection and the bearing grade selection, and carrying out initialization setting on the VR image data to generate VR image setting data.
In the embodiment of the invention, before the VR experience is performed, a user can first select a VR image and a VR tolerance level to be experienced. It should be noted that, for VR image selection, a specific image is selected. For example, the user selects the "Jurassic park" image by a click operation. In addition, for a specific image, a plurality of images with different bearing levels are correspondingly arranged in the database. That is, for the image of the Jurassic park, a plurality of versions with different bearing levels can be selected for playing. Furthermore, VR image selection and bearing grade selection performed by a user are received, corresponding VR image data are loaded from a VR image library, and initialization setting is performed on the VR image data according to the VR bearing grade selected by the user to generate VR image setting data.
It is understood that the VR tolerance level is a level for evaluating the reality of the VR imaging environment simulation. Specifically, different VR bear grades, and different in aspects such as the background volume of VR image, background music type and the action range of VR equipment, can bring the VR shadow experience of different realities for the user, and VR bears the grade and is higher, causes uncomfortable feelings such as user's vertigo, nausea more easily. The VR video setting data is a result of initial adjustment of the background volume, the background music type, the operation range of the VR device, and the like of the VR video in the VR video data according to the VR tolerance level set by the psychological expectation of the user.
Specifically, fig. 2 shows a flowchart of performing initialization setting in the method provided by the embodiment of the present invention.
In a preferred embodiment of the present invention, the receiving a VR image selection and a receiving level selection of a user, loading VR image data according to the VR image selection and the receiving level selection, and performing initialization setting on the VR image data to generate VR image setting data specifically includes the following steps:
step S1011, receiving a VR image selection of a user, and loading VR image data according to the VR image selection. Step S1012, receiving the bearing level selection of the user, and determining the VR bearing level according to the bearing level selection.
It can be understood that the interactive experience of VR images to users during playing VR images will directly determine the acceptable level of the users. In the invention, the bearing grade of the user is divided into five grades, specifically: the five grades "hard to bear", "bearable", "easy to bear" and "comfortable". Generally, the VR video can be set in a hierarchical manner from a plurality of angles, such as background volume, background music type, and motion range of VR equipment.
For the background volume of the VR image, the background volume may be set according to the above five levels. Further, for the type of background music, the corresponding background music may be selected from the background music library in accordance with the above-described five levels. For example, the "hard" level is selected as the frightened music type, and the "comfortable" level is selected as the soft music type, based on the actual setting. For the operation amplitude of the VR device, different swing amplitudes of the VR device may be set correspondingly according to the above-mentioned five levels. For example, after the user dressed the VR equipment, the scene that corresponds in the VR image was for riding certain kind of animal, then through setting up the action range that the VR was equipped to the synchronous control user experiences of riding in the VR image.
It should be noted that, when setting the user's tolerance level, the setting is not limited to the three aspects of the background volume of the VR image, the type of background music, and the operation range of the VR device, and the actual application requirements are the specific requirements.
Step S1013, initializing the VR image data according to the VR tolerance level, and generating VR image setting data.
Further, in this step, after the VR tolerance level corresponding to each adjustment item (background volume of VR image, background music type, and operation width of VR device) is set, the original VR image data is set for each adjustment item. For example, if the user selects a VR tolerance level of "comfort", for the adjustment item of the background music type, a soft music type is selected from the background music database to replace the background music in the current VR image.
It should be noted that, the VR image referred to in the present invention is generally referred to as VR image segment. The method is only used for playing for a short time, for example, 3 to 5min, and is used for the user to perform the VR playing experience. Therefore, the above-mentioned replacement of the background music in the current VR image refers to the replacement of the background music in the VR image segment.
Further, the VR video playing method further includes the following steps:
and S102, visually playing the VR image setting data, and carrying out bearing tracking monitoring on the user in the playing process to generate bearing tracking monitoring data.
In the embodiment of the invention, the wearing monitoring of the VR equipment is carried out on the user, the wearing monitoring data is generated in real time, and the wearing monitoring data is analyzed in real time. Firstly, judge whether the user accomplishes VR and equips the dress, after the user finishes VR and equips the dress, generate the broadcast signal, then carry out visual broadcast with VR image setting data, the user carries out VR and experiences to be in the in-process that VR experienced at the user, follow the monitoring to user's rhythm of the heart, palm humidity and cry, generate rhythm of the heart respectively and trail monitoring data, palm humidity monitoring data and cry respectively and trail monitoring data. And generating bearing tracking monitoring data by integrating the heart rate tracking monitoring data, the palm humidity monitoring data and the cry tracking monitoring data.
Specifically, fig. 3 shows a flowchart for performing the survivor tracking monitoring in the method provided by the embodiment of the present invention.
In a preferred embodiment of the present invention, the visually playing the VR image setting data, and performing tracking monitoring on the user during the playing process, and generating tracking monitoring data specifically includes the following steps:
and step S1021, performing visual playing on the VR image setting data.
Specifically, fig. 4 shows a flowchart of performing visual playing in the method provided by the embodiment of the present invention.
In a preferred embodiment of the present invention, the visually playing the VR image setting data specifically includes the following steps:
step S10211, the VR equipment wearing monitoring is carried out on the user, and wearing monitoring data are generated in real time.
Step S10212, judging whether the user finishes VR equipment wearing according to the wearing monitoring data.
Step S10213, when the user finishes wearing the VR equipment, a playing signal is generated.
Step S10214, performing a visual playback according to the playback signal and the VR image setting data.
Further, will VR image setting data carries out visual broadcast to bearing tracking monitoring to the user in the broadcast process, the formation bears tracking monitoring data still includes following steps:
step S1022, in the playing process, heart rate tracking and monitoring are performed on the user, so as to generate heart rate tracking and monitoring data.
And S1023, in the playing process, monitoring the palm humidity of the user to generate palm humidity monitoring data.
And step S1024, in the playing process, calling tracking monitoring is carried out on the user, and calling tracking monitoring data are generated.
And S1025, integrating the heart rate tracking monitoring data, the palm humidity monitoring data and the cry tracking monitoring data to generate bearing tracking monitoring data.
In this embodiment, for the data subject to tracking monitoring, a value of credit related to the physiological monitoring data of the user needs to be quantized during data processing, so as to adjust the VR image in the subsequent steps.
Specifically, in the present invention, the calculation formula of the score value of the real-time physiological state of the user calculated according to the data subjected to tracking monitoring is represented as follows:
wherein the content of the first and second substances,
representing the calculated value of the credit for the real-time physiological status of the user based on the exposure tracking monitoring data,
a first weight coefficient is represented by a first weight coefficient,
which represents the second weight coefficient is represented by,
which represents a third weight coefficient of the first weight coefficient,
a base score representing the user's heart rate term,
a base score representing the user's palm wetness term,
a base score representing the user's vocalization item,
a real-time heart rate value representing the user,
a standard heart rate value representing the setting is shown,
represents the real-time palm wetness value of the user,
which represents the set standard humidity value of the humidity,
a volume value representing the user's voice,
indicating the set standard volume value.
Further, the VR video playing method further includes the following steps:
and S103, adjusting the VR image setting data in real time according to the borne tracking monitoring data to generate VR image adjustment data.
In the embodiment of the invention, whether the user is suitable for the VR bearing grade at the moment is judged by analyzing the bearing tracking monitoring data in real time, and when the user is not suitable for the VR bearing grade at the moment, the VR bearing grade of the user in the VR experiencing process is adjusted in real time, so that the VR image setting data is adjusted in real time to generate the VR image adjusting data.
In the embodiment of the invention, the VR bearing grade of the user is adjusted in real time by analyzing the bearing tracking monitoring data in real time, so that the VR image setting data is adjusted in real time, the settings of background volume, background music type, action amplitude of VR equipment and the like of the VR image are changed, and the VR image adjusting data is generated.
Specifically, fig. 5 shows a flowchart of generating VR image adjustment data in the method according to the embodiment of the present invention.
In a preferred embodiment of the present invention, the adjusting VR image setting data in real time according to the tracking monitored data includes the following steps:
and step S1031, analyzing the data subjected to tracking monitoring in real time, and generating real-time adjustment data.
As mentioned above, the user physiological real-time status score value calculated according to the data subjected to tracking monitoring
Then, the value is evaluated according to the physiological real-time state of the user
Further calculating a bearing grade difference factor
Specifically, it is represented as:
wherein the content of the first and second substances,
represents the standard value of the user physiological state score,
representing the bearing grade difference factor.
And step S1032, adjusting the VR image setting data in real time according to the real-time adjustment data to generate VR image adjustment data.
Further, the bearing grade difference factor is obtained through calculation
Then, according to the tolerance grade difference factor
And adjusting the VR bearing grade. Specifically, the adjustment of the VR tolerance level is performed according to the following formula:
wherein the content of the first and second substances,
indicates the VR tolerance level after the adjustment,
indicates the currentThe level of tolerance of the VR is such that,
indicating that the current VR withstand level is adjusted down by one level,
indicating that the current VR withstand level is down-regulated by two levels.
Further, the VR video playing method further includes the following steps:
and step S104, performing real-time adjustment and visual playing according to the VR image adjustment data.
In the embodiment of the invention, the visual playing is adjusted in real time according to the VR image adjustment data, so that the background volume, the background music type, the action amplitude of VR equipment and the like of the VR image are changed in real time according to the VR bearing grade of a user in the VR image playing process.
For example, if the original VR tolerance level is "unacceptable", then
Then the current VR tolerance level is correspondingly adjusted down by two levels, i.e. from the "intolerant" level to the "tolerant" level. Further, after the level adjustment level is determined, the items of background volume of the VR image, background music type, and operation range of the VR device are adjusted.
Further, fig. 6 shows an application architecture diagram of the system provided by the embodiment of the present invention.
In another preferred embodiment, the VR video playback system includes:
the initialization setting unit 101 is configured to receive VR image selection and exposure level selection of a user, load VR image data according to the VR image selection and the exposure level selection, perform initialization setting on the VR image data, and generate VR image setting data.
In the embodiment of the present invention, before performing VR experience, a user may first select a VR image and a VR exposure level that the user wants to experience, and the initialization setting unit 101 loads corresponding VR image data from a VR image library by receiving the VR image selection and the exposure level selection performed by the user, and performs initialization setting on the VR image data according to the VR exposure level selected by the user, so as to generate VR image setting data.
Specifically, fig. 7 shows a block diagram of the initialization setting unit 101 in the system according to the embodiment of the present invention.
In a preferred embodiment provided by the present invention, the initialization setting unit 101 specifically includes:
the image selection receiving module 1011 is configured to receive VR image selection of a user, and load VR image data according to the VR image selection.
A grade selection module 1012, configured to receive a bearing grade selection of a user, and determine a VR bearing grade according to the bearing grade selection.
And an initialization setting module 1013 configured to perform initialization setting on the VR image data according to the VR tolerance level, and generate VR image setting data.
Further, the VR video playback system further includes:
and the playing tracking monitoring unit 102 is used for visually playing the VR image setting data, and carrying out tracking monitoring on the user in the playing process to generate the bearing tracking monitoring data.
In the embodiment of the invention, the playing, tracking and monitoring unit 102 performs VR equipment wearing monitoring on a user, generates wearing monitoring data in real time, analyzes the wearing monitoring data in real time, judges whether the user finishes VR equipment wearing, generates a playing signal after the user finishes VR equipment wearing, visually plays VR image setting data, performs VR experience on the user, tracks and monitors the heart rate, palm humidity and screaming of the user in the VR experience process of the user, respectively generates heart rate tracking and monitoring data, palm humidity monitoring data and screaming sound tracking and monitoring data, and generates bearing tracking and monitoring data by integrating the heart rate tracking and monitoring data, the palm humidity monitoring data and the screaming sound tracking and monitoring data.
Specifically, fig. 8 shows a block diagram of the playback tracking monitoring unit 102 in the system according to the embodiment of the present invention.
In a preferred embodiment provided by the present invention, the play tracking monitoring unit 102 specifically includes:
and a visual playing module 1021, configured to perform visual playing on the VR image setting data.
Specifically, fig. 9 shows a block diagram of a structure of a visual playing module 1021 in the system according to the embodiment of the present invention.
In an embodiment of the present invention, the visual playing module 1021 specifically includes:
And a wearing judgment sub-module 10212 for judging whether the user finishes wearing the VR device according to the wearing monitoring data.
The signal generating sub-module 10213 is configured to generate a play signal when the user finishes wearing the VR equipment.
The visual playing sub-module 10214 is configured to perform visual playing according to the playing signal and the VR image setting data.
Further, the play tracking monitoring unit 102 further includes:
the heart rate monitoring module 1022 is configured to perform heart rate tracking monitoring on the user during the playing process, and generate heart rate tracking monitoring data.
And the humidity monitoring module 1023 is used for monitoring the palm humidity of the user in the playing process to generate palm humidity monitoring data.
And the voice call monitoring module 1024 is configured to perform voice call tracking monitoring on the user in the playing process, and generate voice call tracking monitoring data.
And the monitoring data generating module 1025 is used for integrating the heart rate tracking monitoring data, the palm humidity monitoring data and the cry tracking monitoring data to generate bearing tracking monitoring data.
Further, the VR video playback system further includes:
and a VR real-time adjusting unit 103, configured to adjust the VR image setting data in real time according to the bearing tracking monitoring data, so as to generate VR image adjustment data.
In the embodiment of the present invention, the VR real-time adjustment unit 103 analyzes the load tracking monitoring data in real time, determines whether the user is adapted to the current VR load level, adjusts the VR load level of the user in the VR experience process in real time when the user is not adapted to the current VR load level, and then adjusts the VR image setting data in real time to generate VR image adjustment data.
And the VR adjustment playing unit 104 is used for performing real-time adjustment visual playing according to the VR image adjustment data.
In the embodiment of the present invention, the VR adjustment playing unit 104 performs real-time adjustment and visual playing according to the VR image adjustment data, so that in the VR image playing process, the VR image definition, the jitter amplitude of the VR equipment, the simulated wind, the simulated rain, and the like are changed in real time according to the VR bearing grade of the user.
Further, in another preferred embodiment of the present invention, the VR video player includes:
at least one processor;
at least one memory for storing at least one program;
when executed by the at least one processor, cause the at least one processor to:
receiving VR image selection and bearing grade selection of a user, loading VR image data according to the VR image selection and the bearing grade selection, and carrying out initialization setting on the VR image data to generate VR image setting data;
visually playing the VR image setting data, and carrying out bearing tracking monitoring on a user in the playing process to generate bearing tracking monitoring data;
according to the borne tracking monitoring data, real-time adjustment is carried out on the VR image setting data to generate VR image adjustment data;
and adjusting the visual playing in real time according to the VR image adjustment data.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of steps in various embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternatingly with other steps or at least a portion of sub-steps or stages of other steps.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above may be implemented by a computer program, which may be stored in a non-volatile computer readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is specific and detailed, but not to be understood as limiting the scope of the present invention. It should be noted that various changes and modifications can be made by those skilled in the art without departing from the spirit of the invention, and these changes and modifications are all within the scope of the invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
The above description is intended to be illustrative of the preferred embodiment of the present invention and should not be taken as limiting the invention, but rather, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.
Claims (10)
1. A VR image playback method, comprising:
receiving VR image selection and bearing grade selection of a user, loading VR image data according to the VR image selection and the bearing grade selection, and carrying out initialization setting on the VR image data to generate VR image setting data;
visually playing the VR image setting data, and carrying out bearing tracking monitoring on a user in the playing process to generate bearing tracking monitoring data;
according to the borne tracking monitoring data, real-time adjustment is carried out on the VR image setting data to generate VR image adjustment data;
and adjusting the visual playing in real time according to the VR image adjustment data.
2. The VR image playing method of claim 1, wherein the receiving of the VR image selection and the exposure level selection of the user, loading VR image data according to the VR image selection and the exposure level selection, and performing initialization setting on the VR image data to generate VR image setting data specifically includes the following steps:
receiving VR image selection of a user, and loading VR image data according to the VR image selection;
receiving the bearing grade selection of a user, and determining the VR bearing grade according to the bearing grade selection;
and initializing and setting the VR image data according to the VR bearing grade to generate VR image setting data.
3. The VR image playing method of claim 1, wherein the step of visually playing the VR image setting data and performing tracking monitoring on the user during playing to generate tracking monitoring data specifically includes the following steps:
performing visual playing on the VR image setting data;
in the playing process, heart rate tracking monitoring is carried out on the user to generate heart rate tracking monitoring data;
in the playing process, palm humidity monitoring is carried out on the user, and palm humidity monitoring data are generated;
in the playing process, the user is subjected to voice calling tracking monitoring to generate voice calling tracking monitoring data;
and synthesizing the heart rate tracking monitoring data, the palm humidity monitoring data and the cry tracking monitoring data to generate bearing tracking monitoring data.
4. The VR image playback method of claim 3, wherein the value of the score of the real-time physiological state of the user calculated from the monitored data is calculated according to the following formula:
wherein the content of the first and second substances,
representing the calculated real-time status score value of the user's physiology from the exposure tracking monitoring data,
which represents the first weight coefficient, is,
which represents the second weight coefficient is represented by,
which represents a third weight coefficient of the first weight coefficient,
a base score representing the user's heart rate term,
a base score representing the user's palm moisture term,
a base score representing the user's vocalization item,
a real-time heart rate value representing the user,
a standard heart rate value representing the setting is shown,
represents the real-time palm wetness value of the user,
which represents the set standard humidity value of the humidity,
a volume value representing a call made by the user,
indicating the set standard loudness value.
5. The VR image playing method of claim 4, wherein the visually playing the VR image setting data specifically comprises the following steps:
performing VR equipment wearing monitoring on a user, and generating wearing monitoring data in real time;
judging whether the user finishes wearing the VR equipment or not according to the wearing monitoring data;
when the user finishes wearing the VR equipment, a playing signal is generated;
and carrying out visual playing according to the playing signal and the VR image setting data.
6. The VR image playing method of claim 5, wherein the real-time adjusting the VR image setting data according to the tracking monitored data includes the following steps:
analyzing the data subjected to tracking monitoring in real time to generate real-time adjustment data;
and adjusting the VR image setting data in real time according to the real-time adjustment data to generate VR image adjustment data.
7. The VR image playback method of claim 6, wherein the real-time analysis of the exposure tracking monitor data to generate real-time adjustment data comprises:
scoring values according to the physiological real-time status of the user
Further calculating a bearing grade difference factor
Specifically, it is represented as:
wherein the content of the first and second substances,
represents the standard value of the user physiological state score,
representing the bearing grade difference factor.
8. The VR image playing method of claim 7, wherein the step of adjusting the VR image setting data in real time according to the real-time adjustment data to generate VR image adjustment data includes a formula:
wherein the content of the first and second substances,
indicates the VR tolerance level after the adjustment,
indicates the level of tolerance of the current VR,
indicating that the current VR withstand level is adjusted down by one level,
indicating that the current VR withstand level is down-regulated by two levels.
9. A VR video playback system, comprising:
the device comprises an initialization setting unit, a receiving unit and a processing unit, wherein the initialization setting unit is used for receiving VR image selection and bearing grade selection of a user, loading VR image data according to the VR image selection and the bearing grade selection, and carrying out initialization setting on the VR image data to generate VR image setting data;
the playing tracking monitoring unit is used for visually playing the VR image setting data, and carrying out bearing tracking monitoring on a user in the playing process to generate bearing tracking monitoring data;
the VR real-time adjusting unit is used for adjusting the VR image setting data in real time according to the tracking monitoring data to generate VR image adjusting data;
the VR adjusting and playing unit is used for adjusting and visually playing in real time according to the VR image adjusting data;
the initialization setting unit specifically includes:
the image selection receiving module is used for receiving VR image selection of a user and loading VR image data according to the VR image selection;
the grade selection module is used for receiving the bearing grade selection of a user and determining the VR bearing grade according to the bearing grade selection;
the initialization setting module is used for carrying out initialization setting on the VR image data according to the VR bearing grade to generate VR image setting data;
the playing tracking monitoring unit specifically comprises:
the visual playing module is used for visually playing the VR image setting data;
the heart rate monitoring module is used for tracking and monitoring the heart rate of the user in the playing process and generating heart rate tracking and monitoring data;
the humidity monitoring module is used for monitoring the palm humidity of the user in the playing process to generate palm humidity monitoring data;
the system comprises a calling monitoring module, a calling tracking module and a calling tracking module, wherein the calling monitoring module is used for carrying out calling tracking monitoring on a user in the playing process to generate calling tracking monitoring data;
the monitoring data generating module is used for integrating the heart rate tracking monitoring data, the palm humidity monitoring data and the cry tracking monitoring data to generate bearing tracking monitoring data;
the visual playing module specifically comprises:
the wearing monitoring sub-module is used for carrying out VR equipment wearing monitoring on a user and generating wearing monitoring data in real time;
the wearing judgment sub-module is used for judging whether the user finishes wearing the VR equipment according to the wearing monitoring data;
the signal generation submodule is used for generating a playing signal when the user finishes wearing the VR equipment;
and the visual playing submodule is used for carrying out visual playing according to the playing signal and the VR image setting data.
10. An apparatus for playing VR video, the apparatus comprising:
at least one processor;
at least one memory for storing at least one program;
when executed by the at least one processor, the at least one program causes the at least one processor to implement the VR image playback method as recited in any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211322333.7A CN115396655B (en) | 2022-10-27 | 2022-10-27 | VR image playing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211322333.7A CN115396655B (en) | 2022-10-27 | 2022-10-27 | VR image playing method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115396655A true CN115396655A (en) | 2022-11-25 |
| CN115396655B CN115396655B (en) | 2023-01-24 |
Family
ID=84128024
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211322333.7A Active CN115396655B (en) | 2022-10-27 | 2022-10-27 | VR image playing method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115396655B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106339084A (en) * | 2016-08-21 | 2017-01-18 | 乐视控股（北京）有限公司 | Control method and system for virtual reality equipment |
| CN107491166A (en) * | 2017-07-07 | 2017-12-19 | 深圳市冠旭电子股份有限公司 | A kind of method and virtual reality device for adjusting virtual reality device parameter |
| CN108290070A (en) * | 2015-10-01 | 2018-07-17 | Mc10股份有限公司 | Method and system for interacting with virtual environment |
| US20190265785A1 (en) * | 2018-12-17 | 2019-08-29 | Intel Corporation | Virtual reality adaptive display control |
| WO2021102577A1 (en) * | 2019-11-29 | 2021-06-03 | Electric Puppets Incorporated | System and method for virtual reality based human biological metrics collection and stimulus presentation |
| CN113274720A (en) * | 2021-06-11 | 2021-08-20 | 焦作大学 | Computer data acquisition method for virtual reality |
| CN114515428A (en) * | 2020-11-18 | 2022-05-20 | 华为技术有限公司 | Somatosensory interaction method and electronic equipment |
-
2022
- 2022-10-27 CN CN202211322333.7A patent/CN115396655B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108290070A (en) * | 2015-10-01 | 2018-07-17 | Mc10股份有限公司 | Method and system for interacting with virtual environment |
| CN106339084A (en) * | 2016-08-21 | 2017-01-18 | 乐视控股（北京）有限公司 | Control method and system for virtual reality equipment |
| CN107491166A (en) * | 2017-07-07 | 2017-12-19 | 深圳市冠旭电子股份有限公司 | A kind of method and virtual reality device for adjusting virtual reality device parameter |
| US20190265785A1 (en) * | 2018-12-17 | 2019-08-29 | Intel Corporation | Virtual reality adaptive display control |
| WO2021102577A1 (en) * | 2019-11-29 | 2021-06-03 | Electric Puppets Incorporated | System and method for virtual reality based human biological metrics collection and stimulus presentation |
| CN114515428A (en) * | 2020-11-18 | 2022-05-20 | 华为技术有限公司 | Somatosensory interaction method and electronic equipment |
| CN113274720A (en) * | 2021-06-11 | 2021-08-20 | 焦作大学 | Computer data acquisition method for virtual reality |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115396655B (en) | 2023-01-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10987596B2 (en) | Spectator audio analysis in online gaming environments | |
| CN114746159B (en) | Artificial Intelligence (AI) controlled camera view generator and AI broadcaster | |
| CN114746158B (en) | Artificial Intelligence (AI) controlled camera view generator and AI broadcaster | |
| CN104618446A (en) | Multimedia pushing implementing method and device | |
| CN106599123A (en) | Music playing method and system for use during exercise | |
| EP3473016A2 (en) | Method and system for automatically producing video highlights | |
| US20090144071A1 (en) | Information processing terminal, method for information processing, and program | |
| KR20170104846A (en) | Method and apparatus for analyzing virtual reality content | |
| CN107977184A (en) | A kind of method for playing music and device based on virtual reality technology | |
| CN111968678B (en) | Audio data processing method, device, equipment and readable storage medium | |
| CN116863058B (en) | Video data processing system based on GPU | |
| JP7302256B2 (en) | HIGHLIGHT MOVIE GENERATION PROGRAM, HIGHLIGHT MOVIE GENERATION METHOD, AND INFORMATION PROCESSING APPARATUS | |
| CN115396655B (en) | VR image playing method, device and system | |
| EP4347070A1 (en) | Simulating crowd noise for live events through emotional analysis of distributed inputs | |
| JP2022506486A (en) | Synchronous input feedback for machine learning | |
| KR20170105905A (en) | Method and apparatus for analyzing virtual reality content | |
| US11729479B2 (en) | Methods and systems for dynamic summary queue generation and provision | |
| CN108126341A (en) | A kind of method, apparatus and equipment of the seat parameter for adjusting Virtual Reality Platform | |
| Song et al. | The impact of black edge artifact on qoe of the fov-based cloud vr services | |
| CN109785861A (en) | Control method for playing multimedia, storage medium and terminal based on travelling data | |
| US20230199420A1 (en) | Real-world room acoustics, and rendering virtual objects into a room that produce virtual acoustics based on real world objects in the room | |
| CN111760276B (en) | Game behavior control method, device, terminal, server and storage medium | |
| JP7466087B2 (en) | Estimation device, estimation method, and estimation system | |
| WO2021240677A1 (en) | Video processing device, video processing method, training device, training method, and recording medium | |
| CN113032278A (en) | Method and device for confirming operation mode of application program and grade of terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |