CN111193964A - Method and device for controlling video content in real time according to physiological signals - Google Patents
Method and device for controlling video content in real time according to physiological signals Download PDFInfo
- Publication number
- CN111193964A CN111193964A CN202010020744.5A CN202010020744A CN111193964A CN 111193964 A CN111193964 A CN 111193964A CN 202010020744 A CN202010020744 A CN 202010020744A CN 111193964 A CN111193964 A CN 111193964A
- Authority
- CN
- China
- Prior art keywords
- video
- original
- physiological
- user
- physiological characteristic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Abstract
The invention discloses a method and a device for controlling video content in real time according to physiological signals, which are used for VR equipment and comprise the following steps: shooting a plurality of original videos by the camera device according to the instruction; acquiring user information, setting a physiological characteristic threshold value related to the interest point and storing the physiological characteristic threshold value; identifying and playing the original video which is best matched with the user; and acquiring the physiological signal of the user in real time, comparing the physiological signal with the physiological characteristic threshold value, and changing the playing state of the original video in real time according to the result. By the method and the device, a set of optimal original VR video can be selected according to personal preference and physical conditions, the playing state of the VR video can be adjusted at any time according to the physiological needs of a user in the watching process, including real-time switching-in or switching-back of original VR video segments, so that the shocking experience of the user for watching the VR video in multiple directions, multiple visual angles and multiple seasons is met, the interestingness and satisfaction are greatly improved, the physical health of the user is ensured, and the method and the device are humanized.
Description
Technical Field
The invention relates to the field of electronic equipment, in particular to a method and a device for controlling video content in real time according to physiological signals.
Background
At present, the tourism industry is developed, but tourists mostly watch famous scenic spots in a 'horse-looking' manner under the guidance of a travel agency, and due to the limitation of time, energy and cost, the tourists cannot experience multiple scenic spots in person, and particularly are luxury for friends with serious diseases or disabilities. At present, VR product mainly takes amusement as the main, also is used for the tourism trade, but mainly utilizes computer program to generate a simulated environment, and the user can produce one kind in the vision and immerse in virtual reality's environment experience when using virtual reality product, can satisfy people's some experience wish, but can not satisfy people to oneself well-known mountain river, the true of scenic spot ancient trails carry out the multiple visual angle, diversified view and admire to the four seasons scenery, especially can not satisfy people according to the comprehensive of real-time experience control to a certain view, the enjoyment of feeling to the greatest extent.
Disclosure of Invention
In order to solve the above problems, the present invention provides a method and an apparatus for controlling video content in real time according to physiological signals, which can first select a set of optimal original VR video according to personal preferences and physical conditions, and adjust the playing status of the VR video at any time according to the physiological needs during the watching process, including switching in the relevant original VR video segment or switching back the original VR video segment to the VR video status in real time, so as to satisfy users' shocking experiences in watching VR videos from multiple directions and multiple angles, thereby greatly increasing interest and satisfaction, and simultaneously ensuring the physical health of users and being humanized.
The specific technical scheme provided by the invention is as follows:
a method for controlling video content in real time in response to a physiological signal for a VR device, comprising the steps of:
shooting a plurality of original videos by the camera device according to the instruction;
acquiring user information, setting a physiological characteristic threshold value related to the interest point and storing the physiological characteristic threshold value;
identifying and playing the original video which is best matched with the user;
and acquiring the physiological signal of the user in real time, comparing the physiological signal with the physiological characteristic threshold value, and changing the playing state of the original video in real time according to the result.
Preferably, the original video includes a VR video, and the method for changing the play state of the VR video includes:
switching between normal play, fast play and slow play;
transforming paths and focal lengths of objects or scenes in the VR video;
cut-in or cut-back of the relevant original VR video segment.
The VR video and VR video clip include 3600And (6) panoramic VR video.
Preferably, the VR equipment for playing the VR video is provided with a main control module, an image acquisition device, an induction module, a storage module, an identification module and a playing module;
the user physiological signal comprises a physiological characteristic index signal and a physiological characteristic state signal;
the method for acquiring the physiological characteristic index signal comprises the following steps:
the sensing module senses and acquires a physiological characteristic index signal of a user in real time and transmits the physiological characteristic index signal to the main control module;
the main control module obtains the category of the user interest point through comparison;
and according to a preset instruction, the main control module controls the playing module to change the playing state of the VR video or switch into the related original VR video clip.
Preferably, the method of acquiring the physiological characteristic indicator signal further comprises:
the sensing module acquires heart rate, blood pressure and electroencephalogram values of the user in real time and transmits the values to the main control module in real time;
the main control module is compared with the preset physiological characteristic threshold value to acquire the interest point category of the user;
the physiological characteristic index grouping threshold in the physiological characteristic threshold is set as: normal, active, excited, and personalized time thresholds; the corresponding user interest points are generally interesting, interesting and very interesting.
Preferably, the method for acquiring the physiological characteristic state signal comprises the following steps:
the image acquisition device acquires an eye state image in real time and transmits the eye state image to the main control module;
the main control module obtains the user interest point category through comparison;
according to a preset instruction, the main control module controls the playing module to switch the playing state of the VR video or switch the related original VR video clip.
Preferably, the method for acquiring the state change of the physiological characteristic further comprises the following steps:
the image acquisition device acquires the change state of the eyes of the user in real time;
the main control module is compared with the physiological characteristic threshold value to obtain the user interest point category;
the physiological characteristic state grouping threshold in the physiological characteristic threshold is set as: normal, wide open, up and down and/or left and right eye movement, squinting, and personalized time thresholds;
the interest points of the corresponding users are classified as general interest, very interest and no longer interest.
Preferably, the original VR video segment is formed by:
classifying and encoding the plurality of original VR videos;
performing substance identification and scene identification on each original VR video, cutting a target object, a scene and a path into fragments, classifying and coding;
classifying and coding VR frequency fragments of the same scene in different original VR videos;
forming an original VR video clip.
Preferably, the method of switching into the original VR video segment or switching back:
the main control module comprehensively judges according to the change result of the physiological signal of the user and the currently played video content transmitted by the identification module:
the master control module identifies and cuts in an original VR video clip with the same content as the currently played VR video from the plurality of original VR video clips;
or the original VR video clip is cut back to the VR video which is played currently.
Preferably, the VR device and the computer are connected through the internet, and the internet includes a 3G network, a 4G network, a 5G network, and a WiFi network.
Preferably, the apparatus comprises:
a VR device including:
the main control module is connected with the computer and used for transmitting data and controlling the playing of the VR video;
the playing module is connected with the main control module and used for controlling a display screen to play the VR video;
the sensing module senses and acquires physiological characteristic information in real time and is connected with the main control module;
the identification module is connected with the main control module and used for identifying the original VR video and the original VR video fragment;
the image acquisition device acquires the eye state in real time;
the storage module is used for storing the cache VR video;
a computer, comprising:
the memory is used for storing a preset physiological characteristic index grouping threshold value and an individualized time threshold value, a physiological characteristic state grouping threshold value and an individualized time threshold value, an original VR video and an original VR video clip;
a processor having a computing function for processing a user physiological signal; processing the shot video into a VR video; classifying and coding the original VR video to generate an original VR video segment, and classifying and coding the original VR video segment;
and the camera device is used for shooting the original video.
According to the method and the device for controlling the video content in real time according to the physiological signals, a professional photographer and/or an unmanned aerial vehicle shoots a certain scenic spot including a specific target according to preset requirements and collection and analysis of user enthusiasm spots to form a plurality of original VR videos, wherein the original VR videos include 360 DEG C0A panoramic VR video; the user selects the best original VR video according to the preference, age and expectation of the user, plays the video and watches the videoIn the process, the VR all-in-one machine is provided with a main control module which is used for converting the normal playing of the original VR video into quick playing or slowing down the playing or cutting into the related original video clip according to the real-time physiological characteristic information of the user, so that the shock experience of watching the VR video by the user in multiple directions and multiple visual angles is met, the interestingness and the satisfaction are greatly increased, meanwhile, the body health of the user is ensured, and the VR all-in-one machine is humanized.
The invention has the beneficial effects that:
the invention provides a method and a device for controlling video content in real time according to physiological signals, which can firstly select an optimal original VR video according to personal preference and physical conditions, can adjust the playing state of the VR video to be watched at any time according to the physiological needs of a user in the watching process, comprises switching in relevant original VR video segments or switching back to the currently watched VR video in real time, meets the shocking experience of watching the VR video in multiple directions and multiple visual angles and in different seasons, greatly increases interest and satisfaction, ensures the physical health of the user, and is humanized.
Drawings
FIG. 1 is a schematic diagram of the structural relationship of the present invention;
FIG. 2 is a schematic diagram of the flow relationships of the present invention;
fig. 3 is a schematic diagram of the present invention for real-time switching of the broadcast status according to the physiological signal.
Wherein: 1-VR integrated machine; 2-a computer; 3-a light field camera; 4-a display screen; 5-a playing module; 6-an identification module; 7-a main control module; 8-a sensing device; 9-a communication module; 10-an image acquisition device; 11-a storage module; 12-a processor; 13-a reservoir.
Detailed Description
As used in the specification and in the claims, certain terms are used to refer to particular components. As one skilled in the art will appreciate, manufacturers may refer to a component by different names. This specification and claims do not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms "include" and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to,"; "plurality" should be interpreted as "more than or equal to two". The description which follows is a preferred embodiment of the present application, but is made for the purpose of illustrating the general principles of the application and not for the purpose of limiting the scope of the application. The protection scope of the present application shall be subject to the definitions of the appended claims.
As shown in fig. 1-3, in one embodiment, an apparatus for controlling video content in real time according to physiological signals is provided, which includes a VR all-in-one machine 1, a computer 2 and a light field camera 3. Communication connection is established between VR all-in-one 1 and the computer 2, and through communication module 9 connection VR all-in-one 1 and computer 2 between transmission data, light field camera 3 is connected with computer 2.
VR all-in-one 1 includes:
the main control module 7 is connected with the computer 2 and used for transmitting data, original video VR (virtual reality) videos and original VR video clips;
the playing module 5 is connected with the main control module 7 and controls the playing module 5 to enable the display screen 4 to play the VR video;
the sensing module 8 senses and acquires physiological characteristic information in real time and is connected with the main control module 7;
the identification module 6 is connected with the main control module 7 and used for identifying the related original VR video clips;
the communication module 9 is connected with the main control module 7 and the computer 2;
the storage module 11 is configured to cache an original VR video and the original VR video segment;
the image acquisition device 10 is connected with the main control module 7 and the display screen 4 and is used for acquiring the eye state information of the user;
and the display screen 4 is connected with the playing module 5.
The computer 2 includes:
the memory 13 is used for storing preset physiological characteristic index grouping threshold values and personalized time threshold values, physiological characteristic state grouping threshold values and personalized time threshold values, original VR videos and original VR video clips;
the communication module 9 is in communication connection with the VR integrated machine 1;
a processor 12 having a computing function for processing the physiological signals of the user and storing the processing results in a memory 13; processing the shot video into a VR video; and classifying and coding the original VR video to generate the original VR video segment, and classifying and coding the original VR video segment.
And the light field camera 3 is used for shooting the original video.
The invention provides a method for controlling video content in real time according to physiological signals, which is used for a VR (virtual reality) all-in-one machine 1 and comprises the following steps:
the light field camera 3 shoots a plurality of original VR videos according to the instruction;
acquiring user information, setting a physiological characteristic threshold value related to the interest point and storing the physiological characteristic threshold value in a storage 13 of the computer 2;
an identification module 6 of the VR machine 1 identifies and plays the original video which is optimally matched with the user;
the sensing device 8 and the image acquisition device 10 of the VR machine 1 acquire the physiological signals of the user in real time, compare the physiological signals with the physiological characteristic threshold value, and change the playing state of the original video on the display screen 4 when the playing module 5 is controlled by the fruiting main control module 7.
The VR all-in-one machine 1 acquires a preset physiological characteristic index grouping threshold value and a preset personalized time threshold value, a physiological characteristic state grouping threshold value and a preset personalized time threshold value, the original VR video and the original VR video fragment from a storage 13 of the computer 2 through a communication module 9, and caches the physiological characteristic index grouping threshold value and the personalized time threshold value in the storage module 11.
In one embodiment, the camera device captures a plurality of original videos according to instructions from the collection and analysis of past user's enthusiastic spots, a photographic image formed by a professional photographer and/or by a drone using a light field camera 3 to capture a scene including a specific object, scene, path, the photographic image including 360 processed by the processor 12 of the computer 20And (6) panoramic VR video.
Preferably, the user information includes a preference, age, and desire of the user.
Preferably, the playing state includes a playing speed, i.e. switching between normal playing, fast playing and slow playing; transforming paths and focal lengths of objects or scenes in the VR video; cut-in or cut-back of the relevant original VR video segment.
Preferably, the physiological signal includes a physiological characteristic index acquired by the sensing device 8 in real time and a signal of a physiological characteristic state acquired by the image acquisition device 10 in real time.
The change of the physiological characteristic indexes comprises the contrast change of blood pressure, heart rate and brain waves with the indexes collected before watching the VR video;
preferably, the physiological characteristic index is set as three groups of threshold values of a normal value, an active value and an excitation value according to the age of the user and the measured physical physiological characteristic index information, the time threshold value is set as an individualized time threshold value according to the difference of the user, and the interest points of the user corresponding to the physiological characteristic index grouping threshold value are classified as general interest, interest and great interest and are stored in the storage 13 of the computer 2.
The change of the physiological characteristic state comprises state change information and time information of the eyes, and the physiological characteristic state grouping threshold is set as follows: normal, wide open, eyeball up and down and/or left and right moving, squinting, the time threshold is set as the personalized time threshold;
the physiological characteristic state grouping threshold corresponds to a point of interest classification of the user as generally interesting, highly interesting, no longer interesting and is stored in the memory 13 of the computer 2.
Preferably, the main control module 7 changes the playing state of the VR video in time according to preset parameters for the physical and age conditions of different users in the storage 13 of the computer 2, so as to ensure the physical health of the users.
Preferably, the VR all-in-one machine 1 includes a main control module 7, an image acquisition device 10, a sensing module 8, a storage module 11, an identification module 6, and a playing module 5, wherein the main control module 7 is electrically connected to the image acquisition device 10, the playing module 5, the storage module 11, the identification module 6, and the sensing module 8, respectively.
The user physiological signal comprises a change signal of a physiological characteristic index, and the acquisition method comprises the following steps:
the sensing module 8 senses and acquires the physiological characteristic index of the user in real time and transmits the physiological characteristic index to the main control module 7;
the main control module 7 analyzes the user interest point information from the variation value of the physiological characteristic index;
according to a preset instruction, the main control module 7 controls the playing state of the playing module 5 on the current VR video, or switches into the related original VR video clip.
Preferably, the method for acquiring the change of the physiological characteristic index comprises the following steps:
the sensing module 8 acquires physiological characteristic indexes of the user including heart rate, blood pressure and brain waves in real time and transmits the physiological characteristic indexes to the main control module 7 in real time.
In one embodiment, when a user watches the VR video, when the physiological characteristic index obtained by the sensing device 8 in real time is transmitted to the main control module 7, the main control module 7 compares the physiological characteristic index with the physiological characteristic index grouping threshold of the storage 13, when the physiological characteristic index of the user is analyzed to be an active value and the time reaches a preset personalized time threshold, the user is interested in the video content, and the main control module 7 controls the playing speed of the VR video to be slowed down or the focal length to be changed so as to meet the expectation of the user; when the physiological characteristic index of the user belongs to the excitation value and the time reaches a preset personalized time threshold value, the video content which is very interesting to the user is obtained, the main control module 7 is switched into a plurality of relevant VR video clips shot from other angles in real time to meet the expectation of the user, when the physiological characteristic index of the user belongs to the normal value, the video content which is generally interesting to the user is obtained, and the video content is switched back to the VR video which is played currently to continue playing.
Preferably, the user physiological signal further includes a change signal of the physiological characteristic state, and the obtaining method includes:
the image acquisition device 10 acquires an eye state image in real time and transmits the eye state image to the main control module 7;
the main control module 7 analyzes the user's desire information from the state change of the eye image;
according to a preset instruction, the main control module 7 switches the playing state of the playing module 5 to the current VR video, or switches into the related original VR video segment.
Preferably, the method for acquiring the change of the physiological characteristic state comprises the following steps:
the image acquisition device 10 acquires the opening and closing, squinting and moving direction states of eyes of a user in real time and transmits the moving direction states to the main control module 7 in real time;
in one embodiment, when the image capturing device 10 obtains that the eyes of the user are in an open state, the main control module 7 compares the physiological characteristic state grouping threshold and the personalized time threshold preset in the storage 13, and analyzes that the user is interested in the VR video played in real time, and controls the playing speed of the VR video to be slower or the focal length to be changed; when the image acquisition device 10 acquires that the eyeballs of the user are in the upward and downward and/or leftward and rightward moving states, the main control module 7 compares the physiological characteristic state grouping threshold and the personalized time threshold preset in the storage 13, so that the user is informed of being very interested in the real-time played VR video, and relevant original VR video segments shot from other angles are cut in real time to meet the expectation of the user; when the user's eyes are obtained, the user is informed that the VR video played in real time is not interested any more, and the user switches back to the VR video played currently to continue playing.
Preferably, the original VR video segment is formed by:
the processor 12 of the computer 2 classifies and codes the original VR videos;
slicing, classifying and coding a target object in each original VR video;
performing substance identification and scene identification on each original VR video, cutting a target object, a scene and a path into fragments, classifying and coding;
forming an original VR video clip, which is stored in said storage 13.
Preferably, the method for changing the playing state of the VR video includes:
when the playing module 5 plays the current VR video, the normal speed is changed into fast playing or slow playing, or the fast playing and slow playing are switched;
the playing module 5 changes the path and the focal length of a target object or a scene when playing the current VR video;
and a cut-in or a cut-back of the original VR video segment associated with the target content to the current VR video.
Preferably, the method of switching into the original VR video segment or switching back:
the main control module 7 comprehensively judges according to the change value of the physiological characteristic index and/or the change signal of the physiological characteristic state and the currently played video content transmitted by the identification module 6:
the main control module 7 identifies and cuts in an original VR video segment with the same content as the currently played VR video from the plurality of original VR video segments;
and cutting back the original VR video clip to the VR video which is played currently according to the physiological signal or preset time of the user.
Preferably, the original VR video is formed by:
original data are quantized from a photographic image sample, and a plurality of shooting tracks are preset;
installing a light field camera 3 on a spherical surface to carry out 360-degree panoramic shooting and obtaining a plurality of frames of pictures;
splicing adjacent frame pictures, and splicing the overlapped parts by using a weighted average method;
respectively carrying out field splicing on multi-frame pictures of a far frame, a middle frame and a near frame to complete a panoramic video;
a plurality of original VR videos are processed by a processor 12 provided in the computer 2 and stored in the memory 13.
The communication module 9 is connected through the internet, and the internet comprises a 3G, a 4G, a 5G network or a wifi network.
The foregoing describes several preferred embodiments of the present application, but, as noted above, it is to be understood that the application is not limited to the forms disclosed herein, but is not to be construed as excluding other embodiments and is capable of use in various other combinations, modifications, and environments and is capable of changes within the scope of the inventive concept as expressed herein, commensurate with the above teachings, or the skill or knowledge of the relevant art. And that modifications and variations may be effected by those skilled in the art without departing from the spirit and scope of the application, which is to be protected by the claims appended hereto.
Claims (10)
1. A method for controlling video content in real-time in response to a physiological signal for use in a VR device, comprising: the method comprises the following steps:
shooting a plurality of original videos by the camera device according to the instruction;
acquiring user information, setting a physiological characteristic threshold value related to the interest point and storing the physiological characteristic threshold value;
identifying and playing the original video which is best matched with the user;
and acquiring the physiological signal of the user in real time, comparing the physiological signal with the physiological characteristic threshold value, and changing the playing state of the original video in real time according to the result.
2. The method of claim 1, wherein the video content is controlled in real time according to the physiological signal, and the method further comprises: the original video comprises a VR video, and the method for converting the playing state of the VR video comprises the following steps:
switching between normal play, fast play and slow play;
transforming paths and focal lengths of objects or scenes in the VR video;
cut-in or cut-back of the relevant original VR video segment.
3. The method of real-time controlling video content according to physiological signals of claim 2, wherein: the VR equipment for playing the VR video is provided with a main control module, an image acquisition device, an induction module, a storage module, an identification module and a playing module;
the user physiological signal comprises a physiological characteristic index signal and a physiological characteristic state signal;
the method for acquiring the physiological characteristic index signal comprises the following steps:
the sensing module senses and acquires a physiological characteristic index signal of a user in real time and transmits the physiological characteristic index signal to the main control module;
the main control module obtains the category of the user interest point through comparison;
and according to a preset instruction, the main control module controls the playing module to change the playing state of the VR video or switch into the related original VR video clip.
4. A method for controlling video content in real time according to physiological signals as claimed in claim 3, wherein: the method of obtaining the physiological characteristic indicator signal further comprises:
the sensing module acquires heart rate, blood pressure and electroencephalogram values of the user in real time and transmits the values to the main control module in real time;
the main control module is compared with the preset physiological characteristic threshold value to acquire the interest point category of the user;
the physiological characteristic index grouping threshold in the physiological characteristic threshold is set as: normal, active, excited, and personalized time thresholds; the corresponding user interest points are generally interesting, interesting and very interesting.
5. A method for controlling video content in real time according to physiological signals as claimed in claim 3, wherein: the method for acquiring the physiological characteristic state signal comprises the following steps:
the image acquisition device acquires an eye state image in real time and transmits the eye state image to the main control module;
the main control module obtains the user interest point category through comparison;
according to a preset instruction, the main control module controls the playing module to switch the playing state of the VR video or switch the related original VR video clip.
6. The method of real-time controlling video content according to physiological signals of claim 5, wherein: the method for acquiring the state change of the physiological characteristic further comprises the following steps:
the image acquisition device acquires the change state of the eyes of the user in real time;
the main control module is compared with the physiological characteristic threshold value to obtain the user interest point category;
the physiological characteristic state grouping threshold in the physiological characteristic threshold is set as: normal, wide open, up and down and/or left and right eye movement, squinting, and personalized time thresholds;
the interest points of the corresponding users are classified as general interest, very interest and no longer interest.
7. The method according to any one of claims 2 to 6, wherein the video content is controlled in real time according to the physiological signal, and the method comprises the following steps: the original VR video clip forming method comprises the following steps:
classifying and encoding the plurality of original VR videos;
performing substance identification and scene identification on each original VR video, cutting a target object, a scene and a path into fragments, classifying and coding;
classifying and coding VR frequency fragments of the same object in different original VR videos;
forming an original VR video clip.
8. The method of real-time controlling video content according to physiological signals of claim 7, wherein: method of switching in the original VR video segment or switching back:
the main control module comprehensively judges according to the change result of the physiological signal of the user and the currently played video content transmitted by the identification module:
the master control module identifies and cuts in an original VR video clip with the same content as the currently played VR video from the plurality of original VR video clips;
or the original VR video clip is cut back to the VR video which is played currently.
9. The method of claim 8, wherein the video content is controlled in real time according to the physiological signal, and the method further comprises: the VR equipment with the computer passes through internet connection, the internet contains 3G network, 4G network, 5G network and wiFi network.
10. An apparatus for controlling video content in real time based on a physiological signal, the apparatus comprising:
a VR device including:
the main control module is connected with the computer and used for transmitting data and controlling the playing of the VR video;
the playing module is connected with the main control module and used for controlling a display screen to play the VR video;
the sensing module senses and acquires physiological characteristic information in real time and is connected with the main control module;
the identification module is connected with the main control module and used for identifying the original VR video and the original VR video fragment;
the image acquisition device acquires the eye state in real time;
the storage module is used for storing the cache VR video;
a computer, comprising:
the memory is used for storing a preset physiological characteristic index grouping threshold value and an individualized time threshold value, a physiological characteristic state grouping threshold value and an individualized time threshold value, an original VR video and an original VR video clip;
a processor having a computing function for processing a user physiological signal; processing the shot video into a VR video; classifying and coding the original VR video to generate an original VR video segment, and classifying and coding the original VR video segment;
and the camera device is used for shooting the original video.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010020744.5A CN111193964A (en) | 2020-01-09 | 2020-01-09 | Method and device for controlling video content in real time according to physiological signals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010020744.5A CN111193964A (en) | 2020-01-09 | 2020-01-09 | Method and device for controlling video content in real time according to physiological signals |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111193964A true CN111193964A (en) | 2020-05-22 |
Family
ID=70709887
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010020744.5A Pending CN111193964A (en) | 2020-01-09 | 2020-01-09 | Method and device for controlling video content in real time according to physiological signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111193964A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112717343A (en) * | 2020-11-27 | 2021-04-30 | 杨凯 | Method and device for processing sports data, storage medium and computer equipment |
| CN113676758A (en) * | 2021-07-13 | 2021-11-19 | 北京奇艺世纪科技有限公司 | Index generation method, client, server, electronic device, and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104246660A (en) * | 2012-03-16 | 2014-12-24 | 英特尔公司 | System and method for dynamic adaption of media based on implicit user input and behavior |
| US20160089028A1 (en) * | 2014-09-25 | 2016-03-31 | Harman International Industries, Inc. | Media player automated control based on detected physiological parameters of a user |
| CN107491166A (en) * | 2017-07-07 | 2017-12-19 | 深圳市冠旭电子股份有限公司 | A kind of method and virtual reality device for adjusting virtual reality device parameter |
-
2020
- 2020-01-09 CN CN202010020744.5A patent/CN111193964A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104246660A (en) * | 2012-03-16 | 2014-12-24 | 英特尔公司 | System and method for dynamic adaption of media based on implicit user input and behavior |
| US20160089028A1 (en) * | 2014-09-25 | 2016-03-31 | Harman International Industries, Inc. | Media player automated control based on detected physiological parameters of a user |
| CN107491166A (en) * | 2017-07-07 | 2017-12-19 | 深圳市冠旭电子股份有限公司 | A kind of method and virtual reality device for adjusting virtual reality device parameter |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112717343A (en) * | 2020-11-27 | 2021-04-30 | 杨凯 | Method and device for processing sports data, storage medium and computer equipment |
| CN113676758A (en) * | 2021-07-13 | 2021-11-19 | 北京奇艺世纪科技有限公司 | Index generation method, client, server, electronic device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Wu et al. | A dataset for exploring user behaviors in VR spherical video streaming | |
| Kim et al. | Vrsa net: Vr sickness assessment considering exceptional motion for 360 vr video | |
| US9247201B2 (en) | Methods and systems for realizing interaction between video input and virtual network scene | |
| CN106303555B (en) | A kind of live broadcasting method based on mixed reality, device and system | |
| Itti | Automatic foveation for video compression using a neurobiological model of visual attention | |
| CN1905629B (en) | Image capturing apparatus and image capturing method | |
| JP6282769B2 (en) | Engagement value processing system and engagement value processing device | |
| CN103229174B (en) | Display control unit, integrated circuit and display control method | |
| US20180227482A1 (en) | Scene-aware selection of filters and effects for visual digital media content | |
| US10088896B2 (en) | Queasiness management for virtual reality systems | |
| CN111726518A (en) | System for capturing images and camera device | |
| KR102055481B1 (en) | Method and apparatus for quantitative evaluation assessment of vr content perceptual quality using deep running analysis of vr sickness factors | |
| US10541000B1 (en) | User input-based video summarization | |
| US11748870B2 (en) | Video quality measurement for virtual cameras in volumetric immersive media | |
| CN110166827A (en) | Determination method, apparatus, storage medium and the electronic device of video clip | |
| JP2020039029A (en) | Video distribution system, video distribution method, and video distribution program | |
| CN111193964A (en) | Method and device for controlling video content in real time according to physiological signals | |
| CN107124662A (en) | Net cast method, device, electronic equipment and computer-readable recording medium | |
| CN101971608A (en) | Method and apparatus to provide a physical stimulus to a user, triggered by a motion detection in a video stream | |
| CN107895161B (en) | Real-time attitude identification method and device based on video data and computing equipment | |
| KR102239134B1 (en) | Broadcast system for provides athletic video taken with VR cameras attached to drones | |
| CN109299326A (en) | Video recommendation method and device, system, electronic equipment and storage medium | |
| CN111442464A (en) | Air conditioner and control method thereof | |
| CN106708257A (en) | Game interaction method and device | |
| CN113596558A (en) | Interaction method, device, processor and storage medium in game live broadcast |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200522 |