CN107979763A - A kind of virtual reality device generation video, playback method, apparatus and system - Google Patents
A kind of virtual reality device generation video, playback method, apparatus and system Download PDFInfo
- Publication number
- CN107979763A CN107979763A CN201610921898.5A CN201610921898A CN107979763A CN 107979763 A CN107979763 A CN 107979763A CN 201610921898 A CN201610921898 A CN 201610921898A CN 107979763 A CN107979763 A CN 107979763A
- Authority
- CN
- China
- Prior art keywords
- video
- picture frames
- virtual reality
- generation
- play device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 238000009877 rendering Methods 0.000 claims abstract description 29
- 230000005540 biological transmission Effects 0.000 claims description 15
- 238000004891 communication Methods 0.000 claims description 11
- 230000006399 behavior Effects 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 10
- 230000007812 deficiency Effects 0.000 abstract description 5
- 208000002173 dizziness Diseases 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 10
- 238000003860 storage Methods 0.000 description 9
- 230000000007 visual effect Effects 0.000 description 8
- 230000003993 interaction Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000004438 eyesight Effects 0.000 description 3
- 238000007654 immersion Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008447 perception Effects 0.000 description 3
- 238000011946 reduction process Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 208000012886 Vertigo Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 229910002056 binary alloy Inorganic materials 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 239000008358 core component Substances 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000014860 sensory perception of taste Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 241000894007 species Species 0.000 description 1
- 238000004611 spectroscopical analysis Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
This application discloses a kind of method, apparatus of virtual reality device generation video, a kind of electronic equipment, a kind of video broadcasting method, device, another electronic equipment and a kind of audio/video player system.Wherein, the method for the virtual reality device generation video includes：VR picture frames are generated according to engine renders；The VR picture frames are subjected to coding and obtain video flowing；The video flowing is sent to video play device in real time to play for the video play device.By the way that coding generation video flowing will be carried out by the VR picture frames that render, and decoding broadcasting is carried out in other video play devices, it is poor, dizzy with the problem of lacking interactivity to compensate for the missing on mobile terminal due to hardware, the rendering effect that performance deficiency is brought.Meanwhile interacted when the operator is operated by the mixing of voice and audio between viewing user, improve interactivity.
Description
Technical field
This application involves technical field of virtual reality, and in particular to a kind of method of virtual reality device generation video, one
Kind video broadcasting method and a kind of audio/video player system；The application is related to a kind of dress of virtual reality device generation video at the same time
Put, a kind of electronic equipment, a kind of video play device and another electronic equipment.
Background technology
As virtual reality (virtual reality VR) technology is quickly grown, there are more and more virtual realities
Equipment.Virtual reality device is varied, with the raising of intelligent terminal performance, can also use smart mobile phone, tablet computer etc.
Intelligent terminal observes virtual scene.At present, in the virtual reality device of computer terminal user's vision, the sense of hearing or even portion can be allowed
On the spot in person in point tactile, feeling of immersion and telepresenc are stronger, can be interacted naturally very much with the object in virtual world；But
It is limited to the rendering capability of virtual scene on mobile terminals, is merely capable of realizing at present on mobile terminals in fixed viewpoint
Visual virtual scene.In addition, the virtual scene that most of virtual reality devices render can only be set by wearing virtual reality
Standby voluntarily viewing operation.
It can be seen from the above that under the implementation of existing virtual reality, since the missing of hardware can cause to hand on mobile terminal
Mutual means lack, the free degree is high experience makes the virtual scene effect that renders poor, separately also due to the deficiency of performance can produce dizzy
When external operator is operated, other users can not be made to watch virtual scene interaction poor, and operator carry out operation with
It cannot be interacted between viewing user.
The content of the invention
Method, a kind of video broadcasting method and one kind this application provides a kind of virtual reality device generation video regard
Frequency play system, to solve the above problem of the prior art.The application is related to a kind of virtual reality device generation video at the same time
Device, a kind of electronic equipment, a kind of video play device and another electronic equipment.
The embodiment of the present application provides a kind of method of virtual reality device generation video, the virtual reality device generation
The method of video, including：
VR picture frames are generated according to engine renders；
The VR picture frames are subjected to coding and obtain video flowing；
The video flowing is sent to video play device in real time to play for the video play device.
Optionally, it is described to send the video flowing for video play device broadcasting, bag to video play device in real time
Include：
It is dialogue-based to send the video flowing for video play device broadcasting to the video play device in real time.
Optionally, send what the video flowing was played for the video play device to video play device in real time described
Before step, including：
Session communication is established by conversation server with the video play device to link.
Optionally, before described the step of generating VR picture frames according to engine renders, including：
Receive the image demand information that the video play device is sent；
Correspondingly, described generate VR picture frames according to engine renders, including：
The image of demand in described image demand information is carried out rendering generation VR picture frames.
Optionally, described image demand information, including：Voice messaging.
Optionally, when described image demand information is voice messaging, to the image of demand in described image demand information into
Row renders generation VR picture frames, including：
The voice messaging is identified；
Obtain the image of the corresponding virtual scene of demand information identified to the voice messaging；
Described image is carried out to render generation VR picture frames.
Optionally, it is described by the VR picture frames carry out coding obtain video flowing when, further include：
Described image demand information is mixed with audio information when generating the VR picture frames.
Correspondingly, the embodiment of the present application additionally provides a kind of device of virtual reality device generation video, it is described virtual existing
The device of real equipment generation video, including：
VR picture frame generation units, for generating VR picture frames according to engine renders；
Video flowing acquiring unit, video flowing is obtained for the VR picture frames to be carried out coding；
Video stream unit, the video play device is supplied for sending the video flowing to video play device in real time
Play.
In addition, the embodiment of the present application additionally provides a kind of electronic equipment, including：
Display；
Processor；
Memory, for storing video coding program, described program performs as follows when reading execution by the processor
Operation:VR picture frames are generated according to engine renders；The VR picture frames are subjected to coding and obtain video flowing；In real time to video playing
Device sends the video flowing and is played for the video play device.
In addition, the embodiment of the present application additionally provides a kind of video broadcasting method, the video broadcasting method, including：
Receive the video flowing that video source is sent；
Parse and show that the video flowing obtains the VR picture frames after rendering.
Optionally, before the step of video flowing that the reception video source is sent, including：
Image demand information is sent to the video source；Described image demand information is voice messaging.
Optionally, the video flowing for receiving video source and sending, including：
The dialogue-based video flowing for receiving the video source and sending.
Optionally, before the step of video flowing that the reception video source is sent, including：
Session communication is established by conversation server with the video source to link.
Correspondingly, the embodiment of the present application additionally provides a kind of video play device, the video play device, including：
Video reception unit, for receiving the video flowing of video source transmission；
VR picture frame acquiring units, for parsing and showing that the video flowing obtains the VR picture frames after rendering.
In addition, the embodiment of the present application additionally provides another electronic equipment, including：
Display；
Processor；
Memory, for storing video reproduction program, described program performs as follows when reading execution by the processor
Operation:Receive the video flowing that video source is sent；Parse and show that the video flowing obtains the VR picture frames after rendering.
In addition, the embodiment of the present application additionally provides a kind of audio/video player system, the audio/video player system, including：
The device of above-mentioned virtual reality device generation video；And
Above-mentioned video play device.
Optionally, the audio/video player system, further includes：
Conversation server, between the square device of virtual reality device generation video and the video play device
Establish and maintain session communication linkage.
Compared with prior art, the application has the following advantages：
The method, apparatus and electronic equipment for a kind of virtual reality device generation video that the application provides, pass through basis
Engine renders generate VR picture frames；The VR picture frames are subjected to coding and obtain video flowing；Sent in real time to video play device
The video flowing is played for the video play device.
A kind of video broadcasting method, device and the electronic equipment that the application provides, by receiving regarding for video source transmission
Frequency flows；Decode and play the video flowing and obtain the VR picture frames after rendering.
The method of virtual reality device generation video is used in conjunction with each other with the video broadcasting method, by will be through
Cross the VR picture frames rendered and carry out coding generation video flowing, and decoding broadcasting is carried out in other video play devices, compensate for
The rendering effect brought on mobile terminal due to missing, the performance deficiency of hardware is poor, dizzy with the problem of lacking interactivity.Together
When, interacted when the operator is operated by the mixing of voice and audio between viewing user, improve interactivity.
Brief description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, below will be to embodiment or existing
There is attached drawing needed in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments described in application, for those of ordinary skill in the art, can also obtain other according to these attached drawings
Attached drawing.
Fig. 1 shows the flow chart of the method for the virtual reality device generation video provided according to an embodiment of the present application；
Fig. 2 shows the schematic diagram of the device of the virtual reality device generation video provided according to an embodiment of the present application；
Fig. 3 shows the schematic diagram of the electronic equipment provided according to an embodiment of the present application,
Fig. 4 shows the flow chart of the video broadcasting method provided according to an embodiment of the present application；
Fig. 5 shows the schematic diagram of the video play device provided according to an embodiment of the present application；
Fig. 6 shows the schematic diagram of the electronic equipment provided according to an embodiment of the present application；
Fig. 7 shows the schematic diagram of the audio/video player system provided according to an embodiment of the present application.
Embodiment
It is below in conjunction with the accompanying drawings and specific real in order to be more clearly understood that the above-mentioned purpose of the application, feature and advantage
Mode is applied the application is further described in detail.It should be noted that in the case where there is no conflict, the implementation of the application
Feature in example and embodiment can be mutually combined.
Many details are elaborated in the following description in order to fully understand the application.But the application can
Much to implement different from other manner described here, those skilled in the art can be in the feelings without prejudice to the application intension
Similar popularization is done under condition, therefore, the application from following public specific implementation limitation.
Embodiments herein provide a kind of method of virtual reality device generation video, a kind of video broadcasting method with
A kind of and audio/video player system；The application be related at the same time the device of virtual reality device generation video a kind of, a kind of electronic equipment,
A kind of video play device and another electronic equipment.It is described in detail one by one in the following embodiments.
At present, in the equipment of computer terminal user's vision, on the spot in person, feeling of immersion in the sense of hearing or even part tactile can be allowed
It is stronger with telepresenc, it can be interacted naturally very much with the object in virtual world；But on mobile terminals to virtual field
The rendering capability of scape is limited, is merely capable of realizing the visual virtual scene in fixed viewpoint at present on mobile terminals.This
Outside, the virtual scene that most of virtual reality devices render can only voluntarily watch operation by wearing virtual reality device.Thus may be used
See, under the implementation of existing virtual reality, since the missing of hardware can cause interactive means to lack, freely on mobile terminal
High experience is spent also due to the deficiency of performance can produce dizzy, is made the virtual scene effect that renders poor, is in addition carried out in operator
During operation, other users can not be made to watch virtual scene interaction poor, and operator is operated and watched between user not
It can interact.For this problem, the technical solution of the application by the VR picture frames rendered by will carry out coding generation
Video flowing, and decoding broadcasting is carried out in other video play devices, it compensate for missing, performance on mobile terminal due to hardware
Rendering effect that deficiency is brought is poor, dizzy with the problem of lacking interactivity.Meanwhile operator is made by the mixing of voice and audio
It can be interacted when being operated between viewing user, improve interactivity.
Before the specific steps of the present embodiment are described in detail, the virtual reality being first related to the technical program is made briefly
It is bright.
Virtual reality technology (VR) is a kind of can create and its utilization meter of the computer simulation system in the experiencing virtual world
It is a kind of interactive Three-Dimensional Dynamic what comes into a driver's of Multi-source Information Fusion and the system of entity behavior that calculation machine, which generates a kind of simulated environment,
Emulation makes user be immersed in the environment.Virtual reality technology is that an important directions of emulation technology are emulation technology and calculating
The set of the multiple technologies such as machine graphics human-machine interface technology multimedia technology sensing technology network technology is one rich in challenge
The interleaving techniques front subject and research field of property.Virtual reality technology mainly includes simulated environment, perception, natural technical ability and biography
Feel equipment etc..Simulated environment be generated by computer, dynamic 3 D stereo photorealism in real time.Perception refers to ideal
VR should have all people possessed by perceive.In addition to the visual perception that computer graphics techniques are generated, there is the sense of hearing, touch
The perception such as feel, power are felt, movement, or even smell and sense of taste etc. are further included, also referred to as perceive more.Natural technical ability refers to that the head of people turns
Dynamic, eyes, gesture or other human body behavior acts, the data adaptable with the action of participant are handled by computer, and right
Real-time response is made in the input of user, and feeds back to the face of user respectively.Sensing equipment refers to three-dimension interaction equipment.
The technical solution of the application is directed under virtual reality scenario, and virtual scene renders the high terminal of disposal ability to wash with watercolours
The method that the low terminal of dye disposal ability shares virtual scene, i.e.,：The terminal of the terminal of high throughput to reduction process ability is total to
Enjoy virtual reality real-time video.Wherein, the terminal of high throughput is to send a side of virtual reality real-time video, below
Video source is known as to the terminal of high throughput in the description of embodiment；The terminal of reduction process ability is to receive and play virtually now
One side of real real-time video, is known as video play device in the description of embodiment to the terminal of reduction process ability below, under
Elaborate in face of the present embodiment.
Embodiments herein provides a kind of method of virtual reality device generation video.The present embodiment is by completion image
The terminal for being rendered into VR picture frames is completed, and the terminal can be the VR equipment for having independent image disposal ability, can also be
One computer equipment.The embodiment of the method for the virtual reality device generation video is as follows：
Please refer to Fig.1, it illustrates the method for the virtual reality device generation video provided according to an embodiment of the present application
Flow chart.
The method of the virtual reality device generation video includes：
Step S101, VR picture frames are generated according to engine renders.
In the present embodiment, it is described to generate VR picture frames according to engine renders, it can realize in the following way：Video source
Current scene is rendered according to game engine, generates the VR picture frames of corresponding scene.Such as：By Unity engines,
Unreal, illusory 4 engine renders generation VR picture frames.
It should be noted that the game engine refers to：The core component of interactive realtime graphic application program.Game is drawn
Hold up and include following system：Rendering engine (i.e. " renderer ", engine containing two dimensional image and 3-D view engine), physical engine, touch
Hit detecting system, audio, script engine etc..
In the present embodiment, scene rendering work is completed by computer equipment, and made coordinating with the computer equipment
The VR picture frames of generation are shown in VR equipment.Specifically, the VR picture frames for the scene generation that the computer equipment renders
May than with the use of VR equipment display screen it is big, it is also possible to it is identical with the display screen size of VR equipment.
When the VR picture frames are bigger than the display screen of VR equipment, then the parts of images of only described VR picture frames is shown
In VR equipment, the image shown in VR equipment can be adjusted display according to the current location of VR equipment.Such as：Described
Left position shows house in VR picture frames, and personage is shown in centre position, and position display has an animal on the right, that
It may can only be shown in VR equipment and see a personage, and the animal of the river of left position and location right will not be at the same time
It is shown in VR equipment, when the position of VR equipment is adjusted, (carry out rotation and translation) then can show house in VR equipment
Or animal.
It should be understood that reach new position when the current location for the VR equipment being used cooperatively exceedes the VR picture frames
When, computer equipment can render to obtain a new VR picture frame according to the new position.
In the present embodiment, the computer equipment is to be carried out rendering generation VR images according to the demand of video play device
Frame, so needing first to obtain the image information of the video play device demand, then given birth in step S101 according to engine renders
, it is necessary to receive the image demand information that the video play device is sent before into VR picture frames.
The image demand information for receiving the video play device and sending, can realize in the following way：Calculate
Machine equipment is connected laggard row information interaction by procotols such as TCP/IP connections with the video play device, is regarded described in reception
The image demand information that frequency playing device is sent.Such as：Computer equipment is carried out by Ethernet and the video play device
Connection.
It should be noted that described image demand information is the information of the virtual scene of video play device demand, it is described
Image demand information can be transmitted by the form of voice messaging.When computer equipment receives described image demand information
When, speech recognition is carried out, is that voice messaging is identified so when performing step S101 according to engine renders generation VR picture frames
The corresponding scene of virtual scene information (image) of the demand gone out carries out rendering generation VR picture frames.Such as：The voice messaging
For city, then the City scenarios are carried out rendering the VR picture frames for generating corresponding urban environment.
In the present embodiment, the speech recognition is mainly converted to the voice signal of the voice messaging identifiable
Text message, such as：The voice signal of the voice messaging is converted into the binary system that computer equipment can identify or input
Coding or character string etc..The text message includes：Chinese text, Chinese word, phonetic, numeral, English words and/or English
Cliction language etc..Specifically, speech recognition process can use the audio recognition methods such as statistical-simulation spectrometry technology.
Since speech recognition is in itself there may be error rate, full text identification, the text envelope identified are directly carried out
Breath may be led to the failure due to some small identification mistakes, provide a kind of preferred embodiment in the present embodiment,
Under preferred embodiment, word segmentation processing can be carried out to the text message according to keyword dictionary set in advance, obtained multiple
Keyword, obtained keyword root is divided according to the type of keyword dictionary set in advance.
It should be noted that keyword dictionary set in advance only supports Chinese text and word, from the text message
Middle division obtains the keyword of multiple Chinese texts or Chinese type of word.By extracting identifiable keyword in voice messaging
Mode, the probability for being converted to identifiable text message mistake to reduce speech recognition errors to cause.
Such as：Keyword dictionary set in advance is the species progress to the supported virtual scene of the computer equipment
Division, is divided into City scenarios, scale Forest Scene and river scene etc. are crucial to Yingcheng City respectively according to different virtual scenes
Word, forest keyword and river keyword.
Step S103, carries out coding by the VR picture frames and obtains video flowing.
This step is that the step S101 VR picture frames gone out according to engine real-time rendering are carried out to the mistake of coding acquisition video flowing
Journey.
In the present embodiment, it is described that the VR picture frames are subjected to coding acquisition video flowing, can be real in the following way
It is existing：The VR picture frames shown in the display screen for the VR equipment being used cooperatively with the computer equipment are subjected to coding and obtain video
Stream.
It should be noted that the video flowing (Video Streaming) refers to the transmission of video data, such as：Video
Stream can be transmitted by stable as one and continuous stream by network.
It should be understood that since the angular field of view of user is limited, the image of the VR picture frames shown in the VR equipment is just
It is the visual range of the observable virtual scene of user, so the VR picture frames shown in VR equipment are carried out coding formation
Video flowing can meet the needs of user is to virtual scene.
In the specific implementation, the VR picture frames shown in the display screen of VR equipment are carried out by H264 video compression algorithms
Coding obtains video flowing.H.264 it is compression of digital video form, is a kind of video encoding and decoding standard.
When watching VR picture frames using the VR equipment being used cooperatively with the computer equipment, since the computer is set
The standby virtual scene that renders is larger, and when user watches the VR picture frames by video play device, will not normally stay in
Same position longer time, so needing the conversion by view position, makes the VR being used cooperatively with the computer equipment
The image of the other positions in VR picture frames is shown in equipment, so except video play device needs in described image demand information
Outside the information for the virtual scene asked, visual angle effect order is further included.
It should be noted that described image demand information is transmitted by procotols such as TCP/IP connections, institute
To send visual angle effect order, the meter using any moment that the user of video play device can be when watching virtual scene
Machine equipment is calculated to be parsed after described image demand information is received, and according to the visual angle effect order adjustment parsed and institute
The current location for the VR equipment that computer equipment is used cooperatively is stated, changes in VR equipment the image shown.Such as：Described image needs
Information is sought to turn left, turning right, up or down.
In order to using the user of video play device in vision, it is acoustically on the spot in person, increase feeling of immersion and telepresenc energy
Interacted naturally very much with the object in virtual world, the technical solution of the present embodiment provides one kind side of being preferable to carry out
Formula, under preferred embodiment, it is described by the VR picture frames carry out coding obtain video flowing when, by described image demand information with
Audio information when generating the VR picture frames is mixed.
It should be understood that when the computer equipment receives described image demand information, described image demand is believed
Breath is played out by loudspeaker, since when playing, the computer equipment has rendered corresponding virtual scene, in void
Intend that corresponding audio can be had according to the difference of scene in scene, so by described image demand information with generating the VR images
When audio information during frame is mixed, can also corresponding audio be carried out to described image demand information and rendered.Such as：Closing
Under the virtual scene in room, the described image demand information to be mixed increases echo audio.
Step S105, sends the video flowing to video play device in real time and is played for the video play device.
In the present embodiment, it is described to be broadcast in real time to the video play device transmission video flowing for the video play device
Put, can realize in the following way：After computer equipment is connected by real time streaming transport protocol with the video play device
Information exchange is carried out, send the video flowing to video play device in real time plays for the video play device.
It should be noted that the real time streaming transport protocol (rtsp Real Time Streaming Protocol), is
An application layer protocol in ICP/IP protocol system, controls the transmission of real time data.The agreement is used for C/S models, is one
Text based agreement, for being established when both ends communicate and consulting real-time streaming session.Rtsp is established and controlled one or several
The continuous Streaming Media of time synchronization.
In the present embodiment, it is described to be broadcast in real time to the video play device transmission video flowing for the video play device
It is to set up connection by session (session) to put, and sends to the video play device regarded described in the video flowing confession in real time
Frequency playing device plays.
The session is to send to establish chain with the video play device to conversation server by the computer equipment
After the request connect, established the link by the conversation server between the computer equipment and the video play device.Institute
The address for the video play device for needing to establish connection can be carried by stating in the request established the link.
It should be noted that the session is the method for the dialogue-based server for hold mode.Session allows to lead to
Cross to be stored in object in the memory of conversation server and any object is kept during whole user conversation.Session is to be used for two
Unbroken request response sequence is established during the communication of end.
In the above-described embodiment, there is provided a kind of method of virtual reality device generation video, with above-mentioned virtual reality
The method of equipment generation video is corresponding, and present invention also provides a kind of square device of virtual reality device generation video.By
The embodiment of method is substantially similar in the embodiment of device, so describing fairly simple, related part is implemented referring to method
The part explanation of example.Device embodiment described below is only schematical.The virtual reality device generates video
Square device embodiment it is as follows：
Please refer to Fig.2, it illustrates side's dress of the virtual reality device generation video provided according to an embodiment of the present application
The schematic diagram put.
The square device of the virtual reality device generation video, including：VR picture frames generation unit 201, video flowing obtain
Unit 203 and video stream unit 205；
The VR picture frames generation unit 201, for generating VR picture frames according to engine renders；
The video flowing acquiring unit 203, video flowing is obtained for the VR picture frames to be carried out coding；
The video stream unit 205, the video is supplied for sending the video flowing to video play device in real time
Playing device plays.
Optionally, the VR picture frames generation unit 201, specifically for generating VR picture frames according to engine renders.
Optionally, the video stream unit 205, sends out to the video play device in real time specifically for dialogue-based
The video flowing is sent to be played for the video play device.
Optionally, the square device of virtual reality device generation video, further includes：Communicate to connect unit；
The communication connection unit, for supplying the video to the video play device transmission video flowing in real time described
Before playing device plays, session information is established with the video play device by conversation server and is linked.
Optionally, the square device of virtual reality device generation video, further includes：Demand information receiving unit；
The demand information receiving unit, for it is described according to engine renders generate VR picture frames before, described in reception
The image demand information that video play device is sent；
Correspondingly, the VR picture frames generation unit 201, specifically for the image to demand in described image demand information
Carry out rendering generation VR picture frames.
Optionally, the demand information receiving unit, the image demand information of the video play device transmission of reception
For voice messaging.
Optionally, the square device of virtual reality device generation video, further includes：Audio mixed cell；
The audio mixed cell, for it is described by the VR picture frames carry out coding obtain video flowing when, will described in
Image demand information is mixed with audio information when generating the VR picture frames.
In the above-described embodiment, there is provided the method and a kind of virtual reality of a kind of virtual reality device generation video
Equipment generates the square device of video, in addition, present invention also provides a kind of electronic equipment；The electronic equipment embodiment is as follows：
Please refer to Fig.3, it illustrates the schematic diagram of the electronic equipment provided according to an embodiment of the present application.
The electronic equipment, including：Display 301；Processor 303；Memory 305；
The memory 305, for storing video coding program, described program read by the processor perform when,
Perform following operation:VR picture frames are generated according to engine renders；The VR picture frames are subjected to coding and obtain video flowing；In real time to
Video play device sends the video flowing and is played for the video play device.
In the above-described embodiment, there is provided a kind of method, a kind of virtual reality of virtual reality device generation video are set
The square device and a kind of electronic equipment of standby generation video, in addition, present invention also provides a kind of video broadcasting method；It is described to regard
Frequency playback method embodiment is as follows：
Please refer to Fig.4, it illustrates the flow chart of the video broadcasting method provided according to an embodiment of the present application.
The video broadcasting method, including：
Step S401, receives the video flowing that video source is sent.
The present embodiment is completed by the video play device of broadcasting video flowing, and the video play device passes through wired or wireless
Mode be attached with computer equipment, the video play device is only responsible for receiving regarding of sending in real time of computer equipment
Frequency flows, and is shown after decoding, and not responsible renders work.
It should be noted that the video play device includes smart mobile phone, the tablet computer of android, ios system
Deng.The video play device at least has central processing unit (CPU), mainboard, the image processing unit for handling image
(GPU), memory, display screen, audio/video decoder and virtual reality peripheral element.
Such as：The video play device is the smart mobile phone of Android system, then the audio/video decoder can be pre-
The hardware compression such as mediacodec first with android interface is realized.
In the present embodiment, the video flowing for receiving video source and sending, can realize in the following way：Video playing
Device is connected laggard row information interaction by real time streaming transport protocol with the computer equipment, receives the video that video source is sent
Stream.
It should be noted that the video flowing (Video Streaming) refers to the transmission of video data, such as：Video
Stream can be transmitted by stable as one and continuous stream by network；The real time streaming transport protocol is rtsp videos
Flow host-host protocol.
In the present embodiment, the video flowing for receiving video source transmission is to set up connection by session (session),
Receive the video flowing that the video source is sent.The session is to conversation server by the video play device
After sending the request established the link with the computer equipment, by the conversation server for the video play device with it is described
Established the link between computer equipment.The computer equipment for needing to establish connection can be carried in the request established the link
Address.
It should be noted that the session is the method for the dialogue-based server for hold mode.Session allows to lead to
Cross to be stored in object in the memory of conversation server and any object is kept during whole user conversation.Session is to be used for two
Unbroken request response sequence is established during the communication of end.
In the present embodiment, the video flowing that the video play device receives is the demand according to video play device
Carry out rendering what is formed after generation VR picture frames encode, so needing first to inform the virtual scene that computer equipment is rendered
Information, then, it is necessary to send image demand information to the video source before receiving the video flowing of video source transmission in step S401；
Described image demand information is voice messaging.
It is described to send image demand information to the video source, it can realize in the following way：The video playing dress
Put and be connected laggard row information interaction with the computer equipment by procotols such as TCP/IP connections, sent to the video source
Image demand information.Such as：The video play device is attached by Ethernet and the computer equipment.
It should be noted that described image demand information is the information of the virtual scene of video play device demand, it is described
Image demand information can be transmitted by the form of voice messaging.Specifically, the video play device can be passed through
Microphone gathers voice messaging input by user.Such as：User is city by microphone input " city ", the then voice messaging
City.
Step S403, parses and shows that the video flowing obtains the VR picture frames after rendering.
In the present embodiment, it is described to parse and show that the video flowing obtains the VR picture frames after rendering.It can use such as
Under type is realized：Read the video flowing received, the audio and video solution that the video flowing is passed through into the video play device
Code device is decoded, the VR picture frames after obtaining that the video flowing is corresponding and rendering, and is shown in the video play device
The VR picture frames.It should be noted that the VR figures that the video play device is got after the video flowing is decoded
As frame is VR picture frames.
Such as：If the video flowing that the video play device receives is formed by H264 video compression algorithms,
So when being decoded to the video flowing, it is also desirable to decoded using H264 decoding standards.
The VR picture frames got after the video flowing is decoded due to the video play device are VR picture frames,
The technical solution of the present embodiment provides a kind of preferred embodiment, under preferred embodiment, is decoded to the video flowing
When can to VR picture frames carry out split screen processing.In this step, the processing of simplest split screen be, for example, by VR picture frames into
Row diminution is handled, and is replicated the VR picture frames after reducing and is carried out left and right arrangement, generates the VR for being adapted to left eye and right eye to watch at the same time
Picture frame.
When user watches the VR picture frames using the video play device, rendered due to the computer equipment
Virtual scene is larger, and the VR picture frames be with the use of VR equipment in the VR picture frames that are shown, can not be complete
The whole virtual scenes rendered are shown entirely, or the display VR picture frames are not the user using the video play device
Want viewing, then need to change the position for the VR equipment being used cooperatively with the computer equipment, make to set with the computer
The image of the other positions in VR picture frames is shown in the standby VR equipment being used cooperatively, so the video play device can be to institute
State computer equipment and send the image demand information for carrying visual angle effect order.
It should be noted that described image demand information is transmitted by procotols such as TCP/IP connections, institute
To send visual angle effect order using any moment that the user of video play device can be when watching virtual scene.Such as：
Described image demand information is to turn left, turn right, up or down.
Embodiments herein proposes video broadcasting method, has played the performance of the hardware decoder of video play device,
Decoding broadcasting easily can be carried out to VR videos, avoid spinning sensation caused by can not being rendered due to performance condition.
In the above-described embodiment, there is provided a kind of video broadcasting method, it is corresponding with above-mentioned video broadcasting method, this
Application additionally provides a kind of video play device.Since the embodiment of device is substantially similar to the embodiment of method, so description
Must be fairly simple, the relevent part can refer to the partial explaination of embodiments of method.Device embodiment described below is only to show
Meaning property.The video play device embodiment is as follows：
Fig. 5 is refer to, it illustrates the schematic diagram of the video play device provided according to an embodiment of the present application.
The video play device, including：Video reception unit 501 and VR picture frames acquiring unit 503；
The video reception unit 501, for receiving the video flowing of video source transmission；
The VR picture frames acquiring unit 503, for parsing and showing that the video flowing obtains the VR picture frames after rendering.
Optionally, the VR picture frames acquiring unit 503, specifically for parsing and playing after the video flowing obtains and render
VR picture frames.
Optionally, the video play device, further includes：Demand information transmitting element；
The demand information transmitting element, for it is described reception video source send video flowing before, to the video
Source sends image demand information；Described image demand information is voice messaging.
Optionally, the video reception unit 501, regards specifically for dialogue-based receive described in the video source transmission
Frequency flows.
Optionally, the video play device, further includes：Connection setup unit；
The connection setup unit, for before the video flowing that the reception video source is sent, passing through conversation server
Session communication is established with the video source to link.
In the above-described embodiment, there is provided a kind of method, a kind of virtual reality of virtual reality device generation video are set
Square device, a kind of electronic equipment, a kind of video broadcasting method and a kind of video play device of standby generation video, in addition, this
Application additionally provides another electronic equipment；The electronic equipment embodiment is as follows：
Fig. 6 is refer to, it illustrates the schematic diagram of the electronic equipment provided according to an embodiment of the present application.
The electronic equipment, including：Display 601；Processor 603；Memory 605；
The memory 605, for storing video reproduction program, described program read by the processor perform when,
Perform following operation:Receive the video flowing that video source is sent；Parse and show that the video flowing obtains the VR picture frames after rendering.
In the above-described embodiment, there is provided a kind of method, a kind of virtual reality of virtual reality device generation video are set
Square device, a kind of electronic equipment, a kind of video broadcasting method, a kind of video play device and another electricity of standby generation video
Sub- equipment, in addition, present invention also provides a kind of audio/video player system；The audio/video player system embodiment is as follows：
Fig. 7 is refer to, it illustrates the schematic diagram of the audio/video player system provided according to an embodiment of the present application.
The audio/video player system, including：Virtual reality device generates the square device 701 and video play device of video
703；
The square device 701 of the virtual reality device generation video, VR picture frames are generated according to engine renders；By described in
VR picture frames carry out coding and obtain video flowing；The video flowing is sent to video play device supply the video play device in real time
Play；
The video play device 703, receives the video flowing that video source is sent；Parse and show that the video flowing obtains
VR picture frames after rendering.
Wherein, the square device 701 of virtual reality device generation video can be arranged with computer, but being not limited to
This equipment, the method that above-mentioned virtual reality device generation video can be that by, and hardware condition props up enough with performance
Hold any equipment rendered to virtual scene；The video play device 703 can arrange with mobile terminal, but not office
It is limited to this equipment, any equipment of above-mentioned video broadcasting method can be that by.
Optionally, the audio/video player system, further includes：Conversation server；
The conversation server, square device and the video play device for virtual reality device generation video
Between establish and maintain session communication linkage.
In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net
Network interface and memory.
Memory may include computer-readable medium in volatile memory, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Memory is computer-readable medium
Example.
1st, computer-readable medium can be by any side including permanent and non-permanent, removable and non-removable media
Method or technology realize that information stores.Information can be computer-readable instruction, data structure, the module of program or other numbers
According to.The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM
(SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only storage
(ROM), electrically erasable programmable read-only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc are read-only
Memory (CD-ROM), digital versatile disc (DVD) or other optical storages, magnetic cassette tape, tape magnetic rigid disk storage or
Other magnetic storage apparatus or any other non-transmission medium, the information that can be accessed by a computing device available for storage.According to
Herein defines, and computer-readable medium does not include non-temporary computer readable media (transitory media), such as modulates
Data-signal and carrier wave.
2nd, it will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer program production
Product.Therefore, the application can use the embodiment in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Form.Moreover, the application can use the computer for wherein including computer usable program code in one or more can use
The computer program product that storage medium is implemented on (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
Form.
Although the application is disclosed as above with preferred embodiment, it is not for limiting the application, any this area skill
Art personnel are not being departed from spirit and scope, can make possible variation and modification, therefore the guarantor of the application
Shield scope should be subject to the scope that the application claim is defined.
Claims (17)
- A kind of 1. method of virtual reality device generation video, it is characterised in that including：VR picture frames are generated according to engine renders；The VR picture frames are subjected to coding and obtain video flowing；The video flowing is sent to video play device in real time to play for the video play device.
- 2. the method for virtual reality device generation video according to claim 1, it is characterised in that described in real time to video Playing device sends the video flowing and is played for the video play device, including：It is dialogue-based to send the video flowing for video play device broadcasting to the video play device in real time.
- 3. the method for virtual reality device according to claim 2 generation video, it is characterised in that it is described in real time to regarding Before frequency playing device sends the step of video flowing is played for the video play device, including：Session communication is established by conversation server with the video play device to link.
- 4. the method for virtual reality device generation video according to claim 1, it is characterised in that described according to engine Before the step of rendering generation VR picture frames, including：Receive the image demand information that the video play device is sent；Correspondingly, described generate VR picture frames according to engine renders, including：The image of demand in described image demand information is carried out rendering generation VR picture frames.
- 5. the method for virtual reality device generation video according to claim 4, it is characterised in that described image demand is believed Breath, including：Voice messaging.
- 6. the method for virtual reality device generation video according to claim 5, it is characterised in that described image demand is believed Cease for voice messaging when, the image of demand in described image demand information is carried out to render generation VR picture frames, including：The voice messaging is identified；Obtain the image of the corresponding virtual scene of demand information identified to the voice messaging；Described image is carried out to render generation VR picture frames.
- 7. the method for virtual reality device generation video according to claim 6, it is characterised in that described by the VR When picture frame carries out coding acquisition video flowing, further include：Described image demand information is mixed with audio information when generating the VR picture frames.
- A kind of 8. device of virtual reality device generation video, it is characterised in that including：VR picture frame generation units, for generating VR picture frames according to engine renders；Video flowing acquiring unit, video flowing is obtained for the VR picture frames to be carried out coding；Video stream unit, broadcasts for sending the video flowing to video play device in real time for the video play device Put.
- 9. a kind of electronic equipment, it is characterised in that the electronic equipment, including：Display；Processor；Memory, for storing video coding program, described program performs following behaviour when reading execution by the processor Make:VR picture frames are generated according to engine renders；The VR picture frames are subjected to coding and obtain video flowing；Filled in real time to video playing Put and send the video flowing for video play device broadcasting.
- A kind of 10. video broadcasting method, it is characterised in that including：Receive the video flowing that video source is sent；Parse and show that the video flowing obtains the VR picture frames after rendering.
- 11. video broadcasting method according to claim 10, it is characterised in that in the video that the reception video source is sent Before the step of stream, including：Image demand information is sent to the video source；Described image demand information is voice messaging.
- 12. video broadcasting method according to claim 10, it is characterised in that the video for receiving video source and sending Stream, including：The dialogue-based video flowing for receiving the video source and sending.
- 13. video broadcasting method according to claim 12, it is characterised in that in the video that the reception video source is sent Before the step of stream, including：Session communication is established by conversation server with the video source to link.
- A kind of 14. video play device, it is characterised in that including：Video reception unit, for receiving the video flowing of video source transmission；VR picture frame acquiring units, for parsing and showing that the video flowing obtains the VR picture frames after rendering.
- 15. a kind of electronic equipment, it is characterised in that the electronic equipment, including：Display；Processor；Memory, for storing video reproduction program, described program performs following behaviour when reading execution by the processor Make:Receive the video flowing that video source is sent；Parse and show that the video flowing obtains the VR picture frames after rendering.
- A kind of 16. audio/video player system, it is characterised in that including：The device of virtual reality device generation video according to the claims 8；AndVideo play device according to claim 14.
- 17. audio/video player system according to claim 16, it is characterised in that further include：Conversation server, for being established between the square device of virtual reality device generation video and the video play device And maintain session communication linkage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610921898.5A CN107979763B (en) | 2016-10-21 | 2016-10-21 | Virtual reality equipment video generation and playing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610921898.5A CN107979763B (en) | 2016-10-21 | 2016-10-21 | Virtual reality equipment video generation and playing method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107979763A true CN107979763A (en) | 2018-05-01 |
| CN107979763B CN107979763B (en) | 2021-07-06 |
Family
ID=62004638
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610921898.5A Active CN107979763B (en) | 2016-10-21 | 2016-10-21 | Virtual reality equipment video generation and playing method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107979763B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108810554A (en) * | 2018-06-15 | 2018-11-13 | 腾讯科技（深圳）有限公司 | Scene image transmission method, computer equipment and the storage medium of virtual scene |
| CN108965959A (en) * | 2018-08-10 | 2018-12-07 | Tcl通力电子（惠州）有限公司 | Broadcasting, acquisition methods, mobile phone, PC equipment and the system of VR video |
| CN109510990A (en) * | 2018-10-25 | 2019-03-22 | 深圳市腾讯信息技术有限公司 | Image processing method and device, computer readable storage medium, electronic equipment |
| CN110807111A (en) * | 2019-09-23 | 2020-02-18 | 北京铂石空间科技有限公司 | Three-dimensional graph processing method and device, storage medium and electronic equipment |
| CN111064985A (en) * | 2018-10-16 | 2020-04-24 | 北京凌宇智控科技有限公司 | System, method and device for realizing video streaming |
| CN111093142A (en) * | 2019-12-24 | 2020-05-01 | 杭州当虹科技股份有限公司 | VR-based multi-direction sound source synthesis implementation method |
| WO2021078182A1 (en) * | 2019-10-22 | 2021-04-29 | 华为技术有限公司 | Playback method and playback system |
| CN112969098A (en) * | 2019-12-13 | 2021-06-15 | 阿里巴巴集团控股有限公司 | Engine architecture and apparatus for interactive video |
| CN113141346A (en) * | 2021-03-16 | 2021-07-20 | 青岛小鸟看看科技有限公司 | Streaming-based VR-multiservice system and method |
| CN113176868A (en) * | 2021-03-16 | 2021-07-27 | 青岛小鸟看看科技有限公司 | One-to-many system and method of intelligent equipment |
| CN115174954A (en) * | 2022-08-03 | 2022-10-11 | 抖音视界有限公司 | Video live broadcast method and device, electronic equipment and storage medium |
| US11500455B2 (en) | 2018-10-16 | 2022-11-15 | Nolo Co., Ltd. | Video streaming system, video streaming method and apparatus |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103095828A (en) * | 2013-01-14 | 2013-05-08 | 上海电力学院 | Web three dimensional (3D) synchronous conference system based on rendering cloud and method of achieving synchronization |
| CN103197757A (en) * | 2012-01-09 | 2013-07-10 | 癸水动力（北京）网络科技有限公司 | Immersion type virtual reality system and implementation method thereof |
| CN103812761A (en) * | 2012-11-13 | 2014-05-21 | 三星电子株式会社 | Apparatus and method for providing social network service using augmented reality |
| CN104731343A (en) * | 2015-04-14 | 2015-06-24 | 上海云富网络科技有限公司 | Virtual reality man-machine interaction children education experience system based on mobile terminal |
| CN104915979A (en) * | 2014-03-10 | 2015-09-16 | 苏州天魂网络科技有限公司 | System capable of realizing immersive virtual reality across mobile platforms |
| CN105096373A (en) * | 2015-06-30 | 2015-11-25 | 华为技术有限公司 | Media content rendering method, user device and rendering system |
| CN105450736A (en) * | 2015-11-12 | 2016-03-30 | 小米科技有限责任公司 | Method and device for establishing connection with virtual reality |
| WO2016049187A1 (en) * | 2014-09-23 | 2016-03-31 | Lincolnpeak | Systems, methods, and software for processing a question relative to one or more of a plurality of population research databases |
| CN105791977A (en) * | 2016-02-26 | 2016-07-20 | 北京视博云科技有限公司 | Virtual reality data processing method and system based on cloud service and devices |
| CN105843380A (en) * | 2016-03-17 | 2016-08-10 | 广东小天才科技有限公司 | Environmental temperature simulation method and device for virtual reality scene |
| CN105869215A (en) * | 2016-03-28 | 2016-08-17 | 上海米影信息科技有限公司 | Virtual reality imaging system |
| CN105892683A (en) * | 2016-04-29 | 2016-08-24 | 上海乐相科技有限公司 | Display method and target equipment |
| CN105894570A (en) * | 2015-12-01 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Virtual reality scene modeling method and device |
| CN105913478A (en) * | 2015-12-28 | 2016-08-31 | 乐视致新电子科技（天津）有限公司 | 360-degree panorama display method and display module, and mobile terminal |
| CN105976424A (en) * | 2015-12-04 | 2016-09-28 | 乐视致新电子科技（天津）有限公司 | Image rendering processing method and device |
| CN106021273A (en) * | 2016-04-25 | 2016-10-12 | 北京光年无限科技有限公司 | Method and system for processing information facing question answering robot |
-
2016
- 2016-10-21 CN CN201610921898.5A patent/CN107979763B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103197757A (en) * | 2012-01-09 | 2013-07-10 | 癸水动力（北京）网络科技有限公司 | Immersion type virtual reality system and implementation method thereof |
| CN103812761A (en) * | 2012-11-13 | 2014-05-21 | 三星电子株式会社 | Apparatus and method for providing social network service using augmented reality |
| CN103095828A (en) * | 2013-01-14 | 2013-05-08 | 上海电力学院 | Web three dimensional (3D) synchronous conference system based on rendering cloud and method of achieving synchronization |
| CN104915979A (en) * | 2014-03-10 | 2015-09-16 | 苏州天魂网络科技有限公司 | System capable of realizing immersive virtual reality across mobile platforms |
| WO2016049187A1 (en) * | 2014-09-23 | 2016-03-31 | Lincolnpeak | Systems, methods, and software for processing a question relative to one or more of a plurality of population research databases |
| CN104731343A (en) * | 2015-04-14 | 2015-06-24 | 上海云富网络科技有限公司 | Virtual reality man-machine interaction children education experience system based on mobile terminal |
| CN105096373A (en) * | 2015-06-30 | 2015-11-25 | 华为技术有限公司 | Media content rendering method, user device and rendering system |
| CN105450736A (en) * | 2015-11-12 | 2016-03-30 | 小米科技有限责任公司 | Method and device for establishing connection with virtual reality |
| CN105894570A (en) * | 2015-12-01 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Virtual reality scene modeling method and device |
| CN105976424A (en) * | 2015-12-04 | 2016-09-28 | 乐视致新电子科技（天津）有限公司 | Image rendering processing method and device |
| CN105913478A (en) * | 2015-12-28 | 2016-08-31 | 乐视致新电子科技（天津）有限公司 | 360-degree panorama display method and display module, and mobile terminal |
| CN105791977A (en) * | 2016-02-26 | 2016-07-20 | 北京视博云科技有限公司 | Virtual reality data processing method and system based on cloud service and devices |
| CN105843380A (en) * | 2016-03-17 | 2016-08-10 | 广东小天才科技有限公司 | Environmental temperature simulation method and device for virtual reality scene |
| CN105869215A (en) * | 2016-03-28 | 2016-08-17 | 上海米影信息科技有限公司 | Virtual reality imaging system |
| CN106021273A (en) * | 2016-04-25 | 2016-10-12 | 北京光年无限科技有限公司 | Method and system for processing information facing question answering robot |
| CN105892683A (en) * | 2016-04-29 | 2016-08-24 | 上海乐相科技有限公司 | Display method and target equipment |
Non-Patent Citations (2)
| Title |
|---|
| HAN SUK KIM ET AL: "High Resolution Video Playback in Immersive Virtual Environments", 《 2009 IEEE VIRTUAL REALITY CONFERENCE》 * |
| 杨光: "AMD用卓越技术成就用户完美体验", 《产品与技术》 * |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019237821A1 (en) * | 2018-06-15 | 2019-12-19 | 腾讯科技（深圳）有限公司 | Method and apparatus for transmitting scene image of virtual scene, computer device and computer readable storage medium |
| US11831566B2 (en) | 2018-06-15 | 2023-11-28 | Tencent Technology (Shenzhen) Company Limited | Method and apparatus for transmitting scene image of virtual scene, computer device, and computer-readable storage medium |
| CN108810554A (en) * | 2018-06-15 | 2018-11-13 | 腾讯科技（深圳）有限公司 | Scene image transmission method, computer equipment and the storage medium of virtual scene |
| CN108810554B (en) * | 2018-06-15 | 2021-06-22 | 腾讯科技（深圳）有限公司 | Scene image transmission method of virtual scene, computer device and storage medium |
| CN108965959A (en) * | 2018-08-10 | 2018-12-07 | Tcl通力电子（惠州）有限公司 | Broadcasting, acquisition methods, mobile phone, PC equipment and the system of VR video |
| US11500455B2 (en) | 2018-10-16 | 2022-11-15 | Nolo Co., Ltd. | Video streaming system, video streaming method and apparatus |
| CN111064985A (en) * | 2018-10-16 | 2020-04-24 | 北京凌宇智控科技有限公司 | System, method and device for realizing video streaming |
| CN109510990A (en) * | 2018-10-25 | 2019-03-22 | 深圳市腾讯信息技术有限公司 | Image processing method and device, computer readable storage medium, electronic equipment |
| CN110807111A (en) * | 2019-09-23 | 2020-02-18 | 北京铂石空间科技有限公司 | Three-dimensional graph processing method and device, storage medium and electronic equipment |
| WO2021078182A1 (en) * | 2019-10-22 | 2021-04-29 | 华为技术有限公司 | Playback method and playback system |
| CN112969098A (en) * | 2019-12-13 | 2021-06-15 | 阿里巴巴集团控股有限公司 | Engine architecture and apparatus for interactive video |
| CN111093142B (en) * | 2019-12-24 | 2021-06-08 | 杭州当虹科技股份有限公司 | VR-based multi-direction sound source synthesis implementation method |
| CN111093142A (en) * | 2019-12-24 | 2020-05-01 | 杭州当虹科技股份有限公司 | VR-based multi-direction sound source synthesis implementation method |
| CN113176868A (en) * | 2021-03-16 | 2021-07-27 | 青岛小鸟看看科技有限公司 | One-to-many system and method of intelligent equipment |
| CN113176868B (en) * | 2021-03-16 | 2022-11-15 | 青岛小鸟看看科技有限公司 | One-to-many system and method of intelligent equipment |
| CN113141346A (en) * | 2021-03-16 | 2021-07-20 | 青岛小鸟看看科技有限公司 | Streaming-based VR-multiservice system and method |
| CN113141346B (en) * | 2021-03-16 | 2023-04-28 | 青岛小鸟看看科技有限公司 | VR one-to-multiple system and method based on series flow |
| CN115174954A (en) * | 2022-08-03 | 2022-10-11 | 抖音视界有限公司 | Video live broadcast method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107979763B (en) | 2021-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107979763A (en) | A kind of virtual reality device generation video, playback method, apparatus and system | |
| CN112543342B (en) | Virtual video live broadcast processing method and device, storage medium and electronic equipment | |
| CN111010586B (en) | Live broadcast method, device, equipment and storage medium based on artificial intelligence | |
| CN108200446B (en) | On-line multimedia interaction system and method of virtual image | |
| US10897646B2 (en) | Video stream transmission method and related device and system | |
| US20190325652A1 (en) | Information Processing Method and Apparatus | |
| US10477179B2 (en) | Immersive video | |
| US20200092600A1 (en) | Method and apparatus for presenting video information | |
| US20220392224A1 (en) | Data processing method and apparatus, device, and readable storage medium | |
| CN111163360B (en) | Video processing method, video processing device, computer-readable storage medium and computer equipment | |
| CN113570686A (en) | Virtual video live broadcast processing method and device, storage medium and electronic equipment | |
| US11451858B2 (en) | Method and system of processing information flow and method of displaying comment information | |
| CN110446114A (en) | Multimedia data processing device, method, electronic equipment and storage medium | |
| CN111464828A (en) | Virtual special effect display method, device, terminal and storage medium | |
| CN110134487A (en) | Dynamic skin change method, readable storage medium storing program for executing and the computer equipment at interface is broadcast live | |
| CN112492324A (en) | Data processing method and system | |
| CN117876543A (en) | Interactive application method based on digital person | |
| CN108347654A (en) | Online live broadcast mode switching device and method | |
| CN117544808A (en) | Device control method, storage medium, and electronic device | |
| CN114339197A (en) | Video playing test method, device and equipment | |
| CN114339074A (en) | Comment video generation method and device, computer equipment and storage medium | |
| CN107659805B (en) | A kind of video conversion method and device | |
| WO2024222599A1 (en) | Processing method and apparatus for haptic media, and storage medium, electronic device and program product | |
| US11695488B2 (en) | ATSC over-the-air (OTA) broadcast of public volumetric augmented reality (AR) | |
| CN107948128A (en) | A kind of method for realizing digital education interaction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1254563 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |