CN106507115A - Based on the coding/decoding method of the VR videos of iOS device, device and terminal device - Google Patents
Based on the coding/decoding method of the VR videos of iOS device, device and terminal device Download PDFInfo
- Publication number
- CN106507115A CN106507115A CN201611086076.6A CN201611086076A CN106507115A CN 106507115 A CN106507115 A CN 106507115A CN 201611086076 A CN201611086076 A CN 201611086076A CN 106507115 A CN106507115 A CN 106507115A
- Authority
- CN
- China
- Prior art keywords
- data
- video
- hard decoder
- session
- frame data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The embodiment of the invention discloses a kind of player method of the VR videos based on iOS device, device and terminal device, the method includes：Obtain the VR video stream datas based on RTMP agreements；Picture frame data, the image frame data fit AVFrame data structure is extracted from the VR video datas；The application programming interfaces of hardware decoding assembly in the iOS device are called, hard decoder session is created；Hard decoder is carried out by hardware decoding assembly in the iOS device to the picture frame data, output is applied to the video playback data of iOS device.The video data based on RTMP agreements is decoded by hard decoder mode, avoid the problem of the section excessive cycle of the video data of HLS protocol, it also avoid by CPU come the problem that decoding efficiency is low, power consumption and heat condition are serious caused by soft decoding video data, without the need for adjusting to the hardware of existing iOS device, ability to play of the iOS device to VR videos can be improved from software view, with very strong application prospect.
Description
Technical field
The present invention relates to video decoding techniques field, more particularly to a kind of player method of the VR videos based on iOS device,
Device and terminal device.
Background technology
VR (Virtual Reality) video is typically by the common camera by a group (2 or more) by specific
The panoramic camera that combines of mode shoot and form.Multichannel common camera can be clapped after the completion of shooting by panoramic video
Take the photograph gained frame of video to be spliced into the VR frame of video of a 2D to store so that the video capacity of VR frame of video is relative to common shooting
Machine is shot the video to want big many.
Currently, people often play VR using iOS device (for example conventional iPhone mobile phones, iPad panel computers) and regard
Frequently, current iOS device is all based on HLS (HTTP Live Streaming), used as host-host protocol, this HLS protocol can be right
Video carries out slice transmission, and every time the interval of section is 10 seconds, due to the video capacity of VR videos larger, each slice transmission
Time-consuming longer so that have significant delays when iOS device is to play VR videos, have a strong impact on user viewing.
Content of the invention
The purpose of the embodiment of the present invention is to provide a kind of coding/decoding method of the VR videos based on iOS device, device and terminal
Equipment, for solving the above problems.
For solving above-mentioned technical problem, the embodiment of the present invention provides a kind of coding/decoding method of the VR videos based on iOS device,
Including：
Obtain the VR video datas based on RTMP agreements；
Picture frame data, the image frame data fit AVFrame data structure is extracted from the VR video datas；
The application programming interfaces of hardware decoding assembly in the iOS device are called, hard decoder session is created；
According to the hard decoder session, the picture frame data are carried out by hardware decoding assembly in the iOS device
Hard decoder, output are applied to the video playback data of iOS device.
In an embodiment of the present invention, picture frame data are extracted from the VR video datas, is specifically included：
According to player analysis protocol, the VR video datas are converted to H.264 data flow, the H.264 data flow
Including picture frame data and description data；
Picture frame data are extracted in the H.264 data flow.
In an embodiment of the present invention, hard decoder session is created, is specifically included：
Scan data is extracted in the H.264 data flow；
Obtain the sequence parameter set and picture parameter set in the scan data；
Sequence parameter set and picture parameter set according to being extracted creates video format description information；
Hard decoder session is created according to video format description information, the picture format exported by the hard decoder session is
NV12.
In an embodiment of the present invention, the picture frame data are carried out by hardware decoding assembly in the iOS device
Hard decoder, specifically includes：
By each image frame data input to the hardware decoding assembly, by the hardware decoding assembly to each picture frame number
According to carrying out hard decoder.
In an embodiment of the present invention, according to the hard decoder session, by hardware decoding assembly pair in the iOS device
After the picture frame data carry out hard decoder, methods described also includes：
Nullify the hard decoder session.
In an embodiment of the present invention, according to the hard decoder session, by hardware decoding assembly pair in the iOS device
After the picture frame data carry out hard decoder, methods described also includes：
Eyes are carried out to the video data of hard decoder and renders process, to play the VR video datas.
For solving above-mentioned technical problem, the embodiment of the present invention provides a kind of decoding apparatus of the VR videos based on iOS device,
Including：
Data acquisition module, for obtaining the VR video datas based on RTMP agreements；
Data conversion module, for extracting picture frame data, the image frame data fit from the VR video datas
AVFrame data structures；
Conversation establishing module, for calling the application programming interfaces of hardware decoding assembly in the iOS device, creates hard solution
Code session；
Data solve module firmly, for being carried out firmly to the picture frame data by hardware decoding assembly in the iOS device
Decoding, output are applied to the video playback data of iOS device.
In an embodiment of the present invention, the data conversion module, specifically includes：
According to player analysis protocol, the VR video datas are converted to H.264 data flow, the H.264 data flow
Including picture frame data and description data；
Picture frame data are extracted in the H.264 data flow.
In an embodiment of the present invention, the conversation establishing module, specifically for：
Scan data is extracted in the H.264 data flow；
Obtain the sequence parameter set and picture parameter set in the scan data；
Sequence parameter set and picture parameter set according to being extracted creates video format description information；
Hard decoder session is created according to video format description information, the picture format exported by the hard decoder session is
NV12.
In an embodiment of the present invention, the data solve module firmly, specifically for：
Hard decoder is carried out to each picture frame data.
In an embodiment of the present invention, described device also includes session cancellation module, is used for：
Nullify the hard decoder session.
In an embodiment of the present invention, described device also includes Video Rendering module, is used for：
Eyes are carried out to the video data of hard decoder and renders process, to play the VR video datas.
For solving above-mentioned technical problem, the embodiment of the present invention provides a kind of terminal device, including：
Player；
Decoding apparatus as described in foregoing summary；
Request module, for asking VR video datas to be played, and by obtained VR video data transmissions to described
Decoding apparatus and player.
From technical scheme provided in an embodiment of the present invention above, the embodiment of the present invention provided based on iOS device
The player method of VR videos, device and terminal device, decode the video data based on RTMP agreements by hard decoder mode,
The problem of the section excessive cycle of the video data of HLS protocol is avoided, be it also avoid by CPU come soft decoding video data institute
The problem that decoding efficiency is low, power consumption and heat condition are serious for causing, without the need for adjusting to the hardware of existing iOS device, from soft
Part aspect can improve ability to play of the iOS device to VR videos, with very strong application prospect.
Description of the drawings
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
Accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments described in invention, for those of ordinary skill in the art, in the premise for not paying creative labor
Under, can be with according to these other accompanying drawings of accompanying drawings acquisition.
Fig. 1 by the embodiment of the present invention based on iOS device VR videos coding/decoding method and the system that is suitable for of device
Organization Chart.
The mould of terminal devices of the Fig. 2 by being suitable for based on the decoding apparatus of the VR videos of iOS device in the embodiment of the present invention
Block figure.
Fig. 3 is the flow chart of the coding/decoding method of the VR videos in the embodiment of the present invention based on iOS device.
Fig. 4 be in the embodiment of the present invention in coding/decoding method based on the VR videos of iOS device from the VR video datas
Extract the particular flow sheet of picture frame data.
Tools of the Fig. 5 for establishment hard decoder session in the coding/decoding method in the embodiment of the present invention based on the VR videos of iOS device
Body flow chart.
Fig. 6 is the flow chart of the coding/decoding method of the VR videos in another embodiment of the present invention based on iOS device.
Fig. 7 is the module map of the decoding apparatus of the VR videos in the embodiment of the present invention based on iOS device.
Fig. 8 is the module map of the decoding apparatus of the VR videos in another embodiment of the present invention based on iOS device.
Specific embodiment
In order that those skilled in the art more fully understand the technical scheme in the present invention, below in conjunction with of the invention real
Apply the accompanying drawing in example, to the embodiment of the present invention in technical scheme be clearly and completely described, it is clear that described enforcement
Example is only a part of embodiment of the invention, rather than whole embodiment.Embodiment in based on the present invention, this area are common
The every other embodiment obtained under the premise of creative work is not made by technical staff, should all belong to protection of the present invention
Scope.
Fig. 1 by the embodiment of the present invention based on iOS device VR videos coding/decoding method and the system that is suitable for of device
Organization Chart.In conjunction with shown in Fig. 1, the system includes can terminal device 100 and cloud server 200.Terminal device 100 is should
The be suitable for iOS device of coding/decoding method, its can be iPhone mobile phones, iPad panel computers etc.；Cloud server 200 can be
Server of the server of the video website of industry routine or cloud storage website etc., cloud server 200 are built with terminal device 100
Vertical communication, VR videos to be decoded are stored in cloud server 200, and terminal device 100 can be obtained from cloud server 200
VR video datas, are decoded and play.Certainly, VR data can be with offline storage in terminal device 100, and here is not done superfluous
State.
The mould of terminal devices of the Fig. 2 by being suitable for based on the decoding apparatus of the VR videos of iOS device in the embodiment of the present invention
Block figure.In conjunction with shown in Fig. 2, the terminal device 100 is iOS device, and which includes decoding apparatus 10, player 20 and asks modulus
Block 30, request module 30 can be set up with cloud server 200 and communicate and ask VR videos to be played from cloud server 200
Received VR video data transmittings are delivered to player 20 by data, request module 300, and player 20 is coordinated with decoding apparatus 10
Carry out the hard decoder VR video datas and play out.Wherein, decoding apparatus 10 can be industry routine image processor GPU or
Video processing unit VPU.
Certainly, terminal device 100 will also include the components and parts such as camera, memory, processor, supply module, and here is not
Repeat.
Fig. 3 is the flow chart of the coding/decoding method of the VR videos in the embodiment of the present invention based on iOS device.The iOS device is
For aforementioned terminals equipment 100, the executive agent of the coding/decoding method is aforementioned decoding apparatus 10, the coding/decoding method specifically include as
Under step S101 to S103.
The VR video datas of step S101, acquisition based on RTMP agreements.
VR video datas can be stored in cloud server 200, it is also possible in offline storage and terminal device 100, and
The VR video data streams are based on RTMP (Real Time Messaging Protocol, real-time messages host-host protocol) agreement
, RTMP agreements are based on TCP, including multiple mutation such as RTMP basic agreements and RTMPT, TTMPS, can be used for and support
Audio frequency and video and data communication are carried out based between the Streaming Media of RTMP agreements, interactive server, be will not be described here.
Step S102, from the VR video datas extract picture frame data, the image frame data fit AVFrame number
According to structure.
VR data to be decoded can extract, after write player, the picture frame number for meeting AVFrame data structures
According to.AVFrame data structures are also the data structure for pre-defining, different from common soft solution mode, and data decoding passes through
GPU is realized.
Particular flow sheets of the Fig. 4 for S102 in the coding/decoding method in the embodiment of the present invention based on the VR videos of iOS device, should
Step S102 specifically includes step S121 to S122, specific as follows.
Step S121, according to player analysis protocol, the VR video datas are converted to H.264 data flow, described
H.264 data flow includes image frame data and description data.
When player receives VR videos to be decoded in the iOS device 100, assisted by the decoding carried by the player
VR Video Quality Metrics are H.264 data flow, are H.264 a kind of video encoding standards by view, can be good at adapting to IP and wireless network
Network, with very strong anti-error code and anti-dropout performance.
Include picture frame data and description data, image frame data fit in the H.264 data flow being converted to
AVFrame data structures.Description data are the binary data streams for describing each picture frame data, can specifically describe these pictures
The RGB parameters of picture representated by the frame data of face, resolution ratio etc..
Step S122, in the H.264 data flow, extract picture frame data.
Picture frame data are obtained in the H.264 data flow through being converted to, with by subsequent treatment.Due to H.264 counting
It is common technique in the industry according to the structure of stream, can simply extracts very much picture frame data and description data.
Step S103, the application programming interfaces for calling hardware decoding assembly in the iOS device, create hard decoder session.
Hardware decoding assembly as aforementioned decoding apparatus 10 can for example be the image processor GPU of industry routine or regard
Frequency processing unit VPU.In iOS system aspect, the application programming interfaces API of decoding apparatus 10 is provided with, the application can be passed through
Routine interface API create decoding session session, controlled by the decoding session session hardware decoding assembly come
Picture frame data in abovementioned steps carry out hard decoder.
Idiographic flows of the Fig. 5 for step S103 in the coding/decoding method in the embodiment of the present invention based on the VR videos of iOS device
Figure, step S103 specifically includes step S131 to S134, specific as follows.
Step S131, in the H.264 data flow, extract scan data.
Include description data in the H.264 data flow being converted to, obtain in the H.264 data flow through being converted to
Picture frame data are arrived, with by subsequent treatment.As the structure of H.264 data flow is common technique in the industry, simply can carry very much
Take out description data.
Step S132, the sequence parameter set and picture parameter set obtained in the scan data.
Include sequence parameter set SPS (Sequence Parameter Set) and picture parameter set PS in description data
(Picture Parameter Set), sequence parameter set includes all information in image sequence, be describe data basis it
One, picture parameter set includes all slice informations of an image, is equally to describe one of basis of data.In description data
Determine that sequence parameter set and picture parameter set are industry routine technological means, will not be described here.
Step S133, video format description information is created according to the sequence parameter set that extracted and picture parameter set.
In embodiments of the present invention, it is possible to use mesh is called according to the sequence parameter set and picture parameter set for being extracted
Front establishment function known in the art, to create video format description information.
Step S134, according to video format description information create hard decoder session, the figure exported by the hard decoder session
As form is NV12.
The picture format for being exported is kCVPixelBufferPixelFormatTypeKey property values, by the property value
It is set as NV12, as existing hardware decoding assembly supports NV12 in iOS device, is easy to the image subsequently to being exported to carry out firmly
Part is decoded.
In embodiments of the present invention, after this completes hard decoder operation, the decoding session can be destroyed, to reduce processing money
The consumption in source.
Step S104, hard decoder is carried out to the picture frame data by hardware decoding assembly in the iOS device, exported
It is applied to the video playback data of iOS device.
Decoding apparatus 10 are called to carry out hard decoder to obtaining picture frame data in abovementioned steps, so that obtain can be with iOS device
The picture data that can be played.
In embodiments of the present invention, by each image frame data input to decoding apparatus 10, using as sample instance
sample buffer.Constantly by image frame Refresh Data, sample instance can pass through to use sample instance
CMBlockBufferCreateWithMemeoryBlock from H.264 one CMBlockBufferRef example of data creation, so
CMSampleBufferRef examples are created afterwards with CMSampleBufferCreateReady, using as sample instance.
After hard decoder, the image of output can include YUV (color of image coding) data of current picture frame, concrete lattice
Formula is CVPixelBufferRef (carrying AVPlayer output formats with apple identical), and the image of output can directly generate
The texture of the OpenGL that iOS players 20 are supported.
Fig. 6 is the flow chart of the coding/decoding method of the VR videos in another embodiment of the present invention based on iOS device, with aforementioned reality
Apply example to compare, the method also includes following steps S105 after step S104, specific as follows.
Step S105, eyes are carried out to the video data of hard decoder render process, to play the VR video datas.
After image after hard decoder is received, playable data texturing is converted into, then by configuring single eyes
Strategy, calculate picture size being rendered, finally transfer in iOS device GLKit components to play out, realize VR videos
The broadcasting of data.
To sum up, the player method of the VR videos based on iOS device provided by the embodiment of the present invention, by hard decoder mode
Decoding the video data based on RTMP agreements, it is to avoid the problem of the section excessive cycle of the video data of HLS protocol, also keep away
Exempt from by CPU come the problem that decoding efficiency is low, power consumption and heat condition are serious caused by soft decoding video data, without the need for right
The hardware of existing iOS device adjusts, and can improve ability to play of the iOS device to VR videos from software view, with very strong
Application prospect.
Fig. 7 is the module map of the decoding apparatus of the VR videos in the embodiment of the present invention based on iOS device, and described device can wrap
Include：
Data acquisition module 11, for obtaining the VR video datas based on RTMP agreements；
Data conversion module 12, for extracting picture frame data, the image frame data symbols from the VR video datas
Close AVFrame data structures；
Conversation establishing module 13, for calling the application programming interfaces of hardware decoding assembly in the iOS device, creates hard
Decoding session；
Data solve module 14 firmly, for being carried out to the picture frame data by hardware decoding assembly in the iOS device
Hard decoder, output are applied to the video playback data of iOS device.
In an embodiment of the present invention, the data conversion module 12, specifically includes：
According to player analysis protocol, the VR video datas are converted to H.264 data flow, the H.264 data flow
Including picture frame data and description data；
Picture frame data are extracted in the H.264 data flow.
In an embodiment of the present invention, the conversation establishing module 13, specifically for：
Scan data is extracted in the H.264 data flow；
Obtain the sequence parameter set and picture parameter set in the scan data；
Sequence parameter set and picture parameter set according to being extracted creates video format description information；
Hard decoder session is created according to video format description information, the picture format exported by the hard decoder session is
NV12.
In an embodiment of the present invention, the data solve module 14 firmly, specifically for：
By each image frame data input to the hardware decoding assembly, by the hardware decoding assembly to each picture frame number
According to carrying out hard decoder.
In an embodiment of the present invention, described device may also include session cancellation module, be used for：
Nullify the hard decoder session.
Fig. 8 is the module map of the decoding apparatus of the VR videos in another embodiment of the present invention based on iOS device, in above-mentioned figure
On the basis of embodiment shown in 7, described device may also include Video Rendering module, be used for：
Eyes are carried out to the video data of hard decoder and renders process, to play the VR video datas.
To sum up, the playing device of the VR videos based on iOS device provided by the embodiment of the present invention, by hard decoder mode
Decoding the video data based on RTMP agreements, it is to avoid the problem of the section excessive cycle of the video data of HLS protocol, also keep away
Exempt from by CPU come the problem that decoding efficiency is low, power consumption and heat condition are serious caused by soft decoding video data, without the need for right
The hardware of existing iOS device adjusts, and can improve ability to play of the iOS device to VR videos from software view, with very strong
Application prospect.
Each embodiment in this specification is described by the way of going forward one by one, identical similar portion between each embodiment
Divide mutually referring to what each embodiment was stressed is the difference with other embodiment.Especially for system reality
For applying example, as which is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method
Part explanation.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
Mode by software plus required general hardware platform is realizing, naturally it is also possible to by hardware.Such understanding is based on, on
State the part that technical scheme substantially contributes prior art in other words to embody in the form of software product, should
Computer software product can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disc, CD etc., including some fingers
Order is used so that a computer equipment (can be personal computer, server, or network equipment etc.) executes each enforcement
Method described in some parts of example or embodiment.
Finally it should be noted that：Above example only in order to technical scheme to be described, rather than a limitation；Although
With reference to the foregoing embodiments the present invention has been described in detail, it will be understood by those within the art that：Which still may be used
To modify to the technical scheme described in foregoing embodiments, or equivalent is carried out to which part technical characteristic；
And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and
Scope.
Embodiments of the invention are the foregoing is only, the present invention is not limited to.For those skilled in the art
For, the present invention can have various modifications and variations.All any modifications that is made within spirit and principles of the present invention, equivalent
Replace, improve etc., should be included within scope of the presently claimed invention.
Claims (13)
1. a kind of coding/decoding method of the VR videos based on iOS device, it is characterised in that include：
Obtain the VR video datas based on RTMP agreements；
Picture frame data, the image frame data fit AVFrame data structure is extracted from the VR video datas；
The application programming interfaces of hardware decoding assembly in the iOS device are called, hard decoder session is created；
According to the hard decoder session, the picture frame data are solved firmly by hardware decoding assembly in the iOS device
Code, output are applied to the video playback data of iOS device.
2. the method for claim 1, it is characterised in that extract picture frame data from the VR video datas, specifically
Including：
According to player analysis protocol, the VR video datas are converted to H.264 data flow, the H.264 data flow includes
Picture frame data and description data；
Picture frame data are extracted in the H.264 data flow.
3. method as claimed in claim 2, it is characterised in that create hard decoder session, specifically include：
Scan data is extracted in the H.264 data flow；
Obtain the sequence parameter set and picture parameter set in the scan data；
Sequence parameter set and picture parameter set according to being extracted creates video format description information；
Hard decoder session is created according to video format description information, the picture format exported by the hard decoder session is NV12.
4. method as claimed in claim 3, it is characterised in that by hardware decoding assembly in the iOS device to the picture
Face frame data carry out hard decoder, specifically include：
By each image frame data input to the hardware decoding assembly, each picture frame data are entered by the hardware decoding assembly
Row hard decoder.
5. the method for claim 1, it is characterised in that according to the hard decoder session, by hard in the iOS device
After part decoding assembly carries out hard decoder to the picture frame data, methods described also includes：
Nullify the hard decoder session.
6. the method for claim 1, it is characterised in that according to the hard decoder session, by hard in the iOS device
After part decoding assembly carries out hard decoder to the picture frame data, methods described also includes：
Eyes are carried out to the video data of hard decoder and renders process, to play the VR video datas.
7. a kind of decoding apparatus of the VR videos based on iOS device, it is characterised in that include：
Data acquisition module, for obtaining the VR video datas based on RTMP agreements；
Data conversion module, for extracting picture frame data, the image frame data fit from the VR video datas
AVFrame data structures；
Conversation establishing module, for calling the application programming interfaces of hardware decoding assembly in the iOS device, creates hard decoder meeting
Words；
Data solve module firmly, for according to the hard decoder session, by hardware decoding assembly in the iOS device to the picture
Face frame data carry out hard decoder, and output is applied to the video playback data of iOS device.
8. device as claimed in claim 7, it is characterised in that the data conversion module, specifically includes：
According to player analysis protocol, the VR video datas are converted to H.264 data flow, the H.264 data flow includes
Picture frame data and description data；
Picture frame data are extracted in the H.264 data flow.
9. device as claimed in claim 8, it is characterised in that the conversation establishing module, specifically for：
Scan data is extracted in the H.264 data flow；
Obtain the sequence parameter set and picture parameter set in the scan data；
Sequence parameter set and picture parameter set according to being extracted creates video format description information；
Hard decoder session is created according to video format description information, the picture format exported by the hard decoder session is NV12.
10. device as claimed in claim 9, it is characterised in that the data solve module firmly, specifically for：
Hard decoder is carried out to each picture frame data.
11. devices as claimed in claim 7, it is characterised in that described device also includes session cancellation module, is used for：
Nullify the hard decoder session.
12. devices as claimed in claim 7, it is characterised in that described device also includes Video Rendering module, is used for：
Eyes are carried out to the video data of hard decoder and renders process, to play the VR video datas.
13. a kind of terminal devices, it is characterised in that include：
Player；
Decoding apparatus as any one of claim 7 to 12；
Request module, for asking VR video datas to be played, and by obtained VR video data transmissions to the decoding
Device and player.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611086076.6A CN106507115B (en) | 2016-11-30 | 2016-11-30 | Coding/decoding method, device and the terminal device of VR video based on iOS device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611086076.6A CN106507115B (en) | 2016-11-30 | 2016-11-30 | Coding/decoding method, device and the terminal device of VR video based on iOS device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106507115A true CN106507115A (en) | 2017-03-15 |
| CN106507115B CN106507115B (en) | 2019-10-15 |
Family
ID=58329244
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611086076.6A Active CN106507115B (en) | 2016-11-30 | 2016-11-30 | Coding/decoding method, device and the terminal device of VR video based on iOS device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106507115B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108174174A (en) * | 2017-12-29 | 2018-06-15 | 暴风集团股份有限公司 | VR image display methods, device and terminal |
| CN114079823A (en) * | 2021-11-17 | 2022-02-22 | 天翼数字生活科技有限公司 | Video rendering method, device, equipment and medium based on Flutter |
| CN114125542A (en) * | 2022-01-26 | 2022-03-01 | 北京智象信息技术有限公司 | Video insertion method and device for realizing single-channel hardware decoder based on software mode |
| CN114222185A (en) * | 2021-12-10 | 2022-03-22 | 洪恩完美(北京)教育科技发展有限公司 | Video playing method, terminal equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101010951A (en) * | 2004-08-31 | 2007-08-01 | 松下电器产业株式会社 | Moving image encoding method and apparatus |
| US20120179833A1 (en) * | 2010-06-02 | 2012-07-12 | Onmobile Global Limited | Method and apparatus for adapting media |
| CN104616243A (en) * | 2015-01-20 | 2015-05-13 | 北京大学 | Effective GPU three-dimensional video fusion drawing method |
| CN105163169A (en) * | 2015-09-16 | 2015-12-16 | 北京暴风科技股份有限公司 | Data package format method and system suitable for transmission |
| CN105992044A (en) * | 2015-02-05 | 2016-10-05 | 天脉聚源（北京）科技有限公司 | Method and system of transcoding HLS to RTMP live streaming |
| CN106034252A (en) * | 2015-03-12 | 2016-10-19 | 深圳市腾讯计算机系统有限公司 | Streaming media processing method and device |
-
2016
- 2016-11-30 CN CN201611086076.6A patent/CN106507115B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101010951A (en) * | 2004-08-31 | 2007-08-01 | 松下电器产业株式会社 | Moving image encoding method and apparatus |
| US20120179833A1 (en) * | 2010-06-02 | 2012-07-12 | Onmobile Global Limited | Method and apparatus for adapting media |
| CN104616243A (en) * | 2015-01-20 | 2015-05-13 | 北京大学 | Effective GPU three-dimensional video fusion drawing method |
| CN105992044A (en) * | 2015-02-05 | 2016-10-05 | 天脉聚源（北京）科技有限公司 | Method and system of transcoding HLS to RTMP live streaming |
| CN106034252A (en) * | 2015-03-12 | 2016-10-19 | 深圳市腾讯计算机系统有限公司 | Streaming media processing method and device |
| CN105163169A (en) * | 2015-09-16 | 2015-12-16 | 北京暴风科技股份有限公司 | Data package format method and system suitable for transmission |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108174174A (en) * | 2017-12-29 | 2018-06-15 | 暴风集团股份有限公司 | VR image display methods, device and terminal |
| CN114079823A (en) * | 2021-11-17 | 2022-02-22 | 天翼数字生活科技有限公司 | Video rendering method, device, equipment and medium based on Flutter |
| CN114222185A (en) * | 2021-12-10 | 2022-03-22 | 洪恩完美(北京)教育科技发展有限公司 | Video playing method, terminal equipment and storage medium |
| CN114222185B (en) * | 2021-12-10 | 2024-04-05 | 洪恩完美(北京)教育科技发展有限公司 | Video playing method, terminal equipment and storage medium |
| CN114125542A (en) * | 2022-01-26 | 2022-03-01 | 北京智象信息技术有限公司 | Video insertion method and device for realizing single-channel hardware decoder based on software mode |
| CN114125542B (en) * | 2022-01-26 | 2022-05-31 | 北京智象信息技术有限公司 | Video insertion method and device for realizing single-channel hardware decoder based on software mode |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106507115B (en) | 2019-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI826321B (en) | A method for enhancing quality of media | |
| CN103974135B (en) | A kind of video sharing method and system | |
| CN105227963B (en) | Streaming Media collection automatic identification direction and the method and system adjusted are carried out to terminal | |
| CN104683884B (en) | A kind of stream media live broadcasting method and system | |
| CN106507115A (en) | Based on the coding/decoding method of the VR videos of iOS device, device and terminal device | |
| WO2018045927A1 (en) | Three-dimensional virtual technology based internet real-time interactive live broadcasting method and device | |
| CN111818004B (en) | Cloud game live broadcast method and system and computer readable storage medium | |
| CN111314577B (en) | Transformation of dynamic metadata to support alternate tone rendering | |
| US11290345B2 (en) | Method for enhancing quality of media | |
| US12003386B2 (en) | Method for enhancing quality of media | |
| US20160330531A1 (en) | Method and apparatus for the generation of metadata for video optimization | |
| CN113301342B (en) | Video coding method, network live broadcasting method, device and terminal equipment | |
| CN104683781A (en) | Video play processing method and video play processing device | |
| CN110267093A (en) | Live video method for pushing, device, storage medium, terminal and live streaming mirror | |
| CN107318052A (en) | Player method, television set and the storage medium of television video | |
| CN110602523A (en) | VR panoramic live multimedia processing and synthesizing system and method | |
| KR20160105797A (en) | Method and apparatus for video optimization using metadata | |
| CN110166798A (en) | A kind of down conversion method and device edited based on 4K HDR | |
| Pitkänen et al. | Remote VR gaming on mobile devices | |
| CN106507125A (en) | A kind of pair of terminal coordinates live method and device | |
| US11457049B2 (en) | Cloud-based video broadcast system | |
| US8963989B2 (en) | Data distribution apparatus, data distribution method, and program | |
| CN104333765A (en) | Processing method and device of video live streams | |
| CN109379622A (en) | The method and apparatus of video are played in game | |
| CN117099363A (en) | Method and apparatus for providing dialogue service in mobile communication system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 200131 Shanghai city on Heidelberg Pudong New Area Free Trade Zone Road No. 38 Building 2 floor 306-48 room three Applicant after: Shanghai Yinqi Cultural Development Co., Ltd. Address before: 200131 Shanghai city on Heidelberg Pudong New Area Free Trade Zone Road No. 38 Building 2 floor 306-48 room three Applicant before: Shanghai Aige Network Technology Co. Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |