CN109120939B - Video App decoding method and device - Google Patents

Video App decoding method and device Download PDF

Info

Publication number
CN109120939B
CN109120939B CN201810779048.5A CN201810779048A CN109120939B CN 109120939 B CN109120939 B CN 109120939B CN 201810779048 A CN201810779048 A CN 201810779048A CN 109120939 B CN109120939 B CN 109120939B
Authority
CN
China
Prior art keywords
decoding
video
code rate
information
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810779048.5A
Other languages
Chinese (zh)
Other versions
CN109120939A (en
Inventor
李金伟
黄博
陈杉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201810779048.5A priority Critical patent/CN109120939B/en
Publication of CN109120939A publication Critical patent/CN109120939A/en
Application granted granted Critical
Publication of CN109120939B publication Critical patent/CN109120939B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client data or end-user data
    • H04N21/4516Management of client data or end-user data involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention provides a video App decoding method and device, and belongs to the technical field of videos. The method comprises the following steps: collecting video coding and decoding information required by video decoding; generating a decoding strategy according to the video coding and decoding information, wherein the decoding strategy comprises each playing code rate supported by the current terminal and a mapping relation of a decoding type corresponding to each playing code rate, and the decoding type is determined by hardware information; analyzing the decoding strategy to select one of the playing code rates as a target playing code rate; and determining a decoding type corresponding to the target playing code rate according to the mapping relation so as to decode the video. According to the video App decoding method and device provided by the invention, the decoding type can be selected according to the playing code rate, an accurate and appropriate decoding strategy is provided for the video App, the decoding difference of different terminals is reduced, and the use experience of a user for playing videos can be improved.

Description

Video App decoding method and device
Technical Field
The invention belongs to the technical field of videos, and particularly relates to a video App decoding method and device.
Background
With the continuous development of video decoding technology, in addition to using software decoding technology, hardware decoding technology is also adopted in mobile terminals. Software decoding refers to decoding by a CPU occupied by the software itself. Hardware decoding refers to the video decoding performed by using a special module of a GPU in the mobile terminal, and because the parallel computing capability of the GPU is far higher than that of the CPU, the load of the CPU caused by video playing can be effectively reduced, so that the hardware decoding is more power-saving and is suitable for long-time mobile-end high-definition video playing and live broadcasting. In addition, the occupation of a CPU is reduced by hardware decoding, and the fluency of video playing is favorably improved, so that the hardware decoding is widely applied to the video App.
At present, the mobile terminals of Android systems in the market have various brands and models, and terminal devices of various brands and models adopt different hardware platforms and Android systems of different versions, so that a video App manually configures a video decoding strategy according to a GPU (graphics processing Unit), and generally determines to adopt hardware decoding or software decoding for a mainstream machine type extensive configuration decoding strategy directly according to the mobile phone model and hardware information thereof. Therefore, the decoding capabilities supported by each brand model terminal device are different, the difference of video decoding effects among different devices is large, and a user experiences a large contrast when using the video App.
Disclosure of Invention
The invention provides a video App decoding method and device, which are used for solving the problem that the decoding effect of the existing video App in different terminal devices is large in difference.
According to a first aspect of the present invention, there is provided a video App decoding method, the method comprising:
collecting video coding and decoding information required by video decoding;
generating a decoding strategy according to the video coding and decoding information, wherein the decoding strategy comprises each playing code rate supported by the current terminal and a mapping relation of a decoding type corresponding to each playing code rate, and the decoding type is determined by hardware information;
analyzing the decoding strategy to select one of the playing code rates as a target playing code rate;
and determining a decoding type corresponding to the target playing code rate according to the mapping relation so as to decode the video.
Optionally, the generating a decoding policy according to the video coding and decoding information includes:
acquiring a profile and a level through the video coding and decoding information;
obtaining each playing code rate supported by the mobile terminal according to the profile and the level;
and adapting the corresponding decoding type for each playing code rate to generate a decoding strategy.
Optionally, hardware information of the mobile terminal is collected;
and determining the decoding type and the type of a decoder according to the hardware information.
Optionally, collecting version information of an operating system of the mobile terminal;
controlling display of additional function icons according to the operating system version information, the additional functions including at least one or several of a sharpness setting, a VR setting, a HDR setting.
Optionally, the video playing is controlled according to the version information of the operating system.
According to a second aspect of the invention, there is provided a video App decoding device, the device comprising:
the first collection module is used for collecting video coding and decoding information required by video decoding;
a generating module, configured to generate a decoding policy according to the video encoding and decoding information, where the decoding policy includes mapping relationships between each play code rate supported by a current terminal and a decoding type corresponding to each play code rate, and the decoding type is determined by hardware information;
the analysis module is used for analyzing the decoding strategy to select one of the playing code rates as a target playing code rate;
and the decoding module is used for determining the decoding type corresponding to the target playing code rate according to the mapping relation so as to decode the video.
Optionally, the generating module includes:
an information obtaining unit, configured to obtain a profile and a level through the video encoding and decoding information;
a code rate obtaining unit, configured to obtain each play code rate supported by the mobile terminal according to the profile and the level;
and the adaptation unit is used for adapting the corresponding decoding type for each playing code rate to generate a decoding strategy.
Optionally, the apparatus further comprises:
the second collection module is used for collecting the hardware information of the mobile terminal;
and the decoding type determining module is used for determining the decoding type and the type of the decoder according to the hardware information.
Optionally, the apparatus further comprises:
the third collection module is used for collecting the version information of the operating system of the mobile terminal;
and the additional function control module is used for controlling the display of additional function icons according to the operating system version information, and the additional functions at least comprise one or more of definition setting, VR setting and HDR setting.
Optionally, the apparatus further comprises:
and the playing control module is used for controlling video playing according to the version information of the operating system.
Aiming at the prior art, the invention has the following advantages: according to the video App decoding method provided by the invention, each playing code rate supported by the mobile terminal can be obtained according to the collected video coding and decoding information, one playing code rate and the corresponding decoding type are selected for decoding, an accurate and appropriate fine-grained decoding strategy can be provided for the video App, the decoding effect of the video can be ensured, the decoding difference of terminals of different types is reduced, the application range is wider, and the use experience of a user for playing the video can be improved.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a flowchart illustrating steps of a video App decoding method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating steps of a video App decoding method according to a second embodiment of the present invention;
fig. 3 is a block diagram of a video App decoding device according to a third embodiment of the present invention;
fig. 4 is a block diagram of another video App decoding device according to the third embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
Example one
Referring to fig. 1, a flowchart illustrating steps of a video App decoding method in the embodiment of the present invention is shown, and the specific steps include:
step 101, collecting video encoding and decoding information required by video decoding;
generally, a video APP can display and play video resource files in various formats, and a video APP in a mobile terminal decodes a video by matching a fixed hardware decoding scheme for a corresponding terminal through a terminal model. In the invention, video coding and decoding information required by video decoding is collected by a video App, wherein the video coding and decoding information is Mediacodecinfo information which is definition about a video data compression protocol, coding and decoding formats and the like (for example, the definition at least comprises a data format, a color format and the like). Android provides Mediacodec classes to facilitate developers to more flexibly process video coding and decoding, and compared with high-level APIs such as MediaPlayer/VideoView, Mediacodec is low-level APIs, so that it provides more complete, flexible and rich interfaces, and developers can realize more flexible functions. The MediaCodec class, which is part of the Android underlying video support infrastructure, can be used to access the Android underlying video codec (e.g., encoder/decoder components), from which MediaCodec information can be obtained for decoding of video.
102, generating a decoding strategy according to the video coding and decoding information, wherein the decoding strategy comprises each playing code rate supported by a current terminal and a mapping relation of a decoding type corresponding to each playing code rate, and the decoding type is determined by hardware information;
and the video App generates a decoding strategy based on a preset rule according to the collected video coding and decoding information. The generated decoding strategy comprises each playing code rate supported by the terminal and the mapping relation of the decoding type corresponding to each playing code rate. The playback bit rate, i.e. the bit rate, refers to the number of bits (bits) transmitted Per second, and the unit is bps (bit Per second), and the higher the bit rate is, the faster the data transmission speed is, and the higher the quality of the corresponding video is. Because the effect of hardware decoding is superior to that of software decoding, the preset rule when the decoding strategy is generated can be that high playing code rate is matched with hardware decoding or that hardware decoding and software decoding are matched simultaneously, and that low playing code rate is matched with software decoding. Such as: the supported play code rate is 40Mbps and 15Mbps according to the Mediacodeinfo information of the terminal A, wherein the decoding type corresponding to the play code rate of 40Mbps can be software decoding or hardware decoding, and the decoding type corresponding to the play code rate of 15Mbps can be software decoding. Since the decoding type is determined by hardware performance, the decoding type can be determined in advance by hardware information. Therefore, by means of the decoding strategy, on one hand, which play code rates are supported by the mobile terminal can be known, and on the other hand, the decoding type suitable for a certain play code rate can be known.
Certainly, in step 102, the video App may also upload the collected video coding and decoding information to an application server of the video App through a network protocol, and the application server generates a decoding policy according to a preset rule. In this case, the mobile terminal where the video App is located may also receive a notification message from the application server to confirm that the uploading of the video coding and decoding information is completed, and generate and store a flag information according to the notification message, so as to identify that the uploading of the video coding and decoding information is successful and avoid repeated uploading of the decoding information.
The server can issue the decoding strategy to each mobile terminal, for the mobile terminals with the same model and the same configuration, the server can generate the corresponding decoding strategy as long as the server collects the video coding and decoding information uploaded by any one terminal, the decoding strategy can be issued to each mobile terminal with the same model and the same configuration in batches, and each mobile terminal is not required to generate the decoding strategy locally.
103, analyzing the decoding strategy to select one of the playing code rates as a target playing code rate;
based on the generated decoding strategy, the video App can analyze the decoding strategy, and can obtain each playing code rate supported by the current mobile terminal through analysis, so that one playing code rate can be selected as a target playing code rate for video decoding.
And 104, determining a decoding type corresponding to the target playing code rate according to the mapping relation so as to decode the video.
When the target playing code rate of the video decoding is determined, the decoding type corresponding to the target playing code rate can be determined according to the mapping relation in the decoding strategy, and certainly, because the hardware decoding has the excellent characteristic that the workload of a CPU can be reduced, when the target playing code rate simultaneously corresponds to the hardware decoding and the software decoding, the hardware decoding is preferentially selected to ensure the video decoding effect. And the video App selects a proper decoder from the mobile terminal to decode the data stream related to the video according to the analyzed decoding strategy. Therefore, the decoding type is selected through the playing code rate, the decoding effect of the video is guaranteed, the decoding difference of terminals of different types is reduced, and the playing experience of a user is improved.
According to the video App decoding method provided by the invention, each playing code rate supported by the mobile terminal can be obtained according to the collected video coding and decoding information, one playing code rate and the corresponding decoding type are selected for decoding, an accurate and appropriate fine-grained decoding strategy can be provided for the video App, the decoding effect of the video can be ensured, the decoding difference of terminals of different types is reduced, the application range is wider, and the use experience of a user for playing the video can be improved.
Example two
Referring to fig. 2, a flowchart illustrating steps of a video App decoding method in the embodiment of the present invention is shown, and the specific steps include:
step 201, collecting hardware information of a mobile terminal;
generally, a hardware product has its corresponding application manual, which specifies the usage instructions and performance parameters of the hardware product. The hardware information refers to parameter information of a CPU, a GPU and the like related to video decoding and playing, and is used for configuring the type and decoding type of the decoder, that is, for determining which type of the decoder is h.264avc, h.265hevc, VP8, VP9 and the like, and whether software decoding or hardware decoding is used. Based on the information, the invention can establish a hardware information configuration table in the video App and record the decoding types and the types of decoders supported by various types of hardware such as CPUs, GPUs and the like. The decoding type and the type of the decoder may be determined by collecting hardware information of the mobile terminal through the configuration table.
Step 202, determining a decoding type and a type of a decoder according to the hardware information;
when the video App acquires the hardware information of the current terminal, the decoding type and the type of the decoder supported by the terminal can be determined by inquiring the hardware information configuration table. For example, it is known through table lookup that a GPU of a certain model supports a decoding type of hardware decoding, and supports a decoder of the h.265hevc type. Of course, in practice, it may happen that the terminal supports multiple decoder types (e.g., h.264avc, h.265hevc, VP8, VP9, etc.), and at this time, the type of the decoder is usually further determined according to the encoding mode of the played video slice source, which is not described herein again.
Step 203, collecting the operating system version information of the mobile terminal;
the operating systems of different versions generally indicate which additional video special effect functions are supported by the system, and the version information of the operating system can be collected and acquired through configuration files related to the operating system, so that the additional functions during video playing can be configured, and a user can experience the corresponding functions to control the playing of the video conveniently.
Step 204, controlling the display of additional function icons according to the operating system version information, wherein the additional functions at least comprise one or more of definition setting, VR setting and HDR setting;
after the version information of the operating system is collected, it can be known which additional functions are supported by the operating system of the current version, and the corresponding icons can be decoded and displayed on the player to set and control the functions according to the additional functions contained in the broadcast control information, where the additional functions may be one or more of definition setting, VR setting, and HDR setting, and of course, as the hardware performance is enhanced and the operating system functions are rich, the additional functions may also be expanded and increased, which is not limited in this invention.
Step 205, collecting video encoding and decoding information required by video decoding;
in the invention, video coding and decoding information required by video decoding is collected by a video App, wherein the video coding and decoding information is Mediacodecinfo information which is definition about a video data compression protocol, coding and decoding formats and the like (for example, the definition at least comprises a data format, a color format and the like). Android provides Mediacodec classes to facilitate developers to more flexibly process video coding and decoding, and compared with high-level APIs such as MediaPlayer/VideoView, Mediacodec is low-level APIs, so that it provides more complete, flexible and rich interfaces, and developers can realize more flexible functions. The MediaCodec class, which is a part of the Android underlying video support infrastructure, can be used to access the Android underlying video codec (e.g., encoder/decoder components), from which video codec information can be obtained for decoding of video.
Step 206, generating a decoding strategy according to the video coding and decoding information, wherein the decoding strategy comprises mapping relationships between each playing code rate supported by a current terminal and a decoding type corresponding to each playing code rate, and the decoding type is determined by hardware information;
generating a decoding strategy according to the video coding and decoding information, wherein the decoding strategy comprises the following steps:
step 2061, obtaining a profile and a level through the video coding and decoding information;
video codec information is mediacodec info, which is a definition of a video data compression protocol, codec format, etc. (e.g., including at least definitions of a data format, a color format, etc.) of video, etc., and profile (profile) definitions are associated with characteristics, such as a compression algorithm, a chroma format, etc., and Level (Level) definitions are associated with performance, such as a maximum bit rate, a maximum frame size, etc. Thus, the profile and level may be obtained by the video codec information for decoding of the video.
Step 2062, obtaining each playing code rate supported by the mobile terminal according to the profile and the level;
taking the h.264avc video coding standard as an example, based on the information of the image coding type recorded in a profile (profile), if the image coding type is determined to be a key frame, an intra-frame prediction method is adopted for coding, otherwise, an inter-frame prediction method is adopted for motion estimation of the scene change situation, and the motion estimation value is actually a prediction value obtained by taking a currently coded video image frame as a reference image and performing motion compensation. Meanwhile, in order to reduce the prediction error and improve the compression ratio of the video image frame, the selection of the reference image can be obtained by reconstructing the video image frame which is coded in the past or in the future. And then, calculating the difference value between the predicted value and the current macro block to obtain residual macro block information, and then carrying out integer transformation, quantization, entropy coding and other processing on the residual macro block information. And finally, combining the bit rate obtained by coding with the information recorded in the Level to obtain each playing code rate supported by the mobile terminal. Therefore, each play code rate supported by the mobile terminal can be obtained according to the profile and the level.
Step 2063, adapting the corresponding decoding type for each playing code rate to generate a decoding strategy.
And the video App generates a decoding strategy based on a preset rule according to the collected video coding and decoding information. The generated decoding strategy comprises each playing code rate supported by the terminal and the mapping relation of the decoding type corresponding to each playing code rate. Since the decoding type is determined by hardware performance, the decoding type can be determined in advance by hardware information. Because the effect of hardware decoding is superior to that of software decoding, the preset rule when the decoding strategy is generated can be that high playing code rate is matched with hardware decoding or that hardware decoding and software decoding are matched simultaneously, and that low playing code rate is matched with software decoding. Specifically, a configuration file can be set according to the rule to record the corresponding relation between each playing code rate and the decoding type applied in the industry, and the configuration file is placed in the video App in advance, so that after each playing code rate supported by the mobile terminal is obtained according to a profile and a level, the video App can adapt to the corresponding decoding type for each playing code rate by inquiring the configuration file to generate a decoding strategy. Such as: the preset configuration file records 10Mbps corresponding software decoding, 15Mbps corresponding software decoding, 20Mbps corresponding software decoding, 40Mbps corresponding hardware decoding or software decoding, and the supported play code rate is 40Mbps and 15Mbps according to the Mediacodeinfo information of the A terminal, so that the configuration file shows that the decoding type corresponding to the play code rate of 40Mbps can be software decoding or hardware decoding, and the decoding type corresponding to the play code rate of 15Mbps can be software decoding.
Therefore, the generated decoding strategy includes mapping relationships between the various play code rates supported by the terminal and the decoding types corresponding to the various play code rates. Through the decoding strategy, on one hand, the playing code rates supported by the mobile terminal can be known, and on the other hand, the decoding type suitable for a certain playing code rate can be known.
Step 207, analyzing the decoding strategy to select one of the playing code rates as a target playing code rate;
based on the generated decoding strategy, the video App can analyze the decoding strategy, and can obtain each playing code rate supported by the current mobile terminal through analysis, so that one playing code rate can be selected as a target playing code rate for video decoding.
Step 208, determining a decoding type corresponding to the target playing code rate according to the mapping relation so as to decode the video;
when the target playing code rate of the video decoding is determined, the decoding type corresponding to the target playing code rate can be determined according to the mapping relation in the decoding strategy, and certainly, because the hardware decoding has the excellent characteristic that the workload of a CPU can be reduced, when the target playing code rate simultaneously corresponds to the hardware decoding and the software decoding, the hardware decoding is preferentially selected to ensure the video decoding effect. Therefore, by selecting the decoding type corresponding to the target playing code rate, the accuracy and the fineness of the decoding strategy are ensured, the video decoding effect is improved, the decoding difference of terminals of different types is reduced, and the playing experience of a user can be improved.
And step 209, controlling video playing according to the version information of the operating system.
Based on the decoding of the video, the collected version information of the operating system can be used in the decoding and playing control process, and the version information of the operating system is also used for playing control in the decoding process, wherein the operating systems of different versions generally indicate which additional special effect functions are supported by the system, and the additional functions during the playing of the video can be configured through the version information of the operating system, so that a user can experience the corresponding functions to play and control the video, and the user can obtain rich function experience.
The video App decoding method provided by the invention can obtain the decoding type on the basis of hardware information, obtain each playing code rate supported by the mobile terminal according to the collected video coding and decoding information, select one as a target playing code rate, select the corresponding decoding type on the basis of the target playing code rate, and on the basis of the decoding type determined by the hardware information, the playing code rate from the video coding and decoding information is fused and considered, so that the coordination performance of software and hardware is fully exerted, the decoding strategy is more accurate, the system version information is utilized in the decoding process, the expansion of the decoding and playing control function is realized, and the use experience of a user is integrally improved.
EXAMPLE III
Referring to fig. 3, a block diagram of a video App decoding apparatus in the embodiment of the present invention is shown, where the apparatus includes:
a first collecting module 301, configured to collect video encoding and decoding information required for video decoding;
a generating module 302, configured to generate a decoding policy according to the video encoding and decoding information, where the decoding policy includes mapping relationships between each playing code rate supported by a current terminal and a decoding type corresponding to each playing code rate, and the decoding type is determined by hardware information;
an analyzing module 303, configured to analyze the decoding policy to select one of the playing code rates as a target playing code rate;
a decoding module 304, configured to determine, according to the mapping relationship, a decoding type corresponding to the target playing code rate to decode a video.
Optionally, referring to fig. 4, on the basis of fig. 3, the generating module 302 includes:
an information obtaining unit 3021, configured to obtain a profile and a level through the video encoding and decoding information;
a code rate obtaining unit 3022, configured to obtain each play code rate supported by the mobile terminal according to the profile and the level;
an adapting unit 3023, configured to adapt the corresponding decoding type for each playback rate to generate a decoding strategy.
Optionally, the apparatus further comprises:
a second collecting module 305 for collecting hardware information of the mobile terminal;
a decoding type determining module 306, configured to determine a decoding type and a type of a decoder according to the hardware information.
Optionally, the apparatus further comprises:
a third collecting module 307, configured to collect version information of the operating system of the mobile terminal;
an additional function control module 308 for controlling the display of additional function icons according to the operating system version information, the additional functions including at least one or several of a sharpness setting, a VR setting, an HDR setting.
Optionally, the apparatus further comprises:
and a playing control module 309, configured to control video playing according to the version information of the operating system.
The video App decoding method provided by the invention can obtain the decoding type on the basis of hardware information, obtain each playing code rate supported by the mobile terminal according to the collected video coding and decoding information, select one as a target playing code rate, select the corresponding decoding type on the basis of the target playing code rate, and on the basis of the decoding type determined by the hardware information, the playing code rate from the video coding and decoding information is fused and considered, so that the coordination performance of software and hardware is fully exerted, the decoding strategy is more accurate, the system version information is utilized in the decoding process, the expansion of the decoding and playing control function is realized, and the use experience of a user is integrally improved.
For the above device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As is readily imaginable to the person skilled in the art: any combination of the above embodiments is possible, and thus any combination between the above embodiments is an embodiment of the present invention, but the present disclosure is not necessarily detailed herein for reasons of space.
The video App decoding methods provided herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with the teachings herein. The structure required to construct a system incorporating aspects of the present invention will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of the video APP decoding method according to embodiments of the invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Claims (10)

1. A video App decoding method, the method comprising:
collecting video coding and decoding information required by video decoding;
obtaining each playing code rate supported by the current terminal according to the video coding and decoding information;
adapting each playing code rate supported by the current terminal to a corresponding decoding type by querying a configuration file to generate a decoding strategy, wherein the decoding strategy comprises each playing code rate supported by the current terminal and a mapping relation of the decoding type corresponding to each playing code rate, and the decoding type is determined by hardware information;
analyzing the decoding strategy to select one of the playing code rates as a target playing code rate;
and determining a decoding type corresponding to the target playing code rate according to the mapping relation so as to decode the video.
2. The method of claim 1, wherein obtaining each play code rate supported by a current terminal according to the video coding and decoding information comprises:
acquiring a profile and a level through the video coding and decoding information;
and acquiring each playing code rate supported by the mobile terminal according to the profile and the level.
3. The method of claim 1, further comprising, prior to generating a decoding strategy based on the video codec information:
collecting hardware information of the mobile terminal;
and determining the decoding type and the type of a decoder according to the hardware information.
4. The method of claim 1, further comprising:
collecting operating system version information of the mobile terminal;
controlling display of additional function icons according to the operating system version information, the additional functions including at least one or several of a sharpness setting, a VR setting, a HDR setting.
5. The method of claim 4, further comprising:
and controlling video playing according to the version information of the operating system.
6. A video App decoding apparatus, the apparatus comprising:
the first collection module is used for collecting video coding and decoding information required by video decoding;
the acquisition module is used for acquiring each playing code rate supported by the current terminal according to the video coding and decoding information;
a generating module, configured to adapt, to a corresponding decoding type for each play code rate supported by the current terminal by querying a configuration file, to generate a decoding policy, where the decoding policy includes mapping relationships between each play code rate supported by the current terminal and the decoding type corresponding to each play code rate, and the decoding type is determined by hardware information;
the analysis module is used for analyzing the decoding strategy to select one of the playing code rates as a target playing code rate;
and the decoding module is used for determining the decoding type corresponding to the target playing code rate according to the mapping relation so as to decode the video.
7. The apparatus of claim 6, wherein the obtaining module comprises:
an information obtaining unit, configured to obtain a profile and a level through the video encoding and decoding information;
and the code rate acquisition unit is used for acquiring each playing code rate supported by the mobile terminal according to the profile and the level.
8. The apparatus of claim 6, further comprising:
the second collection module is used for collecting the hardware information of the mobile terminal;
and the decoding type determining module is used for determining the decoding type and the type of the decoder according to the hardware information.
9. The apparatus of claim 6, further comprising:
the third collection module is used for collecting the version information of the operating system of the mobile terminal;
and the additional function control module is used for controlling the display of additional function icons according to the operating system version information, and the additional functions at least comprise one or more of definition setting, VR setting and HDR setting.
10. The apparatus of claim 9, further comprising:
and the playing control module is used for controlling video playing according to the version information of the operating system.
CN201810779048.5A 2018-07-16 2018-07-16 Video App decoding method and device Active CN109120939B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810779048.5A CN109120939B (en) 2018-07-16 2018-07-16 Video App decoding method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810779048.5A CN109120939B (en) 2018-07-16 2018-07-16 Video App decoding method and device

Publications (2)

Publication Number Publication Date
CN109120939A CN109120939A (en) 2019-01-01
CN109120939B true CN109120939B (en) 2021-04-06

Family

ID=64862834

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810779048.5A Active CN109120939B (en) 2018-07-16 2018-07-16 Video App decoding method and device

Country Status (1)

Country Link
CN (1) CN109120939B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109640094B (en) * 2018-11-27 2021-06-15 Oppo广东移动通信有限公司 Video decoding method and device and electronic equipment
CN111614975B (en) * 2020-05-08 2022-07-12 深圳拙河科技有限公司 Hundred million-level pixel video playing method, device, medium and equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101383962A (en) * 2007-09-07 2009-03-11 武汉大学 Low code rate space domain enhancement layer encoding and decoding method based on interested region
CN101895737A (en) * 2010-07-13 2010-11-24 中兴通讯股份有限公司 Multimedia decoding method and device as well as video monitoring method and system
CN107302703A (en) * 2016-04-15 2017-10-27 中兴通讯股份有限公司 Audio and video playing method and device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140368672A1 (en) * 2002-04-19 2014-12-18 Soryn Technologies Llc Methods for Deploying Video Monitoring Applications and Services Across Heterogeneous Networks
JP2009182889A (en) * 2008-01-31 2009-08-13 Toshiba Corp Re-encoder and re-encoding method
CN103269331A (en) * 2013-04-20 2013-08-28 华为技术有限公司 Method and device for selectively playing code rate content
CN104780378B (en) * 2015-04-16 2018-10-19 腾讯科技(北京)有限公司 A kind of method for decoding video, device and player
CN104837042B (en) * 2015-05-06 2018-01-16 腾讯科技(深圳)有限公司 The coding method of digital multimedia data and device
CN106131319A (en) * 2016-06-29 2016-11-16 努比亚技术有限公司 A kind of information processing method and device, terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101383962A (en) * 2007-09-07 2009-03-11 武汉大学 Low code rate space domain enhancement layer encoding and decoding method based on interested region
CN101895737A (en) * 2010-07-13 2010-11-24 中兴通讯股份有限公司 Multimedia decoding method and device as well as video monitoring method and system
CN107302703A (en) * 2016-04-15 2017-10-27 中兴通讯股份有限公司 Audio and video playing method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
面向视频解码应用的SOPC系统研究;彭国杰;《中国优秀硕士学位论文全文数据库》;20130315;全文 *

Also Published As

Publication number Publication date
CN109120939A (en) 2019-01-01

Similar Documents

Publication Publication Date Title
KR101467430B1 (en) Method and system for providing application based on cloud computing
CN110557670B (en) Method, device, terminal and storage medium for playing video in webpage
CN103609117B (en) Code and decode the method and device of image
CN107634930B (en) Method and device for acquiring media data
CN109672893B (en) Video decoding method, device, equipment and storage medium
US11438645B2 (en) Media information processing method, related device, and computer storage medium
CN110636346A (en) Code rate self-adaptive switching method and device, electronic equipment and storage medium
US11381816B2 (en) Method and system for real-time content-adaptive transcoding of video content on mobile devices to save network bandwidth during video sharing
WO2017041551A1 (en) Spice protocol-based image transmission method and apparatus
US20100061443A1 (en) Method and system for video streaming of a graphical display of an application
CN109120939B (en) Video App decoding method and device
US20150067721A1 (en) Method and system for transmitting videos to mobile phones
CN111885346A (en) Picture code stream synthesis method, terminal, electronic device and storage medium
CN113709554A (en) Animation video generation method and device, and animation video playing method and device in live broadcast room
WO2021057697A1 (en) Video encoding and decoding methods and apparatuses, storage medium, and electronic device
CN112714320A (en) Decoding method, decoding device and computer readable storage medium
CN103635938B (en) For processing the method for video streaming data, streaming client in streaming client
CN115134629A (en) Video transmission method, system, device and storage medium
CN104333765B (en) A kind of processing method and processing unit of net cast stream
CN109379630A (en) Method for processing video frequency, device, electronic equipment and storage medium
CN115802054A (en) Video alignment method and device
CN114173154A (en) Video processing method and system
TWI700918B (en) Coding of video and audio with initialization fragments
WO2022061194A1 (en) Method and system for real-time content-adaptive transcoding of video content on mobile devices
CN108574881A (en) A kind of projection type recommends method, server and client

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant