CN108924606B - Streaming media processing method and device, storage medium and electronic device - Google Patents

Streaming media processing method and device, storage medium and electronic device Download PDF

Info

Publication number
CN108924606B
CN108924606B CN201810645862.8A CN201810645862A CN108924606B CN 108924606 B CN108924606 B CN 108924606B CN 201810645862 A CN201810645862 A CN 201810645862A CN 108924606 B CN108924606 B CN 108924606B
Authority
CN
China
Prior art keywords
streaming media
media resource
resource file
content description
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810645862.8A
Other languages
Chinese (zh)
Other versions
CN108924606A (en
Inventor
张斌
陈颖川
曹珈
张晓渠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201810645862.8A priority Critical patent/CN108924606B/en
Publication of CN108924606A publication Critical patent/CN108924606A/en
Application granted granted Critical
Publication of CN108924606B publication Critical patent/CN108924606B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25891—Management of end-user data being end-user preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H04L67/561—Adding application-functional data or data for application control, e.g. adding metadata
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Graphics (AREA)
  • Library & Information Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a streaming media processing method, a streaming media processing device, a storage medium and an electronic device. The method comprises the steps of obtaining content description metadata of a streaming media resource file, wherein the content description metadata is metadata for describing the content of the streaming media resource file under one or more content description dimensions; and processing the streaming media resource file based on the content description metadata. By the scheme, the problem that massive streaming media resource contents are difficult to manage only according to the current streaming media resource description information in the related technology is solved, and more detailed management, distribution and statistics of streaming media based on the contents and more targeted recommendation to users are possible.

Description

Streaming media processing method and device, storage medium and electronic device
Technical Field
The present invention relates to the field of communications, and in particular, to a streaming media processing method, apparatus, storage medium, and electronic apparatus.
Background
In recent years, with the increase of internet bandwidth and the large-scale deployment of Content Delivery Networks (CDNs), internet streaming media becomes a main viewing object for users to surf the internet. Currently, a variety of internet Streaming technologies have appeared, for example, internet Streaming technologies dominated by Hypertext Transfer Protocol (HTTP) Streaming over HTTP (HLS) and dynamic adaptive Streaming over HTTP (DASH) are currently dominant.
In current internet streaming technologies, such as HLS and DASH, streaming media resources are described by streaming media resource description metadata, where the streaming media resource description metadata may include a list of media file entity names, a media file path, a media file bitrate, and a media file encoding method. HLS uses m3u8 (a file format for playing multimedia lists), DASH describes streaming media assets using mpd (media presentation description), including timing, Uniform Resource Locator (URL), and media characteristics such as video resolution and bitrate.
However, it is worth noting that the streaming media resource description information can only provide auxiliary information in the streaming media playing, for example, solving the problems of the streaming media address lookup, the determination of the streaming media playing resolution and bit rate, and the like. With the development of large video services, massive streaming media resources are continuously on-line, and how to effectively manage resource contents in the massive streaming media resources is difficult to achieve by only according to the current streaming media resource description information, and more targeted content recommendation is performed for users.
Disclosure of Invention
Embodiments of the present invention provide a streaming media processing method, a streaming media processing apparatus, a storage medium, and an electronic apparatus, so as to at least solve a problem in the related art that it is difficult to manage massive streaming media resource contents only according to current streaming media resource description information.
According to an embodiment of the present invention, there is provided a streaming media processing method, including: obtaining content description metadata of a streaming media resource file, wherein the content description metadata is metadata describing content of the streaming media resource file in one or more content description dimensions; and processing the streaming media resource file based on the content description metadata.
As an exemplary embodiment, before obtaining the content description metadata of the streaming media resource file, the method further comprises: analyzing the content of the streaming media resource file based on the one or more content description dimensions, and generating the content description metadata of the streaming media resource file; and merging the content description metadata and the resource description metadata of the streaming media resource file to generate a streaming media index file corresponding to the streaming media resource file.
As an exemplary embodiment, obtaining the content description metadata of the streaming media resource file includes: acquiring the streaming media index file of the streaming media resource file; and acquiring the content description metadata of the streaming media resource file according to the streaming media index file.
As an exemplary embodiment, after merging the content description metadata with the resource description metadata of the streaming media resource file and generating a streaming media index file corresponding to the streaming media resource file, the method further includes: publishing the streaming media resource file and the streaming media index file corresponding to the streaming media resource file; and counting the access heat of each segment of the content of the streaming media resource file, adding metadata which describes the content of the streaming media resource file and takes the access heat as a content description dimension into the content description metadata, and updating the streaming media index file.
As an exemplary embodiment, analyzing the content of the streaming media resource file based on the one or more content description dimensions, generating the content description metadata of the streaming media resource file includes: inputting the streaming media resource file into a streaming media content analysis model, segmenting the streaming media resource file based on the one or more content description dimensions, and recording segmented information as the content description metadata of the streaming media resource file; or, the content of the streaming media resource file is evaluated with the matching degree of the one or more content description dimensions, and information of a segment with the matching degree higher than a first threshold value in the content of the streaming media resource file is recorded as the content description metadata of the streaming media resource file.
As an exemplary embodiment, merging the content description metadata with the resource description metadata of the streaming media resource file, and generating a streaming media index file corresponding to the streaming media resource file includes: associating the content description metadata with the resource description metadata of the streaming media resource file, and embedding a mark of the content description metadata in the resource description metadata of the streaming media resource file; and writing the content description metadata and the resource description metadata into a streaming media index file corresponding to the streaming media resource file.
As an exemplary embodiment, processing the streaming media resource file based on the content description metadata includes: based on the content description metadata, removing segments, corresponding to content description meeting a first preset condition, in the streaming media resource file, and then combining other segments in the streaming media resource file into a streaming media resource subfile; or, based on the content description metadata, extracting segments, corresponding to content descriptions meeting a second preset condition, in the streaming media resource file, and combining the extracted segments into a streaming media resource subfile.
As an exemplary embodiment, processing the streaming media resource file based on the content description metadata includes: based on the content description metadata, generating a guide menu for the streaming media resource file according to the one or more content description dimensions and displaying the guide menu; and responding to the received selection instruction, and playing the streaming media resource file.
As an exemplary embodiment, playing the streaming media resource file in response to the received selection instruction includes: determining a screening condition under the selected content description dimension according to the received selection instruction; extracting the segments which accord with the screening condition in the content of the streaming media resource file for playing; or, for a segment meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a first code rate, and for a segment not meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a second code rate, and playing the segment file with the first code rate and the segment file with the second code rate, wherein the first code rate is higher than the second code rate.
As an exemplary embodiment, processing the streaming media resource file based on the content description metadata includes: acquiring a user access record of the streaming media resource file; and counting the playing behavior of the user based on the content description metadata and the user access record.
As an exemplary embodiment, the statistical result of the user playing behavior includes playing preferences in one or more content description dimensions, and after the user playing behavior is counted based on the content description metadata and the user access record, the method further includes: and responding to a received playing request aiming at a streaming media resource file, and selecting a segment meeting the playing preference in the streaming media resource file to play based on the content description metadata of the streaming media resource file.
As an exemplary embodiment, processing the streaming media resource file based on the content description metadata includes: determining a segment of the streaming media resource file with the access heat higher than a second threshold value based on the content description metadata of the streaming media resource file; notifying scheduling information of the segments whose access heat is determined to be higher than the second threshold to an edge node.
According to another embodiment of the present invention, there is provided a streaming media processing apparatus including: the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring content description metadata of a streaming media resource file, and the content description metadata is metadata for describing the content of the streaming media resource file under one or more content description dimensions; and the processing module is used for processing the streaming media resource file based on the content description metadata.
As an exemplary embodiment, the apparatus further comprises: a content description metadata generation module, configured to analyze the content of the streaming media resource file based on the one or more content description dimensions, and generate the content description metadata of the streaming media resource file; and the merging module is used for merging the content description metadata and the resource description metadata of the streaming media resource file to generate a streaming media index file corresponding to the streaming media resource file.
As an exemplary embodiment, the obtaining module is to: acquiring the streaming media index file of the streaming media resource file; and acquiring the content description metadata of the streaming media resource file according to the streaming media index file.
As an exemplary embodiment, the apparatus further comprises: the publishing module is used for publishing the streaming media resource file and the streaming media index file corresponding to the streaming media resource file; and the counting module is used for counting the access heat of each segment of the content of the streaming media resource file, informing the content description metadata generation module to add the metadata which describes the content of the streaming media resource file and takes the access heat as a content description dimension into the content description metadata, and informing the merging module to update the streaming media index file.
As an exemplary embodiment, the content description metadata generation module is to: inputting the streaming media resource file into a streaming media content analysis model, segmenting the streaming media resource file based on the one or more content description dimensions, and recording segmented information as the content description metadata of the streaming media resource file; or, the content of the streaming media resource file is evaluated with the matching degree of the one or more content description dimensions, and information of a segment with the matching degree higher than a first threshold value in the content of the streaming media resource file is recorded as the content description metadata of the streaming media resource file.
As an exemplary embodiment, the merge module is to: associating the content description metadata with the resource description metadata of the streaming media resource file, and embedding a mark of the content description metadata in the resource description metadata of the streaming media resource file; and writing the content description metadata and the resource description metadata into a streaming media index file corresponding to the streaming media resource file.
As an example embodiment, the processing module is to: based on the content description metadata, removing segments, corresponding to content description meeting a first preset condition, in the streaming media resource file, and then combining other segments in the streaming media resource file into a streaming media resource subfile; or, based on the content description metadata, extracting segments, corresponding to content descriptions meeting a second preset condition, in the streaming media resource file, and combining the extracted segments into a streaming media resource subfile.
As an example embodiment, the processing module is to: based on the content description metadata, generating a guide menu for the streaming media resource file according to the one or more content description dimensions and displaying the guide menu; and responding to the received selection instruction, and playing the streaming media resource file.
As an example embodiment, the processing module is to: determining a screening condition under the selected content description dimension according to the received selection instruction; extracting the segments which accord with the screening condition in the content of the streaming media resource file for playing; or, for a segment meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a first code rate, and for a segment not meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a second code rate, and playing the segment file with the first code rate and the segment file with the second code rate, wherein the first code rate is higher than the second code rate.
As an example embodiment, the processing module is to: acquiring a user access record of the streaming media resource file; and counting the playing behavior of the user based on the content description metadata and the user access record.
As an exemplary embodiment, the statistical result of the user playing behavior comprises playing preferences under one or more content description dimensions, the apparatus further comprises: and the playing module is used for responding to a received playing request aiming at a streaming media resource file, and selecting the segments meeting the playing preference in the streaming media resource file to play based on the content description metadata of the streaming media resource file.
As an example embodiment, the processing module is to: determining a segment of the streaming media resource file with the access heat higher than a second threshold value based on the content description metadata of the streaming media resource file; notifying scheduling information of the segments whose access heat is determined to be higher than the second threshold to an edge node.
According to a further embodiment of the present invention, a storage medium is provided, in which a computer program is stored, wherein the computer program is arranged to perform the methods in the above and exemplary embodiments when executed.
According to yet another embodiment of the present invention, there is provided an electronic apparatus including a memory in which a computer program is stored and a processor configured to execute the computer program to perform the methods in the above embodiments and exemplary embodiments.
In the scheme of the invention, the description capability of the internet streaming media for the content is enhanced by providing the streaming media content description metadata to describe the content of the streaming media resource file and processing the streaming media resource file based on the content description metadata, and the problem that the massive streaming media resource content is difficult to manage only according to the current streaming media resource description information in the related technology is solved, so that the streaming media can be more finely managed, distributed and counted based on the content, and can be more pertinently recommended to the user.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a flowchart of a streaming media processing method according to embodiment 1 of the present invention;
fig. 2 is a block diagram of a streaming media processing apparatus according to embodiment 2 of the present invention;
fig. 3 is a block diagram one of a preferred structure of a streaming media processing device according to embodiment 2 of the present invention;
fig. 4 is a block diagram of a preferred structure of a streaming media processing device according to embodiment 2 of the present invention;
fig. 5 is a flowchart of generation and update of content description metadata of a streaming media resource file according to embodiment 4 of the present invention;
fig. 6 is a schematic diagram of embedding a streaming media content description metadata VideoContentMeta tag in an mpd according to embodiment 6 of the present invention;
fig. 7 is a schematic diagram of embedding the streaming media CONTENT description METADATA EXT-X-CONTENT-METADATA tag in m3u8 according to embodiment 6 of the present invention;
fig. 8 is a block diagram of a directory structure of an HLS streaming media resource according to embodiment 6 of the present invention;
fig. 9 is a schematic diagram of a user player acquiring content description metadata and a streaming media resource by acquiring a master index according to embodiment 6 of the present invention;
FIG. 10 is a diagram illustrating a process of generating a user guide menu and a user playing interface according to embodiment 7 of the present invention;
FIG. 11 is a flowchart of acquiring a user representation according to embodiment 8 of the present invention;
fig. 12 is a schematic diagram of implementing intelligent scheduling of the CDN based on multidimensional heat analysis according to embodiment 9 of the present invention.
Detailed Description
Due to the development of large video services, users cannot browse massive video contents. Since there is no description of the content actually contained in the streaming media (for example, the HLS index only describes the URL of the segment file, and there is no description of the scene content of the related segment file), although the industry also adopts a thumbnail method, some static pictures are browsed when the user drags the progress bar, but after all, the player itself cannot identify and needs to be operated by a viewer), when the user player plays the streaming media, the content that the user is interested in or interested in cannot be quickly located according to the limited streaming media resource description metadata (m3u8 or mpd). Moreover, if the user wants to find the content in which the user is interested in within a limited time, the user can only locate the desired video segment by dragging, fast forwarding and fast rewinding. In addition, when a user uses a video production tool to produce a customized streaming media, a certain time is needed to manually play and view the streaming media content, a player is frequently used to frequently perform operations such as fast forward, fast backward, pause and the like in the production process, then the time points of concerned video scenes are manually recorded, and then the time points of the concerned video scenes are connected in series by using the video production tool.
When the video website carries out user playing statistics and recommendation, the user playing statistics and recommendation are also carried out based on limited text description and complete user playing records, and because scene information, actor information and other specific content information which are watched by the user in a key mode cannot be obtained, accurate portrayal of user preference cannot be achieved, for example, the user watches a certain gunfight film, but cannot know whether the gunfight scene or a certain actor is preferred or emotional play in the gunfight scene.
In addition, most video websites deploy a Content Delivery Network (CDN) architecture from a film library, a central node, a region node to an edge node. The edge nodes carry the services of the vast majority of subscribing users. In a conventional manner, when a streaming media resource file is distributed to an edge node, a lagging statistical distribution manner is often used, that is: after the 'miss' of the edge node reaches a certain proportion, some streaming media fragment files are distributed to the edge node by the central node or the area node. The distribution mode often has no instantaneity, and in addition, the distribution mode cannot sense the fragment content and count the playing behavior of the user.
Most video websites currently use a hierarchical storage system, namely: the streaming media file with more playing times in a complete streaming media is migrated from a slow mass storage (such as a traditional mechanical hard disk) to a novel storage medium (such as an SSD) with a small capacity to improve the throughput. When the current video website carries out hot-cut migration, the migration of the hot-cut streaming media file is carried out after the playing heat of a specific segment in the complete streaming media content reaches a certain value by a user based on the analysis after the fact. Such migration methods tend to have hysteresis. It is not possible to describe in advance which segments are hot segments and which segments are cold segments in a complete stream.
Moreover, most video websites currently use Just-In-Time packing (JITP) to perform real-Time encoding, decoding and packing on streaming media resource files, so as to meet the playing requirements of users with different access terminals and different bandwidths. If the streaming media content can be known, only part of the streaming media file needs to be processed by JITP, thereby saving time and system resources.
However, no method is described for internet streaming media content in the industry at present, and embodiments of the present invention provide a streaming media processing method, a streaming media processing device, a storage medium, and an electronic device, where streaming media content is described by streaming media content description metadata, and the streaming media content can be used for multiple purposes, such as user-defined playing, video website playing statistics, and CDN edge node instant delivery.
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
Example 1
Fig. 1 is a flowchart of a streaming media processing method according to embodiment 1 of the present invention. As shown in fig. 1, the streaming media processing method may include:
step S102, obtaining content description metadata of a streaming media resource file, wherein the content description metadata is metadata describing contents of the streaming media resource file (for example, an actually displayed episode, a scene, a character and the like during the playing of streaming media, namely, an actually displayed picture, sound and a subtitle during the playing of the media) under one or more content description dimensions;
and step S104, processing the streaming media resource file based on the content description metadata.
The description of the content of the streaming media resource file is carried out by providing the streaming media content description metadata, so that the description capability of the internet streaming media for the content is enhanced, the problem that the massive streaming media resource content is difficult to manage only according to the current streaming media resource description information in the related technology is solved, and the more detailed management, distribution and statistics of the streaming media based on the content and the more targeted recommendation to the user become possible.
The content description dimension may be a preset condition of the streaming media content description, and for example, the preset condition of the streaming media content description may be set according to a producer, a director, a main actor and scene, a caption, a scene bridge, a scene, a popularity, a rating, a picture sample, a sound clip sample, a video clip sample, or a related combination thereof. It should be noted that, in addition to the content description dimension based on the text or file expression, a multimedia sample file based on the video sample, the audio sample, and the picture sample may be set, so that the expression manner of the content description dimension may be enhanced, and the content description dimension may be more accurate.
The above streaming media resource files may be encoded files containing streaming media content of audio and video, such as files suffixed with mp4, files suffixed with ts, files suffixed with fmp4, and so on.
The content description metadata of the streaming media resource file may describe one or more dimensions of the content itself in the form of json (java script object notification) or xml (extensible Markup language), and generate a description file of the one or more dimensions of the content description metadata.
The content description metadata of the streaming media resource file can be generated by the following steps and embedded into the streaming media index file:
analyzing the content of the streaming media resource file based on the one or more content description dimensions to generate the content description metadata of the streaming media resource file, as an optional implementation manner, inputting a streaming media content analysis model to the streaming media resource file, segmenting the streaming media resource file based on the one or more content description dimensions, and recording segmented information as the content description metadata of the streaming media resource file; or, performing matching degree evaluation on the content of the streaming media resource file and the one or more content description dimensions, and recording information of a segment with the matching degree higher than a first threshold in the content of the streaming media resource file as the content description metadata of the streaming media resource file;
merging the content description metadata with the resource description metadata of the streaming media resource file to generate a streaming media index file corresponding to the streaming media resource file, specifically, associating the content description metadata with the resource description metadata of the streaming media resource file, and embedding a mark of the content description metadata in the resource description metadata of the streaming media resource file; and writing the content description metadata and the resource description metadata into a streaming media index file corresponding to the streaming media resource file. An exemplary implementation of associating content description metadata with resource description metadata may be found in the example described in example 6.
At this time, to acquire the content description metadata of the streaming media resource file, the streaming media index file of the streaming media resource file may be acquired first, and the content description metadata of the streaming media resource file may be acquired according to the streaming media index file.
In practical applications, for the preset condition of the popularity in the content description dimension, since it relates to the access record statistics after the streaming media resource is actually published, the content description metadata about popularity can be generated according to the access popularity of the streaming media resource file after the streaming media resource file is published. In this embodiment, the following steps may be taken to generate and update content description metadata about popularity:
publishing the streaming media resource file and the streaming media index file corresponding to the streaming media resource file;
and counting the access heat of each segment of the content of the streaming media resource file, adding metadata which describes the content of the streaming media resource file and takes the access heat as a content description dimension into the content description metadata, and updating the streaming media index file.
For the generation of the resource description metadata and the update process of the resource description metadata according to the access heat after the streaming media is published, refer to the example described in embodiment 4.
The streaming media content is described by providing the streaming media content description metadata, so that the content of the streaming media can be managed conveniently and comprehensively, and the information can be applied to many scenes, and a few examples of applying the streaming media content description metadata are given below.
As an embodiment, multiple versions of an original streaming media resource file may be generated based on content description metadata, so as to adapt to different resource acquisition requirements. For example, after removing segments, of which the corresponding content description meets a first preset condition, from the streaming media resource file based on the content description metadata, other segments in the streaming media resource file may be combined into a streaming media resource subfile; or, based on the content description metadata, extracting segments, corresponding to content descriptions meeting a second preset condition, in the streaming media resource file, and combining the extracted segments into a streaming media resource subfile. A specific example of generating multiple versions of an original streaming media asset file based on content description metadata can be seen in embodiment 5.
As another embodiment, the content description metadata may be provided to the user player so that it generates a guide menu based on the content description metadata, providing a streaming media playing service more conforming to the user's preference for the user's selection. For example, a guide menu may be generated and displayed for the streaming media resource file according to the one or more content description dimensions based on the content description metadata; and responding to the received selection instruction, and playing the streaming media resource file. Specifically, the user player may determine a filtering condition under the selected content description dimension according to the received selection instruction; extracting the segments which meet the screening conditions in the content of the streaming media resource file for playing, for example, the segments which are preferred by the user can be played in a centralized manner; or, for a segment meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a first code rate, and for a segment not meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a second code rate, and playing the segment file with the first code rate and the segment file with the second code rate, where the first code rate is higher than the second code rate, that is, a bridge segment preferred by a user may be downloaded and played with a high code rate, and a bridge segment not much concerned by the user may be downloaded and played with a low code rate. A specific example of the user player performing the guidance and selective play based on the content description metadata can be seen in embodiment 7.
As another embodiment, a user may be rendered based on content description metadata in conjunction with a user's access record. For example, a user access record of the streaming media resource file may be obtained; and counting the playing behavior of the user based on the content description metadata and the user access record. The statistical result of the user playing behavior may include playing preferences in one or more content description dimensions, and after the user playing behavior is counted based on the content description metadata and the user access record, a segment that meets the playing preferences in the streaming media resource file may be selected for playing based on the content description metadata of the streaming media resource file in response to a received playing request for the streaming media resource file. A specific example of portraying a user based on content description metadata in conjunction with a record of access by the user can be seen in example 8.
As another embodiment, intelligent distribution of content-aware can be achieved based on content description metadata. For example, a segment of the streaming media resource file with a degree of access above a second threshold may be determined based on the content description metadata of the streaming media resource file; notifying scheduling information of the segments whose access heat is determined to be higher than the second threshold to an edge node. In response to the scheduling information, the edge node may schedule the segments whose determined access heat is higher than the second threshold to local. A specific example of implementing intelligent distribution of perceptual content based on content description metadata can be seen in example 9.
Example 2
This embodiment provides a streaming media processing apparatus, which is used to implement the foregoing embodiments and preferred embodiments, and the description of the apparatus is omitted for brevity. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 2 is a block diagram of a streaming media processing apparatus according to embodiment 2 of the present invention. As shown in fig. 2, the streaming media processing device may include an acquisition module 22 and a processing module 24.
The obtaining module 22 is configured to obtain content description metadata of the streaming media resource file, where the content description metadata is metadata describing content of the streaming media resource file in one or more content description dimensions.
The processing module 24 is connected to the obtaining module 22, and is configured to process the streaming media resource file based on the content description metadata.
Fig. 3 is a block diagram of a preferred structure of a streaming media processing device according to embodiment 2 of the present invention. As shown in fig. 3, the streaming media processing apparatus may further include a content description metadata generation module 32 and a merging module 34 on the basis of the acquisition module 22 and the processing module 24.
The content description metadata generation module 32 is configured to analyze the content of the streaming media resource file based on the one or more content description dimensions, and generate the content description metadata of the streaming media resource file. The content description metadata generation module 32 may be configured to input the streaming media resource file into a streaming media content analysis model, segment the streaming media resource file based on the one or more content description dimensions, and record segmented information as the content description metadata of the streaming media resource file; or, the content of the streaming media resource file is evaluated with the matching degree of the one or more content description dimensions, and information of a segment with the matching degree higher than a first threshold value in the content of the streaming media resource file is recorded as the content description metadata of the streaming media resource file.
The merging module 34 is connected to the content description metadata generation module 32 and the obtaining module 22, and is configured to merge the content description metadata with the resource description metadata of the streaming media resource file, and generate a streaming media index file corresponding to the streaming media resource file. The merging module 34 may be configured to associate the content description metadata with the resource description metadata of the streaming media resource file, and embed a tag of the content description metadata in the resource description metadata of the streaming media resource file; and writing the content description metadata and the resource description metadata into a streaming media index file corresponding to the streaming media resource file.
The obtaining module 22 may be configured to obtain the streaming media index file of the streaming media resource file; and acquiring the content description metadata of the streaming media resource file according to the streaming media index file.
Fig. 4 is a block diagram of a preferred structure of a streaming media processing device according to embodiment 2 of the present invention. As shown in fig. 4, the streaming media processing apparatus may further include a publishing module 42 and a statistics module 44 based on the obtaining module 22, the processing module 24, the content description metadata generation module 32 and the merging module 34.
The publishing module 42 is connected to the merging module 34, and configured to publish the streaming media resource file and the streaming media index file corresponding to the streaming media resource file.
A statistics module 44, connected to the publishing module 42, the content description metadata generation module 32 and the merging module 34, configured to count access heat of each segment of the content of the streaming media resource file, notify the content description metadata generation module 32 to add metadata describing the content of the streaming media resource file with the access heat as a content description dimension to the content description metadata, and notify the merging module 34 to update the streaming media index file.
The streaming media content is described by providing the streaming media content description metadata, so that the content of the streaming media can be managed conveniently and comprehensively, and the information can be applied to many scenes, and a few examples of applying the streaming media content description metadata are given below.
As an embodiment, the processing module 24 may be configured to, based on the content description metadata, remove segments, of the streaming media resource file, of which corresponding content descriptions meet a first preset condition, and then combine other segments in the streaming media resource file into a streaming media resource subfile; or, based on the content description metadata, extracting segments, corresponding to content descriptions meeting a second preset condition, in the streaming media resource file, and combining the extracted segments into a streaming media resource subfile. A specific example of generating multiple versions of an original streaming media asset file based on content description metadata can be seen in embodiment 5.
As another embodiment, the processing module 24 may be configured to generate and display a guide menu for the streaming media resource file according to the one or more content description dimensions based on the content description metadata; and responding to the received selection instruction, and playing the streaming media resource file. The processing module 24 may be configured to determine a filtering condition under the selected content description dimension according to the received selection instruction; extracting the segments which accord with the screening condition in the content of the streaming media resource file for playing; or, for a segment meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a first code rate, and for a segment not meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a second code rate, and playing the segment file with the first code rate and the segment file with the second code rate, wherein the first code rate is higher than the second code rate. A specific example of the user player performing the guidance and selective play based on the content description metadata can be seen in embodiment 6.
As another embodiment, the processing module 24 may be configured to obtain a user access record of the streaming media resource file; and counting the playing behavior of the user based on the content description metadata and the user access record. The statistical result of the user playing behavior comprises playing preferences in one or more content description dimensions, and the apparatus may further comprise: and the playing module is used for responding to a received playing request aiming at a streaming media resource file, and selecting the segments meeting the playing preference in the streaming media resource file to play based on the content description metadata of the streaming media resource file. A specific example of portraying a user based on content description metadata in conjunction with a record of access by the user can be seen in example 7.
As another embodiment, the processing module 24 may be configured to determine, based on the content description metadata of the streaming media resource file, a segment of the streaming media resource file with a degree of access heat higher than a second threshold; notifying scheduling information of the segments whose access heat is determined to be higher than the second threshold to an edge node. A specific example of implementing intelligent distribution of perceptual content based on content description metadata can be found in embodiment 8.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Example 3
Embodiments of the present invention also provide a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s1, obtaining content description metadata of a streaming media resource file, where the content description metadata is metadata describing content of the streaming media resource file (e.g., an episode, a scene, a character, etc. actually shown during playing of streaming media, i.e., a picture, a sound, and a subtitle actually shown during playing of media) in one or more content description dimensions;
s2, processing the stream media resource file based on the content description metadata.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, obtaining content description metadata of a streaming media resource file, where the content description metadata is metadata describing content of the streaming media resource file (e.g., an episode, a scene, a character, etc. actually shown during playing of streaming media, i.e., a picture, a sound, and a subtitle actually shown during playing of media) in one or more content description dimensions;
s2, processing the stream media resource file based on the content description metadata.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
Example 4
The embodiment provides a method for describing contents of a multi-dimensional streaming media, which enhances the description capability of the internet streaming media for the contents, and describes the contents by expanding metadata of the streaming media contents: the multidimensional content metadata of the content itself is described using, without limitation, JSON or XML, and the like, and a description file of the multidimensional content metadata is generated as part of the media asset. Fig. 5 is a flowchart of generation and update of content description metadata of a streaming media resource file according to embodiment 4 of the present invention. As shown in fig. 5, the process includes the following steps:
step S502, acquiring complete streaming media resource description metadata and streaming media resource files;
step S504, determining preset content description dimensions (content scene, actor information, popularity, restriction level, scenario bridge, etc.), in this embodiment, in addition to the content description dimensions based on text or file expression, multimedia sample files based on video sample, audio sample, and picture sample can be set, thereby enhancing the expression mode of the content description dimensions and making the content description dimensions more accurate;
step S506, based on the content description dimension, using the multi-dimensional content description metadata generation system, performing multi-dimensional analysis (by using an intelligent multimedia video analysis tool or by using methods such as manual identification and producer marking) on the target media content according to the input content and the preset content description dimension, performing scene identification, character identification, and voice identification on the target video content, and generating a multi-dimensional content metadata file, which includes a description file or a picture, a voice, and other media not limited to the JSON format or the XML format, as the content description metadata file.
Step S508, based on the generated multidimensional content metadata file, integrating the generated multidimensional content metadata file into the original video index file through the multidimensional content description metadata integration module to form a complete content description index file.
Step S510, the content with the multi-dimensional content metadata is published to the video media service system for service.
Step S512, in the video media service process, the access heat of the media file is statistically analyzed through a statistical analysis system to obtain the heat value of each segment of the content, and then the heat description dimension is increased through a multi-dimensional content description metadata generation system and a content description index file is added.
The multi-dimensional content description index file generated by the embodiment can be conveniently accessed by the player, and content description information of the multi-dimensional content description index file is obtained, so that personalized intelligent playing of the player can be conveniently realized, user experience is improved, and user time is saved.
Example 5
The video content provider or the video website can generate a plurality of streaming media versions according to the content description metadata with different dimensions, which is equivalent to generating a plurality of sub-version contents from one original content.
A video content provider or a video website may define content description of a dimension according to a film rating, a film feature, a film hero, a visit popularity, and the like, where the level dimension is a description of rating information for a segment of video content according to a requirement of local law on video rating.
Figure BDA0001703492570000181
Figure BDA0001703492570000191
Through the multi-dimensional description index in the JSON format, streaming media content description metadata for various sub-versions of the same movie can be generated, such as: a condensed version, a child-visible version, a version specific to a certain hero or lead actor, etc.
For example, metadata is described for streaming media content that resembles a JSON format like:
Figure BDA0001703492570000192
Figure BDA0001703492570000201
Figure BDA0001703492570000211
Figure BDA0001703492570000221
Figure BDA0001703492570000231
Figure BDA0001703492570000241
descriptions about other dimensions may be extended.
Thus, for the same original movie file, through "streaming media content description metadata", extracting corresponding media segments, and generating multiple movies of different sub-versions (a system side generates multiple index files, such as R-level, PG-13-level, and G-level indexes, where the R-level index corresponds to a request for R-level content, and the G-level index corresponds to a request for G-level content). One original film and a plurality of versions can effectively save storage space.
For example, according to the classification rule of U.S. movies, an R-class movie (restricted class, under 17 years of age, a viewer is required to have a parent or adult accompanying view — this class of movie contains adult content, and there are many scenes such as sexual love, violence, drug abuse/excessive bloody smell, and the like and dirty words), and after the identification and arrangement of content metadata, after removing part of the restricted class shots and scenes, the R-class movie can be converted into a G-class (popular class) for all ages to watch.
Meanwhile, multiple pieces of content description metadata with different dimensions and original streaming media resources can be stored on a video website or a film library server of a video content provider together, so that a user can use an HLS protocol or a DASH protocol to realize online playing and offline downloading playing of different video sub-versions.
Example 6
The embodiment describes how a standard media resource index file adds a description of multi-dimensional content description metadata, that is, how to associate a streaming media resource description with a streaming media content description, by a specific example.
The m3u8 or mpd has strong expansibility, and as an alternative implementation, the stream media content description metadata can be directly embedded on the basis of the existing m3u8 or mpd.
Fig. 6 is a schematic diagram of embedding a streaming media content description metadata VideoContentMeta tag in an mpd according to embodiment 6 of the present invention, and as shown in fig. 6, a multidimensional streaming media content description metadata VideoContentMeta tag may be embedded in an mpd.
Fig. 7 is a schematic diagram of embedding the streaming media CONTENT description METADATA EXT-X-CONTENT-METADATA tag in m3u8 according to embodiment 6 of the present invention, and as shown in fig. 7, a multi-dimensional streaming media CONTENT description METADATA EXT-X-CONTENT-METADATA tag may be embedded in one m3u 8.
Fig. 8 is a block diagram of a directory structure of an HLS streaming media resource according to embodiment 6 of the present invention, and as shown in fig. 8, the directory structure extends multi-dimensional content description in a main index file index.m3u8 except that the directory structure includes streaming media resource segments 001, ts... 00n.ts with different bitrate.
Fig. 8 shows a content description clip in which a description manner based on the relative play time (PlayBeginTime and PlayEndTime fields) of movies is used, such as that in the Actor-based description file clip, the description for Actor 1(Actor1) is:
Actor1
Figure BDA0001703492570000261
PlayBeginTime and PlayEndTime describe the start and end time periods, respectively, in which the Actor1 appears in a movie, and Actor1 appears in many places in a movie, so there are multiple PlayBeginTime and PlayEndTime segments. A relative time equivalent to the play out using the movie is associated with the streaming media asset.
It should be noted that the embodiment of the present invention does not limit the way the content description is associated with the streaming media resource. In the following example, it is shown whether the slicing file is used in HLS and the associated manner in byte offset in the slicing file, or the segment example is described in content based on actors:
Actor1
Figure BDA0001703492570000262
Figure BDA0001703492570000271
as described above, the start point and the end point each include a description of the content slice file and the offset bytes, and thus the content description metadata is associated with the resource description metadata.
Fig. 9 is a schematic diagram of a user player acquiring content description metadata and a streaming media resource by acquiring a master index according to embodiment 6 of the present invention. As shown in fig. 9, the user player successfully acquires the multi-dimensional content description flag in the main index at the same time of acquiring the main index index.m3u 8. The streaming media server adopts an HLS directory structure sample and comprises two types of files with subcode rates:
1677722_ directory corresponding to high bit rate stream media resource file;
641000_ directory corresponding to low bit rate streaming media resource file.
Further, index.m3u8 integrates a master index of streaming media content description metadata.
Example 7
Fig. 10 is a schematic diagram of a user guide menu generation process and a user play interface according to embodiment 7 of the present invention, and illustrates how a player implements a user guide menu function through multi-dimensional content description metadata. As shown in fig. 10, the process may include the steps of:
s1002, when the user player plays the internet streaming media, the user player acquires a main index file, for example, the main index index.m3u8 is acquired for the HLS, and the index.mpd, the index.m3u8 and the index.mpd may contain the multidimensional content description metadata or may not contain the multidimensional content description metadata and the user player separately acquires the multidimensional content description metadata file, where fig. 10 shows a case where the multidimensional content description metadata file is separately acquired.
S1004, the user player parses index.m3u8 or index.mpd, acquires a content description metadata path in the base, acquires a content description file, and after acquiring the content description file, parses "streaming media content description metadata" therein, respectively.
S1006, the user player generates a guide menu according to the "streaming media content description metadata", for example, the guide menu includes a focus generated according to the content description dimension: such as actor present, scene, plot bridge, heat, etc. The user can quickly switch to the corresponding playing picture through the selection of the 'guide menu', or selectively play the video media content, such as only watching the shots of a favorite actor, or quickly browse (the browsing time can be selected, for example, when the user finishes watching 10 minutes, the player can extract the segmented files of 10 minutes according to the heat of each segment of the content to play), and can switch to the normal playing mode at any time according to the needs of the user.
Under the condition of limited network bandwidth, the method and the process of the embodiment can also effectively save system resources and user bandwidth, for example, in a multi-rate scene of HLS and DASH, when playing the content that the current user is interested in, a higher rate is downloaded for playing, and when playing the content that is not interested in by the user, a lower rate is downloaded for playing, so that the network bandwidth can be effectively saved.
Example 8
Fig. 11 is a flowchart of obtaining a user representation according to embodiment 8 of the present invention, which illustrates how to obtain preferences of a user for video scenes, actors, etc., accurate representation of the user, and implement personalized smart play through multi-dimensional content description metadata. As shown in fig. 11, the process includes the following steps:
s1102, the video service provider obtains the user playing behavior (such as a user access log or a ticket) through statistics, and in addition, the video service provider also obtains content description metadata.
And S1104, performing fusion analysis on the user access log and the multi-dimensional content description metadata, wherein the records of the user access video content are combined with the multi-dimensional content description metadata, so that information such as scenes, actors, plot bridges and the like watched by the user can be accurately known.
S1106, accurate user portrait can be obtained through fusion analysis of user playing behaviors.
S1108, according to the user profile, the client may obtain the user' S preference and preference for the media content, such as a preference for some action scenes or some actors, and a dislike for the bridge segment.
S1110, the player can realize personalized intelligent playing for each user according to the information and the acquired content description metadata information of the on-demand content (only scenes and actors which are interested by the user are played, and uninteresting plot bridge segments can be automatically skipped over).
Example 9
Fig. 12 is a schematic diagram of implementing intelligent scheduling of a CDN based on multidimensional heat analysis according to embodiment 9 of the present invention, and illustrates a process of implementing intelligent delivery of perceptual content by using multidimensional content description metadata in combination with statistical analysis, where as shown in fig. 12, the process includes the following steps:
and S1202, the CDN statistical analysis system performs multidimensional heat analysis on the content according to the access information and the multidimensional content information, such as scene heat, actor heat, director heat and the like, and analysis results are periodically sent to a CDN content management module (responsible for content management and scheduling of the CDN).
S1204, the new content is injected into the central content library of the CDN, and the multidimensional content description metadata file is contained at the same time.
S1206, the CDN content management module obtains multi-dimensional content description metadata of the content.
And S1208, the CDN content management module generates an intelligent distribution strategy of the content according to the multidimensional heat statistical result and in combination with the multidimensional content description metadata of the content, and notifies each edge node of the fragment content scheduling messages if the parts of the content are likely to be hot spots. For example, the recent statistics of the popularity of the car road pursuit scenes is very high, and the contents of the car road pursuit scene part of the contents are distributed to the edge nodes by analyzing the content description metadata of the release contents to find that several scenes belong to the car road pursuit scenes.
S1210, the CDN edge node schedules the content partial segment according to the scheduling message.
Therefore, the multi-dimensional content description metadata is introduced, so that the media video service system, particularly the CDN, can conveniently sense the content, and the intelligent distribution scheduling of the content can be realized based on the multi-dimensional heat analysis.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.

Claims (22)

1. A streaming media processing method, comprising:
obtaining content description metadata of a streaming media resource file, wherein the content description metadata is metadata describing content of the streaming media resource file in one or more content description dimensions;
processing the streaming media resource file based on the content description metadata;
before obtaining the content description metadata of the streaming media resource file, the method further includes:
analyzing the content of the streaming media resource file based on the one or more content description dimensions, and generating the content description metadata of the streaming media resource file;
merging the content description metadata and the resource description metadata of the streaming media resource file to generate a streaming media index file corresponding to the streaming media resource file;
publishing the streaming media resource file and the streaming media index file corresponding to the streaming media resource file;
and counting the access heat of each segment of the content of the streaming media resource file, adding metadata which describes the content of the streaming media resource file and takes the access heat as a content description dimension into the content description metadata, and updating the streaming media index file.
2. The method of claim 1, wherein obtaining content description metadata for a streaming media asset file comprises:
acquiring the streaming media index file of the streaming media resource file;
and acquiring the content description metadata of the streaming media resource file according to the streaming media index file.
3. The method of claim 1, wherein analyzing the content of the streaming media asset file based on the one or more content description dimensions, and wherein generating the content description metadata for the streaming media asset file comprises:
inputting the streaming media resource file into a streaming media content analysis model, segmenting the streaming media resource file based on the one or more content description dimensions, and recording segmented information as the content description metadata of the streaming media resource file; alternatively, the first and second electrodes may be,
and evaluating the matching degree of the content of the streaming media resource file and the one or more content description dimensions, and recording the information of the segments with the matching degree higher than a first threshold value in the content of the streaming media resource file as the content description metadata of the streaming media resource file.
4. The method of claim 1, wherein merging the content description metadata with resource description metadata of the streaming media resource file, and generating a streaming media index file corresponding to the streaming media resource file comprises:
associating the content description metadata with the resource description metadata of the streaming media resource file, and embedding a mark of the content description metadata in the resource description metadata of the streaming media resource file;
and writing the content description metadata and the resource description metadata into a streaming media index file corresponding to the streaming media resource file.
5. The method of claim 1, wherein processing the streaming media asset file based on the content description metadata comprises:
based on the content description metadata, removing segments, corresponding to content description meeting a first preset condition, in the streaming media resource file, and then combining other segments in the streaming media resource file into a streaming media resource subfile; alternatively, the first and second electrodes may be,
and extracting the segments of which the corresponding content description meets a second preset condition in the streaming media resource file based on the content description metadata, and combining the extracted segments into a streaming media resource subfile.
6. The method of claim 1, wherein processing the streaming media asset file based on the content description metadata comprises:
based on the content description metadata, generating a guide menu for the streaming media resource file according to the one or more content description dimensions and displaying the guide menu;
and responding to the received selection instruction, and playing the streaming media resource file.
7. The method of claim 6, wherein playing the streaming media asset file in response to the received selection instruction comprises:
determining a screening condition under the selected content description dimension according to the received selection instruction;
extracting the segments which accord with the screening condition in the content of the streaming media resource file for playing; or, for a segment meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a first code rate, and for a segment not meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a second code rate, and playing the segment file with the first code rate and the segment file with the second code rate, wherein the first code rate is higher than the second code rate.
8. The method of claim 1, wherein processing the streaming media asset file based on the content description metadata comprises:
acquiring a user access record of the streaming media resource file;
and counting the playing behavior of the user based on the content description metadata and the user access record.
9. The method of claim 8, wherein the statistics of user playback behavior include playback preferences in one or more content description dimensions, and wherein after performing statistics of user playback behavior based on the content description metadata and the user access records, the method further comprises:
and responding to a received playing request aiming at a streaming media resource file, and selecting a segment meeting the playing preference in the streaming media resource file to play based on the content description metadata of the streaming media resource file.
10. The method of claim 1, wherein processing the streaming media asset file based on the content description metadata comprises:
determining a segment of the streaming media resource file with the access heat higher than a second threshold value based on the content description metadata of the streaming media resource file;
notifying scheduling information of the segments whose access heat is determined to be higher than the second threshold to an edge node.
11. A streaming media processing apparatus, comprising:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring content description metadata of a streaming media resource file, and the content description metadata is metadata for describing the content of the streaming media resource file under one or more content description dimensions;
the processing module is used for processing the streaming media resource file based on the content description metadata;
wherein the apparatus further comprises:
a content description metadata generation module, configured to analyze the content of the streaming media resource file based on the one or more content description dimensions, and generate the content description metadata of the streaming media resource file;
a merging module, configured to merge the content description metadata with resource description metadata of the streaming media resource file, and generate a streaming media index file corresponding to the streaming media resource file;
the publishing module is used for publishing the streaming media resource file and the streaming media index file corresponding to the streaming media resource file;
and the counting module is used for counting the access heat of each segment of the content of the streaming media resource file, informing the content description metadata generation module to add the metadata which describes the content of the streaming media resource file and takes the access heat as a content description dimension into the content description metadata, and informing the merging module to update the streaming media index file.
12. The apparatus of claim 11, wherein the obtaining module is configured to:
acquiring the streaming media index file of the streaming media resource file;
and acquiring the content description metadata of the streaming media resource file according to the streaming media index file.
13. The apparatus of claim 11, wherein the content description metadata generation module is configured to:
inputting the streaming media resource file into a streaming media content analysis model, segmenting the streaming media resource file based on the one or more content description dimensions, and recording segmented information as the content description metadata of the streaming media resource file; alternatively, the first and second electrodes may be,
and evaluating the matching degree of the content of the streaming media resource file and the one or more content description dimensions, and recording the information of the segments with the matching degree higher than a first threshold value in the content of the streaming media resource file as the content description metadata of the streaming media resource file.
14. The apparatus of claim 11, wherein the merging module is configured to:
associating the content description metadata with the resource description metadata of the streaming media resource file, and embedding a mark of the content description metadata in the resource description metadata of the streaming media resource file;
and writing the content description metadata and the resource description metadata into a streaming media index file corresponding to the streaming media resource file.
15. The apparatus of claim 11, wherein the processing module is configured to:
based on the content description metadata, removing segments, corresponding to content description meeting a first preset condition, in the streaming media resource file, and then combining other segments in the streaming media resource file into a streaming media resource subfile; alternatively, the first and second electrodes may be,
and extracting the segments of which the corresponding content description meets a second preset condition in the streaming media resource file based on the content description metadata, and combining the extracted segments into a streaming media resource subfile.
16. The apparatus of claim 11, wherein the processing module is configured to:
based on the content description metadata, generating a guide menu for the streaming media resource file according to the one or more content description dimensions and displaying the guide menu;
and responding to the received selection instruction, and playing the streaming media resource file.
17. The apparatus of claim 16, wherein the processing module is configured to:
determining a screening condition under the selected content description dimension according to the received selection instruction;
extracting the segments which accord with the screening condition in the content of the streaming media resource file for playing; or, for a segment meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a first code rate, and for a segment not meeting the screening condition in the content of the streaming media resource file, downloading a segment file with a second code rate, and playing the segment file with the first code rate and the segment file with the second code rate, wherein the first code rate is higher than the second code rate.
18. The apparatus of claim 11, wherein the processing module is configured to:
acquiring a user access record of the streaming media resource file;
and counting the playing behavior of the user based on the content description metadata and the user access record.
19. The apparatus of claim 18, wherein the statistics of user playback behavior comprise playback preferences in one or more content description dimensions, the apparatus further comprising:
and the playing module is used for responding to a received playing request aiming at a streaming media resource file, and selecting the segments meeting the playing preference in the streaming media resource file to play based on the content description metadata of the streaming media resource file.
20. The apparatus of claim 11, wherein the processing module is configured to:
determining a segment of the streaming media resource file with the access heat higher than a second threshold value based on the content description metadata of the streaming media resource file;
notifying scheduling information of the segments whose access heat is determined to be higher than the second threshold to an edge node.
21. A storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the method of any of claims 1 to 10 when executed.
22. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to execute the computer program to perform the method of any of claims 1 to 10.
CN201810645862.8A 2018-06-21 2018-06-21 Streaming media processing method and device, storage medium and electronic device Active CN108924606B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810645862.8A CN108924606B (en) 2018-06-21 2018-06-21 Streaming media processing method and device, storage medium and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810645862.8A CN108924606B (en) 2018-06-21 2018-06-21 Streaming media processing method and device, storage medium and electronic device

Publications (2)

Publication Number Publication Date
CN108924606A CN108924606A (en) 2018-11-30
CN108924606B true CN108924606B (en) 2020-06-16

Family

ID=64419853

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810645862.8A Active CN108924606B (en) 2018-06-21 2018-06-21 Streaming media processing method and device, storage medium and electronic device

Country Status (1)

Country Link
CN (1) CN108924606B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022211864A1 (en) * 2021-03-31 2022-10-06 Rovi Guides, Inc. Transmitting content based on genre information

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111510791B (en) 2019-01-30 2022-07-29 上海哔哩哔哩科技有限公司 Method and device for playing audio and video, computer equipment and readable storage medium
CN111757170B (en) * 2020-07-01 2022-09-23 三星电子（中国）研发中心 Video segmentation and marking method and device
CN116828270B (en) * 2023-07-05 2024-04-09 联通沃音乐文化有限公司 Intelligent segmentation labeling method for video data stream

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7451229B2 (en) * 2002-06-24 2008-11-11 Microsoft Corporation System and method for embedding a streaming media format header within a session description message
CN101026615B (en) * 2006-02-18 2011-09-14 华为技术有限公司 IMS-based flow media network system
CN101312522A (en) * 2007-05-22 2008-11-26 中兴通讯股份有限公司 Video play-on-demand system
US20110035382A1 (en) * 2008-02-05 2011-02-10 Dolby Laboratories Licensing Corporation Associating Information with Media Content
CN101242430B (en) * 2008-02-22 2012-03-28 华中科技大学 Fixed data pre-access method in peer network order system
CN101610244B (en) * 2008-06-20 2011-11-23 华为技术有限公司 Method for establishing personalized content delivery channel, user equipment and network equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022211864A1 (en) * 2021-03-31 2022-10-06 Rovi Guides, Inc. Transmitting content based on genre information

Also Published As

Publication number Publication date
CN108924606A (en) 2018-11-30

Similar Documents

Publication Publication Date Title
CN108924606B (en) Streaming media processing method and device, storage medium and electronic device
US20160149956A1 (en) Media management and sharing system
JP6379375B2 (en) Method and apparatus for processing social media for multimedia content shifted at a selected time
US10264314B2 (en) Multimedia content management system
JP5651231B2 (en) Media fingerprint for determining and searching content
KR102091414B1 (en) Enriching broadcast media related electronic messaging
KR101493696B1 (en) Method and Apparatus for generating integrated metadata
EP3563584A1 (en) Recommendation of segmented content
US20190259423A1 (en) Dynamic media recording
MX2014008657A (en) Receiving device, receiving method, program, and information processing system.
US20090043739A1 (en) Method of displaying customized data and browser agent
US10334302B2 (en) Method and system for segment based recording
US8805866B2 (en) Augmenting metadata using user entered metadata
BR112013017292A2 (en) disclosure of media asset usage data that indicates corresponding content creator
CN101925888A (en) Method and apparatus for providing metadata of contents, and method and apparatus for limiting use-authortity of contents
US10015548B1 (en) Recommendation of segmented content
US8745650B1 (en) Content segment selection based on time-shifted content viewing
CN106961626B (en) Method and device for automatically complementing and arranging video meta-information
JP2016213709A (en) Moving image reproduction system, client device, server device, and program
EP2864907A1 (en) Systems and methods for identifying electronic content using video graphs
KR20190091215A (en) Method and apparatus for streaming multimedia data without transcoding using meta data
KR20160067685A (en) Method, server and system for providing video scene collection
KR102659489B1 (en) Information processing devices, information processing devices and programs
KR102297362B1 (en) Apparatus and method for providing advertisement based on user characteristic using content playing apparatus
JP5780898B2 (en) Information providing apparatus, information providing method, and information providing program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant