CN118413696A

CN118413696A - Streaming media management system based on cross-cloud integrated environment

Info

Publication number: CN118413696A
Application number: CN202410578654.6A
Authority: CN
Inventors: 王丹; 孙洋; 屠媛媛; 谢辉; 万锋
Original assignee: Agricultural Information Institute of CAAS
Current assignee: Agricultural Information Institute of CAAS
Priority date: 2024-05-11
Filing date: 2024-05-11
Publication date: 2024-07-30

Abstract

The invention provides a streaming media management system based on a cross-cloud integrated environment, and relates to the technical field of streaming media application software in the cross-cloud integrated environment. The system provides perfect business management capability of cross-cloud, cross-system and cross-service, has overall extensible deployment and compatibility capability, supports smooth upgrade of system version and stable expansion of functional business, improves the integration capability with the existing website content management system and identity authentication system, and greatly reduces the application complexity of the cross-system and service of the cross-cloud integration environment-based streaming media management system in the cross-cloud integration field. Meanwhile, the cross-cloud integrated deployment mode improves the usability and the access capability, reduces the storage cost, and particularly can be used after quick expansion and buying when the service is expanded; and convenience is provided for users on the premise of ensuring the image transmission safety.

Description

Streaming media management system based on cross-cloud integrated environment

Technical Field

The invention relates to the technical field of streaming media application software in a cross-cloud integrated environment, in particular to a streaming media management system based on the cross-cloud integrated environment.

Background

This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.

A streaming media management system is a software system for managing and distributing streaming media content. With the rapid development of internet information technology, streaming media based on internet environment gradually shows unprecedented advantages in terms of transmission, and compared with the traditional image-text transmission mode, the experience of people on video and audio content is more visual, and the demand is more urgent. Streaming media management systems have been developed to meet the needs of users for high quality, high efficiency streaming media services.

At present, the support capability of the traditional website content management system for video data is very limited, inconvenience is brought to users, meanwhile, a plurality of scientific research institutions have risks of data leakage or data loss which cause data security threat when video is released through a third party platform, and the traditional website content management system cannot realize the full-link characteristic from generation, management and release of streaming media content.

Disclosure of Invention

In order to overcome the problems in the related art, the invention provides a streaming media management system based on a cross-cloud integrated environment, which at least solves the problem that the related art cannot be operated by a user conveniently on the premise of ensuring the data transmission safety to a certain extent, solves the problem that the access of internal and external network resources cannot be controllably isolated, realizes the remote access of an external website to the internal network resources, realizes the full-flow chained management from a streaming media generation end to an access end, and realizes the full-link characteristics of streaming media content from generation, management and release.

The embodiment of the invention provides a streaming media management system based on a cross-cloud integrated environment, which comprises the following components:

the system comprises a system deployment module, a streaming media management module and a resource control module;

The system deployment module is used for deploying application programs or services into a cross-cloud integrated environment, and realizing remote access of external websites to internal network resources by controllably isolating the access of the internal network resources and the external network resources;

the streaming media management module is used for automatically transcoding, labeling and editing the initial streaming media uploaded by the user by calling an application program or service deployed in the cross-cloud integrated environment to obtain target streaming media, and displaying the corresponding target streaming media to each video portal according to the retrieval result of the user;

The resource control module is used for distributing corresponding network resources according to the categories of the application programs or the services called by the streaming media management module, and carrying out safety protection on the access of the user to the target streaming media.

The technical scheme provided by the embodiment of the invention can comprise the following beneficial effects:

The system deployment module is used for deploying application programs or services into the cross-cloud integrated environment, realizing remote access of external websites to internal network resources by controllable isolation of internal and external network resource access, automatically transcoding, labeling and editing initial streaming media uploaded by a user by calling the application programs or services deployed in the cross-cloud integrated environment to obtain target streaming media, displaying the corresponding target streaming media to each video portal according to a search result of the user, and the resource control module is used for distributing corresponding network resources according to the category of the application programs or services called by the streaming media management module and carrying out safety protection on access of the target streaming media by the user. On one hand, the system deployment module can controllably isolate the access of the internal and external network resources, so that a user can remotely access the internal network resources through external websites in regions and countries, but the access authority is strictly controlled, and the confidentiality and the security of the internal network resources are improved while the access convenience is provided for the user; on the other hand, the resource management module can automatically transcode, label mark and edit the initial streaming media uploaded by the user by calling the application program or service deployed in the integrated environment, so that the user does not need to check whether the streaming media format is consistent with the system format before uploading, and the user does not need to self-summarize the content of the initial streaming media and select the corresponding label, thereby simplifying the process of uploading the initial streaming media by the user, providing convenience for the use of the user and realizing the full-link characteristic from generation, management and release of the streaming media content; in yet another aspect, the resource control module may allocate corresponding network resources according to the class of application or service invoked by the streaming media management module. The system resource can be reasonably utilized by each service, and the performance and stability of the system are improved. Meanwhile, the resource control module can also carry out safety protection on the access of the user to the target streaming media, so that the problem that the security of the system data is affected due to malicious attack and illegal access of individual users to the system data is avoided, and the data confidentiality and security of the system are improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

FIG. 1 is an exemplary diagram of a scenario for a cross-cloud integration environment based streaming media management system according to an exemplary embodiment of the present invention.

Fig. 2 is a general architecture diagram of a streaming media management system based on a cross-cloud integration environment according to an exemplary embodiment of the present invention.

Fig. 3 is a functional architecture diagram of a cross-cloud integration environment based streaming media management system according to an exemplary embodiment of the present invention.

Fig. 4 is a block diagram illustrating an exemplary streaming media management system based on a cross-cloud integration environment according to an exemplary embodiment of the present invention.

Fig. 5 is a block diagram of an identity authentication unit according to an exemplary embodiment of the present invention.

Fig. 6 is a block diagram of an automatic transcoding unit, according to an exemplary embodiment of the present invention.

Fig. 7 is a block diagram of a labeling unit according to an exemplary embodiment of the present invention.

Fig. 8 is a block diagram illustrating a streaming media editing unit according to an exemplary embodiment of the present invention.

Fig. 9 is a block diagram of a streaming media retrieval unit according to an exemplary embodiment of the present invention.

Fig. 10 is a block diagram of a streaming media presentation unit according to an exemplary embodiment of the present invention.

Fig. 11 is a flow chart of a cross-cloud integration environment based streaming media management system according to another exemplary embodiment of the present invention.

Fig. 12 is a sequence diagram of a cross-cloud integration environment based streaming media management system according to an exemplary embodiment of the present invention.

Fig. 13 is a schematic structural view of an electronic device according to an exemplary embodiment of the present invention for implementing an embodiment of the present invention.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention may be practiced without one or more of the specific details, or with other methods, components, devices, steps, etc. In other instances, well-known aspects have not been shown or described in detail to avoid obscuring aspects of the invention.

Furthermore, the drawings are merely schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software or in one or more hardware modules or integrated circuits or in different networks and/or processor devices and/or microcontroller devices.

FIG. 1 illustrates an exemplary diagram of a scenario in which a cross-cloud integration environment based streaming media management system may be employed in accordance with an embodiment of the present invention.

As shown in fig. 1, the scenario may include a server 100, a streaming media generation end 200, and a streaming media access end 300. The streaming media generating end 200 and the streaming media accessing end 300 may be various electronic devices with interactive functions, and the electronic devices may have a display screen thereon, where the display screen may be used to display the retrieved streaming media to the user, and may also display various UI interfaces for interaction to the user. In an actual embodiment of the present invention, the streaming media generating end 200 and the streaming media accessing end 300 may be a mobile terminal, a desktop computer, a handheld device, a virtual reality device, etc., which is not particularly limited in this example embodiment.

It should be understood that the numbers of servers 100 and streaming media generation end 200 and streaming media access end 300 in fig. 1 are merely illustrative. Any number of servers 100, streaming media generation end 200 and streaming media access end 300 may be provided according to implementation requirements, for example, the servers 100 may be a server cluster formed by a plurality of servers.

In the related art, there are the following problems:

At present, the traditional website content management system has very limited supporting capability for video data, firstly, the system cannot support uploading of large files, and cannot meet transcoding requirements of adapting to various video formats, so that inconvenience is brought to users; secondly, the traditional information transmission mode needs an independent video processing coder-decoder, so that the installation deployment and compiling environment difference of the video processing coder-decoder and the video processing coder-decoder in different hardware and operating systems are caused, and the complexity of installation deployment and expansion is increased; thirdly, the traditional content management system under the non-cross-cloud integrated environment has the problems that the storage cost is increased in the local hardware environment, the cross-system and service cooperation has the technical bottleneck, the imbalance of the resource consumption and the processing time of manuscript release and video transcoding exists, the consistency of the cooperative state cannot be kept, the operation is incoherent, management staff needs to process service call and the like besides executing the conventional management operation, and the complexity is increased during version upgrading and function service expansion; fourth, video resources in the conventional content management system cannot be intelligently managed, and an automatic tag system cannot be formed. Meanwhile, many scientific research institutions have risks of data leakage or data loss to threaten data security when video is released through a third party platform.

Based on one or more of the above problems, the embodiments of the present invention first provide a streaming media management system based on a cross-cloud integration environment, so as to provide convenience for users to use on the premise of ensuring security. The stream media management system based on the cross-cloud integrated environment can be used for unified management and release of multimedia resources such as video, audio and the like in the cross-cloud integrated environment. The streaming media management system based on the cross-cloud integrated environment can provide video management such as efficient uploading of the video resources, automatic collection of the system, classified editing and the like, and realizes multi-video format uploading, classified storage, editing processing, video transcoding, video slicing, intelligent labels, auditing management, intelligent retrieval, statistical analysis and online playing and publishing of the videos. The streaming media management system based on the cross-cloud integrated environment can support a plurality of media formats, is oriented to a unified streaming media management platform of a website and various applications of the cross-cloud integrated environment, and forms a good ecological circle of streaming media from production, processing to publishing and sharing.

Embodiment 1A streaming media management System based on a Cross-cloud Integrated Environment

Referring to fig. 2, a cross-cloud integration environment based streaming media management system 201 is shown, comprising the following modules:

the system deployment module 202 is used for deploying application programs or services into a cross-cloud integration environment, and realizing remote access of external websites to internal network resources by controllably isolating the access of the internal network resources and the external network resources;

The streaming media management module 203 is configured to automatically transcode, label tag and edit an initial streaming media uploaded by a user by calling an application program or a service deployed in a cross-cloud integrated environment, obtain a target streaming media, and display the corresponding target streaming media to each video portal according to a search result of the user;

The resource control module 204 is configured to allocate corresponding network resources according to the class of the application program or service called by the streaming media management module 203, and secure access of the user to the target streaming media.

According to the streaming media management system based on the cross-cloud integrated environment in the exemplary embodiment of the invention, on one hand, the system deployment module can controllably isolate the access of the internal and external network resources, so that a user can remotely access the internal network resources through the external websites in a cross-region and cross-country manner, but the access authority is strictly controlled, and the confidentiality and the security of the internal network resources are improved while the access convenience is provided for the user; on the other hand, the resource management module can automatically transcode, label mark and edit the initial streaming media uploaded by the user by calling the application program or service deployed in the integrated environment, so that the user does not need to check whether the streaming media format is consistent with the system format before uploading, and the user does not need to self-summarize the content of the initial streaming media and select the corresponding label, thereby simplifying the process of uploading the initial streaming media by the user, providing convenience for the use of the user and realizing the full-link characteristic from generation, management and release of the streaming media content; in yet another aspect, the resource control module may allocate corresponding network resources according to the class of application or service invoked by the streaming media management module. The system resource can be reasonably utilized by each service, and the performance and stability of the system are improved. Meanwhile, the resource control module can also carry out safety protection on the access of the user to the target streaming media, so that the problem that the security of the system data is affected due to malicious attack and illegal access of individual users to the system data is avoided, and the data confidentiality and security of the system are improved.

The streaming media management system based on the cross-cloud integrated environment provided by the embodiment of the invention can realize unified management and release of multimedia resources such as video and audio in the cross-cloud integrated environment, and can be used for solving the technical problems of video encoding and decoding, transcoding, cross-cloud service linkage, cross-system and cross-service collaboration in the cross-cloud integrated environment. The system can take streaming media automatic transcoding as a core in an autonomous controllable operating system environment, adopts a more reliable Euler operating system (openEuler, which is an open source and free enterprise operating system), realizes message transmission and data interaction by using distributed collaborative management, uses a message queue (MessageQueue, MQ) to deconstruct service request dependence among systems, and maintains state consistency while realizing decoupling among service transaction establishment. The collaborative multisystem module can be realized by adopting an internal micro-service and message queue mechanism, task collaboration among cross-system modules is realized, resource consumption of image-text release and video transcoding and frequent imbalance of processing are effectively processed by combining a service mode, operation interruption is avoided, service call among systems and state synchronization are unified cooperatively through the message queue, chained transaction call is formed, and complex service realization of cross-system and service can be completed only by executing conventional management operation at a management end; the packaging video processing codec performs service interaction with the website content system and the user management system, performs controllable upgrade adaptation on FFmpeg (open source software for video coding and decoding and format conversion) aiming at the technical bottlenecks of stream media resource management, cross-system and cross-service collaborative technologies of the traditional content management system, forms an automatic tag system of video resources, and realizes text knowledge graph labeling of video content.

The modules 202, 203, and 204 are described in detail below.

The system deployment module 202 is configured to deploy an application program or a service into a cross-cloud integrated environment, and implement remote access of an external website to an internal network resource by controllably isolating access to the internal and external network resources.

The system deployment module 202 includes a server deployment unit 401, configured to deploy, in an internal network, a server to which a streaming media management service belongs, and deploy, in an external network, a server to which a streaming media sharing service belongs; the firewall deployment unit 402 is configured to limit access to resources between the internal network and the external network according to the access rule. Wherein the access rule comprises: the stream media management service only performs resource access on the internal network, and the stream media sharing service can access the live recording data of the internal network.

For example, a server deployed on an internal network may perform unified management operations on streaming media by an organization administrator such as a scientific research unit, a college, etc., such as uploading, transcoding, quality monitoring, etc.; the server deployed on the external network can allow the user to access the streaming media content from any place, and realize the distribution sharing of the streaming media, the unified authentication and flow control of the user, and the like.

For example, open source streaming server software, such as Red5 (a streaming server developed in Java programming language) or Wowza (a professional and highly customizable streaming server) streaming server may be used to install on an internal network server, or a network (Web) application server, such as Tomcat (a Web application server with free open source code, belonging to a lightweight application server) may be used to install on an internal network server, and various management operations of streaming media are implemented through management interfaces or application programming interfaces (Application Programming Interface, API) provided by these software or applications.

For example, the access of the user may be limited according to the IP (Internet Protocol ) address of the user, for example, when a specific IP address is identified to have malicious attack, the firewall may block all access requests of the IP address, and may limit the requests of the external network to access the designated port, so as to prevent unauthorized access to the specific service, for example, when the firewall sets access requests of only 80 ports and 443 ports, the access requests of the external network to other ports may be denied, the accessed content may be checked, malicious codes or sensitive information in the access requests may be filtered, if it is found that the access requests violate the access rule, the request may be denied, or may be set in a specific time period, so that the condition that the access request of the external network is allowed or denied, and the delay of the end time of the maintenance is caused by the normal operation of the internal network due to the access interference of the external network during the maintenance or backup of the system is avoided, and the waiting time of the user for the maintenance of the system is reduced.

In an example embodiment of the present disclosure, a streaming media management system based on a cross-cloud integrated environment is basically deployed as two parts of an internal network and an external network, and a logical isolation mode is adopted to ensure file exchange and rights identification functions and ensure security of data storage and transmission.

Specifically, the internal network may deploy a server to which the video management end belongs and associated data, where the file storage may use local storage or map NAS (Network Attached Storage ) or the like, which is not particularly limited in this example embodiment.

The external network can deploy a server to which the on-demand application service belongs, and is used for pushing the on-demand video file to the client for playing in a streaming mode, and meanwhile, taking account of permission identification and access limitation.

The front-end routing layer may deploy ng ix (also known as engine x, a high performance HTTP (Hypertext Transfer Protocol, hypertext transfer protocol) and reverse proxy Web server) or F5 (a load balancing scheme) or other equivalent load balancing nodes for requesting load distribution.

The firewall may deploy isolation policies set for the internal network and the external network: the video management end is limited to access only on the intranet, video on demand and permission identification service can be opened to the outside, and live broadcast recorded video files can be one-way synchronized from external network storage to storage in the intranet; at the same time, the firewall may set rules to allow or prohibit specific IP addresses, ports or protocols to communicate, which may ensure that only authorized users may access the corresponding streaming media services.

Optionally, the streaming media management system can be provided with user login and administrator login, and is used for distributing the rights of browsing, uploading, inquiring and editing streaming media to the users, distributing the rights of auditing users to share video to the administrators, and carrying out split-rights management on the users, so that the management of the users of the system is transparent and fine while the workload of the administrators is effectively reduced.

For example, an RBAC (Role-Based Access Control based access control) model may be used to set respective access rights for users and administrators, e.g., users may only view personal information pages and system homepage content, and administrators may access and manage all user data and may view and audit materials submitted by users.

The RBAC model enables access control to streaming media management system resources by assigning permissions to a role and then assigning roles to a user. Typically a single user may have several roles, each with several rights. In this way, an authorization model of "user-role-rights" is constructed, in which the relationship between user and role, and between role and rights, is generally many-to-many. Wherein, the roles refer to abstract concepts with a set of related rights in the streaming media management system, representing the identity or function of the user in a specific context, such as an administrator, a common user, etc.; rights refer to permissions, such as read, write, modify, etc., that operate on resources of the streaming media management system, where rights can be assigned to roles; users refer to actual users of the streaming media management system, each user may be assigned one or more roles; assignment refers to associating roles with users to give the users corresponding rights.

On one hand, by controllably isolating the access of the internal network resources and the external network resources, the unauthorized remote access of the external website to the internal network resources can be effectively prevented, and when an application program or service is deployed, access rules are set to clearly specify which resources can be accessed by the external network, and the restricted access rules can effectively prevent illegal access and unauthorized data leakage and improve the security of the system; on the other hand, the application programs or services are deployed into the cross-cloud integrated environment, so that users can conveniently deploy and manage the application programs or services on different cloud platforms, and greater flexibility and selectivity are provided.

The streaming media management module 203 is configured to automatically transcode, label tag and edit an initial streaming media uploaded by a user by calling an application program or a service deployed in a cross-cloud integrated environment, obtain a target streaming media, and display the corresponding target streaming media to each video portal according to a search result of the user.

Referring to fig. 3, fig. 3 illustrates a functional example diagram of a streaming media management system 201 based on a cross-cloud integration environment in the present disclosure, a streaming media generating end 200 may implement streaming media uploading 301, streaming media management 302, automatic transcoding 303, streaming media auditing 304, labeling 305, online editing 306, and real-time monitoring 307 functions, and a streaming media accessing end 300 may implement streaming media browsing 308, streaming media searching 309, streaming media on-demand 310, streaming media live broadcasting 311, and streaming media referencing 312 functions.

The streaming media uploading 301 function can support efficient uploading of large files, and can realize fragment uploading or breakpoint continuous uploading, for example, the system supports uploading of large files with a size of more than 10G, and in the transmission process of video files, if the video files are interrupted by signals, dropped, abnormally shut down and the like, the video files are uploaded again without restarting, and the video files can be uploaded continuously from an interrupt position after being identified by the system. Meanwhile, in the process of uploading streaming media, the system can detect the streaming media cover at the same time, if no cover which is uploaded and/or to be uploaded is detected, the picture in the streaming media is automatically intercepted to generate the streaming media cover, if the uploaded cover is detected, the picture is used as the corresponding streaming media cover, and if the uploaded cover and the cover to be uploaded are detected at the same time, the cover to be uploaded is used as the streaming media cover, and the cover to be uploaded is covered after the cover to be uploaded is uploaded.

The streaming media management 302 function may add background users, modify user information, delete user accounts, assign user permissions, and query user information.

The streaming media auditing 304 functions may fully audit the uploaded streaming media file including, but not limited to, basic attributes of video and audio quality, format, duration, size, and encoding. Meanwhile, the streaming media auditing function 304 can also realize auditing the content of the uploaded streaming media file. Specifically, the auditing of the streaming media file content can include automatic auditing and manual auditing, wherein the automatic auditing mainly carries out content identification on the uploaded streaming media content through a machine learning algorithm, for example, whether sensitive vocabulary, obscene or violent content exists or not is detected, and the manual auditing is to judge whether the content requiring manual intervention is displayed or not and confirm. The streaming media auditing 304 functionality may also allow an administrator to set or adjust auditing rules as desired, such as defining sensitive vocabulary lists, setting auditing criteria for different categories of streaming media, etc.

The real-time monitoring 307 function can perform statistical analysis from two dimensions of the user and the streaming media, and can count the watching quantity of a certain user and the watching progress of a certain video according to the dimension of the user, and can inquire the watching user and the watching time according to the dimension of the streaming media. For example, all statistical data can be arranged into readable data tables by using the data tables so as to display various indexes of each user or each streaming media, statistical analysis can be performed by using a cake chart showing proportional relations, a histogram showing size relations among a plurality of categories, a line chart showing time-varying trend of variables and the like, all tables and graphs can be typeset and integrated on one instrument board for display, and a thermodynamic diagram mode can be adopted to display the watching heat of different streaming media or the liveness of different users in a specific time period. On the one hand, the user can inquire the watching record at any time without recall and secondary inquiry of the past browsing record, and the use experience of the user is improved. Meanwhile, an administrator is helped to monitor the access condition of the user in real time, count hot topics and analyze trend, and the performance of the server can be adjusted according to the access times of the user and the like.

Meanwhile, the real-time monitoring 307 function can monitor the use conditions of the memory, the hard disk and the CPU (Central Processing Unit ) of the server in real time. For example, the performance and traffic of the server may be monitored, it may also be determined whether the number of user connections reaches the maximum service load and whether the server is already in a high load operating state, and the network traffic may be monitored.

The streaming media browsing 308 function can realize basic control functions such as playing, pausing, stopping, fast forwarding, fast rewinding, random jumping and the like of streaming media, can also realize multi-code rate switching of streaming media on a front-end player, for example, can realize free switching of videos between definition such as standard definition, gao Qingji super definition and the like, and support picture-in-picture playing and full screen playing, and a user can select proper video image quality according to network conditions so as to ensure the playing smoothness of the videos, can flexibly select the user when the streaming media contains multiple subtitles or audio tracks, can set a corresponding streaming media buffer zone so as to prevent network delay from influencing the continuity of video playing, can realize the functions of pre-caching of data, dynamically adjusting the cache size and the like, can ensure the stability of streaming media playing, can also set an interaction zone so as to provide interactive functions such as evaluation messages, appreciation, sharing, and the like related to the user, and thus enhancing the experience of the user.

The streaming media on demand 310 may provide a UI (User Interface) Interface for a User to select streaming media, and perform selection processing on the User to return the selected streaming media, or may generate a corresponding streaming media play list according to a selection request of the User, and play streaming media contents sequentially according to a selection order of the User, and may download a next streaming media content in advance when the User views the currently selected content, so as to realize seamless play of multiple streaming media files.

The streaming media live broadcast 311 function can realize online live broadcast on a video portal by accessing a live broadcast platform or pulling stream and the like, provide bullet screen and evaluation functions, realize live broadcast across networks and national boundaries, and push live broadcast contents to all subscribers in real time, and the subscribers can acquire the live broadcast contents only by having networks.

The streaming media reference 312 function may enable the invocation of shared video in the system through the article editor and be inserted into the article manuscript as a play resource. For example, an "insert video" or related option may be set in the article editor, when the user clicks on the option, the system may provide a video library or resource management interface for the user to select the shared video to be referred to, and may set a search function for the user to quickly locate the referred video, after the user finishes selecting and clicks on confirmation, related information of the video, such as a video name or ID (Identity Document, unique identification code), will be associated with the article manuscript, and when the user reads the article and reaches the video position, the system may search the corresponding video resource in the shared video library through the video ID, thereby generating a video player on the page to play the video.

In an exemplary embodiment of the present disclosure, referring to fig. 4, the streaming media management module 203 includes an automatic transcoding unit 403, a tag labeling unit 404, a streaming media editing unit 405, a streaming media retrieving unit 406, and a streaming media presentation unit 407.

Streaming media is multimedia data that is transmitted and played in real time through the internet or a local area network. The streaming media in the present disclosure may be video, audio, pictures, etc., which is not limited by the present exemplary embodiment.

The automatic transcoding unit 403 is configured to upload an initial streaming media submitted by a user to a server and perform automatic transcoding on the initial streaming media to obtain a target streaming media; the tag labeling unit 404 is configured to identify the target streaming media and label the target streaming media with a corresponding tag; the streaming media editing unit 405 is used for the user to edit the uploaded target streaming media online; the stream media retrieval unit 406 is configured to match the target stream media based on the retrieval information input by the user, and sequence and display the target stream media according to the matching degree; the stream media display unit 407 is configured to display the target stream media in the internal network and share the target stream media through the external network.

In an exemplary embodiment of the present disclosure, referring to fig. 6, the automatic transcoding unit 403 includes a streaming media acquisition subunit 601, a streaming media identification subunit 602, a format comparison subunit 603, a parameter acquisition subunit 604, and a streaming media transcoding subunit 605.

The streaming media acquisition subunit is used for acquiring initial streaming media submitted by a user; a stream media identification subunit, configured to identify a first coding format of an initial stream media; the format comparison subunit is used for comparing the first coding format with a preset second coding format and returning a comparison result; the parameter acquisition subunit is used for acquiring transcoding parameters corresponding to the second coding format when the first coding format is different from the second coding format; and the streaming media conversion subunit is used for converting the initial streaming media adopting the first coding format into target streaming media adopting the second coding format according to the transcoding parameters.

Optionally, FFmpeg program may be invoked to complete the acquisition, frame extraction and transcoding tasks of video file information. The transcoding system is based on FFmpeg packaging JavaCV (packaging library formed by various open source computer vision libraries) tool components, so that the dependence of FFmpeg codecs on system environment components is effectively reduced, the virtualized service consistency of JVM (Java Virtual Machine ) is fully utilized, the requirements of a service end on tool components such as FFmpeg expected video codec clips and the like are met, and development and deployment efficiency is greatly facilitated.

It can be understood that through the video transcoding technology, videos in any file format can be uniformly converted according to the requirements of different devices, different service networks and different video formats, so that the purposes of improving the coding quality of video resources and efficiently utilizing the bandwidth and the storage capacity of the Internet are achieved. And according to different application ranges and scene requirements (for example, the scene requirements of saving bandwidth, terminal compatibility, display and the like), the conversion of different parameters, such as resolution, code rate and the like, of the multimedia data coding mode can be realized. The multimedia codec library libavcodec (one of the core components of the open source program Ffmpeg) included in the FFmpeg is used as a kernel in most video players, to record video information and convert the format into a required format, and finally, codec into a media stream capable of crossing multiple platforms, i.e. adjust the resolution and video frame rate, and store video data key frames, video slices, and the like. The FFmpeg can enable the video resource to be converted into a TS Stream file (DVD file format), and after the video transcoding is completed, the video resource is divided into slices including parameters such as m3u8 index files.

Alternatively, the first encoding format and the second encoding format may be any one or more of mp4, swf, mkv, mov, wma, avi, rmvb, m v, m2v, mod, mp2v, mpeg, and 3gpp, which is not particularly limited in this example embodiment.

The method can carry out statistical analysis on the coding and packaging formats of the historical video library video files and the main stream video files, realizes compatibility for the main video formats, realizes unified coding rate and packaging format standard output of multiple formats and packages through batch task processing of a system unified codec and a packaging unit for uploaded video files, and carries out targeted streaming media service optimization based on the coding and packaging, thereby realizing unified and smooth output of front-end video playing and adaptation of multiple terminals.

The embodiment of the application can fully utilize the middle layer characteristic of a Java (an object-oriented programming language) virtual machine, is compatible with the adaptation of different hardware, operating systems and compiling environments, encapsulates the video processing coder-decoder based on JavaSDK, effectively avoids the installation and deployment differences of the video processing coder-decoder in the different hardware and operating systems and the compiling environment dependence, and effectively reduces the complexity of installation, deployment and expansion; and meanwhile, an API calling mode based on Java language is provided for the service layer, which is in accordance with the native management processing development language environment and compiling mode of the existing service, and is beneficial to the service developer to concentrate on the processing of the service layer.

Optionally, the identifying and analyzing the initial streaming media includes analyzing at least one piece of information including format, resolution, coding, code rate, etc. of the initial streaming media, which is not particularly limited in the present exemplary embodiment.

Alternatively, the detailed information of the streaming media may be viewed through different media information tools, such as FFmpeg, mediaInfo (a video parameter detection tool may be used for code analysis query on video and code and information detection on audio files), and the selection of tools is not particularly limited in this example embodiment.

Optionally, in the process of converting the initial streaming media into the target streaming media, the used transcoder may be FFmpeg, handBrake (a free, open-source, cross-platform video conversion software mainly used for converting a video file from one format or code to another format or code), or the like, and the transcoding of the streaming media may be completed, which is not limited in this exemplary embodiment.

Alternatively, the transcoding parameter includes at least one of a bit rate, a code rate, a frame rate, an image quality, etc., and the present exemplary embodiment is not particularly limited.

For example, a FFprobe (a multimedia analysis tool, which can analyze parameters of audio and video, parameter information of a media container, and the like, and also can analyze the length of each packet, the type of the packet, information of a frame, and the like in a media file) command may be used to complete acquisition of information of the video file, so as to return a JSON (JavaScript Object Notation, JS object profile, a lightweight data exchange format) object containing detailed information of the corresponding video file, such as duration, bit rate, stream information, and the like, and also can perform frame extraction per second on the video, and save the frames and set up a picture format at the same time, for example, videoCapture (a tool that can traverse video frames and edit and modify each frame of data in the traversal process) function in an Open CV (an Open source-published cross-platform computer vision and machine learning software library) library may be used to perform frame extraction on the video.

Alternatively, an interface for displaying the transcoding state may be provided in the automatic transcoding unit 403, and the interface may show the current transcoding progress and whether the transcoding is successful or not. Optionally, the transcoding state has at least one of a state of being transcoded, a success of transcoding, and a failure of transcoding. Specifically, the system responds to the video transmission request of the user only when the current transcoding state is "successful", when the current transcoding state is "failure", the system can display error prompt information and provide options of re-transcoding, and when the current transcoding state is "under transcoding", the system displays "50% of the transcoding progress", "80% of the transcoding progress" and the like according to the stage in which the transcoding progress is located.

In an example embodiment of the present disclosure, referring to fig. 7, the labeling unit 404 includes a data acquisition subunit 701, a feature extraction subunit 702, a feature matching subunit 703, and a labeling subunit 704.

The data acquisition subunit is used for acquiring corresponding streaming media data from the target streaming media; the feature extraction subunit is used for carrying out feature extraction on the streaming media data to obtain corresponding feature data; the feature matching subunit is used for inputting the feature data into the trained classification model to obtain corresponding classification probability data; the label labeling subunit is used for sorting the classification probability data, and selecting the label with the highest probability according to the preset label number to label the target streaming media.

The streaming media data refers to frame-by-frame screenshot data or audio fragment data corresponding to the target streaming media. For example, feature extraction can be performed on the screenshot data frame by frame, and then classification can be performed according to the extracted features, so that the content of the target streaming media can be judged according to the classification data.

Optionally, the streaming media data may need to be preprocessed before feature extraction of the streaming media data can take place. For example, the images are subjected to graying, binarization, normalization, size scaling and the like, so that the interference of redundant information in streaming media data on a classification model is reduced.

Alternatively, each screenshot may be converted into an RGB color space, and the pixel distribution condition of each channel may be calculated to obtain a color histogram, and the similarity of the color histograms may be determined by comparing the histograms of different shots, or texture descriptors, such as a local binary pattern, a gray level co-occurrence matrix, etc., may be used to capture texture information in the screenshot, or an edge detection algorithm, such as an edge detection operator Canny, may be used to extract edge information in the screenshot, and feature extraction may be performed on the screenshot data frame by frame, which is not particularly limited in this example embodiment. Similarly, when the streaming media data is audio data, a Mel-frequency cepstral coefficient (Mel-Frequency Cepstral Coefficients, MFCC) may be used to perform feature extraction on the audio signal to obtain feature vectors representing key characteristics of the streaming media data.

Optionally, the classification model is a neural network model for performing inference analysis on feature data corresponding to the streaming media data to determine the type of data content in the streaming media data, and can quickly classify the content in the streaming media data through the classification model, so that the labeling efficiency of the target streaming media is improved. For example, the classification model may select the LeNet-5 model (a classical convolutional neural network model), the ResNet model (a deep convolutional neural network model), and the MobileNetV model (a lightweight convolutional neural network model), which is not particularly limited in this example embodiment.

For example, when the preset number of labels is 1, the label with the highest classification probability is selected as the prediction label, and when the preset number of labels is 3, the three labels with the highest classification probability are selected as the prediction labels according to the sorting of the classification probabilities.

The manuscript content of the content management system can be automatically associated with the streaming media content, and according to news manuscript titles, summary content, manual labeling or automatically extracted keywords, the manual labeling or the automatically extracted keywords are used as automatic labeling of video content objects, an automatic label system of the video content is formed, and the analysis description of the video content is realized through text content association, so that the text knowledge map labeling of the video content is realized.

In an example embodiment of the present disclosure, referring to fig. 8, the streaming media editing unit 405 includes a picture processing subunit 801 and a personalizing subunit 802.

The picture processing subunit is used for carrying out online image and audio optimization processing on the target streaming media; the personalized subunit is used for adding watermark and/or identification to the target streaming media by the user.

The on-line image and audio optimization processing may include improving the quality of an image by improving parameters such as brightness, contrast, saturation, and the like of the image, making the image clearer by removing noise and interference in the image, calibrating colors of the image, enhancing edges and details of the image, eliminating background noise, enhancing definition and volume of an audio signal, stabilizing shake in a video image, reducing influence of lens shake or vibration of a photographing device on the quality of the image, and the like, which is not limited in this example embodiment.

Alternatively, the watermark may be in the form of text, an image, logo (Logotype, logo), etc., may identify the owner of the content or convey specific information, which is not particularly limited in this example embodiment. Meanwhile, the user can upload the custom watermark, and the format of the uploaded watermark includes, but is not limited to JPG, PNG, GIF, SVG and the like.

In particular, the user may edit the watermark and/or logo online in terms of color, size, angle of rotation, and location.

Optionally, the personalized subunit can identify the existing watermark or identifier through an image or video analysis technology and modify the existing watermark or identifier, so that the user is helped to effectively control the content, and the user does not need to search other software to perform secondary editing, thereby providing convenience for the operation of the user.

In an example embodiment of the present disclosure, referring to fig. 9, the streaming media retrieval unit 406 includes a keyword extraction subunit 901, a tag matching subunit 902, and a video selection subunit 903.

The keyword extraction subunit is used for extracting keywords from the search information input by the user to obtain corresponding search keyword information; the label matching subunit is used for calculating similarity scores between all the search keyword information and all the labels to obtain labels with similarity scores greater than or equal to a preset similarity threshold; the video selecting subunit is configured to display, according to the similarity score of the tag, a streaming media corresponding to the tag with the similarity score greater than or equal to the preset similarity threshold.

The method includes the steps of removing stay words in search information, segmenting text input by a user according to a certain rule, segmenting long sentences into independent words, marking the word after word segmentation, and extracting keywords from the text after word segmentation and word segmentation according to a certain rule or algorithm.

Optionally, when extracting keywords from the search information input by the user, the keyword extraction can be implemented through a related statistical algorithm, for example, a TF-IDF (Term Frequency-inverse text inverse Frequency) algorithm based on word Frequency statistics can be selected to extract the keywords, which is a weighting technique used for information retrieval and text mining, and is mainly used for evaluating the importance degree of a Term (word) in a document or a corpus, and if the Frequency of occurrence of a Term (word) in a document is high (TF value is large) and the Frequency of occurrence of the Term (word) in other documents is low (IDF value is large), the Term has better category distinguishing capability and is suitable for classification; of course, keyword extraction can also be achieved by training a deep learning model, for example, a text topic-based LDA (LINEAR DISCRIMINANT ANALYSIS ) algorithm can be adopted, the text topic-based LDA algorithm is an unsupervised machine learning technology and can be used for identifying potential hidden topic information in a large-scale document set or corpus, and the method assumes that each word is extracted from a back potential hidden topic; the text extraction method can also adopt a Textrank algorithm (an extraction type unsupervised text abstract extraction method) based on word vectors, wherein the Textrank algorithm based on word vectors is a graph-based ordering algorithm for texts, a node connection graph is constructed by dividing the texts into a plurality of constituent units (sentences), the similarity among the sentences is used as the weight of edges, the TextRank value of the sentences is calculated through loop iteration, and finally the sentences with high rank are extracted to be combined into text abstracts; the present exemplary embodiment does not particularly limit the manner of keyword extraction.

Alternatively, cosine similarity (Cosin), jaccard similarity (Jaccard), edit distance, trained text semantic similarity model, and the like may be used to calculate the similarity score, which is not particularly limited in this example embodiment.

In an example embodiment of the present disclosure, referring to fig. 10, the streaming media presentation unit 407 includes a streaming media presentation subunit 1001 and a streaming media sharing subunit 1002.

The streaming media display subunit is used for embedding the target streaming media into a corresponding display webpage to realize the display of the streaming media; and the streaming media sharing subunit is used for sharing the target streaming media into a public database of an external network, and opening corresponding access windows at each video portal to access and display the target streaming media.

Specifically, the streaming media display unit may manage the playing of the video, such as playing, pausing, fast forwarding, rewinding, etc. the streaming media, and handle any compatibility problem that may occur, and may control other parameters related to the playing of the video, such as resolution, buffering speed, etc.

Optionally, the player has a video multi-code rate switching function, can realize the video to switch freely between definition such as "standard definition", "high definition", "super definition", meet different users' watching demands, its playing mode supports picture-in-picture playing and full screen playing, users can select the appropriate video image quality according to the condition of the internet speed, in order to guarantee the video fluency, support cell-phone and Pad to watch at the same time.

In an exemplary embodiment of the present disclosure, referring to FIG. 4, the resource control module 204 includes an automation deployment unit 408, a resource management unit 409, and an identity authentication unit 410.

The automatic deployment unit is used for rapidly deploying the application program or the service into the corresponding private cloud and/or public cloud environment according to a preset deployment rule; the resource management unit is used for distributing and scheduling the resources in the public cloud and the private cloud; the identity authentication unit is used for verifying the identity information of the user and realizing centralized verification of a plurality of associated systems.

In particular, the automated deployment unit may be responsible for managing configuration information of applications or services, including environmental variables, database connections, log management, and the like. By separating the configuration information from the application program codes and performing unified management, a more flexible and maintainable deployment process can be realized; the automated deployment unit may also be responsible for preparing the required infrastructure and dependent resources during deployment. This includes creating virtual machines, installing operating systems, configuring network connections, and the like.

Specifically, the resource management unit may allocate appropriate computing and storing network resources according to the demands of the user, dynamically adjust the resource configuration according to the scale and load conditions of the application program to achieve the best performance and cost efficiency, and reasonably schedule and manage cloud resources according to factors such as the priority of the user and the resource utilization rate, for example, may distribute the requests to different computing nodes according to a load balancing policy, and monitor the use condition of the resources to ensure the stability and reliability of the whole system, and may automatically adjust the number and configuration of the resources according to the load condition of the application program, for example, may automatically increase the number of computing nodes to improve the processing capability of the system at high load, and may automatically reduce the number of computing nodes to save the resources and cost at low load.

In an example embodiment of the present disclosure, referring to fig. 5, an authentication unit 410 includes a request submission subunit 501 and an authentication subunit 502.

The request submitting subunit is used for sending the acquired identity information of the user to the unified identity authentication server through the secure transmission channel; the identity verification sub-unit is used for acquiring the authentication token returned by the unified identity authentication server and verifying the authentication token, and if the authentication token is valid, the authentication sub-unit responds to the access request of the user.

Through the service discovery of the unified identity authentication server and the combination of global roaming encryption Token authentication and distributed caching, the service request can be realized under the framework of compliance safety, and the request frequency and dependence can be reduced; the method supports multiple common remote authentication modes to access the authentication of the server side, realizes the overall authentication and authorization scheduling by the control side through the unified authentication and bill roaming modes, and realizes the lightweight configuration authorization authentication of the server side.

For example, the system platform identity authentication mechanism can adopt server-side Session (a login authentication module) authentication to conform to a cross-application Token authorization authentication mode, and on the premise of meeting identity authentication security and service controllability, the requirement of acquiring identity authentication in a cross-application roaming mode is met. When a user logs in the unified authentication system, the application system can automatically verify the logged-in user identity without a user sending an instruction, namely when the user initiates an access request to the streaming media management system, the streaming media management system verifies the user identity authentication token and returns the user identity authentication token, the user sends the user identity authentication token to the application program through an SSL (Secure Socket Layer ) transmission channel, the application program sends the received user token and the self service identification to the unified authentication system together, meanwhile, the user identity checking instruction is initiated, the unified authentication system receives the instruction, then decrypts the user identity authentication token, feeds back the result to the application program after checking with a database, and the application program can determine whether the user is allowed to access according to the user authority after receiving the feedback result.

On the one hand, by verifying identity information provided by a user, such as a user name and a password, and confirming the identity of the user, unauthorized access can be prevented, and the security of the system is ensured; on the other hand, by realizing the single sign-on function, namely, the user can access a plurality of associated systems only by carrying out identity authentication once. Thus, the login process of the user can be simplified, and the user experience is improved; on the other hand, the user is authorized and managed according to the identity and role information of the user, the access rights of different users to the system resources can be defined, and the behavior of the user is monitored so as to ensure the safety and compliance of the system.

In an exemplary embodiment of the present disclosure, referring to fig. 11, a flowchart of a streaming media management system based on a cross-cloud integration environment of the present disclosure is shown, including the following steps S1101 to S1102:

Step 1101, obtaining an initial streaming media uploaded by a user;

Step S1102, comparing the first coding format with a preset second coding format, and returning a comparison result, if the first coding format is different from the second coding format, executing S1103, and if the first coding format is the same as the second coding format, executing S1104;

Step S1103, setting a transcoding parameter corresponding to the second coding format, and generating a target streaming media corresponding to the second coding format according to the transcoding parameter;

step 1104, extracting the characteristics of the content of the target streaming media, inputting the extracted characteristics into the classification model, and obtaining corresponding labels and marking;

step S1105, the user can edit the generated target streaming media online, such as logo marking;

Step 1106, storing the target streaming media into a corresponding database according to the labels;

Step S1107, extracting keywords from the search information of the user, and matching the keywords with the labels according to the similarity;

Step S1108, the matched streaming media is displayed and shared into a video portal of an external website for the user to access.

In an example embodiment of the present disclosure, referring to fig. 12, fig. 12 shows an example for uploading and publishing streaming media by an unregistered user:

Step S1201, a user inputs a management page address at a streaming media access terminal and sends an access request to a server;

step S1202, when the server receives an access request, an identity authentication interface is displayed;

step S1203, a user inputs own identity information, account numbers, passwords and the like in an identity authentication interface;

step S1204, after receiving the identity information of the user, the server compares the identity information with the information in the database;

step S1205, the server receives the comparison result of the user identity information and the data in the database;

Step S1206, after the comparison is successful, the user interface jumps to a streaming media management page;

step S1207, the user uploads video on the management page, identifies a first coding format of the initial streaming media, compares the first coding format with a second coding format, and determines whether automatic transcoding is needed;

step S1208, the server automatically transcodes the streaming media (the first encoding format is the same as the second encoding format, and the streaming media is not performed), and identifies and marks the labels;

step S1209, the server stores the target streaming media;

Step S1210, the server receives the user display and sharing request;

step S1211, the server returns to the stream media display and sharing page, thereby completing the whole video uploading process, and realizing the display of the target stream media in the internal network and the sharing through the external network.

Embodiment 2a storage medium

Exemplary embodiments of the present invention also provide a computer readable storage medium having stored thereon a program product capable of implementing the system described in the present specification. In some possible implementations, aspects of the invention may also be implemented in the form of a program product comprising program code for causing an electronic device to carry out the steps according to the various exemplary embodiments of the invention as described in the "exemplary systems" section of this specification, when the program product is run on an electronic device. The program product may employ a portable compact disc read-only memory (CD-ROM) and comprise program code and may be run on an electronic device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C#, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

Example 3 an electronic device

The exemplary embodiment of the invention also provides an electronic device capable of realizing the system. An electronic device 1300 according to such an exemplary embodiment of the present invention is described below with reference to fig. 13. The electronic device 1300 shown in fig. 13 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.

As shown in fig. 13, the electronic device 1300 may be embodied in the form of a general purpose computing device. The components of the electronic device 1300 may include, but are not limited to: at least one processing unit 1310, at least one memory unit 1320, a bus 1330 connecting the different system components (including the memory unit 1320 and the processing unit 1310), and a display unit 1340.

The storage unit 1320 stores program code that can be executed by the processing unit 1310, so that the processing unit 1310 performs steps according to various exemplary embodiments of the present invention described in the above section of the "exemplary system" of the present specification. For example, processing unit 1310 may run the system of FIG. 2.

The storage unit 1320 may include readable media in the form of volatile storage units, such as Random Access Memory (RAM) 1321 and/or cache memory 1322, and may further include Read Only Memory (ROM) 1323.

The storage unit 1320 may also include a program/utility 1324 having a set (at least one) of program modules 1325, such program modules 1325 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.

Bus 1330 may be a local bus representing one or more of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or using any of a variety of bus architectures.

The electronic device 1300 may also communicate with one or more external devices 1370 (e.g., keyboard, pointing device, bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 1300, and/or any device (e.g., router, modem, etc.) that enables the electronic device 1300 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 1350. Also, the electronic device 1300 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, for example, the Internet, through a network adapter 1360. As shown, the network adapter 1360 communicates with other modules of the electronic device 1300 over the bus 1330. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 1300, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID (Redundant Arrays of INDEPENDENT DISKS, redundant array of independent disks) systems, tape drives, data backup storage systems, and the like.

From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present invention may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a U-disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, a terminal device, or a network device, etc.) to execute the system according to the exemplary embodiments of the present invention.

Furthermore, the above-described figures are only illustrative of the processes involved in a system according to exemplary embodiments of the present invention, and are not intended to be limiting. It will be readily appreciated that the processes shown in the above figures do not indicate or limit the temporal order of these processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, for example, among a plurality of modules.

Embodiment 4A cross-cloud service linkage, cross-System, and Cross-service collaboration System

The cross-cloud integrated environment in the embodiment of the invention can comprise private cloud and public cloud, and can realize message transmission and data interaction by using distributed collaborative management, thereby realizing cross-cloud business linkage, cross-system and cross-service collaboration. The message queues MQ are used among the cross systems to deconstruct service request dependence, so that decoupling among service transaction compilations is realized, and meanwhile, state consistency is maintained. The collaborative multisystem module is realized by adopting an internal micro-service and message queue mechanism, task collaboration among cross-system modules is realized, resource consumption of manuscript release and video transcoding and frequent imbalance of processing are effectively processed by combining a business mode, operation interruption is avoided, service call and state synchronization among systems are unified cooperatively through the message queue, chained transaction call is formed, and complex business realization of cross-system and service can be completed only by executing conventional management operation at a management end.

In order to solve the technical problems of video coding and cross-cloud service linkage, cross-system and cross-service coordination in a cross-cloud integration environment, the embodiment of the invention designs and develops a set of streaming media management system based on the cross-cloud integration environment, realizes message transmission and data interaction by using distributed collaborative management, and has the characteristics of high distribution, high performance, high instantaneity and the like by adopting a message queue technology MQ to realize resource state synchronization in order to avoid excessive cross-system state pushing.

In a cross-cloud integrated environment based streaming media management system RocketMQ (a low-latency, high-concurrency, high-availability, high-reliability distributed message middleware) can be used as a message queue transfer station, and the streaming media system and the user unified identity authentication system respectively send messages into a message queue, and then acquire and process the messages from the queue by another system. This approach can ensure reliable transmission and processing of messages and the two systems can operate independently, as long as the processing of the corresponding message at the appropriate time is ensured.

The streaming media management system based on the cross-cloud integration environment in the embodiment of the invention can be configured to be asynchronously processed. The streaming media management system and the user unified identity authentication system based on the cross-cloud integrated environment respectively process respective tasks and store the information needing to be interacted into a database or store the information by using other persistence methods. Another system may then acquire and process messages from the database or interaction information stored using other persistence methods at regular or on-demand. The method is suitable for scenes with low non-real-time requirements, but can greatly reduce the coupling of the system.

The streaming media management system based on the cross-cloud integrated environment in the embodiment of the invention can be configured as a time-delay task queue. By using RocketMQ delay task queues, messages that need to be delayed can be placed in the queue and a time stamp set to indicate when the task is to be performed. When the time stamp arrives, the queue will trigger a task and be processed by the corresponding system.

The message queues MQ can be configured among the systems to deconstruct service request dependence, so that decoupling among service transaction compilations is realized, and meanwhile, the state consistency is maintained. The collaborative multisystem module is realized by adopting an internal micro-service and message queue mechanism, task collaboration among cross-system modules is realized, resource consumption of manuscript release and video transcoding and frequent imbalance of processing are effectively processed by combining a business mode, operation interruption is avoided, service call and state synchronization among systems are unified cooperatively through the message queue, chained transaction call is formed, and complex business realization of cross-system and service can be completed only by executing conventional management operation at a management end.

It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functions of two or more modules or units described above may be embodied in one module or unit in accordance with embodiments of the invention. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied.

This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope of the invention being indicated by the following claims.

It is to be understood that the invention is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

1. A cross-cloud integration environment based streaming media management system, comprising: the system comprises a system deployment module, a streaming media management module and a resource control module, wherein the system deployment module, the streaming media management module and the resource control module are used for realizing full-flow chained management from a streaming media generation end to an access end; wherein:

The system deployment module is used for deploying application programs or services into a cross-cloud integration environment, and realizing remote access of external websites to internal network resources by controllably isolating the access of the internal network resources and the external network resources;

2. The cross-cloud integrated environment based streaming media management system of claim 1, wherein said system deployment module comprises:

The server deployment unit is used for deploying the servers of the streaming media management service in the internal network and deploying the servers of the streaming media sharing service in the external network;

the firewall deployment unit is used for limiting the resource access between the internal network and the external network according to the access rule;

wherein the access rule includes: the streaming media management service only accesses resources in the internal network, the streaming media sharing service can access live broadcast recorded data of the internal network, and online live broadcast in real time of a video portal is realized by accessing a live broadcast platform or a streaming mode.

3. The cross-cloud integrated environment based streaming media management system of claim 1, wherein said resource control module comprises:

The automatic deployment unit is used for rapidly deploying the application program or the service into the corresponding private cloud and/or public cloud environment according to a preset deployment rule;

The resource management unit is used for distributing and scheduling the resources in the public cloud and the private cloud;

And the identity authentication unit is used for verifying the identity information of the user and realizing centralized verification of a plurality of associated systems.

4. The cross-cloud integrated environment based streaming media management system of claim 3, wherein said identity authentication unit comprises:

The request submitting subunit is used for sending the acquired identity information of the user to the unified identity authentication server through the secure transmission channel;

And the identity verification sub-unit is used for acquiring the authentication token returned by the unified identity authentication server and verifying the authentication token, and responding to the access request of the user if the authentication token is valid.

5. The system according to claim 1, wherein the streaming media management module comprises an automatic transcoding unit, a tag labeling unit, a streaming media editing unit, a streaming media retrieving unit and a streaming media displaying unit;

The automatic transcoding unit is used for uploading initial streaming media submitted by a user to a server and automatically transcoding the initial streaming media to obtain target streaming media;

The label marking unit is used for identifying the target streaming media and marking the target streaming media by adopting corresponding labels;

the stream media editing unit is used for the user to edit the uploaded target stream media online;

The stream media retrieval unit is used for carrying out matching on the target stream media based on retrieval information input by a user, and sequencing and displaying the target stream media according to the matching degree;

The stream media display unit is used for displaying the target stream media in an internal network and sharing the target stream media through an external network.

6. The cross-cloud integrated environment based streaming media management system of claim 5, wherein said automatic transcoding unit comprises:

a streaming media obtaining subunit, configured to obtain an initial streaming media submitted by the user;

a stream media identification subunit, configured to identify a first coding format of the initial stream media;

The format comparison subunit is used for comparing the first coding format with a preset second coding format and returning a comparison result;

A parameter obtaining subunit, configured to obtain a transcoding parameter corresponding to the second coding format when the first coding format is different from the second coding format;

and the streaming media conversion subunit is used for converting the initial streaming media adopting the first coding format into the target streaming media adopting the second coding format according to the transcoding parameters.

7. The cross-cloud integrated environment based streaming media management system of claim 5, wherein said tagging unit comprises:

The data acquisition subunit is used for acquiring corresponding streaming media data from the target streaming media;

the characteristic extraction subunit is used for carrying out characteristic extraction on the streaming media data to obtain corresponding characteristic data;

the feature matching subunit is used for inputting the feature data into the trained classification model to obtain corresponding classification probability data;

and the label labeling subunit is used for sequencing the classification probability data, and selecting the label with the highest probability according to the preset label number to label the target streaming media.

8. The cross-cloud integration environment based streaming media management system of claim 5, wherein the streaming media editing unit comprises:

The picture processing subunit is used for carrying out online image and audio optimization processing on the target streaming media;

and the individuation subunit is used for adding the watermark and/or the identifier to the target streaming media by the user.

9. The cross-cloud integration environment based streaming media management system of claim 5, wherein the streaming media retrieval unit comprises:

The keyword extraction subunit is used for extracting keywords from the search information input by the user to obtain corresponding search keyword information;

the label matching subunit is used for calculating similarity scores between all the search keyword information and all the labels to obtain labels with the similarity scores greater than or equal to a preset similarity threshold;

And the video selection subunit is used for displaying the streaming media corresponding to the labels with the similarity scores greater than or equal to the preset similarity threshold according to the similarity scores of the labels.

10. The cross-cloud integrated environment based streaming media management system of claim 5, wherein said streaming media presentation unit comprises:

the streaming media display subunit is used for embedding the target streaming media into a corresponding display webpage to realize the display of the streaming media;

And the streaming media sharing subunit is used for sharing the target streaming media to a public database of the external network, and opening corresponding access windows at each video portal to access and display the target streaming media.