CN118413696A - Streaming media management system based on cross-cloud integrated environment - Google Patents

Abstract

The present invention provides a streaming media management system based on a cross-cloud integrated environment, and relates to the technical field of streaming media application software under a cross-cloud integrated environment. The system provides a complete cross-cloud, cross-system and cross-service business management capability, and the system has an overall scalable deployment and compatibility capability, supports smooth upgrades of system versions and stable expansion of functional services, improves the integration capability with existing website content management systems and identity authentication systems, and greatly reduces the application complexity of streaming media management systems based on a cross-cloud integrated environment across systems and services in the cross-cloud integrated field. At the same time, the cross-cloud integrated deployment method improves availability and access capabilities, reduces storage costs, and especially when the business is expanded, rapid expansion is available for purchase and use; and it can provide convenience for users under the premise of ensuring the security of image transmission.

Description

A streaming media management system based on cross-cloud integrated environment

Technical Field

The present invention relates to the technical field of streaming media application software in a cross-cloud integrated environment, and in particular to a streaming media management system based on a cross-cloud integrated environment.

Background technique

This section is intended to provide a background or context to embodiments of the invention that are recited in the claims. No description herein is admitted to be prior art by inclusion in this section.

Streaming media management system is a software system used to manage and distribute streaming media content. With the rapid development of Internet information technology, streaming media based on the Internet environment has gradually shown unprecedented advantages in communication. Compared with traditional graphic communication methods, people's experience of video and audio content is more intuitive and the demand is more urgent. Streaming media management system came into being to meet users' demand for high-quality and efficient streaming media services.

At present, the support capabilities of traditional website content management systems for video data are very limited, which brings inconvenience to users. At the same time, many scientific research institutions are at risk of data leakage or loss when publishing videos through third-party platforms, which threatens data security. In addition, traditional website content management systems cannot realize the full-link characteristics of streaming media content from generation, management to release.

Summary of the invention

In order to overcome the problems existing in the related art, the present invention provides a streaming media management system based on a cross-cloud integrated environment, thereby at least to a certain extent solving the problem in the related art that it is impossible to facilitate user operations while ensuring the security of data transmission, and solving the problem that internal and external network resource access cannot be controlled and isolated, thereby realizing remote access of external websites to internal network resources, realizing full-process chain management from the streaming media generation end to the access end, and realizing the full-link characteristics of streaming media content from generation, management to release.

An embodiment of the present invention provides a streaming media management system based on a cross-cloud integrated environment, the system comprising:

System deployment module, streaming media management module and resource control module;

The system deployment module is used to deploy applications or services into a cross-cloud integrated environment and to achieve remote access to internal network resources from external websites by controlling the isolation of internal and external network resource access.

The streaming media management module is used to automatically transcode, label and edit the initial streaming media uploaded by the user by calling the application or service deployed in the cross-cloud integration environment to obtain the target streaming media, and display the corresponding target streaming media to each video portal according to the user's search results;

The resource control module is used to allocate corresponding network resources according to the category of the application program or service called by the streaming media management module, and to provide security protection for the user's access to the target streaming media.

The technical solution provided by the embodiments of the present invention may have the following beneficial effects:

In the example embodiment of the present invention, a streaming media management system based on a cross-cloud integrated environment, a system deployment module is used to deploy applications or services into the cross-cloud integrated environment, and to achieve remote access of external websites to internal network resources by controllable isolation of internal and external network resource access; a streaming media management module is used to automatically transcode, label and edit the initial streaming media uploaded by the user by calling the application or service deployed in the cross-cloud integrated environment to obtain the target streaming media, and to display the corresponding target streaming media to each video portal according to the user's search results; a resource control module is used to allocate corresponding network resources according to the category of the application or service called by the streaming media management module, and to provide security protection for the user's access to the target streaming media. On the one hand, the system deployment module can controllably isolate the access to internal and external network resources, so that users can remotely access internal network resources through external websites across regions and countries, but at the same time, their access rights are strictly controlled, so that while providing users with convenient access, the confidentiality and security of internal network resources are improved; on the other hand, the resource management module can automatically transcode, label and edit the initial streaming media uploaded by the user by calling the application or service deployed in the integrated environment, so that the user does not need to check whether the streaming media format is consistent with the system format before uploading, and the user does not need to summarize the content of the initial streaming media and select the corresponding label, which simplifies the process of users uploading the initial streaming media, provides convenience for users, and realizes the full-link characteristics of streaming media content from generation, management to release; on the other hand, the resource control module can allocate corresponding network resources according to the category of the application or service called by the streaming media management module. This allows each service to reasonably use system resources and improve the performance and stability of the system. At the same time, the resource control module can also provide security protection for users' access to the target streaming media, avoiding the problem of individual users' malicious attacks and illegal access to system data that affects the security of system data, and improving the data confidentiality and security of the system.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

Fig. 1 is a scene example diagram of a streaming media management system based on a cross-cloud integrated environment according to an exemplary embodiment of the present invention.

FIG2 is an overall architecture diagram of a streaming media management system based on a cross-cloud integrated environment according to an exemplary embodiment of the present invention.

FIG3 is a functional architecture diagram of a streaming media management system based on a cross-cloud integrated environment according to an exemplary embodiment of the present invention.

FIG4 is a module example diagram of a streaming media management system based on a cross-cloud integrated environment according to an exemplary embodiment of the present invention.

Fig. 5 is a block diagram of an identity authentication unit according to an exemplary embodiment of the present invention.

Fig. 6 is a block diagram of an automatic transcoding unit according to an exemplary embodiment of the present invention.

Fig. 7 is a block diagram of a label marking unit according to an exemplary embodiment of the present invention.

Fig. 8 is a block diagram of a streaming media editing unit according to an exemplary embodiment of the present invention.

Fig. 9 is a block diagram of a streaming media retrieval unit according to an exemplary embodiment of the present invention.

Fig. 10 is a block diagram of a streaming media presentation unit according to an exemplary embodiment of the present invention.

FIG. 11 is a flow chart of a streaming media management system based on a cross-cloud integrated environment according to another exemplary embodiment of the present invention.

FIG. 12 is a sequence diagram of a streaming media management system based on a cross-cloud integrated environment according to an exemplary embodiment of the present invention.

FIG. 13 is a schematic diagram of the structure of an electronic device for implementing an embodiment of the present invention according to an exemplary embodiment of the present invention.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present invention will be more comprehensive and complete, and the concept of the example embodiments will be fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present invention. However, those skilled in the art will appreciate that the technical solutions of the present invention may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present invention.

In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

FIG. 1 shows an example scenario diagram of a streaming media management system based on a cross-cloud integrated environment to which an embodiment of the present invention can be applied.

As shown in FIG1 , the scenario may include a server 100, a streaming media generating terminal 200, and a streaming media access terminal 300. The streaming media generating terminal 200 and the streaming media access terminal 300 may be various electronic devices with interactive functions, and the electronic device may have a display screen, which may be used to display the retrieved streaming media to the user, and may also display various UI interfaces for interaction to the user. In the actual implementation of the present invention, the streaming media generating terminal 200 and the streaming media access terminal 300 may be a mobile terminal, a desktop computer, a handheld device, a virtual reality device, etc., and this exemplary embodiment does not specifically limit this.

It should be understood that the number of servers 100, streaming media generating terminals 200, and streaming media access terminals 300 in FIG1 is merely illustrative. According to implementation requirements, there may be any number of servers 100, streaming media generating terminals 200, and streaming media access terminals 300, for example, the server 100 may be a server cluster composed of multiple servers.

In the related art, there are the following problems:

At present, the support capacity of traditional website content management systems for video data is very limited. First, it can neither support large file uploads nor meet the requirements of adapting to various video format transcoding, which brings inconvenience to users. Second, traditional information dissemination methods require separate video processing codecs, resulting in differences in the installation and deployment and compilation environment of the two in different hardware and operating systems, thereby increasing the complexity of installation, deployment and expansion. Third, traditional content management systems in non-cross-cloud integrated environments have increased storage costs in local hardware environments, technical bottlenecks in cross-system and service collaboration, imbalance in resource consumption and processing time between document publishing and video transcoding, inability to maintain consistent collaborative status, incoherent operations, and managers need to handle business calls in addition to performing routine management operations, which increases complexity during version upgrades and functional business expansion. Fourth, video resources in traditional content management systems cannot be managed intelligently, and an automatic tagging system cannot be formed. At the same time, many scientific research units have the risk of data leakage or loss when publishing videos through third-party platforms, resulting in data security threats.

Based on one or more of the above problems, the embodiment of the present invention first proposes a streaming media management system based on a cross-cloud integrated environment to provide convenience for users under the premise of ensuring security. The streaming media management system based on a cross-cloud integrated environment can be used for the unified management and release of multimedia resources such as video and audio in a cross-cloud integrated environment. Among them, various types of video resources can include videos mainly from media news, video conferences, important activities, expert lectures, original popular science and high-quality courseware. The streaming media management system based on a cross-cloud integrated environment can provide video management such as efficient uploading, automatic system collection and classification editing of these video resources, and realize multi-video format uploading, classification storage, editing and processing, video transcoding, video slicing, intelligent labeling, audit management, intelligent retrieval, statistical analysis and online playback and release of videos. The streaming media management system based on a cross-cloud integrated environment in the embodiment of the present invention can support multiple media formats, a unified streaming media management platform for cross-cloud integrated environment websites and various applications, and form a good ecosystem for streaming media from production, processing to release and sharing.

Example 1 A streaming media management system based on a cross-cloud integrated environment

Referring to FIG. 2 , a streaming media management system 201 based on a cross-cloud integrated environment is shown, including the following modules:

The system deployment module 202 is used to deploy applications or services into a cross-cloud integrated environment, and to achieve remote access of external websites to internal network resources by controlling the isolation of internal and external network resource access;

The streaming media management module 203 is used to automatically transcode, label and edit the initial streaming media uploaded by the user by calling the application or service deployed in the cross-cloud integration environment to obtain the target streaming media, and display the corresponding target streaming media to each video portal according to the user's search results;

The resource control module 204 is used to allocate corresponding network resources according to the category of the application program or service called by the streaming media management module 203, and to provide security protection for the user's access to the target streaming media.

According to the streaming media management system based on the cross-cloud integrated environment in the exemplary embodiment of the present invention, on the one hand, the system deployment module can controllably isolate the access to internal and external network resources, so that users can remotely access internal network resources through external websites across regions and countries, but at the same time, their access rights are strictly controlled, so that while providing users with access convenience, the confidentiality and security of internal network resources are improved; on the other hand, the resource management module can automatically transcode, label and edit the initial streaming media uploaded by the user by calling the application or service deployed in the integrated environment, so that the user does not need to check whether the streaming media format is consistent with the system format before uploading, and the user does not need to summarize the content of the initial streaming media and select the corresponding label, which simplifies the process of users uploading the initial streaming media, provides convenience for users, and realizes the full-link characteristics of streaming media content from generation, management to release; on the other hand, the resource control module can allocate corresponding network resources according to the category of the application or service called by the streaming media management module. So that each service can reasonably use system resources and improve the performance and stability of the system. At the same time, the resource control module can also provide security protection for users' access to target streaming media, avoiding the problem of individual users' malicious attacks and illegal access to system data that affects the security of system data, thereby improving the data confidentiality and security of the system.

The streaming media management system based on the cross-cloud integrated environment provided in the embodiment of the present invention can realize the unified management and release of multimedia resources such as video and audio in the cross-cloud integrated environment, and can be used to solve the technical problems of video encoding and decoding, transcoding, cross-cloud business linkage, cross-system, and cross-service collaboration in the cross-cloud integrated environment. The system can take streaming media automatic transcoding as the core in an autonomous and controllable operating system environment, adopt a more reliable Euler operating system (openEuler, an open source, free enterprise-level operating system), use distributed collaborative management to realize message transmission and data interaction, use message queues (MessageQueue, MQ) across systems to deconstruct service request dependencies, and realize decoupling between service transaction compilations while maintaining state consistency. Collaborative multi-system modules can be implemented using internal microservices and message queue mechanisms. Task collaboration between cross-system modules, combined with business models, can effectively handle resource consumption and uneven processing time for graphic and text publishing and video transcoding, avoid operation interruptions, and synchronize service calls and status between systems through message queues. Chained transaction calls are formed, and only routine management operations need to be performed on the management side to complete complex business implementation across systems and services. Encapsulate video processing codecs, interact with website content systems and user management systems, and target the technical bottlenecks of streaming media resource management in traditional content management systems and cross-system and cross-service collaboration. FFmpeg (open source software for video encoding and decoding and format conversion) can be upgraded and adapted in a controllable manner, and an automatic labeling system for video resources can be formed to achieve text knowledge graph annotation of video content.

Next, modules 202, 203 and 204 are described in detail.

The system deployment module 202 is used to deploy applications or services into a cross-cloud integrated environment, and to achieve remote access of external websites to internal network resources by controlling the isolation of internal and external network resource access.

The system deployment module 202 includes a server deployment unit 401, which is used to deploy a server belonging to the streaming media management service in the internal network and a server belonging to the streaming media sharing service in the external network; a firewall deployment unit 402, which is used to restrict resource access between the internal network and the external network according to access rules. The access rules include: the streaming media management service can only access resources in the internal network, and the streaming media sharing service can access the live broadcast and recording data of the internal network.

For example, the server deployed on the internal network can execute unified management operations on streaming media by administrators of scientific research institutions, universities and other institutions, such as uploading, transcoding, and quality monitoring of streaming media; the server deployed on the external network can allow users to access streaming media content from anywhere, and realize the distribution and sharing of streaming media, unified authentication of users, and traffic control.

For example, you can use open source streaming media server software, such as Red5 (an open source streaming media server developed using the Java programming language) or Wowza (a professional and highly customizable streaming media server). The streaming media server can be installed on an internal network server. You can also use a network (Web) application server, such as Tomcat (a free, open source Web application server that is a lightweight application server), to install it on an internal network server. Through the management interface or application programming interface (API) provided by these software or applications, you can implement various management operations on streaming media.

Exemplarily, user access can be restricted based on the user's IP (Internet Protocol) address. For example, when a specific IP address is identified as having malicious attack behavior, the firewall will block all access requests from this IP address. Requests for external network access to specified ports can be restricted to prevent unauthorized access to specific services. For example, when the firewall is set to only allow access requests to ports 80 and 443, access requests from external networks to other ports will be rejected. The content of the access can also be checked to filter malicious code or sensitive information in the access request. If the access request is found to contain content that violates the access rules, the request will be rejected. Of course, it can also be set to allow or reject access requests from the external network within a specific time period, thereby avoiding the situation where the end of system maintenance or backup is delayed due to external network access interfering with the normal operation of the internal network, thereby reducing the time users spend waiting for system maintenance.

In an example embodiment of the present disclosure, a streaming media management system based on a cross-cloud integrated environment is basically deployed as two parts, an internal and external network, and a logical isolation method is used to ensure the security of data storage and transmission while ensuring file exchange and permission identification functions.

Specifically, the internal network may deploy a server and associated data of the video management terminal, wherein the file storage may adopt local storage or mapping NAS (Network Attached Storage), etc., which is not particularly limited in this example embodiment.

The external network can deploy the server of the on-demand application service to push the on-demand video files to the client for playback in the form of streams, while taking into account the permission identification and access restrictions.

The front-end routing layer can deploy Nginx (also known as engine x, a high-performance HTTP (Hypertext Transfer Protocol) and reverse proxy web server) or F5 (a load balancing solution) or other equivalent load balancing nodes for request load distribution.

Firewalls can be deployed to set up isolation policies for internal and external networks: restricting video management access to the intranet only, allowing video on demand and permission authentication services to be open to the outside world, and allowing live recorded video files to be synchronized from external network storage to storage in the internal network in one direction; firewalls can also set rules to allow or prohibit specific IP addresses, ports or protocols from communicating, ensuring that only authorized users can access the corresponding streaming media services.

Optionally, the streaming media management system can be provided with user login and administrator login, and users can be assigned permissions to browse, upload, query, and edit streaming media, and administrators can be assigned permissions to review users' shared videos. Users can also be managed by authority, which effectively reduces the workload of administrators while making the management of system users more transparent and detailed.

For example, the RBAC (Role-Based Access Control) model can be used to set respective access rights for users and administrators. For example, users can only browse personal information pages and system homepage content, while administrators can access and manage all user data and view and review audit materials submitted by users.

The RBAC model implements access control to the resources of the streaming media management system by assigning permissions to a role and then assigning the role to a user. Generally, a single user can have several roles, and each role has several permissions. In this way, a "user-role-permission" authorization model is constructed. In this model, there is generally a many-to-many relationship between users and roles, and between roles and permissions. Among them, a role refers to an abstract concept with a set of related permissions in the streaming media management system, representing the identity or function of a user in a specific context, such as an administrator, ordinary user, etc.; permissions refer to the permission to operate the resources of the streaming media management system, such as reading, writing, modifying, etc., and permissions can be assigned to roles; users refer to the actual users of the streaming media management system, and each user can be assigned one or more roles; allocation refers to associating roles with users to grant users corresponding permissions.

On the one hand, by controlling and isolating access to internal and external network resources, unauthorized remote access to internal network resources by external websites can be effectively prevented. When deploying applications or services, access rules can be set to clearly specify which resources can be accessed by external networks. These restrictive access rules can effectively prevent illegal access and unauthorized data leakage, thereby improving system security. On the other hand, deploying applications or services into a cross-cloud integrated environment allows users to easily deploy and manage applications or services on different cloud platforms, providing greater flexibility and selectivity.

The streaming media management module 203 is used to automatically transcode, label and edit the initial streaming media uploaded by the user by calling the application or service deployed in the cross-cloud integration environment to obtain the target streaming media, and display the corresponding target streaming media to each video portal according to the user's search results.

Referring to Figure 3, Figure 3 shows a functional example diagram of a streaming media management system 201 based on a cross-cloud integrated environment in the present disclosure. The streaming media generation terminal 200 can realize streaming media upload 301, streaming media management 302, automatic transcoding 303, streaming media review 304, labeling 305, online editing 306 and real-time monitoring 307 functions, and the streaming media access terminal 300 can realize streaming media browsing 308, streaming media retrieval 309, streaming media on demand 310, streaming media live broadcast 311 and streaming media reference 312 functions.

Among them, the streaming media upload 301 function can support the efficient upload of large files, and can realize segmented upload or breakpoint resume. For example, the system supports the upload of large files larger than 10G. During the transmission of video files, if the signal is interrupted, disconnected, or the computer is shut down abnormally, there is no need to restart when uploading again. After the system recognizes it, it can continue uploading from the interrupted position. At the same time, during the streaming media upload process, the system will also detect the streaming media cover. If no uploaded and/or to-be-uploaded cover is detected, the image in the streaming media will be automatically captured to generate the streaming media cover. If an uploaded cover is detected, it will be used as the corresponding streaming media cover. If both an uploaded cover and a to-be-uploaded cover are detected at the same time, the to-be-uploaded cover will be used as the streaming media cover and the uploaded cover will be overwritten after the to-be-uploaded cover is uploaded.

The streaming media management 302 function can add backend users, modify user information, delete user accounts, assign user permissions, and query user information.

The streaming media review 304 function can conduct a comprehensive review of the uploaded streaming media files, including but not limited to basic attributes such as video and audio quality, format, duration, size and encoding. At the same time, the streaming media review 304 function can also realize the review of the content of the uploaded streaming media files. Specifically, the review of the content of streaming media files can include automatic review and manual review. The automatic review mainly uses machine learning algorithms to identify the content of the uploaded streaming media content, such as detecting whether there are sensitive words, obscene or violent content, etc. The manual review is to display and confirm whether the content that requires manual intervention for further judgment is displayed. The streaming media review 304 function can also allow administrators to set or adjust review rules as needed, such as defining a list of sensitive words, setting review standards for different categories of streaming media, etc.

The real-time monitoring 307 function can perform statistical analysis from two dimensions: users and streaming media. According to the user dimension, the number of views of a certain user and the viewing progress of a certain video can be counted. According to the streaming media dimension, the viewing users and viewing time can be queried. For example, data tables can be used to organize all statistical data into easy-to-read data tables to display various indicators of each user or each streaming media. Statistical analysis can also be performed using graphical display methods such as pie charts showing proportional relationships, bar charts showing the size relationship between multiple categories, and line graphs showing the trend of variables changing over time. All tables and graphics can also be typeset and integrated into a dashboard for display. Heat maps can also be used to display the viewing popularity of different streaming media or the activity of different users in a specific time period. On the one hand, users can query their viewing records at any time without having to recall and query past browsing records again, which improves the user experience. At the same time, it helps administrators monitor user access in real time, count hot topics and analyze trends, and adjust server performance according to user access times and other conditions.

At the same time, the real-time monitoring 307 function can monitor the usage of the server's memory, hard disk, and CPU (Central Processing Unit) in real time. For example, it can monitor the performance and traffic of the server, determine whether the number of user connections has reached the maximum load of the service and whether the server is already in a high-load operation state, and monitor network traffic.

The streaming media browsing 308 function can realize basic control functions such as streaming media playback, pause, stop, fast forward, fast rewind and arbitrary jump, and can also realize multi-bitrate switching of streaming media on the front-end player, for example, freely switch the video between standard definition, high definition and ultra-high definition, and support picture-in-picture playback and full-screen playback. Users can choose appropriate video quality according to network conditions to ensure smooth video playback. Users can also make flexible choices when the streaming media contains multiple subtitles or audio tracks. In order to prevent network delays from affecting the continuity of video playback, corresponding streaming media buffers can be set to realize data pre-caching and dynamic adjustment of cache size, etc., to ensure the stability of streaming media playback. Even an interactive area can be set to provide users with streaming media-related evaluation messages, rewards, sharing and other interactive functions, thereby enhancing the user experience.

The streaming media on demand 310 function can provide a UI (User Interface) interface for users to select streaming media, and process the user's selection to return the selected streaming media. It can also generate a corresponding streaming media playlist based on the user's selection request, and play the streaming media content in sequence according to the user's selection order. At the same time, it can also pre-download the next streaming media content when the user is watching the currently selected content, thereby realizing seamless playback of multiple streaming media files.

The streaming live broadcast 311 function can be used to achieve online live broadcast on video portals by connecting to live broadcast platforms or pulling streams, and provides barrage and evaluation functions. It can also achieve cross-network and cross-border live broadcasts, and can push live broadcast content to all subscribers in real time. Subscribers can obtain live broadcast content as long as they have an Internet connection.

The streaming media reference 312 function can be used to call the shared video in the system through the article editor and insert it into the article manuscript as a playback resource. For example, an "Insert Video" or related option can be set in the article editor. When the user clicks on this option, the system can provide a video library or resource management interface for the user to select the shared video to be referenced. At the same time, a search function can also be set for the user to quickly locate the referenced video. When the user has completed the selection and clicked to confirm, the relevant information of the video, such as the video name or ID (Identity Document, unique identification code) will be associated with the article manuscript. When the user reads the article and reaches the video location, the system can find the corresponding video resource in the shared video library through the video ID, thereby generating a video player on the page to play the video.

In an exemplary embodiment of the present disclosure, referring to FIG. 4 , the streaming media management module 203 includes an automatic transcoding unit 403 , a tagging unit 404 , a streaming media editing unit 405 , a streaming media retrieval unit 406 and a streaming media display unit 407 .

Streaming media is a type of multimedia data that is transmitted and played in real time through the Internet or a local area network. The streaming media in the present disclosure may be video, audio, pictures, etc., which is not limited in this exemplary embodiment.

Among them, the automatic transcoding unit 403 is used to upload the initial streaming media submitted by the user to the server and automatically transcode the initial streaming media to obtain the target streaming media; the label marking unit 404 is used to identify the target streaming media and mark it with corresponding labels; the streaming media editing unit 405 is used for the user to edit the uploaded target streaming media online; the streaming media retrieval unit 406 is used to match the target streaming media based on the retrieval information input by the user, and sort and display the target streaming media according to the matching degree; the streaming media display unit 407 is used to display the target streaming media in the internal network and share it through the external network.

In an exemplary embodiment of the present disclosure, referring to FIG. 6 , the automatic transcoding unit 403 includes a streaming media acquisition subunit 601 , a streaming media identification subunit 602 , a format comparison subunit 603 , a parameter acquisition subunit 604 and a streaming media transcoding subunit 605 .

Among them, the streaming media acquisition subunit is used to obtain the initial streaming media submitted by the user; the streaming media identification subunit is used to identify the first encoding format of the initial streaming media; the format comparison subunit is used to compare the first encoding format with the preset second encoding format and return the comparison result; the parameter acquisition subunit is used to obtain the transcoding parameters corresponding to the second encoding format when the first encoding format is different from the second encoding format; the streaming media transcoding subunit is used to convert the initial streaming media using the first encoding format into the target streaming media using the second encoding format according to the transcoding parameters.

Optionally, you can call the FFmpeg program to complete the acquisition, frame extraction and transcoding of video file information. The transcoding system is based on the FFmpeg encapsulated JavaCV (a packaging library composed of multiple open source computer vision libraries) tool component, which effectively reduces the FFmpeg codec's dependence on system environment components, and fully utilizes the virtualization service consistency of the JVM (Java Virtual Machine). While meeting the business end's expected needs for FFmpeg's various video codec editing and other tool components, it also greatly facilitates development and deployment efficiency.

It can be understood that through video transcoding technology, videos of any file format can be uniformly converted according to the requirements of different devices, different business networks, and different video formats, so as to achieve the purpose of improving the encoding quality of video resources and efficiently utilizing Internet bandwidth and storage capacity. And according to different application scopes and scenario requirements (for example, saving bandwidth, terminal compatibility, display and other scenario requirements), different parameters of multimedia data encoding methods can be converted, such as resolution, bit rate, etc. The multimedia codec library libavcodec (one of the core components of the open source program Ffmpeg) included in the open source program FFmpeg is used as the kernel and applied in most video players to record video information and convert its format into the required format, and finally encode and decode it into a media stream that can cross multiple platforms, that is, adjust the resolution and video frame rate, and store video data key frames, video slices, etc. Through FFmpeg, video resources can be converted into TS stream files (TransportStream, DVD file format), and after the video transcoding is completed, it is divided into slices including parameters such as m3u8 index files.

Optionally, the first encoding format and the second encoding format may be any one or more of mp4, swf, mkv, mov, wma, avi, rmvb, m1v, m2v, mod, mp2v, mpeg, and 3gpp, and this example embodiment does not specifically limit this.

Statistical analysis can be performed on the encoding and packaging formats of historical video library video files and mainstream video files to achieve compatibility for major video formats. The uploaded video files can be processed in batches through the system's unified codec and packaging unit to achieve standardized output of unified encoding bit rates and packaging formats for multiple formats and packaging. Based on this encoding and packaging, targeted streaming media service optimization can be performed to achieve unified and smooth output of front-end video playback and adaptation to multiple terminals.

The embodiments of the present application can make full use of the middle-layer characteristics of the Java (an object-oriented programming language) virtual machine, adapt to and be compatible with different hardware, operating systems, and compilation environments, and encapsulate the video processing codec based on the JavaSDK, thereby effectively avoiding the installation and deployment differences of the video processing codec in different hardware and operating systems, as well as the compilation environment dependency, thereby effectively reducing the complexity of installation, deployment, and expansion; at the same time, it provides a Java-based API calling method for the business layer, which is in line with the native management processing development language environment and compilation method of existing businesses, and is conducive to business developers focusing on business-level processing.

Optionally, the identification and analysis of the initial streaming media includes analyzing at least one piece of information such as the format, resolution, encoding, and bit rate of the initial streaming media, which is not particularly limited in this exemplary embodiment.

Optionally, the detailed information of the streaming media can be viewed through different media information tools, such as FFmpeg, MediaInfo (a video parameter detection tool that can be used for encoding analysis and query of videos and encoding and information detection of audio files), etc. This example embodiment does not specifically limit the selection of tools.

Optionally, in the process of converting the initial streaming media into the target streaming media, the transcoder used can be FFmpeg, or it can be HandBrake (a free, open source, cross-platform video conversion software, mainly used to convert video files from one format or encoding to another format or encoding), etc., which can complete the transcoding of the streaming media. This example embodiment does not specifically limit this.

Optionally, the transcoding parameters include at least one of bit rate, code rate, frame rate, image quality, etc., which are not particularly limited in this example embodiment.

For example, you can use the FFprobe (a multimedia analysis tool that can analyze audio and video parameters, media container parameter information, etc., and can also analyze the length of each packet in the media file, the type of packet, frame information, etc.) command to complete the acquisition of video file information to return a JSON (JavaScript Object Notation, JS object notation, a lightweight data exchange format) object containing detailed information of the corresponding video file, such as duration, bit rate, stream information, etc. You can also extract frames per second from the video, save these frames and set the image format at the same time. For example, you can use the VideoCapture (a tool that can traverse video frames and edit and modify each frame of data during the traversal process) function in the Open CV (an open source cross-platform computer vision and machine learning software library) library to extract video frames.

Optionally, an interface for displaying the transcoding status can be set in the automatic transcoding unit 403, and the interface can display the current transcoding progress and the transcoding status of whether the transcoding is successful. Optionally, the transcoding status includes at least one of the states of transcoding, transcoding success, and transcoding failure. Specifically, only when the current transcoding status is "transcoding success", the system will respond to the user's video sending request. When the current transcoding status is "transcoding failure", the system can display an error prompt message and provide an option to re-transcode. When the current transcoding status is "transcoding", "transcoding progress 50%", "transcoding progress 80%", etc. are displayed according to the stage of the transcoding progress.

In an exemplary embodiment of the present disclosure, referring to FIG. 7 , the label marking unit 404 includes a data collection subunit 701 , a feature extraction subunit 702 , a feature matching subunit 703 and a label marking subunit 704 .

Among them, the data acquisition subunit is used to obtain the corresponding streaming media data from the target streaming media; the feature extraction subunit is used to extract features from the streaming media data to obtain corresponding feature data; the feature matching subunit is used to input the feature data into the trained classification model to obtain corresponding classification probability data; the labeling subunit is used to sort the classification probability data and select the label with the highest probability according to the preset number of labels to label the target streaming media.

The streaming media data refers to the frame-by-frame screenshot data or audio clip data corresponding to the target streaming media. For example, the frame-by-frame screenshot data can be subjected to feature extraction, and then classified according to the extracted features, and then the content of the target streaming media can be judged according to the classified data.

Optionally, before extracting the features of streaming media data, the streaming media data needs to be preprocessed, such as graying, binarizing, normalizing, scaling, etc., so as to reduce the interference of redundant information in the streaming media data on the classification model.

Optionally, each screenshot can be converted into RGB color space, and the pixel distribution of each channel can be calculated to obtain a color histogram. The similarity of different screenshots can be determined by comparing their histograms. Texture descriptors such as local binary patterns, grayscale co-occurrence matrices, etc. can also be used to capture texture information in the screenshots. Edge detection algorithms such as edge detection operator Canny can also be used to extract edge information in the screenshots. Feature extraction can be performed on the screenshot data frame by frame, and this example embodiment does not specifically limit this. Similarly, when the streaming media data is audio data, Mel-Frequency Cepstral Coefficients (MFCC) can be used to extract features from the audio signal to obtain a feature vector representing the key characteristics of the streaming media data.

Optionally, the classification model refers to a neural network model used to perform reasoning analysis on feature data corresponding to streaming media data and determine the data content type in the streaming media data. The classification model can be used to quickly classify the content in the streaming media data and improve the labeling efficiency of the target streaming media. For example, the classification model can select the LeNet-5 model (a classic convolutional neural network model), the ResNet model (a deep convolutional neural network model), or the MobileNetV2 model (a lightweight convolutional neural network model), which is not particularly limited in this example embodiment.

Exemplarily, when the preset number of tags is 1, the tag with the highest classification probability is selected as the predicted tag. When the preset number of tags is 3, the three tags with the highest classification probability are selected as the predicted tags according to the sorting of classification probabilities.

Exemplarily, the manuscript content of the content management system can be automatically associated with the streaming media content, and based on the news manuscript title, summary content, manually annotated or automatically extracted keywords, the video content objects can be automatically annotated to form an automatic labeling system for the video content. The video content can be analyzed and described through text content association, thereby realizing the text knowledge graph annotation of the video content.

In an exemplary embodiment of the present disclosure, referring to FIG. 8 , the streaming media editing unit 405 includes a picture processing subunit 801 and a personalization subunit 802 .

The image processing subunit is used to perform online image and audio optimization processing on the target streaming media; the personalization subunit is used for the user to add watermarks and/or logos to the target streaming media.

Among them, online image and audio optimization processing can include improving image quality by increasing image brightness, contrast, saturation and other parameters, making the image clearer by removing noise and interference in the image, calibrating the color of the image, enhancing the edges and details of the image, eliminating background noise, enhancing the clarity and volume of the audio signal, stabilizing the jitter in the video image, reducing the impact of lens shake or vibration of the shooting equipment on the image quality, etc., as long as the image quality and audio clarity can be improved, this example embodiment does not make any specific limitations on this.

Optionally, the watermark can be in the form of text, image, logo (logotype, logo), etc., which can identify the owner of the content or convey specific information. This exemplary embodiment does not specifically limit this. At the same time, the user can also upload a custom watermark, and the format of the uploaded watermark includes but is not limited to JPG, PNG, GIF, SVG, etc.

Specifically, the user can edit the color, size, rotation angle, and position of the watermark and/or logo online.

Optionally, the personalization subunit can also identify existing watermarks or logos through image or video analysis technology and modify existing watermarks or logos, thereby helping users to effectively control the content. Users do not need to find other software for secondary editing, which provides convenience for user operations.

In an exemplary embodiment of the present disclosure, referring to FIG. 9 , the streaming media retrieval unit 406 includes a keyword extraction subunit 901 , a tag matching subunit 902 , and a video selection subunit 903 .

Among them, the keyword extraction subunit is used to extract keywords from the search information input by the user to obtain the corresponding search keyword information; the tag matching subunit is used to calculate the similarity scores between all the search keyword information and all the tags to obtain the tags whose similarity scores are greater than or equal to the preset similarity threshold; the video selection subunit is used to display the streaming media corresponding to the tags whose similarity scores are greater than or equal to the preset similarity threshold according to the tag similarity scores.

For example, by removing stop words in the search information and segmenting the text input by the user according to certain rules, long sentences can be divided into independent words, and then the segmented words are tagged with parts of speech. Then, according to certain rules or algorithms, keywords can be extracted from the segmented and part-of-speech tagged text.

Optionally, when extracting keywords from the search information input by the user, the keyword extraction can be achieved through relevant statistical algorithms. For example, the TF-IDF (Term Frequency–Inverse Document Frequency) algorithm based on word frequency statistics can be selected to extract keywords. The TF-IDF algorithm is a weighted technology used for information retrieval and text mining. It is mainly used to evaluate the importance of terms (words) in a document or corpus. If a word appears frequently in a document (large TF value) and rarely appears in other documents (large IDF value), then the word has good category discrimination ability and is suitable for classification. Of course, keyword extraction can also be achieved by training a deep learning model. For example, the text topic-based LDA (Linear Discriminant Advanced Feature Searching (LDA) algorithm can be used. Analysis, Linear Discriminant Analysis) algorithm, the text topic-based LDA algorithm is an unsupervised machine learning technology that can be used to identify potential hidden topic information in large-scale document sets or corpora. This method assumes that each word is extracted from a potential hidden topic behind it; the word vector-based Textrank algorithm (an extractive unsupervised text summary extraction method) can also be used. The word vector-based Textrank algorithm is a graph-based sorting algorithm for text. It divides the text into several components (sentences), constructs a node connection graph, uses the similarity between sentences as the weight of the edge, calculates the TextRank value of the sentence through a loop iteration, and finally extracts the high-ranking sentences to form a text summary; this example embodiment does not specifically limit the method of keyword extraction.

Optionally, cosine similarity (Cosin), Jaccard similarity (Jaccard), edit distance, trained text semantic similarity model, etc. may be used to calculate the similarity score, which is not particularly limited in this example embodiment.

In an exemplary embodiment of the present disclosure, referring to FIG. 10 , the streaming media presentation unit 407 includes a streaming media presentation subunit 1001 and a streaming media sharing subunit 1002 .

Among them, the streaming media display subunit is used to embed the target streaming media into the corresponding display web page to realize the display of the streaming media; the streaming media sharing subunit is used to share the target streaming media to the public database of the external network, and open a corresponding access window in each video portal to access and display the target streaming media.

Specifically, the streaming media display unit can manage the playback of the video, such as playing, pausing, fast forwarding, rewinding, etc., and handle any compatibility issues that may arise. It can also control other parameters related to video playback, such as resolution, buffering speed, etc.

Optionally, the player has a video multi-bitrate switching function, which can realize free switching of video clarity between "standard definition", "high definition", "ultra-definition" and other definition to meet the viewing needs of different users. Its playback mode supports picture-in-picture playback and full-screen playback. Users can choose the appropriate video quality according to the network speed to ensure video smoothness. It also supports viewing on mobile phones and Pads.

In an exemplary embodiment of the present disclosure, referring to FIG. 4 , the resource control module 204 includes an automatic deployment unit 408 , a resource management unit 409 and an identity authentication unit 410 .

Among them, the automated deployment unit is used to quickly deploy applications or services to the corresponding private cloud and/or public cloud environment according to preset deployment rules; the resource management unit is used to allocate and schedule resources in the public cloud and private cloud; the identity authentication unit is used to verify the user's identity information and realize centralized verification of multiple related systems.

Specifically, the automated deployment unit can be responsible for managing the configuration information of applications or services, including environment variables, database connections, log management, etc. By separating these configuration information from the application code and managing them in a unified manner, a more flexible and maintainable deployment process can be achieved; during the deployment process, the automated deployment unit can also be responsible for preparing the required infrastructure and dependent resources. This includes creating virtual machines, installing operating systems, configuring network connections, etc.

Specifically, the resource management unit can allocate appropriate computing, storage and network resources according to user needs, and can dynamically adjust resource configuration according to the scale and load of the application to achieve optimal performance and cost-effectiveness. At the same time, it can also reasonably schedule and manage cloud resources according to factors such as user priorities and resource utilization. For example, it can distribute requests to different computing nodes according to load balancing strategies and monitor resource usage to ensure the stability and reliability of the entire system. It can also automatically adjust the number and configuration of resources according to the load of the application. For example, when the load is high, the number of computing nodes can be automatically increased to improve the processing power of the system, and when the load is low, the number of computing nodes can be automatically reduced to save resources and costs.

In an exemplary embodiment of the present disclosure, referring to FIG. 5 , the identity authentication unit 410 includes a request submission subunit 501 and an identity authentication subunit 502 .

Among them, the request submission subunit is used to send the obtained user identity information to the unified identity authentication server through a secure transmission channel; the identity authentication subunit is used to obtain the authentication token returned by the unified identity authentication server and verify the authentication token. If the authentication token is valid, respond to the user's access request.

Through the service discovery of the unified identity authentication server, combined with global roaming encrypted token authentication and distributed cache, service requests can be implemented within a compliant and secure framework while reducing request frequency and dependency. It supports multiple common remote authentication methods to access server-side authentication, and through unified authentication and ticket roaming, the control end completes overall authentication and authorization scheduling, and the server-side lightweight configuration authorization authentication.

For example, the system platform identity authentication mechanism can adopt the server-side Session (a login authentication module) authentication in accordance with the cross-application Token authorization authentication method, and meet the cross-application roaming form of identity authentication requirements under the premise of meeting the identity authentication security and service controllability. When a user logs in to the unified authentication system, the application system can automatically verify the identity of the logged-in user without the user sending instructions, that is, when the user initiates an access request to the streaming media management system, the streaming media management system verifies the user's identity authentication token and returns the user's own identity certificate. The user then sends his or her identity authentication token to the application through the SSL (Secure Socket Layer) transmission channel. The application sends the received user token and its own service identifier to the unified identity authentication system and initiates a user identity verification instruction at the same time. After receiving the instruction, the unified identity authentication system then decrypts the user's identity authentication token, verifies it with the database, and feeds back the result to the application. After receiving the feedback result, the application can decide whether to allow the user to access according to the user's authority.

On the one hand, by verifying the identity information provided by the user, such as user name and password, and confirming the user's identity, unauthorized access can be prevented and the security of the system can be ensured; on the other hand, by implementing the single sign-on function, that is, the user only needs to perform identity authentication once to access multiple related systems. This can simplify the user's login process and improve the user experience; on the other hand, according to the user's identity and role information, the user's authorization management can be carried out, the access rights of different users to system resources can be defined, and the user's behavior can be monitored to ensure the security and compliance of the system.

In an exemplary embodiment of the present disclosure, referring to FIG. 11 , a flow chart of a streaming media management system based on a cross-cloud integrated environment of the present disclosure is shown, including the following steps S1101 to S1102:

Step S1101. Obtaining the initial streaming media uploaded by the user;

Step S1102. Compare the first encoding format with the preset second encoding format and return the comparison result. If the first encoding format is different from the second encoding format, execute S1103; if they are the same, execute S1104;

Step S1103. Set transcoding parameters corresponding to the second encoding format, and generate target streaming media corresponding to the second encoding format according to the transcoding parameters;

Step S1104. Extract features from the target streaming media content and input them into the classification model, thereby obtaining corresponding labels and marking them;

Step S1105. The user can edit the generated target streaming media online, such as marking a logo, etc.;

Step S1106. The target streaming media is stored in the corresponding database according to the tag;

Step S1107. Extract keywords from the user's search information and perform similarity matching based on keywords and tags;

Step S1108: Display and share the matched streaming media to a video portal of an external website for user access.

In an exemplary embodiment of the present disclosure, referring to FIG. 12 , FIG. 12 shows an example for a non-logged-in user to upload and publish streaming media:

Step S1201. The user enters the management page address in the streaming media access terminal and sends the access request to the server;

Step S1202. When the server receives the access request, it displays the identity authentication interface;

Step S1203. The user enters his or her identity information, account number, password, etc. in the identity authentication interface;

Step S1204. After receiving the user's identity information, the server compares it with the information in the database;

Step S1205. The server receives the comparison result of the user identity information and the data in the database;

Step S1206. After the comparison is successful, the user interface jumps to the streaming media management page;

Step S1207. The user uploads the video on the management page, identifies the first encoding format of the initial streaming media, compares it with the second encoding format, and determines whether automatic transcoding is required;

Step S1208. The server automatically transcodes the streaming media (not if the first encoding format is the same as the second encoding format), identifies the tag and marks it;

Step S1209. The server stores the target streaming media;

Step S1210. The server receives a user display and sharing request;

Step S1211. The server returns the streaming media display and sharing page, thereby completing the entire video upload process, and realizing the display of the target streaming media within the internal network and sharing through the external network.

Embodiment 2 A storage medium

The exemplary embodiments of the present invention also provide a computer-readable storage medium on which a program product capable of implementing the above-mentioned system of the present specification is stored. In some possible embodiments, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on an electronic device, the program code is used to cause the electronic device to perform the steps of various exemplary embodiments of the present invention described in the above-mentioned "Exemplary System" section of this specification. The program product can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on an electronic device, such as a personal computer. However, the program product of the present invention is not limited to this. In this document, the readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

The program product may adopt any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C#, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

Embodiment 3 An electronic device

The exemplary embodiment of the present invention also provides an electronic device capable of implementing the above system. The electronic device 1300 according to this exemplary embodiment of the present invention is described below with reference to FIG. 13. The electronic device 1300 shown in FIG. 13 is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

As shown in Fig. 13, the electronic device 1300 may be in the form of a general-purpose computing device. The components of the electronic device 1300 may include, but are not limited to: at least one processing unit 1310, at least one storage unit 1320, a bus 1330 connecting different system components (including the storage unit 1320 and the processing unit 1310), and a display unit 1340.

The storage unit 1320 stores program codes, which can be executed by the processing unit 1310, so that the processing unit 1310 performs the steps of various exemplary embodiments of the present invention described in the "Exemplary System" section above. For example, the processing unit 1310 can run the system in Figure 2.

The storage unit 1320 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 1321 and/or a cache memory unit 1322 , and may further include a read-only memory unit (ROM) 1323 .

The storage unit 1320 may also include a program/utility 1324 having a set (at least one) of program modules 1325, such program modules 1325 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

Bus 1330 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

The electronic device 1300 may also communicate with one or more external devices 1370 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 1300, and/or communicate with any device that enables the electronic device 1300 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed through an input/output (I/O) interface 1350. In addition, the electronic device 1300 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and/or public networks, such as the Internet) through a network adapter 1360. As shown, the network adapter 1360 communicates with other modules of the electronic device 1300 through a bus 1330. It should be understood that, although not shown in the figure, other hardware and/or software modules may be used in conjunction with the electronic device 1300, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID (Redundant Arrays of Independent Disks, independent redundant disk array) systems, tape drives, and data backup storage systems.

Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the system according to the exemplary implementation of the present invention.

In addition, the above-mentioned figures are only schematic illustrations of the processes included in the system according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

Example 4 A cross-cloud business linkage, cross-system, and cross-service collaborative system

The cross-cloud integration environment in the embodiment of the present invention may include private clouds and public clouds, and distributed collaborative management may be used to implement message transmission and data interaction, and realize cross-cloud business linkage, cross-system, and cross-service collaboration. The message queue MQ is used across systems to deconstruct service request dependencies, achieve decoupling between service transaction compilations, and maintain state consistency. The collaborative multi-system module is implemented using internal microservices and message queue mechanisms. The task collaboration between cross-system modules, combined with the business model, effectively handles the resource consumption and processing time imbalance of document publishing and video transcoding, and avoids operation interruptions. The service calls and state synchronization between systems are coordinated and unified through message queues, and chained transaction calls are formed. Only routine management operations need to be performed on the management side to complete the complex business implementation across systems and services.

In order to solve the technical problems of video encoding and transcoding and cross-cloud business linkage, cross-system and cross-service collaboration in a cross-cloud integrated environment, the embodiment of the present invention has designed and developed a streaming media management system based on a cross-cloud integrated environment, which uses distributed collaborative management to realize message transmission and data interaction. The data layer communicates through interfaces, and in order to avoid excessive cross-system status push, the message queue technology MQ is used to realize resource status synchronization. The message queue MQ can be developed based on Java, and has the characteristics of distribution, strong performance and strong real-time performance.

In a streaming media management system based on a cross-cloud integrated environment, RocketMQ (a distributed messaging middleware with low latency, high concurrency, high availability, and high reliability) can be used as a message queue transfer station. The streaming media system and the user unified identity authentication system send messages to the message queue respectively, and then the other system retrieves and processes these messages from the queue. This method can ensure the reliable transmission and processing of messages, and the two systems can work independently, as long as the corresponding messages are processed at the appropriate time.

The streaming media management system based on the cross-cloud integrated environment in the embodiment of the present invention can be configured for asynchronous processing. The streaming media management system based on the cross-cloud integrated environment and the user unified identity authentication system each handle their own tasks, and store the messages that need to be interacted in the database or use other persistence methods for storage. Then, the other system can obtain and process the messages from the database or the interactive information stored using other persistence methods on a regular basis or on demand. This method is suitable for scenarios with low non-real-time requirements, but can greatly reduce the coupling of the system.

The streaming media management system based on the cross-cloud integrated environment in the embodiment of the present invention can be configured as a delayed task queue. By using the RocketMQ delayed task queue, messages that need to be delayed can be placed in the queue, and a timestamp can be set to indicate when the task will be executed. When the timestamp arrives, the queue will trigger the task and it will be processed by the corresponding system.

Message queues MQ can be configured across systems to deconstruct service request dependencies, achieve decoupling between service transaction compilations, and maintain state consistency. Collaborative multi-system modules are implemented using internal microservices and message queue mechanisms. Task collaboration between cross-system modules, combined with business models, effectively handles resource consumption and imbalanced processing times for document publishing and video transcoding, and avoids operational interruptions. Service calls and state synchronization between systems are coordinated and unified through message queues, and chained transaction calls are formed. On the management side, only routine management operations need to be performed to complete complex business implementations across systems and services.

It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

The present invention is intended to cover any variation, use or adaptation of the present invention, which follows the general principles of the present invention and includes common knowledge or customary technical means in the art not disclosed by the present invention. The description and examples are to be regarded as exemplary only, and the true scope of the present invention is indicated by the claims.

It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims (10)

1. A cross-cloud integration environment based streaming media management system, comprising: the system comprises a system deployment module, a streaming media management module and a resource control module, wherein the system deployment module, the streaming media management module and the resource control module are used for realizing full-flow chained management from a streaming media generation end to an access end; wherein:

The system deployment module is used for deploying application programs or services into a cross-cloud integration environment, and realizing remote access of external websites to internal network resources by controllably isolating the access of the internal network resources and the external network resources;

The streaming media management module is used for automatically transcoding, labeling and editing the initial streaming media uploaded by the user by calling an application program or service deployed in the cross-cloud integrated environment to obtain target streaming media, and displaying the corresponding target streaming media to each video portal according to the retrieval result of the user;

The resource control module is used for distributing corresponding network resources according to the categories of the application programs or the services called by the streaming media management module, and carrying out safety protection on the access of the user to the target streaming media.

2. The cross-cloud integrated environment based streaming media management system of claim 1, wherein said system deployment module comprises:

The server deployment unit is used for deploying the servers of the streaming media management service in the internal network and deploying the servers of the streaming media sharing service in the external network;

the firewall deployment unit is used for limiting the resource access between the internal network and the external network according to the access rule;

wherein the access rule includes: the streaming media management service only accesses resources in the internal network, the streaming media sharing service can access live broadcast recorded data of the internal network, and online live broadcast in real time of a video portal is realized by accessing a live broadcast platform or a streaming mode.

3. The cross-cloud integrated environment based streaming media management system of claim 1, wherein said resource control module comprises:

The automatic deployment unit is used for rapidly deploying the application program or the service into the corresponding private cloud and/or public cloud environment according to a preset deployment rule;

The resource management unit is used for distributing and scheduling the resources in the public cloud and the private cloud;

And the identity authentication unit is used for verifying the identity information of the user and realizing centralized verification of a plurality of associated systems.

4. The cross-cloud integrated environment based streaming media management system of claim 3, wherein said identity authentication unit comprises:

The request submitting subunit is used for sending the acquired identity information of the user to the unified identity authentication server through the secure transmission channel;

And the identity verification sub-unit is used for acquiring the authentication token returned by the unified identity authentication server and verifying the authentication token, and responding to the access request of the user if the authentication token is valid.

5. The system according to claim 1, wherein the streaming media management module comprises an automatic transcoding unit, a tag labeling unit, a streaming media editing unit, a streaming media retrieving unit and a streaming media displaying unit;

The automatic transcoding unit is used for uploading initial streaming media submitted by a user to a server and automatically transcoding the initial streaming media to obtain target streaming media;

The label marking unit is used for identifying the target streaming media and marking the target streaming media by adopting corresponding labels;

the stream media editing unit is used for the user to edit the uploaded target stream media online;

The stream media retrieval unit is used for carrying out matching on the target stream media based on retrieval information input by a user, and sequencing and displaying the target stream media according to the matching degree;

The stream media display unit is used for displaying the target stream media in an internal network and sharing the target stream media through an external network.

6. The cross-cloud integrated environment based streaming media management system of claim 5, wherein said automatic transcoding unit comprises:

a streaming media obtaining subunit, configured to obtain an initial streaming media submitted by the user;

a stream media identification subunit, configured to identify a first coding format of the initial stream media;

The format comparison subunit is used for comparing the first coding format with a preset second coding format and returning a comparison result;

A parameter obtaining subunit, configured to obtain a transcoding parameter corresponding to the second coding format when the first coding format is different from the second coding format;

and the streaming media conversion subunit is used for converting the initial streaming media adopting the first coding format into the target streaming media adopting the second coding format according to the transcoding parameters.

7. The cross-cloud integrated environment based streaming media management system of claim 5, wherein said tagging unit comprises:

The data acquisition subunit is used for acquiring corresponding streaming media data from the target streaming media;

the characteristic extraction subunit is used for carrying out characteristic extraction on the streaming media data to obtain corresponding characteristic data;

the feature matching subunit is used for inputting the feature data into the trained classification model to obtain corresponding classification probability data;

and the label labeling subunit is used for sequencing the classification probability data, and selecting the label with the highest probability according to the preset label number to label the target streaming media.

8. The cross-cloud integration environment based streaming media management system of claim 5, wherein the streaming media editing unit comprises:

The picture processing subunit is used for carrying out online image and audio optimization processing on the target streaming media;

and the individuation subunit is used for adding the watermark and/or the identifier to the target streaming media by the user.

9. The cross-cloud integration environment based streaming media management system of claim 5, wherein the streaming media retrieval unit comprises:

The keyword extraction subunit is used for extracting keywords from the search information input by the user to obtain corresponding search keyword information;

the label matching subunit is used for calculating similarity scores between all the search keyword information and all the labels to obtain labels with the similarity scores greater than or equal to a preset similarity threshold;

And the video selection subunit is used for displaying the streaming media corresponding to the labels with the similarity scores greater than or equal to the preset similarity threshold according to the similarity scores of the labels.

10. The cross-cloud integrated environment based streaming media management system of claim 5, wherein said streaming media presentation unit comprises:

the streaming media display subunit is used for embedding the target streaming media into a corresponding display webpage to realize the display of the streaming media;

And the streaming media sharing subunit is used for sharing the target streaming media to a public database of the external network, and opening corresponding access windows at each video portal to access and display the target streaming media.