CN117478823A

CN117478823A - Bank hybrid cloud conference service system, conference processing method and device

Info

Publication number: CN117478823A
Application number: CN202311481880.4A
Authority: CN
Inventors: 刘轩
Original assignee: China Construction Bank Corp
Current assignee: China Construction Bank Corp
Priority date: 2023-11-08
Filing date: 2023-11-08
Publication date: 2024-01-30

Abstract

The invention provides a bank hybrid cloud conference service system, a conference processing method and a conference processing device, and relates to the technical field of hybrid clouds, wherein the system comprises: conference terminals, total service clusters, sub-service clusters and three-party cloud platforms; the conference terminal sends a conference request to the total service cluster; the method comprises the steps that a conference is established by a total service cluster; judging the type of the conference terminal, and forwarding a media stream generated by the conference to the conference terminal when the type of the conference terminal is judged to be the first type of terminal; when the second type of terminal is judged, forwarding a media stream generated by the conference to the sub-service cluster; when the terminal is judged to be an Internet terminal, forwarding a media stream generated by the conference to a three-party cloud platform; the sub-service clusters are used for receiving the media streams sent by the total service clusters and forwarding the media streams to the second class terminals; the three-party cloud platform is used for receiving the media stream sent by the total service cluster, forwarding the media stream to the Internet terminal, providing a more stable and higher-quality cross-country cloud video conference service, guaranteeing data safety and network safety, and reducing construction cost and operation and maintenance cost.

Description

Bank hybrid cloud conference service system, conference processing method and device

Technical Field

The invention relates to the technical field of hybrid clouds, in particular to a bank hybrid cloud conference service system, a conference processing method and a conference processing device.

Background

This section is intended to provide a background or context for embodiments of the invention. The description herein is not admitted to be prior art by inclusion in this section.

With the rapid development of computer and communication technologies, video conference technologies are getting more and more attention from various industries. The video conference system is a personal or group of two or more different places, and distributes various data such as static and dynamic images, voice, characters, pictures and the like of people to computers of all users through various conventional communication transmission media, so that geographically dispersed users can be copolymerized in one place, information can be exchanged in various modes such as graphics, sound and the like, and the understanding capability of the two parties on the content is improved. The video conference system is popular for a plurality of users because the video conference system can greatly improve the communication efficiency, continuously reduce the communication cost, bring about the upgrade of the internal management level, and is widely applied to various fields of government, army, transportation, finance, operators, education, enterprises and the like.

The financial industry is an important scene of video conference system application, particularly has more important effect on the characteristic of cross-region communication at any time of a large-scale cross-country bank, can be used for internal communication of banks, and a bank headquarter can communicate information with bank branches distributed in different regions at any time to timely convey important instructions or know the dynamic state of financial markets in all places; on the other hand, the system can be used for remotely education and training staff of a bank branch office to help the staff to improve the business level.

Existing videoconferencing systems can be divided into: a software video conference system and a hardware video conference system. The hardware video conference system is based on an embedded architecture video communication mode, and video and audio processing, network communication and various conference functions are realized by means of DSP (Digital Signal Processor ) +embedded software. The method has the greatest characteristics of high performance, good reliability, and the problems of large investment, poor expansibility, single function and the like, which are caused by adopting a hardware video mode in most medium-high-end video applications. The software video conference system is a video communication mode based on a pure software architecture, mainly relies on a CPU (Central Processing Unit ) to process video and audio coding and decoding, and has the greatest characteristics of low cost, good openness and convenience in software integration. However, the stability and reliability of the software video are still to be improved, and the video quality is generally not comparable to that of a hardware video system.

How to reduce investment and improve compatibility and expansibility of a video conference system while maintaining better user experience of a hardware video conference system is a development direction in the design of video conference system solutions. The existing video conference systems have the following limitations: the traditional cloud video service system is not applied to the current advanced 5G, internet of things, intelligent screen and special cloud video terminals, and is not compatible with the original traditional conference room terminals; through wireless wifi link, the use condition of network bandwidth and the security of network channels are not considered; through the links of the Internet and the intranet, the consideration of data safety and network safety is lacking, and a plurality of limiting factors such as conference resource bottleneck, network firewall availability and reliability, and security of a bidirectional proxy of an intranet and an extranet fusion conference are not considered. The video conference method of privatization and multi-center deployment needs to build the same system in a plurality of centers at the same time, a large amount of data transmission exists among the centers and most of data transmission is video images and audio, the bandwidth consumption of an intranet and an Internet network is huge, and the construction cost and the later operation and maintenance cost are high. The method of fusing the local video conference and a third party SaaS (Software-as-a-service) video conference system is adopted, the network bandwidth and the cluster resource involved in the fusion between the systems are not explicitly verified and considered, and the method is not applicable to a scene fused on a large scale and cannot ensure the conference quality and stability; and secondly, conference data is possibly stored in a third party by adopting a mode of fusing with a third party video conference system, so that the data security of the conference cannot be ensured.

Disclosure of Invention

In order to solve the problems in the prior art, the invention provides a bank hybrid cloud conference service system, a conference processing method and a conference processing device. The cloud video conference service system can provide a more stable and higher-quality cloud video conference service, ensure data safety and network safety, and reduce construction cost and operation and maintenance cost.

In an embodiment of the present invention, a bank hybrid cloud conference service system is provided, including: conference terminals, total service clusters, sub-service clusters and three-party cloud platforms; the communication among the conference terminal, the total service cluster, the sub service cluster and the three-party cloud platform adopts encryption processing;

the conference terminal comprises a first type terminal, a second type terminal and an Internet terminal; the first type of terminals and the second type of terminals are intranet banking terminals; the first type of terminals are head office terminals, and the second type of terminals are branch terminals;

the conference terminal is used for sending a conference request to the total service cluster through a load balancing CLB (Cloud Load Balancer, cloud load balancing);

the total service cluster comprises a total media server; the total media server is used for forwarding the media stream generated by the conference to the conference terminal;

the total service cluster is used for receiving the conference request and establishing a conference; determining conference level, conference size, quality of user experience QoE (Quality of Experience, quality of user experience); adjusting the routing of the conference according to the conference level, the conference scale and the user quality of experience QoE; judging the type of the conference terminal, and calling a total media server to forward a media stream generated by the conference to the conference terminal when the conference terminal is a first type terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; when the conference terminal is an internet terminal, forwarding a media stream generated by the conference to a three-party cloud platform;

The sub-service clusters are used for receiving the media streams sent by the total service clusters and forwarding the media streams to the second class terminals;

and the three-party cloud platform is used for receiving the media stream sent by the total service cluster and forwarding the media stream to the Internet terminal.

In the embodiment of the invention, a conference processing method of a bank hybrid cloud conference service system is also provided, which comprises the following steps:

receiving a conference request sent by a conference terminal, and establishing a conference according to the conference request;

determining conference level, conference scale and user experience quality QoE;

adjusting the routing of the conference according to the conference level, the conference scale and the user quality of experience QoE;

judging the type of the conference terminal, and calling a total media server to forward a media stream generated by the conference to the conference terminal when the conference terminal is a first type terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; and when the conference terminal is an internet terminal, forwarding the media stream generated by the conference to the three-party cloud platform.

In the embodiment of the present invention, there is also provided a total service cluster in a bank hybrid cloud conference service system, including:

the receiving module is used for receiving a conference request sent by the conference terminal and establishing a conference according to the conference request;

The determining module is used for determining conference level, conference scale and user quality of experience QoE;

the route adjustment module is used for adjusting the route of the conference according to the conference level, the conference scale and the user experience quality QoE;

the media stream forwarding module is used for judging the type of the conference terminal, and calling the total media server to forward the media stream generated by the conference to the conference terminal when the conference terminal is a first type terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; and when the conference terminal is an internet terminal, forwarding the media stream generated by the conference to the three-party cloud platform.

Compared with the traditional cloud video service system, privatization and multi-center deployment and the scheme of fusing a local video conference and a third-party video conference system in the prior art, the bank mixed cloud conference service scheme provided by the invention has the advantages that the conference terminal sends a conference request to a total service cluster through a load balancing CLB; the total service cluster receives the conference request and establishes a conference; determining conference level, conference scale and user experience quality QoE; adjusting the routing of the conference according to the conference level, the conference scale and the user quality of experience QoE; judging the type of the conference terminal, and calling a total media server to forward a media stream generated by the conference to the conference terminal when the conference terminal is a first type terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; when the conference terminal is an internet terminal, forwarding a media stream generated by the conference to a three-party cloud platform; the sub-service clusters receive the media stream sent by the total service clusters and forward the media stream to the second class of terminals; the three-party cloud platform receives the media stream sent by the total service cluster, forwards the media stream to the Internet terminal, uses the hybrid cloud network architecture, merges the ultra-large bandwidth resource of the third-party cloud, gives consideration to the high security provided by the private cloud, can provide more stable and higher-quality cloud video conference service, ensures data safety and network safety, reduces construction cost and operation and maintenance cost, uses the quantized QoE value as a network intelligent routing basis, and can realize self-adaptive network routing.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of a bank hybrid cloud conference service system according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a layered architecture of a main service server according to an embodiment of the present invention;

fig. 3 is a schematic diagram of a specific example of a bank hybrid cloud conference service system according to an embodiment of the present invention;

fig. 4 is a flowchart of a conference processing method of the bank hybrid cloud conference service system according to the embodiment of the present invention;

fig. 5 is a schematic diagram of a total service cluster in a bank hybrid cloud conference service system according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of a computer device according to an embodiment of the invention.

Detailed Description

The principles and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are presented merely to enable those skilled in the art to better understand and practice the invention and are not intended to limit the scope of the invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Those skilled in the art will appreciate that embodiments of the invention may be implemented as a system, apparatus, device, method, or computer program product. Accordingly, the present disclosure may be embodied in the following forms, namely: complete hardware, complete software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.

According to the embodiment of the invention, a bank hybrid cloud conference service system, a conference processing method and a conference processing device are provided, and the system and the device relate to the fields of hybrid cloud technology and financial science and technology.

The principles and spirit of the present invention are explained in detail below with reference to several representative embodiments thereof.

Based on the defects of the prior art, how to reduce investment and improve compatibility and expansibility of a video conference system while maintaining better user experience of the hardware video conference system is a development direction in the design of video conference system solutions. In this context, cloud video conferencing systems have evolved.

The cloud video conference takes cloud computing as a core, and provides a service for users to carry out multiparty video communication in conference rooms, personal computers and mobile states. Compared with the traditional video conference system, the cloud video conference is born in the 'Internet+' age, and has the great advantages of lower cost, flexible architecture, high efficiency in processing, convenience in use and the like. The innovation of the cloud video conference system to the original system architecture is mainly divided into two major parts: cloud platform and customer end. The cloud platform replaces the original MCU (Media Control Unit ) equipment, the functions of the MCU equipment are decomposed into modules, and the modules are mutually coupled and can be flexibly expanded; and updating the concurrency bottleneck of the traditional MCU into dynamic resource pooling, thereby breaking the concurrency limit of the video conference system. For the end user, only the front-end equipment needs to be purchased to conduct the video conference.

Most large-scale across-the-country banking headquarters and branches thereof have uniformly deployed a set of video conference systems based on hardware, and part of branch network sites also purchase part of video conference terminals by themselves and rely on an internal network to carry out remote video communication with other units in the bank. The main system of the bank video conference system adopts different brands and models of hardware MCU and terminals, and can only basically meet the requirements of holding video conferences between inner branches and between branches and a headquarter, but banks have a large number of international services, overseas branches are distributed in all places of the world, and the overseas branches have the requirements of convenient communication with the headquarter or branches. However, the network bandwidth between the headquarter and overseas regions is different, a part of regions have no special line link, and the special line bandwidth of a part of regions is only less than 1M, so that the audio-visual experience of the video conference is difficult to ensure.

Based on the current situation problem of large-scale across-the-country banks and service pain points, and in combination with the technical advantages of the cloud video conference, the application provides a cloud video conference system solution based on hybrid cloud super fusion.

The cloud video technology relies on a cloud computing platform and has the core essential characteristics of all cloud computing technologies, and audio and video media processing resources are totally pooled, so that the universality is high, the system elasticity is stronger, and the usability is greatly improved; the multi-data center, the distributed and the mixed cloud deployment can realize flexible scheduling of computing resources, and a load sharing and load balancing mechanism is established for the large-flow and large-bandwidth cloud video service, and a mixed cloud mode is adopted, so that the high availability of lines is ensured and the communication cost is saved; the application scene aspect relates to all headquarters, branches and network points across the country, a user can join in a conference at any time, any place and any equipment through any network, and meanwhile, the user independent group conference, the user independent application of conference resources and the independent management of conference processes are supported; the backup of video data is constructed, so that the reliability of application is further ensured; yun Shipin operation platform tracks all storage, CPU and bandwidth resources in real time, and index quantization display can be realized, so that background resources can be quickly adjusted and optimized.

The embodiment of the invention provides a bank mixed cloud conference service system applied to a national bank, a conference processing method and a device, and aims to deploy a cloud video service system in the national bank by using a mixed cloud deployment mode, so that all branches and staff individuals at home and abroad can safely, quickly and conveniently access a cloud video conference. In summary, the embodiment of the invention provides a novel distributed hybrid cloud deployment mode, and on the basis of fully ensuring the safety of a conference, the service of a stable and high-quality cloud video conference can be provided according to conference level, conference scale and conference user experience (QoE) index, and the safety of the conference is ensured to the maximum under the condition of ensuring the conference quality and experience.

Fig. 1 is a schematic diagram of a bank hybrid cloud conference service system according to an embodiment of the present invention. As shown in fig. 1, the system may include:

conference terminals, total service clusters, sub-service clusters and three-party cloud platforms; the communication among the conference terminal, the total service cluster, the sub service cluster and the three-party cloud platform adopts encryption processing;

The conference terminal is used for sending a conference request to the total service cluster through the load balancing CLB;

the total service cluster is used for receiving the conference request and establishing a conference; determining conference level, conference scale and user experience quality QoE; adjusting the routing of the conference according to the conference level, the conference scale and the user quality of experience QoE; judging the type of the conference terminal, and calling a total media server to forward a media stream generated by the conference to the conference terminal when the conference terminal is a first type terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; when the conference terminal is an internet terminal, forwarding a media stream generated by the conference to a three-party cloud platform;

As shown in fig. 1, the total media server is a media server (server) in the total service cluster.

According to the embodiment of the invention, a bank intranet and extranet hybrid cloud video conference service system is built, global networks are optimized, the flexible access of users in the sea and the outside Internet and the participation of users in the bank intranet are realized, meanwhile, the existing fixed conference room video conference system is docked, an enterprise-level cloud video technology assembly is built, the integration capability of cloud video is realized, safe and controllable remote video interaction application integration is provided, a unified conference management and control system is built, and the user experience of the video conference in a row is improved.

In the top layer design and overall planning process, the bank mixed cloud conference service system of the embodiment of the invention builds a digital cloud video system and cloud video capability according to the overall thought of unified platform, unified system, unified design, unified standard, distributed-centralized maintenance management and refined operation. The cloud video technology is used for promoting global bank digital office and business integration to be fully covered from a headquarter, a first-class branch, a second-class branch and a network point, and integrating video conference and financial business.

Firstly, introducing architecture specification of a bank hybrid cloud conference service system of the embodiment of the invention:

by using a financial hybrid cloud super-fusion deployment architecture, according to QoE self-adaption and SDN linkage, the network adaptability is improved, the requirements of an internal network and an external network high-definition video conference are met, and the specification comprises: the hybrid cloud bidirectional service coverage solves the problem of network bandwidth of the video conference system and realizes the full coverage of the internal network and the external network; the super fusion architecture is used for constructing a cluster MCU resource pool by using a cloud computing MCU virtualization and hardware special MCU equipment fusion architecture; network adaptability is improved, routing of the software defined network (soft defined network, SDN) is adaptively adjusted according to user experience quality (Quality of Experience, qoE), network traffic is carried in a partitioned mode, and the effect of achieving high-definition smooth video in an unstable network environment is achieved.

According to the architecture specification, the technical route of the bank hybrid cloud conference service system of the embodiment of the invention comprises hybrid cloud, super fusion computing, cloud computing virtualization, qoE and software defined network SDN, and finally, the realization that clients realize interaction and enjoyment of services through fusion of a cloud media system and application video conference equipment is realized, the transfer is carried out from the traditional fields of image and sound transmission and the like to the multimedia service fusion direction, and the video communication system is applied to the aspects of department operation, work coordination, operation and maintenance management, service promotion and the like, so that the work efficiency, the management level and the service level are improved by means of new technologies.

1) The hybrid cloud merges public cloud and private cloud, and for safety reasons, banking users prefer to store data in the private cloud, but hope to expand cloud computing resources of a public cloud platform, in this case, the hybrid cloud is increasingly adopted, and the hybrid cloud merges ultra-large-scale cloud computing resources of the public cloud and also considers the high safety provided by the private cloud.

2) Super-fusion resource pool technology: the traditional MCU (micro control unit) and the virtualized MCU are subjected to resource pooling, centralized operation and maintenance management, and unified background management and maintenance are realized; the servers are mutually backed up, so that the overall stability and reliability requirements of the system are met, and services are provided uninterruptedly.

3) Virtualized elastic deployment technology: the virtualization technology is flexibly deployed, and an X86 universal server is used for distributed computation, parallel computation, utility computation, network storage, virtualization, load balancing, hot backup redundancy and the like, so that ultra-large scale, virtual flexibility, high reliability, universality and high expandability are realized. By adopting the fusion technology, the virtualized deployment and the traditional hardware deployment are fused, and all service modules are deployed in a virtualized mode, so that the compatibility and high quality of hardware equipment can be ensured while the rapid deployment of the virtualized MCU and the rapid online of a service system are realized.

4) QoE collaboration SDN intelligent routing architecture: the MCU supports a cluster resource pool architecture, load balance and multiple-activity backup are carried out among the MCUs in the resource pool, the network route is cooperatively regulated by a software defined network according to QoE requirements and the current MCU resource condition, and the terminal is automatically switched into the MCU with the optimal resources in the same domain.

5) Secure encryption technology: the security policies such as conference password, host password, conference lock and the like are provided by adopting an encryption mechanism to realize the security of all directions such as communication, transmission, user data, content archiving and the like.

The architecture standard of the bank hybrid cloud conference service system of the embodiment of the invention is as follows:

And (3) integrated design: the cloud video platform is designed integrally, and unified specifications and standards are provided for video access of all levels of units. Total line distribution type deployment: according to the embodiment of the invention, all components of the total split type multi-place cluster deployment architecture support cluster deployment, and single-point fault risks are avoided. Intelligent access: based on the cloud video platform distributed and deployed by the total branches, the data center of the total branches and each branch have video service access capability, the video conference is intelligently accessed nearby, the network can rapidly and autonomously use video services, and the supporting capability of on-demand use and available anytime and anywhere is achieved.

The performance index of the bank hybrid cloud conference service system provided by the embodiment of the invention is as follows:

stability index: the system needs to be deployed by adopting financial hybrid cloud, has the functions of elastic capacity expansion, load balancing and dynamic switching, and ensures that 7×24 hours of uninterrupted operation is ensured, and the fault recovery time is less than or equal to 10 minutes.

The concurrency index is as follows: and 300000 user registration is supported, 5000 high-definition video concurrency is supported, and the system covers the access of audio and video of all relevant units (departments) of the head office, branch office and directly affiliated units, branch office and network points.

Video indexes: the code stream supports 512kbps-100Mbps regulation, the frame rate supports 0-60fps regulation, and the method can be applied in different bandwidth environments matched with clients.

Network index: the QoE bandwidth self-adaption capability is provided. When the video network bandwidth is occupied, the system can automatically reduce the resolution and the frame rate according to the current network bandwidth; when the video network bandwidth is restored, the system can automatically restore to the resolution and frame rate when the bandwidth is not squeezed. The network packet loss resistance capability is provided.

The following describes each part of the bank hybrid cloud conference service system according to the embodiment of the invention:

in one embodiment, a conference terminal may include: one or any combination of hardware conference equipment, PC terminals, web terminals, ios terminals and Android terminals.

In one embodiment, the total service cluster may further include: a main service server, a media management server and an intermediate file management server; the main service server is used for establishing a conference according to the conference request; accessing a conference terminal into a conference; providing conference service, media forwarding, intelligent routing and data backup service; transmitting a file generated by the conference to an intermediate file management server; the media management server is used for judging the type of the conference terminal, and when the conference terminal is a first type terminal, the total media server is called to forward the media stream generated by the conference to the conference terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; when the conference terminal is an internet terminal, forwarding a media stream generated by the conference to a three-party cloud platform; and the intermediate file management server is used for receiving the file.

As shown in fig. 1, the main service server is a main service (server) in the total service cluster; the media management server is the media management (server) in the total service cluster; the intermediate file management server is an intermediate piece in the total service cluster. The total service cluster may also include other services (servers) to assist in providing part of the functionality of the conference.

In this embodiment, a server with a large occupied flow, such as a media server, is deployed locally in each branch, and other resources can be deployed in a headquarter, where a headquarter intranet terminal accesses a headquarter data center media service cluster, and a media stream of the branching intranet terminal accesses a branch local media service cluster. All internet media servers are deployed on the three-party cloud platform, and the media flow of the internet client is borne by the three-party cloud platform. The three-party cloud platform is connected with the data center through a special line to perform media cascading, as shown in fig. 1.

In one embodiment, the main service server is a layered architecture, loose coupling of the system is realized through the design of the layered architecture, the reliability of the system is improved through the loose coupling design, and the complexity and the dependence among the sub-integers are reduced. As shown in fig. 2, the main service server may include: an equipment access layer for accessing a conference terminal to a conference, comprising: traditional video conference equipment access, PC (Windows, mac) client access, web client, mobile (IOS, android) client access; the application management layer can be divided into four business modules, and is used for providing conference service functions, and comprises: conference management, conference control, statistics management, conference resource management functions; the meeting management module can create meetings, meeting notifications, post-meeting tracking, meeting lists, meeting approval, meeting inspection, meeting calendars, and the like; the conference control module can be provided with a main seat, picture polling, one-key split-screen, person-pulling conference entering, code scanning sign-in and the like; the conference resource management module can perform conference terminal management, conference room management, conference templates, address books, conference resource visualization, conference summary and the like; the design management module can perform equipment statistics, conference duration statistics, visual display and the like. The system management layer comprises various background infrastructures for carrying audio and video communication and provides services such as media forwarding, fusion, intelligent routing, data backup, user authentication, role authority management, conference grading and dividing, equipment log, user operation log and the like; the system management layer can comprise one or any combination of a user database, a media database and a file database, and is used for storing various core data of system service and providing highly safe redundancy backup measures.

In this embodiment, the functions of the conference established by the main service server may include: (1) The multi-terminal access supports the networks such as company information intranet, information extranet, 4G, 5G, WIFI and the like, realizes the access to the multi-type terminals such as PC, pad, smart phone, audio-video conference terminal and the like, and supports the operating systems of IOS, android, windows, web and the like in different versions. (2) Real-time audio and video interaction provides high-definition video and no-delay voice call, video supports 1080P and 4K, and high-quality video conference effect is provided. (3) Desktop sharing, supporting modes such as screen sharing, screen selected area sharing, application program sharing and the like, pushing pictures of important application systems such as unified video monitoring, security risk management and control and the like to a remote participant computer for display. (4) The document demonstration module supports independent document demonstration modules, supports the advanced uploading of various types of documents, and can make annotation operation on any page in the shared document. (5) The audio-video synchronous playing supports the synchronous playing of the multimedia files in any standard format to other participants. (6) The file distribution supports the downloading and uploading of the files to be distributed to the file transfer station in the video conference process, and participants can freely download the files at the file transfer station, so that the application of the conference is facilitated. (7) Electronic roll calling is supported, a conference host can check the report situation, and meanwhile, the system can export and store roll calling results locally. (8) Text communication, supporting private chat and group chat, and supporting sending of text, standard definition, pictures and websites. (9) Simultaneous interpretation, supporting simultaneous conference in multiple languages. (10) Electronic sign-in is supported, the conference participants click the sign-in, and the conference moderator can check the sign-in condition. (11) And the conference notification is uniformly sent to the participants, and the participants directly enter the conference according to the link or conference number in the notification. (12) The conference calendar displays past, present and future conferences, and can be entered by one key for the conference to the point. (13) The conference template is built by a user, so that the user can conveniently hold a similar conference. (14) The participant feeds back participant information or conference experience feedback.

In this embodiment, the conference established by the main service server also provides the following functions:

conference control: for the ordinary user, provide convenient use and experience, need not special personnel's guarantee and can independently operate, to system management fortune dimension person, provide comprehensive data fortune dimension management tool, reduce the maintenance degree of difficulty and manage and control risk, promote system fortune dimension guarantee level.

And (3) statistical management: and counting and visually displaying video conference equipment, conference times, conference duration and the like.

Docking a platform: support interfacing with an established hardware videoconferencing system. The client supports H.323, H.264 and H.265 protocol calls, is connected with the existing MCU server, and realizes double-flow seamless butt joint with the hardware terminal, thereby solving the compatibility problem of different conference systems.

Financial scene application: real-time multiparty audio-video interaction is realized through the cloud video platform and the access terminal, the requirements of various remote multimedia interactions are met, and the method is widely applied to financial scenes such as trusted double-recording, internal audit interviews, individual credit remote interviews and the like.

In one embodiment, as shown in FIG. 1, a sub-service cluster may include: a media separating server and a fusion server; the media server is used for receiving the media stream sent by the total service cluster and forwarding the media stream to the conference terminal; the fusion server is used for accessing conference terminals which are of the type of simultaneously accessing the cloud video conference terminal and/or the traditional hardware video conference terminal into the conference.

As shown in fig. 1, the sub-media server is a media server (server) in a sub-service cluster; the converged server is a converged service (server) in a sub-service cluster.

In one embodiment, the total service cluster is further configured to: when all conference terminals in a conference are second class terminals, issuing media service rights to a sub-media server; when all conference terminals in a conference are internet terminals, issuing media service rights to a three-party cloud platform; the sub-media server is also used for directly forwarding the media stream generated by the conference to the second class terminal according to the media service authority; and the three-party cloud platform is also used for directly forwarding the media stream generated by the conference to the Internet terminal according to the media service authority.

In one embodiment, the media cascade is performed between the total media server and the media server of the three-party cloud platform through a three-party cloud private line; the total media server and the sub media servers are in media cascading. The media server of the three-party cloud platform is used for receiving the media stream sent by the total service cluster and forwarding the media stream to the conference terminal; and receiving the media service authority sent by the total service cluster, forwarding a media stream generated by the conference to the conference terminal, and reporting the conference statistical data to the main media server through the three-party cloud private line.

As shown in fig. 1, the media server of the three-party cloud platform is a media server (server) in the three-party cloud platform.

In one embodiment, the load balancing CLBs include a first load balancing CLB, a second load balancing CLB; the first load balancing is an intranet load balancing CLB; the second load balancing CLB is a non-bank intranet load balancing CLB; the first class terminals and the second class terminals are used for sending conference requests to the total service cluster through the first load balancing CLB; the internet terminal is used for sending a conference request to the total service cluster through the second load balancing CLB and the high-availability cluster HA agent.

In this embodiment, tcp signaling traffic such as login and calling of the internet terminal still flows to the second load balancing CLB, and the udp media traffic generated by the conference is directly carried by the three-party cloud platform; when the intranet terminal is involved, the open area media service performs udp media stream interaction with the media service of the three-party cloud platform through the cloud private line; when only the internet terminal is involved and records, the recorded file is stored in the open area server, and the media cascade between the open area and the three-party cloud platform through the cloud private line is also required. The open area server manages and requests the core service of issuing the media service of the three-party cloud platform through the private line; meanwhile, the media service of the three-party cloud platform accesses the main open area server through the private line and is used for reporting the conference statistical data.

Fig. 3 is a schematic diagram of a specific example of a bank hybrid cloud conference service system according to an embodiment of the present invention, and a conference media stream according to an embodiment of the present invention is described below with reference to fig. 3 and a specific application scenario.

In fig. 3, a, b, c represent terminal signaling and information management, a represents external internet terminal, service integration terminal and general internet client signaling and information management, b represents office network headquarter, branch terminal signaling and information management, c represents open area main service server, media management server to internet side and branch media server signaling and information management; 1. 2, 5, 6 are media interactions representing media streams; 3. 4 is a media cascade. The scheme is as follows: determining the positions of the terminal and the server according to the information from a, b and c, and designating a media server for media interaction; bandwidth occupation is reduced by media aggregation and concatenation. The following sub-scenes are used for media stream analysis:

scene one: communication between internet terminals:

(1) And (3) judging by the client: the main service server and the media management server send messages, and the main service server and the media management server judge the position of the conference terminal and specify the used media service.

(2) Media interaction: the internet terminal uses the internet "media service" for media interaction, as indicated by the arrow [ 2 ] in fig. 3.

Scene II: communication between the internet terminal and the headquarter terminal:

(1) And (3) judging by the client: the same scene is the first;

(2) Media interaction: after the internet terminal media are converged by the internet side media service, the internet terminal media are cascaded with the AP isolation area media service in a media cascading [ 3 ] mode, so that interaction with office network headquarter conference terminal media is realized, and specific information flows are realized: internet terminal- [ 2 ] internet- & gt media service- & gt 3- & gt open area-media service- & gt 5- & gt office network- & gt headquarter terminal.

Scene III: communication between the branch terminals:

(1) And (3) judging by the client: the same scene is the first;

(2) Media interaction: the branch terminals adopt branch media servers to conduct media interaction, as shown in the figure [ 6 ].

Scene four: the branch terminal communicates with the headquarter terminal:

(1) And (3) judging by the client: the same scene is the first;

(2) Media interaction: the branch side 'media service' gathers the media of the branch terminals, and the media is cascaded with the media service of the open area in a media cascading [ 4 ] mode to realize the media interaction with the terminal of the headquarter, and the specific information flow is as follows: the method comprises the steps of a branch client side [ 6 ], a branch virtual machine, a media service [ 4 ], an open area-media service [ 5 ], an office network and a headquarter client side.

In one embodiment, the total service cluster is further to: when the network bandwidth of the conference is occupied, automatically reducing the resolution and the frame rate according to the network bandwidth of the current conference; when the network bandwidth of the conference is restored, the network bandwidth of the conference is restored to the resolution and the frame rate when the network bandwidth of the conference is not squeezed.

Compared with the traditional cloud video service system, privatization and multi-center deployment and the scheme of fusion of a local video conference and a third-party video conference system in the prior art, the bank mixed cloud conference service system provided by the embodiment of the invention has the advantages that the conference terminal sends a conference request to a total service cluster through a load balancing CLB; the total service cluster receives the conference request and establishes a conference; determining conference level, conference scale and user experience quality QoE; adjusting the routing of the conference according to the conference level, the conference scale and the user quality of experience QoE; judging the type of the conference terminal, and calling a total media server to forward a media stream generated by the conference to the conference terminal when the conference terminal is a first type terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; when the conference terminal is an internet terminal, forwarding a media stream generated by the conference to a three-party cloud platform; the sub-service clusters receive the media stream sent by the total service clusters and forward the media stream to the second class of terminals; the three-party cloud platform receives the media stream sent by the total service cluster, forwards the media stream to the Internet terminal, uses the hybrid cloud network architecture, merges the ultra-large bandwidth resource of the third-party cloud, gives consideration to the high security provided by the private cloud, can provide more stable and higher-quality cloud video conference service, ensures data safety and network safety, reduces construction cost and operation and maintenance cost, uses the quantized QoE value as a network intelligent routing basis, and can realize self-adaptive network routing.

The embodiment of the invention also provides a conference processing method of the bank hybrid cloud conference service system, which is applied to the total service cluster, and fig. 4 is a flow chart of the conference processing method of the bank hybrid cloud conference service system. As shown in fig. 4, the method may include:

step 401, receiving a conference request sent by a conference terminal, and establishing a conference according to the conference request;

step 402, determining conference level, conference scale and user quality of experience QoE;

step 403, adjusting the route of the conference according to the conference level, conference scale and user quality of experience QoE;

step 404, judging the type of the conference terminal, and when the conference terminal is a first type terminal, calling a total media server to forward a media stream generated by the conference to the conference terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; and when the conference terminal is an internet terminal, forwarding the media stream generated by the conference to the three-party cloud platform.

In order to more clearly explain the conference processing method of the bank hybrid cloud conference service system, each step is described in detail below.

In one embodiment, the method may further comprise: when all conference terminals in a conference are second class terminals, issuing media service rights to a sub-media server; and when all conference terminals in a conference are internet terminals, issuing media service rights to the three-party cloud platform.

In one embodiment, the method may further comprise: when the network bandwidth of the conference is occupied, automatically reducing the resolution and the frame rate according to the network bandwidth of the current conference; when the network bandwidth of the conference is restored, the network bandwidth of the conference is restored to the resolution and the frame rate when the network bandwidth of the conference is not squeezed.

It should be noted that although the operations of the method of the present invention are described in a particular order in the above embodiments and the accompanying drawings, this does not require or imply that the operations must be performed in the particular order or that all of the illustrated operations be performed in order to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform.

Having described the method of an exemplary embodiment of the present invention, next, a description is given of a total service cluster in a bank hybrid cloud conference service system of an exemplary embodiment of the present invention with reference to fig. 5.

The implementation of the total service cluster in the bank hybrid cloud conference service system can be referred to the implementation of the method, and the repetition is not repeated. The term "module" or "unit" as used below may be a combination of software and/or hardware that implements the intended function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.

Based on the same inventive concept, the invention also provides a general service cluster in the bank hybrid cloud conference service system, as shown in fig. 5, the device may include:

a receiving module 501, configured to receive a conference request sent by a conference terminal, and establish a conference according to the conference request;

a determining module 502, configured to determine a conference level, a conference scale, and a user quality of experience QoE;

a route adjustment module 503, configured to adjust a route of the conference according to the conference level, the conference scale, and the quality of experience QoE of the user;

the media stream forwarding module 504 is configured to determine a type of a conference terminal, and call the total media server to forward a media stream generated by the conference to the conference terminal when the conference terminal is a first type terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; and when the conference terminal is an internet terminal, forwarding the media stream generated by the conference to the three-party cloud platform.

In one embodiment, the apparatus may further include:

the service authority issuing module is used for issuing media service authority to the sub-media server when all conference terminals in a conference are second class terminals; and when all conference terminals in a conference are internet terminals, issuing media service rights to the three-party cloud platform.

In one embodiment, the apparatus may further include:

the network bandwidth adjusting module is used for automatically reducing resolution and frame rate according to the network bandwidth of the current conference when the network bandwidth of the conference is occupied; when the network bandwidth of the conference is restored, the network bandwidth of the conference is restored to the resolution and the frame rate when the network bandwidth of the conference is not squeezed.

It should be noted that while several modules of the total service cluster in a bank hybrid cloud conference service system are mentioned in the detailed description above, this partitioning is merely exemplary and not mandatory. Indeed, the features and functions of two or more modules described above may be embodied in one module in accordance with embodiments of the present invention. Conversely, the features and functions of one module described above may be further divided into a plurality of modules to be embodied.

Based on the foregoing inventive concept, as shown in fig. 6, the present invention further proposes a computer device 600, including a memory 610, a processor 620, and a computer program 630 stored in the memory 610 and capable of running on the processor 620, where the processor 620 implements the conference processing method of the bank hybrid cloud conference service system when executing the computer program 630.

Based on the foregoing inventive concept, the present invention proposes a computer-readable storage medium storing a computer program which, when executed by a processor, implements the conference processing method of the bank hybrid cloud conference service system described above.

Based on the foregoing inventive concept, the present invention proposes a computer program product comprising a computer program which, when executed by a processor, implements a conference processing method of a bank hybrid cloud conference service system.

Compared with the traditional cloud video service system, privately owned and multi-center deployment and the scheme of fusing a local video conference with a third party video conference system in the prior art, the bank hybrid cloud conference service system, the conference processing method and the device provided by the invention have the advantages that the conference terminal sends a conference request to the total service cluster through the load balancing CLB; the total service cluster receives the conference request and establishes a conference; determining conference level, conference scale and user experience quality QoE; adjusting the routing of the conference according to the conference level, the conference scale and the user quality of experience QoE; judging the type of the conference terminal, and calling a total media server to forward a media stream generated by the conference to the conference terminal when the conference terminal is a first type terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; when the conference terminal is an internet terminal, forwarding a media stream generated by the conference to a three-party cloud platform; the sub-service clusters receive the media stream sent by the total service clusters and forward the media stream to the second class of terminals; the three-party cloud platform receives the media stream sent by the total service cluster, forwards the media stream to the Internet terminal, uses the hybrid cloud network architecture, merges the ultra-large bandwidth resource of the third-party cloud, gives consideration to the high security provided by the private cloud, can provide more stable and higher-quality cloud video conference service, ensures data safety and network safety, reduces construction cost and operation and maintenance cost, uses the quantized QoE value as a network intelligent routing basis, and can realize self-adaptive network routing.

In the technical scheme, the acquisition, storage, use, processing and the like of the data all accord with the relevant regulations of laws and regulations.

It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

Finally, it should be noted that: the above examples are only specific embodiments of the present invention, and are not intended to limit the scope of the present invention, but it should be understood by those skilled in the art that the present invention is not limited thereto, and that the present invention is described in detail with reference to the foregoing examples: any person skilled in the art may modify or easily conceive of the technical solution described in the foregoing embodiments, or perform equivalent substitution of some of the technical features, while remaining within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention, and are intended to be included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A bank hybrid cloud conference service system, comprising:

2. The system of claim 1, wherein the total service cluster further comprises: a main service server, a media management server and an intermediate file management server;

the main service server is used for establishing a conference according to the conference request; accessing a conference terminal into a conference; providing conference service, media forwarding, intelligent routing and data backup service; transmitting a file generated by the conference to an intermediate file management server;

the media management server is used for judging the type of the conference terminal, and when the conference terminal is a first type terminal, the total media server is called to forward the media stream generated by the conference to the conference terminal; when the conference terminal is a second type terminal, forwarding a media stream generated by the conference to the sub-service cluster; when the conference terminal is an internet terminal, forwarding a media stream generated by the conference to a three-party cloud platform;

and the intermediate file management server is used for receiving the file.

3. The system of claim 2, wherein the main service server is a hierarchical architecture comprising:

The device access layer is used for accessing the conference terminal into the conference;

an application management layer for providing conference service functions, comprising: conference management, conference control, statistics management, conference resource management functions;

the system management layer comprises various background infrastructures for carrying audio and video communication and provides services of media forwarding, fusion, intelligent routing and data backup; the system management layer comprises one or any combination of a user database, a media database and a file database.

4. The system of claim 1, wherein the sub-service cluster comprises: a media separating server and a fusion server;

the media server is used for receiving the media stream sent by the total service cluster and forwarding the media stream to the conference terminal;

and the fusion server is used for accessing the conference terminal with the type of the cloud video conference terminal and/or the traditional hardware video conference terminal into the conference.

5. The system of claim 4, wherein the total service cluster is further configured to: when all conference terminals in a conference are second class terminals, issuing media service rights to a sub-media server; when all conference terminals in a conference are internet terminals, issuing media service rights to a three-party cloud platform;

The sub-media server is also used for directly forwarding the media stream generated by the conference to the second class terminal according to the media service authority;

and the three-party cloud platform is also used for directly forwarding the media stream generated by the conference to the Internet terminal according to the media service authority.

6. The system of claim 4, wherein the media cascading is performed between the master media server and the media servers of the three-party cloud platform through a three-party cloud private line; the total media server and the sub media servers are subjected to media cascading;

the media server of the three-party cloud platform is used for receiving the media stream sent by the total service cluster and forwarding the media stream to the conference terminal; and receiving the media service authority sent by the total service cluster, forwarding a media stream generated by the conference to the conference terminal, and reporting the conference statistical data to the main media server through the three-party cloud private line.

7. The system of claim 1, wherein the load balancing CLBs comprise a first load balancing CLB, a second load balancing CLB; the first load balancing is an intranet load balancing CLB; the second load balancing CLB is a non-bank intranet load balancing CLB;

the first class terminals and the second class terminals are used for sending conference requests to the total service cluster through the first load balancing CLB;

The internet terminal is used for sending a conference request to the total service cluster through the second load balancing CLB and the high-availability cluster HA agent.

8. The system of claim 1, wherein the conference terminal comprises: one or any combination of hardware conference equipment, PC terminals, web terminals, ios terminals and Android terminals.

9. The system according to claim 1, characterized by a total service cluster, in particular for: when the network bandwidth of the conference is occupied, automatically reducing the resolution and the frame rate according to the network bandwidth of the current conference; when the network bandwidth of the conference is restored, the network bandwidth of the conference is restored to the resolution and the frame rate when the network bandwidth of the conference is not squeezed.

10. A conference processing method of a bank hybrid cloud conference service system according to any of claims 1 to 9, applied to a total service cluster, comprising:

determining conference level, conference scale and user experience quality QoE;

11. The method as recited in claim 10, further comprising:

when all conference terminals in a conference are second class terminals, issuing media service rights to a sub-media server; and when all conference terminals in a conference are internet terminals, issuing media service rights to the three-party cloud platform.

12. The method as recited in claim 10, further comprising:

when the network bandwidth of the conference is occupied, automatically reducing the resolution and the frame rate according to the network bandwidth of the current conference; when the network bandwidth of the conference is restored, the network bandwidth of the conference is restored to the resolution and the frame rate when the network bandwidth of the conference is not squeezed.

13. A total service cluster in a bank hybrid cloud conference service system according to any of claims 1 to 9, comprising:

14. The total service cluster of claim 13, further comprising:

15. The total service cluster of claim 13, further comprising:

16. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of any of claims 10 to 12 when executing the computer program.

17. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements the method of any of claims 10 to 12.

18. A computer program product, characterized in that the computer program product comprises a computer program which, when executed by a processor, implements the method of any of claims 10 to 12.