WO2024055800A1 - 一种基于数字换流站的监控系统及方法 - Google Patents

一种基于数字换流站的监控系统及方法 Download PDF

Info

Publication number
WO2024055800A1
WO2024055800A1 PCT/CN2023/113310 CN2023113310W WO2024055800A1 WO 2024055800 A1 WO2024055800 A1 WO 2024055800A1 CN 2023113310 W CN2023113310 W CN 2023113310W WO 2024055800 A1 WO2024055800 A1 WO 2024055800A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
video fusion
user
monitoring
vip
Prior art date
Application number
PCT/CN2023/113310
Other languages
English (en)
French (fr)
Inventor
金炜
王庆
郭贤珊
吕军
刘思源
张祥
王言国
张展国
王海峰
童充
李明
程炜
赵宁
陈州
侯晓钧
赵汉卿
Original Assignee
国家电网有限公司
国网经济技术研究院有限公司
南京南瑞继保电气有限公司
许继集团有限公司
国电南瑞科技股份有限公司
北京国网信通埃森哲信息技术有限公司
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 国家电网有限公司, 国网经济技术研究院有限公司, 南京南瑞继保电气有限公司, 许继集团有限公司, 国电南瑞科技股份有限公司, 北京国网信通埃森哲信息技术有限公司, 华为技术有限公司 filed Critical 国家电网有限公司
Priority to EP23825364.5A priority Critical patent/EP4362456A1/en
Priority to AU2023296339A priority patent/AU2023296339A1/en
Publication of WO2024055800A1 publication Critical patent/WO2024055800A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing

Definitions

  • This application relates to the field of data processing technology, and in particular to a monitoring system and method based on digital converter stations.
  • the power system achieves remote management by adopting a three-level system architecture of "headquarters-province-station".
  • "headquarters” can refer to the headquarters of the power grid system
  • "province” can refer to the provincial-level unit of the power grid system.
  • “Station” can refer to a converter station.
  • the three-level architecture is required to have multiple capabilities to achieve multiple functions so that the power system can be managed comprehensively and efficiently and meet the diverse functional requirements of the power system.
  • users can flexibly access video images at the power grid system headquarters, provincial units of the power grid system, and converter stations, and apply existing video fusion and remote calling technologies.
  • a three-level remote access mode is adopted. The specific implementation process is as follows:
  • the video fusion rendering engine has video processing, three-dimensional processing , video fusion rendering and interaction capabilities;
  • maintaining user sessions between the remote end and the station end requires a large amount of software, hardware and network bandwidth resources, while video fusion is all completed on the station end, and the three-dimensional video fusion rendering requires CPU, GPU, etc.
  • Computing resources various data information resources are needed in the video fusion process.
  • the acquisition process of information resources also requires computing resources and network bandwidth resources, and the station end passes the user Pushing video fusion interactive images to the remote end through sessions also requires a large amount of network bandwidth resources.
  • the computing resources and network bandwidth resources at the station are limited and can only support concurrent access by a certain number of users.
  • the computing resources and network bandwidth resources consumed by video fusion applications will increase with the increase in the number of users, causing serious problems.
  • the remote end and the station end are generally far apart, up to thousands of kilometers away, and data needs to be transmitted through multi-level network equipment, therefore, the data transmission delay, network equipment delay and network layer complexity
  • the network delay caused by factors such as remote viewing of video images cannot be ignored.
  • the transmission delay, sending delay and queuing delay are all uncontrollable, which makes the network delay uncertain.
  • the video screen becomes stuck and packets are lost, resulting in inconsistent user experience at three different locations: the power grid system headquarters, the power grid system provincial unit, and the converter station.
  • the purpose of the embodiments of this application is to provide a monitoring system and method based on digital converter stations.
  • various functional modules, especially video fusion processing modules on monitoring terminals at all levels, the monitoring terminals at all levels can respond locally. There is no need for the station to respond to all monitoring and retrieval requests from users at all levels. Users can directly view the video fusion images locally without accessing from the remote end, thus enabling the system to operate under the premise of limited network bandwidth resources. This effectively reduces network latency, improves the real-time display of video images, and improves the use effect and user experience of video fusion applications.
  • a monitoring system based on a digital converter station, including a first monitoring terminal deployed on the primary monitoring side, a second monitoring terminal deployed on the secondary monitoring side, and a monitoring terminal deployed on the third level monitoring side.
  • the third monitoring terminal on the level 3 monitoring side; the monitored objects of the monitoring system include the digital converter station deployed on the level 3 monitoring side; the first monitoring terminal, the second monitoring terminal and the third monitoring terminal.
  • Each monitoring terminal includes at least a communication module, a human-computer interaction module, an equipment status monitoring module, an equipment alarm management module, a video fusion processing module and a data transmission control module.
  • the third monitoring terminal also includes a data storage module.
  • the data storage module configured to store digital converter station data;
  • the communication module is configured to implement communication between the first monitoring terminal, the second monitoring terminal and the third monitoring terminal; the equipment status monitoring module is configured to monitor and manage the digital converter station. Ledger information, operation information and monitoring data of all equipment; the equipment alarm management module configuration Set to manage alarm information of all equipment of the digital converter station; the human-computer interaction module is configured to receive monitoring call requests from users on the local monitoring side;
  • Each of the video fusion processing modules is configured to respond to the monitoring call request of the user on the local monitoring side, use the video fusion original data in the digital converter station data to perform video fusion processing, and obtain the user call request for the local monitoring side. Read the video fusion picture;
  • Each of the data transmission control modules is configured to be triggered according to the rate adjustment condition when the preset rate adjustment condition of the service data is triggered during the process of the local monitoring terminal transmitting service data to another monitoring terminal. Adjust the current network bandwidth and minimum delay time detected before, the delay time detected when the rate adjustment condition is triggered, and the delay recovery time configured based on the data type of the service data. The data transmission rate is adjusted to continue transmitting the service data to another monitoring terminal according to the adjusted data transmission rate.
  • the data transmission control module when the preset rate adjustment condition of the service data is triggered, adjusts the rate before the rate adjustment condition is triggered.
  • the detected network available bandwidth and minimum delay time, the delay time detected when the rate adjustment condition is triggered, and the delay recovery time configured based on the data type of the service data are used to adjust the current data of the service data Transmission rate to continue transmitting the service data to another monitoring terminal according to the adjusted data transmission rate, specifically including:
  • the data transmission control module obtains the data detected before the rate adjustment condition is triggered when the preset rate adjustment condition of the service data is triggered.
  • the available network bandwidth S0 and the minimum delay time RTT0, the delay time RTT2 detected when the rate adjustment condition is triggered, and the delay recovery time t configured based on the data type of the service data;
  • the data transmission control module adjusts the current data transmission rate of the service data according to the rate adjustment target value S2' to obtain the adjusted data transmission rate S0', and the adjusted data transmission rate S0' satisfies S0' ⁇ S2 ', and continue to transmit the service data to another monitoring terminal according to the adjusted data transmission rate S0'.
  • the delayed recovery time is obtained by the data transmission control module querying a preset delayed recovery schedule according to the data type of the business data; wherein the delayed recovery timetable includes at least one type of data Type and its corresponding configured delayed recovery time. The higher the priority of the business data corresponding to each data type, the smaller the corresponding configured delayed recovery time.
  • the third monitoring terminal also includes a fault wave recording management module, a data report management module, a digital station area management module and a remote intelligent inspection module;
  • the fault wave recording management module is configured to manage the fault wave recording files of the digital converter station and perform online analysis based on the fault wave recording files;
  • the data report management module is configured to collect statistics on the business data of the digital converter station, display historical data, statistical data and analytical data in different report forms according to the operation and maintenance requirements of the digital converter station, and implement reports Task formulation function, automatic report generation function, report export function and report printing function;
  • the digital station area management module is configured to monitor and manage the security, fire protection and power environment of the digital converter station with the station area of the digital converter station as the main body;
  • the remote intelligent inspection module is configured to control the monitoring device to carry out joint inspection operations of indoor and outdoor equipment, analyze the inspection data, and form inspection results and inspection reports.
  • the digital converter station has unified common components, the common components include business components and data components, and the business components and the data components are configured to provide various application systems of the digital converter station based on Unify and standardize business function interfaces and basic data services, and formulate unified data interaction protocols and data interaction formats to provide a unified data service interface for the third monitoring terminal.
  • the digital converter station has a unified basic application, which is constructed using unified basic software and hardware facilities, unified data models, unified data service specifications and unified application development specifications.
  • the basic applications include site-wide video control applications, site-wide three-dimensional presentation applications, equipment status overview applications, equipment alarm overview applications, fault wave recording management applications, intelligent report management applications, digital station area management applications, and remote intelligent inspections.
  • the whole-site video management and control application and the whole-site three-dimensional rendering application are configured to provide services for the video fusion processing module
  • the equipment status overview application is configured to provide services for the equipment status monitoring module
  • the equipment The alarm overview application is configured to provide services for the equipment alarm management module
  • the fault wave recording management application is configured to provide services for the fault wave recording management module
  • the intelligent report management application is configured to provide services for the data report management module.
  • the digital station area management application is configured to provide services for the digital station area management module
  • the remote intelligent inspection application is configured to provide services for the remote intelligent inspection module.
  • the user on the first-level monitoring side is regarded as the first user, and the video fusion processing module of the first monitoring terminal is used as the first video fusion processing module;
  • the first video fusion processing module is also configured to perform user rights management on the first user to configure the first user as a first ordinary user or a first VIP user; wherein the first ordinary user is The first VIP user is configured to have the authority to view the video fusion picture of the designated monitored area of the digital converter station, and the first VIP user is configured to have the authority to view the video fusion picture of all monitored areas of the digital converter station;
  • the first video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user call request for the local monitoring side.
  • Read the video fusion picture including:
  • the first video fusion processing module responds to the monitoring call request of the first ordinary user, and obtains the specified data from the digital converter station data. Obtain the original video fusion data of the area to be viewed from the original video fusion data of the monitoring area, and use the computing resources of the first monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, to obtain the original video fusion data for the first common area.
  • the video fusion screen viewed by the user.
  • the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module. management module;
  • the first video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user call request for the local monitoring side.
  • the video fusion picture you read also includes:
  • the first video fusion processing module When the first user is the first VIP user, the first video fusion processing module responds to the monitoring call request of the first VIP user and sends the first video fusion processing module to the third video fusion processing module. request, the first video fusion request includes an identification of the area to be viewed;
  • the third video fusion processing module obtains the original video fusion data of all monitored areas in the digital converter station data to be viewed based on the area identification to be viewed in the first video fusion request.
  • the original video fusion data of the area is used, and the computing resources of the third monitoring terminal are used to perform video fusion processing on the original video fusion data of the area to be viewed, and the video fusion picture for the first VIP user is obtained and sent to the The first video fusion processing module;
  • the first video fusion processing module receives and obtains the video fusion picture for the first VIP user to call.
  • the user on the secondary monitoring side is used as the second user, and the video fusion processing module of the second monitoring terminal is used as the second video fusion processing module;
  • the second video fusion processing module is also configured to perform user rights management on the second user to configure the second user as a second ordinary user or a second VIP user; wherein the second ordinary user is The second VIP user is configured to have the authority to view the video fusion picture of the designated monitored area of the digital converter station, and the second VIP user is configured to have the authority to view the video fusion picture of all monitored areas of the digital converter station;
  • the second video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user call request for the local monitoring side.
  • Read the video fusion picture including:
  • the second video fusion processing module responds to the monitoring call request of the second ordinary user, and obtains the specified data from the digital converter station data.
  • the video fusion screen viewed by the user.
  • the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module
  • the second video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user call request for the local monitoring side.
  • the video fusion picture you read also includes:
  • the second video fusion processing module responds to the monitoring call request of the second VIP user and sends a second video fusion processing module to the third video fusion processing module.
  • the second video fusion request includes an identification of the area to be viewed;
  • the third video fusion processing module obtains the original video fusion data of all monitored areas in the digital converter station data to be viewed based on the area identification to be viewed in the second video fusion request.
  • Regional video fusion raw data, and use the computing resources of the third monitoring terminal Perform video fusion processing on the original video fusion data of the area to be viewed, obtain a video fusion picture for the second VIP user to access, and send it to the second video fusion processing module;
  • the second video fusion processing module receives and obtains the video fusion picture for the second VIP user to call.
  • the user on the third-level monitoring side is regarded as the third user, and the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module;
  • the third video fusion processing module is also configured to perform user rights management on the third users, so as to configure the third users as third VIP users; wherein the third VIP users are configured to have rights View the video fusion images of all monitored areas of the digital converter station;
  • the third video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user call request for the local monitoring side.
  • Read the video fusion picture including:
  • the third video fusion processing module responds to the monitoring call request of the third VIP user, and obtains all the data from the digital converter station data. Obtain the original video fusion data of the area to be viewed from the original video fusion data of the monitoring area, and use the computing resources of the third monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, and obtain the original video fusion data for the third VIP The video fusion screen viewed by the user.
  • the second monitoring terminal is used as a data sending end and the first monitoring terminal is used as a data receiving end, or the third monitoring terminal is used as a data sending end and the second monitoring terminal is used as a data receiving end. ;
  • the data sending end further includes a network detection module; the network detection module is configured to perform network bandwidth detection regularly to detect the available network bandwidth and minimum delay between the data sending end and the corresponding data receiving end. time, and when each detection is completed, only the last detected network available bandwidth and minimum delay time are recorded, so that when video convergence service data needs to be transmitted to the corresponding data receiving end, the network can be used according to the currently recorded network bandwidth.
  • the available bandwidth determines the initial data transmission rate of video convergence service data.
  • the network detection module periodically performs network bandwidth detection to detect the available network bandwidth and minimum delay time between the data sending end and the corresponding data receiving end, specifically including:
  • Text sending rate
  • the network detection module When the network detection module first determines that the RTT value increases, the time point when the RTT value increases is recorded as T1, and the time point when the last RTT value before T1 remains unchanged is recorded as T0, the minimum delay time is determined according to the RTT value corresponding to T0, and the network available bandwidth between the data sending end and the corresponding data receiving end is determined according to the last message sending rate before T1.
  • each time the network detection module performs network bandwidth detection it sends detection messages to the corresponding data receiving end in sequence according to the increasing message sending rate, specifically including:
  • the network detection module sets a rate adjustment threshold according to the upper limit of available bandwidth, and adjusts the In the process of sequentially sending detection messages to the corresponding data receiving end with an increasing message sending rate, when the message sending rate is less than the rate adjustment threshold, according to the first increasing amplitude, the increasing message sending rate is sequentially sent to the corresponding data receiving end.
  • the corresponding data receiving end sends a detection message.
  • detection messages are sent to the corresponding data receiving end in sequence according to the second increasing amplitude and the increasing message sending rate. Text; wherein, the first increasing amplitude is greater than the second increasing amplitude.
  • the data transmission control module is also configured to enter the first transmission stage, the second transmission stage and the third transmission stage of the data transmission process in sequence when the local monitoring terminal needs to transmit video convergence service data to another monitoring terminal. Until the data transmission is completed, the data transmission process ends;
  • the first transmission stage obtain the network available bandwidth and minimum delay time currently recorded by the local network detection module, and determine the initial data transmission rate of the video fusion service data according to the obtained network available bandwidth, so as to determine the initial data transmission rate of the video fusion service data according to the obtained network available bandwidth.
  • the initial data transmission rate begins to transmit video convergence service data to another monitoring terminal until it is determined that the preset rate adjustment condition is triggered, and then the second transmission stage is entered; wherein the rate adjustment condition is the first determination that the RTT value increases reaches the preset delay time threshold, or receives a packet loss report for the first time;
  • the delay time detected when the rate adjustment condition is triggered based on the obtained network available bandwidth and minimum delay time, the delay time detected when the rate adjustment condition is triggered, and the data type and monitoring call requesting user based on the video convergence service data
  • the target delay recovery time configured for the user type, adjust the current data transmission rate of the video convergence service data to continue transmitting the video convergence service data to another monitoring terminal according to the adjusted data transmission rate until it is determined that the rate adjustment condition is
  • the third transmission stage is entered;
  • the local network detection module is triggered to perform network bandwidth detection to detect and record local monitoring
  • the network available bandwidth and minimum delay time between the terminal and another monitoring terminal are obtained, and the network available bandwidth and minimum delay time currently recorded by the local network detection are obtained, and the data of the video fusion service data is determined based on the obtained network available bandwidth.
  • transmission rate and continue to transmit video convergence service data to another monitoring terminal according to the determined data transmission rate, until it is determined that the rate adjustment condition is triggered, and then returns to the second transmission stage.
  • the target delay recovery time is obtained by querying the preset delay recovery schedule according to the data type of the video fusion service data and the user type of the monitoring call requesting user by the data transmission control module; wherein, the delay recovery time is
  • the time recovery schedule includes at least one data type, a user type corresponding to each data type, and a configured delay recovery time corresponding to each user type.
  • the data type includes video convergence service data
  • the user type includes For ordinary users and VIP users, the higher the priority of the business data corresponding to each data type, the smaller the corresponding configured delayed recovery time.
  • the corresponding configured delayed recovery time for ordinary users It is greater than the delayed recovery time corresponding to the VIP user configuration.
  • the delay time threshold is set according to the currently recorded minimum delay time.
  • the user on the first-level monitoring side is regarded as the first user
  • the user on the second-level monitoring side is regarded as the second user
  • the user on the third-level monitoring side is regarded as the third user
  • the user on the first monitoring terminal is The video fusion processing module serves as the first video fusion processing module.
  • the video fusion of the second monitoring terminal The processing module serves as the second video fusion processing module
  • the video fusion processing module of the third monitoring terminal serves as the third video fusion processing module
  • the second monitoring terminal also includes a second network detection module
  • the third monitoring terminal also Includes a third network detection module;
  • the first video fusion processing module is also configured to perform user rights management on the first user to configure the first user as a first ordinary user or a first VIP user;
  • the second video fusion processing module is also configured to perform user rights management on the second user to configure the second user as a second ordinary user or a second VIP user;
  • the third video fusion processing module is also configured to perform user rights management on the third users, so as to configure all the third users as third VIP users;
  • the second network detection module is configured to periodically perform network bandwidth detection to detect the available network bandwidth between the second monitoring terminal and the first monitoring terminal, and send the currently detected first network available bandwidth to the The first video fusion processing module;
  • the third network detection module is configured to perform network bandwidth detection regularly to detect the available network bandwidth between the third monitoring terminal and the second monitoring terminal, and send the currently detected second network available bandwidth to The first video fusion processing module;
  • the first video fusion processing module is further configured to adjust the number of the first VIP users or/and the number of the second VIP users according to the available bandwidth of the first network and the available bandwidth of the second network;
  • the first ordinary user and the second ordinary user are configured to have permission to view the video fusion picture of the designated monitored area of the digital converter station, and the first VIP user and the second VIP user And the third VIP user is configured to have permission to view the video fusion pictures of all monitored areas of the digital converter station.
  • the first video fusion processing module adjusts the number of first VIP users or/and the number of second VIP users according to the available bandwidth of the first network and the available bandwidth of the second network, specifically including: :
  • the first video fusion processing module adjusts the number of the second VIP users according to the available bandwidth of the first network and the number of the second VIP users.
  • the first remaining network bandwidth is obtained from two network available bandwidths, the network bandwidth occupied by the first ordinary user and the basic number of network bandwidths occupied by the second VIP users, and the first VIP is adjusted according to the first remaining network bandwidth. number of users;
  • the first video fusion processing module adjusts the number of the second VIP users according to the available bandwidth of the first network and the number of the first VIP users.
  • the second remaining network bandwidth is obtained from two network available bandwidths, the network bandwidth occupied by the first ordinary user and the basic number of network bandwidths occupied by the first VIP users, and the second VIP is adjusted according to the second remaining network bandwidth. number of users;
  • the first video fusion processing module When the first video fusion processing module needs to adjust the number of first VIP users and the number of second VIP users at the same time, the first video fusion processing module adjusts the first network available bandwidth, the second network available bandwidth and the The network bandwidth occupied by the first ordinary user obtains the third remaining network bandwidth, and the number of the first VIP users and the number of the second VIP users are adjusted according to the third remaining network bandwidth.
  • the first video fusion processing module adjusts the number of first VIP users according to the first remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the first remaining network bandwidth is greater than a preset first bandwidth threshold. If so, configure at least M first users as the first VIP users; if not, Then release the network bandwidth occupied by the first ordinary user, and configure at least M first users as the first VIP users according to the first remaining network bandwidth and the network bandwidth occupied by the first ordinary user;
  • M represents the basic number of first VIP users that need to be maintained, M ⁇ 1, and the first bandwidth threshold is set according to the network bandwidth occupied by the M first VIP users.
  • the first video fusion processing module adjusts the number of first VIP users according to the first remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the first remaining network bandwidth is greater than the network bandwidth occupied by one of the first VIP users, and if so, configures at least one of the first users as the first VIP user; If not, configure all first users as first ordinary users.
  • the first video fusion processing module adjusts the number of second VIP users according to the second remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the second remaining network bandwidth is greater than a preset second bandwidth threshold, and if so, sends a VIP user addition instruction to the second video fusion processing module; if not, sends a VIP user addition instruction to the second video fusion processing module.
  • the second video fusion processing module sends a normal user disabling instruction;
  • the second video fusion processing module configures at least N second users as the second VIP users according to the VIP user adding instruction, or releases the occupation of the second ordinary users according to the ordinary user disabling instruction. network bandwidth, and configure at least N second users as the second VIP users according to the second remaining network bandwidth and the network bandwidth occupied by the second ordinary users;
  • N represents the basic number of second VIP users that need to be maintained, N ⁇ 1, and the second bandwidth threshold is set according to the network bandwidth occupied by N second VIP users.
  • the first video fusion processing module adjusts the number of second VIP users according to the second remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the second remaining network bandwidth is greater than the network bandwidth occupied by one of the second VIP users, and if so, sends a VIP user addition instruction to the second video fusion processing module; if not , then send a VIP user reduction instruction to the second video fusion processing module;
  • the second video fusion processing module configures at least one of the second users as the second VIP user according to the VIP user increase instruction, or configures all the second users according to the VIP user decrease instruction. Be the second ordinary user.
  • the first video fusion processing module adjusts the number of first VIP users and the number of second VIP users according to the third remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the third remaining network bandwidth is greater than a preset third bandwidth threshold, and if so, configures at least M first users as the first VIP users, and provides The second video fusion processing module sends a VIP user increase instruction; if not, the network bandwidth occupied by the first ordinary user is released. According to the third remaining network bandwidth and the network bandwidth occupied by the first ordinary user, at least M first users are configured as the first VIP users, and send ordinary user disabling instructions to the second video fusion processing module;
  • the second video fusion processing module converts at least the N-th ones according to the VIP user adding instruction.
  • the second user is configured as the second VIP user, or the network bandwidth occupied by the second ordinary user is released according to the ordinary user disabling instruction, and the network bandwidth occupied by the second ordinary user is released according to the third remaining network bandwidth and the network occupied by the second ordinary user.
  • the bandwidth configures at least N second users as the second VIP users;
  • M represents the basic number of the first VIP users that need to be maintained, M ⁇ 1, and N represents the basic number of the second VIP users that need to be maintained, N ⁇ 1, and the third bandwidth threshold is based on M
  • the network bandwidth occupied by the first VIP user and the network bandwidth occupied by the N second VIP users are set.
  • the increased number of first VIP users is not less than the increased number of second VIP users. quantity.
  • embodiments of the present application also provide a monitoring method based on a digital converter station.
  • the method is suitable for any of the above-mentioned monitoring systems based on a digital converter station.
  • the monitoring system includes a deployment The first monitoring terminal on the first-level monitoring side, the second monitoring terminal deployed on the second-level monitoring side and the third monitoring terminal deployed on the third-level monitoring side; the monitored objects of the monitoring system include those deployed on the third-level monitoring system.
  • the first monitoring terminal, the second monitoring terminal and the third monitoring terminal all include at least a communication module, a human-computer interaction module, an equipment status monitoring module, an equipment alarm management module, a video Fusion processing module and data transmission control module, the third monitoring terminal also includes a data storage module, the data storage module is configured to store digital converter station data; the method includes:
  • Communication between the first monitoring terminal, the second monitoring terminal and the third monitoring terminal is realized through the communication module; all equipment of the digital converter station is monitored and managed through the equipment status monitoring module Account information, operation information and monitoring data; manage the alarm information of all equipment of the digital converter station through the equipment alarm management module; receive monitoring and access requests from users on the local monitoring side through the human-computer interaction module ;
  • Each of the video fusion processing modules responds to the monitoring access request of the user on the local monitoring side, and uses the original video fusion data in the digital converter station data to perform video fusion processing to obtain the user access for the local monitoring side.
  • each of the data transmission control modules in the process of transmitting service data from a local monitoring terminal to another monitoring terminal, when the preset rate adjustment condition of the service data is triggered, according to the rate adjustment condition before being triggered, The detected network available bandwidth and minimum delay time, the delay time detected when the rate adjustment condition is triggered, and the delay recovery time configured based on the data type of the service data are used to adjust the current data of the service data transmission rate to continue transmitting the service data to another monitoring terminal according to the adjusted data transmission rate.
  • the rate adjustment condition is triggered according to the rate adjustment condition. Adjust the current network bandwidth and minimum delay time detected before, the delay time detected when the rate adjustment condition is triggered, and the delay recovery time configured based on the data type of the service data.
  • Data transmission rate to continue transmitting the service data to another monitoring terminal according to the adjusted data transmission rate specifically including:
  • the data transmission control module adjusts the current data transmission rate of the service data according to the rate adjustment target value S2' to obtain the adjusted data transmission rate S0', and the adjusted data transmission rate S0' satisfies S0' ⁇ S2', continue to transmit the service data to another monitoring terminal according to the adjusted data transmission rate S0'.
  • the delayed recovery time is obtained by the data transmission control module querying a preset delayed recovery schedule according to the data type of the business data; wherein the delayed recovery timetable includes at least one type of data Type and its corresponding configured delayed recovery time. The higher the priority of the business data corresponding to each data type, the smaller the corresponding configured delayed recovery time.
  • the user on the first-level monitoring side is used as the first user, and the video fusion processing module of the first monitoring terminal is used as the first video fusion processing module; the method also includes:
  • User rights management is performed on the first user through the first video fusion processing module to configure the first user as a first ordinary user or a first VIP user; wherein the first ordinary user is configured as Have the authority to view the video fusion picture of the designated monitored area of the digital converter station, and the first VIP user is configured to have the authority to view the video fusion picture of all monitored areas of the digital converter station;
  • the first video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user information for the local monitoring side.
  • the video fusion images retrieved include:
  • the specified data in the digital converter station data is Obtain the original video fusion data of the area to be viewed from the original video fusion data of the monitored area, and use the computing resources of the first monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, and obtain the original video fusion data for the area to be viewed.
  • Video fusion images accessed by ordinary users.
  • the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module
  • the first video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user information for the local monitoring side.
  • the video fusion images recalled also include:
  • the first video fusion processing module When the first user is the first VIP user, the first video fusion processing module responds to the monitoring call request of the first VIP user and sends a third video fusion processing module to the third video fusion processing module.
  • a video fusion request, the first video fusion request includes an identification of the area to be viewed;
  • the third video fusion processing module obtains the original video fusion data of all monitored areas in the digital converter station data according to the area identification to be viewed in the first video fusion request. View the original video fusion data of the area, and use the computing resources of the third monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, obtain the video fusion picture for the first VIP user and send it to The first video fusion processing module;
  • the first video fusion processing module receives and obtains the video fusion picture for the first VIP user to call.
  • the user on the first-level monitoring side is regarded as the first user
  • the user on the second-level monitoring side is regarded as the second user
  • the user on the third-level monitoring side is regarded as the third user
  • the user on the first monitoring terminal is
  • the video fusion processing module serves as the first video fusion processing module
  • the video fusion processing module of the second monitoring terminal serves as the second video fusion processing module
  • the video fusion processing module of the third monitoring terminal serves as the third video fusion processing module
  • the second monitoring terminal further includes a second network detection module
  • the third monitoring terminal further includes a third network detection module
  • the method further includes:
  • the second network detection module periodically performs network bandwidth detection to detect the available network bandwidth between the second monitoring terminal and the first monitoring terminal, and sends the currently detected first network available bandwidth to the first monitoring terminal.
  • the first video fusion processing module ;
  • the third network detection module periodically performs network bandwidth detection to detect the network available bandwidth between the third monitoring terminal and the second monitoring terminal, and sends the currently detected second network available bandwidth to the The first video fusion processing module;
  • the first ordinary user and the second ordinary user are configured to have permission to view the video fusion picture of the designated monitored area of the digital converter station, and the first VIP user and the second VIP user And the third VIP user is configured to have permission to view the video fusion pictures of all monitored areas of the digital converter station.
  • adjusting the number of first VIP users or/and the number of second VIP users according to the available bandwidth of the first network and the available bandwidth of the second network specifically includes:
  • the available bandwidth of the first network, the available bandwidth of the second network, and the number of second VIP users need to be kept unchanged.
  • the first network bandwidth is obtained based on the first network available bandwidth, the second network available bandwidth, the network bandwidth occupied by the first ordinary user and the network bandwidth occupied by a basic number of the first VIP users. 2. remaining network bandwidth, adjusting the number of the second VIP users according to the second remaining network bandwidth;
  • the second network available bandwidth and the network bandwidth occupied by the first ordinary user Obtain a third remaining network bandwidth, and adjust the number of first VIP users and the number of second VIP users according to the third remaining network bandwidth.
  • the monitoring system includes a first monitoring terminal deployed on the primary monitoring side, and a first monitoring terminal deployed on the secondary monitoring side.
  • Both the second monitoring terminal and the third monitoring terminal include a communication module, a human-computer interaction module, an equipment status monitoring module, an equipment alarm management module, a video fusion processing module and a data transmission control module.
  • the third monitoring terminal also includes a data storage module.
  • each of the video fusion processing modules is configured to respond to a monitoring call request from a user on the local monitoring side, use the original video fusion data in the digital converter station data to perform video fusion processing, and obtain information for local monitoring.
  • the video fusion picture viewed by the user on the side; each of the data transmission control modules is configured to transmit business data from a local monitoring terminal to another monitoring terminal when the preset rate adjustment condition of the business data is triggered.
  • the processing module allows monitoring terminals at all levels to locally respond to monitoring and access requests from users at all levels. There is no need for the station to respond to all monitoring and access requests from users at all levels. Users can directly view the video fusion picture locally without having to remotely access the video.
  • the module can configure the available network bandwidth and minimum delay time detected before the rate adjustment condition is triggered, the delay time detected when the rate adjustment condition is triggered, and the data type configuration based on business data when the rate adjustment condition is triggered. Delayed recovery time, real-time adjustment of the current data transmission rate of business data, so that the appropriate data transmission rate can be configured for the business data before the business data is sent out, effectively preventing the business data from being sent out due to delays in the transmission process.
  • the uncontrollable problem of network delay caused by the uncontrollable network delay reduces the difficulty of solving the network delay problem. At the same time, it improves the accuracy of data transmission rate adjustment and improves the adaptability of the rate adjustment scheme. and flexibility.
  • Figure 1 is a structural block diagram of a preferred embodiment of a monitoring system based on digital converter stations provided by this application;
  • Figure 2 is a schematic diagram of an application scenario of a monitoring system based on digital converter stations provided by the embodiment of the present application;
  • Figure 3 is a schematic diagram of another application scenario of a monitoring system based on a digital converter station provided by an embodiment of the present application.
  • the embodiment of the present application provides a monitoring system based on a digital converter station. See Figure 1, which is a structural block diagram of a preferred embodiment of a monitoring system based on a digital converter station provided by the present application.
  • the monitoring system includes a first monitoring terminal deployed on the first-level monitoring side, a second monitoring terminal deployed on the second-level monitoring side, and a third monitoring terminal deployed on the third-level monitoring side; the monitored objects of the monitoring system include those deployed on all The digital converter station on the three-level monitoring side; the first monitoring terminal, the second monitoring terminal and the third monitoring terminal all include at least a communication module, a human-computer interaction module, an equipment status monitoring module, and an equipment alarm management module.
  • module, a video fusion processing module and a data transmission control module, the third monitoring terminal also includes a data storage module, the data storage module is configured to store digital converter station data;
  • the communication module is configured to implement communication between the first monitoring terminal, the second monitoring terminal and the third monitoring terminal; the equipment status monitoring module is configured to monitor and manage the digital converter station. Ledger information, operation information and monitoring data of all equipment; the equipment alarm management module is configured to manage the alarm information of all equipment of the digital converter station; the human-computer interaction module is configured to receive the alarm information of users on the local monitoring side Monitor call requests;
  • Each of the video fusion processing modules is configured to respond to the monitoring call request of the user on the local monitoring side, use the video fusion original data in the digital converter station data to perform video fusion processing, and obtain the user call request for the local monitoring side. Read the video fusion picture;
  • Each of the data transmission control modules is configured to be triggered according to the rate adjustment condition when the preset rate adjustment condition of the service data is triggered during the process of the local monitoring terminal transmitting service data to another monitoring terminal. Adjust the current network bandwidth and minimum delay time detected before, the delay time detected when the rate adjustment condition is triggered, and the delay recovery time configured based on the data type of the service data. The data transmission rate is adjusted to continue transmitting the service data to another monitoring terminal according to the adjusted data transmission rate.
  • the monitoring system adopts a three-level architecture, which mainly consists of a first monitoring terminal deployed on the first-level monitoring side, a second monitoring terminal deployed on the second-level monitoring side, and a third monitoring terminal deployed on the third-level monitoring side.
  • Composition mainly consists of a first monitoring terminal deployed on the first-level monitoring side, a second monitoring terminal deployed on the second-level monitoring side, and a third monitoring terminal deployed on the third-level monitoring side.
  • the first-level monitoring side can be the monitoring side such as the power grid system headquarters
  • the second-level monitoring side can be the monitoring side such as the provincial unit of the power grid system
  • the third-level monitoring side can be the monitoring side such as the digital converter station
  • the monitored objects of the monitoring system at least include digital converter stations deployed on the third-level monitoring side, and may also include other monitored objects.
  • Figure 1 only shows that the monitoring system includes a first monitoring terminal, A second monitoring terminal, a third monitoring terminal and a monitored object Application scenarios, and the number of monitoring terminals at all levels and the number of monitored objects can be deployed according to actual needs, and are not specifically limited in the embodiments of this application.
  • the first monitoring terminal, the second monitoring terminal and the third monitoring terminal all include at least a communication module, a human-computer interaction module, an equipment status monitoring module, an equipment alarm management module, a video fusion processing module and a data transmission control module.
  • the third monitoring terminal also It includes a data storage module.
  • the first monitoring terminal specifically includes a first communication module, a first human-computer interaction module, a first equipment status monitoring module, a first equipment alarm management module, a first video fusion processing module and The first data transmission control module
  • the second monitoring terminal specifically includes a second communication module, a second human-computer interaction module, a second equipment status monitoring module, a second equipment alarm management module, a second video fusion processing module and a second data transmission
  • the control module, the third monitoring terminal specifically includes a third communication module, a third human-computer interaction module, a third equipment status monitoring module, a third equipment alarm management module, a third video fusion processing module, a third data transmission control module and a data storage module.
  • the communication module is mainly configured to realize communication between the first monitoring terminal, the second monitoring terminal and the third monitoring terminal. That is, the first monitoring terminal, the second monitoring terminal and the third monitoring terminal can communicate through the first communication module. , the second communication module and the third communication module communicate; the data storage module is mainly configured to store all data of the digital converter station as the monitored object, and all data of the digital converter station include at least all data of the digital converter station.
  • the video of the monitored area is integrated with original data;
  • the equipment status monitoring module is mainly configured to monitor and manage the ledger information, operation information and monitoring data of all equipment in the digital converter station. That is, the first equipment status monitoring module is mainly configured as Remotely monitor and manage the ledger information, operating information and monitoring data of all equipment in the digital converter station.
  • the second equipment status monitoring module is mainly configured to monitor the ledger information, operating information and monitoring data of all equipment in the digital converter station.
  • the monitoring data is remotely monitored and managed.
  • the third equipment status monitoring module is mainly configured to locally monitor and manage the account information, operation information and monitoring data of all equipment in the digital converter station;
  • the equipment alarm management module is mainly configured as Manage the alarm information of all equipment in the digital converter station to implement alarm statistics functions, system alarm query functions and application alarm query functions. That is, the first equipment alarm management module is mainly configured to monitor alarms for all equipment in the digital converter station.
  • the information is remotely managed to realize remote alarm statistics function, remote system alarm query function and remote application alarm query function.
  • the second equipment alarm management module is mainly configured to remotely manage the alarm information of all equipment in the digital converter station to realize remote alarm Statistical function, remote system alarm query function and remote application alarm query function.
  • the third equipment alarm management module is mainly configured to locally manage the alarm information of all equipment in the digital converter station to realize local alarm statistics function and local system alarm query function. and local application alarm query function;
  • the human-computer interaction module is mainly configured to receive operation requests from users on the local monitoring side.
  • the operation requests at least include monitoring call requests, that is, the first human-computer interaction module is mainly configured to receive operation requests from the primary monitoring side.
  • the first user's monitoring access request the second human-computer interaction module is mainly configured to receive the monitoring access request from the second user on the secondary monitoring side
  • the third human-computer interaction module is mainly configured to receive the third level monitoring side's monitoring access request.
  • User's monitoring call request is mainly configured to receive the third level monitoring side's monitoring access request.
  • Each video fusion processing module is mainly configured to respond to the monitoring request of the user on the local monitoring side, using the original video fusion data of all monitored areas in the digital converter station data stored in the data storage module of the third monitoring terminal.
  • the video fusion process correspondingly obtains the video fusion picture for user access on the local monitoring side, that is: when the first human-computer interaction module receives the monitoring access request from the first user on the primary monitoring side, the first video fusion
  • the processing module is mainly configured to respond to the first user's monitoring request, use the original video fusion data of all monitored areas in the digital converter station data stored in the data storage module to perform video fusion processing, and obtain the video fusion picture accordingly.
  • the video fusion picture is provided for the first user to review; when the second human-computer interaction module receives the monitoring review request from the second user on the secondary monitoring side, the second video fusion processing module is mainly configured to respond to the second user's monitoring Retrieval request, use the original video fusion data of all monitored areas in the digital converter station data stored in the data storage module to perform video fusion processing, and obtain the video fusion picture accordingly, and the video fusion picture can be retrieved by the second user;
  • the third human-computer interaction module receives the monitoring access request from the third user on the third-level monitoring side
  • the third video fusion processing module is mainly configured to respond to the monitoring access request from the third user, using the information stored in the data storage module.
  • the original video fusion data of all monitored areas in the digital converter station data is subjected to video fusion processing, and the video fusion picture is obtained accordingly, and the video fusion picture is available for third users to review.
  • the first video fusion processing module is further configured to respond to the monitoring screen adjustment request from the first user and adjust the currently displayed video.
  • the video fusion picture is adjusted accordingly to meet the first user's monitoring and viewing needs such as perspective control and camera switching;
  • the second human-computer interaction module receives a monitoring picture adjustment request from the second user on the secondary monitoring side
  • the second video fusion processing module is also configured to respond to the second user's monitoring picture adjustment request and adjust the currently displayed video fusion picture accordingly to meet the second user's monitoring and viewing needs such as perspective control and camera switching;
  • the third video fusion processing module is also configured to respond to the monitoring screen adjustment request from the third user and adjust the currently displayed video fusion screen accordingly. , to meet the monitoring and viewing needs of third users such as perspective control and camera switching.
  • video fusion raw data specifically refers to the various raw data required by the video fusion processing module when performing video fusion processing, which can include image/video collection devices such as cameras and patrol robots deployed in digital converter stations.
  • the collected image/video data, the measurement point data collected by the sensors deployed in the digital converter station, the model scene data corresponding to the three-dimensional model and scene resources of the digital converter station, are collected by the sensors deployed in the digital converter station.
  • the measurement and status data collected by power measurement devices, environmental measurement devices, etc., relevant equipment ledger data of digital converter stations, equipment topology relationship data, etc. are all collected by the rendering engine through video fusion from the data storage module.
  • the various raw data required can be rendered and processed using three-dimensional models to render and process the raw data into video fusion images.
  • Each data transmission control module is mainly configured to, in the process of transmitting business data from a local monitoring terminal to another monitoring terminal, when the preset rate adjustment condition of the business data is triggered, according to the rate detected before the rate adjustment condition is triggered.
  • the available bandwidth of the network, the minimum delay time detected before the rate adjustment condition is triggered, the delay time detected when the rate adjustment condition is triggered, and the delay recovery time configured based on the data type of the service data.
  • the current data transmission rate is adjusted to continue transmitting the service data to another monitoring terminal according to the adjusted data transmission rate.
  • the available network bandwidth and the minimum delay time before the rate adjustment condition is triggered can be obtained based on the network bandwidth detection between the local monitoring terminal and another monitoring terminal before the rate adjustment condition is triggered.
  • the network bandwidth detection The working process will be introduced in detail in the working process of the network detection module in the following embodiments, and will not be repeated here; the delay time detected when the rate adjustment condition is triggered can be obtained by monitoring the transmission process of business data.
  • business data is transmitted from a local monitoring terminal to another monitoring terminal in the form of a business message.
  • the RTT Red Trip
  • Time (round trip delay) value the most recently obtained RTT value when the rate adjustment condition is triggered can be used as the delay time detected when the rate adjustment condition is triggered; the delay recovery time specifically refers to the delay time adjusted by the rate
  • the time required for the corresponding RTT value is also the time required for the business packets in the buffer to be cleared.
  • the delay recovery time can be configured accordingly according to the data type of the business data. For example, different data types can be configured with different values.
  • Delay recovery time represents the different needs of users for delay recovery time during the transmission process of different data types of business data.
  • the rate adjustment values for different data types of business data can be determined correspondingly. , thereby correspondingly configuring the network bandwidth occupied by different data types of business data during transmission, and allocating available network bandwidth to business data with higher priority to achieve optimal allocation of resources.
  • the rate adjustment condition can be set to: for the first time It is determined that the RTT value increases to the preset delay time threshold, that is, when the RTT value of the first determination service packet increases to the preset delay time threshold, the decision rate adjustment condition is triggered; alternatively, the service can also be monitored
  • the rate adjustment condition For the packet loss situation, set the rate adjustment condition to: when the packet loss report is received for the first time, that is, when the packet loss report is received for the first time, it is determined that the rate adjustment condition is triggered; it is understandable that the rate adjustment condition can also be based on the actual situation.
  • the requirements are set to other conditions (such as relevant judgment conditions corresponding to network congestion), and the set rate adjustment conditions can be applied to various data types of service data, which are not specifically limited in the embodiments of this application.
  • the data types of business data can be classified according to the functions that the monitoring system can implement. Based on the multiple functions that the monitoring system can implement, the business data transmitted from one monitoring terminal to another monitoring terminal can also include Multiple data types.
  • the data types may include equipment status monitoring business data corresponding to the functions of the equipment status monitoring module, equipment alarm business data corresponding to the functions of the equipment alarm management module, and equipment status monitoring business data corresponding to the functions of the video fusion processing module.
  • the rate adjustment scheme provided by the embodiment of the present application can be used to adjust the data transmission rate of the service data in real time, and for each data type
  • the specific rate adjustment scheme is only carried out during the transmission process of business data of the same data type, that is, when the business data of a certain data type needs to adjust the data transmission rate during the transmission process , the current data transmission rate of the service data of this data type will only be adjusted according to the rate adjustment scheme provided by the embodiment of the present application, rather than adjusting the data transmission rates of all data types of service data, so it will not It will affect the data transmission process of other data types of business data, and will not affect the use experience of other business functions.
  • the data transmission rate of the service data is adjusted only when the rate adjustment condition is determined to be triggered.
  • the adjustment timing of the data transmission rate is not determined arbitrarily, nor is the data transmission rate continuously adjusted. rate, so it can reduce unnecessary resource occupation to a certain extent and save resources.
  • the rate adjustment condition is The delay time detected when triggered and the delay recovery time configured based on the data type of the business data are used to determine the adjustment value of the data transmission rate. It is not an arbitrary adjustment of the data transmission rate, nor is it a fixed rate adjustment in advance.
  • using the rate adjustment scheme provided by the embodiments of the present application can improve the adaptability of the rate adjustment scheme and the accuracy of the rate adjustment, making the adjusted data transmission rate more suitable for the current network status and user needs.
  • Using inappropriate rate adjustment values to adjust the data transmission rate may also easily lead to network flapping problems.
  • using the rate adjustment scheme provided by the embodiments of the present application can avoid network flapping.
  • the monitoring system based on digital converter stations provided by the embodiments of the present application has the following beneficial effects:
  • the first monitoring terminal, the second monitoring terminal and the third monitoring terminal can respond locally to the local monitoring side.
  • Users' monitoring and access requests do not need to be responded to by the station at all levels of monitoring.
  • users can directly view the video fusion images locally without accessing from the remote end, effectively alleviating the need for multiple station-side responses.
  • the pressure of concurrent user access can effectively reduce network latency, improve the real-time performance of video screen display, and improve the use effect and user experience of video fusion applications under the premise of limited computing resources and network bandwidth resources at the site, making it at the first level
  • the user experience at three different locations: the monitoring side, the secondary monitoring side and the tertiary monitoring side is consistent;
  • the process of transmitting business data between the first monitoring terminal, the second monitoring terminal and the third monitoring terminal is achieved.
  • the rate adjustment condition when the rate adjustment condition is triggered, it can be based on the available network bandwidth and minimum delay time detected before the rate adjustment condition is triggered, the delay time detected when the rate adjustment condition is triggered, and the data based on the service data to be transmitted.
  • the delay recovery time configured by the type adjusts the current data transmission rate of the business data, so that the appropriate data transmission rate can be configured for the business data before the business data is sent out, effectively avoiding the delay in the transmission process after the business data is sent out.
  • the uncontrollable network delay in the network causes difficult-to-solve network delay problems, which reduces the difficulty of solving network delay problems;
  • the delay recovery time configured for the data type of the transmitted business data is used to adjust the current data transmission rate of the business data.
  • the adjustment value of the data transmission rate can be accurately determined, and the available network bandwidth and minimum detected before the rate adjustment condition is triggered.
  • Delay time and rate adjustment The delay time detected when the condition is triggered is a parameter value that is more in line with the real-time network status.
  • the delay recovery time configured based on the data type of the business data is a parameter value that is more in line with user needs. Data is determined in real time based on these parameter values.
  • the adjustment value of the transmission rate makes the adjusted data transmission rate more suitable for the current network status and user needs, thereby improving the accuracy of the data transmission rate adjustment and improving the adaptability of the rate adjustment scheme;
  • the rate adjustment scheme provided by the embodiment of the present application can be used to adjust the data transmission rate of the service data in real time, and for each data type of service data It is said that the specific rate adjustment scheme is only carried out during the transmission process of business data of the same data type, and the data transmission rate of all data types of business data will not be adjusted in the same way. Therefore, the data transmission rate of other data types will not be adjusted in the same way.
  • the data transmission process of business data will not affect the use experience of other business functions;
  • Business data can be configured with different priorities (or importance) according to different data types. For example, video convergence business data has relatively high time requirements, and the corresponding configuration priority is relatively high, and other data types of business data have higher time requirements. The time requirement is relatively low, and the priority of the corresponding configuration is relatively low.
  • the priority of the business data matches the delay recovery time, which can meet the needs of business data with different priorities. According to different delay recovery requirements, the available network bandwidth is allocated to business data with higher priority, thereby achieving optimal configuration of network resources and improving the flexibility of the rate adjustment scheme;
  • the rate adjustment scheme provided by the embodiments of this application can achieve accurate adjustment of the data transmission rate without relying on intermediate devices.
  • the rate adjustment scheme is simple, easy to deploy and implement, takes up less resources, and is highly practical.
  • the data transmission control module adjusts the rate according to the rate.
  • the available network bandwidth and minimum delay time detected before the adjustment condition is triggered, the delay time detected when the rate adjustment condition is triggered, and the delay recovery time configured based on the data type of the service data adjust the The current data transmission rate of the business data to continue transmitting the business data to another monitoring terminal according to the adjusted data transmission rate, specifically including:
  • the data transmission control module obtains the data detected before the rate adjustment condition is triggered when the preset rate adjustment condition of the service data is triggered.
  • the available network bandwidth S0 and the minimum delay time RTT0, the delay time RTT2 detected when the rate adjustment condition is triggered, and the delay recovery time t configured based on the data type of the service data;
  • the data transmission control module adjusts the current data transmission rate of the business data according to the rate adjustment target value S2', and obtains the adjusted data transmission rate S0', and the adjusted data transmission rate The rate S0' satisfies S0' ⁇ S2', so as to continue transmitting the service data to another monitoring terminal according to the adjusted data transmission rate S0'.
  • the data transmission control module when the data transmission control module determines that the rate adjustment condition preset for the service data is triggered during the process of the local monitoring terminal transmitting service data to another monitoring terminal, the data transmission control module will adjust the service data to continue.
  • the data transmission rate during transmission the specific implementation process of the rate adjustment scheme is as follows: before the data transmission control module obtains the rate adjustment condition, it detects the available network bandwidth and minimum delay time by performing network bandwidth detection, and records the available network bandwidth. The bandwidth is S0, and the minimum delay time is recorded as RTT0.
  • the acquisition rate adjustment condition is triggered, the obtained delay time is detected by monitoring the RTT value of the service message, and the delay time is recorded as RTT2, and the acquired rate based on the service data is obtained.
  • the delay recovery time configured by the data type, and record the delay recovery time as t.
  • the data transmission control module can adjust the current data transmission rate of the service data according to the calculated rate adjustment target value S2', and obtain the adjusted data transmission rate accordingly.
  • the adjusted data transmission rate continues to transmit the service data to another monitoring terminal, and the adjusted data transmission rate is recorded as S0', then the adjusted data transmission rate S0' satisfies S0' ⁇ S2'.
  • the available network bandwidth S0 and the minimum delay time RTT0 have been determined based on network bandwidth detection.
  • the rate adjustment condition is triggered, the current data transmission rate of the service data needs to be adjusted.
  • the available network bandwidth is no longer S0, it is necessary to know what the current available network bandwidth is. If the current available network bandwidth is obtained again by performing network bandwidth detection, the implementation process of network bandwidth detection requires time. It takes a certain amount of time to complete, which will cause the current available network bandwidth obtained by detection to have a certain lag and low real-time performance, thus affecting the accuracy and real-time performance of subsequent rate adjustments.
  • the estimated available bandwidth S2 reflects the changes in the available bandwidth of the network through changes in the delay time, thereby quickly estimating and obtaining the current estimated available bandwidth S2 of the network, improving real-time performance.
  • RTT0*S0 represents the total amount of business data sent by the local monitoring terminal during the RTT0 time.
  • RTT2*S0 represents the total amount of business data sent by the local monitoring terminal during the RTT2 time, that is, the data volume of the messages in transit.
  • n (RTT2-RTT0)*S0
  • the available network bandwidth S0 and the minimum delay time RTT0 have been determined based on network bandwidth detection, and the service data is initially transmitted at the data transmission rate S0.
  • the rate adjustment condition is triggered at time point T2
  • the delay time is monitored to increase from RTT0 to RTT2.
  • the data transmission rate can be directly reduced from S0 to S2' to continue transmitting business data, thereby quickly determining the rate adjustment value.
  • the current data transmission rate is reduced, that is, the adjusted data transmission rate S0' obtained satisfies S0' ⁇ S2'.
  • the rate adjustment scheme provided by the embodiment of the present application has simple steps and is easy to deploy and implement, and the available network bandwidth and minimum delay time detected before the rate adjustment condition is triggered, and the delay time detected when the rate adjustment condition is triggered All are parameter values that are more in line with the real-time network status.
  • the delay recovery time configured based on the data type of the business data is a parameter value that is more in line with user needs. Based on these parameter values, the adjustment value of the data transmission rate is determined in real time, so that the adjusted The data transmission rate is more adapted to the current network status and user needs, thereby improving the accuracy of data transmission rate adjustment and improving the adaptability of the rate adjustment scheme.
  • the delayed recovery time is obtained by querying a preset delayed recovery schedule according to the data type of the service data by the data transmission control module; wherein the delayed recovery timetable includes at least one Each data type and its corresponding configured delayed recovery time. The higher the priority of the business data corresponding to each data type, the smaller the corresponding configured delayed recovery time.
  • a delayed recovery schedule is preset in the data transmission control module.
  • the delayed recovery schedule includes at least one data type and its corresponding configured delayed recovery time. That is to say, in In this delayed recovery schedule, there is a one-to-one correspondence between the delayed recovery time and the data type, and the higher the priority of the business data corresponding to the data type, the smaller the corresponding configured delayed recovery time, that is, it is required to be able to The sooner the business packets in the buffer are cleared, so that the delay time can return to normal, the data transmission control module will obtain the data type based on the business data to be transmitted.
  • the delayed recovery time When the delayed recovery time is configured, you can query the delayed recovery schedule based on the data type of the business data to be transmitted, and find out the relationship between the business data to be transmitted and all the data types included in the delayed recovery schedule.
  • the data type matches the data type, and the delayed recovery time corresponding to the found data type in the delayed recovery schedule is used as the delayed recovery time configured based on the data type of the business data to be transmitted.
  • the business data that needs to be transmitted can also include multiple data types.
  • the data types in the delayed recovery schedule can also include multiple data types.
  • the video fusion service data described in the above embodiments in combination with the following embodiments, the video fusion service data may include video stream data corresponding to the transmission of video fusion pictures, or corresponding video fusion original data when transmitting the specified monitored area).
  • business data may include video stream data corresponding to the transmission of video fusion pictures, or corresponding video fusion original data when transmitting the specified monitored area.
  • business data may include video stream data corresponding to the transmission of video fusion pictures, or corresponding video fusion original data when transmitting the specified monitored area.
  • business data equipment status monitoring business data
  • equipment alarm business data etc.
  • Different data types can be configured with different delayed recovery times according to the different priorities (or importance) of the corresponding business data.
  • the business data The priority (or importance) can be configured according to actual needs, and the priority (or importance) of the service data corresponding to different data types can be configured to be the same or different. For example, assume that video convergence service data has If the real-time requirements are higher, the corresponding priority (or importance is higher), while other data types of business data have lower real-time requirements and the corresponding priority is lower (or importance), then in In the delay recovery schedule, you can configure a smaller delay recovery time for the data types corresponding to the video convergence service data, and configure a larger delay recovery time for the data types corresponding to other data types of service data, and For video convergence service data, a higher priority can be configured separately, and for all other data types of service data, it can be uniformly configured to a lower priority, or it can also be configured based on the services of other data types. Actual requirements for data may be configured with different lower priorities, which are not specifically limited in the embodiments of this application.
  • the monitoring system based on a digital converter station configured by the embodiment of the present application configures corresponding delay recovery times for different data types according to the priority of the service data, so that the priority of the service data is consistent with the delay recovery time. Matching can meet the different delay recovery requirements of business data of different priorities.
  • it can be determined based on the different delay recovery times configured corresponding to business data of different priorities.
  • Different rate adjustment values determine the occupation of the available network bandwidth when business data of different priorities continue to be transmitted.
  • the available network bandwidth can be configured for use by business data with higher priority, thus achieving optimal configuration of network resources. , at the same time, it also improves the flexibility of the rate adjustment scheme.
  • the third monitoring terminal also includes a fault wave recording management module, a data report management module, a digital station area management module and a remote intelligent patrol module;
  • the fault wave recording management module is configured to manage the fault wave recording files of the digital converter station and perform online analysis based on the fault wave recording files;
  • the data report management module is configured to collect statistics on the business data of the digital converter station, display historical data, statistical data and analytical data in different report forms according to the operation and maintenance requirements of the digital converter station, and implement reports Task formulation function, automatic report generation function, report export function and report printing function;
  • the digital station area management module is configured to monitor and manage the security, fire protection and power environment of the digital converter station with the station area of the digital converter station as the main body;
  • the remote intelligent inspection module is configured to control the monitoring device to carry out joint inspection operations of indoor and outdoor equipment, analyze the inspection data, and form inspection results and inspection reports.
  • the third monitoring terminal also includes a fault wave recording management module, a data report management module, a digital station area management module and a remote intelligent inspection module.
  • the fault wave recording management module is mainly configured to convert digital current Manage the fault recording files of the station, and conduct online analysis based on the fault recording files to display the waveforms, configuration parameters and fault report information of each channel;
  • the data report management module is mainly configured to collect statistics on the business data of the digital converter station. According to the operation and maintenance requirements of the digital converter station, historical data, statistical data and analytical data are displayed in different report forms (for example, in the form of daily, weekly or monthly reports), and the report task formulation function and automatic report generation function are implemented.
  • the digital station area management module is mainly configured to take the station area of the digital converter station as the main body, relying on the unified three-dimensional base of the whole station, to assist the security, fire protection and power environment of the digital converter station. Monitoring information is uniformly monitored and managed; the remote intelligent patrol module is mainly configured to control monitoring devices (for example, cameras, robots, drones and voiceprint monitoring devices, etc.) to carry out joint patrol operations of indoor and outdoor equipment, receive the collected patrol data, It also conducts intelligent analysis on the collected inspection data, forms inspection results and inspection reports, and sends alarms in a timely manner.
  • monitoring devices for example, cameras, robots, drones and voiceprint monitoring devices, etc.
  • the fault recording management module, data report management module, digital station area management module and remote intelligent inspection module are generally deployed in the third monitoring terminal, and can also be deployed in three levels according to actual needs, that is, in the first monitoring terminal
  • the terminal and the second monitoring terminal can also respectively deploy at least one module among the fault wave recording management module, the data report management module, the digital station area management module and the remote intelligent patrol module, which are not specifically limited in the embodiments of this application.
  • the monitoring system based on digital converter stations provided by the embodiments of this application deploys three-level functional modules such as video fusion processing module, equipment status monitoring module and equipment alarm management module, and also deploys a third monitoring terminal.
  • the fault recording management module, data report management module, digital station area management module and remote intelligent inspection module enable diversified monitoring and management of monitored objects to meet the diverse management needs of users.
  • the digital converter station has unified common components, the common components include business components and data components, and the business components and the data components are configured to be the components of the digital converter station.
  • Each application system provides business function interfaces and basic data services based on unified specifications, and formulates unified data interaction protocols and data interaction formats to provide a unified data service interface for the third monitoring terminal.
  • the digital converter station as the monitored object has unified public components.
  • the public components mainly include business components and data components.
  • the business components and data components are configured to serve as various application systems of the digital converter station.
  • the flow station obtains data and stores it in the data storage module, so that the monitoring system can call the required data from the data storage module.
  • the digital converter station has unified common components and can provide a third monitoring terminal. Provide a unified data service interface, so that when the monitoring system implements various functions, it can effectively solve the problem of docking complexity and network delay when the converter station interacts with external parties.
  • the digital converter station has a unified basic application, which is constructed using unified basic software and hardware facilities, unified data models, unified data service specifications and unified application development specifications.
  • the digital converter station in addition to having unified common components, also has unified basic applications. These basic applications all adopt unified basic software and hardware facilities, unified data models, unified data service specifications and unified applications. The construction of development specifications can provide unified and standardized data services for monitoring terminals at all levels when the monitoring system implements various functions.
  • a unified management device can be deployed to manage the digital converter station (interconnected with the third monitoring terminal).
  • the management device can be composed of one or more servers.
  • the purpose is to To solve the problem of separate construction and inconsistent specifications of the software and hardware of each sub-application system in the station, the management equipment includes a standardized basic platform to provide virtual machines, containers, distributed storage, and graphics acceleration for the public components and business applications of the digital converter station. and a series of infrastructure services such as AI reasoning.
  • the basic platform includes basic hardware and basic software.
  • Basic hardware refers to all software and services provided for digital converter stations, a collection of hardware that provides computing, storage, and network resources and supports the operation of various applications.
  • Basic hardware includes: storage computing fusion nodes, Graphics processing nodes, video access nodes, general computing nodes, AI computing nodes, graphics cards and node interconnection switches; basic software refers to services that rely on basic hardware to run and integrate and schedule hardware resources, and accept calls or dependencies from public components or application software and resources.
  • the basic software includes: virtualization, container management, distributed storage, infrastructure management, and operating system, providing elastic and heterogeneous computing resource pools and storage resource pools for the entire factory site.
  • an operation and maintenance management system based on digital converter stations can be further constructed to manage digital converter stations.
  • the operation and maintenance management system mainly consists of public components and basic applications.
  • Public components include business components and data components. The purpose is to solve the problems of chimney construction of each sub-application system of the converter station, inconsistent data collection and data interaction specifications, and point-to-point private protocol interaction.
  • the business components and data components provide business function interfaces and basic data services based on unified specifications.
  • a unified data interaction protocol and data interaction format have been formulated to provide a unified platform for data interaction among multiple sub-application systems; basic applications are deployed in a separate manner from front-end and back-end, and application front-ends are deployed on monitoring terminals at all levels.
  • Various functions of the monitoring system are realized by calling the back-end data of the basic application for corresponding processing.
  • basic applications are deployed in a distributed manner with front-end and back-end separation, which can realize remote-site business experience consistency platform system, including site-side data components, business components, basic applications, and corresponding headquarters DC technology center , Integrated applications and related support components on the middle and Taiwan sides of national units.
  • Basic applications are deployed at converter stations in a front-end and back-end separation manner.
  • provincial units and headquarters deploy application front-ends or browsers, and call the back-end data of basic applications. Content, pages, etc. to ensure that the power grid system headquarters, Consistency of user experience in different locations of provincial units and digital converter stations in the power grid system.
  • the digital converter station in the embodiment of the present application can provide unified data model maintenance technology, based on unified model specifications, based on the CIM and SG-CIM model system, combined with business application requirements, and modeling for equipment , according to the model hierarchy of the converter station, a regional model is established, including DC field, AC field, etc.
  • an equipment model is established, including converter transformer, converter valve, current transformer, DC arrester, etc., in the equipment Under the model, continue to establish the measurement point model, including temperature, humidity, voltage, current, etc., and finally establish the model association of the geographical area of the entire station, primary and secondary equipment, collection measurement points, and each application subsystem, and provide model associations for the entire station equipment and
  • the measuring point model prepares a unique identification ID to realize the standardized integration of the whole site model data and realize the horizontal collaboration and vertical connection of business and information.
  • 3D and video can be used to display the ledger information, operating data information and status information of the corresponding equipment based on a unified model.
  • the corresponding model ID can be used in the 3D and video models. , find the location of the corresponding alarm device, display alarm data information in real time, and facilitate operation and maintenance personnel to locate alarms.
  • the digital converter station in the embodiment of the present application can also provide unified data service technology based on converter station operation data, realize unified aggregation and flexible sharing of different types and different maintenance data of the entire station, and solve multiple applications.
  • the main functions include: data aggregation function across security zones.
  • unified standard integration protocols such as 104 or 61850 protocols, various main control systems and auxiliary systems in security I and security II zones can be realized.
  • the digital converter station in the embodiment of the present application unifies the equipment of each application subsystem in the station to form a unified standard digital converter station management equipment, including unified hardware resources and the use of domestically produced controllable equipment.
  • hardware equipment to form a unified hardware resource pool using a unified domestically controlled operating system as the software running environment, and at the same time, unified precipitation of public software and middleware to form a unified basic software layer to provide unified standard services for the last application .
  • Management equipment includes servers, network equipment, firewalls, storage equipment, and virtualization equipment. Management equipment can be implemented by one or more servers.
  • Management equipment standardizes and serializes server computing power, forming four types of edge computing power serialization specifications (Integrated cabinets, hyper-converged equipment, edge computing equipment, industry adaptation equipment), while standardizing basic OSs such as edge computing VMs and containers.
  • edge computing power serialization specifications Integrated cabinets, hyper-converged equipment, edge computing equipment, industry adaptation equipment
  • basic OSs such as edge computing VMs and containers.
  • the standardization and serialization of edge computing power has improved the standardization of edge applications and the effective use of ICT capabilities.
  • time slice allocation the CPU computing power is standardized, so that the basic units of computing power provided for different applications are consistent, thereby improving the deployment efficiency of edge hardware and applications, and providing a basis for efficient operation and maintenance; it also provides a unified collaboration module.
  • Service triggering rules are used to schedule tasks to achieve cross-site, cross-cloud, and cross-network data collaboration, and at the same time support the standardization of components and application interfaces within the site: 1. Unify the external interfaces within the site to facilitate seamless expansion of internal and external applications; 2. Unify Registration management facilitates global control and standardized construction; 3. Unify the interactive relationships among components within the site and standardize the division of labor among components to facilitate the overall planning and construction of the basic core system.
  • the unified standard digital converter station management equipment provides the basis for the in-station operating environment for cloud-side collaboration of the three-level deployment architecture of video integration, and provides a unified service interface for video stream synchronization and model, data, and alarm synchronization. It is the ideal video The prerequisite for multi-site promotion that integrates cloud-edge collaboration functions.
  • the basic applications include site-wide video control applications, site-wide three-dimensional presentation applications, equipment status overview applications, equipment alarm overview applications, fault wave recording management applications, intelligent report management applications, digital station area management applications, and Remote intelligent inspection application; wherein, the whole-station video management and control application and the whole-station three-dimensional rendering application are configured to provide services for the video fusion processing module, and the equipment status overview application is configured to provide services for the equipment status monitoring module,
  • the equipment alarm overview application is configured to provide services for the equipment alarm management module
  • the fault wave recording management application is configured to provide services for the fault wave recording management module
  • the intelligent report management application is configured to provide services for the data
  • the report management module provides services
  • the digital station area management application is configured to provide services for the digital station area management module
  • the remote intelligent inspection application is configured to provide services for the remote intelligent inspection module.
  • the basic applications of the digital converter station mainly include the whole-station video control application, the whole-station three-dimensional presentation application, the equipment status overview application, the equipment alarm overview application, the fault wave recording management application, and the intelligent report management application.
  • Digital station area management applications and remote intelligent patrol applications, etc. including:
  • the whole-station video management and control application is mainly configured to provide services for the video fusion processing modules of monitoring terminals at all levels; the whole-station video management and control application is to build the whole-station video management and control function based on the 3D-GIS geographical information system, using geographical information and three-dimensional models. , the method of combining real-time video to achieve the association of camera images and geographical information data. Access to the entire site's video resources can be achieved through camera area lists, three-dimensional model visualization clicks, mini-map navigation and positioning areas, etc., and should be reported to the digital converter station.
  • the basic functional requirements of the site-wide video management and control application mainly include: 1) Support real geographical information coordinate systems such as latitude and longitude, built-in WGS84 coordinate system (EPSG: 4326), and support various The ability to convert geographical coordinates; 2) carry GIS data such as image maps, digital elevations, vector data, digital line drawings, etc.; 3) have the ability to build models using laser scanning, manual modeling, etc., with OBJ, 3DS, FBX, OSG It has the ability to import multiple model formats, such as real-time rendering of large scenes and dynamic memory scheduling; 4) It has the function of direct import of oblique photography models and osgb models, and it has the ability to read osgb data and hierarchical rendering of sub-plot LOD architecture.
  • GIS data such as image maps, digital elevations, vector data, digital line drawings, etc.
  • OSG has the ability to import multiple model formats, such as real-time rendering of large scenes and dynamic memory scheduling
  • It has the function of direct import of oblique photography
  • the video centralized management functional requirements of the website video control application mainly include: 1) Integrating video resources within the website, including: industrial video, fully automatic inspection, infrared, drones, robots, etc.
  • System video data completes the collection and calibration of the spatial coordinates of each camera in the three-dimensional GIS system; 2) Supports traditional surveillance 1/4/9 grid playback formats, and can customize the number and position of video playback; 3) Supports three-dimensional scenes Quickly access the video by clicking on the visual icon, and the position and size of the video pop-up window can be dynamically adjusted with the movement of the three-dimensional icon; 4) Supports navigation and positioning areas according to the camera area list, mini-map, etc. Quickly access video resources in various forms; 5) It has regular video operation functions such as PTZ control and video playback.
  • the superior remote operation and control functional requirements of the whole-station video management and control application mainly include: 1) Supporting superior units to remotely access the site-side real-time video surveillance images; supporting superior units to remotely control site-side cameras; supporting superior units to remotely access site-side 3D- GIS geographical information system, operating three-dimensional scene images; 2) There should be a permission allocation and operation mutual exclusion mechanism to ensure that the same instance can only be controlled by one party at the same time; when multiple instances operate the same camera at the same time, the camera should be locked and unlocked according to permissions Control; 3) Support PC and central control room large screens to run full-site video management and control applications, and upload high-definition images with clear images; the functional requirements for the advanced application expansion interface of full-site video management and control applications mainly include: 1) It should be capable of realizing panoramic video fusion Functional expansion capabilities, video fusion implementation methods are: video three-dimensional mapping, adjacent video splicing, integrating multiple discrete video streams at different locations, and projecting video images on a three-dimensional model; 2) It should be
  • the whole-station three-dimensional rendering application is mainly configured to provide services for the video fusion processing modules of monitoring terminals at all levels; the whole-station three-dimensional rendering application is based on three-dimensional refined modeling based on point cloud data, multi-dimensionally presenting the full scene information in the station, and truly reflecting the Equipment status and its surrounding environment, integrating real-time information such as alarm prompts, monitoring data, and video images, as well as data materials such as operation records and primary wiring diagrams, support the highlighting of areas, equipment, systems, buildings, etc.
  • the basic model requirements for full-station three-dimensional rendering applications mainly include: 1) The ability to perform color laser point processing of full-station equipment, ancillary facilities, buildings, roads, security facilities, etc.
  • Point cloud scanning and material collection functions point cloud density ⁇ 100 points/square meter, accuracy 1mm ⁇ 10mm, ghosting of point cloud files does not exceed 2cm; 2) point cloud scanning range, indoors should include but not limited to: comprehensive buildings, Main control building, protection equipment room, air conditioning equipment room, water pump room, station auxiliary equipment, spare parts warehouse, guard room, etc.; outdoor should include but not limited to: main transformer, station transformer, high resistance, lightning rod tower, steel structure bracket , lightning protection network, all wiring in the station, fire protection facilities, roads, walls, pools, air conditioner outdoor units and other station facilities, etc.; 3) It has the function of collecting high-definition pictures of the entire station in partitions to ensure clear shooting of equipment meters and nameplates, and output 360° panoramic view Picture; 4) It has the function of processing the original point cloud scanning las data, cutting it according to the proportion of the area, and cutting the key equipment separately.
  • the size of the individual cutting files is ⁇ 4G; the model production should be made by comparing the point cloud scanning and the photos collected on site. ; 5) Have the function of outputting las and max models for refined model production; the requirements for refined models for full-site 3D rendering applications mainly include: 1) having the ability to carry out refined 3D modeling based on the full-site cloud data model; 2) having 3D scene construction based on the real site environment Modeling capabilities, real-life texture processing, and color matching should be consistent with the scene.
  • the equipment and the surrounding environment of the equipment should be truly restored, including other equipment, facilities, surrounding buildings, etc. related to the equipment; 3) Support the 3D modeling of each site in the full-site 3D model Areas, equipment, systems, buildings, etc.
  • the multi-dimensional information presentation of the whole-site 3D presentation application mainly includes: 1) It has the linkage function of system alarm information, navigation tree, system integration framework and 3D scenes, and can quickly position and present the whole site, region, equipment, system, etc., which can be completed Zoom in, zoom out, rotate and other operations; 2) Support positioning and presentation of various types of information, which should include equipment ledger information, operating parameter information, status information, real-time operating data, online monitoring data, maintenance records, defect records, etc.; 3 ) should have the function of visually presenting the real operating status of the equipment, such as running, opening and closing status, etc., and presenting the rendering effects in different states, such as equipment action animation, etc.; when a certain equipment is selected in the 3D model of the whole site, the application The color distinguishes the equipment status, such as: normal is green, abnormal is orange, fault is red, uncharged is gray, etc.; 4) It has the function of visualizing the data of primary equipment measurement points, which should display the real-time measurement point values of the equipment and
  • the measuring point value In the abnormal situation where the measuring point exceeds the threshold value, the measuring point value is highlighted in yellow or red; 5) It has the function of receiving and reading the equipment alarm information in the platform, and at the same time, it automatically renders the equipment with abnormal alarm in yellow or red according to the alarm level. Alarm mode and positioning in the 3D scene continuously prompt the operator to pay attention to the fault.
  • the performance requirements of the full-site 3D rendering application mainly include: 1) The first loading completion time of the 3D full-site scene is ⁇ 4 seconds; 2) The response time of user switching area in the 3D scene is ⁇ 1 second; 3) The response time of loading the interactive interface in the 3D scene is ⁇ 1 second; 4) The data display delay in the 3D scene is ⁇ 1 second; 5) Interactive real-time rendering of the 3D scene Frame rate ⁇ 30 frames/second.
  • the equipment status overview application is mainly configured to provide services for the equipment status monitoring modules of monitoring terminals at all levels.
  • the equipment status overview application is a full-station data aggregation based on digital converter stations, including equipment ledgers, operation information, monitoring data, etc. , with the equipment as the center, it summarizes the key indicators of the equipment in a hierarchical manner and conducts a comprehensive display.
  • the functional requirements mainly include: 1) It should have an overview screen for monitoring the status of the entire station's equipment, monitor the operating status of the entire station's equipment, and support the display of key equipment data information by equipment classification; 2) It should have the change range of the key parameters of the equipment within the specified time range.
  • Threshold setting function when the key monitored parameters exceed the threshold range, a prompt message should be issued; 3) Support the display of key measuring point information of the converter transformer (transformer), including winding temperature, oil surface temperature, casing SF6 air pressure, Air content in the main body oil, iron core grounding current, clamp grounding current, main body oil tank oil level, on-load tap changer oil level, main body oil pressure, etc.; 4) Support the display of key measurement point information of the station transformer, including oil temperature , winding temperature, gas content in the body oil, core grounding current, clamp grounding current, body oil level, etc.; 5) Support GIS key measurement point information display, including SF6 pressure, wall casing pressure, oil pressure, Conductive rod temperature, motor loop current, etc.; 6) Comparison object selection methods should support multiple methods, including: supporting fuzzy query, inputting keywords can model match the corresponding measuring point object; supporting equipment query, providing all equipment Tree structure of equipment and measuring points, select by level, and support multiple selections; 7) Time selection methods should support multiple selections, including
  • the equipment alarm overview application is mainly configured to provide services for the equipment alarm management modules of monitoring terminals at all levels.
  • the equipment alarm overview application is based on the whole-station data aggregation of digital converter stations to achieve equipment alarm overview and support alarm information in equipment, Statistics and information display in dimensions such as level and time, and supports real-time refresh and filter retrieval of alarm information.
  • the linkage function of the device to which the alarm belongs can be manually triggered to display data information related to the device;
  • the alarm statistics function requirements of the device alarm overview application mainly include: 1) Have the statistics function by alarm source, and the sources include various types System and application alarms support viewing the proportion and number of three types of alarms based on day, week, month, and year; 2) It has the statistics function by alarm level, and counts the proportion and number of alarms of each level based on day, week, month, and year.
  • the system alarm query function requirements of the equipment alarm overview application mainly include: 1) Supports filtering of non-confirmed alarm information; 2) It has the function of filtering and retrieving alarm information by level, system, and device; 3) It has the function of filtering and retrieving alarm information by alarm description keywords; 4) For unidentified alarm information, The processed alarms have the alarm confirmation function and support the entry of confirmation information; 5) support alarm information to distinguish alarm levels by color; the application alarm query function requirements of the device alarm overview application mainly include: 1) support filtering of non-confirmation alarm information; 2) It has the function of filtering and retrieving alarm information by level, device, application and type; 3) it has the function of filtering and retrieving alarm information by alarm description keywords; 4) it has the alarm confirmation function for unprocessed alarms.
  • the performance requirements of equipment alarm overview applications mainly include: 1) Statistical data loading Completion time ⁇ 1 second; 2) Alarm query time for the current day ⁇ 1 second; 3) Alarm query time for the current month ⁇ 5 seconds; 4) Alarm query time for the current year ⁇ 10 seconds; 5) Alarm confirmation response time ⁇ 1 second.
  • the fault recording management application is mainly configured to provide services for the fault recording management module of the third monitoring terminal.
  • the fault recording management application is based on the whole station data aggregation of the digital converter station to realize fault recording management and can unify Query and retrieve the fault recording files connected to the platform, analyze the files online, and display the waveforms, configuration parameters and fault report information of each channel;
  • the functional requirements of the fault recording management application mainly include: 1) Have the ability to All wave recording files can be searched by device, file name, and time; 2) The search results are displayed in list form, and the display column includes file name, time, size and other information; 3) It has the function of packaging and downloading the entire waveform file; 4) It has the function of waveform Online viewing function supports custom rendering of multiple channel waveform curves, all waveform timelines are the same, and supports unified cursors.
  • Waveform scaling It has the function of online viewing of wave recording data, which supports the display of all channel data points, including channel names, units and data of each sampling point; 6) It has the function of online viewing of wave recording parameters, which supports the display of basic waveform parameters in CFG files.
  • waveform information including basic information of waveform files, analog channel parameter information and status channel parameter information; 7) It has the function of online viewing of wave recording briefings and supports parsing of HDR files; 8) It has the function of opening online waveform analysis to third-party applications, providing waveform files Online analysis service; 9) With waveform export (PNG, PDG, Jpeg, Comtrade and other formats) and printing functions; the performance requirements of fault recording management applications mainly include: 1) Waveform loading completion time ⁇ 10 seconds; 2) Configuration parameter loading Time ⁇ 5 seconds; 3) Fault report loading time ⁇ 5 seconds.
  • the intelligent report management application is mainly configured to provide services for the data report management module of the third monitoring terminal.
  • the intelligent report management application is to realize the statistics of relevant business data in the digital station and display the history through daily, weekly and monthly reports according to the operation and maintenance requirements.
  • the functional requirements of intelligent report management applications mainly include: 1) Support important report items required by operation and maintenance personnel for daily statistics: Contains daily, weekly and monthly reports of line load of incoming and outgoing lines, system load, oil-immersed transformer temperature, unbalanced current, oil chromatography statistics, SF6 transcripts, etc.; 2) It has a customized report generation task function, and the system automatically generates and exports it according to the task Reports support daily, monthly, quarterly, annual reports, etc.; 3) Have statistical analysis data functions, including maximum value, minimum value, average value, load rate, etc.; 4) Have report data export file functions, and the file type should be compatible with EXCEL; 5) It has a report printing function and provides a public print button for one-click printing; 6) It should have the function of generating daily production and operation reports in the site according to templates; the performance requirements of intelligent report management applications mainly include: 1) Single-day measurement point report form
  • the digital station area management application is mainly configured to provide services for the digital station area management module of the third monitoring terminal.
  • the digital station area management application is based on the whole station data aggregation of the digital converter station, with the station area as the main body and relying on the whole
  • the unified three-dimensional base of the station completes unified monitoring and management of security, fire protection, power environment and other auxiliary monitoring information; the security monitoring function requirements of digital station area management applications mainly include: 1) Real-time video review, historical video information retrieval, etc.
  • the power environment monitoring function requirements of digital station area management applications mainly include: 1) Unify the information showing the status of the station area such as lights, air conditioners, water pumps, access control, water supply and drainage, etc. Monitoring; 2) It has the function of controlling lighting, air conditioning, access control, water supply and drainage and other equipment; the performance requirements of digital station area management applications mainly include: 1) Real-time data loading completion time ⁇ 1 second; 2) Alarm query time ⁇ 1 second; 3) Control record query time ⁇ 5 seconds; 4) Comprehensive warning trigger time ⁇ 10 seconds.
  • the remote intelligent patrol application is mainly configured to provide services for the remote intelligent patrol module of the third monitoring terminal.
  • the remote intelligent patrol application is to realize unified access, distribution control and monitoring of cameras, robots, drones and voiceprint monitoring devices. Process inspection results. Control robots and cameras to carry out joint inspections of indoor and outdoor equipment, receive inspection data, collect files, intelligently analyze the collected data, form inspection results and inspection reports, and send alarms in a timely manner. It also has functions such as real-time monitoring and intelligent linkage with the main and auxiliary equipment monitoring systems, and should provide interactive interfaces that meet relevant standards for other applications in the digital converter station.
  • the digital converter station in the embodiment of the present application can also provide panoramic three-dimensional digital twin technology and panoramic video fusion technology.
  • panoramic three-dimensional digital twin technology realizes the integration of equipment asset data and three-dimensional systems, through a three-dimensional space perspective
  • the method realizes the visual management function of equipment asset information and provides basic functions of 3D display: movement, zooming, rotation, and hierarchical browsing of 3D models; provides real-time data display: the 3D panoramic system of the converter station is integrated with the equipment data, which can be viewed in real time.
  • Functions such as primary equipment status, telemetry real-time data, and analog historical data; provide three-dimensional linkage: realize the integration of equipment alarm information and three-dimensional components.
  • the three-dimensional picture can display the converter station system alarm information in real time and mark the corresponding location of the alarm information.
  • Panoramic video fusion technology Based on virtual reality fusion technology, discrete traditional surveillance videos and panoramic three-dimensional models are video fused to form a spatial correlation between different video images in the scene, and an AR video surveillance system is established; discrete distribution is done at key points in the factory.
  • the surveillance video in the prevention and control area is spliced and integrated into the virtual reality scene model to establish the perception and application capabilities of video in the virtual reality space, provide continuous and intuitive monitoring of multiple areas, facilitate personnel to have an overall overview, and realize panoramic video that can span regions and perspectives.
  • Integrated display provides automatic video inspection function of key maintenance paths, which can automatically conduct inspections according to the angle and speed of daily inspections of inspection and maintenance personnel, and display resource information associated with the set route on demand without manual switching.
  • the platform's automatic inspections are combined with personnel inspections to ensure 24-hour uninterrupted monitoring of key areas; it provides 2D and 3D information synchronization and correlation functions to synchronously display 3D panoramic videos, 2D global maps and split-shot videos; on a flat 2D map
  • the coverage area and position of all cameras in the key area and the viewing angle position of the user's current observation point are displayed in the center. According to the viewing angle setting in the three-dimensional scene, the platform automatically associates and displays the split-shot surveillance video of the area for the monitoring personnel to select the best video viewing angle. .
  • the monitoring system based on digital converter stations is, compared with the traditional converter station
  • the digital converter station as a monitored object has unified common components and basic applications, enabling consistency management and control of technical architecture (standardized serialization and pre-integration of edge plant side equipment and OS) and providing unified data integration. and data service bus, providing a unified basic application framework to ensure the implementation of the digital converter station standard system, thereby providing basic guarantee for the digital transformation of traditional converter stations, and being able to provide information to all levels when the monitoring system implements various functions.
  • the monitoring terminal provides unified and standardized data services, greatly reducing the external interaction cost and time cost of the digital converter station, and effectively reducing network delay.
  • the user on the first-level monitoring side is regarded as the first user, and the video fusion processing module of the first monitoring terminal is used as the first video fusion processing module;
  • the first video fusion processing module is also configured to perform user rights management on the first user to configure the first user as a first ordinary user or a first VIP user; wherein the first ordinary user is The first VIP user is configured to have the authority to view the video fusion picture of the designated monitored area of the digital converter station, and the first VIP user is configured to have the authority to view the video fusion picture of all monitored areas of the digital converter station;
  • the first video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user call request for the local monitoring side.
  • Read the video fusion picture including:
  • the first video fusion processing module responds to the monitoring call request of the first ordinary user, and obtains the specified data from the digital converter station data. Obtain the original video fusion data of the area to be viewed from the original video fusion data of the monitoring area, and use the computing resources of the first monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, to obtain the original video fusion data for the first common area.
  • the video fusion screen viewed by the user.
  • the first video fusion processing module can perform user rights management on the first user on the first-level monitoring side, and configure the first user as the first ordinary user or the first VIP user; wherein, the first user It can be the decision-making management user of the power grid system headquarters or other users.
  • the user permissions of the first ordinary user are: having permission to view the video fusion picture of the designated monitored area of the digital converter station, but not having the authority to view the designated monitored area of the digital converter station.
  • Video fusion pictures of other monitored areas outside the monitoring area; the user permissions of the first VIP user are: have the authority to view the video fusion pictures of all monitored areas of the digital converter station.
  • the first video fusion processing module can By dividing and managing permissions on user accounts, the user permissions of the first user are managed.
  • the first video fusion processing module is mainly configured to respond to the monitoring request from the first ordinary user.
  • Request first obtain the video fusion original data of the area to be viewed from the video fusion original data of the designated monitored area in the digital commutation data stored in the data storage module of the third monitoring terminal, and then use the local data of the first monitoring terminal
  • Computing resources are used to perform video fusion processing on the obtained original video fusion data of the area to be viewed, and correspondingly obtain a video fusion picture, which is available for the first ordinary user to review.
  • the designated monitored area can be selected according to the user needs of the first ordinary user.
  • the designated monitored area includes at least one monitored area of the digital converter station. Since the first ordinary user only has the authority to view the video fusion picture of the designated monitored area of the digital converter station, in the embodiment of the present application, to be viewed The area can only be selected from the designated monitored areas, that is, at least one monitored area in the designated monitored area can be selected as the area to be viewed, and the first ordinary user can also specify the area to be viewed when initiating a monitoring call request. , so that the first video fusion processing module can determine which video fusion original data of one or several monitored areas actually needs to be remotely called from the third monitoring terminal according to the monitoring request of the first ordinary user.
  • the monitoring system based on the digital converter station performs user rights management on the first user on the primary monitoring side.
  • Different user rights levels correspond to different video fusion picture scheduling and review capabilities, and through Add certain restrictions to the first ordinary user's video fusion picture scheduling access rights, so that the first ordinary user can only schedule and view video fusion pictures in the designated monitored area, thereby saving wide-area egress bandwidth.
  • the first video fusion processing module directly remotely calls the required video fusion original data, and renders and processes the obtained video fusion original data according to the rendering engine locally deployed on the first monitoring terminal, so that the first video fusion processing module The monitoring terminal completes the video fusion task locally.
  • the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module
  • the first video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user call request for the local monitoring side.
  • the video fusion picture you read also includes:
  • the first video fusion processing module When the first user is the first VIP user, the first video fusion processing module responds to the monitoring call request of the first VIP user and sends the first video fusion processing module to the third video fusion processing module. request, the first video fusion request includes an identification of the area to be viewed;
  • the third video fusion processing module obtains the original video fusion data of all monitored areas in the digital converter station data to be viewed based on the area identification to be viewed in the first video fusion request.
  • the original video fusion data of the area is used, and the computing resources of the third monitoring terminal are used to perform video fusion processing on the original video fusion data of the area to be viewed, and the video fusion picture for the first VIP user is obtained and sent to the The first video fusion processing module;
  • the first video fusion processing module receives and obtains the video fusion picture for the first VIP user to call.
  • the first video fusion processing module when the first human-computer interaction module receives a monitoring review request from a first VIP user on the primary monitoring side, the first video fusion processing module is mainly configured to respond to the monitoring review request from the first VIP user and send a first video fusion request to the third video fusion processing module of the third monitoring terminal, wherein the first video fusion request includes an identifier of the area to be viewed; after receiving the first video fusion request, the third video fusion processing module first obtains the video fusion original data of the area to be viewed from the video fusion original data of all monitored areas in the digital converter station data stored in the data storage module according to the identifier of the area to be viewed contained in the first video fusion request, and then uses the third video fusion processing module to obtain the video fusion original data of the area to be viewed.
  • the local computing resources of the monitoring terminal perform video fusion processing on the acquired video fusion raw data of the area to be viewed, and correspondingly obtain a video fusion picture for the first VIP user to review, and feed the obtained video fusion picture for the first VIP user to review to the first video fusion processing module; the first video fusion processing module receives the video fusion picture in real time, and the video fusion picture is provided for the first VIP user to review.
  • the area to be viewed can be selected from all monitored areas of the digital converter station.
  • at least one monitored area among all monitored areas can be selected as the area to be viewed, and when the first VIP user initiates a monitoring call request, the area to be viewed can be specified at the same time.
  • the area to be viewed can be specified by The monitored area sets area identifiers to distinguish different monitored areas.
  • the first VIP user can specify the area to be viewed through the area identifier.
  • the first video fusion processing module in response to the monitoring call request of the first VIP user, sends a video fusion request to the third video fusion processing module, and the third video fusion processing module sends a video fusion request to the third video fusion processing module.
  • the video fusion processing module renders and processes the obtained video fusion original data according to the rendering engine deployed locally on the third monitoring terminal, thereby completing the video fusion task locally on the third monitoring terminal.
  • the first VIP user can remotely access it from the third monitoring terminal.
  • the video fusion screen can meet the needs of the first VIP user to view any monitored area.
  • the first video fusion processing module selects and executes different video fusion processing solutions according to different user permissions, which can ensure that the video fusion tasks of users with high computing power and response requirements can be performed locally. Execute nearby, thereby effectively solving the network delay problem, and when completing the video fusion processing task locally, the first video fusion processing module can only call the original video fusion data of the designated monitored area of the digital converter station stored in the data storage module , all first ordinary users share the original video fusion data of the designated monitored area of the digital converter station, thereby reducing the occupation of network bandwidth resources and further reducing network latency.
  • the user on the secondary monitoring side is used as the second user, and the video fusion processing module of the second monitoring terminal is used as the second video fusion processing module;
  • the second video fusion processing module is also configured to perform user rights management on the second user to configure the second user as a second ordinary user or a second VIP user; wherein the second ordinary user is The second VIP user is configured to have the authority to view the video fusion picture of the designated monitored area of the digital converter station, and the second VIP user is configured to have the authority to view the video fusion picture of all monitored areas of the digital converter station;
  • the second video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user call request for the local monitoring side.
  • Read the video fusion picture including:
  • the second video fusion processing module responds to the monitoring call request of the second ordinary user, and obtains the specified data from the digital converter station data.
  • the video fusion screen viewed by the user.
  • the second video fusion processing module can process the third video on the secondary monitoring side.
  • the second user performs user rights management and configures the second user as a second ordinary user or a second VIP user; among them, the second user can be an operation and maintenance management and control user of a provincial unit of the power grid system or other users, etc.
  • the second ordinary user User permissions are: have permission to view the video fusion picture of the designated monitored area of the digital converter station, but do not have the authority to view the video fusion picture of other monitored areas outside the designated monitored area of the digital converter station; the second VIP user's User permissions are: Have permission to view the video fusion images of all monitored areas of the digital converter station.
  • a certain number of user accounts can be opened for the second user to log in according to different functions and operational requirements, and based on limitations of computing resources and network bandwidth.
  • the second video fusion processing module can By dividing and managing permissions on user accounts, the user permissions of the second user are managed.
  • the second video fusion processing module is mainly configured to respond to the monitoring request from the second ordinary user.
  • Request first obtain the original video fusion data of the area to be viewed from the original video fusion data of the designated monitored area in the digital converter station data stored in the data storage module of the third monitoring terminal, and then use the second monitoring terminal's Local computing resources perform video fusion processing on the obtained original video fusion data of the area to be viewed, and accordingly obtain a video fusion picture, which can be accessed by a second ordinary user.
  • the designated monitored area can be selected according to the user needs of the second ordinary user.
  • the designated monitored area includes at least one monitored area of the digital converter station, because the second ordinary user only has the authority to view the digital converter station.
  • the video fusion picture of the designated monitored area Therefore, in the embodiment of the present application, the area to be viewed can only be selected from the designated monitored areas, that is, at least one monitored area in the designated monitored area can be selected as the area to be viewed.
  • the second ordinary user initiates a monitoring call request, he can specify the area to be viewed at the same time, so that the second video fusion processing module can determine the actual need to remotely call from the third monitoring terminal according to the second ordinary user's monitoring call request. Which video of the monitored area or areas is fused with the original data.
  • the monitoring system based on the digital converter station performs user rights management on the second user on the secondary monitoring side.
  • Different user rights levels correspond to different video fusion picture scheduling and review capabilities, and through Add certain restrictions to the second ordinary user's video fusion picture scheduling and viewing rights, so that the second ordinary user can only schedule and view video fusion pictures in the designated monitored area, thereby saving wide-area export bandwidth.
  • the second video fusion processing module directly remotely calls the video fusion original data, and renders and processes the obtained video fusion original data according to the rendering engine deployed locally on the second monitoring terminal, so that it can be displayed locally on the second monitoring terminal.
  • the second ordinary user can directly check the obtained video fusion picture locally.
  • There is no need for a third monitoring terminal to complete the video fusion and there is no need to remotely access the video fusion picture from the third monitoring terminal, thus effectively avoiding remote adjustment.
  • the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module
  • the second video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains
  • the video fusion images accessed by users on the local monitoring side also include:
  • the second video fusion processing module responds to the monitoring call request of the second VIP user and sends a second video fusion processing module to the third video fusion processing module.
  • the second video fusion request includes an identification of the area to be viewed;
  • the third video fusion processing module obtains the original video fusion data of all monitored areas in the digital converter station data to be viewed based on the area identification to be viewed in the second video fusion request.
  • the original video fusion data of the area is used, and the computing resources of the third monitoring terminal are used to perform video fusion processing on the original video fusion data of the area to be viewed, and the video fusion picture for the second VIP user is obtained and sent to the The second video fusion processing module;
  • the second video fusion processing module receives and obtains the video fusion picture for the second VIP user to call.
  • the second video fusion processing module is mainly configured to respond to the monitoring call request from the second VIP user.
  • View request send a second video fusion request to the third video fusion processing module of the third monitoring terminal
  • the second video fusion request includes the area identification to be viewed
  • the third video fusion processing module receives the second video fusion request
  • the video of the area to be viewed is obtained from the original video fusion data of all the monitored areas in the digital converter station data stored in the data storage module.
  • the video fusion picture for the second VIP user is fed back to the second video fusion processing module; the second video fusion processing module receives the video fusion picture in real time, and the video fusion picture is for the second VIP user to call.
  • the area to be viewed can be selected from all monitored areas of the digital converter station.
  • at least one monitored area among all monitored areas can be selected as the area to be viewed, and when the second VIP user initiates a monitoring call request, the area to be viewed can be specified at the same time.
  • the area to be viewed can be specified by The monitored area sets an area identifier to distinguish different monitored areas.
  • the second VIP user can specify the area to be viewed through the area identifier.
  • the second video fusion processing module in response to the monitoring call request of the second VIP user, sends a video fusion request to the third video fusion processing module, and the third video fusion processing module
  • the video fusion processing module renders and processes the obtained video fusion raw data according to the rendering engine deployed locally on the third monitoring terminal, thereby completing the video fusion task locally on the third monitoring terminal.
  • the second VIP user can remotely access it from the third monitoring terminal.
  • the video fusion screen can meet the needs of the second VIP user to view any monitored area.
  • the second video fusion processing module selects and executes different video fusion processing solutions according to different user permissions, which can ensure that the video fusion tasks of users with high computing power and response requirements can be performed locally. Executed nearby, thereby effectively solving the network delay problem, and when completing the video fusion processing task locally, the second video fusion processing module can only call the original video fusion data of the designated monitored area of the digital converter station stored in the data storage module , all second common uses The video of the designated monitored area of the household-shared digital converter station is fused with the original data, thereby reducing the occupation of network bandwidth resources and further reducing network latency.
  • the first video fusion processing module can only remotely call the original video fusion data of the designated monitored area of the digital converter station from the data storage module, and the first ordinary user is limited to only schedule and view the video of the designated monitored area.
  • the second video fusion processing module can only remotely call the original video fusion data of the designated monitored area of the digital converter station from the data storage module.
  • the second ordinary user is limited to only schedule and view the video fusion of the designated monitored area.
  • the designated monitored areas that the first ordinary user and the second ordinary user have permission to view can be monitored areas within the same range.
  • All the first ordinary users and the second ordinary user Two ordinary users can share the original video fusion data of the designated monitored area of the digital converter station, and remotely call the video fusion of the designated monitored area from the data storage module.
  • Original data only needs to occupy the same network bandwidth resource.
  • the user on the third-level monitoring side is used as the third user, and the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module;
  • the third video fusion processing module is also configured to perform user rights management on the third users, so as to configure the third users as third VIP users; wherein the third VIP users are configured to have rights View the video fusion images of all monitored areas of the digital converter station;
  • the third video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user call request for the local monitoring side.
  • Read the video fusion picture including:
  • the third video fusion processing module responds to the monitoring call request of the third VIP user, and obtains all the data from the digital converter station data. Obtain the original video fusion data of the area to be viewed from the original video fusion data of the monitoring area, and use the computing resources of the third monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, and obtain the original video fusion data for the third VIP The video fusion screen viewed by the user.
  • the third video fusion processing module can perform user rights management on the third users on the three-level monitoring side, and configure all third users as third VIP users; wherein, the third users can be digital exchangers.
  • the monitoring and operation and maintenance users of the flow station or other users, etc., the user permissions of the third VIP user are: have the permission to view the video fusion pictures of all monitored areas of the digital converter station.
  • the third-level monitoring side For example, on the third-level monitoring side, a certain number of user accounts can be opened for third users to log in according to different functions and operational needs, and based on limitations of computing resources and network bandwidth.
  • the third video fusion processing module can Through permission division and permission management of user accounts, the user permissions of the third user can be managed. Since the third user itself is on the third-level monitoring side, there is no need to use remote functions and will not occupy the third-level monitoring side and the second-level monitoring side. The network bandwidth resources between the side and the first-level monitoring side, therefore, all third users can be configured as third VIP users.
  • the third video fusion processing module is mainly configured to respond to the monitoring request of the third VIP user.
  • Request first obtain the original video fusion data of the area to be viewed from the original video fusion data of all monitored areas in the digital converter station data stored in the data storage module, and then use the local computing resources of the third monitoring terminal to The acquired video of the area to be viewed is fused with the original data to make a video Through fusion processing, a video fusion picture is obtained correspondingly, and the video fusion picture is available for the third VIP user to review.
  • the area to be viewed can be selected from all monitored areas of the digital converter station.
  • at least one monitored area among all monitored areas can be selected as the area to be viewed, and when the third VIP user initiates a monitoring call request, the area to be viewed can be specified at the same time.
  • the area to be viewed can be specified by The monitored area sets area identifiers to distinguish different monitored areas.
  • the third VIP user can specify the area to be viewed through the area identifier.
  • the third video fusion processing module processes the obtained video according to the rendering engine locally deployed by the third monitoring terminal.
  • the original data is fused for rendering processing, so as to complete the video fusion task locally on the third monitoring terminal.
  • the third VIP user can directly access the video fusion picture locally, which can avoid the network delay problem caused by remote access and meet the requirements of the third monitoring terminal. Second VIP users can view the needs of any monitored area.
  • the second monitoring terminal is used as a data sending end and the first monitoring terminal is used as a data receiving end, or the third monitoring terminal is used as a data sending end and the second monitoring terminal is used as a data sending end.
  • the terminal serves as the data receiving end;
  • the data sending end further includes a network detection module; the network detection module is configured to perform network bandwidth detection regularly to detect the available network bandwidth and minimum delay between the data sending end and the corresponding data receiving end. time, and when each detection is completed, only the last detected network available bandwidth and minimum delay time are recorded, so that when video convergence service data needs to be transmitted to the corresponding data receiving end, the network can be used according to the currently recorded network bandwidth.
  • the available bandwidth determines the initial data transmission rate of video convergence service data.
  • the first video fusion processing module when the first video fusion processing module responds to the monitoring request of the first VIP user, it needs to remotely access the third video from the third monitoring terminal through the second monitoring terminal.
  • the first video fusion processing module when the first video fusion processing module responds to the monitoring call request of the first ordinary user, it needs to remotely call the designated monitored area from the data storage module of the third monitoring terminal through the second monitoring terminal.
  • the video fusion raw data when the second video fusion processing module responds to the second VIP user's monitoring request, needs to remotely access the video fusion picture generated by the third video fusion processing module from the third monitoring terminal, the second video When the fusion processing module responds to the monitoring request of the second ordinary user, it needs to remotely call the original video fusion data of the designated monitored area from the data storage module of the third monitoring terminal. It can be seen that between the first monitoring terminal and the third monitoring terminal When data is transmitted between two monitoring terminals, the second monitoring terminal serves as the data sending end, and the first monitoring terminal serves as the data receiving end. When data is transmitted between the second monitoring terminal and the third monitoring terminal, the third monitoring terminal The terminal serves as the data sending end, and the second monitoring terminal serves as the data receiving end.
  • the data sending end (i.e., the second monitoring terminal and the third monitoring terminal) also includes a network detection module.
  • the network detection module is mainly configured to pass between each pair of data sending end and data receiving end. Regularly conduct network bandwidth detection to detect the available network bandwidth and minimum delay time between each pair of data sending end and corresponding data receiving end in real time, and when each detection is completed, only the network availability obtained by the last detection is recorded. bandwidth and minimum delay time required at the data sending end.
  • the initial data transmission rate of the video convergence service data can be determined based on the currently recorded network available bandwidth.
  • the business data transmitted between the sending end and the data receiving end is in addition to the video fusion business data (the video fusion business data may include the corresponding video stream data when transmitting the video fusion picture, or transmitting the video fusion of the designated monitored area.
  • the video fusion business data may include the corresponding video stream data when transmitting the video fusion picture, or transmitting the video fusion of the designated monitored area.
  • other types of business data may also be included.
  • relevant business data required by various functional modules of monitoring terminals at all levels such as equipment status monitoring business data and equipment alarms described in the above embodiments
  • Business data etc.
  • the data sending end needs to transmit other data types of business data to the corresponding data receiving end, it can also determine the initial data transmission rate of other data types of business data based on the currently recorded network available bandwidth.
  • the network detection module can detect and record the relationship between each pair of data sending end and the corresponding data receiving end in real time by regularly performing network bandwidth detection. The available network bandwidth and minimum delay time of the network. In order to reduce resource occupation, when the data sending end needs to transmit business data to the corresponding data receiving end, the network detection module can no longer perform network bandwidth detection regularly. At this time, the business data can be The network status is still detected and sensed by monitoring the transmitted service packets.
  • the network detection module can perform network bandwidth detection in real time according to a preset time period. Assume that when the first detection is completed, the available network bandwidth between the corresponding data sending end and the corresponding data receiving end is A1, and the minimum The delay time is B1. At this time, since the first detection is completed, the last detection is the first detection, so A1 and B1 are recorded; when the second detection is completed, the data sending end and the corresponding data receiving end are obtained accordingly. The available bandwidth of the network between terminals is A2, and the minimum delay time is B2.
  • the last detection is the second detection, so only A2 and B2 are recorded, that is, no more Record A1 and B1, for example, you can directly delete the recorded A1 and B1, or use A2 to replace A1, use B2 to replace B1; and so on; assuming that when the fifth detection is completed, the data sender and the corresponding The available bandwidth of the network between the data receivers is A5, the minimum delay time is B5, and only A5 and B5 are recorded. After the fifth detection is completed, and before the sixth detection is completed, the data sender needs to send a message to the corresponding When the data receiving end transmits data, the data transmission rate can be determined based on the currently recorded network available bandwidth, that is, based on the recorded A5.
  • the available bandwidth of the network is uncertain and changes with time. changes, and the end-to-end network is composed of multiple devices and links between devices. Therefore, based on the consideration of end-to-end data transmission delay, the minimum available bandwidth in each detected end-to-end link is usually As the end-to-end network available bandwidth.
  • the network detection module detects the available bandwidth and minimum delay time of the network between the data sending end and the data receiving end, the network detection module can be deployed on either the data sending end or the data receiving end. , or deployed at the data sending end and the data receiving end at the same time.
  • the specific deployment location can be set according to actual needs, and is not specifically limited in the embodiments of this application.
  • the monitoring system based on a digital converter station can obtain the available network bandwidth and minimum delay time between the data sending end and the data receiving end through regular network bandwidth detection and real-time detection, and can detect the data in the data.
  • the real-time The detected network available bandwidth determines the appropriate data transmission rate, thereby ensuring that a better data transmission rate can be maintained even when bandwidth resources are limited, so that the data transmission process can be completed as quickly as possible, and network bandwidth resources can also be reasonably utilized. , to prevent network bandwidth resources from being idle, thereby improving resource utilization.
  • the network detection module regularly performs network bandwidth detection to detect the available network bandwidth and minimum delay time between the data sending end and the corresponding data receiving end, specifically including:
  • Text sending rate
  • the network detection module determines that the RTT value has increased for the first time, it records the time point when the RTT value increases as T1, and records the last time point before T1 when the RTT value remains unchanged as T0, and determines the minimum value based on the RTT value corresponding to T0.
  • the delay time determines the available network bandwidth between the data sending end and the corresponding data receiving end based on the last message sending rate before T1.
  • the working principle of the network detection module is the same every time it performs network bandwidth detection.
  • the specific working process of the network detection module is as follows:
  • the network detection module in the data sending end continues to send detection packets to the corresponding data receiving end according to the law of gradual increase in packet sending rate, and records the packet sending rate corresponding to each detection packet sent, and records each time The RTT (Round Trip Time, round trip delay) value when receiving the ACK message responded by the corresponding data receiving end; it is understandable that in the process of gradually increasing the message sending rate, as long as the message sending rate does not exceed the network available Bandwidth, the RTT value corresponding to the detection packet will remain unchanged. As the packet sending rate gradually increases, after the new traffic fills up the available bandwidth of the network, the excess detection packet will enter the buffer, which will cause the RTT value to increase. Increase until the first time it is determined that the RTT value has increased, and you can stop sending detection messages;
  • the network detection module can determine the changing trend of the RTT value based on the recorded RTT value.
  • T1 time point at which the RTT value increases
  • T1 time point all RTT values recorded before the T1 time point are Remain unchanged
  • record the last time point before T1 time point where the RTT value remains unchanged as T0 that is, the RTT value begins to increase after the T0 time point, that is, after the T0 time point
  • the message sending rate begins to exceed The available bandwidth of the network
  • the packet enters the buffer, and the delay increases.
  • the network detection module can determine the minimum delay time based on the RTT value corresponding to the T0 time point, and can determine the available bandwidth in the network based on the changing trend of the RTT value. Accordingly, the available network bandwidth between the data sending end and the corresponding data receiving end can be determined based on the last message sending rate before the T1 time point.
  • the monitoring system based on digital converter stations provided by the embodiments of the present application continuously sends detection messages at a gradually increasing rate of message sending, and determines the available bandwidth in the network based on the changing trend of the recorded RTT value. changing trend, thereby determining the available network bandwidth and minimum delay time between the data sending end and the corresponding data receiving end, which can realize network bandwidth detection simply, conveniently and quickly without occupying too much network bandwidth resources, and According to the changing trend of RTT value, the network status can be reflected in time, thereby improving the accuracy of detection results.
  • the network detection module sends detection messages to the corresponding data receiving end in sequence according to the increasing message sending rate each time it performs network bandwidth detection, specifically including:
  • the network detection module sets a rate adjustment threshold according to the upper limit of the available bandwidth, and in the process of sequentially sending detection messages to the corresponding data receiving end according to the increasing message sending rate, when the message sending rate is less than the
  • detection packets are sent to the corresponding data receiving end in sequence according to the increasing message sending rate according to the first increasing amplitude.
  • detection messages are sent according to the second increasing amplitude.
  • Probe messages are sent to the corresponding data receiving end in sequence according to the increasing message sending rate; wherein the first increasing range is greater than the second increasing range.
  • the network detection module when the network detection module sends detection messages to the corresponding data receiving end in sequence according to the increasing message sending rate, the network detection module can pre-according to the local data sending end (that is, the data sending end where the network detection module is located)
  • the maximum egress bandwidth and the bandwidth occupancy experience value of the local data sending end (the bandwidth occupancy experience value can be evaluated and determined based on the bandwidth occupancy historical data in the data sending end) to determine the available bandwidth between the data sending end and the corresponding data receiving end.
  • the upper limit is set, and the rate adjustment threshold is set according to the upper limit of the available bandwidth.
  • the message sending rate can be gradually increased according to the first increase range, and detection messages are sent to the corresponding data receiving end in sequence, until the message sending rate increases to reach the set rate adjustment threshold, the message sending rate can be continued according to The second increase range gradually increases the message sending rate, and sends detection messages to the corresponding data receiving end in sequence; wherein, the first increase range is greater than the second increase range.
  • the initial message sending rate of detection messages can be set according to actual needs. For example, you can set a smaller initial message sending rate and start sending probes to the corresponding data receiving end at the initial message sending rate. messages, and gradually increase the message sending rate according to the first increasing range, and send detection messages to the corresponding data receiving end in turn, until the message sending rate increases to reach the set rate adjustment threshold, continue to gradually increase according to the second increasing range. Increase the message sending rate and send detection messages to the corresponding data receiving end in sequence until the first time it is determined that the RTT value has increased, and you can stop sending detection messages.
  • the message sending rate gradually increases from low to high.
  • the adjustable space is relatively large and the impact on the detection results is relatively small. Therefore, a larger increase can be used to gradually increase the message sending rate.
  • the adjustable space is relatively small and the impact on the detection results is relatively large. Therefore, a smaller increase can be used to continue to gradually increase the message sending rate to improve The accuracy of detection results.
  • the rate adjustment threshold is set to 50% of the upper limit of available bandwidth, and the message sending rate initially increases by a larger percentage of the upper limit of available bandwidth.
  • the message sending rate reaches 50% of the upper limit of available bandwidth, the message sending rate It is increased by a smaller percentage of the upper limit of the available bandwidth, and the specific increase range can be set according to actual needs, and is not specifically limited in the embodiment of this application.
  • the data transmission control module is also configured to enter the first step of the data transmission process sequentially when the local monitoring terminal needs to transmit video fusion service data to another monitoring terminal.
  • the first transmission stage obtain the network available bandwidth and minimum delay time currently recorded by the local network detection module, and determine the initial data transmission rate of the video fusion service data according to the obtained network available bandwidth, so as to determine the initial data transmission rate of the video fusion service data according to the obtained network available bandwidth.
  • the initial data transmission rate begins to transmit video convergence service data to another monitoring terminal until it is determined that the preset rate adjustment condition is triggered, and then the second transmission stage is entered; wherein the rate adjustment condition is the first determination that the RTT value increases reaches the preset delay time threshold, or receives a packet loss report for the first time;
  • the delay time detected when the rate adjustment condition is triggered based on the obtained network available bandwidth and minimum delay time, the delay time detected when the rate adjustment condition is triggered, and the data type and monitoring call requesting user based on the video convergence service data
  • the target delay recovery time configured for the user type, adjust the current data transmission rate of the video convergence service data to continue transmitting the video convergence service data to another monitoring terminal according to the adjusted data transmission rate until it is determined that the rate adjustment condition is
  • the third transmission stage is entered;
  • the local network detection module is triggered to perform network bandwidth detection to detect and record local monitoring
  • the network available bandwidth and minimum delay time between the terminal and another monitoring terminal are obtained, and the network available bandwidth and minimum delay time currently recorded by the local network detection are obtained, and the data of the video fusion service data is determined based on the obtained network available bandwidth.
  • transmission rate and continue to transmit video convergence service data to another monitoring terminal according to the determined data transmission rate, until it is determined that the rate adjustment condition is triggered, and then returns to the second transmission stage.
  • the data transmission control module is mainly configured to divide the entire data transmission process of video fusion service data into three stages when the local monitoring terminal needs to transmit video fusion service data to another monitoring terminal, including In the first transmission stage, the second transmission stage and the third transmission stage, the data transmission control module enters the first transmission stage, the second transmission stage and the third transmission stage in sequence until all the video convergence service data to be transmitted is completed. , ends the entire data transmission process; the specific data transmission process is as follows:
  • the data transmission control module obtains the network available bandwidth and minimum delay time currently recorded by the local network detection module (that is, before starting to transmit the video fusion service data, the local network detection module obtains the network available bandwidth from the latest detection bandwidth and minimum delay time), determine the initial data transmission rate of the video convergence service data based on the obtained network available bandwidth, and start transmitting the video convergence service data to another monitoring terminal based on the determined initial data transmission rate until the preset setting is determined When the rate adjustment condition is triggered, the second transmission phase is entered.
  • the rate adjustment condition can be set as: first determination of RTT The value is increased to the preset delay time threshold; alternatively, the packet loss of business packets can also be monitored, and the rate adjustment condition is set to: receiving a packet loss report for the first time, that is, within the first transmission stage, When it is first determined that the RTT value has increased to the preset delay time threshold, the second transmission phase is entered, or when a packet loss report is received for the first time, the second transmission phase is entered.
  • the data transmission control module obtains the local data in the first transmission phase.
  • the network detection module currently records the network available bandwidth and minimum delay time, the delay time detected when the rate adjustment condition is triggered in the first transmission stage, and the data type and monitoring request user (monitoring) based on the video fusion service data
  • the call requesting user specifically refers to the user who requests to obtain video convergence service data, that is, the user who issues the monitoring call request).
  • the target delay recovery time configured by the user type adjusts the current data transmission rate of the video convergence service data. (At this time, the initial data transmission rate in the first transmission stage is adjusted and lowered), the adjusted data transmission rate is obtained accordingly, and the video is continued to be transmitted to another monitoring terminal according to the adjusted data transmission rate.
  • the data transmission control module continues to transmit the video fusion service data to another monitoring terminal according to the adjusted data transmission rate determined in the second transmission stage, and at the same time, triggers the local network detection module to perform network bandwidth detection.
  • the specific working process of network bandwidth detection is as described in the above embodiment and will not be repeated here.
  • obtain the local The network detects the currently recorded network available bandwidth and minimum delay time, determines the data transmission rate of the video fusion service data based on the obtained network available bandwidth, and continues to adjust the adjusted data transmission rate determined in the second transmission stage to the third
  • the video fusion service data is continued to be transmitted to another monitoring terminal according to the data transmission rate determined in the third transmission stage until it is determined that the rate adjustment condition is triggered, and then the video fusion service data is returned to the second transmission stage.
  • the data transmission control module detects when the rate adjustment conditions in the third transmission stage are triggered based on the network available bandwidth and minimum delay time currently recorded by the local network detection module obtained in the third transmission stage. Based on the delay time reached and the target delay recovery time configured based on the data type of the video convergence service data and the user type of the monitoring call requesting user, continue to adjust the current data transmission rate of the video convergence service data (this is Adjust the data transmission rate determined in the third transmission stage), obtain the adjusted data transmission rate accordingly, and continue to transmit video fusion service data to another monitoring terminal according to the adjusted data transmission rate until it is determined that the RTT value is determined by the rate When the delay time when the adjustment condition is triggered returns to the value before the RTT value increases, the process returns to the third transmission stage; and so on, until all the video fusion service data to be transmitted is completely transmitted, the entire data transmission process ends. .
  • the data transmission control module obtains the network available bandwidth currently recorded by the local network detection module, and the initial data transmission rate determined based on the obtained network available bandwidth is X1, that is, the local monitoring terminal determines according to the obtained network available bandwidth.
  • the initial data transmission rate is X2
  • the local monitoring terminal continues to transmit video convergence service data to another monitoring terminal according to the data transmission rate While keeping the data transmission rate Adjusted from X2 to X3,
  • the local monitoring terminal continues to transmit video convergence service data to another monitoring terminal according to the data transmission rate
  • a cycle is performed between the second transmission stage and the third transmission stage until all the video fusion service data to be transmitted is completely transmitted, and the entire data transmission process ends.
  • the current data transmission rate of the video convergence service data can be adjusted by using the rate adjustment scheme provided in the above embodiment.
  • the specific implementation process is as follows: In the second transmission stage , before the acquisition rate adjustment condition of the data transmission control module is triggered, the network available bandwidth S0 and the minimum delay time RTT0 obtained through network bandwidth detection are detected (that is, the current record of the local network detection module obtained in the first transmission stage network available bandwidth S0 and minimum delay time RTT0), the time point when it is determined that the rate adjustment condition is met is recorded as T2 (that is, the time point when the RTT value is first determined to increase to the preset delay time threshold is recorded as T2 , or record the time point when the packet loss report is first received as T2), obtain the delay time RTT2 corresponding to the T2 time point by monitoring the RTT value corresponding to the service packet of the video convergence service data, and obtain the video convergence-based service Based on the data type of the data and the target delay recovery time t configured by the user type of the monitoring call
  • the local network detection module can be directly triggered to start performing network bandwidth processing. Detection, at this time, the initial message sending rate of the detection message may not be selected to use the initial message sending rate set when performing regular network bandwidth detection in the above embodiment, but directly based on the network calculated in the second transmission stage. Determine the available bandwidth estimate S2. The initial message sending rate determined based on the network available bandwidth estimate S2 is more in line with the current network status. Based on the initial message sending rate, gradually increase the message sending rate, which can save the early message sending rate.
  • the monitoring system based on a digital converter station can utilize the available network bandwidth and network delay for real-time detection and perception during the process of data transmission between the local monitoring terminal and another monitoring terminal. , and adaptively adjust the data transmission rate according to the detection results to avoid network jitter, thereby improving the stability of the monitoring system, and even in the case of network packet loss, the available network bandwidth can be readjusted downwards , reasonably reduce the data transmission rate, restore the buffer and link to normal, thereby improving the utilization of network bandwidth resources.
  • the target delay recovery time is obtained by the data transmission control module querying the preset delay recovery schedule according to the data type of the video fusion service data and the user type of the monitoring call requesting user; wherein,
  • the delayed recovery schedule includes at least one data type, a user type corresponding to each data type, and a configured delayed recovery time corresponding to each user type.
  • the data types include video convergence service data
  • the User types include ordinary users and VIP users. The higher the priority of the business data corresponding to each data type, the smaller the corresponding configured delay recovery time.
  • the corresponding configured delay recovery time for ordinary users The recovery time is greater than the delayed recovery time corresponding to the VIP user configuration.
  • a delayed recovery schedule is preset in the data transmission control module.
  • the delayed recovery schedule includes at least one data type, the user type corresponding to each data type, and each data type.
  • the delayed recovery time configured corresponding to the user type, that is to say, in the delayed recovery schedule, there is a one-to-one correspondence between the delayed recovery time, the data type, and the user type, where the data type at least includes video
  • the data type corresponding to the fusion service data is preset in the data transmission control module.
  • the delayed recovery schedule includes at least one data type, the user type corresponding to each data type, and each data type.
  • the delayed recovery time configured corresponding to the user type, that is to say, in the delayed recovery schedule, there is a one-to-one correspondence between the delayed recovery time, the data type, and the user type, where the data type at least includes video
  • the data type corresponding to the fusion service data is preset in the data transmission control module.
  • users can be configured as ordinary users and VIP users, then the video fusion in the delayed recovery schedule
  • the user types corresponding to the data type of business data include ordinary users and VIP users (user types can also be set accordingly according to actual needs), and the higher the priority of the business data corresponding to the data type, the longer the corresponding configured delay recovery time. Small. In the same data type, the higher the priority corresponding to the user type, the smaller the corresponding configured delay recovery time, that is, the faster the service packets in the buffer are cleared, so that the delay time can be longer. Get back to normal soon,
  • the corresponding delay recovery time configured for the data type of the video convergence service data is t
  • the user types corresponding to the data type of the video convergence service data include ordinary users and VIP users, and the priority of VIP users is higher than that of ordinary users, then it can be
  • the delayed recovery time corresponding to ordinary users is t1, and satisfies t1 ⁇ t.
  • the delayed recovery time corresponding to VIP users is t2, and satisfies t2 ⁇ t1.
  • the data transmission control module obtains the target delay recovery time configured based on the data type of the video fusion service data and the user type of the monitoring call requesting user, it can obtain the target delay recovery time based on the data type of the video fusion service data and the user type of the monitoring call requesting user.
  • the delayed recovery schedule To query the delayed recovery schedule, first find the data type that matches the data type of the video converged service data from all the data types included in the delayed recovery schedule based on the data type of the video converged service data, and then based on The user type of the monitoring call requesting user finds the user type that matches the user type of the monitoring calling requesting user from the user types corresponding to the matching data types found in the delayed recovery schedule, and the matching
  • the delayed recovery time corresponding to the data type and user type in the delayed recovery schedule is based on the video When fusing the data type of the business data with the target delay recovery time configured by the user type of the monitoring call request user.
  • the relevant information in the delayed recovery schedule is not fixed and can be updated according to user needs during use. For example, a certain The delayed recovery time corresponding to each data type, or the new data type and its corresponding user type and delayed recovery time.
  • the delay time threshold is set according to the currently recorded minimum delay time.
  • the data transmission control module needs to determine whether the RTT value has increased to a preset delay time threshold.
  • the delay time threshold used can be set in real time according to the currently recorded minimum delay time. It is understood that the setting is based on the minimum delay time detected in real time.
  • the delay time threshold set at this time is more in line with the actual status of the current network, thereby improving the adaptability and flexibility of the delay time threshold setting scheme.
  • the delay time threshold can also be preset to a fixed value according to user needs. This situation is suitable for data transmission application scenarios that do not have high network delay requirements.
  • the delay time threshold can be set to 1.3 times the minimum delay time of the current record. That is, when the data transmission control module first determines that the RTT value has increased by 30% compared with the minimum delay time of the current record, it determines that Meet the rate adjustment conditions.
  • the time point when the RTT value increases to the preset delay time threshold is before the time point when the packet loss report is first received. Therefore, if the rate adjustment condition is set to the first time the packet loss report is received, then The data transmission control module can only start to reduce the data transmission rate after buffer overflow and packet loss. If the rate adjustment condition is set to first determine that the RTT value increases to the preset delay time threshold, the data transmission control module can Reduce the data transmission rate before buffer overflow and packet loss, which can effectively avoid packet loss.
  • the user on the first-level monitoring side is regarded as the first user
  • the user on the second-level monitoring side is regarded as the second user
  • the user on the third-level monitoring side is regarded as the third user.
  • the video fusion processing module of the first monitoring terminal serves as the first video fusion processing module
  • the video fusion processing module of the second monitoring terminal serves as the second video fusion processing module
  • the video fusion processing module of the third monitoring terminal serves as the third video fusion processing module.
  • the second monitoring terminal also includes a second network detection module
  • the third monitoring terminal also includes a third network detection module;
  • the first video fusion processing module is also configured to perform user rights management on the first user to configure the first user as a first ordinary user or a first VIP user;
  • the second video fusion processing module is also configured to perform user rights management on the second user to configure the second user as a second ordinary user or a second VIP user;
  • the third video fusion processing module is also configured to perform user rights management on the third users, so as to configure all the third users as third VIP users;
  • the second network detection module is configured to perform network bandwidth detection regularly to detect the available network bandwidth between the second monitoring terminal and the first monitoring terminal, and send the currently detected first network available bandwidth to The first video fusion processing module;
  • the third network detection module is configured to perform network bandwidth detection regularly to detect the third monitoring module. Control the available bandwidth of the network between the terminal and the second monitoring terminal, and send the currently detected available bandwidth of the second network to the first video fusion processing module;
  • the first video fusion processing module is further configured to adjust the number of first VIP users or/and the number of second VIP users according to the available bandwidth of the first network and the available bandwidth of the second network;
  • the first ordinary user and the second ordinary user are configured to have permission to view the video fusion picture of the designated monitored area of the digital converter station, and the first VIP user and the second VIP user And the third VIP user is configured to have permission to view the video fusion pictures of all monitored areas of the digital converter station.
  • the first video fusion processing module can perform user rights management on the first user on the first-level monitoring side, configure the first user as the first ordinary user or the first VIP user
  • the second video fusion processing module The module can manage user rights for the second user on the secondary monitoring side, and configure the second user as a second ordinary user or a second VIP user.
  • the third video fusion processing module can perform user rights management on the third user on the third-level monitoring side.
  • Permission management configures all third users as third VIP users; among them, the user permissions of the first ordinary user and the second ordinary user are: have permission to view the video fusion picture of the designated monitored area of the digital converter station, but do not have permission View the video fusion pictures of other monitored areas outside the designated monitored area of the digital converter station, and the first ordinary user and the second ordinary user have the same user rights; the first VIP user, the second VIP user and the third VIP The user's user permissions are: Have permission to view the video fusion images of all monitored areas of the digital converter station.
  • the second monitoring terminal also includes a second network detection module.
  • the second network detection module is mainly configured to regularly perform network bandwidth detection between the second monitoring terminal and the first monitoring terminal.
  • the specific working process of the second network detection module is the same as that of the network detection module in the above embodiment, and will not be described again here.
  • the third monitoring terminal also includes a third network detection module, and the third network detection module is mainly configured to monitor Between the terminal and the second monitoring terminal, network bandwidth detection is performed regularly (the specific working process of the third network detection module is the same as the specific working process principle of the network detection module in the above embodiment, and will not be described again here) to detect in real time.
  • the number of first VIP users on the first-level monitoring side and the number of second VIP users on the second-level monitoring side can be adjusted according to the network bandwidth detected in real time, and can be achieved by configuring the corresponding user permissions. Adjustment of the number of VIP users. In actual adjustment, you can only adjust the number of first VIP users on the first-level monitoring side, or only adjust the number of second VIP users on the second-level monitoring side. You can also adjust the first-level one at the same time.
  • the specific adjustment plan for the number of first VIP users on the monitoring side and the number of second VIP users on the secondary monitoring side can be flexibly set according to actual needs. This application The examples are not specifically limited.
  • first ordinary user and the second ordinary user have the same user rights and share the original video fusion data of the same designated monitored area of the digital converter station, the first ordinary user and the second ordinary user only jointly occupy For one network bandwidth, increasing the number of first ordinary users and second ordinary users will not increase the bandwidth usage, and the first ordinary user and the second ordinary user can directly complete the video fusion task locally and will not increase the wide area bandwidth. resources, therefore, theoretically, the number of first ordinary users and the number of second ordinary users can be increased arbitrarily. The number of first ordinary users and the number of second ordinary users are only limited by the video fusion calculation that can be provided locally.
  • Resources can be continuously increased until the upper limit of video fusion computing resources that can be provided locally is reached; however, if the local area has a basic demand for the number of VIP users, it is also necessary to consider whether the network bandwidth resources can meet the basic number of VIP users.
  • Bandwidth demand when the detected network bandwidth resources are not enough to meet the basic number requirements of the first VIP user and the second VIP user, the data upload bandwidth resources of the designated monitored area occupied by the first ordinary user and the second Mandarin user can be released At this time, all the user rights of ordinary users cannot be used.
  • the VIP users are simultaneously started to be processed accordingly. When the VIP users release this part of the bandwidth resources, it is detected that the network bandwidth resources are sufficient. , normal user scheduling can still be pulled up again.
  • the monitoring system based on a digital converter station provided by the embodiment of the present application detects the network bandwidth between the second monitoring terminal and the first monitoring terminal, and between the third monitoring terminal and the second monitoring terminal in real time through regular network bandwidth detection.
  • the available bandwidth of the network is uniformly reported to the first video fusion processing module.
  • the first video fusion processing module centrally adjusts and allocates the number of first VIP users on the primary monitoring side and the number of second VIP users on the secondary monitoring side. , so that user permissions can be adjusted in time according to the network bandwidth status. Based on user permission management, it can avoid large network delays caused by insufficient network available bandwidth, thereby achieving an effective match between user experience and network available bandwidth resources, both It can fully guarantee user business SLA (Service Level Agreement) requirements and ensure that network bandwidth resources are fully utilized.
  • Service Level Agreement Service Level Agreement
  • the first video fusion processing module adjusts the number of first VIP users or/and the second VIP users according to the available bandwidth of the first network and the available bandwidth of the second network.
  • the quantity specifically includes:
  • the first video fusion processing module adjusts the number of the second VIP users according to the available bandwidth of the first network and the number of the second VIP users.
  • the first remaining network bandwidth is obtained from two network available bandwidths, the network bandwidth occupied by the first ordinary user and the basic number of network bandwidths occupied by the second VIP users, and the first VIP is adjusted according to the first remaining network bandwidth. number of users;
  • the first video fusion processing module adjusts the number of the second VIP users according to the available bandwidth of the first network and the number of the first VIP users.
  • the second remaining network bandwidth is obtained from two network available bandwidths, the network bandwidth occupied by the first ordinary user and the basic number of network bandwidths occupied by the first VIP users, and the second VIP is adjusted according to the second remaining network bandwidth. number of users;
  • the first video fusion processing module When the first video fusion processing module needs to adjust the number of first VIP users and the number of second VIP users at the same time, the first video fusion processing module adjusts the first video fusion processing module according to the available bandwidth of the first network and the available bandwidth of the second network.
  • the third remaining network bandwidth is obtained by adding the network bandwidth occupied by the first ordinary user, and the number of the first VIP users and the number of the second VIP users are adjusted according to the third remaining network bandwidth.
  • the first video fusion processing module adjusts the number of first VIP users on the primary monitoring side or/and the secondary monitoring side according to the available bandwidth of the first network and the available bandwidth of the second network received in real time.
  • the following adjustment scheme can be adopted:
  • the first video fusion processing module first receives the video in real time based on The available bandwidth of the first network, the available bandwidth of the second network received in real time, the network bandwidth fixedly occupied by the first ordinary user on the primary monitoring side (also the network bandwidth fixedly occupied by the second ordinary user on the secondary monitoring side) and the basic quantity determine the current first remaining network bandwidth based on the network bandwidth occupied by the second VIP user, and then adjust the number of first VIP users on the first-level monitoring side according to the first remaining network bandwidth;
  • the first video fusion processing module first receives the video in real time based on The available bandwidth of the first network, the available bandwidth of the second network received in real time, the network bandwidth fixedly occupied by the first ordinary user on the primary monitoring side (also the network bandwidth fixedly occupied by the second ordinary user on the secondary monitoring side) and the basic quantity Determine the current second remaining network bandwidth based on the network bandwidth occupied by the first VIP users, and then adjust the number of second VIP users on the secondary monitoring side according to the second remaining network bandwidth;
  • the first video fusion processing module first receives the real-time available bandwidth of the first network, The available bandwidth of the second network and the network bandwidth fixedly occupied by the first ordinary user on the first-level monitoring side (also the network bandwidth fixedly occupied by the second ordinary user on the second-level monitoring side), determine the current third remaining network bandwidth, and then based on The third remaining network bandwidth corresponds to adjusting the number of first VIP users on the primary monitoring side and the number of second VIP users on the secondary monitoring side.
  • the basic quantity requirements of the first VIP users on the first-level monitoring side and the basic quantity requirements of the second VIP users on the second-level monitoring side can be considered.
  • the number of first VIP users on the primary monitoring side or/and the number of second VIP users on the secondary monitoring side ensure that at least a basic number of VIP users can be used normally, and the remaining number of users is based on the remaining network bandwidth. Configuration, and ensure that the total bandwidth occupied by all users on the primary monitoring side and secondary monitoring side does not exceed the currently detected network available bandwidth.
  • the monitoring system based on digital converter stations can support adjusting the number of first VIP users on the primary monitoring side and the number of second VIP users on the secondary monitoring side based on the detected network available bandwidth. According to user needs, you can choose to adjust only the number of first VIP users on the first-level monitoring side, or only adjust the number of second VIP users on the second-level monitoring side, or adjust the number of first VIP users on the first-level monitoring side at the same time. number and the number of second VIP users on the secondary monitoring side, thus improving the flexibility of user permission adjustment.
  • the first video fusion processing module adjusts the number of first VIP users according to the first remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the first remaining network bandwidth is greater than a preset third A bandwidth threshold, if yes, configure at least M first users as the first VIP users; if not, release the network bandwidth occupied by the first ordinary user, according to the first remaining network bandwidth and The network bandwidth occupied by the first ordinary user configures at least M first users as the first VIP users;
  • M represents the basic number of first VIP users that need to be maintained, M ⁇ 1, and the first bandwidth threshold is set according to the network bandwidth occupied by the M first VIP users.
  • the first-level monitoring side must maintain a basic number of first VIP users, that is, M (M ⁇ 1) first VIP users.
  • the first video fusion processing module can compare the first remaining network bandwidth with the preset first bandwidth threshold when adjusting the number of first VIP users on the first-level monitoring side according to the first remaining network bandwidth, To determine whether the first remaining network bandwidth is greater than the preset first bandwidth threshold, if so, configure at least M first users as first VIP users according to the first remaining network bandwidth; if not, disable the first ordinary user and the user rights of the second ordinary user, releasing the network bandwidth fixedly occupied by the first ordinary user on the first-level monitoring side (also the network bandwidth fixedly occupied by the second ordinary user on the second-level monitoring side), according to the first remaining network bandwidth and the released network bandwidth fixedly occupied by the first ordinary users, and configure at least M first users as first VIP users.
  • the first bandwidth threshold can be set according to the network bandwidth occupied by the M first VIP users. On this basis, when the first remaining network bandwidth is compared with the first bandwidth threshold, it can be determined whether the first remaining network bandwidth is Meet the bandwidth requirements of M first VIP users. If satisfied, configure at least M first users as first VIP users. If not satisfied, release the data upload bandwidth resources of the designated monitored area. At this time, all The user rights of ordinary users cannot be used.
  • at least M first users are configured as first VIP users to ensure that at least M first VIP users can Normal use ensures that it can meet the basic quantity requirements of the first VIP users on the first-level monitoring side.
  • the number of remaining first VIP users can be configured according to actual needs or according to network bandwidth limitations, which will not be specified in the embodiment of this application. limited.
  • the first video fusion processing module adjusts the number of first VIP users according to the first remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the first remaining network bandwidth is greater than the network bandwidth occupied by one of the first VIP users, and if so, configures at least one of the first users as the first VIP user; If not, configure all first users as first ordinary users.
  • the first video fusion processing module can directly add the first remaining network when adjusting the number of first VIP users on the first level monitoring side according to the first remaining network bandwidth.
  • the bandwidth is compared with the network bandwidth occupied by a first VIP user to determine whether the first remaining network bandwidth is greater than the network bandwidth occupied by a first VIP user. If so, configure at least one first user as the first VIP user. ; If not, all first users are configured as first ordinary users, and the number of first VIP users at this time is 0.
  • the first video fusion processing module configures at least one first user as a first VIP user
  • the specific number of first VIP users can be configured according to actual needs or according to network bandwidth limitations. , there is no specific limitation in the embodiments of this application.
  • the first video fusion processing module adjusts the number of second VIP users according to the second remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the second remaining network bandwidth is greater than a preset second bandwidth threshold, and if so, sends a VIP user addition instruction to the second video fusion processing module; if not, sends a VIP user addition instruction to the second video fusion processing module.
  • the second video fusion processing module sends a normal user disabling instruction;
  • the second video fusion processing module configures at least N second users as the second VIP users according to the VIP user adding instruction, or releases the occupation of the second ordinary users according to the ordinary user disabling instruction. network bandwidth, and configure at least N second users as the second VIP users according to the second remaining network bandwidth and the network bandwidth occupied by the second ordinary users;
  • N represents the basic number of second VIP users that need to be maintained, N ⁇ 1, and the second bandwidth threshold is set according to the network bandwidth occupied by N second VIP users.
  • the first video fusion processing module can compare the second remaining network bandwidth with the preset second bandwidth threshold when adjusting the number of second VIP users on the secondary monitoring side according to the second remaining network bandwidth.
  • the first video fusion processing module To determine whether the second remaining network bandwidth is greater than the preset second bandwidth threshold, if so, the first video fusion processing module generates a corresponding VIP user addition instruction and sends it to the second video fusion processing module, and the second video fusion processing module responds According to the received VIP user adding instruction, at least N second users are configured as second VIP users according to the received VIP user adding instruction; if not, the first video fusion processing module generates a normal user disabling instruction and sends it to the second The video fusion processing module, the second video fusion processing module responds to the received ordinary user disabling instruction, disables the user rights of the second ordinary user on the secondary monitoring side according to the received ordinary user disabling instruction, and releases the fixed occupied space of the second ordinary user.
  • Network bandwidth (which is also the network bandwidth fixedly occupied by the first ordinary user on the first-level monitoring side, the first video fusion processing module will also disable the user permissions of the first ordinary user), according to the second remaining network bandwidth and the released second ordinary user Fixed occupied network bandwidth, and configure at least N second users as second VIP users.
  • the second bandwidth threshold can be set according to the network bandwidth occupied by N second VIP users. On this basis, when the second remaining network bandwidth is compared with the second bandwidth threshold, it can be determined whether the second remaining network bandwidth is Meet the bandwidth requirements of N second VIP users. If satisfied, configure at least N second users as second VIP users. If not satisfied, release the data upload bandwidth resources of the designated monitored area. At this time, all The user rights of ordinary users cannot be used.
  • at least N second users are configured as second VIP users to ensure that at least N second VIP users can Normal use ensures that it can meet the basic quantity requirements of the second VIP users on the secondary monitoring side.
  • the number of remaining second VIP users can be configured according to actual needs or according to network bandwidth limitations, which will not be specified in the embodiment of this application. limited.
  • the first video fusion processing module adjusts the number of second VIP users according to the second remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the second remaining network bandwidth is greater than the network bandwidth occupied by one of the second VIP users, and if so, sends a VIP user addition instruction to the second video fusion processing module; if not , then send a VIP user reduction instruction to the second video fusion processing module;
  • the second video fusion processing module configures at least one of the second users as the second VIP user according to the VIP user increase instruction, or configures all the second users according to the VIP user decrease instruction. Be the second ordinary user.
  • the first video fusion processing module can directly add the second remaining network when adjusting the number of second VIP users on the secondary monitoring side according to the second remaining network bandwidth.
  • the bandwidth is compared with the network bandwidth occupied by a second VIP user to determine whether the second remaining network bandwidth is greater than the network bandwidth occupied by a second VIP user.
  • the first video fusion processing module generates a corresponding VIP user increase
  • the instruction is sent to the second video fusion processing module.
  • the second video fusion processing module responds to the received VIP user adding instruction and configures at least one second user as the second VIP user according to the received VIP user adding instruction; if not, Then the first video fusion processing module generates the corresponding VIP user reduction instruction and sends it to the second video fusion processing module.
  • the second video fusion processing module responds to the received VIP user reduction instruction and reduces all VIP users according to the received VIP user reduction instruction. All second users are configured as second ordinary users, and the number of second VIP users at this time is 0.
  • the first video fusion processing module controls the second video fusion processing module to configure at least one second user as a second VIP user
  • the specific number of second VIP users can be configured according to actual needs, or The configuration is performed according to the limitation of network bandwidth, which is not specifically limited in the embodiments of this application.
  • the first video fusion processing module adjusts the number of first VIP users and the number of second VIP users according to the third remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the third remaining network bandwidth is greater than a preset third bandwidth threshold, and if so, configures at least M first users as the first VIP users, and provides The second video fusion processing module sends a VIP user increase instruction; if not, the network bandwidth occupied by the first ordinary user is released. According to the third remaining network bandwidth and the network bandwidth occupied by the first ordinary user, at least M first users are configured as the first VIP users, and send ordinary user disabling instructions to the second video fusion processing module;
  • the second video fusion processing module configures at least N second users as the second VIP users according to the VIP user adding instruction, or releases the second ordinary user occupation according to the ordinary user disabling instruction. network bandwidth, and configure at least N second users as the second VIP users according to the third remaining network bandwidth and the network bandwidth occupied by the second ordinary users;
  • M represents the basic number of the first VIP users that need to be maintained, M ⁇ 1, and N represents the basic number of the second VIP users that need to be maintained, N ⁇ 1, and the third bandwidth threshold is based on M
  • the network bandwidth occupied by the first VIP user and the network bandwidth occupied by N second VIP users are compared. set up.
  • the first video fusion processing module can adjust the number of first VIP users on the primary monitoring side and the number of second VIP users on the secondary monitoring side according to the third remaining network bandwidth.
  • the preset third bandwidth threshold is compared to determine whether the third remaining network bandwidth is greater than the preset third bandwidth threshold:
  • the first video fusion processing module configures at least M first users as first VIP users according to the third remaining network bandwidth, and generates corresponding VIP user addition instructions and sends them to the second video fusion processing module, and the second video fusion processing module The processing module responds to the received VIP user adding instruction and configures at least N second users as second VIP users according to the received VIP user adding instruction;
  • the first video fusion processing module disables the user rights of the first ordinary user, and generates an ordinary user disabling instruction and sends it to the second video fusion processing module.
  • the second video fusion processing module responds to the received ordinary user disabling instruction, according to The received ordinary user disabling instruction disables the user rights of the second ordinary user, thereby releasing the network bandwidth fixedly occupied by the first ordinary user (also the network bandwidth fixedly occupied by the second ordinary user).
  • the first video fusion processing module The third remaining network bandwidth and the released network bandwidth fixedly occupied by ordinary users configure at least M first users as first VIP users, and the second video fusion processing module configures at least M first users as first VIP users according to the third remaining network bandwidth and the released network bandwidth fixedly occupied by ordinary users. Configure at least N second users as second VIP users.
  • the third bandwidth threshold can be set according to the network bandwidth occupied by M first VIP users and the network bandwidth occupied by N second VIP users. On this basis, the third remaining network bandwidth is compared with the third bandwidth threshold. When compared, it can be determined whether the third remaining network bandwidth meets the bandwidth requirements of the M first VIP users and the N second VIP users. If satisfied, at least M first users are configured as first VIP users, and At least N second users are configured as second VIP users. If the requirements are not met, the data upload bandwidth resources of the designated monitored area will be released. At this time, all the user rights of ordinary users cannot be used. The user rights released by ordinary users will be released.
  • Bandwidth resources and third remaining network bandwidth resources, configuring at least M first users as first VIP users, and configuring at least N second users as second VIP users can ensure that there are at least M first VIP users and N second VIP users can be used normally, thereby ensuring that the basic quantity requirements of the first VIP users on the first-level monitoring side and the basic quantity requirements of the second VIP users on the second-level monitoring side can be met.
  • the number of remaining first VIP users and the number of second VIP users can be configured according to actual needs. It can also be configured according to network bandwidth limitations, which are not specifically limited in the embodiments of this application.
  • the increased number of first VIP users is not less than the increased number of second VIP users. Number of VIP users.
  • the first video fusion processing module performs the processing according to the third remaining network band
  • the number of first VIP users reaches M and the number of second VIP users reaches N that is, after the basic number of VIP users is met, the number of additional first VIP users on the first-level monitoring side is greater than or equal to the number of additional second VIP users on the second-level monitoring side. In this case, it can be guaranteed that in addition to satisfying the VIP In addition to the basic number of users, additional VIP users will be allocated to the first-level monitoring side first.
  • the number ratio of the first VIP user, the second VIP user and the third VIP user initially configured on the first-level monitoring side, the second-level monitoring side and the third-level monitoring side is 2:2:1, for example, 2 respectively. , 2 and 1.
  • the number of third VIP users on the third-level monitoring side can be retained in the initial configuration, and there is no need to increase it.
  • priority is given to ensuring that additional VIP users are allocated to the primary monitoring side and secondary monitoring side for use.
  • additional VIP users can According to the ratio of 1:1, it is evenly allocated to the first-level monitoring side and the second-level monitoring side.
  • a first VIP user can be assigned to the first-level monitoring side, and then a second VIP user can be allocated to the second-level monitoring side.
  • VIP users are added alternately between the first-level monitoring side and the second-level monitoring side, one each time. After the adjustment is completed, the number of additional first-level VIP users on the first-level monitoring side should be greater than or equal to the number of additional first-level VIP users on the second-level monitoring side. Increase the number of second VIP users.
  • FIG. 2 it is a schematic diagram of an application scenario of a monitoring system based on digital converter stations provided by the embodiment of the present application.
  • the monitoring system is applied to "headquarters-province-factory station"
  • the three-level system architecture based on the distributed computing resources deployed at the three levels, and based on the user permissions of users at all levels, all the video convergence resources of VIP users at the headquarters, provincial side and factory sites are deployed on the station side, and the headquarters The video convergence resources for all ordinary users on the provincial side are deployed locally at the headquarters and locally at the provincial side.
  • VIP users need to see the video fusion picture of any monitored area in the factory site in real time, and each VIP user can control the perspective of the video fusion picture or switch the video captured by any camera in the factory site and re-process the video fusion.
  • Graphic resources need to be allocated in the factory site for video fusion processing for each online VIP user at the headquarters, provincial side and factory site; ordinary users need to see the video fusion screen in a specific area of the factory site, and each ordinary user can control the video by themselves From the perspective of the fused screen, it is necessary to allocate graphics resources locally at the headquarters and the provincial side for video fusion processing for online ordinary users at the headquarters and provincial sides.
  • the headquarters VIP user video fusion resource pool allocates resources for video fusion processing to all VIP users on the station side, provincial side and headquarters.
  • resources are allocated locally for ordinary users in the province for video fusion processing.
  • resources are allocated for ordinary users at the headquarters. Allocate resources for video fusion processing.
  • the video fusion application of the headquarters in Figure 2 is the application embodiment of the first video fusion processing module in the above embodiment, and the video fusion application on the provincial side is the second video in the above embodiment.
  • the application embodiment of the fusion processing module, the video fusion application of the factory site, is the application embodiment of the third video fusion processing module in the above embodiment. Based on the application scenario shown in Figure 2, the specific implementation process of the video fusion processing is as follows :
  • Video streams in specific areas designated by superiors are uploaded by the video distribution component to the provincial side;
  • the provincial side uses the video distribution component to upload the video stream in a specific area to the headquarters and forward it to the provincial local video convergence resource maintenance;
  • resources will be allocated to the provincial ordinary users for video fusion processing.
  • virtual machine resources including vCPU, storage, vGPU and video memory, etc.
  • launch the video fusion application i.e., the second video fusion processing module in the above embodiment.
  • the video fusion application performs video fusion processing on the received video stream of a specific area, and accordingly obtains the video fusion picture and displays it. ;
  • it also receives operation instructions such as perspective control from ordinary users on the provincial side, and the video fusion application responds to the operation instructions from ordinary users on the provincial side, and performs corresponding operation control on the currently displayed video fusion screen;
  • resources will be allocated to the headquarters ordinary users for video fusion processing. Specifically: allocate virtual machine resources (including vCPU, storage, vGPU and video memory, etc. ) and launch the video fusion application (i.e., the first video fusion processing module in the above embodiment), the video fusion application performs video fusion processing on the received video stream of a specific area, and accordingly obtains the video fusion picture and displays it; in addition, It also receives operation instructions such as perspective control from ordinary users at the headquarters, and the video fusion application responds to the operation instructions from ordinary users at the headquarters and performs corresponding operation controls on the currently displayed video fusion screen;
  • virtual machine resources including vCPU, storage, vGPU and video memory, etc.
  • the video fusion application performs video fusion processing on the received video stream of a specific area, and accordingly obtains the video fusion picture and displays it; in addition, It also receives operation instructions such as perspective control from ordinary users at the headquarters, and the video fusion application responds to the operation instructions from ordinary users at the
  • the video conferencing system from the provincial side to the station side and the headquarters to the station side calls the VIP video fusion application on the station side (that is, the third video fusion processing module in the above embodiment), and the video fusion application on the station side serves as the headquarters VIP user
  • the headquarters and provincial sides can access the video fusion images that have been integrated for VIP users on the station side; in addition, the headquarters and provincial sides can also issue control instructions to the VIP video fusion applications on the station side. You can control the viewing angle or switch the video captured by any camera in the site to perform video fusion processing again.
  • the VIP users at the headquarters and provincial sides are configured with video conferencing client resources, and they can freely access the videos on the site through remote video conferencing.
  • the site prepares video integration resources for VIP users at the headquarters and provincial sides.
  • VIP Users can switch to the video stream of ordinary users; for ordinary users at the headquarters and provincial sides: Ordinary users at the headquarters and provincial sides share the video stream in a specific area and can switch on demand. As ordinary users increase, the consumed wide area network bandwidth remains unchanged. , and adopts multi-level access and distribution, uploading the same video stream for multiple ordinary users to access, and realizing video integration of multiple video streams locally at the headquarters and the provincial side.
  • video convergence applications can be divided into different levels of user permissions based on different functions and operational requirements, including ordinary users and VIP users.
  • Ordinary users are only deployed on the provincial side and the headquarters, and VIP users are distributed in stations, provinces, etc. , the third level of the headquarters; the video fusion for VIP users is all performed on the station side.
  • VIP users can review the merged videos on the station side and view the required areas at will; at the same time, the station side uploads multiple video streams of specific areas to the provincial side.
  • headquarters, the provincial side and headquarters will fuse the video stream with measurement point and other data to obtain video fusion pictures for ordinary users at the provincial side and headquarters to review.
  • Ordinary users can use the virtualized video fusion computing power to Have a unique view of video fusion footage of the same specific area and perform operations; among them, the video fusion for ordinary users on the provincial side is only performed on the provincial side, and the fused video fusion images are directly retrieved from the provincial side, while the video fusion for ordinary users at the headquarters is performed directly on the headquarters, and the merged video images are retrieved directly from the headquarters. View the fused video fusion picture.
  • FIG 3 is a schematic diagram of another application scenario of a monitoring system based on digital converter stations provided by an embodiment of the present application.
  • the monitoring system is applied to "headquarters-province-factory station" "In the three-level system architecture, by detecting the network bandwidth of the network pipes between the headquarters and the province, and between the province and the factory site, the available bandwidth and minimum delay time of the network can be detected in real time, and the headquarters-province-factory site can be generated Available bandwidth view (shown on the right side of Figure 3).
  • the three cylinders represent the available bandwidth between the headquarters and the provincial side, the available bandwidth between the provincial side and factory site 1, and the available bandwidth between the provincial side and factory site 2. Available bandwidth), which can be allocated and used by user permissions based on the detected network available bandwidth.
  • the theoretical basis of network bandwidth detection is: the wide area network is shared by multiple services and users, and the available bandwidth and link delay are constantly changing, which is difficult to perceive at the data sending end.
  • the available network resources are composed of available bandwidth and buffers, which can be Delay is sensed through packets in transit. Through the change of delay, the time point when the packet sending rate exceeds the available bottleneck bandwidth and enters the buffer can be sensed. Based on the packet sending rate at this time point, the bottleneck bandwidth can be inferred. Through packet loss, the time point when the buffer is full and overflows can be sensed, and the buffer size can be calculated.
  • the functions that can be realized by the network bandwidth and user management application in Figure 3 are the network bandwidth detection functions that can be realized by the network detection module in the above embodiment and the user permissions that can be realized by the video fusion processing module.
  • the integrated embodiment of management functions, network bandwidth detection is scheduled based on user bandwidth requirements, and has the following characteristics: 1. Based on the available network bandwidth, network bandwidth and user management applications can intelligently allocate and switch between VIP users and ordinary users; 2. When When network bandwidth resources are sufficient, all users can be configured as VIP users with VIP user rights; 3. When network bandwidth resources are insufficient, some unimportant video service user rights can be switched to ordinary user rights as needed; through this This scheduling solution can achieve the best balance between user experience and network resource utilization.
  • Real-time detection Network bandwidth and user management applications deployed at all levels conduct real-time detection of the available bandwidth and minimum delay of the network between the headquarters and the provincial side, and between the provincial side and the factory site, so as to Determine the maximum message sending rate, track it in real time, and adjust and refresh the network status in a timely manner;
  • the network bandwidth and user management application After the network bandwidth and user management application generates corresponding user permission adjustment suggestions based on the detection results of network bandwidth detection, it calls the video conferencing user management application at all levels to allocate VIP users.
  • the number of VIP users starts the user client as needed, and allocates virtual machine resources to access the site-side integrated video fusion screen; after the network bandwidth and user management application are allocated to ordinary users, the video fusion application is called, and the video fusion application is called according to the number of ordinary users. Allocate virtual machines and graphics resources, launch the corresponding ordinary user client, perform video fusion processing on the specific area video stream forwarded by the video distribution component, and present the video fusion screen in real time after the user logs in;
  • the user characteristics are: VIP users remotely call the station side from the provincial side and the headquarters after integration processing The video fusion picture; ordinary users share the video stream uploaded in a specific area, and ordinary users call graphics resources locally to perform video fusion processing.
  • the characteristics of network resource requirements are as follows: for VIP users on the provincial side and the headquarters, each VIP user needs to occupy an exclusive share of bandwidth; ordinary users on the provincial side and the headquarters share the video streams uploaded in a specific area, and all ordinary users only occupy one share of bandwidth.
  • the characteristics of the application component are: network bandwidth and user management applications, which can detect changes in available bandwidth in real time, generate a view of network available bandwidth resources between the station side and the provincial side, and between the provincial side and the headquarters, and based on this view, provide VIP users with The number and number of ordinary users are adjusted to ensure that the overall bandwidth occupied between the station side and the provincial side, and between the provincial side and the headquarters does not exceed the currently available bandwidth of the network.
  • the technical indicators of video fusion require: 1) Within the same monitoring field of view, a single monitoring terminal supports no less than 8 channels of 1080P high-definition video in real time Fusion and splicing display; 2) Supports no less than 8 channels of 1080P spliced video synchronous playback function; 3) The average 3D rendering frame rate is no less than 25 frames/second.
  • the site pulls the stream from the video component, performs video fusion operations on the site's virtual machine, and performs frame integration through desktop push streaming.
  • Each fused video stream consumes The push bandwidth of the system is about 20 ⁇ 25M. If the original video stream is sent to the headquarters, it will also consume the communication bandwidth from the station to the headquarters. When the business is relatively busy, there will be insufficient bandwidth and the video fusion screen and operation will be stuck. Due to the pause problem, the picture frame rate will generally be reduced to 5 to 10 frames/second.
  • the video fusion processing modules are deployed in monitoring terminals at all levels, and streams are pulled from the station-side video components.
  • the video fusion services of ordinary users can be performed locally using local computing resources. Completed, the distributed deployment of computing resources is realized, and multi-user concurrency is realized based on the video distribution capability of the video component; among them, the network bandwidth occupied by a single video stream is about 4M. According to the technical index requirements, if 8 video streams are considered In the extreme working conditions of convergence, the total video stream upload bandwidth occupies about 32M. In the embodiment of this application, all ordinary users focus on the same designated monitored area, which can be realized through fixed 8-channel video stream upload.
  • the embodiments of this application can be used to reduce the upload bandwidth to 7-10M.
  • the operation experience and picture frame rate of the remote end are the same as those of the station end, and can be maintained at more than 25 frames/second. If the remote server hardware configuration is relatively High, the screen refresh frame rate will be increased to more than 30 frames/second.
  • the hierarchical deployment solution greatly reduces the bandwidth requirements for long-distance network transmission and communication, and users can hardly feel the delay.
  • the hierarchical deployment solution greatly reduces the bandwidth requirements for long-distance network transmission and communication, and users can hardly feel the delay.
  • the embodiment of the present application also provides a monitoring method based on a digital converter station.
  • the method is suitable for the monitoring system based on a digital converter station described in any of the above embodiments.
  • the monitoring system includes a monitoring method deployed at the first level.
  • the first monitoring terminal, the second monitoring terminal and the third monitoring terminal each include at least a communication module, a human-computer interaction module, an equipment status monitoring module, an equipment alarm management module, a video fusion processing module and Data transmission control module, the third monitoring terminal also includes a data storage module, the data storage module is configured to store digital converter station data; the method includes:
  • Communication between the first monitoring terminal, the second monitoring terminal and the third monitoring terminal is realized through the communication module; all equipment of the digital converter station is monitored and managed through the equipment status monitoring module Account information, operation information and monitoring data; manage the alarm information of all equipment of the digital converter station through the equipment alarm management module; receive monitoring and access requests from users on the local monitoring side through the human-computer interaction module ;
  • Each of the video fusion processing modules responds to the monitoring access request of the user on the local monitoring side, and uses the original video fusion data in the digital converter station data to perform video fusion processing to obtain the user access for the local monitoring side.
  • each of the data transmission control modules in the process of transmitting service data from a local monitoring terminal to another monitoring terminal, when the preset rate adjustment condition of the service data is triggered, according to the rate adjustment condition before being triggered, The detected network available bandwidth and minimum delay time, the delay time detected when the rate adjustment condition is triggered, and the delay recovery time configured based on the data type of the service data are used to adjust the current data of the service data transmission rate to continue transmitting the service data to another monitoring terminal according to the adjusted data transmission rate.
  • the rate adjustment condition is triggered according to the rate adjustment condition.
  • Data transmission rate to continue transmitting the service data to another monitoring terminal according to the adjusted data transmission rate specifically including:
  • the data transmission control module in the process of transmitting service data from a local monitoring terminal to another monitoring terminal, when the preset rate adjustment condition of the service data is triggered, the detection before the rate adjustment condition is triggered is obtained.
  • the data transmission control module adjusts the current data transmission rate of the service data according to the rate adjustment target value S2' to obtain the adjusted data transmission rate S0', and the adjusted data transmission rate S0' satisfies S0' ⁇ S2', continue to transmit the service data to another monitoring terminal according to the adjusted data transmission rate S0'.
  • the delayed recovery time is obtained by the data transmission control module querying a preset delayed recovery schedule according to the data type of the business data; wherein the delayed recovery timetable includes at least one type of data Type and its corresponding configured delayed recovery time.
  • the third monitoring terminal also includes a fault wave recording management module, a data report management module, a digital station area management module and a remote intelligent patrol module;
  • the fault wave recording management module is configured to manage the fault wave recording files of the digital converter station and perform online analysis based on the fault wave recording files;
  • the data report management module is configured to collect statistics on the business data of the digital converter station, display historical data, statistical data and analytical data in different report forms according to the operation and maintenance requirements of the digital converter station, and implement reports Task formulation function, automatic report generation function, report export function and report printing function;
  • the digital station area management module is configured to monitor and manage the security, fire protection and power environment of the digital converter station with the station area of the digital converter station as the main body;
  • the remote intelligent inspection module is configured to control the monitoring device to carry out joint inspection operations of indoor and outdoor equipment, analyze the inspection data, and form inspection results and inspection reports.
  • the digital converter station has unified common components, the common components include business components and data components, and the business components and the data components are configured to provide various application systems of the digital converter station with Unify and standardize business function interfaces and basic data services, and formulate unified data interaction protocols and data interaction formats to provide a unified data service interface for the third monitoring terminal.
  • the common components include business components and data components
  • the business components and the data components are configured to provide various application systems of the digital converter station with Unify and standardize business function interfaces and basic data services, and formulate unified data interaction protocols and data interaction formats to provide a unified data service interface for the third monitoring terminal.
  • the digital converter station has a unified basic application, which is constructed using unified basic software and hardware facilities, a unified data model, a unified data service specification and a unified application development specification.
  • the basic applications include a whole-station video control application, a whole-station three-dimensional presentation application, an equipment status overview application, an equipment alarm overview application, a fault wave recording management application, an intelligent report management application, a digital station area management application, and a remote intelligent inspection.
  • the whole-site video management and control application and the whole-site three-dimensional rendering application are configured to provide services for the video fusion processing module
  • the equipment status overview application is configured to provide services for the equipment status monitoring module
  • the equipment The alarm overview application is configured to provide services for the equipment alarm management module
  • the fault recording management application is configured to provide services for the fault recording
  • the wave management module provides services
  • the intelligent report management application is configured to provide services for the data report management module
  • the digital station area management application is configured to provide services for the digital station area management module
  • the remote intelligent patrol application Configured to provide services for the remote intelligent patrol module.
  • the user on the primary monitoring side is used as the first user
  • the video fusion processing module of the first monitoring terminal is used as the first video fusion processing module; the method further includes:
  • User rights management is performed on the first user through the first video fusion processing module to configure the first user as a first ordinary user or a first VIP user; wherein the first ordinary user is configured as Have the authority to view the video fusion picture of the designated monitored area of the digital converter station, and the first VIP user is configured to have the authority to view the video fusion picture of all monitored areas of the digital converter station;
  • the first video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user configured as the local monitoring side.
  • the video fusion images retrieved include:
  • the specified data in the digital converter station data is Obtain the original video fusion data of the area to be viewed from the original video fusion data of the monitored area, and use the computing resources of the first monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, to obtain the configuration of the first Video fusion images accessed by ordinary users.
  • the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module
  • the first video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user information for the local monitoring side.
  • the video fusion images recalled also include:
  • the first video fusion processing module When the first user is the first VIP user, the first video fusion processing module responds to the monitoring call request of the first VIP user and sends the first video to the third video fusion processing module.
  • a fusion request, the first video fusion request includes an identification of the area to be viewed;
  • the third video fusion processing module obtains the original video fusion data of all monitored areas in the digital converter station data according to the area identification to be viewed in the first video fusion request. View the original video fusion data of the area, and use the computing resources of the third monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, obtain the video fusion picture for the first VIP user and send it to The first video fusion processing module;
  • the first video fusion processing module receives and obtains the video fusion picture for the first VIP user to call.
  • the user on the secondary monitoring side is used as the second user, and the video fusion processing module of the second monitoring terminal is used as the second video fusion processing module; the method further includes:
  • User rights management is performed on the second user through the second video fusion processing module to configure the second user as a second ordinary user or a second VIP user; wherein the second ordinary user is configured as Have the authority to view the video fusion picture of the designated monitored area of the digital converter station, and the second VIP user is configured to have the authority to view the video fusion picture of all monitored areas of the digital converter station;
  • the second video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user information for the local monitoring side.
  • the video fusion images retrieved include:
  • the second video fusion processing module in response to the monitoring call request of the second ordinary user, from the specified data in the digital converter station data Obtain the original video fusion data of the area to be viewed from the original video fusion data of the monitored area, and use the computing resources of the second monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, to obtain the original video fusion data for the second monitoring terminal.
  • Video fusion images accessed by ordinary users.
  • the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module
  • the second video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user information for the local monitoring side.
  • the video fusion images recalled also include:
  • the second video fusion processing module responds to the monitoring call request of the second VIP user and sends the second video to the third video fusion processing module.
  • a fusion request, the second video fusion request includes an identification of the area to be viewed;
  • the third video fusion processing module obtains the original video fusion data of all monitored areas in the digital converter station data according to the area identification to be viewed in the second video fusion request. View the video fusion original data of the area, and use the computing resources of the third monitoring terminal to perform video fusion processing on the video fusion original data of the area to be viewed, obtain the video fusion picture for the second VIP user to review and send it to The second video fusion processing module;
  • the video fusion picture for the second VIP user is received and obtained through the second video fusion processing module.
  • the user on the third-level monitoring side is used as the third user, and the video fusion processing module of the third monitoring terminal is used as the third video fusion processing module; the method further includes:
  • the third video fusion processing module performs user rights management on the third users to configure the third users as third VIP users; wherein, the third VIP users are configured to have the authority to view all Video fusion pictures of all monitored areas of the digital converter station;
  • the third video fusion processing module responds to the monitoring call request of the user on the local monitoring side, uses the original video fusion data in the digital converter station data to perform video fusion processing, and obtains the user information for the local monitoring side.
  • the video fusion images retrieved include:
  • the third user is the third VIP user
  • the third video fusion processing module in response to the monitoring call request of the third VIP user, all the video files in the digital converter station data are Obtain the original video fusion data of the area to be viewed from the original video fusion data of the monitored area, and use the computing resources of the third monitoring terminal to perform video fusion processing on the original video fusion data of the area to be viewed, and obtain the original video fusion data for the area to be viewed.
  • Video fusion screen accessed by VIP users.
  • the second monitoring terminal is used as a data sending end and the first monitoring terminal is used as a data receiving end, or the third monitoring terminal is used as a data sending end and the second monitoring terminal is used as a data receiving end.
  • the data sending end also includes a network detection module; the method also includes:
  • Network bandwidth detection is performed regularly through the network detection module to detect the connection between the data sending end and The network available bandwidth and minimum delay time between the corresponding data receiving ends, and when each detection is completed, only the last detected network available bandwidth and minimum delay time are recorded, so as to report to the corresponding data receiving end when needed.
  • the initial data transmission rate of the video convergence service data is determined based on the currently recorded network available bandwidth.
  • the network bandwidth detection is performed regularly through the network detection module to detect the available network bandwidth and minimum delay time between the data sending end and the corresponding data receiving end, specifically including:
  • detection packets are sent to the corresponding data receiving end in sequence according to the increasing packet sending rate, and the RTT value and the corresponding RTT value of each detection packet sent are recorded.
  • the network detection module When the network detection module first determines that the RTT value has increased, the time point when the RTT value increases is recorded as T1, and the last time point before T1 when the RTT value remains unchanged is recorded as T0, which is determined based on the RTT value corresponding to T0.
  • the minimum delay time determines the available network bandwidth between the data sending end and the corresponding data receiving end based on the last message sending rate before T1.
  • detection messages are sent to the corresponding data receiving end in sequence according to an increasing message sending rate, specifically including:
  • the upper limit of available bandwidth is obtained based on the maximum egress bandwidth of the local data sending end and the bandwidth occupancy experience value of the local data sending end;
  • the network detection module sets a rate adjustment threshold according to the upper limit of the available bandwidth, and in the process of sequentially sending detection messages to the corresponding data receiving end according to the increasing message sending rate, when the message sending rate is less than the
  • the rate adjustment threshold is set, detection packets are sent to the corresponding data receiving end in sequence according to the increasing message sending rate according to the first increase.
  • detection messages are sent according to the second increase.
  • the amplitude is to sequentially send detection messages to the corresponding data receiving end according to the increasing message sending rate; wherein the first increasing amplitude is greater than the second increasing amplitude.
  • the method further comprises: when the local monitoring terminal needs to transmit video fusion service data to another monitoring terminal, the data transmission control module sequentially enters the first transmission stage, the second transmission stage and the third transmission stage of the data transmission process until the data transmission is completed, and then ends the data transmission process; wherein,
  • the first transmission stage obtain the network available bandwidth and minimum delay time currently recorded by the local network detection module, and determine the initial data transmission rate of the video fusion service data according to the obtained network available bandwidth, so as to determine the initial data transmission rate of the video fusion service data according to the obtained network available bandwidth.
  • the initial data transmission rate begins to transmit video convergence service data to another monitoring terminal until it is determined that the preset rate adjustment condition is triggered, and then the second transmission stage is entered; wherein the rate adjustment condition is the first determination that the RTT value increases reaches the preset delay time threshold, or receives a packet loss report for the first time;
  • the delay time detected when the rate adjustment condition is triggered, and the data type and monitoring call requesting user based on the video convergence service data According to the target delay recovery time configured for the user type, adjust the current data transmission rate of the video convergence service data to continue transmitting the video convergence service data to another monitoring terminal according to the adjusted data transmission rate until it is determined that the rate adjustment condition is Delay detected when triggering When the time returns to the obtained minimum delay time, enter the third transmission stage;
  • the local network detection module is triggered to perform network bandwidth detection to detect and record local monitoring
  • the network available bandwidth and minimum delay time between the terminal and another monitoring terminal are obtained, and the network available bandwidth and minimum delay time currently recorded by the local network detection are obtained, and the data of the video fusion service data is determined based on the obtained network available bandwidth.
  • transmission rate and continue to transmit video convergence service data to another monitoring terminal according to the determined data transmission rate, until it is determined that the rate adjustment condition is triggered, and then returns to the second transmission stage.
  • the target delay recovery time is obtained by the data transmission control module querying the preset delay recovery schedule according to the data type of the video fusion service data and the user type of the monitoring call requesting user; wherein, the delay recovery time is
  • the time recovery schedule includes at least one data type, a user type corresponding to each data type, and a configured delay recovery time corresponding to each user type.
  • the data type includes video convergence service data
  • the user type includes For ordinary users and VIP users, the higher the priority of the business data corresponding to each data type, the smaller the corresponding configured delayed recovery time.
  • the corresponding configured delayed recovery time for ordinary users It is greater than the delayed recovery time corresponding to the VIP user configuration.
  • the delay time threshold is set according to the currently recorded minimum delay time.
  • the user on the first-level monitoring side is regarded as the first user
  • the user on the second-level monitoring side is regarded as the second user
  • the user on the third-level monitoring side is regarded as the third user
  • the user on the first monitoring terminal is
  • the video fusion processing module serves as the first video fusion processing module
  • the video fusion processing module of the second monitoring terminal serves as the second video fusion processing module
  • the video fusion processing module of the third monitoring terminal serves as the third video fusion processing module
  • the second monitoring terminal further includes a second network detection module
  • the third monitoring terminal further includes a third network detection module
  • the method further includes:
  • the second network detection module periodically performs network bandwidth detection to detect the available network bandwidth between the second monitoring terminal and the first monitoring terminal, and sends the currently detected first network available bandwidth to the first monitoring terminal.
  • the first video fusion processing module ;
  • the third network detection module periodically performs network bandwidth detection to detect the network available bandwidth between the third monitoring terminal and the second monitoring terminal, and sends the currently detected second network available bandwidth to the The first video fusion processing module;
  • the first ordinary user and the second ordinary user are configured to have permission to view the video fusion picture of the designated monitored area of the digital converter station
  • the first VIP user and the second VIP user and the third VIP user is configured to have permission to view all of the digital converter stations Video fusion picture of the surveillance area.
  • the adjusting the number of first VIP users or/and the number of second VIP users according to the available bandwidth of the first network and the available bandwidth of the second network specifically includes:
  • the available bandwidth of the first network, the available bandwidth of the second network, and the number of second VIP users need to be kept unchanged.
  • the second remaining network bandwidth is obtained according to the first network available bandwidth, the second network available bandwidth, the network bandwidth occupied by the first ordinary user and the network bandwidth occupied by the basic number of the first VIP users, and the number of the second VIP users is adjusted according to the second remaining network bandwidth;
  • the third remaining network bandwidth is obtained according to the first network available bandwidth, the second network available bandwidth and the network bandwidth occupied by the first ordinary user, and the number of the first VIP users and the number of the second VIP users are adjusted according to the third remaining network bandwidth.
  • the adjusting the number of first VIP users according to the first remaining network bandwidth specifically includes:
  • the first video fusion processing module determines whether the first remaining network bandwidth is greater than the preset first bandwidth threshold. If so, configure at least M first users as the first VIP users; if not , then the network bandwidth occupied by the first ordinary user is released, and at least M first users are configured as the first VIP users according to the first remaining network bandwidth and the network bandwidth occupied by the first ordinary user. ;
  • M represents the basic number of first VIP users that need to be maintained, M ⁇ 1, and the first bandwidth threshold is set according to the network bandwidth occupied by the M first VIP users.
  • the adjusting the number of first VIP users according to the first remaining network bandwidth specifically includes:
  • the first video fusion processing module determines whether the first remaining network bandwidth is greater than the network bandwidth occupied by one of the first VIP users. If so, configure at least one of the first users as the first VIP user. ; If not, configure all first users as first ordinary users.
  • adjusting the number of second VIP users according to the second remaining network bandwidth specifically includes:
  • the first video fusion processing module determines whether the second remaining network bandwidth is greater than the preset second bandwidth threshold. If so, a VIP user addition instruction is sent to the second video fusion processing module; if not, a VIP user addition instruction is sent to the second video fusion processing module.
  • the second video fusion processing module sends a normal user disabling instruction;
  • the second video fusion processing module configures at least N second users as the second VIP users according to the VIP user adding instruction, or releases the second ordinary users according to the ordinary user disabling instruction.
  • the occupied network bandwidth is based on the second remaining network bandwidth and the second normal
  • the network bandwidth occupied by users configures at least N second users as the second VIP users;
  • N represents the basic number of second VIP users that need to be maintained, N ⁇ 1, and the second bandwidth threshold is set according to the network bandwidth occupied by N second VIP users.
  • the first video fusion processing module adjusts the number of second VIP users according to the second remaining network bandwidth, specifically including:
  • the first video fusion processing module determines whether the second remaining network bandwidth is greater than the network bandwidth occupied by one of the second VIP users. If so, a VIP user addition instruction is sent to the second video fusion processing module; if If not, send a VIP user reduction instruction to the second video fusion processing module;
  • the second video fusion processing module configures at least one of the second users as the second VIP user according to the VIP user increase instruction, or configures all the second users according to the VIP user decrease instruction. Configure as the second ordinary user.
  • the adjusting the number of first VIP users and the number of second VIP users according to the third remaining network bandwidth specifically includes:
  • the first video fusion processing module determines whether the third remaining network bandwidth is greater than the preset third bandwidth threshold. If so, configure at least M first users as the first VIP users, and provide The second video fusion processing module sends a VIP user adding instruction; if not, the network bandwidth occupied by the first ordinary user is released, and the network bandwidth occupied by the first ordinary user is added according to the third remaining network bandwidth and the network bandwidth occupied by the first ordinary user. At least M first users are configured as the first VIP users, and send ordinary user disabling instructions to the second video fusion processing module;
  • the second video fusion processing module configures at least N second users as the second VIP users according to the VIP user adding instruction, or releases the second ordinary users according to the ordinary user disabling instruction. Occupied network bandwidth, configure at least N second users as the second VIP users according to the third remaining network bandwidth and the network bandwidth occupied by the second ordinary users;
  • M represents the basic number of the first VIP users that need to be maintained, M ⁇ 1, and N represents the basic number of the second VIP users that need to be maintained, N ⁇ 1, and the third bandwidth threshold is based on M
  • the network bandwidth occupied by the first VIP user and the network bandwidth occupied by the N second VIP users are set.
  • the increased number of first VIP users is not less than the increased number of second VIP users. quantity.
  • the monitoring method based on a digital converter station provided by the embodiment of the present application can realize all the processing procedures in the monitoring system based on the digital converter station described in any of the above embodiments.
  • the specific monitoring method is:
  • the processing solution and the technical effects achieved are respectively the same as the monitoring processing solution and the technical effects achieved by the monitoring system based on the digital converter station described in the above embodiments, and will not be described again here.
  • the monitoring system and method based on digital converter stations provided by the embodiments of this application have the following beneficial effects:
  • the first monitoring terminal, the second monitoring terminal and the third monitoring terminal can respond locally to the local monitoring side.
  • Users' monitoring and access requests do not need to be responded to by the station at all levels of monitoring.
  • users can directly view the video fusion images locally without accessing from the remote end, effectively alleviating the need for multiple station-side responses.
  • the pressure of concurrent user access can effectively reduce network latency, improve the real-time performance of video screen display, and improve the use effect and user experience of video fusion applications under the premise of limited computing resources and network bandwidth resources at the site, making it at the first level
  • the user experience at three different locations: the monitoring side, the secondary monitoring side and the tertiary monitoring side is consistent;
  • the process of transmitting business data between the first monitoring terminal, the second monitoring terminal and the third monitoring terminal is achieved.
  • the rate adjustment condition when the rate adjustment condition is triggered, it can be based on the available network bandwidth and minimum delay time detected before the rate adjustment condition is triggered, the delay time detected when the rate adjustment condition is triggered, and the data based on the service data to be transmitted.
  • the delay recovery time configured by the type adjusts the current data transmission rate of the business data, so that the appropriate data transmission rate can be configured for the business data before the business data is sent out, effectively avoiding the delay in the transmission process after the business data is sent out.
  • the uncontrollable network delay in the network brings about the difficult-to-solve problem of network delay, which reduces the difficulty of solving the network delay problem;
  • the delay recovery time configured for the data type of the transmitted business data is used to adjust the current data transmission rate of the business data.
  • the adjustment value of the data transmission rate can be accurately determined, and the available network bandwidth and minimum detected before the rate adjustment condition is triggered.
  • the delay time and the delay time detected when the rate adjustment condition is triggered are parameter values that are more in line with the real-time network status.
  • the delay recovery time configured based on the data type of the business data is a parameter value that is more in line with user needs.
  • Parameter values are used to determine the adjustment value of the data transmission rate in real time, so that the adjusted data transmission rate is more suitable for the current network status and user needs, thereby improving the accuracy of the data transmission rate adjustment and improving the adaptability of the rate adjustment scheme.
  • the rate adjustment scheme provided by the embodiment of the present application can be used to adjust the data transmission rate of the service data in real time, and for each data type of service data It is said that the specific rate adjustment scheme is only carried out during the transmission process of business data of the same data type, and the data transmission rate of all data types of business data will not be adjusted in the same way. Therefore, the data transmission rate of other data types will not be adjusted in the same way.
  • the data transmission process of business data will not affect the use experience of other business functions;
  • Business data can be configured with different priorities (or importance) according to different data types. For example, video convergence business data has relatively high time requirements, and the corresponding configuration priority is relatively high, and other data types of business data have higher time requirements. The time requirement is relatively low, and the priority of the corresponding configuration is relatively low.
  • the priority of the business data matches the delay recovery time, which can meet the needs of business data with different priorities. Different delayed recovery requirements, the network The available bandwidth of the network is allocated to business data with higher priority, thereby achieving optimal configuration of network resources and improving the flexibility of the rate adjustment scheme;
  • the rate adjustment scheme provided by the embodiments of this application can achieve accurate adjustment of the data transmission rate without relying on intermediate devices.
  • the rate adjustment scheme is simple, easy to deploy and implement, takes up less resources, and is highly practical.

Abstract

本申请公开了一种基于数字换流站的监控系统及方法,所述监控系统包括部署在一级监控侧的第一监控终端、部署在二级监控侧的第二监控终端和部署在三级监控侧的第三监控终端,各级监控终端均包括通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块,通过在各级监控终端分别部署视频融合处理模块,能够由各级监控终端在本地响应各级用户的监控调阅请求,无需由站端全部响应各级用户的监控调阅请求,用户可以从本地直接查看视频融合画面,无需从远端调阅,从而能够在网络带宽资源有限的前提下,有效降低网络延迟,提高视频画面显示的实时性,提高视频融合应用的使用效果及用户体验。

Description

一种基于数字换流站的监控系统及方法
相关申请的交叉引用
本申请基于申请号为202211113105.9、申请日为2022年09月14日,申请名称为“一种基于数字换流站的监控系统及方法”的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此以引入方式结合在本申请中。
技术领域
本申请涉及数据处理技术领域,尤其涉及一种基于数字换流站的监控系统及方法。
背景技术
目前,电力系统通过采用“总部-省-站”三级体系架构实现远程管理,在该三级体系架构中,“总部”可以指电网系统总部,“省”可以指电网系统省级单位,“站”可以指换流站。随着电力系统的多样化发展,要求该三级体系架构具有多种能力,以实现多种功能,使电力系统得到全面、高效地管理,并满足电力系统的多样化功能需求。以视频融合功能为例,在该三级体系架构中,用户在电网系统总部、电网系统省级单位和换流站处均能够灵活调阅视频画面,将现有的视频融合及远程调用技术应用在该三级体系架构中,采用三级远程访问模式,具体实现过程如下:
(1)在“总部-省-站”三级体系架构中的换流站所在的站端,部署视频融合渲染引擎以及视频融合所需的软硬件资源,视频融合渲染引擎具备视频处理、三维处理、视频融合渲染和交互等能力;
(2)在需要使用视频融合渲染引擎的位置部署视频融合应用前端,通过远程交互的方式访问视频融合渲染引擎:用户在远端(电网系统总部或电网系统省级单位)使用视频融合应用时,利用视频融合相关组件在远端与站端之间建立专属会话,通过专属会话远程访问站端部署的渲染引擎;渲染引擎读取三维模型、场景资源等预设的三维模型场景数据,调取站端的摄像头、巡视机器人等图像/视频采集装置所采集的实时图像/视频数据,动态汇集量测、台账等电力系统业务数据,并使用GPU、CPU等计算资源,将各路数据融合渲染成可以与用户交互的画面;渲染引擎对交互画面进行编码,将交互画面以数据流的形式通过网络推送给远端用户。
在上述实现过程中,远端与站端之间的用户会话的维持需要占用大量的软硬件资源和网络带宽资源,而视频融合全部在站端完成,其中的三维视频融合渲染需要CPU、GPU等计算资源,视频融合过程中需要各种数据信息资源,信息资源的获取过程也有对计算资源和网络带宽资源的需求,并且站端通过用户 会话向远端推送视频融合交互画面也需要占用大量的网络带宽资源。但是,站端的计算资源和网络带宽资源是有限的,只能支持一定数量的用户的并发访问,而且视频融合应用所消耗的计算资源和网络带宽资源,会随着用户数量的增加而增加,严重影响站端视频融合时渲染引擎的渲染速度,导致远端调阅视频画面出现明显的网络延时。特别是在紧急故障情况下,随着电网系统总部、电网系统省级单位访问换流站站端进行远程指挥和会诊的需求增加,电网系统总部和电网系统省级单位在站端进行全景视频融合通常是对同一个站将其多个前端摄像头设备采集到的视频进行融合,导致带宽需求随用户数量线性增长,很快超过站-省出口带宽的上限,无法满足远程多专家监控和疑难会诊的要求。
此外,由于远端与站端之间一般相距较远,最远可达数千公里,中间还需要经过多级网络设备传输数据,因此,由数据传输延时、网络设备延迟和网络层次复杂度等因素给远端调阅视频画面所带来的网络延时也不可忽略,而远端与站端由于源宿端位置不一样,路径和距离不一样,网络带宽使用情况也不一样,导致数据的传输延时、发送延时和排队延时均不可控,使得网络延时存在不确定性,特别是电网系统总部到换流站站端的路径上还存在带宽争用,网络带宽不足会造成延时增大,调阅视频画面出现卡顿和丢包,导致处于电网系统总部、电网系统省级单位和换流站这三个不同位置处的用户体验不一致。
结合上述分析可知,采用现有的三级远程访问模式实现视频融合时存在较大的网络延时,并且网络延时的不可控性也给解决网络延时问题增加了难度,导致无法满足视频融合应用对交互延时的要求,视频画面显示的实时性较差,影响视频融合应用的使用效果及用户体验。
发明内容
本申请实施例的目的在于,提供一种基于数字换流站的监控系统及方法,通过在各级监控终端分别部署了各个功能模块特别是视频融合处理模块,能够由各级监控终端在本地响应各级用户的监控调阅请求,无需由站端全部响应各级用户的监控调阅请求,用户可以从本地直接查看视频融合画面,无需从远端调阅,从而能够在网络带宽资源有限的前提下,有效降低网络延迟,提高视频画面显示的实时性,提高视频融合应用的使用效果及用户体验。
为了实现上述目的,本申请实施例提供了一种基于数字换流站的监控系统,包括部署在一级监控侧的第一监控终端、部署在二级监控侧的第二监控终端和部署在三级监控侧的第三监控终端;所述监控系统的被监控对象包括部署在所述三级监控侧的数字换流站;所述第一监控终端、所述第二监控终端和所述第三监控终端均至少包括通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块,所述第三监控终端还包括数据存储模块,所述数据存储模块配置为存储数字换流站数据;
所述通信模块配置为实现所述第一监控终端、所述第二监控终端和所述第三监控终端之间的通信;所述设备状态监控模块配置为监控及管理所述数字换流站的所有设备的台账信息、运行信息和监测数据;所述设备告警管理模块配 置为管理所述数字换流站的所有设备的告警信息;所述人机交互模块配置为接收本地监控侧的用户的监控调阅请求;
每一所述视频融合处理模块配置为响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面;
每一所述数据传输调控模块配置为在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据。
进一步地,所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据,具体包括:
所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,获取所述速率调整条件被触发前探测到的网络可用带宽S0和最小延时时间RTT0、所述速率调整条件被触发时探测到的延时时间RTT2以及基于所述业务数据的数据类型配置的延时恢复时间t;
所述数据传输调控模块根据公式S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2;
所述数据传输调控模块根据公式n=(RTT2-RTT0)*S0计算获得进入缓冲区的业务数据量n;
所述数据传输调控模块根据公式S2’=S2-n/t计算获得所述业务数据的速率调整目标值S2’;
所述数据传输调控模块根据所述速率调整目标值S2’调整所述业务数据当前的数据传输速率,获得调整后的数据传输速率S0’,且调整后的数据传输速率S0’满足S0’≤S2’,以根据调整后的数据传输速率S0’继续向另一监控终端传输所述业务数据。
进一步地,所述延时恢复时间由所述数据传输调控模块根据所述业务数据的数据类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型及其对应配置的延时恢复时间,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小。
进一步地,所述第三监控终端还包括故障录波管理模块、数据报表管理模块、数字站区管理模块和远程智能巡视模块;
所述故障录波管理模块配置为对所述数字换流站的故障录波文件进行管理,并根据所述故障录波文件进行在线解析;
所述数据报表管理模块配置为对所述数字换流站的业务数据进行统计,根据所述数字换流站的运维需求以不同的报表形式展示历史数据、统计数据和分析数据,并实现报表任务制定功能、报表自动生成功能、报表导出功能和报表打印功能;
所述数字站区管理模块配置为以所述数字换流站的站区为主体,对所述数字换流站的安防、消防和动力环境进行监控和管理;
所述远程智能巡视模块配置为控制监测装置开展室内外设备联合巡视作业,并对巡视数据进行分析,形成巡视结果和巡视报告。
进一步地,所述数字换流站具有统一的公共组件,所述公共组件包括业务组件和数据组件,所述业务组件和所述数据组件配置为为所述数字换流站的各个应用系统提供基于统一规范的业务功能接口和基础数据服务,并制定统一的数据交互协议和数据交互格式,以为所述第三监控终端提供统一数据服务接口。
进一步地,所述数字换流站具有统一的基础应用,所述基础应用采用统一基础软硬件设施、统一数据模型、统一数据服务规范和统一应用开发规范进行构建。
进一步地,所述基础应用包括全站视频管控应用、全站三维呈现应用、设备状态总览应用、设备告警总览应用、故障录波管理应用、智能报表管理应用、数字站区管理应用和远程智能巡视应用;其中,所述全站视频管控应用和全站三维呈现应用配置为为所述视频融合处理模块提供服务,所述设备状态总览应用配置为为所述设备状态监控模块提供服务,所述设备告警总览应用配置为为所述设备告警管理模块提供服务,所述故障录波管理应用配置为为所述故障录波管理模块提供服务,所述智能报表管理应用配置为为所述数据报表管理模块提供服务,所述数字站区管理应用配置为为所述数字站区管理模块提供服务,所述远程智能巡视应用配置为为所述远程智能巡视模块提供服务。
进一步地,将所述一级监控侧的用户作为第一用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块;
所述第一视频融合处理模块还配置为对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;其中,所述第一普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
所述第一视频融合处理模块在所述第一用户为所述第一普通用户时,响应所述第一普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第一监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一普通用户调阅的视频融合画面。
进一步地,将所述第三监控终端的视频融合处理模块作为第三视频融合处 理模块;
则,所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,还包括:
所述第一视频融合处理模块在所述第一用户为所述第一VIP用户时,响应所述第一VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第一视频融合请求,所述第一视频融合请求中包括待查看区域标识;
所述第三视频融合处理模块根据所述第一视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一VIP用户调阅的视频融合画面并发送至所述第一视频融合处理模块;
所述第一视频融合处理模块接收获得用于所述第一VIP用户调阅的视频融合画面。
进一步地,将所述二级监控侧的用户作为第二用户,所述第二监控终端的视频融合处理模块作为第二视频融合处理模块;
所述第二视频融合处理模块还配置为对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;其中,所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第二VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,所述第二视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
所述第二视频融合处理模块在所述第二用户为所述第二普通用户时,响应所述第二普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第二监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第二普通用户调阅的视频融合画面。
进一步地,将所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
则,所述第二视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,还包括:
所述第二视频融合处理模块在所述第二用户为所述第二VIP用户时,响应所述第二VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第二视频融合请求,所述第二视频融合请求中包括待查看区域标识;
所述第三视频融合处理模块根据所述第二视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源 对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第二VIP用户调阅的视频融合画面并发送至所述第二视频融合处理模块;
所述第二视频融合处理模块接收获得用于所述第二VIP用户调阅的视频融合画面。
进一步地,将所述三级监控侧的用户作为第三用户,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
所述第三视频融合处理模块还配置为对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;其中,所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,所述第三视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
所述第三视频融合处理模块在所述第三用户为所述第三VIP用户时,响应所述第三VIP用户的监控调阅请求,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第三VIP用户调阅的视频融合画面。
进一步地,将所述第二监控终端作为数据发送端且所述第一监控终端作为数据接收端,或,将所述第三监控终端作为数据发送端且所述第二监控终端作为数据接收端;
则,所述数据发送端还包括网络探测模块;所述网络探测模块配置为定期进行网络带宽探测,以探测所述数据发送端与对应的所述数据接收端之间的网络可用带宽和最小延时时间,并在每一次探测完成时,仅记录最后一次探测到的网络可用带宽和最小延时时间,以在需要向对应的所述数据接收端传输视频融合业务数据时,根据当前记录的网络可用带宽确定视频融合业务数据的初始数据传输速率。
进一步地,所述网络探测模块定期进行网络带宽探测,以探测所述数据发送端与对应的所述数据接收端之间的网络可用带宽和最小延时时间,具体包括:
所述网络探测模块在每一次进行网络带宽探测时,按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,并记录每一次发送的探测报文对应的RTT值和报文发送速率;
所述网络探测模块在首次判定RTT值增大时,将RTT值增大的时间点记为T1,将T1之前的最后一个RTT值不变的时间点记为T0,根据T0对应RTT值确定最小延时时间,根据T1之前的最后一个报文发送速率确定所述数据发送端与对应的所述数据接收端之间的网络可用带宽。
进一步地,所述网络探测模块在每一次进行网络带宽探测时,按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,具体包括:
所述网络探测模块在每一次进行网络带宽探测时,根据本地数据发送端的最大出口带宽和本地数据发送端的带宽占用经验值,获取可用带宽上限;
所述网络探测模块根据所述可用带宽上限设置速率调整阈值,并在按照递 增的报文发送速率依次向对应的所述数据接收端发送探测报文的过程中,当报文发送速率小于所述速率调整阈值时,根据第一增加幅度按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,当报文发送速率不小于所述速率调整阈值时,根据第二增加幅度按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文;其中,所述第一增加幅度大于所述第二增加幅度。
进一步地,所述数据传输调控模块还配置为在本地监控终端需要向另一监控终端传输视频融合业务数据时,依次进入数据传输过程的第一传输阶段、第二传输阶段和第三传输阶段,直至数据传输完成时,结束所述数据传输过程;其中,
在所述第一传输阶段内,获取本地的所述网络探测模块当前记录的网络可用带宽和最小延时时间,根据获得的网络可用带宽确定视频融合业务数据的初始数据传输速率,以根据所述初始数据传输速率开始向另一监控终端传输视频融合业务数据,直至判定预设的速率调整条件被触发时,进入所述第二传输阶段;其中,所述速率调整条件为首次判定RTT值增大到预设的延时时间阈值,或,首次接收到丢包报告;
在所述第二传输阶段内,根据获得的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于视频融合业务数据的数据类型和监控调阅请求用户的用户类型配置的目标延时恢复时间,调整视频融合业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定所述速率调整条件被触发时探测到的延时时间恢复到获得的最小延时时间时,进入所述第三传输阶段;
在所述第三传输阶段内,在根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据的同时,触发本地的所述网络探测模块进行网络带宽探测,以探测并记录本地监控终端与另一监控终端之间的网络可用带宽和最小延时时间,获取本地的所述网络探测当前记录的网络可用带宽和最小延时时间,根据获得的网络可用带宽确定视频融合业务数据的数据传输速率,以根据确定的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定所述速率调整条件被触发时,返回所述第二传输阶段。
进一步地,所述目标延时恢复时间由所述数据传输调控模块根据视频融合业务数据的数据类型和监控调阅请求用户的用户类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型、每一种数据类型对应的用户类型以及每一种用户类型对应配置的延时恢复时间,所述数据类型包括视频融合业务数据,所述用户类型包括普通用户和VIP用户,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小,同一种数据类型对应的用户类型中,普通用户对应配置的延时恢复时间大于VIP用户对应配置的延时恢复时间。
进一步地,所述延时时间阈值根据当前记录的最小延时时间进行设置。
进一步地,将所述一级监控侧的用户作为第一用户,所述二级监控侧的用户作为第二用户,所述三级监控侧的用户作为第三用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块,所述第二监控终端的视频融合 处理模块作为第二视频融合处理模块,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;所述第二监控终端还包括第二网络探测模块,所述第三监控终端还包括第三网络探测模块;
所述第一视频融合处理模块还配置为对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;
所述第二视频融合处理模块还配置为对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;
所述第三视频融合处理模块还配置为对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;
所述第二网络探测模块配置为定期进行网络带宽探测,以探测所述第二监控终端与所述第一监控终端之间的网络可用带宽,并将当前探测到第一网络可用带宽发送至所述第一视频融合处理模块;
所述第三网络探测模块配置为定期进行网络带宽探测,以探测所述第三监控终端与所述第二监控终端之间的网络可用带宽,并将当前探测到的第二网络可用带宽发送至所述第一视频融合处理模块;
所述第一视频融合处理模块还配置为根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量;
其中,所述第一普通用户和所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户、所述第二VIP用户和所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面。
进一步地,所述第一视频融合处理模块根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量,具体包括:
所述第一视频融合处理模块在只需调整所述第一VIP用户的数量,而所述第二VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第二VIP用户占用的网络带宽获取第一剩余网络带宽,根据所述第一剩余网络带宽调整所述第一VIP用户的数量;
所述第一视频融合处理模块在只需调整所述第二VIP用户的数量,而所述第一VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第一VIP用户占用的网络带宽获取第二剩余网络带宽,根据所述第二剩余网络带宽调整所述第二VIP用户的数量;
所述第一视频融合处理模块在同时需要调整所述第一VIP用户的数量和所述第二VIP用户的数量时,根据所述第一网络可用带宽、所述第二网络可用带宽和所述第一普通用户占用的网络带宽获取第三剩余网络带宽,根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量。
进一步地,所述第一视频融合处理模块根据所述第一剩余网络带宽调整所述第一VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第一剩余网络带宽是否大于预设的第一带宽阈值,若是,则将至少M个所述第一用户配置为所述第一VIP用户;若否,则释放所述第一普通用户占用的网络带宽,根据所述第一剩余网络带宽和所述第一普通用户占用的网络带宽将至少M个所述第一用户配置为所述第一VIP用户;
其中,M表示需要保持的所述第一VIP用户的基础数量,M≥1,所述第一带宽阈值根据M个所述第一VIP用户占用的网络带宽进行设置。
进一步地,所述第一视频融合处理模块根据所述第一剩余网络带宽调整所述第一VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第一剩余网络带宽是否大于一个所述第一VIP用户占用的网络带宽,若是,则将至少一个所述第一用户配置为所述第一VIP用户;若否,则将所有所述第一用户全部配置为所述第一普通用户。
进一步地,所述第一视频融合处理模块根据所述第二剩余网络带宽调整所述第二VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第二剩余网络带宽是否大于预设的第二带宽阈值,若是,则向所述第二视频融合处理模块发送VIP用户增加指令;若否,则向所述第二视频融合处理模块发送普通用户禁用指令;
所述第二视频融合处理模块根据所述VIP用户增加指令将至少N个所述第二用户配置为所述第二VIP用户,或,根据所述普通用户禁用指令释放所述第二普通用户占用的网络带宽,根据所述第二剩余网络带宽和所述第二普通用户占用的网络带宽将至少N个所述第二用户配置为所述第二VIP用户;
其中,N表示需要保持的所述第二VIP用户的基础数量,N≥1,所述第二带宽阈值根据N个所述第二VIP用户占用的网络带宽进行设置。
进一步地,所述第一视频融合处理模块根据所述第二剩余网络带宽调整所述第二VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第二剩余网络带宽是否大于一个所述第二VIP用户占用的网络带宽,若是,则向所述第二视频融合处理模块发送VIP用户增加指令;若否,则向所述第二视频融合处理模块发送VIP用户减少指令;
所述第二视频融合处理模块根据所述VIP用户增加指令将至少一个所述第二用户配置为所述第二VIP用户,或,根据所述VIP用户减少指令将所有所述第二用户全部配置为所述第二普通用户。
进一步地,所述第一视频融合处理模块根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第三剩余网络带宽是否大于预设的第三带宽阈值,若是,则将至少M个所述第一用户配置为所述第一VIP用户,并向所述第二视频融合处理模块发送VIP用户增加指令;若否,则释放所述第一普通用户占用的网络带宽,根据所述第三剩余网络带宽和所述第一普通用户占用的网络带宽将至少M个所述第一用户配置为所述第一VIP用户,并向所述第二视频融合处理模块发送普通用户禁用指令;
所述第二视频融合处理模块根据所述VIP用户增加指令将至少N个所述第 二用户配置为所述第二VIP用户,或,根据所述普通用户禁用指令释放所述第二普通用户占用的网络带宽,根据所述第三剩余网络带宽和所述第二普通用户占用的网络带宽将至少N个所述第二用户配置为所述第二VIP用户;
其中,M表示需要保持的所述第一VIP用户的基础数量,M≥1,N表示需要保持的所述第二VIP用户的基础数量,N≥1,所述第三带宽阈值根据M个所述第一VIP用户占用的网络带宽和N个所述第二VIP用户占用的网络带宽进行设置。
进一步地,在所述第一VIP用户的数量达到M个,所述第二VIP用户的数量达到N个之后,增加的所述第一VIP用户的数量不小于增加的所述第二VIP用户的数量。
为了实现上述目的,本申请实施例还提供了一种基于数字换流站的监控方法,所述方法适用于上述任一项所述的基于数字换流站的监控系统,所述监控系统包括部署在一级监控侧的第一监控终端、部署在二级监控侧的第二监控终端和部署在三级监控侧的第三监控终端;所述监控系统的被监控对象包括部署在所述三级监控侧的数字换流站;所述第一监控终端、所述第二监控终端和所述第三监控终端均至少包括通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块,所述第三监控终端还包括数据存储模块,所述数据存储模块配置为存储数字换流站数据;所述方法包括:
通过所述通信模块实现所述第一监控终端、所述第二监控终端和所述第三监控终端之间的通信;通过所述设备状态监控模块监控及管理所述数字换流站的所有设备的台账信息、运行信息和监测数据;通过所述设备告警管理模块管理所述数字换流站的所有设备的告警信息;通过所述人机交互模块接收本地监控侧的用户的监控调阅请求;
通过每一所述视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面;
通过每一所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据。
进一步地,通过所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据,具体包括:
通过所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据 的过程中,当所述业务数据的预设的速率调整条件被触发时,获取所述速率调整条件被触发前探测到的网络可用带宽S0和最小延时时间RTT0、所述速率调整条件被触发时探测到的延时时间RTT2以及基于所述业务数据的数据类型配置的延时恢复时间t;
通过所述数据传输调控模块根据公式S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2;
通过所述数据传输调控模块根据公式n=(RTT2-RTT0)*S0计算获得进入缓冲区的业务数据量n;
通过所述数据传输调控模块根据公式S2’=S2-n/t计算获得所述业务数据的速率调整目标值S2’;
通过所述数据传输调控模块根据所述速率调整目标值S2’调整所述业务数据当前的数据传输速率,获得调整后的数据传输速率S0’,且调整后的数据传输速率S0’满足S0’≤S2’,以根据调整后的数据传输速率S0’继续向另一监控终端传输所述业务数据。
进一步地,所述延时恢复时间由所述数据传输调控模块根据所述业务数据的数据类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型及其对应配置的延时恢复时间,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小。
进一步地,将所述一级监控侧的用户作为第一用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块;所述方法还包括:
通过所述第一视频融合处理模块对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;其中,所述第一普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,通过所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
通过所述第一视频融合处理模块在所述第一用户为所述第一普通用户时,响应所述第一普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第一监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一普通用户调阅的视频融合画面。
进一步地,将所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
则,通过所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,还包括:
通过所述第一视频融合处理模块在所述第一用户为所述第一VIP用户时,响应所述第一VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第 一视频融合请求,所述第一视频融合请求中包括待查看区域标识;
通过所述第三视频融合处理模块根据所述第一视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一VIP用户调阅的视频融合画面并发送至所述第一视频融合处理模块;
通过所述第一视频融合处理模块接收获得用于所述第一VIP用户调阅的视频融合画面。
进一步地,将所述一级监控侧的用户作为第一用户,所述二级监控侧的用户作为第二用户,所述三级监控侧的用户作为第三用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块,所述第二监控终端的视频融合处理模块作为第二视频融合处理模块,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;所述第二监控终端还包括第二网络探测模块,所述第三监控终端还包括第三网络探测模块;所述方法还包括:
通过所述第一视频融合处理模块对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;
通过所述第二视频融合处理模块对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;
通过所述第三视频融合处理模块对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;
通过所述第二网络探测模块定期进行网络带宽探测,以探测所述第二监控终端与所述第一监控终端之间的网络可用带宽,并将当前探测到的第一网络可用带宽发送至所述第一视频融合处理模块;
通过所述第三网络探测模块定期进行网络带宽探测,以探测所述第三监控终端与所述第二监控终端之间的网络可用带宽,并将当前探测到的第二网络可用带宽发送至所述第一视频融合处理模块;
通过所述第一视频融合处理模块根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量;
其中,所述第一普通用户和所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户、所述第二VIP用户和所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面。
进一步地,所述根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量,具体包括:
在只需调整所述第一VIP用户的数量,而所述第二VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第二VIP用户占用的网络带宽获取第一剩余网络带宽,根据所述第一剩余网络带宽调整所述第一VIP用户的数量;
在只需调整所述第二VIP用户的数量,而所述第一VIP用户的数量需要保 持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第一VIP用户占用的网络带宽获取第二剩余网络带宽,根据所述第二剩余网络带宽调整所述第二VIP用户的数量;
在同时需要调整所述第一VIP用户的数量和所述第二VIP用户的数量时,根据所述第一网络可用带宽、所述第二网络可用带宽和所述第一普通用户占用的网络带宽获取第三剩余网络带宽,根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量。
与现有技术相比,本申请实施例提供了一种基于数字换流站的监控系统及方法,所述监控系统包括部署在一级监控侧的第一监控终端、部署在二级监控侧的第二监控终端和部署在三级监控侧的第三监控终端;所述监控系统的被监控对象包括部署在所述三级监控侧的数字换流站;所述第一监控终端、所述第二监控终端和所述第三监控终端均包括通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块,所述第三监控终端还包括数据存储模块;其中,每一所述视频融合处理模块配置为响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面;每一所述数据传输调控模块配置为在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据;通过在各级监控终端分别部署了各个功能模块特别是视频融合处理模块,能够由各级监控终端在本地响应各级用户的监控调阅请求,无需由站端全部响应各级用户的监控调阅请求,用户可以从本地直接查看视频融合画面,无需从远端调阅,从而能够在网络带宽资源有限的前提下,有效降低网络延迟,提高视频画面显示的实时性,提高视频融合应用的使用效果及用户体验;通过在各级监控终端分别部署了数据传输调控模块,能够在速率调整条件被触发时,根据速率调整条件被触发前探测到的网络可用带宽和最小延时时间、速率调整条件被触发时探测到的延时时间以及基于业务数据的数据类型配置的延时恢复时间,实时调整业务数据当前的数据传输速率,从而能够在业务数据被发送出去之前,为业务数据配置合适的数据传输速率,有效避免业务数据在发送出去之后,由于传输过程中的网络延时的不可控性所带来的网络延时难以解决的问题,降低了解决网络延时问题的难度,同时,提高了数据传输速率调整的准确性,提高了速率调整方案的自适应性和灵活性。
附图说明
图1是本申请提供的一种基于数字换流站的监控系统的一个优选实施例的结构框图;
图2是本申请实施例提供的一种基于数字换流站的监控系统的一个应用场景示意图;
图3是本申请实施例提供的一种基于数字换流站的监控系统的另一个应用场景示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本技术领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请实施例提供了一种基于数字换流站的监控系统,参见图1所示,是本申请提供的一种基于数字换流站的监控系统的一个优选实施例的结构框图,所述监控系统包括部署在一级监控侧的第一监控终端、部署在二级监控侧的第二监控终端和部署在三级监控侧的第三监控终端;所述监控系统的被监控对象包括部署在所述三级监控侧的数字换流站;所述第一监控终端、所述第二监控终端和所述第三监控终端均至少包括通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块,所述第三监控终端还包括数据存储模块,所述数据存储模块配置为存储数字换流站数据;
所述通信模块配置为实现所述第一监控终端、所述第二监控终端和所述第三监控终端之间的通信;所述设备状态监控模块配置为监控及管理所述数字换流站的所有设备的台账信息、运行信息和监测数据;所述设备告警管理模块配置为管理所述数字换流站的所有设备的告警信息;所述人机交互模块配置为接收本地监控侧的用户的监控调阅请求;
每一所述视频融合处理模块配置为响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面;
每一所述数据传输调控模块配置为在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据。
具体的,所述监控系统采用三级体系架构,主要由部署在一级监控侧的第一监控终端、部署在二级监控侧的第二监控终端以及部署在三级监控侧的第三监控终端构成;示例性的,一级监控侧可以为电网系统总部等监控侧,二级监控侧可以为电网系统省级单位等监控侧,三级监控侧可以为数字换流站等监控侧;所述监控系统的被监控对象至少包括部署在三级监控侧的数字换流站,还可以包括其他被监控对象,并且可以理解的,图1仅示出了所述监控系统包括一个第一监控终端、一个第二监控终端、一个第三监控终端和一个被监控对象 的应用场景,而各级监控终端的数量和被监控对象的数量均可以根据实际需要进行部署,本申请实施例不作具体限定。
第一监控终端、第二监控终端和第三监控终端均至少包括通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块,第三监控终端还包括数据存储模块,如图1所示,第一监控终端具体包括第一通信模块、第一人机交互模块、第一设备状态监控模块、第一设备告警管理模块、第一视频融合处理模块和第一数据传输调控模块,第二监控终端具体包括第二通信模块、第二人机交互模块、第二设备状态监控模块、第二设备告警管理模块、第二视频融合处理模块和第二数据传输调控模块,第三监控终端具体包括第三通信模块、第三人机交互模块、第三设备状态监控模块、第三设备告警管理模块、第三视频融合处理模块、第三数据传输调控模块和数据存储模块。
可以理解的,除了通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块之外,第一监控终端、第二监控终端和第三监控终端还可以根据实际需求分别部署其他功能模块,本申请实施例不作具体限定。
通信模块主要配置为实现第一监控终端、第二监控终端和第三监控终端之间的通信,即,第一监控终端、第二监控终端和第三监控终端之间,可以通过第一通信模块、第二通信模块和第三通信模块进行通信;数据存储模块主要配置为存储作为被监控对象的数字换流站的所有数据,数字换流站的所有数据中至少包括该数字换流站的所有被监控区域的视频融合原始数据;设备状态监控模块主要配置为对数字换流站的所有设备的台账信息、运行信息和监测数据进行监控及管理,即,第一设备状态监控模块主要配置为对数字换流站的所有设备的台账信息、运行信息和监测数据进行远程监控及远程管理,第二设备状态监控模块主要配置为对数字换流站的所有设备的台账信息、运行信息和监测数据进行远程监控及远程管理,第三设备状态监控模块主要配置为对数字换流站的所有设备的台账信息、运行信息和监测数据进行本地监控及本地管理;设备告警管理模块主要配置为对数字换流站的所有设备的告警信息进行管理,实现告警统计功能、系统告警查询功能和应用告警查询功能,即,第一设备告警管理模块主要配置为对数字换流站的所有设备的告警信息进行远程管理,实现远程告警统计功能、远程系统告警查询功能和远程应用告警查询功能,第二设备告警管理模块主要配置为对数字换流站的所有设备的告警信息进行远程管理,实现远程告警统计功能、远程系统告警查询功能和远程应用告警查询功能,第三设备告警管理模块主要配置为对数字换流站的所有设备的告警信息进行本地管理,实现本地告警统计功能、本地系统告警查询功能和本地应用告警查询功能;人机交互模块主要配置为接收本地监控侧的用户的操作请求,该操作请求至少包括监控调阅请求,即第一人机交互模块主要配置为接收一级监控侧的第一用户的监控调阅请求,第二人机交互模块主要配置为接收二级监控侧的第二用户的监控调阅请求,第三人机交互模块主要配置为接收三级监控侧的第三用户的监控调阅请求。
每一个视频融合处理模块主要配置为响应本地监控侧的用户的监控调阅请求,利用第三监控终端的数据存储模块中存储的数字换流站数据中的所有被监控区域的视频融合原始数据进行视频融合处理,相应获得用于本地监控侧的用户调阅的视频融合画面,即:当第一人机交互模块接收到一级监控侧的第一用户的监控调阅请求时,第一视频融合处理模块主要配置为响应第一用户的监控调阅请求,利用数据存储模块中存储的数字换流站数据中的所有被监控区域的视频融合原始数据进行视频融合处理,相应获得视频融合画面,该视频融合画面供第一用户进行调阅;当第二人机交互模块接收到二级监控侧的第二用户的监控调阅请求时,第二视频融合处理模块主要配置为响应第二用户的监控调阅请求,利用数据存储模块中存储的数字换流站数据中的所有被监控区域的视频融合原始数据进行视频融合处理,相应获得视频融合画面,该视频融合画面供第二用户进行调阅;当第三人机交互模块接收到三级监控侧的第三用户的监控调阅请求时,第三视频融合处理模块主要配置为响应第三用户的监控调阅请求,利用数据存储模块中存储的数字换流站数据中的所有被监控区域的视频融合原始数据进行视频融合处理,相应获得视频融合画面,该视频融合画面供第三用户进行调阅。
可选的,当第一人机交互模块接收到一级监控侧的第一用户的监控画面调整请求时,第一视频融合处理模块还配置为响应第一用户的监控画面调整请求,对当前显示的视频融合画面进行相应调整,以满足第一用户的视角控制、摄像头切换等监控查看需求;同理,当第二人机交互模块接收到二级监控侧的第二用户的监控画面调整请求时,第二视频融合处理模块还配置为响应第二用户的监控画面调整请求,对当前显示的视频融合画面进行相应调整,以满足第二用户的视角控制、摄像头切换等监控查看需求;当第三人机交互模块接收到三级监控侧的第三用户的监控画面调整请求时,第三视频融合处理模块还配置为响应第三用户的监控画面调整请求,对当前显示的视频融合画面进行相应调整,以满足第三用户的视角控制、摄像头切换等监控查看需求。
需要说明的是,视频融合原始数据具体是指视频融合处理模块在进行视频融合处理时所需要的各路原始数据,可以包括由部署在数字换流站的摄像头、巡视机器人等图像/视频采集装置所采集的图像/视频数据,由部署在数字换流站的传感器所采集到的测点数据,数字换流站的三维模型、场景资源所对应的模型场景数据,由部署在数字换流站的电力量测装置、环境量测装置等所采集的量测、状态数据,数字换流站的相关设备台账数据、设备拓扑关系数据等等,渲染引擎通过从数据存储模块中读取视频融合所需的各路原始数据,利用三维模型进行渲染加工处理,即可将各路原始数据渲染加工成视频融合画面。
每一个数据传输调控模块主要配置为在本地监控终端向另一监控终端传输业务数据的过程中,当该业务数据的预先设置的速率调整条件被触发时,根据速率调整条件被触发前探测到的网络可用带宽、速率调整条件被触发前探测到的最小延时时间、速率调整条件被触发时探测到的延时时间以及基于该业务数据的数据类型配置的延时恢复时间,对该业务数据的当前的数据传输速率进行调整,以根据调整后的数据传输速率继续向另一监控终端传输该业务数据。
其中,速率调整条件被触发前的网络可用带宽和最小延时时间,可以在速率调整条件被触发之前,根据在本地监控终端与另一监控终端之间进行的网络带宽探测对应获得,网络带宽探测的工作过程将在下述实施例中的网络探测模块的工作过程中进行具体介绍,这里不再赘述;速率调整条件被触发时探测到的延时时间,可以根据对业务数据的传输过程进行监控获得,例如,业务数据以业务报文的形式由本地监控终端向另一监控终端传输,针对每一次接收到另一监控终端回应的ACK报文,均可以获得业务报文所对应的RTT(Round Trip Time,往返时延)值,则可以将速率调整条件被触发时最近一次获得的RTT值作为速率调整条件被触发时探测到的延时时间;延时恢复时间具体是指延时时间由速率调整条件被触发时对应的延时时间恢复到速率调整条件被触发前对应的最小延时时间所需的时间,即RTT值由速率调整条件被触发时对应的RTT值恢复到速率调整条件被触发前对应的RTT值所需的时间,也是缓冲区中的业务报文出清所需的时间,延时恢复时间可以根据业务数据的数据类型进行对应配置,例如,不同的数据类型可以对应配置不同的延时恢复时间,表示了不同数据类型的业务数据在传输过程中,用户对于延时恢复时间的不同需求,通过配置不同的延时恢复时间,能够对应确定不同数据类型的业务数据的速率调整值,从而对应配置不同数据类型的业务数据在传输时所占用的网络带宽,可以将网络可用带宽配置给优先级更高的业务数据使用,实现资源的优化配置。
需要说明的是,由于业务数据以业务报文的形式由本地监控终端向另一监控终端传输,可以监控到业务报文所对应的RTT值的变化趋势,因此,速率调整条件可以设置为:首次判定RTT值增大到预设的延时时间阈值,即,当首次判定业务报文的RTT值增大到预设的延时时间阈值时,判定速率调整条件被触发;或者,也可以监控业务报文的丢包情况,将速率调整条件设置为:首次接收到丢包报告,即,当首次接收到丢包报告时,判定速率调整条件被触发;可以理解的,速率调整条件也可以根据实际需求设置为其他条件(例如网络拥塞对应的相关判断条件),并且设置的速率调整条件可以适用于各种数据类型的业务数据,本申请实施例不作具体限定。
需要说明的是,业务数据的数据类型可以根据所述监控系统能够实现的功能进行分类,基于所述监控系统能够实现的多种功能,一监控终端向另一监控终端传输的业务数据也可以包括多种数据类型,例如,数据类型可以包括实现设备状态监控模块的功能所对应的设备状态监控业务数据,实现设备告警管理模块的功能所对应的设备告警业务数据,实现视频融合处理模块的功能所对应的视频融合业务数据等;在每一种数据类型的业务数据的传输过程中,均可以采用本申请实施例所提供的速率调整方案对业务数据的数据传输速率进行实时调整,并且对于每一种数据类型的业务数据来说,具体的速率调整方案只在同一种数据类型的业务数据的传输过程中进行,即,当某一种数据类型的业务数据在传输过程中需要调整数据传输速率时,只会根据本申请实施例所提供的速率调整方案来调整这一种数据类型的业务数据当前的数据传输速率,而不是对所有数据类型的业务数据的数据传输速率均进行调整,因此不会对其他数据类型的业务数据的数据传输过程产生影响,也不会影响其他业务功能的使用体验。
进一步的,在本申请实施例中,只有当判定速率调整条件被触发时,才开始调整业务数据的数据传输速率,并不是任意决定数据传输速率的调整时机,也不是一直在不断地调整数据传输速率,因此可以在一定程度减少不必要的资源占用,节省资源,并且在实际调整数据传输速率时,是根据速率调整条件被触发前探测到的网络可用带宽和最小延时时间、速率调整条件被触发时探测到的延时时间以及基于业务数据的数据类型配置的延时恢复时间,来确定数据传输速率的调整值,并不是任意调整数据传输速率的大小,也不是预先设置一个固定的速率调整值,采用本申请实施例所提供的速率调整方案能够提高速率调整方案的自适应性和速率调整大小的准确性,使得调整后的数据传输速率更适应于当前的网络状态和用户需求,同时,采用不合适的速率调整值来调整数据传输速率还容易导致出现网络震荡问题,而采用本申请实施例所提供的速率调整方案能够避免网络震荡。
与现有技术相比,本申请实施例所提供的一种基于数字换流站的监控系统,具有以下有益效果:
(1)通过在第一监控终端、第二监控终端和第三监控终端分别部署视频融合处理模块、设备状态监控模块和设备告警管理模块等功能模块,使得所述监控系统的各个功能均支持由各级监控终端在本地自行完成,无需全部由站端完成,大大减少了对站端资源的占用;
(2)通过在第一监控终端、第二监控终端和第三监控终端分别部署视频融合处理模块,使得第一监控终端、第二监控终端和第三监控终端能够分别在本地响应本地监控侧的用户的监控调阅请求,无需全部由站端响应各级监控侧的用户的监控调阅请求,并且用户可以从本地直接查看视频融合画面,无需从远端调阅,有效缓解了站端响应多用户并发访问的压力,从而能够在站端的计算资源和网络带宽资源有限的前提下,有效降低网络延迟,提高视频画面显示的实时性,提高视频融合应用的使用效果及用户体验,使得处于一级监控侧、二级监控侧和三级监控侧这三个不同位置处的用户体验具有一致性;
(3)通过在第一监控终端、第二监控终端和第三监控终端分别部署数据传输调控模块,使得第一监控终端、第二监控终端和第三监控终端之间在传输业务数据的过程中,能够在速率调整条件被触发时,根据速率调整条件被触发前探测到的网络可用带宽和最小延时时间、速率调整条件被触发时探测到的延时时间以及基于待传输的业务数据的数据类型配置的延时恢复时间,调整业务数据的当前的数据传输速率,从而能够在业务数据被发送出去之前,为业务数据配置合适的数据传输速率,有效避免业务数据在发送出去之后,由于传输过程中的网络延时的不可控性所带来的网络延时难以解决的问题,降低了解决网络延时问题的难度;
(4)通过数据传输调控模块在速率调整条件被触发时,根据速率调整条件被触发前探测到的网络可用带宽和最小延时时间、速率调整条件被触发时探测到的延时时间以及基于待传输的业务数据的数据类型配置的延时恢复时间,来调整业务数据的当前的数据传输速率,能够准确确定数据传输速率的调整值,并且速率调整条件被触发前探测到的网络可用带宽和最小延时时间、速率调整 条件被触发时探测到的延时时间均是更符合实时网络状态的参数值,基于业务数据的数据类型配置的延时恢复时间是更符合用户需求的参数值,根据这些参数值来实时确定数据传输速率的调整值,使得调整后的数据传输速率更适应于当前的网络状态和用户需求,从而提高了数据传输速率调整的准确性,并且提高了速率调整方案的自适应性;
(5)在不同数据类型的业务数据的传输过程中,均可以采用本申请实施例所提供的速率调整方案对业务数据的数据传输速率进行实时调整,并且对于每一种数据类型的业务数据来说,具体的速率调整方案只在同一种数据类型的业务数据的传输过程中进行,而不会对所有数据类型的业务数据的数据传输速率均进行同样的调整,因此不会对其他数据类型的业务数据的数据传输过程产生影响,也不会影响其他业务功能的使用体验;
(6)业务数据可以根据不同的数据类型对应配置不同的优先级(或重要程度),例如,视频融合业务数据对时间要求比较高,对应配置的优先级比较高,其他数据类型的业务数据对时间要求比较低,对应配置的优先级比较低,通过为不同的数据类型配置对应的延时恢复时间,使得业务数据的优先级与延时恢复时间相匹配,能够满足不同优先级的业务数据的不同的延时恢复需求,将网络可用带宽配置给优先级更高的业务数据使用,从而实现了网络资源的优化配置,也提高了速率调整方案的灵活性;
(7)本申请实施例所提供的速率调整方案,不依赖于中间设备即可实现数据传输速率的准确调整,并且速率调整方案简单,容易部署实施,占用资源少,实用性高。
在另一个优选实施例中,所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据,具体包括:
所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,获取所述速率调整条件被触发前探测到的网络可用带宽S0和最小延时时间RTT0、所述速率调整条件被触发时探测到的延时时间RTT2以及基于所述业务数据的数据类型配置的延时恢复时间t;
所述数据传输调控模块根据公式S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2;
所述数据传输调控模块根据公式n=(RTT2-RTT0)*S0计算获得进入缓冲区的业务数据量n;
所述数据传输调控模块根据公式S2’=S2-n/t计算获得所述业务数据的速率调整目标值S2’;
所述数据传输调控模块根据所述速率调整目标值S2’调整所述业务数据当前的数据传输速率,获得调整后的数据传输速率S0’,且调整后的数据传输速 率S0’满足S0’≤S2’,以根据调整后的数据传输速率S0’继续向另一监控终端传输所述业务数据。
具体的,结合上述实施例,数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当判定针对该业务数据预先设置的速率调整条件被触发时,会调整该业务数据继续传输时的数据传输速率,速率调整方案的具体实现过程如下:数据传输调控模块获取速率调整条件被触发前,通过进行网络带宽探测而探测获得的网络可用带宽和最小延时时间,并记网络可用带宽为S0,记最小延时时间为RTT0,获取速率调整条件被触发时,通过监控业务报文的RTT值而探测获得的延时时间,并记延时时间为RTT2,获取基于该业务数据的数据类型配置的延时恢复时间,并记延时恢复时间为t,在获得这些参数值之后,数据传输调控模块可以先根据公式S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2,并根据公式n=(RTT2-RTT0)*S0计算获得已经发送出去该业务数据中进入缓冲区的业务数据量n,再根据公式S2’=S2-n/t计算获得该业务数据继续传输的速率调整目标值S2’,此时,数据传输调控模块就可以根据计算获得的速率调整目标值S2’来调整该业务数据的当前的数据传输速率,相应获得调整后的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输该业务数据,记调整后的数据传输速率为S0’,则调整后的数据传输速率S0’满足S0’≤S2’。
其中,在速率调整条件被触发之前,已经根据网络带宽探测确定了网络可用带宽S0和最小延时时间RTT0,在速率调整条件被触发时,需要调整业务数据当前的数据传输速率,而在实际调整数据传输速率时,由于网络可用带宽不再是S0,因此需要知道当前的网络可用带宽是多少,如果再次通过进行网络带宽探测而探测获得当前的网络可用带宽,由于网络带宽探测的实现过程需要花费一定时间才能完成,会导致探测获得的当前的网络可用带宽具有一定的滞后性,实时性不高,从而影响后续速率调整的准确性和实时性,而且可以理解的,速率调整方案本身就要求在速率调整条件被触发时,缓冲区内的业务报文能够尽快出清,延时时间能够尽快恢复正常,因此,也不会在速率调整条件被触发后预留较多的时间来进行网络带宽探测工作,或者说,基于实时性需求,根本来不及再次通过进行网络带宽来探测获得当前的网络可用带宽,因此,在本申请实施例中,可以根据公式S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2,通过延时时间的变化情况反映网络可用带宽的变化情况,从而快速预估获得当前的网络可用带宽估计值S2,提高实时性。
RTT0*S0表示本地监控终端在RTT0时间内共发出的业务数据量,RTT2*S0表示本地监控终端在RTT2时间内共发出的业务数据量,也即在途报文的数据量,当延时时间由RTT0增大到RTT2时,认为本地监控终端在增大的(RTT2-RTT0)时间内发出的业务数据量最大可能是进入了缓冲区,当速率调整条件被触发时,需要通过对业务数据的数据传输速率进行调整,将缓冲区中的业务报文出清,并且使延时时间由RTT2恢复到RTT0,因此,在本申请实施例中,可以先根据公式n=(RTT2-RTT0)*S0计算获得已经发送出去的业务数据中进入缓冲区的业务数据量n,进一步的,再基于延时恢复时间t确定缓冲区 中的业务报文出清所需的时间,即可以根据公式S2’=S2-n/t计算获得业务数据继续传输所需的速率调整目标值S2’。
示例性的,假设在速率调整条件被触发之前,已经根据网络带宽探测确定了网络可用带宽S0和最小延时时间RTT0,并且业务数据最开始是以S0为数据传输速率进行传输,在业务数据的传输过程中,在T2时间点判定速率调整条件被触发,并且监控到延时时间由RTT0增大到RTT2,此时来不及通过网络带宽探测确定当前的网络可用带宽,则可以直接根据S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2,并根据公式n=(RTT2-RTT0)*S0计算获得已经发送出去的业务数据中进入缓冲区的业务数据量n,根据公式S2’=S2-n/t计算获得业务数据继续传输的速率调整目标值S2’,可以将数据传输速率由S0直接降低到S2’继续传输业务数据,从而快速确定速率调整值。
需要说明的是,数据传输调控模块在根据计算获得的速率调整目标值S2’调整同一种数据类型的业务数据当前的数据传输速率时,获得的调整后的数据传输速率S0’应该满足S0’≤S2’,也就是说,可以直接将当前的数据传输速率直接降低到S2’,即获得的调整后的数据传输速率S0’满足S0’=S2’,也可以在S2’的基础上,进一步降低当前的数据传输速率降,即获得的调整后的数据传输速率S0’满足S0’<S2’,可以理解的,S0’相比于S2’的降低幅度越大,获得的S0’越小,延时增大处理的响应速度越快,即越快能够将缓冲区中的业务报文出清,使得延时时间越快恢复正常,从而能够越及时地解决延时增大问题。
可以理解的,在通过公式计算速率调整目标值时,需要获取公式中的参数的具体参数值才能进行计算,而网络状态一直是实时动态变化的,参数值的获取过程本身具有一定的滞后性,因此,固定设置的公式参数并不适配置为动态变化的网络状态,并且计算公式越复杂,由获取参数值时的滞后性所带来的延时影响越不可忽略,反而会导致计算结果越不准确,本申请实施例所提供的速率调整方案,步骤简单,容易部署实施,并且速率调整条件被触发前探测到的网络可用带宽和最小延时时间、速率调整条件被触发时探测到的延时时间均是更符合实时网络状态的参数值,基于业务数据的数据类型配置的延时恢复时间是更符合用户需求的参数值,根据这些参数值来实时确定数据传输速率的调整值,使得调整后的数据传输速率更适应于当前的网络状态和用户需求,从而提高了数据传输速率调整的准确性,并且提高了速率调整方案的自适应性。
作为上述方案改进,所述延时恢复时间由所述数据传输调控模块根据所述业务数据的数据类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型及其对应配置的延时恢复时间,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小。
具体的,结合上述实施例,数据传输调控模块中预先设置了延时恢复时间表,该延时恢复时间表中包括至少一种数据类型及其对应配置的延时恢复时间,也就是说,在该延时恢复时间表中,延时恢复时间与数据类型之间具有一一对应的关系,并且数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小,即要求能够越快将缓冲区中的业务报文出清,使得延时时间能够越快恢复正常,则,数据传输调控模块在获取基于待传输的业务数据的数据类型 配置的延时恢复时间时,可以根据待传输的业务数据的数据类型查询该延时恢复时间表,从该延时恢复时间表中包括的所有的数据类型中找出与待传输的业务数据的数据类型相匹配的数据类型,并将找到的数据类型在该延时恢复时间表中所对应的延时恢复时间作为基于待传输的业务数据的数据类型配置的延时恢复时间。
需要说明的是,基于所述监控系统能够实现的多种功能,需要传输的业务数据也可以包括多种数据类型,相应的,延时恢复时间表中的数据类型也可以包括多种数据类型,例如上述实施例所述的视频融合业务数据(结合下述实施例,视频融合业务数据可以包括传输视频融合画面时对应的视频流数据,或,传输指定被监控区域的视频融合原始数据时对应的业务数据)、设备状态监控业务数据和设备告警业务数据等,不同的数据类型可以根据对应的业务数据的不同的优先级(或重要程度)对应配置不同的延时恢复时间,其中,业务数据的优先级(或重要程度)可以根据实际需求进行配置,并且不同的数据类型对应的业务数据的优先级(或重要程度)可以配置为相同,也可以配置为不同,例如,假设视频融合业务数据对实时性要求较高,对应的优先级较高(或重要程度较高),而其他数据类型的业务数据对实时性要求较低,对应的优先级较低(或重要程度较低),则在延时恢复时间表中,可以为视频融合业务数据所对应的数据类型配置较小的延时恢复时间,而为其他数据类型的业务数据所对应的数据类型配置较大的延时恢复时间,并且对于视频融合业务数据来说,可以单独配置一个较高的优先级,对于其他所有数据类型的业务数据来说,可以统一配置为一个较低的优先级,或者,也可以根据其他数据类型的业务数据的实际需求分别配置不同的较低的优先级,本申请实施例不作具体限定。
本申请实施例所提供的一种基于数字换流站的监控系统,通过根据业务数据的优先级为不同的数据类型配置对应的延时恢复时间,使得业务数据的优先级与延时恢复时间相匹配,能够满足不同优先级的业务数据的不同延时恢复需求,在对业务数据的数据传输速率进行调整的过程中,能够基于不同优先级的业务数据所对应配置的不同的延时恢复时间确定不同的速率调整值,从而决定了不同优先级的业务数据继续传输时对网络可用带宽的占用情况,可以将网络可用带宽配置给优先级更高的业务数据使用,从而实现了网络资源的优化配置,同时,也提高了速率调整方案的灵活性。
在又一个优选实施例中所述第三监控终端还包括故障录波管理模块、数据报表管理模块、数字站区管理模块和远程智能巡视模块;
所述故障录波管理模块配置为对所述数字换流站的故障录波文件进行管理,并根据所述故障录波文件进行在线解析;
所述数据报表管理模块配置为对所述数字换流站的业务数据进行统计,根据所述数字换流站的运维需求以不同的报表形式展示历史数据、统计数据和分析数据,并实现报表任务制定功能、报表自动生成功能、报表导出功能和报表打印功能;
所述数字站区管理模块配置为以所述数字换流站的站区为主体,对所述数字换流站的安防、消防和动力环境进行监控和管理;
所述远程智能巡视模块配置为控制监测装置开展室内外设备联合巡视作业,并对巡视数据进行分析,形成巡视结果和巡视报告。
具体的,结合上述实施例,第三监控终端还包括故障录波管理模块、数据报表管理模块、数字站区管理模块和远程智能巡视模块,其中,故障录波管理模块主要配置为对数字换流站的故障录波文件进行管理,并根据故障录波文件进行在线解析,展示各通道波形、配置参数和故障报告信息等;数据报表管理模块主要配置为对数字换流站的业务数据进行统计,根据数字换流站的运维需求以不同的报表形式(例如,以日报、周报或月报等报表形式)展示历史数据、统计数据和分析数据,并实现报表任务制定功能、报表自动生成功能、报表导出功能和报表打印功能等;数字站区管理模块主要配置为以数字换流站的站区为主体,依托全站统一的三维底座,对数字换流站的安防、消防和动力环境等辅助监控信息进行统一监控和管理;远程智能巡视模块主要配置为控制监测装置(例如,摄像头。机器人、无人机和声纹监测装置等)开展室内外设备联合巡视作业,接收采集到的巡视数据,并对采集到的巡视数据进行智能分析,形成巡视结果和巡视报告,及时发送告警。
需要说明的是,故障录波管理模块、数据报表管理模块、数字站区管理模块和远程智能巡视模块一般部署在第三监控终端,也可以根据实际需求进行三级部署,即,在第一监控终端和第二监控终端也可以分别部署故障录波管理模块、数据报表管理模块、数字站区管理模块和远程智能巡视模块中的至少一个模块,本申请实施例不作具体限定。
本申请实施例所提供的一种基于数字换流站的监控系统,通过三级部署视频融合处理模块、设备状态监控模块和设备告警管理模块等功能模块之外,还在第三监控终端部署了故障录波管理模块、数据报表管理模块、数字站区管理模块和远程智能巡视模块,从而能够对被监控对象进行多样化的监控管理,以满足用户多样化的管理需求。
在又一个优选实施例中,所述数字换流站具有统一的公共组件,所述公共组件包括业务组件和数据组件,所述业务组件和所述数据组件配置为为所述数字换流站的各个应用系统提供基于统一规范的业务功能接口和基础数据服务,并制定统一的数据交互协议和数据交互格式,以为所述第三监控终端提供统一数据服务接口。
具体的,结合上述实施例,作为被监控对象的数字换流站,具有统一的公共组件,公共组件主要包括业务组件和数据组件,业务组件和数据组件配置为为数字换流站的各个应用系统提供基于统一规范的业务功能接口和基础数据服务,并制定统一的数据交互协议和数据交互格式,以为第三监控终端提供统一数据服务接口,使得第三监控终端能够基于统一数据服务接口从数字换流站获取数据并存储在数据存储模块中,以供所述监控系统从数据存储模块中调用所需数据。
需要说明的是,现有的换流站一般没有采用统一的模型规范和数据规范,换流站中的各个应用子系统也独立构建、独立管理,视频融合相关的设备模型数据、测点采集数据、监控视频流数据等从各个应用子系统接入时,需要跨越 各个应用子系统间的防火墙、安全网关等边界防护设备,同时需要针对各个应用子系统的私有模型格式、私有交互协议和私有数据格式,进行相应的模型映射、协议开发和数据格式转换,增加了数据交互成本和时间成本,导致换流站对外交互时的对接复杂度和网络延时也相应增加,而在本申请实施例中,数字换流站具有统一的公共组件,能够为第三监控终端提供统一数据服务接口,从而在所述监控系统实现各种功能时,能够有效解决换流站对外交互时的对接复杂度和网络延时问题。
作为上述方案的改进,所述数字换流站具有统一的基础应用,所述基础应用采用统一基础软硬件设施、统一数据模型、统一数据服务规范和统一应用开发规范进行构建。
具体的,结合上述实施例,数字换流站除了具有统一的公共组件之外,还具有统一的基础应用,这些基础应用均采用统一基础软硬件设施、统一数据模型、统一数据服务规范和统一应用开发规范进行构建,能够在所述监控系统实现各种功能时,分别为各级监控终端提供统一的、标准化的数据服务。
需要说明的是,在数字换流站的站端,可以部署统一的管理设备来管理数字换流站(与第三监控终端对接),该管理设备可以由一台或者多台服务器构成,目的是解决站内各个子应用系统软硬件单独建设、规范不一的问题,该管理设备包括了标准化的基础平台,为数字换流站的公共组件和业务应用提供虚拟机、容器、分布式存储、图形加速和AI推理等一系列的基础设施服务。基础平台包括基础硬件和基础软件,基础硬件是指为数字换流站提供的所有软件和服务,提供计算、存储、网络资源并支撑各应用运行的硬件集合,基础硬件包括:存储计算融合节点、图形处理节点、视频接入节点、通用计算节点、AI计算节点、显卡和节点互连交换机;基础软件是指依赖于基础硬件运行并整合调度硬件资源,接受公共组件或应用软件调用或者依赖的服务和资源,基础软件包括:虚拟化、容器管理、分布式存储、基础设施管理、操作系统,为整个厂站提供弹性、异构的计算资源池和存储资源池。
在标准化的基础平台上,可以进一步构建基于数字换流站的运维管理系统来管理数字换流站,运维管理系统包括主要由公共组件和基础应用构成,公共组件包括业务组件和数据组件,目的是解决换流站各子应用系统烟囱式建设,数据采集和数据交互规范不一,点对点的私有协议交互等问题,业务组件和数据组件提供了基于统一规范的业务功能接口和基础数据服务,并制定了统一的数据交互协议和数据交互格式,为多个子应用系统的数据交互提供了统一的平台;基础应用以前端、后端分离的方式进行部署,应用前端分别部署在各级监控终端,通过调用基础应用的后端数据进行相应处理,以实现所述监控系统的各种功能。
示例性的,基础应用以前端、后端分离的方式进行分布式部署,能够实现远端-站端的业务体验一致性平台系统,包含站端数据组件、业务组件、基础应用、对应总部直流技术中心、省级单位中台侧的集成应用以及相关支撑组件,基础应用以前后端分离方式在换流站部署,同时省级单位和总部部署应用前端或浏览器,通过调用基础应用的后端数据、内容、页面等来保证电网系统总部、 电网系统省级单位和数字换流站不同位置的用户体验一致性。
示例性的,本申请实施例中的数字换流站,能够提供统一数据模型维护技术,基于统一的模型规范,以CIM和SG-CIM模型体系为基础,结合业务应用需求,面向设备进行建模,根据换流站的模型层次结构,建立区域模型,包括直流场、交流场等,在区域模型下,建立设备模型,包括换流变、换流阀、电流互感器、直流避雷器等,在设备模型下,继续建立测点模型,包括温度、湿度、电压、电流等,最终建立全站的地理区域、一二次设备、采集测点、各应用子系统的模型关联,并为全站设备和测点模型编制唯一标识ID,实现全站模型数据的标准化整合,实现业务和信息的横向协同和纵向贯通。在进行视频融合时,即可根据统一的模型,利用三维和视频展示对应设备的台账信息、运行数据信息和状态信息,当发送告警时,能够在三维和视频模型中,通过对应的模型ID,找到对应的告警设备位置,实时展示告警数据信息,方便运维人员进行告警定位。
示例性的,本申请实施例中的数字换流站,还能够提供基于换流站运行数据的统一数据服务技术,实现全站不同类型、不同维护数据的统一汇聚和灵活共享,解决多个应用系统点对点交互、私有化协议问题,主要功能包括:数据跨安全区汇聚功能,通过统一标准的集成规约,例如104或者61850规约,实现从安全I区、安全II区的各类主控系统、辅控系统汇聚至安全IV区的功能,并最终接入厂站平台,利用满足安全规范的数据单向传输功能,通过安全隔离装置,实现数据的跨区集成接入;实时数据、告警数据的接入和共享功能,实时采集和告警数据通过总线进行实时接入,并基于厂站业务交互规范,提供实时数据查询接口和数据订阅接口、历史数据查询接口;全站视频数据接入和共享服务,通过统一的标准规约,接入全站摄像头的视频数据,并基于厂站业务交互规范,提供实时视频数据流接口和视频回放接口;全站文件数据接入和共享服务,主要涉及故障录波文件、红外图像文件等文件类数据的汇聚和文件数据共享,基于厂站业务交互规范,提供文件数据的上传、下载、查询接口。
示例性的,本申请实施例中的数字换流站,通过将站内各个应用子系统的设备统一化,形成一台统一标准的数字换流站管理设备,包括硬件资源统一,采用国产自主可控的硬件设备,形成统一硬件资源池,采用统一的国产自主可控操作系统,作为软件运行环境,同时对公共软件和中间件进行统一沉淀,形成统一基础软件层,对上次应用提供统一标准服务。管理设备包括服务器、网络设备、防火墙、存储设备、虚拟化设备,管理设备可以由一台或多台服务器实现,管理设备对服务器算力进行标准化系列化,形成四类边缘算力系列化规格(一体化机柜、超融合设备、边缘计算设备、行业适配设备),同时对边缘计算VM、容器等基础OS进行标准化,边缘算力的标准化系列化提升了边缘应用的标准化和ICT能力有效利用,通过时间片分配的方式,将CPU算力标准化,从而使得对不同应用提供的算力基础单元一致,从而提升边缘硬件以及应用的部署效率,以及为高效运维提供基础;还提供统一协同模块,作为架构中的一个通用数据组件,三级部署,互相同步联通,面向所有应用提供全量、增量数据同步、实时、定时数据同步,根据API、消息方式按照时间、数据数量等任 务触发规则来调度任务,实现跨站、跨云、跨网络的数据协同,同时支撑了站内组件和应用接口的标准化:1、统一站内对外接口,便于站内、外应用无缝拓展;2、统一注册管理,便于全局管控,标准化建设;3、统一收口站内组件交互关系,标准化组件分工,便于统筹建设基础核心系统。统一标准的数字换流站管理设备,为视频融合的三级部署架构的云边协同,提供了站内运行环境基础,为视频流同步及模型、数据、告警同步,提供了统一服务接口,是视频融合云边协同功能的多站推广的前提。
作为上述方案的改进,所述基础应用包括全站视频管控应用、全站三维呈现应用、设备状态总览应用、设备告警总览应用、故障录波管理应用、智能报表管理应用、数字站区管理应用和远程智能巡视应用;其中,所述全站视频管控应用和全站三维呈现应用配置为为所述视频融合处理模块提供服务,所述设备状态总览应用配置为为所述设备状态监控模块提供服务,所述设备告警总览应用配置为为所述设备告警管理模块提供服务,所述故障录波管理应用配置为为所述故障录波管理模块提供服务,所述智能报表管理应用配置为为所述数据报表管理模块提供服务,所述数字站区管理应用配置为为所述数字站区管理模块提供服务,所述远程智能巡视应用配置为为所述远程智能巡视模块提供服务。
具体的,结合上述实施例,数字换流站的基础应用主要包括全站视频管控应用、全站三维呈现应用、设备状态总览应用、设备告警总览应用、故障录波管理应用、智能报表管理应用、数字站区管理应用和远程智能巡视应用等,其中:
针对全站视频管控应用,主要配置为为各级监控终端的视频融合处理模块提供服务;全站视频管控应用,即基于3D-GIS地理信息系统建设全站视频管控功能,采用地理信息、三维模型、实时视频结合的方式,实现摄像机画面与地理信息数据关联,可通过摄像机区域列表、三维模型可视化点选、小地图导航定位区域等方式实现访问全站视频资源,并应向数字换流站的其他应用提供满足相关标准的交互接口;全站视频管控应用的基础功能要求主要包括:1)支持真实的经纬度等地理信息坐标体系,内建WGS84坐标系(EPSG:4326),并具有支持各种地理坐标转换的能力;2)承载影像图、数字高程、矢量数据、数字线划图等GIS数据;3)具备激光扫描、手动建模等方式建立模型的能力,具备OBJ、3DS、FBX、OSG等多种模型格式的导入功能,具备大场景实时渲染,动态内存调度的能力;4)具备倾斜摄影模型、osgb模型直接导入功能,具备分地块LOD架构的osgb数据读取与分层级渲染功能;5)具备图层管理功能,可分为设备模型图层、视频融合图层等,图层可进行显示、隐藏;6)以三维数字地球为支撑,支持多级混合精度的三维地理数据,可加载地理信息数据、三维建筑模型及二维矢量电子地图;7)应具备站区周边10平方公里范围的卫星影像图及数字高程加载的能力;8)应具备站内视频巡检路线定制功能,应实现巡视计划设置、巡视点配置、巡视任务查询、巡视结果统计,关键生产数据弹出展示,实现数据预警;可采用立即执行、周期执行、定期执行等方式;可自动生成巡检日志;全站视频管控应用的视频集中管理功能要求主要包括:1)整合站内视频资源,包括:工业视频、全自动巡检、红外、无人机、机器人等 系统视频数据,在三维GIS系统中完成各摄像机空间坐标的采集与标定;2)支持传统监控1/4/9宫格播放形式,可自定义调整视频播放数量和位置;3)支持在三维场景中通过可视化图标点选的方式,对视频进行快速访问,调出的视频弹窗位置、大小,可伴随三维图标的移动而进行动态调整;4)支持按照摄像头区域列表、小地图导航定位区域等多种形式快速访问视频资源;5)具备云台控制、录像回放等常规视频操作功能。
全站视频管控应用的上级远程操作与控制功能要求主要包括:1)支持上级单位远程访问站端实时视频监控画面;支持上级单位对站端摄像头进行远程操控;支持上级单位远程访问站端3D-GIS地理信息系统,操作三维场景画面;2)应具备权限分配与操作互斥机制,确保同一个实例同时只能由一方操控应用;当多实例同时操作同一个摄像头时,根据权限锁定与解锁摄像头控制;3)支持PC、中控室大屏运行全站视频管控应用,上送高清画质,画面清晰;全站视频管控应用的高级应用拓展接口功能要求主要包括:1)应具备实现全景视频融合功能的扩展能力,视频融合实现方式为:视频三维映射、相邻视频拼接,将不同位置的多路离散视频流汇集融合到一起,在三维模型上投射视频画面;2)应具备接入人工智能、图像识别算法识别结果的拓展能力,可接入各类报警数据,并在应用中进行告警;3)应具备构建多端协同标绘功能的拓展能力;4)应具备与资源部署编辑器结合、实现可视化编辑协同预案与推演功能的拓展能力;5)应具备以局部区域或事件目标为驱动,实现协同追视功能的拓展能力;全站视频管控应用的性能要求主要包括:1)支持任意多路高清视频同步接入;2)各项功能用户界面点击后响应时间≤1秒;3)对外接口调用后响应时间≤1秒;4)平均三维渲染帧率≥30帧/秒。
针对全站三维呈现应用,主要配置为为各级监控终端的视频融合处理模块提供服务;全站三维呈现应用,即基于点云数据进行三维精细化建模,多维呈现站内全场景信息,真实反映设备状态及其周围环境,融合告警提示、监测数据、视频图像等实时信息,以及作业记录、一次接线图等数据资料,支持对站内区域、设备、系统、建筑物等进行突出显示,并应向数字换流站的其他应用提供满足相关标准的交互接口;全站三维呈现应用的基础模型要求主要包括:1)具备对全站设备、附属设施、建筑物、道路、安防设施等进行彩色激光点云扫描及素材采集功能,点云密度≥100点/平方米,精度为1mm~10mm,点云文件的重影不超过2cm;2)点云扫描范围,室内应包括但不限于:综合楼、主控楼、保护设备室、空调设备间、水泵房、站辅助设备、备品备件库房、门卫室等;室外应包括但不限于:主变、站用变、高抗、避雷针塔、钢构支架、避雷网、站内全部接线、消防设施、道路、围墙、水池、空调外机及其他站内设施等;3)具备分区采集全站高清图片功能,保证设备表计、名牌拍摄清晰、输出360°全景图片;4)具备对点云扫描las原始数据进行处理,按区域等比例大小切割,对重点设备进行单独切割功能,切割单独文件大小≤4G;模型制作应将点云扫描和现场采集照片对照制作;5)具备输出las、max模型用于精细化模型制作功能;全站三维呈现应用的精细化模型要求主要包括:1)具备基于全站点云数据模型开展精细化三维建模能力;2)具备根据真实的站内环境进行三维场景建 模能力,实景化处理纹理,配色与现场保持一致,应真实还原设备及设备周围环境,包括与该设备相关的其他设备、设施、周围建筑物等;3)支持在全站三维模型中对各区域、设备、系统、建筑物等进行突出显示,具备支持全站一次设备定位功能;4)应具备依据GIS地图准确设置三维场景的地理坐标数据的能力,三维模型应支持IoT(物联网)类数据接入,如现场测点数据、摄像头(红外)等;5)具备三维空间点对点精准测距、面积精准测量能力;6)支持分区域层级信息呈现:应实现多系统与三维场景联动,可按全站、区域、子区域等不同层级、不同维度的查看运行情况。
全站三维呈现应用的多维信息呈现主要包括:1)具备系统告警信息、导航树、系统集成框架与三维场景的联动功能,以全站、区域、设备、系统等为单位快速定位呈现,可完成放大、缩小、转动等操作;2)支持对各类信息进行定位呈现,应包含设备的台账信息、运行参数信息、状态信息、实时运行数据、在线监测数据、检修记录、缺陷记录等;3)应具备直观呈现设备的真实运行状态的功能,如运行、分合闸状态等,呈现不同状态下的渲染效果,如设备动作动画等;全站三维模型中点选到某一设备时,应用颜色区分设备状态,如:正常为绿色,异常为橙色,故障为红色,未带电为灰色等;4)具备一次设备测点数据可视化功能,应显示设备实时测点数值,并同时呈现测点对应的上限、上上限、下限、下下限的阈值信息,支持测点数据历史趋势图查看。在测点超阈值的异常情况下以黄色或红色突出显示测点值;5)具备接收、读取平台中的设备报警信息功能,同时自动将出现异常告警的设备根据告警等级渲染成黄色或红色告警模式并在三维场景定位,不间断提示操作人员关注故障,确认后设备告警状态不再闪烁;全站三维呈现应用的性能要求主要包括:1)三维全站场景首次加载完成时间≤4秒;2)三维场景中用户切换区域场景响应时间≤1秒;3)三维场景中交互界面加载响应时间≤1秒;4)三维场景中数据显示时延≤1秒;5)三维场景交互式实时渲染帧率≥30帧/秒。
针对设备状态总览应用,主要配置为为各级监控终端的设备状态监控模块提供服务,设备状态总览应用,即基于数字换流站的全站数据汇聚,包括设备台账、运行信息、监测数据等,以设备为中心,分级汇总设备关键指标,并进行综合展示,支持关键设备数据在日周月及自定义时间范围的比对分析、原始数据一键导出和异常信息标注提示;设备状态总览应用的功能要求主要包括:1)应具备全站设备状态监视总览画面,监视全站设备的运行状态,支持按设备分类展示关键设备数据信息;2)具备设备的关键参量在指定时间范围内变化幅度域值设定功能,当监测的关键参量超出域值范围时,应发出提示信息;3)支持换流变(变压器)关键测点信息展示,包括绕组温度、油面温度、套管SF6气压、本体油中含气量、铁芯接地电流、夹件接地电流、本体油箱油位、有载分接开关油位、本体油压等;4)支持站用变的关键测点信息展示,包括油温、绕组温度、本体油中含气量、铁芯接地电流、夹件接地电流、本体油位等;5)支持GIS关键测点信息展示,包括GIS中SF6压力、穿墙套管压力、油压、导电杆温度、电机回路电流等;6)比对对象选择方式应支持多种,包括:支持模糊查询,输入关键字可以模型匹配对应的测点对象;支持设备查询,提供所有设 备与测点的树形结构,按层级选择,并支持多选;7)时间选择方式应支持多种,包括按日选择查询、按周选择查询、按月选择查询,并可自定义起止时间查询;8)查询后应显示所选测点对象的曲线图形,支持所选曲线在同一时间段内进行比对分析,并标识出每个对象查询周期中的最大值、最小值、平均值等;9)支持单个测点不同时间段的历史数据曲线的展示,可根据条件选择单个测点对象,并添加选择多个时间段查询数据曲线;10)当所查询的测点对象数据有异常时,应给出相应文字提示信息,记录异常的对象、发生时间等信息;11)具备所选测点对象原始数据导出功能,导出格式为csv;设备状态总览应用的性能要求主要包括:1)测点树加载完成时间≤2秒;2)多选测点数量≥5条;3)日曲线及数据表加载时间≤3秒;4)周曲线及数据表加载时间≤7秒;5)月曲线及数据表加载时间≤30秒;6)原始数据导出时间≤5秒。
针对设备告警总览应用,主要配置为为各级监控终端的设备告警管理模块提供服务,设备告警总览应用,即基于数字换流站的全站数据汇聚,实现设备告警总览,支持告警信息在设备、等级、时间等维度上的统计及信息展示,并支持告警信息的实时刷新及过滤检索功能。告警推送时,可人工触发该项告警所属设备的联动功能,展示与该设备相关的数据信息;设备告警总览应用的告警统计功能要求主要包括:1)具备按告警来源统计功能,来源包括各类系统及应用告警,支持根据日、周、月、年查看三种类型告警的占比与数量;2)具备按告警等级统计功能,根据日、周、月、年统计各等级告警的占比与数量;3)具备按时间段统计功能,支持按日、周、月、年统计每个时间段内的告警数量,展示告警按时间分布情况;设备告警总览应用的系统告警查询功能要求主要包括:1)支持过滤非确认告警信息;2)具备按等级、按系统、按设备对告警信息进行过滤和检索功能;3)具备按告警描述关键字对告警信息进行过滤和检索功能;4)对于未处理的告警,具备告警确认功能,并支持确认信息录入;5)支持告警信息按颜色区分告警等级;设备告警总览应用的应用告警查询功能要求主要包括:1)支持过滤非确认告警信息;2)具备按等级、按设备、按应用、按类型对告警信息进行过滤和检索功能;3)具备按告警描述关键字对告警信息进行过滤和检索功能;4)对于未处理的告警,具备告警确认功能,并支持确认信息录入;5)支持告警信息按颜色区分告警等级;6)对于附带有故障简报的应用告警,具备故障简报查看功能;设备告警总览应用的性能要求主要包括:1)统计数据加载完成时间≤1秒;2)当日告警查询时间≤1秒;3)当月告警查询时间≤5秒;4)当年告警查询时间≤10秒;5)告警确认响应时间≤1秒。
针对故障录波管理应用,主要配置为为第三监控终端的故障录波管理模块提供服务,故障录波管理应用,即基于数字换流站的全站数据汇聚,实现故障录波管理,能够统一查询与检索平台接入的故障录波文件,并对文件进行在线解析,展示各通道波形、配置参数与故障报告信息;故障录波管理应用的功能要求主要包括:1)具备数字换流站中所有录波文件按设备、文件名称、时间检索功能;2)检索结果以列表形式展示,展示列包括文件的名称、时间、大小等信息;3)具备波形文件整体打包下载功能;4)具备波形在线查看功能,支持自定义渲染多个通道波形曲线,所有波形时间轴相同,并支持统一游标,支持 波形缩放;5)具备录波数据在线查看功能,支持展示所有通道数据点,包括通道名称、单位及每个采样点数据;6)具备录波参数在线查看功能,支持展示CFG文件中波形基本参数信息,包括波形文件基本信息、模拟通道参数信息以及状态通道参数信息;7)具备录波简报在线查看功能,支持解析HDR文件;8)具备向第三方应用开放在线波形解析功能,为波形文件提供在线分析服务;9)具备波形导出(PNG、PDG、Jpeg、Comtrade等格式)、打印功能;故障录波管理应用的性能要求主要包括:1)波形加载完成时间≤10秒;2)配置参数加载时间≤5秒;3)故障报告加载时间≤5秒。
针对智能报表管理应用,主要配置为为第三监控终端的数据报表管理模块提供服务,智能报表管理应用,即实现数字站站内相关业务数据统计,按照运维需求通过日报、周报、月报展示历史数据、统计数据和分析数据,实现报表的任务制定、报表自动生成、报表导出及打印等功能;智能报表管理应用的功能要求主要包括:1)支持运维人员日常统计所需的重要报表项:包含进出线的线路负荷、系统负荷、油浸式变压器温度、不平衡电流、油色谱统计、SF6抄录等日、周、月报表;2)具备定制报表生成任务功能,系统按照任务自动生成、导出报表,支持日报、月报、季报、年报等;3)具备统计分析数据功能,包括最大值、最小值、平均值、负荷率等;4)具备报表数据导出文件功能,文件类型应兼容EXCEL;5)具备报表打印功能,提供公共打印按钮,一键打印;6)应具备按模板生成站内生产运行日报功能;智能报表管理应用的性能要求主要包括:1)单日测点报表表格数据加载时间≤3秒;2)单日告警数据报表表格加载时间≤3秒;3)月度统计分析类数据报表表格加载时间≤30秒;4)年度统计分析类数据报表表格加载时间≤300秒;5)报表导出动作响应时间≤3秒。
针对数字站区管理应用,主要配置为为第三监控终端的数字站区管理模块提供服务,数字站区管理应用,即基于数字换流站的全站数据汇聚,以站区为主体,依托全站统一的三维底座,完成安防、消防、动力环境和其它辅助监控信息等统一监视和管理;数字站区管理应用的安防监测功能要求主要包括:1)具备视频实时查阅、历史视频信息调阅等功能,具备主控楼出入口、二次设备机房、门卫室、周界出入口、生产区出入口、周界、与外界相连的窗口、通风口、管道(沟、渠)等位置的轮巡功能;2)具备重点部位布置巡查功能,如重点设备、周界、主控室、二次设备室、高压室等;3)支持展示出入口、窗口、通风口告警信息,实现入口管理、视频联动及远程控制等功能;4)支持安防告警信息联动现场声光报警器、安防照明控制系统、视频监控系统;5)支持告警源、告警事件、等级、发生时间、确认人、确认时间等信息呈现,并能关联查询告警所产生的联动行为;6)支持告警联动录像一键回放;7)支持记录电子巡查等功能模块业务日志,并能通过人员、类型、日期等条件进行查询并导出报表;数字站区管理应用的消防监测功能要求主要包括:1)具备视频实时查阅、历史视频信息调阅等功能,展示消防设备、区域实时视频信息;2)支持火灾报警主机、火灾探测设备、固定灭火设备的运行状态呈现;3)支持通过三维底座呈现固定灭火设备位置、火灾探测设备、移动式手持式灭火设备原始地理位置;4)支持消防告警信息联动监控视频,推送报警点位置画面,画面内容包 括报警点附近消防设备、物资、通道等状态信息;数字站区管理应用的动力环境监测功能要求主要包括:1)对灯光、空调、水泵、门禁、给排水等呈现站区状态的信息进行统一监视;2)具备对灯光、空调、门禁、给排水等设备控制功能;数字站区管理应用的性能要求主要包括:1)实时数据加载完成时间≤1秒;2)告警查询时间≤1秒;3)管控记录查询时间≤5秒;4)综合预警触发时间≤10秒。
针对远程智能巡视应用,主要配置为为第三监控终端的远程智能巡视模块提供服务,远程智能巡视应用,即实现摄像机、机器人、无人机及声纹监测装置实现统一接入、下发控制和处理巡视结果。控制机器人和摄像机开展室内外设备联合巡视作业,接收巡视数据、采集文件,对采集的数据进行智能分析,形成巡视结果和巡视报告,及时发送告警。同时具备实时监控、与主辅设备监控系统智能联动等功能,并应向数字换流站的其他应用提供满足相关标准的交互接口。
需要说明的是,基于数字换流站全站视频管控应用、全站三维呈现应用、设备状态总览应用、设备告警总览应用、故障录波管理应用、智能报表管理应用、数字站区管理应用和远程智能巡视应用等基础应用所具备的功能,在各级监控终端中所部署的视频融合处理模块、设备状态监控模块、设备告警管理模块、故障录波管理模块、数据报表管理模块、数字站区管理模块和远程智能巡视模块等功能模块,也能对应实现基础应用所具备的功能。
示例性的,本申请实施例中的数字换流站,还能够提供全景三维数字孪生技术和全景视频融合技术,其中,全景三维数字孪生技术:实现设备资产数据与三维系统融合,通过三维空间视角的方式实现对设备资产信息的可视化管理功能,提供三维展示基础功能:三维模型的移动、缩放、旋转、分层浏览;提供实时数据展示:换流站三维全景系统与设备数据融合,可实时查看一次设备状态和遥测实时数据、模拟量历史数据等功能;提供三维联动:实现设备告警信息与三维构件的融合,三维画面能实时显示换流站系统告警信息并标注告警信息对应的位置。全景视频融合技术:基于虚拟现实融合技术将离散的传统监控视频与全景的三维模型进行视频融合,形成场景内不同视频画面之间的空间关联,建立AR视频监控体系;将离散分布在厂站重点防控区域的监控视频拼接融合到虚拟现实场景模型中,建立视频在虚拟现实空间的感知及应用能力,提供多个区域连续、直观监控,方便人员概览全局,实现可跨越区域、视角的全景视频融合展示;提供关键检修路径视频自动巡检功能,可按照巡视检修人员日常巡视的角度、巡视的速度自动进行巡检,按需展示与设定路线相关联的资源信息,不用进行人为切换,通过平台自动巡检与人员巡视相结合,保障对重点区域24小时不间断的监测;提供二三维信息同步关联功能,将三维全景视频、二维全局地图和分镜头视频同步联动显示;在平面二维地图中显示重点区域内所有摄像机的覆盖区域和位置以及用户当前观察点的视角位置,根据三维场景中的视角设定,平台自动关联显示该区域的分镜头监控视频,以供监控人员选择最佳视频视角。
本申请实施例所提供的一种基于数字换流站的监控系统,相比于传统的换 流站,作为被监控对象的数字换流站具有统一的公共组件和基础应用,使能技术架构一致性管控(边缘厂站侧设备和OS的标准化系列化以及预集成)、提供统一的数据集成及数据服务总线、提供统一的基础应用框架,确保数字换流站标准体系落地,从而为传统换流站的数字化转型提供基础保障,并且能够在所述监控系统实现各种功能时,向各级监控终端提供统一的、标准化的数据服务,大大降低数字换流站的对外交互成本和时间成本,有效降低网络延。
在又一个优选实施例中,将所述一级监控侧的用户作为第一用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块;
所述第一视频融合处理模块还配置为对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;其中,所述第一普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
所述第一视频融合处理模块在所述第一用户为所述第一普通用户时,响应所述第一普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第一监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一普通用户调阅的视频融合画面。
具体的,结合上述实施例,第一视频融合处理模块可以对一级监控侧的第一用户进行用户权限管理,将第一用户配置为第一普通用户或第一VIP用户;其中,第一用户可以为电网系统总部的决策管理用户或其他用户等,第一普通用户的用户权限为:具有权限查看数字换流站的指定被监控区域的视频融合画面,没有权限查看数字换流站的指定被监控区域之外的其他被监控区域的视频融合画面;第一VIP用户的用户权限为:具有权限查看数字换流站的所有被监控区域的视频融合画面。
示例性的,在一级监控侧,可以根据不同的职能和操作需求,并基于计算资源和网络带宽的限制,开通一定数量的用户账号,供第一用户登陆使用,第一视频融合处理模块可以通过对用户账号进行权限划分及权限管理,实现对第一用户的用户权限进行管理。
在本申请实施例中,当第一人机交互模块接收到一级监控侧的第一普通用户的监控调阅请求时,第一视频融合处理模块主要配置为响应第一普通用户的监控调阅请求,先从第三监控终端的数据存储模块中存储的数字换流数据中的指定被监控区域的视频融合原始数据中,获取待查看区域的视频融合原始数据,再利用第一监控终端的本地计算资源,对获得的待查看区域的视频融合原始数据进行视频融合处理,相应获得视频融合画面,该视频融合画面供第一普通用户进行调阅。
可以理解的,指定被监控区域可以根据第一普通用户的用户需求进行选择, 指定被监控区域包括数字换流站的至少一个被监控区域,由于第一普通用户只具有权限查看数字换流站的指定被监控区域的视频融合画面,因此,在本申请实施例中,待查看区域只能从指定被监控区域中进行选择,即可以选择指定被监控区域中的至少一个被监控区域作为待查看区域,并且第一普通用户在发起监控调阅请求时,可以同时指定待查看区域,使得第一视频融合处理模块能够根据第一普通用户的监控调阅请求,确定实际需要从第三监控终端远程调用哪一个或哪几个被监控区域的视频融合原始数据。
本申请实施例所提供的一种基于数字换流站的监控系统,通过对一级监控侧的第一用户进行用户权限管理,不同的用户权限级别对应不同的视频融合画面调度查阅能力,并且通过对第一普通用户的视频融合画面调度查阅权限增加一定的限制,使得第一普通用户只能调度查阅指定被监控区域的视频融合画面,从而能够节约广域出口带宽,进一步的,针对第一普通用户的监控调阅请求,第一视频融合处理模块直接远程调用所需的视频融合原始数据,并根据第一监控终端本地部署的渲染引擎对获得的视频融合原始数据进行渲染加工,从而在第一监控终端本地完成视频融合任务,第一普通用户可以直接从本地查阅获得的视频融合画面,无需由第三监控终端完成视频融合,也无需从第三监控终端远程调阅视频融合画面,从而能够有效避免远程调阅视频融合画面所带来的网络延时问题。
作为上述方案的改进,将所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
则,所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,还包括:
所述第一视频融合处理模块在所述第一用户为所述第一VIP用户时,响应所述第一VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第一视频融合请求,所述第一视频融合请求中包括待查看区域标识;
所述第三视频融合处理模块根据所述第一视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一VIP用户调阅的视频融合画面并发送至所述第一视频融合处理模块;
所述第一视频融合处理模块接收获得用于所述第一VIP用户调阅的视频融合画面。
具体的,结合上述实施例,当第一人机交互模块接收到一级监控侧的第一VIP用户的监控调阅请求时,第一视频融合处理模块主要配置为响应第一VIP用户的监控调阅请求,向第三监控终端的第三视频融合处理模块发送第一视频融合请求,该第一视频融合请求中包括待查看区域标识;第三视频融合处理模块在接收到该第一视频融合请求之后,先根据该第一视频融合请求中所包含的待查看区域标识,从数据存储模块中存储的数字换流站数据中的所有被监控区域的视频融合原始数据中,获取待查看区域的视频融合原始数据,再利用第三 监控终端的本地计算资源,对获取的待查看区域的视频融合原始数据进行视频融合处理,相应获得用于第一VIP用户调阅的视频融合画面,并将获得的用于第一VIP用户调阅的视频融合画面反馈给第一视频融合处理模块;第一视频融合处理模块实时接收视频融合画面,该视频融合画面供第一VIP用户进行调阅。
可以理解的,由于第一VIP用户具有权限查看数字换流站的所有被监控区域的视频融合画面,因此,在本申请实施例中,待查看区域可以从数字换流站的所有被监控区域中进行选择,可以选择所有被监控区域中的至少一个被监控区域作为待查看区域,并且第一VIP用户在发起监控调阅请求时,可以同时指定待查看区域,示例性的,可以通过为每一个被监控区域设置区域标识的方式来区分不同的被监控区域,相应的,第一VIP用户可以通过区域标识来指定待查看区域。
本申请实施例所提供的一种基于数字换流站的监控系统,针对第一VIP用户的监控调阅请求,第一视频融合处理模块向第三视频融合处理模块发送视频融合请求,由第三视频融合处理模块根据第三监控终端本地部署的渲染引擎对获得的视频融合原始数据进行渲染加工,从而在第三监控终端本地完成视频融合任务,第一VIP用户可以从第三监控终端远程调阅视频融合画面,能够满足第一VIP用户可以查看任意被监控区域的需求。
需要说明的是,在本申请实施例中,第一视频融合处理模块根据不同的用户权限选择执行不同的视频融合处理方案,能够保证对算力和响应要求高的用户的视频融合任务能够在本地就近执行,从而有效解决网络延时问题,并且在本地完成视频融合处理任务时,第一视频融合处理模块仅能调用数据存储模块中存储的数字换流站的指定被监控区域的视频融合原始数据,所有第一普通用户共享数字换流站的指定被监控区域的视频融合原始数据,从而能够减少对网络带宽资源的占用,进一步降低网络延迟。
在又一个优选实施例中,将所述二级监控侧的用户作为第二用户,所述第二监控终端的视频融合处理模块作为第二视频融合处理模块;
所述第二视频融合处理模块还配置为对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;其中,所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第二VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,所述第二视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
所述第二视频融合处理模块在所述第二用户为所述第二普通用户时,响应所述第二普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第二监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第二普通用户调阅的视频融合画面。
具体的,结合上述实施例,第二视频融合处理模块可以对二级监控侧的第 二用户进行用户权限管理,将第二用户配置为第二普通用户或第二VIP用户;其中,第二用户可以为电网系统省级单位的运维管控用户或其他用户等,第二普通用户的用户权限为:具有权限查看数字换流站的指定被监控区域的视频融合画面,没有权限查看数字换流站的指定被监控区域之外的其他被监控区域的视频融合画面;第二VIP用户的用户权限为:具有权限查看数字换流站的所有被监控区域的视频融合画面。
示例性的,在二级监控侧,可以根据不同的职能和操作需求,并基于计算资源和网络带宽的限制,开通一定数量的用户账号,供第二用户登陆使用,第二视频融合处理模块可以通过对用户账号进行权限划分及权限管理,实现对第二用户的用户权限进行管理。
在本申请实施例中,当第二人机交互模块接收到二级监控侧的第二普通用户的监控调阅请求时,第二视频融合处理模块主要配置为响应第二普通用户的监控调阅请求,先从第三监控终端的数据存储模块中存储的数字换流站数据中的指定被监控区域的视频融合原始数据中,获取待查看区域的视频融合原始数据,再利用第二监控终端的本地计算资源,对获得的待查看区域的视频融合原始数据进行视频融合处理,相应获得视频融合画面,该视频融合画面供第二普通用户进行调阅。
可以理解的,指定被监控区域可以根据第二普通用户的用户需求进行选择,指定被监控区域包括数字换流站的至少一个被监控区域,由于第二普通用户只具有权限查看数字换流站的指定被监控区域的视频融合画面,因此,在本申请实施例中,待查看区域只能从指定被监控区域中进行选择,即可以选择指定被监控区域中的至少一个被监控区域作为待查看区域,并且第二普通用户在发起监控调阅请求时,可以同时指定待查看区域,使得第二视频融合处理模块能够根据第二普通用户的监控调阅请求,确定实际需要从第三监控终端远程调用哪一个或哪几个被监控区域的视频融合原始数据。
本申请实施例所提供的一种基于数字换流站的监控系统,通过对二级监控侧的第二用户进行用户权限管理,不同的用户权限级别对应不同的视频融合画面调度查阅能力,并且通过对第二普通用户的视频融合画面调度查阅权限增加一定的限制,使得第二普通用户只能调度查阅指定被监控区域的视频融合画面,从而能够节约广域出口带宽,进一步的,针对第二普通用户的监控调阅请求,第二视频融合处理模块直接远程调用视频融合原始数据,并根据第二监控终端本地部署的渲染引擎对获得的视频融合原始数据进行渲染加工,从而在第二监控终端本地完成视频融合任务,第二普通用户可以直接从本地查阅获得的视频融合画面,无需由第三监控终端完成视频融合,也无需从第三监控终端远程调阅视频融合画面,从而能够有效避免远程调阅视频融合画面所带来的网络延时问题。
作为上述方案的改进,将所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
则,所述第二视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于 本地监控侧的用户调阅的视频融合画面,还包括:
所述第二视频融合处理模块在所述第二用户为所述第二VIP用户时,响应所述第二VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第二视频融合请求,所述第二视频融合请求中包括待查看区域标识;
所述第三视频融合处理模块根据所述第二视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第二VIP用户调阅的视频融合画面并发送至所述第二视频融合处理模块;
所述第二视频融合处理模块接收获得用于所述第二VIP用户调阅的视频融合画面。
具体的,结合上述实施例,当第二人机交互模块接收到二级监控侧的第二VIP用户的监控调阅请求时,第二视频融合处理模块主要配置为响应第二VIP用户的监控调阅请求,向第三监控终端的第三视频融合处理模块发送第二视频融合请求,该第二视频融合请求中包括待查看区域标识;第三视频融合处理模块在接收到该第二视频融合请求之后,先根据该第二视频融合请求中所包含的待查看区域标识,从数据存储模块中存储的数字换流站数据中的所有被监控区域的视频融合原始数据中,获取待查看区域的视频融合原始数据,再利用第三监控终端的本地计算资源,对获取的待查看区域的视频融合原始数据进行视频融合处理,相应获得用于第二VIP用户调阅的视频融合画面,并将获得的用于第二VIP用户调阅的视频融合画面反馈给第二视频融合处理模块;第二视频融合处理模块实时接收视频融合画面,该视频融合画面供第二VIP用户进行调阅。
可以理解的,由于第二VIP用户具有权限查看数字换流站的所有被监控区域的视频融合画面,因此,在本申请实施例中,待查看区域可以从数字换流站的所有被监控区域中进行选择,可以选择所有被监控区域中的至少一个被监控区域作为待查看区域,并且第二VIP用户在发起监控调阅请求时,可以同时指定待查看区域,示例性的,可以通过为每一个被监控区域设置区域标识的方式来区分不同的被监控区域,相应的,第二VIP用户可以通过区域标识来指定待查看区域。
本申请实施例所提供的一种基于数字换流站的监控系统,针对第二VIP用户的监控调阅请求,第二视频融合处理模块向第三视频融合处理模块发送视频融合请求,由第三视频融合处理模块根据第三监控终端本地部署的渲染引擎对获得的视频融合原始数据进行渲染加工,从而在第三监控终端本地完成视频融合任务,第二VIP用户可以从第三监控终端远程调阅视频融合画面,能够满足第二VIP用户可以查看任意被监控区域的需求。
需要说明的是,在本申请实施例中,第二视频融合处理模块根据不同的用户权限选择执行不同的视频融合处理方案,能够保证对算力和响应要求高的用户的视频融合任务能够在本地就近执行,从而有效解决网络延时问题,并且在本地完成视频融合处理任务时,第二视频融合处理模块仅能调用数据存储模块中存储的数字换流站的指定被监控区域的视频融合原始数据,所有第二普通用 户共享数字换流站的指定被监控区域的视频融合原始数据,从而能够减少对网络带宽资源的占用,进一步降低网络延迟。
进一步的,在第一视频融合处理模块只能从数据存储模块远程调用数字换流站的指定被监控区域的视频融合原始数据,第一普通用户被限制为只能调度查阅指定被监控区域的视频融合画面,第二视频融合处理模块只能从数据存储模块远程调用数字换流站的指定被监控区域的视频融合原始数据,第二普通用户被限制为只能调度查阅指定被监控区域的视频融合画面的前提下,为了进一步节省带宽,第一普通用户和第二普通用户具有权限查看的指定被监控区域,可以是相同范围内的被监控区域,也就是说,所有的第一普通用户和第二普通用户(或者,一视频融合处理模块和第二视频融合处理模块)可以共享数字换流站的指定被监控区域的视频融合原始数据,在从数据存储模块远程调用指定被监控区域的视频融合原始数据时,也只需占用同一份网络带宽资源。
在又一个优选实施例中,将所述三级监控侧的用户作为第三用户,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
所述第三视频融合处理模块还配置为对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;其中,所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,所述第三视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
所述第三视频融合处理模块在所述第三用户为所述第三VIP用户时,响应所述第三VIP用户的监控调阅请求,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第三VIP用户调阅的视频融合画面。
具体的,结合上述实施例,第三视频融合处理模块可以对三级监控侧的第三用户进行用户权限管理,将第三用户全部配置为第三VIP用户;其中,第三用户可以为数字换流站的监控运维用户或其他用户等,第三VIP用户的用户权限为:具有权限查看数字换流站的所有被监控区域的视频融合画面。
示例性的,在三级监控侧,可以根据不同的职能和操作需求,并基于计算资源和网络带宽的限制,开通一定数量的用户账号,供第三用户登陆使用,第三视频融合处理模块可以通过对用户账号进行权限划分及权限管理,实现对第三用户的用户权限进行管理,而由于第三用户本身处于三级监控侧,无需使用远程功能,不会占用三级监控侧与二级监控侧、一级监控侧之间的网络带宽资源,因此,可以将第三用户全部配置第三VIP用户。
在本申请实施例中,当第三人机交互模块接收到三级监控侧的第三VIP用户的监控调阅请求时,第三视频融合处理模块主要配置为响应第三VIP用户的监控调阅请求,先从数据存储模块中存储的数字换流站数据中的所有被监控区域的视频融合原始数据中,获取待查看区域的视频融合原始数据,再利用第三监控终端的本地计算资源,对获取的待查看区域的视频融合原始数据进行视频 融合处理,相应获得视频融合画面,该视频融合画面供第三VIP用户进行调阅。
可以理解的,由于第三VIP用户具有权限查看数字换流站的所有被监控区域的视频融合画面,因此,在本申请实施例中,待查看区域可以从数字换流站的所有被监控区域中进行选择,可以选择所有被监控区域中的至少一个被监控区域作为待查看区域,并且第三VIP用户在发起监控调阅请求时,可以同时指定待查看区域,示例性的,可以通过为每一个被监控区域设置区域标识的方式来区分不同的被监控区域,相应的,第三VIP用户可以通过区域标识来指定待查看区域。
本申请实施例所提供的一种基于数字换流站的监控系统,针对第三VIP用户的监控调阅请求,由第三视频融合处理模块根据第三监控终端本地部署的渲染引擎对获得的视频融合原始数据进行渲染加工,从而在第三监控终端本地完成视频融合任务,第三VIP用户可以从本地直接调阅视频融合画面,能够避免远程调阅所带来的网络延时问题,并且满足第二VIP用户可以查看任意被监控区域的需求。
在又一个优选实施例中,将所述第二监控终端作为数据发送端且所述第一监控终端作为数据接收端,或,将所述第三监控终端作为数据发送端且所述第二监控终端作为数据接收端;
则,所述数据发送端还包括网络探测模块;所述网络探测模块配置为定期进行网络带宽探测,以探测所述数据发送端与对应的所述数据接收端之间的网络可用带宽和最小延时时间,并在每一次探测完成时,仅记录最后一次探测到的网络可用带宽和最小延时时间,以在需要向对应的所述数据接收端传输视频融合业务数据时,根据当前记录的网络可用带宽确定视频融合业务数据的初始数据传输速率。
需要说明的是,以视频融合处理方案为例,第一视频融合处理模块在响应第一VIP用户的监控调阅请求时,需要通过第二监控终端从第三监控终端远程调阅由第三视频融合处理模块生成的视频融合画面,第一视频融合处理模块在响应第一普通用户的监控调阅请求时,需要通过第二监控终端从第三监控终端的数据存储模块中远程调用指定被监控区域的视频融合原始数据,第二视频融合处理模块在响应第二VIP用户的监控调阅请求时,需要从第三监控终端远程调阅由第三视频融合处理模块生成的视频融合画面,第二视频融合处理模块在响应第二普通用户的监控调阅请求时,需要从第三监控终端的数据存储模块中远程调用指定被监控区域的视频融合原始数据,由此可见,在第一监控终端与第二监控终端之间进行数据传输时,第二监控终端是作为数据发送端,第一监控终端是作为数据接收端,在第二监控终端与第三监控终端之间进行数据传输时,第三监控终端是作为数据发送端,第二监控终端是作为数据接收端。
具体的,结合上述实施例,数据发送端(即第二监控终端和第三监控终端)还包括网络探测模块,网络探测模块主要配置为在每一对数据发送端与数据接收端之间,通过定期进行网络带宽探测,来实时探测每一对数据发送端与对应的数据接收端之间的网络可用带宽和最小延时时间,并且在每一次探测完成时,仅记录最后一次探测获得的网络可用带宽和最小延时时间,以在数据发送端需 要向对应的数据接收端传输视频融合业务数据时,可以根据当前记录的网络可用带宽确定视频融合业务数据的初始数据传输速率。
需要说明的是,发送端与数据接收端之间传输的业务数据除了视频融合业务数据(视频融合业务数据可以包括传输视频融合画面时对应的视频流数据,或,传输指定被监控区域的视频融合原始数据)之外,还可以包括其他类型的业务数据,例如,还可以传输各级监控终端的各个功能模块所需的相关业务数据(如上述实施例所述的设备状态监控业务数据和设备告警业务数据)等,相应的,数据发送端在需要向对应的数据接收端传输其他数据类型的业务数据时,同样可以根据当前记录的网络可用带宽确定其他数据类型的业务数据的初始数据传输速率。
进一步的,在数据发送端不需要向对应的数据接收端传输业务数据时,网络探测模块可以通过定期进行网络带宽探测,来实时探测并记录每一对数据发送端与对应的数据接收端之间的网络可用带宽和最小延时时间,而为了减少资源占用,在数据发送端需要向对应的数据接收端传输业务数据时,网络探测模块可以不再定期进行网络带宽探测,此时业务数据可以以业务报文的形式进行传输,通过对传输的业务报文进行监控,仍然可以探测感知网络状态。
示例性的,网络探测模块可以根据预设的时间周期实时进行网络带宽探测,假设在第一次探测完成时,相应获得数据发送端与对应的数据接收端之间的网络可用带宽为A1,最小延时时间为B1,此时由于是完成第一次探测,最后一次探测即为第一次探测,则记录A1和B1;在第二次探测完成时,相应获得数据发送端与对应的数据接收端之间的网络可用带宽为A2,最小延时时间为B2,此时由于是完成第二次探测,最后一次探测即为第二次探测,则仅记录A2和B2,也就是说,不再记录A1和B1,例如,可以直接删除已记录的A1和B1,或者,利用A2替换A1,利用B2替换B1;以此类推;假设在第五次探测完成时,相应获得数据发送端与对应的数据接收端之间的网络可用带宽为A5,最小延时时间为B5,并仅记录A5和B5,而在第五次探测完成之后,在第六次探测完成之前,数据发送端需要向对应的数据接收端传输数据,则可以根据当前记录的网络可用带宽,即根据记录的A5来确定数据传输速率。
需要说明的是,由于第二监控终端与第一监控终端之间,第三监控终端与第二监控终端之间的网络由多个业务公用,网络可用带宽存在不确定性,并且随时间变化而变化,而且端到端的网络由多个设备及设备间的链路构成,因此,基于对端到端的数据传输延时的考虑,通常将探测到的端到端的各链路中的可用带宽最小值作为端到端的网络可用带宽。
可以理解的,由于网络探测模块探测的是数据发送端与数据接收端之间的网络可用带宽和最小延时时间,因此,网络探测模块既可以部署在数据发送端,也可以部署在数据接收端,或者同时部署在数据发送端和数据接收端,具体的部署位置可以根据实际需求进行设置,本申请实施例不作具体限定。
本申请实施例所提供的一种基于数字换流站的监控系统,通过定期进行网络带宽探测,实时探测获得数据发送端与数据接收端之间的网络可用带宽和最小延时时间,能够在数据发送端与数据接收端之间需要传输数据时,根据实时 探测到的网络可用带宽确定合适的数据传输速率,从而保证在带宽资源有限的情况下也能保持较优的数据传输速率,使得数据传输过程能够尽可能快速完成,并且还能够合理利用网络带宽资源,避免网络带宽资源闲置,从而提高资源利用率。
作为上述方案的改进,所述网络探测模块定期进行网络带宽探测,以探测所述数据发送端与对应的所述数据接收端之间的网络可用带宽和最小延时时间,具体包括:
所述网络探测模块在每一次进行网络带宽探测时,按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,并记录每一次发送的探测报文对应的RTT值和报文发送速率;
所述网络探测模块在首次判定RTT值增大时,将RTT值增大的时间点记为T1,将T1之前的最后一个RTT值不变的时间点记为T0,根据T0对应RTT值确定最小延时时间,根据T1之前的最后一个报文发送速率确定所述数据发送端与对应的所述数据接收端之间的网络可用带宽。
具体的,结合上述实施例,网络探测模块每一次进行网络带宽探测时的工作原理相同,针对单独的任意一次网络带宽探测,网络探测模块的具体工作过程如下:
数据发送端中的网络探测模块按照报文发送速率逐步增加的规律,持续向对应的数据接收端发送探测报文,并且记录每一次发送的探测报文对应的报文发送速率,以及记录每一次接收到对应的数据接收端回应的ACK报文时的RTT(Round Trip Time,往返时延)值;可以理解的,在报文发送速率逐步增加的过程中,只要报文发送速率没有超过网络可用带宽,探测报文所对应的RTT值就会保持不变,而随着报文发送速率逐步增加,新增流量填充满网络可用带宽之后,多余的探测报文将进入缓冲区,会导致RTT值增大,直至在首次判定RTT值增大时,可以停止发送探测报文;
网络探测模块可以根据记录的RTT值判断RTT值的变化趋势,在首次判定RTT值增大时,将RTT值增大的时间点记为T1,即在T1时间点之前记录的所有的RTT值均保持不变,将T1时间点之前的最后一个RTT值不变的时间点记为T0,即在T0时间点之后RTT值开始增加,也就是说,在T0时间点之后,报文发送速率开始超过网络可用带宽,报文进入缓冲区,延时增大,因此,网络探测模块可以根据T0时间点对应RTT值来确定最小延时时间,并且可以根据RTT值的变化趋势来确定网络中的可用带宽的变化趋势,相应的,可以根据T1时间点之前的最后一个报文发送速率确定数据发送端与对应的数据接收端之间的网络可用带宽。
本申请实施例所提供的一种基于数字换流站的监控系统,通过以报文发送速率逐步增加的规律持续发送探测报文,并根据记录的RTT值的变化趋势来确定网络中的可用带宽的变化趋势,从而确定数据发送端与对应的所述数据接收端之间的网络可用带宽和最小延时时间,能够简单、方便、快速地实现网络带宽探测,无需过多占用网络带宽资源,并且根据RTT值的变化趋势能够及时反映网络状态,从而提高探测结果的准确性。
作为上述方案的改进,所述网络探测模块在每一次进行网络带宽探测时,按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,具体包括:
所述网络探测模块在每一次进行网络带宽探测时,根据本地数据发送端的最大出口带宽和本地数据发送端的带宽占用经验值,获取可用带宽上限;
所述网络探测模块根据所述可用带宽上限设置速率调整阈值,并在按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文的过程中,当报文发送速率小于所述速率调整阈值时,根据第一增加幅度按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,当报文发送速率不小于所述速率调整阈值时,根据第二增加幅度按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文;其中,所述第一增加幅度大于所述第二增加幅度。
具体的,结合上述实施例,网络探测模块在按照递增的报文发送速率依次向对应的数据接收端发送探测报文时,可以预先根据本地数据发送端(即网络探测模块所在的数据发送端)的最大出口带宽和本地数据发送端的带宽占用经验值(带宽占用经验值可以根据数据发送端内的带宽占用历史数据进行评估确定),来确定数据发送端与对应的数据接收端之间的可用带宽上限,并根据可用带宽上限设置速率调整阈值,基于设置的速率调整阈值,在按照递增的报文发送速率依次向对应的数据接收端发送探测报文的过程中,当报文发送速率未达到设置的速率调整阈值时,可以根据第一增加幅度逐步增加报文发送速率,并依次向对应的数据接收端发送探测报文,直至报文发送速率增加到达到设置的速率调整阈值时,可以继续根据第二增加幅度逐步增加报文发送速率,并依次向对应的数据接收端发送探测报文;其中,第一增加幅度大于第二增加幅度。
需要说明的是,探测报文的初始报文发送速率可以根据实际需求进行设置,例如,可以设置一个较小的初始报文发送速率,以初始报文发送速率开始向对应的数据接收端发送探测报文,并根据第一增加幅度逐步增加报文发送速率,依次向对应的数据接收端发送探测报文,直至报文发送速率增加到达到设置的速率调整阈值时,继续根据第二增加幅度逐步增加报文发送速率,依次向对应的数据接收端发送探测报文,直至在首次判定RTT值增大时,可以停止发送探测报文。
可以理解的,报文发送速率是从低到高逐步增加的,在刚开始增加时,可调整的空间比较大,对探测结果的影响比较小,因此可以采用较大的增加幅度来逐步增加报文发送速率,而报文发送速率在增加到一定程度之后,可调整的空间比较小,对探测结果的影响比较大,因此可以采用较小的增加幅度来继续逐步增加报文发送速率,以提高探测结果的精确度。
示例性的,速率调整阈值设置为可用带宽上限的50%,报文发送速率最开始以可用带宽上限的较大百分比增加,在报文发送速率达到可用带宽上限的50%时,报文发送速率以可用带宽上限的较小百分比增加,并且具体的增加幅度可以根据实际需要进行设置,本申请实施例不作具体限定。
在又一个优选实施例中,所述数据传输调控模块还配置为在本地监控终端需要向另一监控终端传输视频融合业务数据时,依次进入数据传输过程的第一 传输阶段、第二传输阶段和第三传输阶段,直至数据传输完成时,结束所述数据传输过程;其中,
在所述第一传输阶段内,获取本地的所述网络探测模块当前记录的网络可用带宽和最小延时时间,根据获得的网络可用带宽确定视频融合业务数据的初始数据传输速率,以根据所述初始数据传输速率开始向另一监控终端传输视频融合业务数据,直至判定预设的速率调整条件被触发时,进入所述第二传输阶段;其中,所述速率调整条件为首次判定RTT值增大到预设的延时时间阈值,或,首次接收到丢包报告;
在所述第二传输阶段内,根据获得的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于视频融合业务数据的数据类型和监控调阅请求用户的用户类型配置的目标延时恢复时间,调整视频融合业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定所述速率调整条件被触发时探测到的延时时间恢复到获得的最小延时时间时,进入所述第三传输阶段;
在所述第三传输阶段内,在根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据的同时,触发本地的所述网络探测模块进行网络带宽探测,以探测并记录本地监控终端与另一监控终端之间的网络可用带宽和最小延时时间,获取本地的所述网络探测当前记录的网络可用带宽和最小延时时间,根据获得的网络可用带宽确定视频融合业务数据的数据传输速率,以根据确定的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定所述速率调整条件被触发时,返回所述第二传输阶段。
具体的,结合上述实施例,数据传输调控模块主要配置为在本地监控终端需要向另一监控终端传输视频融合业务数据时,将整个视频融合业务数据的数据传输过程划分成三个阶段,即包括第一传输阶段、第二传输阶段和第三传输阶段,数据传输调控模块依次进入第一传输阶段、第二传输阶段和第三传输阶段,直至所有的待传输的视频融合业务数据全部传输完成时,结束整个数据传输过程;具体数据传输过程如下:
在第一传输阶段内,数据传输调控模块获取本地的网络探测模块当前记录的网络可用带宽和最小延时时间(即开始传输视频融合业务数据之前,本地的网络探测模块最近一次探测获得的网络可用带宽和最小延时时间),根据获得的网络可用带宽来确定视频融合业务数据的初始数据传输速率,并根据确定的初始数据传输速率开始向另一监控终端传输视频融合业务数据,直至判定预先设置的速率调整条件被触发时,进入第二传输阶段。
需要说明的是,由于视频融合业务数据可以以业务报文的形式进行传输,同样可以获取并记录每一次发送的业务报文所对应的RTT值,因此,速率调整条件可以设置为:首次判定RTT值增大到预设的延时时间阈值;或者,也可以监控业务报文的丢包情况,将速率调整条件设置为:首次接收到丢包报告,也就是说,在第一传输阶段内,当首次判定RTT值增大到预设的延时时间阈值时,进入第二传输阶段,或者,当首次接收到丢包报告时,进入第二传输阶段。
在第二传输阶段内,数据传输调控模块根据在第一传输阶段内获得的本地 的网络探测模块当前记录的网络可用带宽和最小延时时间、第一传输阶段内速率调整条件被触发时探测到的延时时间以及基于视频融合业务数据的数据类型和监控调阅请求用户(监控调阅请求用户具体是指请求获取视频融合业务数据的用户,也即发出监控调阅请求的用户)的用户类型配置的目标延时恢复时间,对视频融合业务数据的当前的数据传输速率进行调整(此时即为对第一传输阶段中的初始数据传输速率进行调整,并且为降低调整),相应获得调整后的数据传输速率,并根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定RTT值由速率调整条件被触发时探测到的延时时间恢复到获得的本地的网络探测模块当前记录的最小延时时间(即RTT值由速率调整条件被触发时的延时时间恢复到RTT值增大之前的值)时,进入第三传输阶段。
在第三传输阶段内,数据传输调控模块在根据第二传输阶段内确定的调整后的数据传输速率继续向另一监控终端传输视频融合业务数据的同时,触发本地的网络探测模块进行网络带宽探测(网络带宽探测的具体工作过程如上述实施例所述,这里不再赘述),以探测并记录本地监控终端与另一监控终端之间的网络可用带宽和最小延时时间,同理,获取本地的网络探测当前记录的网络可用带宽和最小延时时间,根据获得的网络可用带宽来确定视频融合业务数据的数据传输速率,将第二传输阶段内确定的调整后的数据传输速率继续调整为第三传输阶段内确定的数据传输速率,以根据第三传输阶段内确定的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定速率调整条件被触发时,返回第二传输阶段。
在第二传输阶段内,数据传输调控模块根据在第三传输阶段内获得的本地的网络探测模块当前记录的网络可用带宽和最小延时时间、第三传输阶段内的速率调整条件被触发时探测到的延时时间以及基于视频融合业务数据的数据类型和监控调阅请求用户的用户类型配置的目标延时恢复时间,对视频融合业务数据的当前的数据传输速率继续进行调整(此时即为对第三传输阶段内确定的数据传输速率进行调整),相应获得调整后的数据传输速率,并根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定RTT值由速率调整条件被触发时的延时时间恢复到RTT值增大之前的值时,返回第三传输阶段;以此类推,直至所有的待传输的视频融合业务数据全部传输完成时,结束整个数据传输过程。
示例性的,假设在第一传输阶段内,数据传输调控模块获得的本地的网络探测模块当前记录的网络可用带宽,根据获得的网络可用带宽确定的初始数据传输速率为X1,即本地监控终端根据初始数据传输速率X1开始向另一监控终端传输视频融合业务数据,直至判定速率调整条件被触发时,进入第二传输阶段;在第二传输阶段内,数据传输调控模块将数据传输速率由X1降低为X2,本地监控终端根据数据传输速率X2继续向另一监控终端传输视频融合业务数据,直至判定网络延时恢复正常时,进入第三传输阶段;在第三传输阶段内,数据传输调控模块在保持数据传输速率X2不变的同时,触发本地的网络探测模块进行网络带宽探测,重新探测并记录网络可用带宽,根据重新探测获得的网络可用带宽确定的数据传输速率为X3,则将数据传输速率由X2调整为X3, 本地监控终端根据数据传输速率X3继续向另一监控终端传输视频融合业务数据,直至判定速率调整条件再次被触发时,返回第二传输阶段进行相应处理;以此类推,数据传输过程经过第一传输阶段之后,在第二传输阶段和第三传输阶段之间循环,直至所有的待传输的视频融合业务数据全部传输完成时为止,结束整个数据传输过程。
需要说明的是,在第二传输阶段内,对视频融合业务数据当前的数据传输速率进行调整,可以采用上述实施例所提供的速率调整方案进行实现,具体实现过程如下:在第二传输阶段内,数据传输调控模块获取速率调整条件被触发前,通过进行网络带宽探测而探测获得的网络可用带宽S0和最小延时时间RTT0(即为在第一传输阶段内获得的本地的网络探测模块当前记录的网络可用带宽S0和最小延时时间RTT0),将判定满足速率调整条件的时间点记为T2(即,将首次判定RTT值增大到预设的延时时间阈值时的时间点记为T2,或者,将首次接收到丢包报告时的时间点记为T2),通过监控视频融合业务数据的业务报文对应的RTT值获得T2时间点所对应的延时时间RTT2,获取基于视频融合业务数据的数据类型和监控调阅请求用户的用户类型配置的目标延时恢复时间t,先根据公式S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2,并将T2时间点作为确定沿途缓冲区大小和在途报文总数的时间点,根据公式n=(RTT2-RTT0)*S0计算获得已经发送出去的视频融合业务数据中进入缓冲区的业务数据量n,再根据公式S2’=S2-n/t计算获得视频融合业务数据继续传输的速率调整目标值S2’,此时,数据传输调控模块就可以根据计算获得的速率调整目标值S2’来调整视频融合业务数据的当前的数据传输速率,相应获得调整后的数据传输速率S0’,且调整后的数据传输速率S0’满足S0’≤S2’,以根据调整后的数据传输速率S0’继续向另一监控终端传输视频融合业务数据;示例性的,可以直接将视频融合业务数据当前的数据传输速率直接降低到S2’,即获得的调整后的数据传输速率S0’满足S0’=S2’,也可以在S2’的基础上,进一步降低视频融合业务数据当前的数据传输速率降,即获得的调整后的数据传输速率S0’满足S0’<S2’。
示例性的,假设t=2秒,则要求在判定满足速率调整条件时,通过降低当前的数据传输速率,使得在2秒内(不超过2秒)就能够将缓冲区中的视频融合业务数据的业务报文出清,保证延时恢复正常。
需要说明的是,在第三传输阶段内,在判定RTT值由速率调整条件被触发时的延时时间恢复到RTT值增大之前的值时,可以直接触发本地的网络探测模块开始进行网络带宽探测,此时,探测报文的初始报文发送速率可以不选择使用上述实施例中定期进行网络带宽探测时设置的初始报文发送速率,而是直接根据在第二传输阶段内计算获得的网络可用带宽估计值S2进行确定,根据网络可用带宽估计值S2确定的初始报文发送速率更加符合当前的网络状态,基于该初始报文发送速率逐步增加报文发送速率,能够节省前期报文发送速率由较小值开始增大这一过程所花费的时间,从而更加快速地探测获得本地监控终端与另一监控终端之间的网络可用带宽和最小延时时间,并且探测报文和视频融合业务数据的业务报文互不影响,业务和带宽均能够得到最大化的利用。
本申请实施例所提供的一种基于数字换流站的监控系统,在本地监控终端与另一监控终端之间传输数据的过程中,可以利用对网络可用带宽和网络延时进行实时探测与感知,并根据探测结果对数据传输速率进行适应性调整,以避免出现网络抖动,从而能够提高所述监控系统的稳定性,并且即使在网络丢包的情况下,也能够重新向下调整网络可用带宽,合理降低数据传输速率,恢复缓冲区和链路正常,从而提高网络带宽资源的利用率。
作为上述方案的改进,所述目标延时恢复时间由所述数据传输调控模块根据视频融合业务数据的数据类型和监控调阅请求用户的用户类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型、每一种数据类型对应的用户类型以及每一种用户类型对应配置的延时恢复时间,所述数据类型包括视频融合业务数据,所述用户类型包括普通用户和VIP用户,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小,同一种数据类型对应的用户类型中,普通用户对应配置的延时恢复时间大于VIP用户对应配置的延时恢复时间。
具体的,结合上述实施例,数据传输调控模块中预先设置了延时恢复时间表,该延时恢复时间表中包括至少一种数据类型、每一种数据类型所对应的用户类型以及每一种用户类型所对应配置的延时恢复时间,也就是说,在该延时恢复时间表中,延时恢复时间与数据类型、用户类型之间具有一一对应的关系,其中,数据类型至少包括视频融合业务数据所对应的数据类型,相应的,结合上述实施例中对各级监控侧的用户进行用户权限管理,可以将用户配置为普通用户和VIP用户,则延时恢复时间表中的视频融合业务数据的数据类型所对应的用户类型包括普通用户和VIP用户(用户类型也可以根据实际需要进行对应设置),并且数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小,在同一种数据类型中,用户类型对应的优先级越高,对应配置的延时恢复时间越小,即要求能够越快将缓冲区中的业务报文出清,使得延时时间能够越快恢复正常,
示例性的,以视频融合业务数据为例,假设在该延时恢复时间表中,如果不考虑用户类型,只考虑数据类型,为视频融合业务数据的数据类型对应配置的延时恢复时间为t,在既考虑数据类型,又考虑用户类型时,为视频融合业务数据的数据类型对应配置的用户类型包括普通用户和VIP用户,并且VIP用户的优先级高于普通用户的优先级,则可以为普通用户对应配置的延时恢复时间为t1,且满足t1≤t,为VIP用户对应配置的延时恢复时间为t2,且满足t2<t1。
数据传输调控模块在获取基于视频融合业务数据的数据类型和监控调阅请求用户的用户类型配置的目标延时恢复时间时,可以根据视频融合业务数据的数据类型和监控调阅请求用户的用户类型查询该延时恢复时间表,先根据视频融合业务数据的数据类型从该延时恢复时间表中包括的所有的数据类型中找出与视频融合业务数据的数据类型相匹配的数据类型,再根据监控调阅请求用户的用户类型从该延时恢复时间表中找到的相匹配的数据类型所对应的用户类型中,找出与监控调阅请求用户的用户类型相匹配的用户类型,并将匹配到的数据类型及用户类型在该延时恢复时间表中所对应的延时恢复时间作为基于视频 融合业务数据的数据类型和监控调阅请求用户的用户类型配置的目标延时恢复时间时。
需要说明的是,延时恢复时间表在初始设置好之后,延时恢复时间表中的相关信息并不是固定不变的,可以在使用过程中,根据用户需求进行更新,例如,可以修改某一种数据类型所对应的延时恢复时间,或者新增数据类型及其对应的用户类型、延时恢复时间。
作为上述方案的改进,所述延时时间阈值根据当前记录的最小延时时间进行设置。
具体的,结合上述实施例,数据传输调控模块需要判断RTT值是否增大到预设的延时时间阈值,其中所使用的延时时间阈值可以根据当前记录的最小延时时间来实时设置,可以理解的,根据实时探测到的最小延时时间进行设置,此时设置的延时时间阈值更加贴合当前网络的实际状态,从而能够提高延时时间阈值设置方案的自适应性和灵活性。
需要说明的是,延时时间阈值也可以根据用户需求预先设置为一个固定值,这种情况适用于对网络延时要求不高的数据传输应用场景。
示例性的,可以将延时时间阈值设置为当前记录的最小延时时间的1.3倍,即数据传输调控模块在首次判定RTT值相比于当前记录的最小延时时间增大30%时,判定满足速率调整条件。
一般来说,RTT值增大到预设的延时时间阈值时的时间点在首次接收到丢包报告时的时间点之前,因此,若将速率调整条件设置为首次接收到丢包报告,则数据传输调控模块只能在缓冲区溢出丢包后才会开始降低数据传输速率,而若将速率调整条件设置为首次判定RTT值增大到预设的延时时间阈值,则数据传输调控模块可以在缓冲区溢出丢包之前就降低数据传输速率,此时可以有效避免出现丢包。
在又一个优选实施例中,将所述一级监控侧的用户作为第一用户,所述二级监控侧的用户作为第二用户,所述三级监控侧的用户作为第三用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块,所述第二监控终端的视频融合处理模块作为第二视频融合处理模块,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;所述第二监控终端还包括第二网络探测模块,所述第三监控终端还包括第三网络探测模块;
所述第一视频融合处理模块还配置为对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;
所述第二视频融合处理模块还配置为对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;
所述第三视频融合处理模块还配置为对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;
所述第二网络探测模块配置为定期进行网络带宽探测,以探测所述第二监控终端与所述第一监控终端之间的网络可用带宽,并将当前探测到的第一网络可用带宽发送至所述第一视频融合处理模块;
所述第三网络探测模块配置为定期进行网络带宽探测,以探测所述第三监 控终端与所述第二监控终端之间的网络可用带宽,并将当前探测到的第二网络可用带宽发送至所述第一视频融合处理模块;
所述第一视频融合处理模块,还配置为根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量;
其中,所述第一普通用户和所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户、所述第二VIP用户和所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面。
具体的,结合上述实施例,第一视频融合处理模块可以对一级监控侧的第一用户进行用户权限管理,将第一用户配置为第一普通用户或第一VIP用户,第二视频融合处理模块可以对二级监控侧的第二用户进行用户权限管理,将第二用户配置为第二普通用户或第二VIP用户,第三视频融合处理模块可以对三级监控侧的第三用户进行用户权限管理,将第三用户全部配置为第三VIP用户;其中,第一普通用户和第二普通用户的用户权限为:具有权限查看数字换流站的指定被监控区域的视频融合画面,没有权限查看数字换流站的指定被监控区域之外的其他被监控区域的视频融合画面,且第一普通用户和第二普通用户的用户权限相同;第一VIP用户、第二VIP用户和第三VIP用户的用户权限为:具有权限查看数字换流站的所有被监控区域的视频融合画面。
在能够对用户权限进行管理的基础上,第二监控终端还包括第二网络探测模块,第二网络探测模块主要配置为在第二监控终端和第一监控终端之间,通过定期进行网络带宽探测(第二网络探测模块的具体工作过程与上述实施例中的网络探测模块的具体工作过程原理相同,这里不再赘述),以实时探测第二监控终端与第一监控终端之间的第一网络可用带宽,并将当前探测获得的第一网络可用带宽发送至第一视频融合处理模块;同理,第三监控终端还包括第三网络探测模块,第三网络探测模块主要配置为在第三监控终端和第二监控终端之间,通过定期进行网络带宽探测(第三网络探测模块的具体工作过程与上述实施例中的网络探测模块的具体工作过程原理相同,这里不再赘述),以实时探测第三监控终端与第二监控终端之间的第二网络可用带宽,并将当前探测获得的第二网络可用带宽发送至第一视频融合处理模块;则,第一视频融合处理模块在接收到第二网络探测模块实时探测到的第一网络可用带宽,以及,接收到第三网络探测模块实时探测到的第二网络可用带宽之后,可以根据接收到的第一网络可用带宽和第二网络可用带宽调整一级监控侧的第一VIP用户的数量或/和二级监控侧的第二VIP用户的数量。
需要说明的是,一级监控侧的第一VIP用户的数量和二级监控侧的第二VIP用户的数量均可以根据实时探测的网络带宽情况进行调整,并且通过配置相应的用户权限即可实现VIP用户数量的调整,而在实际进行调整时,可以只调整一级监控侧的第一VIP用户的数量,也可以只调整二级监控侧的第二VIP用户的数量,还可以同时调整一级监控侧的第一VIP用户的数量和二级监控侧的第二VIP用户的数量,具体的调整方案可以根据实际需求进行灵活设置,本申请 实施例不作具体限定。
可以理解的,由于第一普通用户和第二普通用户的用户权限相同,共享数字换流站的相同指定被监控区域的视频融合原始数据,因此,第一普通用户和第二普通用户只共同占用一份网络带宽,增加第一普通用户的数量和第二普通用户的数量不会增加带宽占用,并且第一普通用户和第二普通用户直接在本地完成视频融合任务,也不会增加广域带宽资源,因此,理论上来说,第一普通用户的数量和第二普通用户的数量可以任意增加,第一普通用户的数量和第二普通用户的数量只受限于本地所能提供的视频融合计算资源,可以不断增加,直至达到本地所能提供的视频融合计算资源上限时为止;但是,若本地对VIP用户的数量有基础数量需求,还需要考虑网络带宽资源能否满足基础数量个VIP用户的带宽需求,当探测到的网络带宽资源不足以满足第一VIP用户及第二VIP用户的基础数量需求时,可以释放掉第一普通用户和第二普通话占用的指定被监控区域的数据上传带宽资源,此时所有的普通用户的用户权限都无法使用,通过使用普通用户释放出的带宽资源,同步启动拉起VIP用户进行相应处理,当VIP用户释放这部分带宽资源后,探测到网络带宽资源充裕时,仍然可以重新将普通用户调度拉起。
本申请实施例所提供的一种基于数字换流站的监控系统,通过定期进行网络带宽探测实时探测第二监控终端和第一监控终端之间、第三监控终端和第二监控终端之间的网络可用带宽,并统一上报到第一视频融合处理模块,由第一视频融合处理模块对一级监控侧的第一VIP用户的数量和二级监控侧的第二VIP用户的数量进行集中调整分配,从而能够根据网络带宽状态及时调整用户权限,基于用户权限管理,可以避免网络可用带宽不够用而导致出现较大的网络延时,从而实现用户体验与网络可用带宽资源之间的有效匹配,既能充分保证用户业务SLA(Service Level Agreement)要求,又能保证网络带宽资源得到充分利用。
在又一个优选实施例中,所述第一视频融合处理模块根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量,具体包括:
所述第一视频融合处理模块在只需调整所述第一VIP用户的数量,而所述第二VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第二VIP用户占用的网络带宽获取第一剩余网络带宽,根据所述第一剩余网络带宽调整所述第一VIP用户的数量;
所述第一视频融合处理模块在只需调整所述第二VIP用户的数量,而所述第一VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第一VIP用户占用的网络带宽获取第二剩余网络带宽,根据所述第二剩余网络带宽调整所述第二VIP用户的数量;
所述第一视频融合处理模块在同时需要调整所述第一VIP用户的数量和所述第二VIP用户的数量时,根据所述第一网络可用带宽、所述第二网络可用带 宽和所述第一普通用户占用的网络带宽获取第三剩余网络带宽,根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量。
具体的,结合上述实施例,第一视频融合处理模块在根据实时接收到的第一网络可用带宽和第二网络可用带宽调整一级监控侧的第一VIP用户的数量或/和二级监控侧的第二VIP用户的数量时,可以采用以下调整方案:
如果只需要调整一级监控侧的第一VIP用户的数量,而二级监控侧的第二VIP用户的数量需要保持一定的基础数量不变,则第一视频融合处理模块先根据实时接收到的第一网络可用带宽、实时接收到的第二网络可用带宽、一级监控侧的第一普通用户固定占用的网络带宽(也是二级监控侧的第二普通用户固定占用的网络带宽)以及基础数量个第二VIP用户所占用的网络带宽,确定当前的第一剩余网络带宽,再根据第一剩余网络带宽对应调整一级监控侧的第一VIP用户的数量;
如果只需要调整二级监控侧的第二VIP用户的数量,而一级监控侧的第一VIP用户的数量需要保持一定的基础数量不变,则第一视频融合处理模块先根据实时接收到的第一网络可用带宽、实时接收到的第二网络可用带宽、一级监控侧的第一普通用户固定占用的网络带宽(也是二级监控侧的第二普通用户固定占用的网络带宽)以及基础数量个第一VIP用户所占用的网络带宽,确定当前的第二剩余网络带宽,再根据第二剩余网络带宽对应调整二级监控侧的第二VIP用户的数量;
如果同时需要调整一级监控侧的第一VIP用户的数量和二级监控侧的第二VIP用户的数量,则第一视频融合处理模块先根据实时接收到的第一网络可用带宽、实时接收到的第二网络可用带宽以及一级监控侧的第一普通用户固定占用的网络带宽(也是二级监控侧的第二普通用户固定占用的网络带宽),确定当前的第三剩余网络带宽,再根据第三剩余网络带宽对应调整一级监控侧的第一VIP用户的数量和二级监控侧的第二VIP用户的数量。
需要说明的是,在实际调整过程中,可以考虑一级监控侧对第一VIP用户的基础数量需求和二级监控侧对第二VIP用户的基础数量需求,在基于当前探测到的网络可用带宽配置一级监控侧的第一VIP用户的数量或/和二级监控侧的第二VIP用户的数量时,保证最少有基础数量个VIP用户能够正常使用,剩余的用户数量再基于剩余网络带宽进行配置,并且保证一级监控侧与二级监控侧的所有用户占用的总体带宽不超过当前探测到的网络可用带宽。
本申请实施例所提供的一种基于数字换流站的监控系统,基于探测到的网络可用带宽能够支持调整一级监控侧的第一VIP用户的数量和二级监控侧的第二VIP用户的数量,并且根据用户需求可以选择只调整一级监控侧的第一VIP用户的数量,或只调整二级监控侧的第二VIP用户的数量,或同时调整一级监控侧的第一VIP用户的数量和二级监控侧的第二VIP用户的数量,从而提高了用户权限调整的灵活性。
作为上述方案的改进,所述第一视频融合处理模块根据所述第一剩余网络带宽调整所述第一VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第一剩余网络带宽是否大于预设的第 一带宽阈值,若是,则将至少M个所述第一用户配置为所述第一VIP用户;若否,则释放所述第一普通用户占用的网络带宽,根据所述第一剩余网络带宽和所述第一普通用户占用的网络带宽将至少M个所述第一用户配置为所述第一VIP用户;
其中,M表示需要保持的所述第一VIP用户的基础数量,M≥1,所述第一带宽阈值根据M个所述第一VIP用户占用的网络带宽进行设置。
具体的,结合上述实施例,如果考虑一级监控侧对第一VIP用户的基础数量需求,需要保证一级监控侧必须维持有基础数量个第一VIP用户,即M(M≥1)个第一VIP用户,则第一视频融合处理模块在根据第一剩余网络带宽调整一级监控侧的第一VIP用户的数量时,可以将第一剩余网络带宽与预设的第一带宽阈值进行比较,以判断第一剩余网络带宽是否大于预设的第一带宽阈值,若是,则根据第一剩余网络带宽将至少M个第一用户配置为第一VIP用户;若否,则通过禁用第一普通用户和第二普通用户的用户权限的方式,释放一级监控侧的第一普通用户固定占用的网络带宽(也是二级监控侧的第二普通用户固定占用的网络带宽),根据第一剩余网络带宽和释放的第一普通用户固定占用的网络带宽,将至少M个第一用户配置为第一VIP用户。
其中,第一带宽阈值可以根据M个第一VIP用户占用的网络带宽进行设置,在此基础上,将第一剩余网络带宽与第一带宽阈值进行比较时,就能够判断第一剩余网络带宽是否满足M个第一VIP用户的带宽需求,若满足,则将至少M个第一用户配置为第一VIP用户,若不满足,则释放掉指定被监控区域的数据上传带宽资源,此时所有的普通用户的用户权限都无法使用,通过使用普通用户释放出的带宽资源和第一剩余网络带宽资源,将至少M个第一用户配置为第一VIP用户,保证最少有M个第一VIP用户能够正常使用,从而保证能够满足一级监控侧对第一VIP用户的基础数量需求。
需要说明的是,除了需要保持的M个第一VIP用户之外,剩下的第一VIP用户的数量可以根据实际需要进行配置,也可以根据网络带宽的限制进行配置,本申请实施例不作具体限定。
作为上述方案的改进,所述第一视频融合处理模块根据所述第一剩余网络带宽调整所述第一VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第一剩余网络带宽是否大于一个所述第一VIP用户占用的网络带宽,若是,则将至少一个所述第一用户配置为所述第一VIP用户;若否,则将所有所述第一用户全部配置为所述第一普通用户。
具体的,结合上述实施例,如果不考虑一级监控侧对第一VIP用户的基础数量需求,不需要保证一级监控侧必须维持有基础数量个第一VIP用户(例如,极限情况下一级监控侧的第一VIP用户的数量可以为0个),则第一视频融合处理模块在根据第一剩余网络带宽调整一级监控侧的第一VIP用户的数量时,可以直接将第一剩余网络带宽与一个第一VIP用户所占用的网络带宽进行比较,以判断第一剩余网络带宽是否大于一个第一VIP用户所占用的网络带宽,若是,则将至少一个第一用户配置为第一VIP用户;若否,则将所有的第一用户全部配置为第一普通用户,此时的第一VIP用户的数量即为0个。
需要说明的是,第一视频融合处理模块在将至少一个第一用户配置为第一VIP用户时,具体的第一VIP用户的数量可以根据实际需要进行配置,也可以根据网络带宽的限制进行配置,本申请实施例不作具体限定。
作为上述方案的改进,所述第一视频融合处理模块根据所述第二剩余网络带宽调整所述第二VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第二剩余网络带宽是否大于预设的第二带宽阈值,若是,则向所述第二视频融合处理模块发送VIP用户增加指令;若否,则向所述第二视频融合处理模块发送普通用户禁用指令;
所述第二视频融合处理模块根据所述VIP用户增加指令将至少N个所述第二用户配置为所述第二VIP用户,或,根据所述普通用户禁用指令释放所述第二普通用户占用的网络带宽,根据所述第二剩余网络带宽和所述第二普通用户占用的网络带宽将至少N个所述第二用户配置为所述第二VIP用户;
其中,N表示需要保持的所述第二VIP用户的基础数量,N≥1,所述第二带宽阈值根据N个所述第二VIP用户占用的网络带宽进行设置。
具体的,结合上述实施例,如果考虑二级监控侧对第二VIP用户的基础数量需求,需要保证二级监控侧必须维持有基础数量个第二VIP用户,即N(N≥1)个第二VIP用户,则第一视频融合处理模块在根据第二剩余网络带宽调整二级监控侧的第二VIP用户的数量时,可以将第二剩余网络带宽与预设的第二带宽阈值进行比较,以判断第二剩余网络带宽是否大于预设的第二带宽阈值,若是,则第一视频融合处理模块生成相应的VIP用户增加指令并发送到第二视频融合处理模块,第二视频融合处理模块响应接收到的VIP用户增加指令,根据接收到的VIP用户增加指令将至少N个第二用户配置为第二VIP用户;若否,则第一视频融合处理模块生成普通用户禁用指令并发送到第二视频融合处理模块,第二视频融合处理模块响应接收到的普通用户禁用指令,根据接收到的普通用户禁用指令禁用二级监控侧的第二普通用户的用户权限,释放第二普通用户固定占用的网络带宽(也是一级监控侧的第一普通用户固定占用的网络带宽,第一视频融合处理模块同样会禁用第一普通用户的用户权限),根据第二剩余网络带宽和释放的第二普通用户固定占用的网络带宽,将至少N个第二用户配置为第二VIP用户。
其中,第二带宽阈值可以根据N个第二VIP用户占用的网络带宽进行设置,在此基础上,将第二剩余网络带宽与第二带宽阈值进行比较时,就能够判断第二剩余网络带宽是否满足N个第二VIP用户的带宽需求,若满足,则将至少N个第二用户配置为第二VIP用户,若不满足,则释放掉指定被监控区域的数据上传带宽资源,此时所有的普通用户的用户权限都无法使用,通过使用普通用户释放出的带宽资源和第二剩余网络带宽资源,将至少N个第二用户配置为第二VIP用户,保证最少有N个第二VIP用户能够正常使用,从而保证能够满足二级监控侧对第二VIP用户的基础数量需求。
需要说明的是,除了需要保持的N个第二VIP用户之外,剩下的第二VIP用户的数量可以根据实际需要进行配置,也可以根据网络带宽的限制进行配置,本申请实施例不作具体限定。
作为上述方案的改进,所述第一视频融合处理模块根据所述第二剩余网络带宽调整所述第二VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第二剩余网络带宽是否大于一个所述第二VIP用户占用的网络带宽,若是,则向所述第二视频融合处理模块发送VIP用户增加指令;若否,则向所述第二视频融合处理模块发送VIP用户减少指令;
所述第二视频融合处理模块根据所述VIP用户增加指令将至少一个所述第二用户配置为所述第二VIP用户,或,根据所述VIP用户减少指令将所有所述第二用户全部配置为所述第二普通用户。
具体的,结合上述实施例,如果不考虑二级监控侧对第二VIP用户的基础数量需求,不需要保证二级监控侧必须维持有基础数量个第二VIP用户(例如,极限情况下二级监控侧的第二VIP用户的数量可以为0个),则第一视频融合处理模块在根据第二剩余网络带宽调整二级监控侧的第二VIP用户的数量时,可以直接将第二剩余网络带宽与一个第二VIP用户所占用的网络带宽进行比较,以判断第二剩余网络带宽是否大于一个第二VIP用户所占用的网络带宽,若是,则第一视频融合处理模块生成相应的VIP用户增加指令并发送到第二视频融合处理模块,第二视频融合处理模块响应接收到的VIP用户增加指令,根据接收到的VIP用户增加指令将至少一个第二用户配置为第二VIP用户;若否,则第一视频融合处理模块生成相应的VIP用户减少指令并发送到第二视频融合处理模块,第二视频融合处理模块响应接收到的VIP用户减少指令,根据接收到的VIP用户减少指令将所有的第二用户全部配置为第二普通用户,此时的第二VIP用户的数量即为0个。
需要说明的是,第一视频融合处理模块在控制第二视频融合处理模块将至少一个第二用户配置为第二VIP用户时,具体的第二VIP用户的数量可以根据实际需要进行配置,也可以根据网络带宽的限制进行配置,本申请实施例不作具体限定。
作为上述方案的改进,所述第一视频融合处理模块根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量,具体包括:
所述第一视频融合处理模块判断所述第三剩余网络带宽是否大于预设的第三带宽阈值,若是,则将至少M个所述第一用户配置为所述第一VIP用户,并向所述第二视频融合处理模块发送VIP用户增加指令;若否,则释放所述第一普通用户占用的网络带宽,根据所述第三剩余网络带宽和所述第一普通用户占用的网络带宽将至少M个所述第一用户配置为所述第一VIP用户,并向所述第二视频融合处理模块发送普通用户禁用指令;
所述第二视频融合处理模块根据所述VIP用户增加指令将至少N个所述第二用户配置为所述第二VIP用户,或,根据所述普通用户禁用指令释放所述第二普通用户占用的网络带宽,根据所述第三剩余网络带宽和所述第二普通用户占用的网络带宽将至少N个所述第二用户配置为所述第二VIP用户;
其中,M表示需要保持的所述第一VIP用户的基础数量,M≥1,N表示需要保持的所述第二VIP用户的基础数量,N≥1,所述第三带宽阈值根据M个所述第一VIP用户占用的网络带宽和N个所述第二VIP用户占用的网络带宽进行 设置。
具体的,结合上述实施例,如果同时考虑一级监控侧对第一VIP用户的基础数量需求,需要保证一级监控侧必须维持有基础数量个第一VIP用户,即M(M≥1)个第一VIP用户,以及,考虑二级监控侧对第二VIP用户的基础数量需求,需要保证二级监控侧必须维持有基础数量个第二VIP用户,即N(N≥1)个第二VIP用户,则第一视频融合处理模块在根据第三剩余网络带宽调整一级监控侧的第一VIP用户的数量和二级监控侧的第二VIP用户的数量时,可以将第三剩余网络带宽与预设的第三带宽阈值进行比较,以判断第三剩余网络带宽是否大于预设的第三带宽阈值:
若是,则第一视频融合处理模块根据第三剩余网络带宽将至少M个第一用户配置为第一VIP用户,并且生成相应的VIP用户增加指令发送到第二视频融合处理模块,第二视频融合处理模块响应接收到的VIP用户增加指令,根据接收到的VIP用户增加指令将至少N个第二用户配置为第二VIP用户;
若否,则第一视频融合处理模块禁用第一普通用户的用户权限,并且生成普通用户禁用指令发送到第二视频融合处理模块,第二视频融合处理模块响应接收到的普通用户禁用指令,根据接收到的普通用户禁用指令禁用第二普通用户的用户权限,从而释放第一普通用户固定占用的网络带宽(也是第二普通用户固定占用的网络带宽),之后,第一视频融合处理模块根据第三剩余网络带宽和释放的普通用户固定占用的网络带宽将至少M个第一用户配置为第一VIP用户,第二视频融合处理模块根据第三剩余网络带宽和释放的普通用户固定占用的网络带宽将至少N个第二用户配置为第二VIP用户。
其中,第三带宽阈值可以根据M个第一VIP用户占用的网络带宽进和N个第二VIP用户占用的网络带宽进行设置,在此基础上,将第三剩余网络带宽与第三带宽阈值进行比较时,就能够判断第三剩余网络带宽是否满足M个第一VIP用户以及N个第二VIP用户的带宽需求,若满足,则将至少M个第一用户配置为第一VIP用户,且将至少N个第二用户配置为第二VIP用户,若不满足,则释放掉指定被监控区域的数据上传带宽资源,此时所有的普通用户的用户权限都无法使用,通过使用普通用户释放出的带宽资源和第三剩余网络带宽资源,将至少M个第一用户配置为第一VIP用户,且将至少N个第二用户配置为第二VIP用户,即可保证最少有M个第一VIP用户和N个第二VIP用户能够正常使用,从而保证能够满足一级监控侧对第一VIP用户的基础数量需求以及二级监控侧对第二VIP用户的基础数量需求。
需要说明的是,除了需要保持的M个第一VIP用户和N个第二VIP用户之外,剩下的第一VIP用户的数量和第二VIP用户的数量,均可以根据实际需要进行配置,也可以根据网络带宽的限制进行配置,本申请实施例不作具体限定。
作为上述方案的改进,在所述第一VIP用户的数量达到M个,所述第二VIP用户的数量达到N个之后,增加的所述第一VIP用户的数量不小于增加的所述第二VIP用户的数量。
具体的,结合上述实施例,第一视频融合处理模块在根据第三剩余网络带 宽调整一级监控侧的第一VIP用户的数量和二级监控侧的第二VIP用户的数量的过程中,在第一VIP用户的数量达到M个,第二VIP用户的数量达到N个,即满足VIP用户的基础数量需求之后,一级监控侧额外增加的第一VIP用户的数量大于或等于二级监控侧额外增加的第二VIP用户的数量,在此情况下,可以保证除了满足VIP用户的基础数量需求之外,额外增加的VIP用户优先分配给一级监控侧使用。
示例性的,假设一级监控侧、二级监控侧和三级监控侧初始配置的第一VIP用户、第二VIP用户和第三VIP用户的数量比为2:2:1,例如分别为2个、2个和1个,三级监控侧的第三VIP用户的数量保留初始配置即可,无需再额外增加,当网络带宽资源充足时,除了需要满足一级监控侧具有2个第一VIP用户、二级监控侧具有2个第二VIP用户的基础数量需求之外,优先保障将额外增加的VIP用户分配给一级监控侧和二级监控侧使用,进一步的,额外增加的VIP用户可以根据1:1的比例平均分配给一级监控侧和二级监控侧,并且在实际分配时,可以先给一级监控侧分配一个第一VIP用户,然后再给二级监控侧分配一个第二VIP用户,在一级监控侧和二级监控侧之间交替增加,每次增加一个,则完成调整后,一级监控侧额外增加的第一VIP用户的数量应该大于或等于二级监控侧额外增加的第二VIP用户的数量。
参见图2所示,是本申请实施例提供的一种基于数字换流站的监控系统的一个应用场景示意图,结合上述所有实施例,将所述监控系统应用于“总部-省-厂站”三级体系架构中,基于三级部署的分布式算力资源,根据各级用户的用户权限,将总部、省侧和厂站的所有的VIP用户的视频融合资源全部部署在站侧,将总部和省侧的所有普通用户的视频融合资源分别部署在总部本地和省侧本地。
用户特点:VIP用户需要实时看到厂站内任意一个被监控区域的视频融合画面,并且每一个VIP用户可以自行控制视频融合画面的视角或者切换厂站内的任意摄像头拍摄的视频重新进行视频融合处理,需要为总部、省侧和厂站的每一个在线的VIP用户在厂站内分配图形资源进行视频融合处理;普通用户需要看到厂站内特定区域的视频融合画面,并且每一个普通用户可以自行控制视频融合画面的视角,需要为总部和省侧的在线的普通用户对应在总部本地和省侧本地分配图形资源进行视频融合处理;如图2所示,在厂站侧设置了站侧、省侧、总部VIP用户视频融合资源池,以为站侧、省侧和总部的所有VIP用户分配资源进行视频融合处理,而在省侧本地为省普通用户分配资源进行视频融合处理,在总部本地为总部普通用户分配资源进行视频融合处理。
需要说明的是,图2中的总部的视频融合应用,即为上述实施例中的第一视频融合处理模块的应用化体现,省侧的视频融合应用,即为上述实施例中的第二视频融合处理模块的应用化体现,厂站的视频融合应用,即为上述实施例中的第三视频融合处理模块的应用化体现,基于图2所示的应用场景,视频融合处理的具体实现过程如下:
1.厂站内的原始视频流接入后,由厂站的视频分发组件统一进行分发处理;
2.上级指定的特定区域(如阀冷、换流变等)视频流由视频分发组件上传 到省侧;
3.省侧利用视频分发组件,将特定区域视频流上传到总部,并转发到省本地的视频融合资源保持;
4.省侧普通用户被激活后,若接收到省侧普通用户的监控调阅请求,则为省侧普通用户分配资源进行视频融合处理,具体的:分配虚机资源(包含vCPU、存储、vGPU和显存等)并拉起视频融合应用(即上述实施例中的第二视频融合处理模块),由视频融合应用对接收到的特定区域视频流进行视频融合处理,相应获得视频融合画面并进行显示;此外,还接收省侧普通用户的视角控制等操作指令,并由视频融合应用响应省侧普通用户的操作指令,对当前显示的视频融合画面进行对应操作控制;
5、总部普通用户被激活后,若接收到总部普通用户的监控调阅请求,则为总部普通用户分配资源进行视频融合处理,具体的:分配虚机资源(包含vCPU、存储、vGPU和显存等)并拉起视频融合应用(即上述实施例中的第一视频融合处理模块),由视频融合应用对接收到的特定区域视频流进行视频融合处理,相应获得视频融合画面并进行显示;此外,还接收总部普通用户的视角控制等操作指令,并由视频融合应用响应总部普通用户的操作指令,对当前显示的视频融合画面进行对应操作控制;
6、省侧和总部的VIP用户被激活后,若接收到总部VIP用户和省侧VIP用户的监控调阅请求,则通过浏览器和视频会议客户端拉起远程视频会议,与站侧建立视频会议会话,总部和省侧可以通过视频会议客户端进行远程访问;
7、省侧到站侧、总部到站侧的视频会议系统调用站侧的VIP视频融合应用(即上述实施例中的第三视频融合处理模块),由站侧的视频融合应用为总部VIP用户和省侧VIP用户完成视频融合处理,总部和省侧可以调阅站侧为VIP用户融合好的视频融合画面;此外,总部和省侧还可以下发控制指令到站侧的VIP视频融合应用,以进行视角控制或者切换任意站内摄像头拍摄的视频重新进行视频融合处理。
其中,对于总部和省侧的VIP用户,总部和省侧的VIP用户配置视频会议客户端资源,通过远程视频会议任意调阅站内视频,站内为总部和省侧的VIP用户预备视频融合资源,VIP用户可切换到普通用户的视频流;对于总部和省侧的普通用户:总部和省侧的普通用户共享特定区域视频流,可以按需切换,普通用户的增加,所消耗的广域网络带宽不变,并且采用多级调阅分发,上传同一路视频流供多个普通用户访问,多路视频流在总部本地和省侧本地实现视频融合。
需要说明的是,视频融合应用根据不同的职能和操作需求,可以将用户权限划分为不同的等级,包括普通用户和VIP用户,普通用户只部署在省侧和总部,VIP用户分布在站、省、总部三级;VIP用户的视频融合全部在站侧进行,VIP用户调阅站侧融合后的视频,可任意查看需要的区域;同时,站侧将特定区域的多路视频流上传到省侧、总部后,由省侧、总部将视频流与测点等数据进行融合处理,获得视频融合画面,供省侧、总部的普通用户调阅,普通用户利用虚拟化后的视频融合算力,可对同一特定区域的视频融合画面有独特的视 角并进行操作;其中,省侧普通用户的视频融合只在省侧进行,并且直接从省侧调阅融合后的视频融合画面,总部普通用户的视频融合直接在总部进行,并且直接从总部调阅融合后的视频融合画面。
参见图3所示,是本申请实施例提供的一种基于数字换流站的监控系统的另一个应用场景示意图,结合上述所有实施例,将所述监控系统应用于“总部-省-厂站”三级体系架构中,通过对总部与省之间、省与厂站之间的网络管道进行网络带宽探测,可实时探测网络的可用带宽和最小延时时间,并生成总部-省-厂站的可用带宽视图(如图3右侧所示,三个圆柱形分别表示了总部与省侧之前的可用带宽、省侧与厂站1之间的可用带宽以及省侧与厂站2之间的可用带宽),根据探测到的网络可用带宽可以供用户权限分配使用。
网络带宽探测的理论基础为:广域网络被多个业务和用户共享,空余可用带宽和链路延时不断变化,在数据发送端难以感知,但网络可用资源由空余可用带宽和缓冲区构成,可以通过在途报文感知到延时,通过延时的变化情况可以感知到报文发送速率超过可用瓶颈带宽而进入缓冲区的时间点,基于该时间点的报文发送速率即可推断出瓶颈带宽,通过丢包可以感知到缓冲区充满而溢出的时间点,从而可以推算出缓冲区大小。
需要说明的是,图3中的网络带宽及用户管理应用所能实现的功能,即为上述实施例中的网络探测模块所能实现的网络带宽探测功能以及视频融合处理模块所能实现的用户权限管理功能的集成化体现,网络带宽探测以用户带宽需求为单位进行调度,具有如下特点:1、基于网络可用带宽,网络带宽及用户管理应用可智能分配和切换VIP用户和普通用户;2、当网络带宽资源充足时,所有用户都可以被配置为具备VIP用户权限的VIP用户;3、当网络带宽资源不足时,可以按需将部分不重要的视频业务用户权限切换为普通用户权限;通过这种调度方案可以在用户体验与网络资源利用方面达到最佳均衡。
基于图3所示的应用场景,能够实现的功能具体如下:
1、实时探测:各级部署的网络带宽及用户管理应用,通过进行网络带宽探测,对总部与省侧之间、省侧与厂站之间的网络可用带宽、最小延迟等进行实时探测,以确定最大报文发送速率,并实时跟踪以及时调整刷新网络状态;
2、生成全网状态视图:厂站-省侧-总部三级的网络带宽及用户管理应用进行可用带宽资源协同,将厂站内广域网出口,省侧与厂站之间的可用带宽/最小时延,省侧与总部之间的可用带宽/最小时延数据进行汇总,上报到总部,由总部生成全网状态视图,以可视化展示网络实时带宽和流量视,以基于此全网状态视图,统一调配VIP用户和普通用户;
3、生成用户权限调整计划,进行用户管理:基于VIP用户和普通用户的网络资源利用情况,进行各级的普通用户和VIP用户分配比例的动态调整计划,在总部集中进行调配控制:
(1)初始分配:初次配置普通用户和VIP用户时,可以基于经验进行预设,后续调节时可以参考检修计划、生产周报、故障告警信息等信息作为触发条件,结合历史使用数据(分配情况)进行自学习设置,预判近期的使用场景,从而进行针对性的用户比例调节;
(2)动态调整:网络带宽及用户管理应用在基于网络带宽探测的探测结果生成相应的用户权限调整建议后,调用各级的视频会议用户管理应用以进行VIP用户分配,在各级根据分配的VIP用户的数量按需启动用户客户端,并分配虚机资源对站侧融合后的视频融合画面进行访问;网络带宽及用户管理应用进行普通用户分配之后,调用视频融合应用,根据普通用户的数量分配虚机和图形资源,拉起相应的普通用户客户端,对视频分发组件转发过来的特定区域视频流进行视频融合处理,并在用户登录后实时呈现视频融合画面;
(3)用户切换:根据网络带宽及用户管理应用的指令,可以按需启动和关闭视频融合应用所适用的用户权限,并且按需将普通用户与VIP的视频会议进行切换。
需要说明的是,在图3所示的应用场景中,网络带宽探测的具体实现过程以及用户权限管理的具体实现方案如上述实施例所述,这里不再赘述。
通过用户权限管理,可实现用户权限与网络资源的有效匹配,既充分保证业务SLA又保证了网络资源的充分利用;其中,用户特点为:VIP用户从省侧、总部远程调用站侧融合处理后的视频融合画面;普通用户共享特定区域上传的视频流,普通用户在本地调用图形资源各自进行视频融合处理。网络资源需求特点为:对于省侧、总部的VIP用户,每一个VIP用户都需要独占一份带宽;省侧、总部的普通用户共享特定区域上传的视频流,所有普通用户只占用一份带宽。应用组件特点为:网络带宽及用户管理应用,可实时探测可用带宽的变化,生成站侧与省侧之间、省侧与总部之间的网络可用带宽资源视图,并基于此视图对VIP用户的数量和普通用户的数量进行调整,保证站侧与省侧之间、省侧与总部之间的总体带宽占用不超过网络当前可用带宽。
示例性的,以所述监控系统实现视频融合处理方案为例,在实际应用中,视频融合的技术指标要求:1)同一监控视野内,单台监控终端支持不少于8路1080P高清视频实时融合和拼接展示;2)支持不少于8路1080P的拼接视频同步回放功能;3)平均三维渲染帧率不低于25帧/秒。
但是,结合上述分析可知,传统的视频融合处理方案,站端从视频组件拉流,在站端的虚拟机上进行视频融合作业,并通过桌面推流形式进行框架集成,每融合一路视频流所消耗的推流带宽约为20~25M,如果将原始视频流上送到总部,同样将消耗由站端到总部之前的通讯带宽,在业务比较繁忙时,会出现带宽不足,视频融合画面与操作卡顿的问题,画面帧率一般会降低到5~10帧/秒。
而采用本申请实施例所提供的视频融合处理方案,将视频融合处理模块部署分别在各级监控终端中,并从站端视频组件拉流,普通用户的视频融合业务可以利用本地计算资源在本地完成,实现算力资源分布式部署,并且基于视频组件的视频分发能力,实现多用户并发;其中,单路视频流的网络带宽占用约为4M,根据技术指标要求,如果考虑8路视频流进行融合的极端工况,视频流上送带宽总占用为32M左右,在本申请实施例中,所有普通用户的关注点在相同的指定被监控区域,可通过固定的8路视频流上送,实现无限多的用户实例并发能力,单实例均摊视频占用即为32M/N(并发总数)。对于VIP用户的 视频融合业务,采用本申请实施例可以将上送带宽降低到7~10M,远端的操作体验、画面帧率与站端相同,且维持在25帧/秒以上,如果远端服务器硬件配置较高,画面刷新帧率将可提升至30帧/秒以上。
进一步的,采用本申请实施例所提供的视频融合处理方案,分级部署方案对网络远距离传输通信的带宽要求大幅降低,用户几乎感觉不到延迟,对于需要高频度交互和操作的三维数字孪生应用,流畅度和清晰度更优,用户体验更好,实现实时渲染帧率≥30帧/秒,场景首次加载完成时间≤4秒,场景切换响应时间≤2秒,交互界面加载响应时间≤2秒。
本申请实施例还提供了一种基于数字换流站的监控方法,所述方法适用于上述任一实施例所述的基于数字换流站的监控系统,所述监控系统包括部署在一级监控侧的第一监控终端、部署在二级监控侧的第二监控终端和部署在三级监控侧的第三监控终端;所述监控系统的被监控对象包括部署在所述三级监控侧的数字换流站;所述第一监控终端、所述第二监控终端和所述第三监控终端均至少包括通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块,所述第三监控终端还包括数据存储模块,所述数据存储模块配置为存储数字换流站数据;所述方法包括:
通过所述通信模块实现所述第一监控终端、所述第二监控终端和所述第三监控终端之间的通信;通过所述设备状态监控模块监控及管理所述数字换流站的所有设备的台账信息、运行信息和监测数据;通过所述设备告警管理模块管理所述数字换流站的所有设备的告警信息;通过所述人机交互模块接收本地监控侧的用户的监控调阅请求;
通过每一所述视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面;
通过每一所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据。
优选地,通过所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据,具体包括:
通过所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,获取所述速率调整条件被触发前探测到的网络可用带宽S0和最小延时时间RTT0、所述速率调整条件被触发时探测到的延时时间RTT2以及基于所述业务数据的数据类型配 置的延时恢复时间t;
通过所述数据传输调控模块根据公式S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2;
通过所述数据传输调控模块根据公式n=(RTT2-RTT0)*S0计算获得进入缓冲区的业务数据量n;
通过所述数据传输调控模块根据公式S2’=S2-n/t计算获得所述业务数据的速率调整目标值S2’;
通过所述数据传输调控模块根据所述速率调整目标值S2’调整所述业务数据当前的数据传输速率,获得调整后的数据传输速率S0’,且调整后的数据传输速率S0’满足S0’≤S2’,以根据调整后的数据传输速率S0’继续向另一监控终端传输所述业务数据。
优选地,所述延时恢复时间由所述数据传输调控模块根据所述业务数据的数据类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型及其对应配置的延时恢复时间,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小。
优选地,所述第三监控终端还包括故障录波管理模块、数据报表管理模块、数字站区管理模块和远程智能巡视模块;
所述故障录波管理模块配置为对所述数字换流站的故障录波文件进行管理,并根据所述故障录波文件进行在线解析;
所述数据报表管理模块配置为对所述数字换流站的业务数据进行统计,根据所述数字换流站的运维需求以不同的报表形式展示历史数据、统计数据和分析数据,并实现报表任务制定功能、报表自动生成功能、报表导出功能和报表打印功能;
所述数字站区管理模块配置为以所述数字换流站的站区为主体,对所述数字换流站的安防、消防和动力环境进行监控和管理;
所述远程智能巡视模块配置为控制监测装置开展室内外设备联合巡视作业,并对巡视数据进行分析,形成巡视结果和巡视报告。
优选地,所述数字换流站具有统一的公共组件,所述公共组件包括业务组件和数据组件,所述业务组件和所述数据组件配置为为所述数字换流站的各个应用系统提供基于统一规范的业务功能接口和基础数据服务,并制定统一的数据交互协议和数据交互格式,以为所述第三监控终端提供统一数据服务接口。
优选地,所述数字换流站具有统一的基础应用,所述基础应用采用统一基础软硬件设施、统一数据模型、统一数据服务规范和统一应用开发规范进行构建。
优选地,所述基础应用包括全站视频管控应用、全站三维呈现应用、设备状态总览应用、设备告警总览应用、故障录波管理应用、智能报表管理应用、数字站区管理应用和远程智能巡视应用;其中,所述全站视频管控应用和全站三维呈现应用配置为为所述视频融合处理模块提供服务,所述设备状态总览应用配置为为所述设备状态监控模块提供服务,所述设备告警总览应用配置为为所述设备告警管理模块提供服务,所述故障录波管理应用配置为为所述故障录 波管理模块提供服务,所述智能报表管理应用配置为为所述数据报表管理模块提供服务,所述数字站区管理应用配置为为所述数字站区管理模块提供服务,所述远程智能巡视应用配置为为所述远程智能巡视模块提供服务。
优选地,将所述一级监控侧的用户作为第一用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块;所述方法还包括:
通过所述第一视频融合处理模块对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;其中,所述第一普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,通过所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得配置为本地监控侧的用户调阅的视频融合画面,具体包括:
通过所述第一视频融合处理模块在所述第一用户为所述第一普通用户时,响应所述第一普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第一监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得配置为所述第一普通用户调阅的视频融合画面。
优选地,将所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
则,通过所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,还包括:
通过所述第一视频融合处理模块在所述第一用户为所述第一VIP用户时,响应所述第一VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第一视频融合请求,所述第一视频融合请求中包括待查看区域标识;
通过所述第三视频融合处理模块根据所述第一视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一VIP用户调阅的视频融合画面并发送至所述第一视频融合处理模块;
通过所述第一视频融合处理模块接收获得用于所述第一VIP用户调阅的视频融合画面。
优选地,将所述二级监控侧的用户作为第二用户,所述第二监控终端的视频融合处理模块作为第二视频融合处理模块;所述方法还包括:
通过所述第二视频融合处理模块对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;其中,所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第二VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,通过所述第二视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
通过所述第二视频融合处理模块在所述第二用户为所述第二普通用户时,响应所述第二普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第二监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第二普通用户调阅的视频融合画面。
优选地,将所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
则,通过所述第二视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,还包括:
通过所述第二视频融合处理模块在所述第二用户为所述第二VIP用户时,响应所述第二VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第二视频融合请求,所述第二视频融合请求中包括待查看区域标识;
通过所述第三视频融合处理模块根据所述第二视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第二VIP用户调阅的视频融合画面并发送至所述第二视频融合处理模块;
通过所述第二视频融合处理模块接收获得用于所述第二VIP用户调阅的视频融合画面。
优选地,将所述三级监控侧的用户作为第三用户,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;所述方法还包括:
通过所述第三视频融合处理模块对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;其中,所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
则,通过所述第三视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
通过所述第三视频融合处理模块在所述第三用户为所述第三VIP用户时,响应所述第三VIP用户的监控调阅请求,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第三VIP用户调阅的视频融合画面。
优选地,将所述第二监控终端作为数据发送端且所述第一监控终端作为数据接收端,或,将所述第三监控终端作为数据发送端且所述第二监控终端作为数据接收端;所述数据发送端还包括网络探测模块;所述方法还包括:
通过所述网络探测模块定期进行网络带宽探测,以探测所述数据发送端与 对应的所述数据接收端之间的网络可用带宽和最小延时时间,并在每一次探测完成时,仅记录最后一次探测到的网络可用带宽和最小延时时间,以在需要向对应的所述数据接收端传输视频融合业务数据时,根据当前记录的网络可用带宽确定视频融合业务数据的初始数据传输速率。
优选地,所述通过所述网络探测模块定期进行网络带宽探测,以探测所述数据发送端与对应的所述数据接收端之间的网络可用带宽和最小延时时间,具体包括:
通过所述网络探测模块在每一次进行网络带宽探测时,按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,并记录每一次发送的探测报文对应的RTT值和报文发送速率;
通过所述网络探测模块在首次判定RTT值增大时,将RTT值增大的时间点记为T1,将T1之前的最后一个RTT值不变的时间点记为T0,根据T0对应RTT值确定最小延时时间,根据T1之前的最后一个报文发送速率确定所述数据发送端与对应的所述数据接收端之间的网络可用带宽。
优选地,所述通过所述网络探测模块在每一次进行网络带宽探测时,按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,具体包括:
通过所述网络探测模块在每一次进行网络带宽探测时,根据本地数据发送端的最大出口带宽和本地数据发送端的带宽占用经验值,获取可用带宽上限;
通过所述网络探测模块根据所述可用带宽上限设置速率调整阈值,并在按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文的过程中,当报文发送速率小于所述速率调整阈值时,根据第一增加幅度按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,当报文发送速率不小于所述速率调整阈值时,根据第二增加幅度按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文;其中,所述第一增加幅度大于所述第二增加幅度。
优选地,所述方法还包括:通过所述数据传输调控模块在本地监控终端需要向另一监控终端传输视频融合业务数据时,依次进入数据传输过程的第一传输阶段、第二传输阶段和第三传输阶段,直至数据传输完成时,结束所述数据传输过程;其中,
在所述第一传输阶段内,获取本地的所述网络探测模块当前记录的网络可用带宽和最小延时时间,根据获得的网络可用带宽确定视频融合业务数据的初始数据传输速率,以根据所述初始数据传输速率开始向另一监控终端传输视频融合业务数据,直至判定预设的速率调整条件被触发时,进入所述第二传输阶段;其中,所述速率调整条件为首次判定RTT值增大到预设的延时时间阈值,或,首次接收到丢包报告;
在所述第二传输阶段内,根据获得的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于视频融合业务数据的数据类型和监控调阅请求用户的用户类型配置的目标延时恢复时间,调整视频融合业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定所述速率调整条件被触发时探测到的延时 时间恢复到获得的最小延时时间时,进入所述第三传输阶段;
在所述第三传输阶段内,在根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据的同时,触发本地的所述网络探测模块进行网络带宽探测,以探测并记录本地监控终端与另一监控终端之间的网络可用带宽和最小延时时间,获取本地的所述网络探测当前记录的网络可用带宽和最小延时时间,根据获得的网络可用带宽确定视频融合业务数据的数据传输速率,以根据确定的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定所述速率调整条件被触发时,返回所述第二传输阶段。
优选地,所述目标延时恢复时间由所述数据传输调控模块根据视频融合业务数据的数据类型和监控调阅请求用户的用户类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型、每一种数据类型对应的用户类型以及每一种用户类型对应配置的延时恢复时间,所述数据类型包括视频融合业务数据,所述用户类型包括普通用户和VIP用户,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小,同一种数据类型对应的用户类型中,普通用户对应配置的延时恢复时间大于VIP用户对应配置的延时恢复时间。
优选地,所述延时时间阈值根据当前记录的最小延时时间进行设置。
优选地,将所述一级监控侧的用户作为第一用户,所述二级监控侧的用户作为第二用户,所述三级监控侧的用户作为第三用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块,所述第二监控终端的视频融合处理模块作为第二视频融合处理模块,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;所述第二监控终端还包括第二网络探测模块,所述第三监控终端还包括第三网络探测模块;所述方法还包括:
通过所述第一视频融合处理模块对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;
通过所述第二视频融合处理模块对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;
通过所述第三视频融合处理模块对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;
通过所述第二网络探测模块定期进行网络带宽探测,以探测所述第二监控终端与所述第一监控终端之间的网络可用带宽,并将当前探测到的第一网络可用带宽发送至所述第一视频融合处理模块;
通过所述第三网络探测模块定期进行网络带宽探测,以探测所述第三监控终端与所述第二监控终端之间的网络可用带宽,并将当前探测到的第二网络可用带宽发送至所述第一视频融合处理模块;
通过所述第一视频融合处理模块根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量;
其中,所述第一普通用户和所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户、所述第二VIP用户和所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被 监控区域的视频融合画面。
优选地,所述根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量,具体包括:
在只需调整所述第一VIP用户的数量,而所述第二VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第二VIP用户占用的网络带宽获取第一剩余网络带宽,根据所述第一剩余网络带宽调整所述第一VIP用户的数量;
在只需调整所述第二VIP用户的数量,而所述第一VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第一VIP用户占用的网络带宽获取第二剩余网络带宽,根据所述第二剩余网络带宽调整所述第二VIP用户的数量;
在同时需要调整所述第一VIP用户的数量和所述第二VIP用户的数量时,根据所述第一网络可用带宽、所述第二网络可用带宽和所述第一普通用户占用的网络带宽获取第三剩余网络带宽,根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量。
优选地,所述根据所述第一剩余网络带宽调整所述第一VIP用户的数量,具体包括:
通过所述第一视频融合处理模块判断所述第一剩余网络带宽是否大于预设的第一带宽阈值,若是,则将至少M个所述第一用户配置为所述第一VIP用户;若否,则释放所述第一普通用户占用的网络带宽,根据所述第一剩余网络带宽和所述第一普通用户占用的网络带宽将至少M个所述第一用户配置为所述第一VIP用户;
其中,M表示需要保持的所述第一VIP用户的基础数量,M≥1,所述第一带宽阈值根据M个所述第一VIP用户占用的网络带宽进行设置。
优选地,所述根据所述第一剩余网络带宽调整所述第一VIP用户的数量,具体包括:
通过所述第一视频融合处理模块判断所述第一剩余网络带宽是否大于一个所述第一VIP用户占用的网络带宽,若是,则将至少一个所述第一用户配置为所述第一VIP用户;若否,则将所有所述第一用户全部配置为所述第一普通用户。
优选地,所述根据所述第二剩余网络带宽调整所述第二VIP用户的数量,具体包括:
通过所述第一视频融合处理模块判断所述第二剩余网络带宽是否大于预设的第二带宽阈值,若是,则向所述第二视频融合处理模块发送VIP用户增加指令;若否,则向所述第二视频融合处理模块发送普通用户禁用指令;
通过所述第二视频融合处理模块根据所述VIP用户增加指令将至少N个所述第二用户配置为所述第二VIP用户,或,根据所述普通用户禁用指令释放所述第二普通用户占用的网络带宽,根据所述第二剩余网络带宽和所述第二普通 用户占用的网络带宽将至少N个所述第二用户配置为所述第二VIP用户;
其中,N表示需要保持的所述第二VIP用户的基础数量,N≥1,所述第二带宽阈值根据N个所述第二VIP用户占用的网络带宽进行设置。
优选地,所述第一视频融合处理模块根据所述第二剩余网络带宽调整所述第二VIP用户的数量,具体包括:
通过所述第一视频融合处理模块判断所述第二剩余网络带宽是否大于一个所述第二VIP用户占用的网络带宽,若是,则向所述第二视频融合处理模块发送VIP用户增加指令;若否,则向所述第二视频融合处理模块发送VIP用户减少指令;
通过所述第二视频融合处理模块根据所述VIP用户增加指令将至少一个所述第二用户配置为所述第二VIP用户,或,根据所述VIP用户减少指令将所有所述第二用户全部配置为所述第二普通用户。
优选地,所述根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量,具体包括:
通过所述第一视频融合处理模块判断所述第三剩余网络带宽是否大于预设的第三带宽阈值,若是,则将至少M个所述第一用户配置为所述第一VIP用户,并向所述第二视频融合处理模块发送VIP用户增加指令;若否,则释放所述第一普通用户占用的网络带宽,根据所述第三剩余网络带宽和所述第一普通用户占用的网络带宽将至少M个所述第一用户配置为所述第一VIP用户,并向所述第二视频融合处理模块发送普通用户禁用指令;
通过所述第二视频融合处理模块根据所述VIP用户增加指令将至少N个所述第二用户配置为所述第二VIP用户,或,根据所述普通用户禁用指令释放所述第二普通用户占用的网络带宽,根据所述第三剩余网络带宽和所述第二普通用户占用的网络带宽将至少N个所述第二用户配置为所述第二VIP用户;
其中,M表示需要保持的所述第一VIP用户的基础数量,M≥1,N表示需要保持的所述第二VIP用户的基础数量,N≥1,所述第三带宽阈值根据M个所述第一VIP用户占用的网络带宽和N个所述第二VIP用户占用的网络带宽进行设置。
优选地,在所述第一VIP用户的数量达到M个,所述第二VIP用户的数量达到N个之后,增加的所述第一VIP用户的数量不小于增加的所述第二VIP用户的数量。
需要说明的是,本申请实施例所提供的一种基于数字换流站的监控方法,能够实现上述任一实施例所述的基于数字换流站的监控系统中的所有处理流程,具体的监控处理方案以及实现的技术效果分别与上述实施例所述的基于数字换流站的监控系统的监控处理方案以及实现的技术效果对应相同,这里不再赘述。
综上,本申请实施例所提供的一种基于数字换流站的监控系统及方法,具有以下有益效果:
(1)通过在第一监控终端、第二监控终端和第三监控终端分别部署视频融合处理模块、设备状态监控模块和设备告警管理模块等功能模块,使得所述监 控系统的各个功能均支持由各级监控终端在本地自行完成,无需全部由站端完成,大大减少了对站端资源的占用;
(2)通过在第一监控终端、第二监控终端和第三监控终端分别部署视频融合处理模块,使得第一监控终端、第二监控终端和第三监控终端能够分别在本地响应本地监控侧的用户的监控调阅请求,无需全部由站端响应各级监控侧的用户的监控调阅请求,并且用户可以从本地直接查看视频融合画面,无需从远端调阅,有效缓解了站端响应多用户并发访问的压力,从而能够在站端的计算资源和网络带宽资源有限的前提下,有效降低网络延迟,提高视频画面显示的实时性,提高视频融合应用的使用效果及用户体验,使得处于一级监控侧、二级监控侧和三级监控侧这三个不同位置处的用户体验具有一致性;
(3)通过在第一监控终端、第二监控终端和第三监控终端分别部署数据传输调控模块,使得第一监控终端、第二监控终端和第三监控终端之间在传输业务数据的过程中,能够在速率调整条件被触发时,根据速率调整条件被触发前探测到的网络可用带宽和最小延时时间、速率调整条件被触发时探测到的延时时间以及基于待传输的业务数据的数据类型配置的延时恢复时间,调整业务数据的当前的数据传输速率,从而能够在业务数据被发送出去之前,为业务数据配置合适的数据传输速率,有效避免业务数据在发送出去之后,由于传输过程中的网络延时的不可控性所带来的网络延时难以解决的问题,降低了解决网络延时问题的难度;
(4)通过数据传输调控模块在速率调整条件被触发时,根据速率调整条件被触发前探测到的网络可用带宽和最小延时时间、速率调整条件被触发时探测到的延时时间以及基于待传输的业务数据的数据类型配置的延时恢复时间,来调整业务数据的当前的数据传输速率,能够准确确定数据传输速率的调整值,并且速率调整条件被触发前探测到的网络可用带宽和最小延时时间、速率调整条件被触发时探测到的延时时间均是更符合实时网络状态的参数值,基于业务数据的数据类型配置的延时恢复时间是更符合用户需求的参数值,根据这些参数值来实时确定数据传输速率的调整值,使得调整后的数据传输速率更适应于当前的网络状态和用户需求,从而提高了数据传输速率调整的准确性,并且提高了速率调整方案的自适应性;
(5)在不同数据类型的业务数据的传输过程中,均可以采用本申请实施例所提供的速率调整方案对业务数据的数据传输速率进行实时调整,并且对于每一种数据类型的业务数据来说,具体的速率调整方案只在同一种数据类型的业务数据的传输过程中进行,而不会对所有数据类型的业务数据的数据传输速率均进行同样的调整,因此不会对其他数据类型的业务数据的数据传输过程产生影响,也不会影响其他业务功能的使用体验;
(6)业务数据可以根据不同的数据类型对应配置不同的优先级(或重要程度),例如,视频融合业务数据对时间要求比较高,对应配置的优先级比较高,其他数据类型的业务数据对时间要求比较低,对应配置的优先级比较低,通过为不同的数据类型配置对应的延时恢复时间,使得业务数据的优先级与延时恢复时间相匹配,能够满足不同优先级的业务数据的不同的延时恢复需求,将网 络可用带宽配置给优先级更高的业务数据使用,从而实现了网络资源的优化配置,也提高了速率调整方案的灵活性;
(7)本申请实施例所提供的速率调整方案,不依赖于中间设备即可实现数据传输速率的准确调整,并且速率调整方案简单,容易部署实施,占用资源少,实用性高。
以上所述仅是本申请的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本申请技术原理的前提下,还可以做出若干改进和变形,这些改进和变形也应视为本申请的保护范围。

Claims (33)

  1. 一种基于数字换流站的监控系统,包括部署在一级监控侧的第一监控终端、部署在二级监控侧的第二监控终端和部署在三级监控侧的第三监控终端;所述监控系统的被监控对象包括部署在所述三级监控侧的数字换流站;所述第一监控终端、所述第二监控终端和所述第三监控终端均至少包括通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块,所述第三监控终端还包括数据存储模块,所述数据存储模块配置为存储数字换流站数据;
    所述通信模块配置为实现所述第一监控终端、所述第二监控终端和所述第三监控终端之间的通信;所述设备状态监控模块配置为监控及管理所述数字换流站的所有设备的台账信息、运行信息和监测数据;所述设备告警管理模块配置为管理所述数字换流站的所有设备的告警信息;所述人机交互模块配置为接收本地监控侧的用户的监控调阅请求;
    每一所述视频融合处理模块配置为响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面;
    每一所述数据传输调控模块配置为在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据。
  2. 如权利要求1所述的基于数字换流站的监控系统,其中,所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据,具体包括:
    所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,获取所述速率调整条件被触发前探测到的网络可用带宽S0和最小延时时间RTT0、所述速率调整条件被触发时探测到的延时时间RTT2以及基于所述业务数据的数据类型配置的延时恢复时间t;
    所述数据传输调控模块根据公式S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2;
    所述数据传输调控模块根据公式n=(RTT2-RTT0)*S0计算获得进入缓冲区的业务数据量n;
    所述数据传输调控模块根据公式S2’=S2-n/t计算获得所述业务数据的 速率调整目标值S2’;
    所述数据传输调控模块根据所述速率调整目标值S2’调整所述业务数据当前的数据传输速率,获得调整后的数据传输速率S0’,且调整后的数据传输速率S0’满足S0’≤S2’,以根据调整后的数据传输速率S0’继续向另一监控终端传输所述业务数据。
  3. 如权利要求2所述的基于数字换流站的监控系统,其中,所述延时恢复时间由所述数据传输调控模块根据所述业务数据的数据类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型及其对应配置的延时恢复时间,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小。
  4. 如权利要求1所述的基于数字换流站的监控系统,其中,所述第三监控终端还包括故障录波管理模块、数据报表管理模块、数字站区管理模块和远程智能巡视模块;
    所述故障录波管理模块配置为对所述数字换流站的故障录波文件进行管理,并根据所述故障录波文件进行在线解析;
    所述数据报表管理模块配置为对所述数字换流站的业务数据进行统计,根据所述数字换流站的运维需求以不同的报表形式展示历史数据、统计数据和分析数据,并实现报表任务制定功能、报表自动生成功能、报表导出功能和报表打印功能;
    所述数字站区管理模块配置为以所述数字换流站的站区为主体,对所述数字换流站的安防、消防和动力环境进行监控和管理;
    所述远程智能巡视模块配置为控制监测装置开展室内外设备联合巡视作业,并对巡视数据进行分析,形成巡视结果和巡视报告。
  5. 如权利要求1所述的基于数字换流站的监控系统,其中,所述数字换流站具有统一的公共组件,所述公共组件包括业务组件和数据组件,所述业务组件和所述数据组件配置为为所述数字换流站的各个应用系统提供基于统一规范的业务功能接口和基础数据服务,并制定统一的数据交互协议和数据交互格式,以为所述第三监控终端提供统一数据服务接口。
  6. 如权利要求5所述的基于数字换流站的监控系统,其中,所述数字换流站具有统一的基础应用,所述基础应用采用统一基础软硬件设施、统一数据模型、统一数据服务规范和统一应用开发规范进行构建。
  7. 如权利要求6所述的基于数字换流站的监控系统,其中,所述基础应用包括全站视频管控应用、全站三维呈现应用、设备状态总览应用、设备告警总览应用、故障录波管理应用、智能报表管理应用、数字站区管理应用和远程智能巡视应用;其中,所述全站视频管控应用和全站三维呈现应用配置为为所述视频融合处理模块提供服务,所述设备状态总览应用配置为为所述设备状态监控模块提供服务,所述设备告警总览应用配置为为所述设备告警管理模块提供服务,所述故障录波管理应用配置为为所述故障录波管理模块提供服务,所述智能报表管理应用配置为为所述数据报表管理模块提供服务,所述数字站区管理应用配置为为所述数字站区管理模块提供服务,所述 远程智能巡视应用配置为为所述远程智能巡视模块提供服务。
  8. 如权利要求1所述的基于数字换流站的监控系统,其中,将所述一级监控侧的用户作为第一用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块;
    所述第一视频融合处理模块还配置为对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;其中,所述第一普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
    则,所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
    所述第一视频融合处理模块在所述第一用户为所述第一普通用户时,响应所述第一普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第一监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一普通用户调阅的视频融合画面。
  9. 如权利要求8所述的基于数字换流站的监控系统,其中,将所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
    则,所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,还包括:
    所述第一视频融合处理模块在所述第一用户为所述第一VIP用户时,响应所述第一VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第一视频融合请求,所述第一视频融合请求中包括待查看区域标识;
    所述第三视频融合处理模块根据所述第一视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一VIP用户调阅的视频融合画面并发送至所述第一视频融合处理模块;
    所述第一视频融合处理模块接收获得用于所述第一VIP用户调阅的视频融合画面。
  10. 如权利要求1所述的基于数字换流站的监控系统,其中,将所述二级监控侧的用户作为第二用户,所述第二监控终端的视频融合处理模块作为第二视频融合处理模块;
    所述第二视频融合处理模块还配置为对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;其中,所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第二VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
    则,所述第二视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
    所述第二视频融合处理模块在所述第二用户为所述第二普通用户时,响应所述第二普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第二监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第二普通用户调阅的视频融合画面。
  11. 如权利要求10所述的基于数字换流站的监控系统,其中,将所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
    则,所述第二视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,还包括:
    所述第二视频融合处理模块在所述第二用户为所述第二VIP用户时,响应所述第二VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第二视频融合请求,所述第二视频融合请求中包括待查看区域标识;
    所述第三视频融合处理模块根据所述第二视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第二VIP用户调阅的视频融合画面并发送至所述第二视频融合处理模块;
    所述第二视频融合处理模块接收获得用于所述第二VIP用户调阅的视频融合画面。
  12. 如权利要求1所述的基于数字换流站的监控系统,其中,将所述三级监控侧的用户作为第三用户,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
    所述第三视频融合处理模块还配置为对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;其中,所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
    则,所述第三视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,具体包括:
    所述第三视频融合处理模块在所述第三用户为所述第三VIP用户时,响应所述第三VIP用户的监控调阅请求,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第三VIP用户调阅的视频融合画面。
  13. 如权利要求1所述的基于数字换流站的监控系统,其中,将所述第二监控终端作为数据发送端且所述第一监控终端作为数据接收端,或,将所述第三监控终端作为数据发送端且所述第二监控终端作为数据接收端;
    则,所述数据发送端还包括网络探测模块;所述网络探测模块配置为定期进行网络带宽探测,以探测所述数据发送端与对应的所述数据接收端之间的网络可用带宽和最小延时时间,并在每一次探测完成时,仅记录最后一次探测到的网络可用带宽和最小延时时间,以在需要向对应的所述数据接收端传输视频融合业务数据时,根据当前记录的网络可用带宽确定视频融合业务数据的初始数据传输速率。
  14. 如权利要求13所述的基于数字换流站的监控系统,其中,所述网络探测模块定期进行网络带宽探测,以探测所述数据发送端与对应的所述数据接收端之间的网络可用带宽和最小延时时间,具体包括:
    所述网络探测模块在每一次进行网络带宽探测时,按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,并记录每一次发送的探测报文对应的RTT值和报文发送速率;
    所述网络探测模块在首次判定RTT值增大时,将RTT值增大的时间点记为T1,将T1之前的最后一个RTT值不变的时间点记为T0,根据T0对应RTT值确定最小延时时间,根据T1之前的最后一个报文发送速率确定所述数据发送端与对应的所述数据接收端之间的网络可用带宽。
  15. 如权利要求14所述的基于数字换流站的监控系统,其中,所述网络探测模块在每一次进行网络带宽探测时,按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,具体包括:
    所述网络探测模块在每一次进行网络带宽探测时,根据本地数据发送端的最大出口带宽和本地数据发送端的带宽占用经验值,获取可用带宽上限;
    所述网络探测模块根据所述可用带宽上限设置速率调整阈值,并在按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文的过程中,当报文发送速率小于所述速率调整阈值时,根据第一增加幅度按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文,当报文发送速率不小于所述速率调整阈值时,根据第二增加幅度按照递增的报文发送速率依次向对应的所述数据接收端发送探测报文;其中,所述第一增加幅度大于所述第二增加幅度。
  16. 如权利要求13所述的基于数字换流站的监控系统,其中,所述数据传输调控模块还配置为在本地监控终端需要向另一监控终端传输视频融合业务数据时,依次进入数据传输过程的第一传输阶段、第二传输阶段和第三传输阶段,直至数据传输完成时,结束所述数据传输过程;其中,
    在所述第一传输阶段内,获取本地的所述网络探测模块当前记录的网络可用带宽和最小延时时间,根据获得的网络可用带宽确定视频融合业务数据的初始数据传输速率,以根据所述初始数据传输速率开始向另一监控终端传输视频融合业务数据,直至判定预设的速率调整条件被触发时,进入所述第二传输阶段;其中,所述速率调整条件为首次判定RTT值增大到预设的延时时间阈值,或,首次接收到丢包报告;
    在所述第二传输阶段内,根据获得的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于视频融合业务数据的 数据类型和监控调阅请求用户的用户类型配置的目标延时恢复时间,调整视频融合业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定所述速率调整条件被触发时探测到的延时时间恢复到获得的最小延时时间时,进入所述第三传输阶段;
    在所述第三传输阶段内,在根据调整后的数据传输速率继续向另一监控终端传输视频融合业务数据的同时,触发本地的所述网络探测模块进行网络带宽探测,以探测并记录本地监控终端与另一监控终端之间的网络可用带宽和最小延时时间,获取本地的所述网络探测当前记录的网络可用带宽和最小延时时间,根据获得的网络可用带宽确定视频融合业务数据的数据传输速率,以根据确定的数据传输速率继续向另一监控终端传输视频融合业务数据,直至判定所述速率调整条件被触发时,返回所述第二传输阶段。
  17. 如权利要求16所述的基于数字换流站的监控系统,其中,所述目标延时恢复时间由所述数据传输调控模块根据视频融合业务数据的数据类型和监控调阅请求用户的用户类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型、每一种数据类型对应的用户类型以及每一种用户类型对应配置的延时恢复时间,所述数据类型包括视频融合业务数据,所述用户类型包括普通用户和VIP用户,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小,同一种数据类型对应的用户类型中,普通用户对应配置的延时恢复时间大于VIP用户对应配置的延时恢复时间。
  18. 如权利要求16所述的基于数字换流站的监控系统,其中,所述延时时间阈值根据当前记录的最小延时时间进行设置。
  19. 如权利要求1所述的基于数字换流站的监控系统,其中,将所述一级监控侧的用户作为第一用户,所述二级监控侧的用户作为第二用户,所述三级监控侧的用户作为第三用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块,所述第二监控终端的视频融合处理模块作为第二视频融合处理模块,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;所述第二监控终端还包括第二网络探测模块,所述第三监控终端还包括第三网络探测模块;
    所述第一视频融合处理模块还配置为对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;
    所述第二视频融合处理模块还配置为对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;
    所述第三视频融合处理模块,还配置为对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;
    所述第二网络探测模块配置为定期进行网络带宽探测,以探测所述第二监控终端与所述第一监控终端之间的网络可用带宽,并将当前探测到的第一网络可用带宽发送至所述第一视频融合处理模块;
    所述第三网络探测模块配置为定期进行网络带宽探测,以探测所述第三监控终端与所述第二监控终端之间的网络可用带宽,并将当前探测到的第二 网络可用带宽发送至所述第一视频融合处理模块;
    所述第一视频融合处理模块还配置为根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量;
    其中,所述第一普通用户和所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户、所述第二VIP用户和所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面。
  20. 如权利要求19所述的基于数字换流站的监控系统,其中,所述第一视频融合处理模块根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量,具体包括:
    所述第一视频融合处理模块在只需调整所述第一VIP用户的数量,而所述第二VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第二VIP用户占用的网络带宽获取第一剩余网络带宽,根据所述第一剩余网络带宽调整所述第一VIP用户的数量;
    所述第一视频融合处理模块在只需调整所述第二VIP用户的数量,而所述第一VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第一VIP用户占用的网络带宽获取第二剩余网络带宽,根据所述第二剩余网络带宽调整所述第二VIP用户的数量;
    所述第一视频融合处理模块在同时需要调整所述第一VIP用户的数量和所述第二VIP用户的数量时,根据所述第一网络可用带宽、所述第二网络可用带宽和所述第一普通用户占用的网络带宽获取第三剩余网络带宽,根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量。
  21. 如权利要求20所述的基于数字换流站的监控系统,其中,所述第一视频融合处理模块根据所述第一剩余网络带宽调整所述第一VIP用户的数量,具体包括:
    所述第一视频融合处理模块判断所述第一剩余网络带宽是否大于预设的第一带宽阈值,若是,则将至少M个所述第一用户配置为所述第一VIP用户;若否,则释放所述第一普通用户占用的网络带宽,根据所述第一剩余网络带宽和所述第一普通用户占用的网络带宽将至少M个所述第一用户配置为所述第一VIP用户;
    其中,M表示需要保持的所述第一VIP用户的基础数量,M≥1,所述第一带宽阈值根据M个所述第一VIP用户占用的网络带宽进行设置。
  22. 如权利要求20所述的基于数字换流站的监控系统,其中,所述第一视频融合处理模块根据所述第一剩余网络带宽调整所述第一VIP用户的数量,具体包括:
    所述第一视频融合处理模块判断所述第一剩余网络带宽是否大于一个 所述第一VIP用户占用的网络带宽,若是,则将至少一个所述第一用户配置为所述第一VIP用户;若否,则将所有所述第一用户全部配置为所述第一普通用户。
  23. 如权利要求20所述的基于数字换流站的监控系统,其中,所述第一视频融合处理模块根据所述第二剩余网络带宽调整所述第二VIP用户的数量,具体包括:
    所述第一视频融合处理模块判断所述第二剩余网络带宽是否大于预设的第二带宽阈值,若是,则向所述第二视频融合处理模块发送VIP用户增加指令;若否,则向所述第二视频融合处理模块发送普通用户禁用指令;
    所述第二视频融合处理模块根据所述VIP用户增加指令将至少N个所述第二用户配置为所述第二VIP用户,或,根据所述普通用户禁用指令释放所述第二普通用户占用的网络带宽,根据所述第二剩余网络带宽和所述第二普通用户占用的网络带宽将至少N个所述第二用户配置为所述第二VIP用户;
    其中,N表示需要保持的所述第二VIP用户的基础数量,N≥1,所述第二带宽阈值根据N个所述第二VIP用户占用的网络带宽进行设置。
  24. 如权利要求20所述的基于数字换流站的监控系统,其中,所述第一视频融合处理模块根据所述第二剩余网络带宽调整所述第二VIP用户的数量,具体包括:
    所述第一视频融合处理模块判断所述第二剩余网络带宽是否大于一个所述第二VIP用户占用的网络带宽,若是,则向所述第二视频融合处理模块发送VIP用户增加指令;若否,则向所述第二视频融合处理模块发送VIP用户减少指令;
    所述第二视频融合处理模块根据所述VIP用户增加指令将至少一个所述第二用户配置为所述第二VIP用户,或,根据所述VIP用户减少指令将所有所述第二用户全部配置为所述第二普通用户。
  25. 如权利要求20所述的基于数字换流站的监控系统,其中,所述第一视频融合处理模块根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量,具体包括:
    所述第一视频融合处理模块判断所述第三剩余网络带宽是否大于预设的第三带宽阈值,若是,则将至少M个所述第一用户配置为所述第一VIP用户,并向所述第二视频融合处理模块发送VIP用户增加指令;若否,则释放所述第一普通用户占用的网络带宽,根据所述第三剩余网络带宽和所述第一普通用户占用的网络带宽将至少M个所述第一用户配置为所述第一VIP用户,并向所述第二视频融合处理模块发送普通用户禁用指令;
    所述第二视频融合处理模块根据所述VIP用户增加指令将至少N个所述第二用户配置为所述第二VIP用户,或,根据所述普通用户禁用指令释放所述第二普通用户占用的网络带宽,根据所述第三剩余网络带宽和所述第二普通用户占用的网络带宽将至少N个所述第二用户配置为所述第二VIP用户;
    其中,M表示需要保持的所述第一VIP用户的基础数量,M≥1,N表示需要保持的所述第二VIP用户的基础数量,N≥1,所述第三带宽阈值根据M个所述第一VIP用户占用的网络带宽和N个所述第二VIP用户占用的网络带宽进行设置。
  26. 如权利要求25所述的基于数字换流站的监控系统,其中,在所述第一VIP用户的数量达到M个,所述第二VIP用户的数量达到N个之后,增加的所述第一VIP用户的数量不小于增加的所述第二VIP用户的数量。
  27. 一种基于数字换流站的监控方法,所述方法适用于如权利要求1~26中任一项所述的基于数字换流站的监控系统,所述监控系统包括部署在一级监控侧的第一监控终端、部署在二级监控侧的第二监控终端和部署在三级监控侧的第三监控终端;所述监控系统的被监控对象包括部署在所述三级监控侧的数字换流站;所述第一监控终端、所述第二监控终端和所述第三监控终端均至少包括通信模块、人机交互模块、设备状态监控模块、设备告警管理模块、视频融合处理模块和数据传输调控模块,所述第三监控终端还包括数据存储模块,所述数据存储模块配置为存储数字换流站数据;所述方法包括:
    通过所述通信模块实现所述第一监控终端、所述第二监控终端和所述第三监控终端之间的通信;通过所述设备状态监控模块监控及管理所述数字换流站的所有设备的台账信息、运行信息和监测数据;通过所述设备告警管理模块管理所述数字换流站的所有设备的告警信息;通过所述人机交互模块接收本地监控侧的用户的监控调阅请求;
    通过每一所述视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面;
    通过每一所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据。
  28. 如权利要求27所述的基于数字换流站的监控方法,其中,通过所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,根据所述速率调整条件被触发前探测到的网络可用带宽和最小延时时间、所述速率调整条件被触发时探测到的延时时间以及基于所述业务数据的数据类型配置的延时恢复时间,调整所述业务数据当前的数据传输速率,以根据调整后的数据传输速率继续向另一监控终端传输所述业务数据,具体包括:
    通过所述数据传输调控模块在本地监控终端向另一监控终端传输业务数据的过程中,当所述业务数据的预设的速率调整条件被触发时,获取所述速率调整条件被触发前探测到的网络可用带宽S0和最小延时时间RTT0、所述速率调整条件被触发时探测到的延时时间RTT2以及基于所述业务数据的 数据类型配置的延时恢复时间t;
    通过所述数据传输调控模块根据公式S2=RTT0/RTT2*S0计算获得当前的网络可用带宽估计值S2;
    通过所述数据传输调控模块根据公式n=(RTT2-RTT0)*S0计算获得进入缓冲区的业务数据量n;
    通过所述数据传输调控模块根据公式S2’=S2-n/t计算获得所述业务数据的速率调整目标值S2’;
    通过所述数据传输调控模块根据所述速率调整目标值S2’调整所述业务数据当前的数据传输速率,获得调整后的数据传输速率S0’,且调整后的数据传输速率S0’满足S0’≤S2’,以根据调整后的数据传输速率S0’继续向另一监控终端传输所述业务数据。
  29. 如权利要求28所述的基于数字换流站的监控方法,其中,所述延时恢复时间由所述数据传输调控模块根据所述业务数据的数据类型查询预设的延时恢复时间表获得;其中,所述延时恢复时间表中包括至少一种数据类型及其对应配置的延时恢复时间,每一种数据类型对应的业务数据的优先级越高,对应配置的延时恢复时间越小。
  30. 如权利要求27所述的基于数字换流站的监控方法,其中,将所述一级监控侧的用户作为第一用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块;所述方法还包括:
    通过所述第一视频融合处理模块对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;其中,所述第一普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面;
    则,通过所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得本地监控侧的用户调阅的视频融合画面,具体包括:
    通过所述第一视频融合处理模块在所述第一用户为所述第一普通用户时,响应所述第一普通用户的监控调阅请求,从所述数字换流站数据中的所述指定被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第一监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一普通用户调阅的视频融合画面。
  31. 如权利要求30所述的基于数字换流站的监控方法,其中,将所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;
    则,通过所述第一视频融合处理模块响应本地监控侧的用户的监控调阅请求,利用所述数字换流站数据中的视频融合原始数据进行视频融合处理,获得用于本地监控侧的用户调阅的视频融合画面,还包括:
    通过所述第一视频融合处理模块在所述第一用户为所述第一VIP用户时,响应所述第一VIP用户的监控调阅请求,向所述第三视频融合处理模块发送第一视频融合请求,所述第一视频融合请求中包括待查看区域标识;
    通过所述第三视频融合处理模块根据所述第一视频融合请求中的所述待查看区域标识,从所述数字换流站数据中的所述所有被监控区域的视频融合原始数据中获取待查看区域的视频融合原始数据,并利用所述第三监控终端的计算资源对待查看区域的视频融合原始数据进行视频融合处理,获得用于所述第一VIP用户调阅的视频融合画面并发送至所述第一视频融合处理模块;
    通过所述第一视频融合处理模块接收获得用于所述第一VIP用户调阅的视频融合画面。
  32. 如权利要求27所述的基于数字换流站的监控方法,其中,将所述一级监控侧的用户作为第一用户,所述二级监控侧的用户作为第二用户,所述三级监控侧的用户作为第三用户,所述第一监控终端的视频融合处理模块作为第一视频融合处理模块,所述第二监控终端的视频融合处理模块作为第二视频融合处理模块,所述第三监控终端的视频融合处理模块作为第三视频融合处理模块;所述第二监控终端还包括第二网络探测模块,所述第三监控终端还包括第三网络探测模块;所述方法还包括:
    通过所述第一视频融合处理模块对所述第一用户进行用户权限管理,以将所述第一用户配置为第一普通用户或第一VIP用户;
    通过所述第二视频融合处理模块对所述第二用户进行用户权限管理,以将所述第二用户配置为第二普通用户或第二VIP用户;
    通过所述第三视频融合处理模块对所述第三用户进行用户权限管理,以将所述第三用户均配置为第三VIP用户;
    通过所述第二网络探测模块定期进行网络带宽探测,以探测所述第二监控终端与所述第一监控终端之间的网络可用带宽,并将当前探测到的第一网络可用带宽发送至所述第一视频融合处理模块;
    通过所述第三网络探测模块定期进行网络带宽探测,以探测所述第三监控终端与所述第二监控终端之间的网络可用带宽,并将当前探测到的第二网络可用带宽发送至所述第一视频融合处理模块;
    通过所述第一视频融合处理模块根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量;
    其中,所述第一普通用户和所述第二普通用户被配置为具有权限查看所述数字换流站的指定被监控区域的视频融合画面,所述第一VIP用户、所述第二VIP用户和所述第三VIP用户被配置为具有权限查看所述数字换流站的所有被监控区域的视频融合画面。
  33. 如权利要求32所述的基于数字换流站的监控方法,其中,所述根据所述第一网络可用带宽和所述第二网络可用带宽调整所述第一VIP用户的数量或/和所述第二VIP用户的数量,具体包括:
    在只需调整所述第一VIP用户的数量,而所述第二VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第二VIP用户占用 的网络带宽获取第一剩余网络带宽,根据所述第一剩余网络带宽调整所述第一VIP用户的数量;
    在只需调整所述第二VIP用户的数量,而所述第一VIP用户的数量需要保持基础数量不变时,根据所述第一网络可用带宽、所述第二网络可用带宽、所述第一普通用户占用的网络带宽和基础数量个所述第一VIP用户占用的网络带宽获取第二剩余网络带宽,根据所述第二剩余网络带宽调整所述第二VIP用户的数量;
    在同时需要调整所述第一VIP用户的数量和所述第二VIP用户的数量时,根据所述第一网络可用带宽、所述第二网络可用带宽和所述第一普通用户占用的网络带宽获取第三剩余网络带宽,根据所述第三剩余网络带宽调整所述第一VIP用户的数量和所述第二VIP用户的数量。
PCT/CN2023/113310 2022-09-14 2023-08-16 一种基于数字换流站的监控系统及方法 WO2024055800A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP23825364.5A EP4362456A1 (en) 2022-09-14 2023-08-16 Monitoring system and method based on digital converter station
AU2023296339A AU2023296339A1 (en) 2022-09-14 2023-08-16 Monitoring system and method based on digital converter station

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211113105.9 2022-09-14
CN202211113105.9A CN115190278B (zh) 2022-09-14 2022-09-14 一种基于数字换流站的监控系统及方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/411,019 Continuation US20240153257A1 (en) 2022-09-14 2024-01-11 Monitoring system and method based on digital converter station

Publications (1)

Publication Number Publication Date
WO2024055800A1 true WO2024055800A1 (zh) 2024-03-21

Family

ID=83524785

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/113310 WO2024055800A1 (zh) 2022-09-14 2023-08-16 一种基于数字换流站的监控系统及方法

Country Status (4)

Country Link
EP (1) EP4362456A1 (zh)
CN (1) CN115190278B (zh)
AU (1) AU2023296339A1 (zh)
WO (1) WO2024055800A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115190278B (zh) * 2022-09-14 2022-11-11 国家电网有限公司 一种基于数字换流站的监控系统及方法
CN117439897A (zh) * 2023-10-31 2024-01-23 广州方驰信息科技有限公司 一种用于数字孪生场景的大数据分析系统及方法

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103647347A (zh) * 2013-11-29 2014-03-19 山东信通电器有限公司 基于视频精确识别的变电站内设备状态巡视管理系统
CN104159086A (zh) * 2014-08-22 2014-11-19 安徽皖通科技股份有限公司 一种省域路网数字化视频监控平台
CN105187771A (zh) * 2015-07-31 2015-12-23 山东创德软件技术有限公司 一种厂级综合监管平台
WO2019233047A1 (zh) * 2018-06-07 2019-12-12 国电南瑞科技股份有限公司 基于电网调度的运维方法
CN110658760A (zh) * 2019-09-26 2020-01-07 国网河北省电力有限公司石家庄市藁城区供电分公司 一种具有远程定位及通讯的电力运维终端
US20210096911A1 (en) * 2020-08-17 2021-04-01 Essence Information Technology Co., Ltd Fine granularity real-time supervision system based on edge computing
CN114157687A (zh) * 2021-11-16 2022-03-08 许继电气股份有限公司 一种基于云平台部署的变电信息集中展示系统及展示方法
CN115190278A (zh) * 2022-09-14 2022-10-14 国家电网有限公司 一种基于数字换流站的监控系统及方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1881744B (zh) * 2005-06-16 2010-05-12 许继集团有限公司 一种高压直流输电换流站实时监控系统的实现方法
US10139437B2 (en) * 2014-02-18 2018-11-27 Encored Technologies, Inc. Apparatus, server, system and method for energy measuring
CN105680466A (zh) * 2016-03-10 2016-06-15 国网山东省电力公司电力科学研究院 一种采用双级直流电压的混合直流电网动态模拟系统
CN107368016B (zh) * 2017-09-04 2019-11-08 云南电网有限责任公司电力科学研究院 一种换流站监控系统运行的优化方法及装置
CN109241060B (zh) * 2018-09-04 2020-10-20 中国南方电网有限责任公司超高压输电公司检修试验中心 换流站远传信号的分层分级方法与装置
CN110460074A (zh) * 2019-08-09 2019-11-15 国电南瑞科技股份有限公司 一种储能电站综合管理及控制系统
CN114745428A (zh) * 2022-03-14 2022-07-12 许继电气股份有限公司 一种换流站监控数据模型快速读写方法及装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103647347A (zh) * 2013-11-29 2014-03-19 山东信通电器有限公司 基于视频精确识别的变电站内设备状态巡视管理系统
CN104159086A (zh) * 2014-08-22 2014-11-19 安徽皖通科技股份有限公司 一种省域路网数字化视频监控平台
CN105187771A (zh) * 2015-07-31 2015-12-23 山东创德软件技术有限公司 一种厂级综合监管平台
WO2019233047A1 (zh) * 2018-06-07 2019-12-12 国电南瑞科技股份有限公司 基于电网调度的运维方法
CN110658760A (zh) * 2019-09-26 2020-01-07 国网河北省电力有限公司石家庄市藁城区供电分公司 一种具有远程定位及通讯的电力运维终端
US20210096911A1 (en) * 2020-08-17 2021-04-01 Essence Information Technology Co., Ltd Fine granularity real-time supervision system based on edge computing
CN114157687A (zh) * 2021-11-16 2022-03-08 许继电气股份有限公司 一种基于云平台部署的变电信息集中展示系统及展示方法
CN115190278A (zh) * 2022-09-14 2022-10-14 国家电网有限公司 一种基于数字换流站的监控系统及方法

Also Published As

Publication number Publication date
CN115190278B (zh) 2022-11-11
CN115190278A (zh) 2022-10-14
AU2023296339A1 (en) 2024-03-28
EP4362456A1 (en) 2024-05-01

Similar Documents

Publication Publication Date Title
WO2024055800A1 (zh) 一种基于数字换流站的监控系统及方法
CN111709643B (zh) 智慧园区管理系统、方法、计算机设备和存储介质
CN109754456B (zh) 景观照明智能化监控系统
CN103269355B (zh) 智慧天网应用平台
CN103595974B (zh) 一种面向城域的视频地理信息系统及方法
CN201160304Y (zh) 大规模数字远程网络视频监控系统
WO2011097449A2 (en) Method and system for an integrated intelligent building
CN103366246A (zh) 电力地理信息服务平台系统
CN104159086A (zh) 一种省域路网数字化视频监控平台
KR101876114B1 (ko) 3d 모델링 구현을 위한 단말기, 서버, 이들을 포함하는 시스템 및 이를 이용하는 3d 모델링 방법
CN109710672A (zh) 基于云服务的水库多层级管理移动应用系统
CN110851498A (zh) 智慧城市照明系统数据管理和决策系统
CN204331803U (zh) 一种用于油气田行业的协同办公系统
CN108881835A (zh) 一种视频监控集中可视化运维管理的方法及系统
CN113659705A (zh) 一种变电站运行管理系统
CN115375172A (zh) 一种基于bim智能化运维方法及系统
CN210168130U (zh) 一种施工进度和现场图像的监控系统
CN107018360A (zh) 一种ipc的添加方法、装置及系统
CN105405291A (zh) 交通数据采集及主动防控系统
US20240153257A1 (en) Monitoring system and method based on digital converter station
CN108429923A (zh) 一种基于新闻协同运维管理的新闻制播全流程监控及呈现方法
CN112615896A (zh) 基于物联网协议的变电站远程运维人机交互系统及方法
CN115346123B (zh) 一种基于智能网关的智慧灯杆自治系统
CN110308857A (zh) 一种基于触控手势的圈选查询装置
WO2022156756A1 (zh) 一种路侧终端、交通信号灯控制方法及相关系统

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2023296339

Country of ref document: AU

ENP Entry into the national phase

Ref document number: 2023825364

Country of ref document: EP

Effective date: 20231228

ENP Entry into the national phase

Ref document number: 2023296339

Country of ref document: AU

Date of ref document: 20230816

Kind code of ref document: A