CN116775255B - Global integration system supporting wide integration scene - Google Patents

Global integration system supporting wide integration scene Download PDF

Info

Publication number
CN116775255B
CN116775255B CN202311023911.1A CN202311023911A CN116775255B CN 116775255 B CN116775255 B CN 116775255B CN 202311023911 A CN202311023911 A CN 202311023911A CN 116775255 B CN116775255 B CN 116775255B
Authority
CN
China
Prior art keywords
service
subsystem
scheduling
period
subsystems
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202311023911.1A
Other languages
Chinese (zh)
Other versions
CN116775255A (en
Inventor
席阳波
刘兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changsha Eastge Information Technology Co ltd
Original Assignee
Changsha Eastge Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changsha Eastge Information Technology Co ltd filed Critical Changsha Eastge Information Technology Co ltd
Priority to CN202311023911.1A priority Critical patent/CN116775255B/en
Publication of CN116775255A publication Critical patent/CN116775255A/en
Application granted granted Critical
Publication of CN116775255B publication Critical patent/CN116775255B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Multi Processors (AREA)

Abstract

The invention relates to the technical field of integrated systems, in particular to a global integration system supporting a wide integration scene, which comprises the following components: an interface management module: the system is used for managing interfaces among all subsystems, providing registration, release, subscription, monitoring and calling of the interfaces, and comprises interface definition, interface protocol and interface version control; and a data conversion and mapping module: the method is used for realizing format conversion and mapping of data among different subsystems, so that the data can flow among a plurality of subsystems; a flow arranging and scheduling module: the system is used for arranging and scheduling the service requests of different subsystems according to the service rules and the flow definition and then sending the service requests to the target subsystem for processing; and a service execution feedback module: and receiving the service processing result of the target subsystem and returning the result to the subsystem initiating the request. The invention releases the computational power resources of part of subsystems, thereby improving the completion efficiency of the service request.

Description

Global integration system supporting wide integration scene
Technical Field
The invention relates to the technical field of integrated systems, in particular to a global integrated system supporting a wide integrated scene.
Background
The global integration system is a central control system that comprehensively manages and controls various intelligent devices and systems. The intelligent control system can be connected with and communicated with various intelligent devices, sensors and systems to realize automatic control, monitoring and linkage operation.
The main characteristics of the global integration system include: 1. cross-platform compatibility: the system can be seamlessly integrated with intelligent devices and systems of different brands and different types, so that cross-platform interoperability is realized; 2. multifunctional integration: it supports integration of various functions and scenes such as safety monitoring, lighting control, temperature regulation, entertainment systems, curtain control, etc.; 3. intelligent management: the system can provide intelligent management and control for habit and behavior modes of the subsystem, and realize automatic task execution; 4. remote control and monitoring: remote control and monitoring can be performed through mobile phone application or network; 5. extensibility and flexibility: the system supports modular design and expansion, and users can gradually increase intelligent devices and functions according to requirements.
Although the global integration system can make all subsystems as a whole, the service processing and information sharing can be performed. However, in the actual service processing process, with the increase of the service processing amount, the coordination between the request end and the processing end, the queue division and the priority ordering between the service requests often occupy the main part of the global integrated system dispatching computing power, so that the computing power of the integrated system needs to be effectively saved under the premise of considering the computing power load of each subsystem.
Disclosure of Invention
The present invention aims to provide a global integration system supporting a wide integration scenario, which solves the above technical problems.
The aim of the invention can be achieved by the following technical scheme:
a global integration system supporting a widely integrated scenario, comprising:
an interface management module: the system is used for managing interfaces among all subsystems, providing registration, release, subscription, monitoring and calling of the interfaces, and comprises interface definition, interface protocol and interface version control;
and a data conversion and mapping module: the method is used for realizing format conversion and mapping of data among different subsystems, so that the data can flow among a plurality of subsystems, including conversion of a data structure, field mapping, data cleaning and verification;
a flow arranging and scheduling module: the system is used for arranging and scheduling the service requests of different subsystems according to the service rules and the flow definition and then sending the service requests to the target subsystem for processing;
and a service execution feedback module: and receiving the service processing result of the target subsystem and returning the result to the subsystem initiating the request.
As a further scheme of the invention: the flow arranging and scheduling module specifically comprises:
a flow arrangement unit: the method comprises the steps of acquiring a service request of a subsystem, analyzing attribute data in the service request, wherein the attribute data comprises service priority and a target subsystem, and the target subsystem represents the subsystem for processing the service request; dividing task queues according to different target subsystems of the service requests, and sequencing the service requests in the same task queue according to service priorities;
a flow scheduling unit: calculating the business processing amount of each batch of the target subsystem according to the business processing condition of the target subsystem, wherein the business processing amount is the completion amount of the business request of the target subsystem in a preset settlement period; and dispatching the service request corresponding to the service processing amount from the task queue to the corresponding target subsystem.
As a further scheme of the invention: the system also comprises a service processing monitoring module, wherein the service processing monitoring module is used for recording the state and performance indexes of each subsystem and analyzing the service processing capacity of the subsystem through logs and monitoring data.
As a further scheme of the invention: in the flow scheduling unit, the scheduling period of the task queue is equal to the settlement period of the business processing amount of the corresponding target subsystem.
As a further scheme of the invention: and after the task queue reaches a scheduling period, acquiring the state of a corresponding target subsystem from the service processing monitoring module, if an unprocessed service request exists in the target subsystem, delaying scheduling by the task queue, wherein the delayed time is a preset waiting period, and detecting the state of the target subsystem again after the waiting period is ended.
As a further scheme of the invention: the specific steps for calculating the traffic are as follows:
taking a current time node as an end point, and acquiring service processing conditions of the subsystem in a preset settlement period, wherein the settlement period is a time interval;
the completion amount of the service request is taken as the service processing amount of the current batch of the subsystem.
As a further scheme of the invention: and after the subsystem calculates the service processing amount, scheduling the service request which is the same as the service processing amount from the task queue corresponding to the subsystem, and taking the settlement period as the scheduling period of the task queue.
As a further scheme of the invention: after the subsystem processes the service request scheduled by the task queue of the last batch, updating the settlement period, wherein the updated settlement period is equal to the time spent by the subsystem for processing the service request of the last batch, and taking the updated settlement period as the scheduling period of the next batch of the task queue.
The invention has the beneficial effects that: in the prior art, after receiving service requests of the subsystems, the integrated system mostly sends different service requests to each target subsystem for processing according to the attributes of the service requests such as classification, priority and the like, but the processing mode cannot realize more accurate management on the service processing of the subsystems after sending the service requests to the subsystems, a large number of service requests in part of the subsystems are likely to be accumulated, the service requests are also newly applied and previously applied, the priority difference exists between the service requests, new service requests are added continuously, and the service requests are required to be ordered again, so that a large amount of calculation resources of each subsystem are wasted;
therefore, in the invention, after the integrated system end receives the service request uniformly, the service request is not transmitted to each target subsystem in real time, the task queues are divided according to the different target subsystems, and the sequencing is carried out in each task queue, after the scheduling period is reached, the corresponding target subsystem transmits quantitative service requests with inherent sequencing, and after the service request is received, the subsystem only needs to process according to the sequenced service request, thus solving the computational resources of part of subsystems and improving the completion efficiency of the service request.
Drawings
The invention is further described below with reference to the accompanying drawings.
FIG. 1 is a schematic diagram of a global integration system supporting a widely integrated scenario according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, the present invention is a global integration system supporting a wide integration scenario, comprising:
an interface management module: the system is used for managing interfaces among all subsystems, providing registration, release, subscription, monitoring and calling of the interfaces, and comprises interface definition, interface protocol and interface version control;
and a data conversion and mapping module: the method is used for realizing format conversion and mapping of data among different subsystems, so that the data can flow among a plurality of subsystems, including conversion of a data structure, field mapping, data cleaning and verification;
a flow arranging and scheduling module: the system is used for arranging and scheduling the service requests of different subsystems according to the service rules and the flow definition and then sending the service requests to the target subsystem for processing;
and a service execution feedback module: and receiving the service processing result of the target subsystem and returning the result to the subsystem initiating the request.
In the invention, the integrated system processes the service request of each subsystem, which comprises the following steps:
receiving a request: the integrated system is used as a middle layer to receive service requests from various subsystems, wherein the requests can be data inquiry, data modification, service flow triggering and the like;
format conversion: the integrated system format-converts the received request to accommodate the requirements of the target subsystem, which may involve conversion of data structures, conversion of protocols, etc.;
routing and distribution: the integrated system routes the request to the corresponding target subsystem according to the business rules and configuration information, which may involve decision logic, rights verification, etc.;
data transfer: the integrated system transmits the data carried in the request to the target subsystem, which can be direct transmission or asynchronous transmission through a message queue or other communication mechanisms;
executing service logic: after receiving the request, the target subsystem executes corresponding business logic according to the business requirement, which may include data query, data processing, business flow operation and the like.
And (5) returning a result: after the target subsystem finishes business processing, returning the result to the integrated system, and returning the result to the subsystem initiating the request by the integrated system;
exception handling: in the whole process, if an error or an abnormal situation occurs, the integrated system needs to perform corresponding abnormal processing, such as logging, sending an alarm notification and the like.
In the above processing procedure, the integrated system is used as a central system of each subsystem, in the prior art, after receiving service requests of the subsystems, different service requests are sent to each target subsystem for processing according to the attributes of the service requests such as classification, priority and the like, but in the processing mode, after the service requests are sent to the subsystems, the service processing of the subsystems cannot be accurately managed, a large number of service requests in part of the subsystems are likely to be accumulated, the service requests are also newly applied and previously applied, the priority difference exists between the service requests, new service requests are added continuously, and the service requests are required to be sequenced again, so that a large amount of computing resources of each subsystem are wasted;
therefore, in the invention, after the integrated system end receives the service request uniformly, the service request is not transmitted to each target subsystem in real time, the task queues are divided according to the different target subsystems, and the sequencing is carried out in each task queue, after the scheduling period is reached, the corresponding target subsystem transmits quantitative service requests with inherent sequencing, and after the service request is received, the subsystem only needs to process according to the sequenced service request, thus solving the computational resources of part of subsystems and improving the completion efficiency of the service request.
In a preferred embodiment of the present invention, the flow scheduling module specifically includes:
a flow arrangement unit: the method comprises the steps of acquiring a service request of a subsystem, analyzing attribute data in the service request, wherein the attribute data comprises service priority and a target subsystem, and the target subsystem represents the subsystem for processing the service request; dividing task queues according to different target subsystems of the service requests, and sequencing the service requests in the same task queue according to service priorities;
a flow scheduling unit: calculating the business processing amount of each batch of the target subsystem according to the business processing condition of the target subsystem, wherein the business processing amount is the completion amount of the business request of the target subsystem in a preset settlement period; and dispatching the service request corresponding to the service processing amount from the task queue to the corresponding target subsystem.
Notably, the global integrated system in the invention can be compatible with various mainstream technical protocols through the interface management module, coordinate each subsystem, perform service processing and information sharing, and integrate scene coverage: A2A integration, B2B integration, cloud integration, big data integration, internet of things integration, mobile application integration, social network integration, file integration and API management are realized, the integration form that enterprise IT and OT, new and old applications, public and private clouds and partners are fully connected under the digital transformation trend is helped to the enterprise, and digital transformation and digital operation are realized.
In a preferred embodiment of the present invention, the system further comprises a service processing monitoring module, wherein the service processing monitoring module is used for recording the state and performance index of each subsystem, and analyzing the service processing capacity of the subsystem through the log and the monitoring data.
In a preferred embodiment of the present invention, in the flow scheduling unit, the scheduling period of the task queue is equal to the settlement period of the traffic throughput of the corresponding target subsystem.
In a preferred embodiment of the present invention, after the task queue reaches the scheduling period, the state of the corresponding target subsystem is obtained from the service processing monitoring module, if an unprocessed service request exists in the target subsystem, the task queue is scheduled in a delayed manner, the delayed time is a preset waiting period, and the state of the target subsystem is detected again after the waiting period is ended.
In a preferred embodiment of the invention, the specific steps for calculating said traffic volume are as follows:
taking a current time node as an end point, and acquiring service processing conditions of the subsystem in a preset settlement period, wherein the settlement period is a time interval;
the completion amount of the service request is taken as the service processing amount of the current batch of the subsystem.
In a preferred embodiment of the present invention, after the subsystem calculates the service throughput, a service request with the same service throughput is scheduled from a task queue corresponding to the subsystem, and the settlement period is used as a scheduling period of the task queue.
In a preferred embodiment of the present invention, after the subsystem processes the service request scheduled by the task queue of the previous batch, the settling period is updated, where the updated settling period is equal to the time spent by the subsystem to process the service request of the previous batch, and the updated settling period is used as the scheduling period of the next batch of the task queue.
The foregoing describes one embodiment of the present invention in detail, but the description is only a preferred embodiment of the present invention and should not be construed as limiting the scope of the invention. All equivalent changes and modifications within the scope of the present invention are intended to be covered by the present invention.

Claims (4)

1. A global integration system supporting a widely integrated scenario, comprising:
an interface management module: the system is used for managing interfaces among all subsystems, providing registration, release, subscription, monitoring and calling of the interfaces, and comprises interface definition, interface protocol and interface version control;
and a data conversion and mapping module: the method is used for realizing format conversion and mapping of data among different subsystems, so that the data can flow among a plurality of subsystems, including conversion of a data structure, field mapping, data cleaning and verification;
a flow arranging and scheduling module: the system is used for arranging and scheduling the service requests of different subsystems according to the service rules and the flow definition and then sending the service requests to the target subsystem for processing;
and a service execution feedback module: receiving a service processing result of the target subsystem, and returning the result to the subsystem initiating the request;
the flow arranging and scheduling module specifically comprises:
a flow arrangement unit: the method comprises the steps of acquiring a service request of a subsystem, analyzing attribute data in the service request, wherein the attribute data comprises service priority and a target subsystem, and the target subsystem represents the subsystem for processing the service request; dividing task queues according to different target subsystems of the service requests, and sequencing the service requests in the same task queue according to service priorities;
a flow scheduling unit: calculating the business processing amount of each batch of the target subsystem according to the business processing condition of the target subsystem, wherein the business processing amount is the completion amount of the business request of the target subsystem in a preset settlement period; scheduling a service request corresponding to the service processing amount from the task queue to a corresponding target subsystem;
the system also comprises a service processing monitoring module, wherein the service processing monitoring module is used for recording the state and performance indexes of each subsystem and analyzing the service processing capacity of the subsystem through logs and monitoring data;
in the flow scheduling unit, the scheduling period of the task queue is equal to the settlement period of the business processing amount of the corresponding target subsystem;
and after the task queue reaches a scheduling period, acquiring the state of a corresponding target subsystem from the service processing monitoring module, if an unprocessed service request exists in the target subsystem, delaying scheduling by the task queue, wherein the delayed time is a preset waiting period, and detecting the state of the target subsystem again after the waiting period is ended.
2. A global integration system supporting a widely integrated scenario as claimed in claim 1, wherein the specific steps of calculating the traffic volume are as follows:
taking a current time node as an end point, and acquiring service processing conditions of the subsystem in a preset settlement period, wherein the settlement period is a time interval;
the completion amount of the service request is taken as the service processing amount of the current batch of the subsystem.
3. The global integration system supporting a global integration scenario according to claim 2, wherein after the subsystem calculates the traffic, the same traffic request as the traffic is scheduled from the task queue corresponding to the subsystem, and the settlement period is used as the scheduling period of the task queue.
4. A global integration system supporting a widely integrated scenario as defined in claim 3, wherein after said subsystem processes a service request scheduled by a previous batch of said task queue, a settling period is updated, said updated settling period being equal to a time taken by said subsystem to process the service request of the previous batch, and said updated settling period is taken as a scheduling period of a next batch of the task queue.
CN202311023911.1A 2023-08-15 2023-08-15 Global integration system supporting wide integration scene Active CN116775255B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311023911.1A CN116775255B (en) 2023-08-15 2023-08-15 Global integration system supporting wide integration scene

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311023911.1A CN116775255B (en) 2023-08-15 2023-08-15 Global integration system supporting wide integration scene

Publications (2)

Publication Number Publication Date
CN116775255A CN116775255A (en) 2023-09-19
CN116775255B true CN116775255B (en) 2023-11-21

Family

ID=88011827

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311023911.1A Active CN116775255B (en) 2023-08-15 2023-08-15 Global integration system supporting wide integration scene

Country Status (1)

Country Link
CN (1) CN116775255B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090028670A (en) * 2007-09-15 2009-03-19 주식회사 케이티프리텔 Integrated operation support system
WO2017074320A1 (en) * 2015-10-27 2017-05-04 Hewlett Packard Enterprise Development Lp Service scaling for batch processing
CN107844365A (en) * 2016-09-18 2018-03-27 广东工业大学 A kind of dispatching method for intelligent family monitoring system
CN108255670A (en) * 2016-12-29 2018-07-06 布尔简易股份公司 The monitoring of the resource of Basis of Computer Engineering facility and assigned unit and method
CN110297711A (en) * 2019-05-16 2019-10-01 平安科技(深圳)有限公司 Batch data processing method, device, computer equipment and storage medium
CN112596885A (en) * 2020-12-25 2021-04-02 网易(杭州)网络有限公司 Task scheduling method, device, equipment and storage medium
CN113672391A (en) * 2021-08-23 2021-11-19 烽火通信科技股份有限公司 Parallel computing task scheduling method and system based on Kubernetes
CN114051055A (en) * 2022-01-12 2022-02-15 江苏银承网络科技股份有限公司 Data transmission method and device in different systems
CN114518934A (en) * 2021-12-31 2022-05-20 安徽海豚新媒体产业发展有限公司 Unified operation and maintenance platform architecture system
CN115442373A (en) * 2022-09-29 2022-12-06 建信金融科技有限责任公司 Data processing method, device, equipment and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102566527B (en) * 2010-12-30 2015-06-10 中国科学院沈阳自动化研究所 Method for realizing transmission control platformization of semiconductor manufacturing equipment front end module
RU2538920C2 (en) * 2013-05-06 2015-01-10 Общество с ограниченной ответственностью "Аби ИнфоПоиск" Method for task distribution by computer system server, computer-readable data medium and system for implementing said method
US20150067028A1 (en) * 2013-08-30 2015-03-05 Indian Space Research Organisation Message driven method and system for optimal management of dynamic production workflows in a distributed environment
US10983836B2 (en) * 2018-08-13 2021-04-20 International Business Machines Corporation Transaction optimization during periods of peak activity

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090028670A (en) * 2007-09-15 2009-03-19 주식회사 케이티프리텔 Integrated operation support system
WO2017074320A1 (en) * 2015-10-27 2017-05-04 Hewlett Packard Enterprise Development Lp Service scaling for batch processing
CN107844365A (en) * 2016-09-18 2018-03-27 广东工业大学 A kind of dispatching method for intelligent family monitoring system
CN108255670A (en) * 2016-12-29 2018-07-06 布尔简易股份公司 The monitoring of the resource of Basis of Computer Engineering facility and assigned unit and method
CN110297711A (en) * 2019-05-16 2019-10-01 平安科技(深圳)有限公司 Batch data processing method, device, computer equipment and storage medium
CN112596885A (en) * 2020-12-25 2021-04-02 网易(杭州)网络有限公司 Task scheduling method, device, equipment and storage medium
CN113672391A (en) * 2021-08-23 2021-11-19 烽火通信科技股份有限公司 Parallel computing task scheduling method and system based on Kubernetes
CN114518934A (en) * 2021-12-31 2022-05-20 安徽海豚新媒体产业发展有限公司 Unified operation and maintenance platform architecture system
CN114051055A (en) * 2022-01-12 2022-02-15 江苏银承网络科技股份有限公司 Data transmission method and device in different systems
CN115442373A (en) * 2022-09-29 2022-12-06 建信金融科技有限责任公司 Data processing method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN116775255A (en) 2023-09-19

Similar Documents

Publication Publication Date Title
CN109542457B (en) Distributed application distribution and deployment system and method for edge computing network
US11321139B2 (en) Streaming traffic pattern for public cloud auto scaling
US10904303B2 (en) Control message from streaming source to facilitate scaling
US20100138540A1 (en) Method of managing organization of a computer system, computer system, and program for managing organization
US20120117242A1 (en) Service linkage system and information processing system
CN110677462B (en) Access processing method, system, device and storage medium for multi-block chain network
CN110601994B (en) Load balancing method for micro-service chain perception in cloud environment
CN109879126B (en) Elevator reservation method and system
JP2014035717A (en) Load distribution method taking account of node of each rank of multi-rank
WO2021254331A1 (en) Resource management method and system, proxy server, and storage medium
CN103873534A (en) Method and device for application cluster migration
CN110413845B (en) Resource storage method and device based on Internet of things operating system
CN109155939A (en) A kind of load migration method, apparatus and system
CN110855739B (en) Container technology-based remote and heterogeneous resource unified management method and system
CN104750544A (en) Process management system and process management method applied to distributed system
CN104660689A (en) Distributed computing system
Zheng et al. Task scheduling using edge computing system in smart city
CN113132456A (en) Edge cloud cooperative task scheduling method and system based on deadline perception
CN113794652A (en) Data processing method and device, electronic equipment and storage medium
CN116775255B (en) Global integration system supporting wide integration scene
CN103186536A (en) Method and system for scheduling data shearing devices
CN108259605B (en) Data calling system and method based on multiple data centers
CN113765825A (en) Planning method and system architecture for chain type service flow scheduling
CN110971533A (en) Method, server apparatus, client apparatus, and medium for data communication
CN111913784B (en) Task scheduling method and device, network element and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant