CN113360307A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN113360307A CN113360307A CN202110601486.4A CN202110601486A CN113360307A CN 113360307 A CN113360307 A CN 113360307A CN 202110601486 A CN202110601486 A CN 202110601486A CN 113360307 A CN113360307 A CN 113360307A
- Authority
- CN
- China
- Prior art keywords
- target
- cloud server
- data request
- idle
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
- G06F11/0709—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/079—Root cause analysis, i.e. error or fault diagnosis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0793—Remedial or corrective actions
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Computer Hardware Design (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention provides a data processing method and a device, wherein the method comprises the following steps: when an abnormal event of a target cloud server is detected, storing a target data request to be sent to the target cloud server into a cache region; then determining a target service type corresponding to the target cloud server; searching out a target idle cloud server from the idle cloud server cluster according to the target service type; and sending the target data request in the cache region to a target idle cloud server. According to the embodiment of the invention, when the target cloud server is abnormal, the data request to be sent to the target cloud server is automatically forwarded to the idle cloud server for processing, and the problem that the cooperative component system cannot normally provide service for a user because the target cloud server is abnormal is avoided.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data processing method and apparatus.
Background
With the continuous development of internet technology, services provided by the internet are more and more.
When a user needs to use a certain service, a data request can be sent to a cloud server corresponding to the service through the mobile terminal so as to request the cloud server to provide the corresponding service.
When the cloud server is in a normal state, the data request can be processed normally; however, when the cloud server is abnormal and is in an abnormal state, the data request may not be processed. At this time, if the abnormal cloud server is maintained, the data request sent to the cloud server is processed, which will seriously affect the use of the user. Therefore, how to normally and rapidly process the data request to be sent to the abnormal cloud server is an urgent problem to be solved in the data processing process of the cloud server.
Disclosure of Invention
In view of the above, it is proposed to provide a data processing method and apparatus that overcomes or at least partially solves the above mentioned problems, comprising:
a data processing method is applied to a cooperative component system, the cooperative component system provides unified external services for a plurality of butted service systems, the cooperative component system comprises an idle cloud server cluster, and the method comprises the following steps:
when the target cloud server is detected to have an abnormal event, storing a target data request to be sent to the target cloud server into a cache region;
determining a target service type corresponding to a target cloud server;
searching out a target idle cloud server from the idle cloud server cluster according to the target service type;
and sending the target data request in the cache region to a target idle cloud server.
Optionally, the method further comprises:
and when detecting that no abnormal event occurs in the preset time period of the target cloud server, stopping sending the data request to the target idle cloud server.
Optionally, the method further comprises:
judging whether an uncompleted data request exists in a target idle cloud server or not;
and when the uncompleted data request does not exist in the target idle cloud server, placing the target idle cloud server into the idle cloud server cluster.
Optionally, before sending the target data request in the cache region to the target idle cloud server, the method further includes:
determining the waiting time of a target data request in a cache region;
and when the waiting time length exceeds the preset time length, sending the target data request to the target idle cloud server.
Optionally, before sending the target data request in the cache region to the target idle cloud server, the method further includes:
determining a target service level of the target data request;
and when the target service level exceeds a preset level, sending the target data request to a target idle cloud server.
Optionally, determining a target service level of the target data request includes:
determining a target service provided by a target cloud server;
and acquiring the grade preset for the target service, and taking the grade preset for the target service as the target service grade of the target data request.
Optionally, the exception event comprises:
overload events, intrusion events.
A data processing device is applied to a cooperative component system, the cooperative component system provides unified external services for a plurality of butted service systems, the cooperative component system comprises an idle cloud server cluster, and the device comprises:
the data request caching module is used for storing a target data request to be sent to the target cloud server into a caching area when the target cloud server is detected to have an abnormal event;
the service type determining module is used for determining a target service type corresponding to the target cloud server;
the idle cloud server determining module is used for searching a target idle cloud server bound with the target cloud server from the idle cloud server cluster according to the target service type;
and the data request sending module is used for sending the target data request in the cache region to the target idle cloud server.
A server comprising a processor, a memory and a computer program stored on the memory and capable of running on the processor, the computer program when executed by the processor implementing a data processing method as above.
A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the data processing method as above.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, when an abnormal event of a target cloud server is detected, a target data request to be sent to the target cloud server is stored in a cache region; then determining a target service type corresponding to the target cloud server; searching out a target idle cloud server from the idle cloud server cluster according to the target service type; and sending the target data request in the cache region to a target idle cloud server. According to the embodiment of the invention, when the target cloud server is abnormal, the data request to be sent to the target cloud server is automatically forwarded to the idle cloud server for processing, and the problem that the cooperative component system cannot normally provide service for a user because the target cloud server is abnormal is avoided.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the description of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a block diagram of an overall architecture of a collaboration system, in accordance with an embodiment of the present invention;
FIG. 2 is a flow chart of the steps of a data processing method of an embodiment of the present invention;
FIG. 3 is a flow chart of steps of another data processing method of an embodiment of the present invention;
FIG. 4 is a flow chart of steps of yet another data processing method of an embodiment of the present invention;
fig. 5 is a block diagram of a data processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The service object is served to other persons and enterprises as one of the original motive power of product design, and the demand and feeling of the service object are focused. The cooperative component system integrates government affairs service, public service and convenient service resources comprehensively around the civil fields of immigration, residence, trip, learning, employment, entrepreneurship, medical treatment, endowment and the like, optimizes service application, and helps non-local individuals and enterprises to know the local, know the local and integrate into the local and local of life.
The cooperative component system is an open application framework platform and provides support capability for service intensive access and management. The system supports integration of various business applications and information resources on a unified management platform, provides a unified user interface for users, establishes service hubs of service operators, service providers and service users, enables governments to rapidly and widely release information and provides services; the enterprise and the person at other places can know the information and use the service in time; the third party of the society can develop and utilize information resources through a public service tool, and urban information and service can be operated, maintained and managed in a centralized way.
The collaborative component system fully utilizes the leading technical capabilities in the industries such as big data, voice recognition, natural language processing, man-machine interaction and the like to construct an intelligent service system integrating intelligent prompt, intelligent question answering, intelligent recommendation and the like; according to the behavior footprint of the user, the habits and the potential requirements of the user are analyzed, services such as accurate pushing, personalized resource subscription and the like are provided, the user is supported to establish a personalized intelligent home page, the 'thousands of people and thousands of faces' of mobile service is realized, and equal, quick, personalized and all-round services and experiences are provided for enterprises and individuals in other places.
Referring to fig. 1, the collaborative component system service architecture is divided into a presentation layer, a service application layer, a support layer, a data layer and a base layer.
1. Revealing layer
The display layer is a layer directly facing to a user and is divided into the following layers according to requirements: collaborative component system (IOS), collaborative component system (Android), collaborative component system (Web console) and H5 applications; the Android and IOS have the same function and are suitable for different platforms; the Web control console provides management functions for administrator users, including user management, service management, consultation management, operation management and the like; the H5 application is a third-party service for integrating in the collaborative component system and providing the user with the function of one application program for multiple services.
2. Business application layer
The business application layer is the central pivot of the whole system, provides all business services, controls the operation of the whole system, and embodies all the capabilities provided by the product; according to the design concept of the micro-service, the layer divides the system into a plurality of micro-service modules according to different provided capabilities, wherein the micro-service modules comprise My module, voice team module, service policy, consultation service, intelligent search, home page, user center, operation management, application integration and the like, and each module operates independently, so that the high availability of the whole service is ensured, and the fine management of the system is realized.
3. Supporting layer
The supporting layer extracts partial capacity of the system and peels off the partial capacity from specific services to realize the independence of the capacity; therefore, the stable operation of the capacity can be ensured, and the multiplexing of the capacity can be realized.
4. Data layer
The data layer provides data storage of the whole system, stores data generated in the running process of the system, realizes data circulation and persistence, and is the value of the whole system.
5. Base layer
The basic layer is a physical layer, which is a physical embodiment of the capabilities of the above layers, provides the running environment, the storage environment, the network environment, the security environment and the like of the system, and is the basis for the normal running of the system.
Referring to fig. 2, a flowchart illustrating steps of a data processing method according to an embodiment of the present invention is shown, where the data processing method is applied to a collaborative component system, the collaborative component system provides a unified external service for a plurality of service systems that are docked, and the collaborative component system includes an idle cloud server cluster;
specifically, the method may include the steps of:
as an example, the exception event may include: overload events and/or intrusion events, of course, may also include abnormal events of other cloud servers. An overload event may refer to the number of data requests processed on a cloud server exceeding the maximum throughput of the cloud server; the intrusion event may be a malicious intrusion of the cloud server.
In order to avoid that the cloud server cannot provide services to the user due to an abnormal event in the cooperative component system, an idle cloud server cluster may be deployed in the cooperative component in advance, and a plurality of idle cloud servers for different services may be deployed in the idle cloud server cluster. The idle cloud server may be completely idle, that is, the idle cloud server does not process any data request before being enabled; or may be partially idle, that is, the idle cloud server is already processing a small amount of data requests before being enabled, which is not limited in the embodiment of the present invention.
In order to ensure that data requests of the collaborative component system can be processed normally and rapidly, a cloud server for providing services in the collaborative component system may be monitored.
When an overload event and/or an intrusion event of a certain cloud server is detected, the cloud server with the abnormal event can be used as a target cloud server. Then, intercepting a target data request to be sent to a target cloud server with an abnormal event, and storing the intercepted target data request into a cache region; the cache region may refer to a storage region in the collaborative component system, and is specially used for temporarily storing data requests that cannot be sent to the cloud server in time.
the target service type may be set for a service provided by the target cloud server.
The services provided by different cloud servers are also different. When an abnormal event occurs in the target cloud server, the service provided by the target cloud server may be determined first, and then the target server type of the service provided by the target cloud server may be determined, for example: if the target cloud server is used to provide the inbound service, it may be determined that the target service type corresponding to the target cloud server is the inbound service type, which is not limited in this embodiment of the present invention.
after the target service type is determined, according to the target service type, an idle cloud server which can provide the service of the same target service type is determined from the idle server cluster and is used as the target idle cloud server.
And step 204, sending the target data request in the cache region to a target idle cloud server.
The target idle cloud server can provide the same service as the target cloud server, so that a target data request which is stored in the cache region and is to be sent to the target cloud server can be sent to the target idle cloud server for processing when the target cloud server generates an abnormal event; therefore, even if the cloud server is abnormal, the idle cloud server can be called in time to take over the abnormal cloud server to continue providing the corresponding service.
In the embodiment of the invention, when an abnormal event of a target cloud server is detected, a target data request to be sent to the target cloud server is stored in a cache region; then determining a target service type corresponding to the target cloud server; searching out a target idle cloud server from the idle cloud server cluster according to the target service type; and sending the target data request in the cache region to a target idle cloud server. According to the embodiment of the invention, when the target cloud server is abnormal, the data request to be sent to the target cloud server is automatically forwarded to the idle cloud server for processing, and the problem that the cooperative component system cannot normally provide service for a user because the target cloud server is abnormal is avoided.
Referring to fig. 3, a flowchart illustrating steps of another data processing method according to an embodiment of the present invention is shown, which may specifically include the following steps:
when an overload event and/or an intrusion event of a certain cloud server is detected, the cloud server with the abnormal event can be used as a target cloud server. And then, intercepting a target data request to be sent to a target cloud server with an abnormal event, and storing the intercepted target data request in a cache region.
when an abnormal event occurs in the target cloud server, the service provided by the target cloud server may be determined first, and then the target server type of the service provided by the target cloud server may be determined.
after the target service type is determined, according to the target service type, an idle cloud server which can provide the service of the same target service type is determined from the idle server cluster and is used as the target idle cloud server.
when more data requests are requested or the determined target idle cloud server has limited processing capacity, resulting in more data requests being accumulated in the buffer area, a portion of the data requests may be left unprocessed for a long time. To avoid this, timing may be started when the target data request is stored in the buffer; and then, calculating the waiting time after the target data is stored in the cache region so as to avoid that the target data request is not processed in the cache region for a long time and the experience of a user using the collaborative component system is influenced.
when the waiting time of the target data request in the cache region is detected to exceed the preset time length, the target data request can be stored in the cache region for a long time and is not processed all the time; at this time, in order to avoid influencing the use experience of the user, the target data request with the waiting time length exceeding the preset time length may be sent to the target idle cloud server for processing.
In an embodiment of the present invention, the method may further include the following steps:
after the data request is sent to the target idle cloud server, the operation of the target cloud server can be stopped, and the target cloud server is maintained and repaired; when the abnormal event occurred by the target cloud server is successfully processed and the target cloud server can recover to normal operation, the subsequent data request can be sent to the target cloud server again for processing.
As an example, the status of the target cloud server may be detected when a data request is started to be sent to the target idle cloud server; when it is detected that the target cloud server no longer has the abnormal event within the preset time period, it may be identified that the target cloud server has recovered to be normal, and the data request may continue to be processed normally. At this time, sending of the data request to the target idle cloud server may be stopped, and a subsequent data request may be sent to the target cloud server for processing.
As another example, when it is detected that there is still an abnormal event in the target cloud server, the data request may continue to be sent to the target idle cloud server for processing, which is not limited in this embodiment of the present invention.
When the target cloud server is recovered to be normal, the target idle cloud server can be returned to the idle cloud server cluster for use when the target cloud server is abnormal again. However, if there are data requests being processed in the target idle cloud server, the target idle cloud server needs to be returned to the idle cloud server cluster after all the data requests being processed are processed.
As an example, it may be detected whether there are outstanding data requests in the target idle cloud server. If the uncompleted data request exists, the target idle cloud server can be returned to the idle cloud server cluster after the target idle cloud server is processed. If it is detected that an uncompleted data request does not exist in the target cloud server, the target idle cloud server may be directly returned to the idle cloud server cluster, which is not limited in the embodiment of the present invention.
In the embodiment of the invention, when an abnormal event of a target cloud server is detected, a target data request to be sent to the target cloud server is stored in a cache region; determining a target service type corresponding to the target cloud server, and finding out the target idle cloud server bound with the target cloud server from the idle cloud server cluster according to the target service type; then determining the waiting time of the target data request in the cache region; when the waiting time exceeds the preset time, sending a target data request to a target idle cloud server; when the abnormal event is detected not to occur in the preset time period of the target cloud server, stopping sending a data request to the target idle cloud server; judging whether an uncompleted data request exists in a target idle cloud server or not; and when the uncompleted data request does not exist in the target idle cloud server, placing the target idle cloud server into the idle cloud server cluster. According to the embodiment of the invention, when the target cloud server is abnormal, whether the data request needs to be immediately forwarded to the idle cloud server or not is judged according to the waiting time of the data request stored in the cache region, so that the influence on user experience caused by the fact that the data request is not processed for a long time is avoided.
And when the target cloud server is no longer abnormal, returning the idle cloud server without the unfinished data request to the idle cloud server cluster, so that when the subsequent target cloud server is abnormal again, the idle cloud server can be called again to take over the target cloud server to provide service for the user.
Referring to fig. 4, a flowchart illustrating steps of another data processing method according to an embodiment of the present invention is shown, which may specifically include the following steps:
when an overload event and/or an intrusion event of a certain cloud server is detected, the cloud server with the abnormal event can be used as a target cloud server. And then, intercepting a target data request to be sent to a target cloud server with an abnormal event, and storing the intercepted target data request in a cache region.
when an abnormal event occurs in the target cloud server, the service provided by the target cloud server may be determined first, and then the target server type of the service provided by the target cloud server may be determined.
after the target service type is determined, according to the target service type, an idle cloud server which can provide the service of the same target service type is determined from the idle server cluster and is used as the target idle cloud server.
the target service level may represent an aging requirement of a service corresponding to the target data request, for example: a data request with a higher target service level can indicate that the timeliness requirement of the corresponding service is higher and needs to be processed as soon as possible; and the data request with a lower target service level can indicate that the time efficiency requirement of the corresponding service is lower, and the processing can be suspended.
Some services are important and some services are common among the services provided by the collaborative component system. The service grades corresponding to different services are different, and correspondingly, the time-efficiency requirements of different services are also different; the required aging of the more important services is also higher. Therefore, the target service level of the target data request can be determined first, so that whether the target data request needs to be sent to the target idle cloud server immediately is judged according to the aging requirement represented by the target service level.
In an embodiment of the present invention, the target service level may be determined by:
determining a target service provided by a target cloud server; and acquiring the grade preset for the target service, and taking the grade preset for the target service as the target service grade of the target data request.
As an example, corresponding service levels may be set in advance for all services in the collaborative component system.
When determining the target service level of the target data request, determining a target service provided by a target cloud server; and then determining a service level which is set for the target service in advance according to the determined target service. After the service level set for the target service is obtained, the service level may be used as a target service level corresponding to the target data request, which is not limited in this embodiment of the present invention.
And 405, when the target service level exceeds a preset level, sending a target data request to a target idle cloud server.
When the target service level is detected to exceed the preset level, the service requested by the target data request can be represented as a service with higher timeliness and needs to be processed as soon as possible; at this time, the target data request in the cache region may be preferentially sent to the target idle cloud server for processing.
In an example, if it is detected that the target service level is lower than the preset level, the target data request may be continuously stored in the cache region, and the target data request is sequentially sent to the target idle cloud servers for processing according to the sequence in the cache region.
In the embodiment of the invention, when an abnormal event of a target cloud server is detected, a target data request to be sent to the target cloud server is stored in a cache region; determining a target service type corresponding to the target cloud server, and finding out the target idle cloud server bound with the target cloud server from the idle cloud server cluster according to the target service type; then determining a target service level of the target data request; and when the target service level exceeds a preset level, sending the target data request to a target idle cloud server. According to the embodiment of the invention, when the target cloud server is abnormal, the data request to be sent to the target cloud server is automatically forwarded to the idle cloud server for processing, and the problem that the cooperative component system cannot normally provide service for a user because the target cloud server is abnormal is avoided.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 5, a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention is shown, and is applied to a cooperative component system, where the cooperative component system provides a unified external service for a plurality of service systems that are docked, and the cooperative component system includes an idle cloud server cluster;
specifically, the following modules may be included:
the data request caching module 501 is configured to, when it is detected that an abnormal event occurs in the target cloud server, store a target data request to be sent to the target cloud server into a cache region;
a service type determining module 502, configured to determine a target service type corresponding to a target cloud server;
the idle cloud server determining module 503 is configured to find a target idle cloud server bound with the target cloud server from the idle cloud server cluster according to the target service type;
a data request sending module 504, configured to send the target data request in the cache region to the target idle cloud server.
In one embodiment of the invention, the apparatus further comprises:
the stopping module is used for stopping sending the data request to the target idle cloud server when detecting that no abnormal event occurs in the preset time period of the target cloud server.
In one embodiment of the invention, the apparatus further comprises:
the idle cloud server returning module is used for judging whether an uncompleted data request exists in the target idle cloud server; and when the uncompleted data request does not exist in the target idle cloud server, placing the target idle cloud server into the idle cloud server cluster.
In one embodiment of the invention, the apparatus further comprises:
the waiting duration sending module is used for determining the waiting duration of the target data request in the cache region before sending the target data request in the cache region to the target idle cloud server; and when the waiting time length exceeds the preset time length, sending the target data request to the target idle cloud server.
In one embodiment of the invention, the apparatus further comprises:
the system comprises a per-level sending module, a target data storage module and a target idle cloud server, wherein the per-level sending module is used for determining a target service level of a target data request before sending the target data request in a cache region to the target idle cloud server; and when the target service level exceeds a preset level, sending the target data request to a target idle cloud server.
In one embodiment of the present invention, the module for sending by rank comprises:
the service determination submodule is used for determining a target service provided by the target cloud server;
and the grade determining submodule is used for acquiring the grade preset for the target service and taking the grade preset for the target service as the target service grade of the target data request.
In one embodiment of the invention, the exception events include:
overload events, intrusion events.
In the embodiment of the invention, when an abnormal event of a target cloud server is detected, a target data request to be sent to the target cloud server is stored in a cache region; then determining a target service type corresponding to the target cloud server; searching out a target idle cloud server from the idle cloud server cluster according to the target service type; and sending the target data request in the cache region to a target idle cloud server. According to the embodiment of the invention, the data request to be sent to the abnormal cloud server is processed normally and rapidly, and even if the cloud server in the cooperative component system is abnormal, the idle cloud server can be called to replace the abnormal cloud server to continue providing the corresponding service, so that the cooperative component system can always provide the service normally.
The embodiment of the invention also provides a server, which may include a processor, a memory and a computer program stored on the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the data processing method is implemented.
The embodiment of the invention also provides a computer readable storage medium, a computer program is stored on the computer readable storage medium, and the computer program is executed by a processor to realize the data processing method.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The data processing method and apparatus provided above are introduced in detail, and a specific example is applied in this document to illustrate the principle and the implementation of the present invention, and the above description of the embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A data processing method is applied to a cooperative component system, the cooperative component system provides unified external services for a plurality of service systems which are in butt joint, the cooperative component system comprises an idle cloud server cluster, and the method comprises the following steps:
when an abnormal event of a target cloud server is detected, storing a target data request to be sent to the target cloud server into a cache region;
determining a target service type corresponding to the target cloud server;
searching out a target idle cloud server from the idle cloud server cluster according to the target service type;
and sending the target data request in the cache region to the target idle cloud server.
2. The method of claim 1, further comprising:
and when the abnormal event is detected not to occur in the preset time period of the target cloud server, stopping sending a data request to the target idle cloud server.
3. The method of claim 2, further comprising:
judging whether an uncompleted data request exists in the target idle cloud server or not;
when the uncompleted data request does not exist in the target idle cloud server, placing the target idle cloud server into an idle cloud server cluster.
4. The method of claim 1, wherein before sending the target data request in the cache to the target idle cloud server, the method further comprises:
determining the waiting time of the target data request in the cache region;
and when the waiting time length exceeds a preset time length, sending the target data request to the target idle cloud server.
5. The method of claim 1, wherein before sending the target data request in the cache to the target idle cloud server, the method further comprises:
determining a target service level of the target data request;
and when the target service level exceeds a preset level, sending the target data request to the target idle cloud server.
6. The method of claim 5, wherein determining the target service level for the target data request comprises:
determining a target service provided by the target cloud server;
and acquiring the grade preset for the target service, and taking the grade preset for the target service as the target service grade of the target data request.
7. The method of claim 1, wherein the exception event comprises:
overload events, intrusion events.
8. A data processing apparatus, applied to a collaborative component system, where the collaborative component system provides a unified external service for a plurality of service systems that are docked, and the collaborative component system includes an idle cloud server cluster, the apparatus includes:
the data request caching module is used for storing a target data request to be sent to a target cloud server into a caching area when an abnormal event of the target cloud server is detected;
the service type determining module is used for determining a target service type corresponding to the target cloud server;
the idle cloud server determining module is used for searching a target idle cloud server bound with the target cloud server from the idle cloud server cluster according to the target service type;
and the data request sending module is used for sending the target data request in the cache region to the target idle cloud server.
9. A server, characterized by comprising a processor, a memory and a computer program stored on the memory and capable of running on the processor, the computer program, when executed by the processor, implementing the data processing method of any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the data processing method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110601486.4A CN113360307B (en) | 2021-05-31 | 2021-05-31 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110601486.4A CN113360307B (en) | 2021-05-31 | 2021-05-31 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113360307A true CN113360307A (en) | 2021-09-07 |
| CN113360307B CN113360307B (en) | 2022-09-20 |
Family
ID=77530499
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110601486.4A Active CN113360307B (en) | 2021-05-31 | 2021-05-31 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113360307B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115022327A (en) * | 2022-06-21 | 2022-09-06 | 深圳一粒云科技有限公司 | Control method and device of cloud server and computer readable storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201497981U (en) * | 2009-04-30 | 2010-06-02 | 升东网络科技发展(上海)有限公司 | Database failure automatic detecting and shifting system |
| US20110320884A1 (en) * | 2010-06-29 | 2011-12-29 | Oracle International Corporation | Request based logging |
| US20150193289A1 (en) * | 2014-01-06 | 2015-07-09 | International Business Machines Corporation | Efficient data system error recovery |
| CN108390908A (en) * | 2018-01-10 | 2018-08-10 | 努比亚技术有限公司 | A kind of data request processing method, apparatus and computer readable storage medium |
| CN110275901A (en) * | 2019-06-25 | 2019-09-24 | 北京创鑫旅程网络技术有限公司 | One kind is data cached to transfer method and device |
| CN110347467A (en) * | 2019-07-08 | 2019-10-18 | 北京字节跳动网络技术有限公司 | A kind of data request processing method, apparatus, terminal device and storage medium |
| CN112256498A (en) * | 2020-11-17 | 2021-01-22 | 珠海大横琴科技发展有限公司 | Fault processing method and device |
| CN112291367A (en) * | 2020-11-17 | 2021-01-29 | 珠海大横琴科技发展有限公司 | Data processing method and device |
-
2021
- 2021-05-31 CN CN202110601486.4A patent/CN113360307B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201497981U (en) * | 2009-04-30 | 2010-06-02 | 升东网络科技发展(上海)有限公司 | Database failure automatic detecting and shifting system |
| US20110320884A1 (en) * | 2010-06-29 | 2011-12-29 | Oracle International Corporation | Request based logging |
| US20150193289A1 (en) * | 2014-01-06 | 2015-07-09 | International Business Machines Corporation | Efficient data system error recovery |
| CN108390908A (en) * | 2018-01-10 | 2018-08-10 | 努比亚技术有限公司 | A kind of data request processing method, apparatus and computer readable storage medium |
| CN110275901A (en) * | 2019-06-25 | 2019-09-24 | 北京创鑫旅程网络技术有限公司 | One kind is data cached to transfer method and device |
| CN110347467A (en) * | 2019-07-08 | 2019-10-18 | 北京字节跳动网络技术有限公司 | A kind of data request processing method, apparatus, terminal device and storage medium |
| CN112256498A (en) * | 2020-11-17 | 2021-01-22 | 珠海大横琴科技发展有限公司 | Fault processing method and device |
| CN112291367A (en) * | 2020-11-17 | 2021-01-29 | 珠海大横琴科技发展有限公司 | Data processing method and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115022327A (en) * | 2022-06-21 | 2022-09-06 | 深圳一粒云科技有限公司 | Control method and device of cloud server and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113360307B (en) | 2022-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI473029B (en) | Extensible and programmable multi-tenant service architecture | |
| JP2019032903A (en) | Systems, methods and computer-readable storage media for customizable event-triggered computation at edge locations | |
| US8295468B2 (en) | Optimized method to select and retrieve a contact center transaction from a set of transactions stored in a queuing mechanism | |
| US10178603B2 (en) | Pausing functions of an assistant device during an active telephone call | |
| CN113360308A (en) | Abnormal event processing method and device | |
| US9813496B2 (en) | Method and apparatus for collaborating in a work environment | |
| US11811780B2 (en) | Behavior-based authentication | |
| US10743168B1 (en) | Call prioritization for reducing network congestion | |
| US11159607B2 (en) | Management for a load balancer cluster | |
| CN113468552B (en) | Data processing method and device | |
| CN113360307B (en) | Data processing method and device | |
| US9203897B1 (en) | Systems and methods for a social network for roadside assistance | |
| CN110708309A (en) | Anti-crawler system and method | |
| CN111158654A (en) | Algorithm calling method, device, server and storage medium | |
| US10176059B2 (en) | Managing server processes with proxy files | |
| CN113469842A (en) | System operation and maintenance method and device | |
| CN113467668A (en) | Data processing method and device | |
| US20160308750A1 (en) | Identifying end users in need of technical assistance | |
| CN113467966B (en) | Data processing method and device | |
| CN113536108A (en) | Information recommendation method and device | |
| CN113672799A (en) | Service recommendation method and device | |
| CN113360166A (en) | Data processing method and device | |
| CN112286593A (en) | Service calling method and device | |
| CN113468412A (en) | Searching method and device | |
| CN113691578A (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |