CN112134955B - Data processing system, data processing method, data processing device, and storage medium - Google Patents
Data processing system, data processing method, data processing device, and storage medium Download PDFInfo
- Publication number
- CN112134955B CN112134955B CN202011009277.2A CN202011009277A CN112134955B CN 112134955 B CN112134955 B CN 112134955B CN 202011009277 A CN202011009277 A CN 202011009277A CN 112134955 B CN112134955 B CN 112134955B
- Authority
- CN
- China
- Prior art keywords
- data processing
- data
- server
- task
- target client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 334
- 238000003672 processing method Methods 0.000 title claims description 8
- 230000006870 function Effects 0.000 claims abstract description 54
- 238000000034 method Methods 0.000 claims description 25
- 230000015572 biosynthetic process Effects 0.000 claims description 16
- 238000003786 synthesis reaction Methods 0.000 claims description 16
- 230000001960 triggered effect Effects 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 7
- 238000005516 engineering process Methods 0.000 claims description 2
- 238000004891 communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000003993 interaction Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000002035 prolonged effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/63—Routing a service request depending on the request content or context
Abstract
The data processing system comprises the first router, the first server and the data processing platform, wherein the first server is arranged outside the data processing platform for the first data processing task of the client in the first region range, so that the processing party of the first data processing task can be selected by pre-configuring the routing rule of the first router. When the first server is used for executing the first data processing task, compared with a data processing platform with more functions, the time delay for completing the first data processing task is reduced. In addition, for one data processing platform corresponding to the existing multiple clients, a first server is arranged outside the data processing platform and is used for executing a first data processing task for the clients registered in the first region range, so that the deployment place of the first server can be set according to region limitation, and the problem that data cannot be processed due to region limitation is solved.
Description
Technical Field
The present disclosure relates to the field of information processing technologies, and in particular, to a data processing system, a data processing method, a data processing device, and a storage medium.
Background
Data processing under client and server architecture typically triggers tasks by clients and performs tasks by servers. Taking video processing APP and a video-on-demand cloud platform as examples, video synthesis is a function of the video APP, and besides, the video APP also has other functions such as video and images uploaded by a cloud storage user. In general, the processing and calculation related to the functions are completed by the point broadcasting cradle head, and the point broadcasting cradle head interacts with the video APP to realize the functions.
Because the functions of the point broadcasting cloud platform are more, the computing capacity and the occupation of resources are saturated in general, and therefore, the problem of long delay of video synthesis exists. In addition, in the case where the region where the registered user of the APP is located has a limitation on the data flow direction, the data may not be able to be transmitted to the spot cloud center, and thus, the service required by the user may not be provided. For example, some countries do not allow domestic data to flow out of the national border, and APP cannot provide services if the spot cloud deck is not within the national border.
Therefore, the current data processing mode under the client and server architecture is limited by the resource and region limitation of the server, and has the problems of prolonged processing time and incapability of processing data.
Disclosure of Invention
The present disclosure provides a data processing system, a method, a device, and a storage medium, so as to at least solve the problems of time delay of data processing and failure to process data under a client and server architecture. The technical scheme of the present disclosure is as follows:
according to a first aspect of embodiments of the present disclosure, there is provided a data processing system, comprising:
the system comprises a first router, a first server and a data processing platform;
the first server is used for executing a first data processing task of a target client, and the target client is a client registered in a first regional range;
the data processing platform is used for executing data processing tasks of a client, the client comprises the target client, and the data processing tasks comprise the first data processing task and other data processing tasks;
the first router is used for sending the data processing task to the first server or the data processing platform according to a preset routing rule after the data processing task triggered by the target client is acquired.
Optionally, the first data processing task of the first server is determined according to a service preference of the target client, where the service preference is obtained by counting the number of service types of the historical data processing task sent by the target client.
Optionally, the routing rule includes: and sending the data processing task to the first server under the condition that the data processing task is the first data processing task.
Optionally, the routing rule further includes: the data processing task cannot be sent outside the first geographical range.
Optionally, the data processing platform executes the first data processing task by calling a preset first data processing module;
and the first server executes the first data processing task by starting a first data processing process preset in the first server.
Optionally, the method further comprises:
a first memory and a second memory;
the first memory is used for storing the data of the target client and synchronizing the data of the target client to the data processing platform by using a mirror technique under the condition that the first router sends the data processing task to the data processing platform;
the second memory is used for storing data of the client, which is required by the data processing platform to execute the data processing task.
Optionally, the method further comprises:
the first cloud storage server and the second cloud storage server;
the first cloud storage server is used for storing result data of the first data processing function executed by the first server;
the second cloud storage server is used for storing result data of the data processing platform executing the data processing function.
Optionally, the data processing platform is further configured to: after the execution of the data processing task is finished, a task completion notification is sent to the first server;
the second cloud storage server is further configured to:
and sending the result data of the data processing task of the target client to the first cloud storage server by the data processing platform.
Optionally, the link used by the second cloud storage server to send the result data of the data processing platform to the first cloud storage server is different from the link used by the first router to send the data processing task to the data processing platform.
Optionally, the method further comprises:
and the second router is used for sending the data processing task sent to the data processing platform to a server corresponding to the type according to the type of the data processing task under the condition that the data processing platform fails or is maintained, and the server at least comprises the first server.
According to a second aspect of the embodiments of the present disclosure, there is provided a data processing method, including:
after acquiring a data processing task triggered by a target client, a first router sends the data processing task to a first server or a data processing platform according to a pre-configured routing rule; the target client is a client registered in a first regional range;
the first server or the data processing platform is used for executing data processing tasks of a client, the client comprises the target client, and the data processing tasks comprise the first data processing task and other data processing tasks.
According to a third aspect of the embodiments of the present disclosure, there is provided a data processing apparatus, including:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the method of processing data according to the second aspect.
According to a fourth aspect of embodiments of the present disclosure, there is provided a storage medium, which when executed by a processor of a processing device of data, enables the processing device of data to perform the method of processing data according to the second aspect.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
the data processing system comprises the first router, the first server and the data processing platform, wherein the first server is arranged outside the data processing platform for the first data processing task of the client in the first region range, so that the multipoint realization of the first data processing task is realized. Thus, the processor of the first data processing task may be selected by pre-configuring the routing rules of the first router. Because the data processing platform is used for executing the data processing tasks of the client, wherein the client comprises the target client, and the data processing tasks comprise the first data processing task and other data processing tasks, when the first data processing task is executed by using the first server, the time delay required for completing the first data processing task is reduced compared with the time delay required for executing the data processing tasks by using more data processing platforms with more functions.
In addition, for one data processing platform corresponding to the existing multiple clients, a first server is arranged outside the data processing platform and is used for executing a first data processing task for the clients registered in the first region range, so that the deployment place of the first server can be set according to region limitation, and the problem that data cannot be processed due to region limitation is solved.
In summary, the technical scheme provided by the disclosure can solve the problems that the processing time is prolonged and the data cannot be processed.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure and do not constitute an undue limitation on the disclosure.
FIG. 1 is a schematic diagram of a data processing system according to an exemplary embodiment;
FIG. 2 is a schematic diagram illustrating a data processing flow according to an exemplary embodiment;
FIG. 3 is a schematic diagram of another data processing system according to an exemplary embodiment;
fig. 4 is a flowchart illustrating a video processing method applied to a video copyright verification terminal according to an exemplary embodiment;
FIG. 5 is a flow chart illustrating a method of processing data according to an exemplary embodiment;
fig. 6 is a block diagram of a data processing device according to an exemplary embodiment.
Detailed Description
In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the foregoing figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the disclosure described herein may be capable of operation in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.
The data processing system disclosed by the invention realizes the service requested by the user at the client through interaction with the client.
The client may be operated on an electronic device, which may be a mobile electronic device, such as a mobile phone, an IPAD, etc., or a fixed electronic device, such as a notebook, a desktop computer, etc.
The data processing system of the present disclosure is shown in fig. 1, and includes a first router 11, a first server 12, and a data processing platform 13.
Wherein the first server 12 is configured to perform a first data processing task of a client registered in a first geographical area (abbreviated as a target client).
The data processing platform 13 is used for performing data processing tasks of the client. The clients include target clients, that is, clients that the data processing platform 13 provides services are more extensive and are not limited to target clients. The data processing tasks include a first data processing task and other data processing tasks. That is, the data processing platform 13 functions more.
In this embodiment, the obvious difference from the prior art is that, under the framework of the client and the server, the first server is specially deployed outside the data processing platform for the client registered in the first geographical range. The data processing flow implemented based on the architecture is shown in fig. 2, and includes the following steps:
s201: and the target client side responds to the data processing request of the user and triggers the data processing task.
The user can operate through an interactive interface displayed on the client to generate a data processing request.
S202: the first router receives a data processing task sent by a target client.
Specifically, in the case that the user is registered as the user in the first area, the client sets the connected routing address as the address of the first router, so as to achieve the purpose of sending the data processing task to the first router.
S203: the first router sends the data processing task to a first server or a data processing platform according to a pre-configured routing rule.
Specifically, the routing rule includes: and in the case that the data processing task is the first data processing task, sending the data processing task to the first server. Otherwise, the data processing task is sent to the data processing platform. It can be seen that the first data processing task is preferentially allocated to the first server for execution by the routing rule.
S204: and after the first server receives the data processing task, executing the data processing task.
In this embodiment, optionally, the first server executes the first data processing task by starting a first data processing process preset in the first server, that is, implements the first data processing function. The way the preset process is started, the time consuming updating of the first data processing function is shorter, as no interaction with other functional modules is involved.
S205: and after the data processing platform receives the data processing task, executing the data processing task.
Generally, in the prior art, because the functions of the data processing platform, for example, the background point broadcasting cloud platform of the video APP, are rich, the functions are implemented by calling a preset function module, for example, the data processing platform executes a first data processing task by calling a preset first data processing module, that is, implements the first data processing function, so as to reduce the burden of the data processing platform.
Optionally, after the data processing task is executed, the data processing platform may send a task completion notification to the first server, and specifically, may notify the first server using an asynchronous message.
As can be seen from the above flow, in case the first server is able to perform the data processing tasks, the first router sends the data processing tasks to the first server, i.e. the first server performs the data processing tasks preferentially.
Optionally, the routing rule may further include: the data processing task cannot be sent outside the first geographical area. For example, some countries or regions do not allow data to flow out of the country or region, and thus, routing rules may be set according to the regulations, so that the regulations of the country or region can be adapted to strive for more users. In this case, it should be noted that, because the first server is configured to provide the first data processing function for the target client, the first router is able to obtain the data processing task triggered by the target client, so both the first server and the first router can be understood to be within the first geographical range.
In connection with the above procedure, there are several cases:
1. the data processing task is a first data processing task, and the first server is capable of executing the data processing task for the target client.
2. The data processing task is not the first data processing task, but the data processing task cannot be executed because the data processing task cannot be transmitted outside the first geographical area.
In order to reduce the probability of occurrence due to case 2, and improve the user experience, the first data processing function of the first server is optionally determined according to the service preference of the target client, wherein the service preference is obtained by counting the number of functions indicated by the historical data processing task sent by the target client.
That is, the number of functions indicated by the history data processing tasks transmitted from the target client may be counted, for example, the number of history data processing tasks indicating the video upload storage function is 100, the number of history data processing tasks indicating the image composition video function is 1000, the number of history data processing tasks indicating other functions is 0, and then the service preference is determined as the image composition video function, and the first data processing function of the first server is set as the image composition video function so as to enable the data processing tasks of the client to be executed as much as possible.
In summary, the data processing system of the embodiment has the following advantages:
1. a first server is provided outside the data processing platform, which performs a first data processing task, capable of providing a first data processing function for the target client. Compared with a data processing platform, the data processing platform has the advantages of low processing time delay and high stability because of single function.
2. Because the data processing platform implements the respective functions by calling other service providers, in addition to the update of the functions itself, the docking of the update with other service providers is required, and thus the update of the functions takes a long time (currently, one to two weeks is required). The first server realizes the function by calling the preset process in the first server, so that the update of the function does not involve interaction with other modules, and the update time can be shortened, for example, experiments prove that only half a day is needed.
3. Because the data processing platform realizes each function by calling other service providers, if a data processing task is sent to the data processing platform for processing, the data link is too long, and if any link has a problem, the data processing task cannot be executed, so the failure rate is higher, and the first server realizes the functions by calling a preset process in the first server, so the data link is shorter, and the failure rate can be reduced.
4. The configuration of the routing rules can adapt to regional regulations, so that the client can also provide services under the regional limiting condition, and the experience of users is improved, so that more users are strived for.
5. From the perspective of the first data processing function, the data processing platform is a standby of the first server, and in the case of failure or maintenance of the first server, the completion of the task (without region limitation) can be ensured by configuring the routing rule.
FIG. 3 is yet another data processing system of an example of the present disclosure, with the addition of storage devices to complete the functionality of the system, as compared to the embodiments described above.
The data processing system shown in fig. 3 includes: a first router 11, a first server 12, a data processing platform 13, a first memory 14, a second memory 15, a first cloud storage server 16, and a second cloud storage server 17.
The functions of the first router 11, the first server 12, and the data processing platform 13 may be referred to the above embodiments, and will not be described herein.
The first memory 14 is configured to store data of a target client, and synchronize the data of the target client to the data processing platform by using a mirroring technique when the first router 11 sends the data processing task to the data processing platform, so as to lay a data foundation for the first processor and the data processing platform to execute the data processing task of the target client.
It should be noted that, because the first memory 14 is used for storing the data of the target client, in the case where the data has a regional limitation, the first memory 14 is disposed in the first area.
The second memory 15 is used for storing data of the client required by the data processing platform to execute the data processing task, so as to lay a data foundation for the data processing platform to execute the data processing task of the target client.
The first cloud storage server 16 is for storing result data of the first server performing the first data processing function. The second cloud storage server 17 is configured to store a result data cloud storage server of the data processing platform performing the data processing function, and can provide convenience for querying the processing result.
And, after the execution of the data processing task of the execution target client of the data processing platform is finished, the second cloud storage server 17 is further configured to: and sending the result data of the data processing task of the target client executed by the processing platform to the first cloud storage server 16 so as to facilitate the subsequent query processing result of the first server.
Optionally, the link used by the second cloud storage server 17 to send the result data of the data processing platform to the first cloud storage server 16 is different from the link used by the first router to send the data processing task to the data processing platform. Specifically, the link used by the first router to send the data processing task to the data processing platform may be a dedicated line, and the link used by the second cloud storage server 17 to send the result data of the data processing platform to the first cloud storage server 16 is a public network link. The method aims at ensuring the reliability and low time delay of data processing task transmission and reducing the transmission cost of result data.
The implementation of the video composition service by the data processing system shown in fig. 3 will be described in detail below by taking the video composition service of an overseas registration client as an example.
Assume that the first router, the first server, the first storage, and the first cloud storage server are all deployed in overseas country a (an example of a first geographical range). The service preference of the user in country a is to use the video composition service, so the function of the first server is to perform the video composition task. The spot broadcasting cloud center stand (an example of a data processing platform), the second memory and the second cloud storage server are all disposed in China. After the user A downloads the client to the mobile phone, the user A registers as the user of the A country, namely the client is registered as the client of the A country.
1: user a uploads the image at the client and selects the video composition service. After the client acquires the image and the service type, a video composition task is triggered, and the image and the data of the user A, including but not limited to the video template selected by the user A, are stored in the first memory.
Assuming that the national law of a prohibits the data of the home country from flowing out of the country a, according to the national law of a, the pre-configured routing rule is: the video composition task is sent to a first server.
2: and triggering and executing 3-5 according to the routing rule after the first router receives the video synthesis task sent by the client.
3: the first router sends the video composition task to the first server.
4: the first server responds to the video composition task, acquires the image and the data of the user A from the first memory, and composes the video according to the image and the data of the user A.
5: the first server stores the video synthesis result data to the first cloud storage server, and feeds back the video synthesis result data to the client for display.
Or,
assuming country a allows data flow to foreign, the pre-configured routing rules are: the video composition task is sent to the first server if the first server is normal (e.g., no failure or resources meet the requirements of video composition), otherwise, the video composition task is sent to the data processing platform.
The first server normally has a flow of 1-5.
And if the first server is abnormal, triggering and executing 6-10 according to the routing rule after the first router receives the video synthesis task sent by the client.
6: and the first router sends the video synthesis task to the point broadcasting cloud center platform.
7: the first memory synchronizes the image and the data of user a to the second memory by mirroring techniques.
8: and the video synthesis task is responded by the video synthesis platform in the spot broadcasting cloud, the image and the data of the user A are obtained from the second memory, and the video is synthesized according to the image and the data of the user A.
9: and the video synthesis result data is stored to the second cloud storage server by the spot broadcasting cradle head.
10: the second cloud storage server feeds back video synthesis result data to the first cloud storage server for storage. And the first server sends the video synthesis result data to the client for display.
If country a does not allow data flow abroad, the video composition task cannot be performed.
Alternatively, user a selects the video clip service at the client, which triggers the video clip task. Assuming country a allows data flow to foreign, the pre-configured routing rules are: and sending the video synthesis task to the first server and sending other tasks to the data processing platform.
After receiving the video synthesis task sent by the client, the first router triggers 11-10 to execute according to the routing rule.
11: and the first router sends the video editing task to the point broadcasting cloud center platform.
12: the first memory synchronizes the image and the data of user a to the second memory by mirroring techniques.
13: and the video editing task is responded by the video editing platform in the spot broadcasting cloud, the image and the data of the user A are obtained from the second memory, and the editing is synthesized according to the image and the data of the user A.
14: and the video clip result data is stored to the second cloud storage server by the spot broadcasting cradle head.
15: the second cloud storage server feeds back video clip result data to the first cloud storage server for storage. The first server sends video clip result data to the client for presentation.
If country a does not allow data to flow abroad, the video clip task cannot be performed.
It should be noted that the above routing rules are only examples, and different routing rules may be reasonably combined, and corresponding, reasonably combined routing rules, subsequent steps caused by the reasonably combined routing rules may also be reasonably combined, split or related reference.
Fig. 4 is a further data processing system of the presently disclosed example, with the addition of a second server (not shown in fig. 4) and a second router 18, as compared to the above-described embodiments. The second server may be a server deployed for clients registered as in a second domain for providing a second data processing function different from the first data processing function.
The second router is used for monitoring the state of the data processing platform, and sending the data processing task sent to the data processing platform to a server corresponding to the type according to the type of the data processing task under the condition of fault or maintenance of the data processing platform.
For example, if the function corresponding to the data processing task is a first data processing function, the data processing task is sent to the first server, and if the function corresponding to the data processing task is a second data processing function, the data processing task is sent to the second server.
According to the data processing system, servers with different functions are deployed respectively, and when a data processing platform is unavailable, the data processing task can be executed by using other servers through the second router, so that at least partial service can be provided. And in combination with the embodiment, servers with different functions are deployed according to the preference of users in the area, so that service processing time delay can be reduced, updating time length can be reduced, regional limitation can be met through configuration of routing rules, or the servers and the data processing platforms can be mutually standby, and the reliability of the system is improved.
FIG. 5 is a diagram illustrating a data processing method applied to the data processing system, according to an exemplary embodiment, including the following steps:
s501: the first router receives a data processing task triggered by a target client.
The target client is a client registered in the first geographical range.
S502: the first router sends the data processing task to a first server or a data processing platform according to a pre-configured routing rule.
S503: the first server or data processing platform performs a first data processing task of the target client.
Specific implementation of the above steps may be found in the above embodiments, and will not be described in detail here. According to the data processing method, the routing rule can be preconfigured, the processing party of the first data processing task is selected, and when the first server is used for executing the first data processing task, compared with a data processing platform with more functions, the data processing task is executed, so that the time delay required for completing the first data processing task is reduced. And the deployment site of the first server can be set according to the regional limitation, so that the problem that data cannot be processed due to the regional limitation is solved.
The data processing system disclosed in the above embodiment can be applied to a data processing apparatus such as a server or the like. Alternatively, fig. 6 shows a block diagram of a hardware structure of a data processing apparatus, and referring to fig. 6, the hardware structure of the data processing apparatus may include: a processor 1, a communication interface 2, a memory 3 and a communication bus 4;
in the embodiment of the application, the number of the processor 1, the communication interface 2, the memory 3 and the communication bus 4 is at least one, and the processor 1, the communication interface 2 and the memory 3 complete communication with each other through the communication bus 4;
processor 1 may be a central processing unit CPU, or a specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement embodiments of the present invention, etc.;
the memory 3 may comprise a high-speed RAM memory, and may further comprise a non-volatile memory (non-volatile memory) or the like, such as at least one magnetic disk memory;
wherein the memory stores executable instructions, the processor is operable to invoke the instructions stored by the memory, the instructions operable to:
after acquiring a data processing task triggered by a target client, a first router sends the data processing task to a first server or a data processing platform according to a pre-configured routing rule; the target client is a client registered in a first regional range;
the first server or the data processing platform is used for executing data processing tasks of a client, the client comprises the target client, and the data processing tasks comprise the first data processing task and other data processing tasks.
Alternatively, the refinement and expansion functions of the instructions may be as described above.
In an exemplary embodiment, a storage medium is also provided, comprising instructions, for example a memory 3 comprising instructions, which are executable by the processor 1 of the data processing device to perform the above method. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (9)
1. A data processing system, comprising:
the system comprises a first router, a first server and a data processing platform;
the first server is used for executing a first data processing task of a target client, and the target client is a client registered in a first regional range;
the data processing platform is used for executing data processing tasks of a client, the client comprises the target client, and the data processing tasks comprise the first data processing task and other data processing tasks;
the first router is used for sending the data processing task to the first server or the data processing platform according to a preset routing rule after the data processing task triggered by the target client is acquired;
the processing system further includes: the system comprises a first memory, a second memory, a first cloud storage server and a second cloud storage server;
the first memory is used for storing the data of the target client and synchronizing the data of the target client to the data processing platform by using a mirror technique under the condition that the first router sends the data processing task to the data processing platform;
the second memory is used for storing data of the client required by the data processing platform to execute the data processing task;
the first cloud storage server is used for storing result data of the first data processing function executed by the first server;
the second cloud storage server is used for storing result data of the data processing platform executing the data processing function;
after the first router acquires the data processing task triggered by the target client, if a pre-configured routing rule cannot be sent to the outside of the first region range for the data processing task, the first router sends the data processing task to a first server, so that the first server responds to the data processing task to acquire the data of the target client from a first memory, executes the data processing task according to the data of the target client, and stores the result data to a first cloud storage server; after triggering a data processing task, the target client stores data of the target client into a first memory, and when the data processing task is a video synthesis task, the data of the target client comprise images and user data uploaded by the target client.
2. The system of claim 1, wherein the first data processing task of the first server is determined based on a traffic preference of the target client, the traffic preference being obtained by counting a number of traffic types of historical data processing tasks sent by the target client.
3. The system of claim 1, wherein the data processing platform performs the first data processing task by invoking a preset first data processing module;
and the first server executes the first data processing task by starting a first data processing process preset in the first server.
4. The system of claim 1, wherein the data processing platform is further configured to: after the execution of the data processing task is finished, a task completion notification is sent to the first server;
the second cloud storage server is further configured to:
and sending the result data of the data processing task of the target client to the first cloud storage server by the data processing platform.
5. The system of claim 4, wherein the link used by the second cloud storage server to send the result data of the data processing platform to the first cloud storage server is different from the link used by the first router to send the data processing tasks to the data processing platform.
6. The system of claim 1, further comprising:
and the second router is used for sending the data processing task sent to the data processing platform to a server corresponding to the type according to the type of the data processing task under the condition that the data processing platform fails or is maintained, and the server at least comprises the first server.
7. A method of processing data, comprising:
after acquiring a data processing task triggered by a target client, a first router sends the data processing task to a first server or a data processing platform according to a pre-configured routing rule; the target client is a client registered in a first regional range;
the first server or the data processing platform is used for executing data processing tasks of a client, the client comprises the target client, and the data processing tasks comprise a first data processing task and other data processing tasks;
the first memory is used for storing the data of the target client and synchronizing the data of the target client to the data processing platform by using a mirror technology under the condition that the first router sends the data processing task to the data processing platform;
the second memory is used for storing data of the client, which are required by the data processing platform to execute the data processing task;
the first cloud storage server is used for storing result data of the first data processing function executed by the first server;
the second cloud storage server is used for storing result data of the data processing platform executing the data processing function;
after the first router acquires the data processing task triggered by the target client, if a pre-configured routing rule cannot be sent to the outside of the first region range for the data processing task, the first router sends the data processing task to a first server, so that the first server responds to the data processing task to acquire the data of the target client from a first memory, executes the data processing task according to the data of the target client, and stores the result data to a first cloud storage server; after triggering a data processing task, the target client stores data of the target client into a first memory, and when the data processing task is a video synthesis task, the data of the target client comprise images and user data uploaded by the target client.
8. A data processing apparatus, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the method of processing data according to claim 7.
9. A storage medium, which when executed by a processor of a data processing device, enables the data processing device to perform the data processing method of claim 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011009277.2A CN112134955B (en) | 2020-09-23 | 2020-09-23 | Data processing system, data processing method, data processing device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011009277.2A CN112134955B (en) | 2020-09-23 | 2020-09-23 | Data processing system, data processing method, data processing device, and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112134955A CN112134955A (en) | 2020-12-25 |
| CN112134955B true CN112134955B (en) | 2024-03-22 |
Family
ID=73841287
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011009277.2A Active CN112134955B (en) | 2020-09-23 | 2020-09-23 | Data processing system, data processing method, data processing device, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112134955B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001291021A (en) * | 2000-04-07 | 2001-10-19 | Lee Wilson Darian | System and method for distributing data for respective areas |
| CN101938508A (en) * | 2009-07-01 | 2011-01-05 | 中国电信股份有限公司 | Method and system for shortening time delay in peer-to-peer network streaming media live broadcast system |
| CN102238089A (en) * | 2011-07-01 | 2011-11-09 | 中兴通讯股份有限公司 | Service interaction method, device and system |
| WO2012149718A1 (en) * | 2011-08-31 | 2012-11-08 | 华为技术有限公司 | Method for cloud terminal to access cloud server in cloud computing system, and cloud computing system |
| CN105357329A (en) * | 2015-10-12 | 2016-02-24 | 广州市百果园网络科技有限公司 | Business data transmission method, device and system for use in cross-Internet data center (IDC) network environment |
| US9660895B1 (en) * | 2014-03-04 | 2017-05-23 | Amazon Technologies, Inc. | Geolocation routing and simulation of network conditions |
| CN107465616A (en) * | 2016-06-03 | 2017-12-12 | 中国移动通信集团四川有限公司 | Client-based service routing method and device |
| CN110086719A (en) * | 2019-04-30 | 2019-08-02 | 深圳市腾讯网域计算机网络有限公司 | Data processing method, device and server |
| CN110166536A (en) * | 2019-04-30 | 2019-08-23 | 广州微算互联信息技术有限公司 | A kind of cloud mobile phone cross-region control method, system, device and storage medium |
| CN110730250A (en) * | 2019-09-06 | 2020-01-24 | 北京小米移动软件有限公司 | Information processing method and device, service system and storage medium |
-
2020
- 2020-09-23 CN CN202011009277.2A patent/CN112134955B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001291021A (en) * | 2000-04-07 | 2001-10-19 | Lee Wilson Darian | System and method for distributing data for respective areas |
| CN101938508A (en) * | 2009-07-01 | 2011-01-05 | 中国电信股份有限公司 | Method and system for shortening time delay in peer-to-peer network streaming media live broadcast system |
| CN102238089A (en) * | 2011-07-01 | 2011-11-09 | 中兴通讯股份有限公司 | Service interaction method, device and system |
| WO2012149718A1 (en) * | 2011-08-31 | 2012-11-08 | 华为技术有限公司 | Method for cloud terminal to access cloud server in cloud computing system, and cloud computing system |
| US9660895B1 (en) * | 2014-03-04 | 2017-05-23 | Amazon Technologies, Inc. | Geolocation routing and simulation of network conditions |
| CN105357329A (en) * | 2015-10-12 | 2016-02-24 | 广州市百果园网络科技有限公司 | Business data transmission method, device and system for use in cross-Internet data center (IDC) network environment |
| CN107465616A (en) * | 2016-06-03 | 2017-12-12 | 中国移动通信集团四川有限公司 | Client-based service routing method and device |
| CN110086719A (en) * | 2019-04-30 | 2019-08-02 | 深圳市腾讯网域计算机网络有限公司 | Data processing method, device and server |
| CN110166536A (en) * | 2019-04-30 | 2019-08-23 | 广州微算互联信息技术有限公司 | A kind of cloud mobile phone cross-region control method, system, device and storage medium |
| CN110730250A (en) * | 2019-09-06 | 2020-01-24 | 北京小米移动软件有限公司 | Information processing method and device, service system and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| Biometrics in the Cloud: Challenges and Research Opportunities;Aniello Castiglione;《IEEE Cloud Computing》;20171012;12-17 * |
| 一种异地库房管理中远程数据维护方法的研究与应用;瞿和平, 朱文奎, 于国华, 贾长雨;现代电子技术;20040601(06);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112134955A (en) | 2020-12-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11258822B2 (en) | Network function service discovery method and device | |
| CN110536330B (en) | UE migration method, device, system and storage medium | |
| EP2461536A1 (en) | Method and system for data synchronization in content delivery network | |
| CN110377431B (en) | Service calling method and device under multi-registry scene | |
| CN111565404A (en) | Data distribution method and device | |
| CN108055157B (en) | Service node acquisition method and device | |
| CN112218342A (en) | Method, device and system for realizing core network sub-slice disaster tolerance | |
| CN105208058A (en) | Information exchange system based on web session sharing | |
| CN112187495A (en) | Communication method and communication system of terminal and server | |
| WO2022007908A1 (en) | Method for service collaboration between network element devices, and network element device | |
| CN112134955B (en) | Data processing system, data processing method, data processing device, and storage medium | |
| CN111258795B (en) | Samba cluster fault reconnection method, device, equipment and medium | |
| CN116260878A (en) | Service center system based on global service structure server of distributed computing and storage | |
| EP3758308B1 (en) | Correspondence processing method and device based on interworking rcs system | |
| CN115349119A (en) | Method and apparatus for enhanced 5GC recovery when deploying a Network Function (NF) set in a network | |
| CN110324425B (en) | Hybrid cloud transaction route processing method and device | |
| CN111131497B (en) | File transmission method and device, electronic equipment and storage medium | |
| CN111200512B (en) | Network connection disaster recovery method, terminal equipment, storage medium and electronic equipment | |
| CN108616597B (en) | Distributed operation method for realizing service uninterrupted forever | |
| CN112367390A (en) | Method, device, equipment and storage medium for sharing service between terminals | |
| JP5078661B2 (en) | Call control system, communication control device, and call control method | |
| CN110784510A (en) | Method for accessing target service node to bus and information interaction method of service node | |
| CN106161580A (en) | A kind of connection status control method, Apparatus and system | |
| CN110730172A (en) | Video conference realization method and device | |
| CN115103423B (en) | Service information determining method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |