CN114201564A

CN114201564A - Map production task processing method and device, electronic equipment and storage medium

Info

Publication number: CN114201564A
Application number: CN202111494826.4A
Authority: CN
Inventors: 王浩; 刘江; 白宇; 黄杰; 彭亮
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2021-12-08
Filing date: 2021-12-08
Publication date: 2022-03-18

Abstract

The disclosure provides a task processing method and device, electronic equipment and a storage medium, and relates to the technical field of computers, in particular to the field of big data and high-precision maps. The specific implementation scheme is as follows: in response to receiving business data, such as high-precision map data, determining a service routine for processing the business data; and generating a task to be processed according to preset public parameter information used for representing the task public attribute and service parameter information corresponding to the service routine, wherein the task to be processed is used for processing the business data by using the service routine.

Description

Map production task processing method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for processing a task, an electronic device, and a storage medium.

Background

With the rapid development of computer and internet technologies, various map products, such as high-precision maps, come into play. The high-precision map is also called as a high-precision map and is applied to the field of automatic driving. The high-precision map has accurate vehicle position information and abundant road element data information, can help an automobile to predict road surface complex information such as gradient, curvature, course and the like, and can better avoid potential risks. The production of map data in map-like products often needs to be done by relying on external services.

Disclosure of Invention

The disclosure provides a task processing method and device, an electronic device and a storage medium.

According to an aspect of the present disclosure, there is provided a task processing method including: in response to receiving traffic data, determining a service routine for processing the traffic data; and generating a task to be processed according to preset public parameter information used for representing the task public attribute and service parameter information corresponding to the service routine, wherein the task to be processed is used for processing the business data by using the service routine.

According to another aspect of the present disclosure, there is provided a task processing apparatus including: a determining module, configured to determine, in response to receiving traffic data, a service routine for processing the traffic data; and the generating module is used for generating a task to be processed according to preset public parameter information used for representing the task public attribute and service parameter information corresponding to the service routine, wherein the task to be processed is used for processing the business data by using the service routine.

According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the task processing method as described above.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the task processing method as described above.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the task processing method as described above.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

fig. 1 schematically illustrates an exemplary system architecture to which the task processing method and apparatus may be applied, according to an embodiment of the present disclosure;

FIG. 2 schematically shows a flow chart of a task processing method according to an embodiment of the present disclosure;

FIG. 3 schematically illustrates an overall flow diagram of a task processing method according to an embodiment of the present disclosure;

FIG. 4 schematically shows a block diagram of a task processing device according to an embodiment of the present disclosure; and

FIG. 5 illustrates a schematic block diagram of an example electronic device that can be used to implement embodiments of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the technical scheme of the disclosure, the collection, storage, use, processing, transmission, provision, disclosure and other processing of the personal information of the related user are all in accordance with the regulations of related laws and regulations, necessary security measures are taken, and the customs of the public order is not violated.

The production process of high-precision maps often requires interaction with multiple external services. Different external services may have different interaction modes, such as asynchronous interaction modes like active invocation, passive access, message queues, etc., and synchronous interaction modes like synchronous waiting, etc. Active invocation may refer to active invocation of an external service during production of a high-precision map. Passive access may refer to providing an access interface based on which relevant data in the high-precision map production process is invoked by an external service. The message queue can refer to introducing middleware in the interaction between the high-precision map and the external service, sending messages related to the to-be-processed data of the high-precision map to the middleware, and then acquiring the messages by the external service for processing. Synchronous waiting requires waiting for the next task to be entered after the previous task has been processed. In order to realize normal and orderly production process of the high-precision map, the high-precision map production management platform needs to adapt to interaction modes of different external services. In addition, a unified access layer can be provided for various external services based on the purpose of multiplexing.

By treating the present service and the external service as equivalent services, a unified access stratum based on HTTP (hypertext transfer protocol) implementation can be provided. The access layer may abstract a task bus, i.e. a task distribution interface, implemented by queues. The task bus can be responsible for the transmission of interactive messages between all the services and the external services, and the tasks among the services are scheduled by distributing the interactive messages to different services according to the types of the interactive messages. The interactive messages sent by each service to the task bus are in json format, so that unified task header information can be abstracted, and detailed task information can be defined according to the type of the service.

The inventor finds that the task bus needs to be additionally arranged in the process of realizing the concept disclosed by the invention, the additionally arranged bus distribution strategy enables the access layer to be strongly coupled with the business logic, and personnel developing the bus needs to know the business logic of all services and the calling relation among all interactive messages. In addition, the interactive message of text type realized based on the json format has smaller data compression ratio and lower serialization efficiency.

Another unified access layer implemented based on HTTP may implement a unified interface for different services, and the interface parameters may include a union of service parameters of different services. The related platform of the high-precision map can distinguish different services through service addresses, and each service can obtain required parameters according to the self requirement.

The inventor finds in the course of implementing the disclosed concept that a unified interface including all parameters that all services need to use will make the parameters redundant and there will be strong coupling between service fields.

The disclosure provides a task processing method and device, an electronic device and a storage medium. The task processing method comprises the following steps: in response to receiving the business data, determining a service routine for processing the business data; and generating the tasks to be processed according to preset public parameter information used for representing the task public attribute and service parameter information corresponding to the service routine. The task to be processed is used for processing the business data by utilizing the service routine.

Fig. 1 schematically shows an exemplary system architecture to which the task processing method and apparatus may be applied, according to an embodiment of the present disclosure.

It should be noted that fig. 1 is only an example of a system architecture to which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, and does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios. For example, in another embodiment, an exemplary system architecture to which the task processing method and apparatus may be applied may include a terminal device, but the terminal device may implement the task processing method and apparatus provided in the embodiments of the present disclosure without interacting with a server.

As shown in fig. 1, the system architecture 100 according to this embodiment may include

terminal devices

101, 102, 103, a network 104 and a server 105. The network 104 serves as a medium for providing communication links between the

terminal devices

101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired and/or wireless communication links, and so forth.

The user may use the

terminal devices

101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The

terminal devices

101, 102, 103 may have installed thereon various communication client applications, such as a knowledge reading application, a web browser application, a search application, an instant messaging tool, a mailbox client, and/or social platform software, etc. (by way of example only).

The

terminal devices

101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.

The server 105 may be a server providing various services, such as a background management server (for example only) providing support for content browsed by the user using the

terminal devices

101, 102, 103. The background management server may analyze and perform other processing on the received data such as the user request, and feed back a processing result (e.g., a webpage, information, or data obtained or generated according to the user request) to the terminal device. The Server may be a cloud Server, which is also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service extensibility in a traditional physical host and a VPS service ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server incorporating a blockchain.

It should be noted that the task processing method provided by the embodiment of the present disclosure may be generally executed by the

terminal device

101, 102, or 103. Accordingly, the task processing device provided by the embodiment of the present disclosure may also be disposed in the

terminal device

101, 102, or 103.

Alternatively, the task processing method provided by the embodiment of the present disclosure may also be generally executed by the server 105. Accordingly, the task processing device provided by the embodiment of the present disclosure may be generally disposed in the server 105. The task processing method provided by the embodiment of the present disclosure may also be executed by a server or a server cluster that is different from the server 105 and is capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105. Accordingly, the task processing device provided by the embodiment of the present disclosure may also be disposed in a server or a server cluster different from the server 105 and capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105.

For example, when task processing is required, the

terminal device

101, 102, 103 or the server 105 may obtain business data, then determine a service routine for processing the business data in response to receiving the business data, and generate a task to be processed according to preset public parameter information for representing a task public attribute and service parameter information corresponding to the service routine. The task to be processed is used for processing the business data by utilizing the service routine. Or by a server or server cluster capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105, in response to receiving the traffic data and enabling the generation of the pending task.

It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

Fig. 2 schematically shows a flow chart of a task processing method according to an embodiment of the present disclosure.

As shown in fig. 2, the method includes operations S210 to S220.

In operation S210, in response to receiving the traffic data, a service routine for processing the traffic data is determined.

In operation S220, a to-be-processed task is generated according to preset public parameter information for representing the task public attribute and service parameter information corresponding to the service routine, where the to-be-processed task is used to process the service data using the service routine.

According to an embodiment of the present disclosure, the service data may include data related to a high-precision map service, for example, may include data of lane lines, road boundaries, road identifiers, driving routes, and the like. The service routines for processing the business data may include service routines that are independent of external services that exist with the high precision map production management platform. External services may be used to facilitate data processing for high-precision map production management platforms. The service routine may include, without limitation, at least one of a pre-processing service routine, a quality inspection service routine, a difference service routine, and a batch service routine.

It should be noted that the service data may also include data related to services in other various application scenarios, which is not limited herein.

According to an embodiment of the present disclosure, the task common attribute may include at least one of a task id (identification), a task execution state, a task type, a task start time, a task end time, and the like. The preset common parameter may include at least one of a parameter related to task identification, a parameter related to task execution state, a parameter related to task type, a parameter related to task start time, and a parameter related to task end time. The service parameters may include parameters corresponding to traffic data required in the service routine.

For example, in the case where the service routine is a preprocessing service routine, the service parameters may include parameters characterizing at least one of a data source address and a data upload address. In the case where the service routine is a quality control service routine, the service parameter may include a parameter indicating at least one of an address of a source of the data and an address related to a quality control mode preset for each type of data. In the case that the service routine is a difference service routine, the service parameters may include parameters characterizing data contents corresponding to different versions of the same data, and parameters characterizing at least one of data contents corresponding to the same data before processing and data contents corresponding to the same data after processing. In the case where the service routine is a batch service routine, the service parameters may include parameters characterizing at least one of a source of the data and an amount of data in a batch unit.

According to the embodiment of the disclosure, the tasks to be processed may include tasks determined according to the preset common parameters and the data corresponding to the preset common parameters, tasks determined according to the service parameters and the data corresponding to the service parameters, and tasks determined according to the preset common parameters, the service parameters, and the data corresponding to the preset common parameters and the service parameters. The high-precision map production management platform can be provided with a preset circulation flow, the circulation flow can control the platform to automatically trigger the corresponding task to perform data processing when receiving the corresponding data, and can automatically trigger the execution process of the next task after the previous task is finished.

For example, where a platform receives newly acquired map data, a service for processing the newly acquired map data may be determined to be a pre-processing service. Then, a preprocessing task may be generated according to the preset common parameter information and the service parameter information corresponding to the preprocessing service. The pre-processing task may include common attribute information of the task, such as task id, task execution state, task type, and the like, and may further include data information that the task needs to process, and the like, so as to implement processing of map data by using the pre-processing service.

According to the embodiment of the disclosure, the public information of different tasks can be represented by using the preset public parameter information, the specific information related to each service can be represented by using the service parameter information, and based on the parameter construction mode, different services can automatically maintain a parameter structure body according to the parameters required by each service, so that the decoupling of service fields among different services can be effectively realized, and the parameter setting redundancy can be effectively relieved.

The method shown in fig. 2 is further described below with reference to specific embodiments.

According to an embodiment of the present disclosure, generating a task to be processed according to preset public parameter information for representing a task public attribute and service parameter information corresponding to a service routine may include: and determining common attribute data for representing the common attribute of the task to be processed according to the preset common parameter information. And determining service data corresponding to the service data according to the service parameter information. And generating the tasks to be processed according to the public attribute data and the service data.

According to an embodiment of the present disclosure, the service routine is, for example, a preprocessing service. The record for the preprocessing task corresponding to the preprocessing service can be generated according to preset public parameter information including parameters such as task id, task execution state and task type, and public attribute data for representing the public attribute of the preprocessing task can be obtained. In this record, the task id may characterize the unique identification information used to determine the preprocessing task. The task execution state may characterize a change in real-time status of the pre-processing task during processing, and may include, for example, "created not started," "in-process," "process success," "process failure," and so on. The task type may be a pre-processing task. The data to be processed in the preprocessing task, namely the service data, which needs to be processed can be determined according to the service parameter information corresponding to the preprocessing service and by combining the service data, and the service data corresponding to the service parameter information can be represented. So as to generate the preprocessing task comprising the record information and the data to be processed according to the public attribute data and the service data of the preprocessing task.

Through the embodiment of the disclosure, the task to be processed can be generated according to the public attribute data determined by the preset public parameter information and the service data determined by the service parameter information. On one hand, the integrity of task data can be kept, on the other hand, the decoupling of service fields among different services can be effectively realized, and the parameter setting redundancy can be reduced.

According to an embodiment of the present disclosure, after generating the task to be processed, the task processing method may further include: in response to detecting the pending task, a service routine is invoked. And processing the service data by utilizing the service routine so as to realize the processing of the task to be processed.

According to an embodiment of the present disclosure, a to-be-processed task including recording information and to-be-processed data may be stored in a preset database. By polling the tasks in the database, a corresponding interaction mode can be selected for the external service to acquire and process the relevant data of the tasks to be processed under the condition that the tasks to be processed are detected.

According to an embodiment of the present disclosure, since the interaction manner may include an active call, a passive access, a message queue, a synchronous wait, and the like, in response to detecting the task to be processed, the method of calling the service routine may include: under the condition that the detected interaction mode of the task to be processed and the external service is determined to be actively called, when the task to be processed is detected, a service routine of the external service can be actively called, so that the task to be processed is processed by the service routine. When the detected interaction mode of the task to be processed and the external service is determined to be passive access, when the task to be processed is detected, the external service routine can actively call and process related data in the task to be processed. When it is determined that the detected interaction mode of the to-be-processed task and the external service is the message queue, data related to the to-be-processed task can be stored in the message queue for a service routine of the external service to acquire and process. And under the condition that the detected interaction mode of the task to be processed and the external service is synchronous waiting, detecting the states of other tasks in the database, and under the condition that the other tasks are not completed, entering a waiting process until the other tasks are completely completed, and processing the task to be processed by using a service routine of the external service.

According to the embodiment of the disclosure, under the condition that the number of the tasks to be processed stored in the database is large, the number of the external services can be expanded, so that the tasks to be processed can be rapidly processed.

Through the embodiments of the present disclosure, asynchronous processing of task generation and task execution can be realized. In addition, the task processing process realized based on the method has good service expansibility.

According to an embodiment of the present disclosure, before processing the service data by using the service routine, the task processing method may further include: the service data is converted into binary format data. The binary format data is transmitted to the service routine.

According to the embodiment of the disclosure, the service routine may be a service routine of an external service existing independently of the high-precision map production management platform, the relevant data of the task to be processed may be stored in an internal database in the high-precision map production management platform, and in the case of processing the task to be processed using the external service, the relevant data of the task to be processed may be transmitted to the service routine of the external service in a binary format.

According to the embodiment of the disclosure, service interaction can be realized by using Brpc + Protobuffer, Brpc is an RPC (Remote Procedure Call) framework based on a Protobuffer interface, and Protobuffer is an independent data interaction format. The brpc uses a Protobuffer serialization mode, can convert the to-be-processed data stored in the database into a binary format for transmission, and the to-be-processed data in the binary format can be more compact.

By the embodiment of the disclosure, the service data is converted into the binary format, so that the message serialization efficiency can be improved, and the task processing efficiency can be effectively improved.

According to an embodiment of the present disclosure, in the process of processing the task to be processed by using the service routine, the task processing method may further include: and responding to the task to be processed, and updating the public attribute data.

According to the embodiment of the disclosure, for example, the to-be-processed task is a preprocessing task, and the common attribute data may include information such as a task id, a task execution state, a task type, a task start time, and a task end time of the preprocessing task. Under the condition that the preprocessing task is generated and data related to the preprocessing task is stored in the preset database, the state in the public attribute data can be 'created and not started', and the state can represent that the preprocessing task does not process the data to be processed. In the case where it is determined that the service routine can process the to-be-processed task, the state in the common attribute data may be automatically updated to "in-process", and in this state, the pre-processing task may acquire and process the to-be-processed data. After processing of the task to be processed is completed using the service routine, the state in the public attribute data may be automatically updated to "processing successful". If the processing procedure for processing the task to be processed by the service routine fails, the state in the common attribute data may be automatically updated to "processing failure", in which case the preprocessing task may be automatically re-executed.

By the embodiment of the disclosure, the processing state of the task can be recorded in real time, and the normal execution of various tasks to be processed is facilitated.

According to an embodiment of the present disclosure, the service routine may include at least one of: pre-processing service routines, quality inspection service routines, difference service routines, and batch service routines, and may be wired in a ratio.

According to the embodiment of the disclosure, corresponding parameter structure bodies can be configured in advance aiming at various service routines needing to be interacted under various service scenes, so that the interaction between the various service routines and service data is realized.

It should be noted that parameter structures configured for different services may be stored in a unified manner in a preset database, and may be stored in the same preset database together with preset public parameter information.

By the embodiment of the disclosure, the interaction between various service routines and service data under various scenes can be realized, the realized task processing method can be compatible with various service types, and new service routines can be easily expanded.

According to an embodiment of the present disclosure, the task-common attribute may include at least one of: task identification, task execution status, task type, task start time, and task end time, and may be wired thereto.

By the embodiment of the disclosure, the processing details of the tasks can be recorded in real time, and the normal execution of various tasks to be processed is facilitated.

Fig. 3 schematically shows an overall block diagram of a task processing method according to an embodiment of the present disclosure.

As shown in FIG. 3, the upstream services module 310 may include various business modules, such as modules associated with a high-precision mapping management platform. The access layer interface module 320 may be configured to encapsulate a parameter structure predefined for service data that needs to be processed by each service, such as Server _ Task _ info _1, Server _ Task _ info _2, and the like, and a parameter structure predefined for common attributes, such as Task _ info and the like, that characterize different tasks that are not related to the service in the Task scheduling framework. The database module 330 may store data related to the pending task, such as service data that may be processed by the pending task, and common attribute data of the pending task. The interaction module 340 may provide various interaction manners, such as active calling, passive access, message queue, synchronous waiting, and the like, so as to facilitate the

service routines

351, 352, 353, and the like of the external service 350 to interact with the database module 330, and implement processing of the to-be-processed task by using the

service routines

351, 352, 353, and the like.

According to the embodiment of the disclosure, the format of the parameter structure body and each parameter information can be pre-defined according to the actual service scene, and the parameter information with different formats and different fields can be defined for different services. The parameter structure may abstract the interaction of tasks into a unified format. For example, in the case of various types of tasks such as push (submitting task), pull (taking task from queue), trigger (triggering one task through one interface), update (updating task state), kill (terminating task), and the like, the various types of tasks can be unified into processing for service data and updating for common attribute data.

For example, in response to the upstream service module 310 receiving the business data, the service routine for processing the business data may be determined to be a quality inspection service routine, and the parameter structure corresponding to the quality inspection service routine is, for example, Server _ task _ info _ 2. Public attribute data including, for example, Task id, Task type is quality check, Task state is "created not started", Task start time is empty, Task end time is empty, etc. may be populated for predefined parameter information in Task _ info. And the service data required to be processed by the task to be processed can be obtained by filling aiming at the predefined parameter information in the Server _ task _ info _2 by combining the service data. The populated service data and public attribute data may be saved to database module 330 to generate quality inspection tasks. Downstream quality control services (e.g., service routine 352) may detect and retrieve quality control tasks, for example, in pull mode, and process the quality control tasks. Accordingly, when processing is performed for the direct task, the execution state for characterizing the quality inspection task stored in the database 330 may be updated to "in-process" according to the task id of the quality inspection task. And by updating the task execution state, the process of processing the task by other services can be refused under the condition that other services also acquire the quality inspection task.

It should be noted that, in the case of processing the quality inspection task by using the quality inspection service routine, since the stand-alone processing is slow, the inside may split the task into many small tasks, each task may have its own status, and when a small task fails, the inside retry mechanism may be executed, and only when all the small tasks are completely processed, the corresponding status in the database may be updated.

According to the embodiment of the disclosure, the Task _ info may be equivalent to the header information of the Task to be processed, and when the Task to be processed is processed, the Task _ info may be parsed first to obtain information such as the Task id, the Task execution state, and the Task type. The process attribute data is analyzed, so that the circulation of the task processing process can be realized. The parameters defined in the corresponding Server _ task _ info may be parsed when the corresponding service is specified, so as to determine and obtain the service data that needs to be processed by the task to be processed.

Through the embodiment of the disclosure, a framework supporting multi-type task access service can be realized, the interaction between various service routines and service data under various scenes can be realized, and the realized task processing method is compatible with various service types and is easy to expand.

Fig. 4 schematically shows a block diagram of a task processing device according to an embodiment of the present disclosure.

As shown in fig. 4, the task processing device 400 may include a determination module 410 and a generation module 420.

A determining module 410 for determining a service routine for processing the traffic data in response to receiving the traffic data.

The generating module 420 is configured to generate a to-be-processed task according to preset public parameter information used for representing the task public attribute and service parameter information corresponding to the service routine, where the to-be-processed task is used for processing the service data by using the service routine.

According to an embodiment of the present disclosure, a generation module includes a first determination unit, a second determination unit, and a generation unit.

And the first determining unit is used for determining the public attribute data of the public attribute for representing the task to be processed according to the preset public parameter information.

And the second determining unit is used for determining service data corresponding to the service data according to the service parameter information.

And the generating unit is used for generating the tasks to be processed according to the public attribute data and the service data.

According to an embodiment of the present disclosure, the to-be-processed task includes service data corresponding to the business data. The task processing device also comprises a calling module and a processing module.

And the calling module is used for calling the service routine in response to the detection of the task to be processed.

And the processing module is used for processing the service data by utilizing the service routine so as to realize the processing of the task to be processed.

According to an embodiment of the present disclosure, before the processing module, the task processing device further includes a conversion module and a transmission module.

And the conversion module is used for converting the service data into binary format data.

And the transmission module is used for transmitting the binary format data to the service routine.

According to an embodiment of the present disclosure, the to-be-processed task includes public attribute data. The task processing device also comprises an updating module.

And the updating module is used for responding to the processing of the task to be processed and updating the public attribute data.

According to an embodiment of the disclosure, the service routine comprises at least one of: a pre-processing service routine, a quality inspection service routine, a difference service routine, and a batch processing service routine.

According to an embodiment of the present disclosure, the task-common attribute includes at least one of: task identification, task execution state, task type, task start time and task end time.

The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.

According to an embodiment of the present disclosure, an electronic device includes: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the task processing method as described above.

According to an embodiment of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform a task processing method as described above.

According to an embodiment of the present disclosure, a computer program product comprising a computer program which, when executed by a processor, implements a task processing method as described above.

FIG. 5 illustrates a schematic block diagram of an example electronic device 500 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 5, the apparatus 500 comprises a computing unit 501 which may perform various appropriate actions and processes in accordance with a computer program stored in a Read Only Memory (ROM)502 or a computer program loaded from a storage unit 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the device 500 can also be stored. The calculation unit 501, the ROM 502, and the RAM 503 are connected to each other by a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.

A number of components in the device 500 are connected to the I/O interface 505, including: an input unit 506 such as a keyboard, a mouse, or the like; an output unit 507 such as various types of displays, speakers, and the like; a storage unit 508, such as a magnetic disk, optical disk, or the like; and a communication unit 509 such as a network card, modem, wireless communication transceiver, etc. The communication unit 509 allows the device 500 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.

The computing unit 501 may be a variety of general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of the computing unit 501 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 501 executes the respective methods and processes described above, such as the task processing method. For example, in some embodiments, the task processing method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 508. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 500 via the ROM 502 and/or the communication unit 509. When the computer program is loaded into the RAM 503 and executed by the computing unit 501, one or more steps of the task processing method described above may be performed. Alternatively, in other embodiments, the computing unit 501 may be configured to perform the task processing method by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and the present disclosure is not limited herein.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A method of task processing, comprising:

in response to receiving traffic data, determining a service routine for processing the traffic data; and

and generating a task to be processed according to preset public parameter information used for representing the task public attribute and service parameter information corresponding to the service routine, wherein the task to be processed is used for processing the business data by using the service routine.

2. The method of claim 1, wherein the generating of the task to be processed according to preset public parameter information for characterizing task public attributes and service parameter information corresponding to the service routine comprises:

determining public attribute data for representing the public attribute of the task to be processed according to the preset public parameter information;

determining service data corresponding to the service data according to the service parameter information; and

and generating the task to be processed according to the public attribute data and the service data.

3. The method of claim 1 or 2, wherein the pending task comprises service data corresponding to the traffic data, the method further comprising:

in response to detecting the task to be processed, calling the service routine; and

and processing the service data by utilizing the service routine so as to realize the processing of the task to be processed.

4. The method of claim 3, further comprising, prior to said processing said service data with said service routine:

converting the service data into binary format data; and

transmitting the binary format data to the service routine.

5. The method of any of claims 1 to 4, wherein the pending task comprises public attribute data, the method further comprising:

and updating the public attribute data in response to the to-be-processed task being processed.

6. The method of any of claims 1 to 5, wherein the service routine comprises at least one of:

a pre-processing service routine, a quality inspection service routine, a difference service routine, and a batch processing service routine.

7. The method of any of claims 1-6, wherein the task-common attributes include at least one of:

task identification, task execution state, task type, task start time and task end time.

8. A task processing device comprising:

a determining module, configured to determine, in response to receiving traffic data, a service routine for processing the traffic data; and

and the generating module is used for generating a task to be processed according to preset public parameter information used for representing the task public attribute and service parameter information corresponding to the service routine, wherein the task to be processed is used for processing the business data by using the service routine.

9. The apparatus of claim 8, wherein the generating means comprises:

the first determining unit is used for determining public attribute data for representing the public attribute of the task to be processed according to the preset public parameter information;

a second determining unit, configured to determine, according to the service parameter information, service data corresponding to the service data; and

and the generating unit is used for generating the task to be processed according to the public attribute data and the service data.

10. The apparatus according to claim 8 or 9, wherein the to-be-processed task includes service data corresponding to the traffic data, the apparatus further comprising:

the calling module is used for calling the service routine in response to the detection of the task to be processed; and

11. The apparatus of claim 10, further comprising, prior to the processing module,

the conversion module is used for converting the service data into binary format data; and

a transmission module for transmitting the binary format data to the service routine.

12. The apparatus of any of claims 8 to 11, wherein the pending task comprises public attribute data, the apparatus further comprising:

13. The apparatus of any of claims 8 to 12, wherein the service routine comprises at least one of:

14. The apparatus of any of claims 8 to 13, wherein the task-common attributes comprise at least one of:

15. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.

16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.

17. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-7.