CN115599820A

CN115599820A - Batch data processing method, device, medium and equipment

Info

Publication number: CN115599820A
Application number: CN202211294998.1A
Authority: CN
Inventors: 桑文锋; 曹犟; 刘耀洲; 付力力; 关海南
Original assignee: Sensors Data Network Technology Beijing Co Ltd
Current assignee: Sensors Data Network Technology Beijing Co Ltd
Priority date: 2022-10-21
Filing date: 2022-10-21
Publication date: 2023-01-13

Abstract

An embodiment of the application provides a batch data processing method, a batch data processing device, a medium and equipment, wherein the method comprises the following steps: when a trigger condition for indicating to execute the batch operation is triggered, generating batch operation request information; obtaining matching conditions of message audience groups according to batch operation request information; acquiring preset identification of a target audience group from a database according to the matching condition; and sending the preset identification and the matching condition to a batch calculation engine to perform batch message generation operation and batch message sending operation. By utilizing the batch data processing method provided by the embodiment of the application, a mode of independent operation and unified export of real-time computation and batch computation is introduced into a computation engine layer, namely, a real-time computation process and a batch computation process which are originally mixed together are split into two independently operated processes, so that conflicts, such as timeliness and throughput capacity, between the real-time computation and the batch computation are avoided, and the output is performed by the same export, so that the independent operation cannot be seen on an application layer.

Description

Batch data processing method, device, medium and equipment

Technical Field

The present application relates to the field of electronic communications technologies, and in particular, to a method, an apparatus, a medium, and a device for processing batch data.

Background

In the field of marketing engines, the calculation of marketing strategies is a key part and is the most complex part of the whole system. The marketing engine can realize message reach (such as short message, weChat, popup window, push and the like) to the user, and the calculation modes of reach are also divided into several types, for example:

the trigger type is that if an event A is done, the trigger is immediately carried out, or if an event A is not done, the trigger is immediately carried out;

timed type, circle a large group of people at a fixed time, send together, time divided single, and repeat routinely, etc.

Therefore, the marketing engine system has high technical requirements such as timeliness, throughput capability, stability, expansibility and the like. However, many systems in the industry adopt the same operator by integrating the calculation of the whole marketing strategy in one computing system, which results in conflicts among many capabilities, such as timeliness and throughput. Meanwhile, the expansion capability is low, because of the technical architecture integrating the flow and batch, each addition of a computing capability is very complicated, and the forward and backward compatibility is difficult to achieve, so that the main flow of the system needs to be adjusted under new requirements, the influence on the stability of the system is very large, and the capability of rapidly supporting a new operator is not provided.

Disclosure of Invention

The batch data processing method provided by the embodiment of the application is utilized, a mode that real-time calculation and batch calculation are independently operated and uniformly exported is introduced into a calculation engine layer, namely a real-time calculation process and a batch calculation process which are mixed together originally are split into two independently operated processes, conflicts between the real-time calculation and the batch calculation, such as timeliness and throughput capacity, are avoided, and the same export is adopted, so that the processes cannot be independently operated on an application layer.

An embodiment of the present application provides a batch data processing method, where the batch data processing method includes:

when a trigger condition for indicating to execute batch operation is triggered, generating batch operation request information corresponding to the trigger condition;

receiving the batch operation request information, and obtaining the matching conditions of the message audience groups according to the batch operation request information;

receiving the request information, and obtaining the matching condition of the message audience group according to the request information;

acquiring preset identification of a target audience group from a database according to the matching condition;

and sending the preset identification and the matching condition to a batch calculation engine constructed based on a workflow model to perform batch message generation operation and batch message sending operation.

In the batch data processing method according to the embodiment of the application, the obtaining of the preset identifier of the target audience group from the database according to the matching condition includes:

constructing an sql query statement based on the matching condition and a preset sql statement template;

and acquiring preset identification of the target audience group from a database through the sql query statement.

In the batch data processing method according to the embodiment of the present application, the sending the preset identifier and the matching condition to a batch calculation engine constructed based on a workflow model to perform a batch message generation operation and a batch message sending operation includes:

a batch computing engine constructed by the workflow model acquires a target message template corresponding to the preset identification from a pre-constructed message template library according to the preset identification;

performing batch message generation operation based on the matching condition and a target message template to obtain a message to be sent corresponding to the preset identifier;

and executing batch message sending operation on the messages to be sent.

In the batch data processing method according to the embodiment of the present application, after the preset identifier and the matching condition are sent to a batch calculation engine constructed based on a workflow model to perform a batch message generation operation and a batch message sending operation, the method further includes:

and generating recording information corresponding to the preset identification and storing the recording information into a recording table, wherein the recording information comprises the preset identification, the execution state of the batch message sending operation and a historical timestamp for carrying out the batch message sending operation.

In the batch data processing method according to the embodiment of the present application, the method further includes:

judging whether a preset identification of the current audience group of the message to be received exists in the record table or not to obtain a judgment result;

and if the judgment result shows that the preset identification exists in the record table, the execution state is that the transmission is successful, and the distance between the moment corresponding to the current timestamp and the moment corresponding to the historical timestamp exceeds a preset threshold value, judging that the current audience group is repeatedly transmitted, and canceling the batch message transmission operation on the current audience group.

acquiring the execution state of the batch message sending operation;

and executing the batch message sending operation again on the audience group corresponding to the execution state of the sending failure.

Accordingly, another aspect of the embodiments of the present application further provides a batch data processing system, where the batch data processing system includes:

the generation module is used for generating batch operation request information corresponding to a trigger condition when the trigger condition for indicating the execution of batch operation is triggered;

the receiving module is used for receiving the batch operation request information and obtaining the matching condition of the message audience groups according to the batch operation request information;

the acquisition module is used for acquiring preset identification of the target audience group from a database according to the matching condition;

and the sending module is used for sending the preset identification and the matching condition to a batch computing engine constructed based on a workflow model to perform batch message generation operation and batch message sending operation.

Correspondingly, another aspect of the embodiments of the present application further provides a storage medium, where the storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to perform the batch data processing method described above.

Correspondingly, another aspect of the embodiments of the present application further provides a terminal device, including a processor and a memory, where the memory stores a plurality of instructions, and the processor loads the instructions to execute the batch data processing method described above.

The embodiment of the application provides a batch data processing method, a device, a medium and equipment, wherein the method comprises the steps of generating batch operation request information corresponding to a trigger condition when the trigger condition for indicating to execute batch operation is triggered; receiving the batch operation request information, and obtaining the matching conditions of the message audience groups according to the batch operation request information; acquiring preset identification of a target audience group from a database according to the matching condition; and sending the preset identification and the matching condition to a batch calculation engine constructed based on the workflow model to perform batch message generation operation and batch message sending operation. By using the batch data processing method provided by the embodiment of the application, a mode of independent operation and unified export of real-time calculation and batch calculation is introduced into a calculation engine layer, namely, the original mixed real-time calculation process and batch calculation process are split into two independently operated processes, so that conflicts between the real-time calculation and the batch calculation, such as timeliness and throughput capacity, are avoided, and the output is realized through the same export, so that the independent operation cannot be seen on an application layer.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly introduced below. It is obvious that the drawings in the following description are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.

Fig. 1 is a schematic flowchart of a batch data processing method according to an embodiment of the present disclosure.

Fig. 2 is a schematic structural diagram of a batch data processing system according to an embodiment of the present disclosure.

FIG. 3 is a schematic diagram of another exemplary batch data processing system according to the present disclosure.

Fig. 4 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without inventive step, are intended to be within the scope of the present application.

It should be noted that the following is a brief introduction to the background of the present solution:

the scheme is mainly developed around the technical problem that the current marketing engine system usually combines real-time stream calculation and batch calculation together, and a unified set of operators are used, so that the architecture is simpler, and conflicts, such as timeliness and throughput capacity, exist between the real-time stream calculation and the batch calculation. It can be understood that in the field of marketing engines, the calculation of marketing strategies is a key ring and is the most complex part of the whole system. The marketing engine can realize message reach (such as short message, weChat, popup window, push and the like) to the user, and the calculation modes of reach are also divided into several types, for example:

the trigger type is that if an event A is done, the trigger is immediately carried out, or if an event A is done and an event B is not done, the trigger is immediately carried out;

timed, at a fixed time, circle a large group of people, send together, timed a single time, and routinely repeated, etc.

Therefore, the marketing engine system has high technical requirements such as timeliness, throughput capability, stability, expandability and the like. Many systems in the industry incorporate the calculation of the whole marketing strategy into one computing system, and use the same operator, so that there is a conflict between many capabilities, such as timeliness and throughput. Meanwhile, the expansion capability is low, because of the technical architecture of flow and batch integration, each time a computing capability is added, the computing capability is very complex, and the compatibility between the front and the back is difficult to achieve, the main flow of the system is often required to be adjusted under new requirements, the influence on the stability of the system is very large, and the capability of rapidly supporting a new operator is not provided.

In order to solve the above technical problem, an embodiment of the present application provides a batch data processing method. By utilizing the batch data processing method provided by the embodiment of the application, a mode of independent operation and unified export of real-time computation and batch computation is introduced into a computation engine layer, namely, a real-time computation process and a batch computation process which are originally mixed together are split into two independently operated processes, so that conflicts, such as timeliness and throughput capacity, between the real-time computation and the batch computation are avoided, and the output is performed by the same export, so that the independent operation cannot be seen on an application layer.

It should be explained that real-time stream computation refers to processing of data streams, and is a way of real-time computation. Batch computing refers to a data computing mode of uniformly collecting data, storing the data into a database and then processing the data in batches.

The difference between real-time flow calculation and batch calculation is as follows:

1. the data are different in timeliness: real-time flow calculation is real-time, low delay, batch calculation is non-real-time, and high delay.

2. The data characteristics are different: data computed in real-time streams is typically dynamic, borderless, while data computed in batches is typically static.

3. The application scenarios are different: the real-time flow calculation is applied to a real-time scene, a scene with higher timeliness requirement such as real-time recommendation and service monitoring, batch calculation generally refers to batch processing, and the method is applied to a scene with low real-time requirement and offline calculation, such as data analysis, offline report and the like.

4. The running modes are different, the task of real-time flow calculation is continuously carried out, and the task of batch calculation is completed at one time.

The workflow model is a set of collections related to business process flow concepts. Is an abstraction of the actual business process flow.

Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a batch data processing method according to an embodiment of the present disclosure. The batch data processing method is applied to terminal equipment. Optionally, the terminal device is a terminal or a server. Optionally, the server is an independent physical server, or a server cluster or distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as cloud service, cloud database, cloud computing, cloud function, cloud storage, web service, cloud communication, middleware service, domain name service, security service, CDN (Content Delivery Network), big data and artificial intelligence platform. Optionally, the terminal is a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, a smart voice interaction device, a smart home appliance, a vehicle-mounted terminal, and the like, but is not limited thereto.

In an embodiment, the method may comprise the steps of:

step 101, when a trigger condition for indicating execution of batch operation is triggered, generating batch operation request information corresponding to the trigger condition.

The triggering condition is manually preset and is used for indicating to execute batch operation. For example, the trigger condition set according to the time dimension may be set at a time point, for example, "8 am every monday", and when the current time point reaches a preset 8 am every monday, the trigger condition is considered to be triggered, and at this time, batch operation request information corresponding to the trigger condition is generated.

And 102, receiving the request information, and obtaining the matching conditions of the message audience groups according to the request information.

Wherein, the matching condition refers to a condition for matching audience groups meeting the sent message, such as "age 10-25", "occupation xx", and the like. The audience groups matched with the matching conditions are screened out, preset identifications (such as id) of the audience groups are obtained, address information corresponding to the preset identifications is constructed in advance in a database of the batch calculation engine, and therefore batch message sending operation can be carried out purposefully.

And 103, acquiring preset identification of the target audience group from a database according to the matching condition.

In order to quickly find target data from a database in which a large amount of data is stored, an sql query statement can be constructed based on a matching condition and a preset sql statement template; and acquiring preset identification of the target audience group from the database through the sql query statement.

Illustratively, the sql query statement is "age 18-25, professional is a salesman", and when two persons a and b exist in the crowd, the identity information corresponding to each person is: a 'age 20, professional clerk', b 'age 10, professional student', obviously only a accords with the sql query statement, so that a is judged as audience crowd, and the preset identification of a is obtained.

And 104, sending the preset identification and the matching condition to a batch calculation engine constructed based on the workflow model to perform batch message generation operation and batch message sending operation.

In the embodiment, a batch computing engine constructed by a workflow model acquires a target message template corresponding to a preset identifier from a pre-constructed message template library according to the preset identifier; performing batch message generation operation based on the matching condition and the target message template to obtain a message to be sent corresponding to a preset identifier; and executing batch message sending operation on the messages to be sent.

By introducing a mode of independent operation and unified export of real-time computation and batch computation into a computation engine layer, namely splitting a real-time computation process and a batch computation process which are originally mixed together into two independently operated processes, conflicts between the real-time computation and the batch computation, such as timeliness and throughput capacity, are avoided, and the output of the same export is adopted, so that the independent operation cannot be seen on an application layer.

The real-time calculation and the batch calculation are carried out separately, and the problems that the troubleshooting link of the whole system is long and the positioning is inconvenient when the problems occur can be avoided.

In some embodiments, after the preset identifier and the matching condition are sent to a batch calculation engine constructed based on a workflow model to perform batch message generation operation and batch message sending operation, record information corresponding to the preset identifier may be recorded through a record table, where the record information includes the preset identifier, an execution state of the batch message sending operation, a historical timestamp for performing the batch message sending operation, and the like.

In some embodiments, the method further comprises the steps of:

judging whether a preset identification of a current audience group of the message to be received exists in a record table or not to obtain a judgment result;

if the judgment result is that the preset identification exists in the record table, the execution state is that the transmission is successful, and the time corresponding to the current timestamp is more than the preset threshold value from the time corresponding to the historical timestamp, the current audience group is judged to be repeatedly transmitted, the operation of transmitting batch messages to the current audience group is cancelled, and the same audience group is prevented from receiving the same messages for multiple times in a short time.

If the execution state is that the sending is failed, the batch message sending operation is executed again for the corresponding audience group.

All the above optional technical solutions may be combined arbitrarily to form optional embodiments of the present application, and are not described herein again.

In particular implementation, the present application is not limited by the execution sequence of the described steps, and some steps may be performed in other sequences or simultaneously without conflict.

As can be seen from the above, in the batch data processing method provided in the embodiment of the present application, when a trigger condition for indicating to execute a batch operation is triggered, batch operation request information corresponding to the trigger condition is generated; receiving the batch operation request information, and obtaining the matching condition of the message audience group according to the batch operation request information; receiving the request information, and obtaining the matching conditions of the message audience groups according to the request information; acquiring preset identification of a target audience group from a database according to the matching condition; and sending the preset identification and the matching condition to a batch calculation engine constructed based on a workflow model to perform batch message generation operation and batch message sending operation. By using the batch data processing method provided by the embodiment of the application, a mode of independent operation and unified export of real-time calculation and batch calculation is introduced into a calculation engine layer, namely, the original mixed real-time calculation process and batch calculation process are split into two independently operated processes, so that conflicts between the real-time calculation and the batch calculation, such as timeliness and throughput capacity, are avoided, and the output is realized through the same export, so that the independent operation cannot be seen on an application layer.

The embodiment of the application further provides a batch data processing system, and the batch data processing system can be integrated in the terminal equipment.

Referring to fig. 2, fig. 2 is a schematic structural diagram of a batch data processing system according to an embodiment of the present disclosure. The batch data processing system 30 may include:

the generation module 31 is configured to generate batch operation request information corresponding to a trigger condition when the trigger condition for instructing to execute a batch operation is triggered;

a receiving module 32, configured to receive the batch operation request information, and obtain a matching condition of a message audience group according to the batch operation request information;

the obtaining module 33 is configured to obtain a preset identifier of the target audience group from a database according to the matching condition;

and the sending module 34 is configured to send the preset identifier and the matching condition to a batch calculation engine constructed based on a workflow model to perform a batch message generation operation and a batch message sending operation.

In some embodiments, the obtaining module 33 is configured to construct an sql query statement based on the matching condition and a preset sql statement template; and acquiring preset identification of the target audience group from a database through the sql query statement.

In some embodiments, the sending module 34 is configured to, by a batch computing engine configured to construct a workflow model, obtain, according to the preset identifier, a target message template corresponding to the preset identifier from a message template library constructed in advance; performing batch message generation operation based on the matching condition and a target message template to obtain a message to be sent corresponding to the preset identifier; and executing batch message sending operation on the messages to be sent.

In some embodiments, the system further includes a recording module, configured to generate recording information corresponding to the preset identifier and store the recording information in a recording table, where the recording information includes the preset identifier, an execution state of the batch message sending operation, and a historical timestamp for performing the batch message sending operation.

In some embodiments, the system further includes a determining module, configured to determine whether a preset identifier of a current audience group of the message to be received exists in the record table, so as to obtain a determination result; if the judgment result is that the preset identification exists in the record table, the execution state is that the transmission is successful, and the distance between the time corresponding to the current timestamp and the time corresponding to the historical timestamp exceeds a preset threshold value, the current audience group is judged to be repeatedly transmitted, and batch message transmission operation on the current audience group is cancelled.

In some embodiments, the system further comprises an execution module for obtaining an execution status of the bulk messaging operation; and executing the batch message sending operation again on the audience group corresponding to the execution state of the sending failure.

In specific implementation, the modules may be implemented as independent entities, or may be combined arbitrarily and implemented as one or several entities.

As can be seen from the above, in the batch data processing system 30 provided in the embodiment of the present application, the generating module 31 is configured to generate batch operation request information corresponding to a trigger condition for instructing to execute a batch operation when the trigger condition is triggered; the receiving module 32 is configured to receive the batch operation request information, and obtain matching conditions of message audience groups according to the batch operation request information; the obtaining module 34 is configured to obtain a preset identifier of the target audience group from a database according to the matching condition; and the sending module 35 is configured to send the preset identifier and the matching condition to a batch calculation engine constructed based on a workflow model to perform a batch message generation operation and a batch message sending operation.

Referring to FIG. 3, FIG. 3 is another schematic diagram of a batch data processing system according to an embodiment of the present disclosure, the batch data processing system 30 includes a memory 120, one or more processors 180, and one or more applications, wherein the one or more applications are stored in the memory 120 and configured to be executed by the processors 180; the processor 180 may include a generation module 31, a reception module 32, an acquisition module 33, and a transmission module 34. For example, the structures and connection relationships of the above components may be as follows:

the memory 120 may be used to store applications and data. The memory 120 stores applications containing executable code. The application programs may constitute various functional modules. The processor 180 executes various functional applications and data processing by running the application programs stored in the memory 120. Further, the memory 120 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 120 may also include a memory controller to provide the processor 180 with access to the memory 120.

The processor 180 is a control center of the device, connects various parts of the entire terminal using various interfaces and lines, performs various functions of the device and processes data by running or executing an application program stored in the memory 120 and calling data stored in the memory 120, thereby monitoring the entire device. Optionally, processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application program, and the like.

Specifically, in this embodiment, the processor 180 loads the executable code corresponding to the process of one or more application programs into the memory 120 according to the following instructions, and the processor 180 runs the application programs stored in the memory 120, thereby implementing various functions:

generating instructions, when a trigger condition for instructing execution of batch operation is triggered, generating batch operation request information corresponding to the trigger condition;

receiving instructions, which are used for receiving the batch operation request information and obtaining the matching conditions of the message audience groups according to the batch operation request information;

an obtaining instruction, configured to obtain a preset identifier of a target audience group from a database according to the matching condition;

and sending an instruction, which is used for sending the preset identifier and the matching condition to a batch computing engine constructed based on a workflow model to perform batch message generation operation and batch message sending operation.

In some embodiments, the obtaining instruction is configured to construct an sql query statement based on the matching condition and a preset sql statement template; and acquiring preset identification of the target audience group from a database through the sql query statement.

In some embodiments, the instruction is sent, so that a batch computing engine for building a workflow model obtains a target message template corresponding to a preset identifier from a message template library built in advance according to the preset identifier; performing batch message generation operation based on the matching condition and a target message template to obtain a message to be sent corresponding to the preset identifier; and executing batch message sending operation on the message to be sent.

In some embodiments, the program further includes a recording instruction, configured to generate recording information corresponding to the preset identifier and store the recording information in a recording table, where the recording information includes the preset identifier, an execution state of the batch message sending operation, and a historical timestamp for performing the batch message sending operation.

In some embodiments, the program further includes a determining instruction, configured to determine whether a preset identifier of a current audience group to receive a message exists in the record table, to obtain a determination result; and if the judgment result shows that the preset identification exists in the record table, the execution state is that the transmission is successful, and the distance between the moment corresponding to the current timestamp and the moment corresponding to the historical timestamp exceeds a preset threshold value, judging that the current audience group is repeatedly transmitted, and canceling the batch message transmission operation on the current audience group.

In some embodiments, the program further comprises execution instructions for obtaining an execution status of the bulk messaging operation; and executing the batch message sending operation again on the audience group corresponding to the execution state of the sending failure.

The embodiment of the application also provides the terminal equipment. The terminal device can be a server, a smart phone, a computer, a tablet computer and the like.

Referring to fig. 4, fig. 4 is a schematic structural diagram of a terminal device provided in the embodiment of the present application, where the terminal device may be used to implement the batch data processing method provided in the foregoing embodiment. The terminal device 1200 may be a smart phone or a tablet computer.

As shown in fig. 4, the terminal device 1200 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more computer-readable storage media (only one shown in the figure), an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a transmission module 170, a processor 180 including one or more processing cores (only one shown in the figure), and a power supply 190. Those skilled in the art will appreciate that the terminal device 1200 configuration shown in fig. 4 does not constitute a limitation of terminal device 1200, and may include more or fewer components than those shown, or some components in combination, or a different arrangement of components. Wherein:

the RF circuit 110 is used for receiving and transmitting electromagnetic waves, and implementing interconversion between the electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices. The RF circuitry 110 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The RF circuitry 110 may communicate with various networks such as the internet, an intranet, a wireless network, or with other devices over a wireless network.

The memory 120 may be configured to store a software program and a module, such as program instructions/modules corresponding to the batch data processing method in the foregoing embodiment, and the processor 180 executes various functional applications and data processing by operating the software program and the module stored in the memory 120, and may automatically select a vibration alert mode according to a current scene where the terminal device is located to perform data update, so as to ensure that not only a scene such as a conference is not disturbed, but also a user can sense an incoming call, and improve intelligence of the terminal device. Memory 120 may include high speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 120 may further include memory located remotely from the processor 180, which may be connected to the terminal device 1200 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input unit 130 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input unit 130 may include a touch-sensitive surface 131 as well as other input devices 132. Touch-sensitive surface 131, also referred to as a touch-sensitive display screen or touch pad, may collect touch operations by a user on or near it (e.g., operations by a user on touch-sensitive surface 131 or near touch-sensitive surface 131 using a finger, a stylus, or any other suitable object or attachment), and actuate the corresponding connection device according to a predetermined program. Alternatively, the touch-sensitive surface 131 may comprise two parts, a touch detection device and a touch controller. The touch detection device detects a touch direction of a user, detects a signal brought by touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 180, and receives and executes commands sent by the processor 180. Additionally, the touch-sensitive surface 131 may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. In addition to touch-sensitive surface 131, input unit 130 may include other input devices 132. In particular, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 140 may be used to display information input by a user or information provided to the user and various graphic user interfaces of the terminal apparatus 1200, which may be configured by graphics, text, icons, video, and any combination thereof. The Display unit 140 may include a Display panel 141, and optionally, the Display panel 141 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface 131 may cover the display panel 141, and when a touch operation is detected on or near the touch-sensitive surface 131, the touch operation is transmitted to the processor 180 to determine the type of the touch event, and then the processor 180 provides a corresponding visual output on the display panel 141 according to the type of the touch event. Although in FIG. 4, touch-sensitive surface 131 and display panel 141 are shown as two separate components to implement input and output functions, in some embodiments, touch-sensitive surface 131 may be integrated with display panel 141 to implement input and output functions.

The terminal device 1200 may also include at least one sensor 150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 141 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 141 and/or the backlight when the terminal device 1200 is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which may be further configured in the terminal device 1200, detailed descriptions thereof are omitted.

The audio circuitry 160, speaker 161, microphone 162 may provide an audio interface between the user and the terminal device 1200. The audio circuit 160 may transmit the electrical signal converted from the received audio data to the speaker 161, and convert the electrical signal into a sound signal for output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electric signal, converts the electric signal into audio data after being received by the audio circuit 160, and then outputs the audio data to the processor 180 for processing, and then to the RF circuit 110 to be transmitted to, for example, another terminal, or outputs the audio data to the memory 120 for further processing. The audio circuitry 160 may also include an earbud jack to provide communication of peripheral headphones with the terminal device 1200.

The terminal device 1200, through the transmission module 170 (e.g., wi-Fi module), may assist the user in e-mail, web browsing, streaming media access, etc., which provides the user with wireless broadband internet access. Although fig. 4 shows the transmission module 170, it is understood that it does not belong to the essential constitution of the terminal device 1200, and may be omitted entirely as needed within a range not changing the essence of the invention.

The processor 180 is a control center of the terminal device 1200, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the terminal device 1200 and processes data by running or executing software programs and/or modules stored in the memory 120 and calling data stored in the memory 120, thereby performing overall monitoring of the mobile phone. Optionally, processor 180 may include one or more processing cores; in some embodiments, the processor 180 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 180.

Terminal device 1200 also includes a power supply 190 for powering the various components, which in some embodiments may be logically coupled to processor 180 via a power management system to manage power discharge and power consumption via the power management system. The power supply 190 may also include any component including one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown, the terminal device 1200 may further include a camera (e.g., a front camera, a rear camera), a bluetooth module, and the like, which are not described in detail herein. Specifically, in this embodiment, the display unit 140 of the terminal device 1200 is a touch screen display, and the terminal device 1200 further includes a memory 120 and one or more programs, wherein the one or more programs are stored in the memory 120 and configured to be executed by the one or more processors 180, and the one or more programs include instructions for:

In some embodiments, the instruction is sent, so that a batch computing engine for building a workflow model obtains a target message template corresponding to a preset identifier from a message template library built in advance according to the preset identifier; performing batch message generation operation based on the matching condition and a target message template to obtain a message to be sent corresponding to the preset identifier; and executing batch message sending operation on the messages to be sent.

In some embodiments, the program further includes a determining instruction, configured to determine whether a preset identifier of a current audience group to receive a message exists in the record table, to obtain a determination result; if the judgment result is that the preset identification exists in the record table, the execution state is that the transmission is successful, and the distance between the time corresponding to the current timestamp and the time corresponding to the historical timestamp exceeds a preset threshold value, the current audience group is judged to be repeatedly transmitted, and batch message transmission operation on the current audience group is cancelled.

The embodiment of the application also provides the terminal equipment. The terminal equipment can be equipment such as a smart phone and a computer.

As can be seen from the above, an embodiment of the present application provides a terminal device 1200, where the terminal device 1200 executes the following steps:

receiving the batch operation request information, and obtaining the matching condition of the message audience group according to the batch operation request information;

An embodiment of the present application further provides a storage medium, where a computer program is stored in the storage medium, and when the computer program runs on a computer, the computer executes the batch data processing method according to any one of the above embodiments.

It should be noted that, for the batch data processing method described in this application, a person skilled in the art may understand that all or part of the processes for implementing the batch data processing method described in this application may be implemented by controlling related hardware through a computer program, where the computer program may be stored in a computer readable storage medium, such as a memory of a terminal device, and executed by at least one processor in the terminal device, and during the execution process, the processes of the embodiments of the batch data processing method may be included. The storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.

For the batch data processing system in the embodiment of the present application, each functional module may be integrated into one processing chip, or each module may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, or the like.

The batch data processing method, device, medium, and apparatus provided in the embodiments of the present application are described in detail above. The principle and the implementation of the present application are explained herein by applying specific examples, and the above description of the embodiments is only used to help understand the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A batch data processing method, comprising:

2. The batch data processing method of claim 1, wherein the obtaining of the preset identification of the target audience segment from the database according to the matching condition comprises:

3. The batch data processing method of claim 1, wherein sending the preset identifier and the matching condition to a batch calculation engine constructed based on a workflow model for batch message generation and sending operations comprises:

and executing batch message sending operation on the messages to be sent.

4. The batch data processing method of claim 1, wherein after sending the preset identifier and the matching condition to a batch computation engine constructed based on a workflow model for a batch message generation operation and a batch message sending operation, the method further comprises:

5. The batch data processing method of claim 4, wherein the method further comprises:

judging whether the preset identification of the current audience group of the message to be received exists in the record table or not to obtain a judgment result;

6. The batch data processing method of claim 4, wherein after sending the preset identification and matching condition to a batch computation engine built based on a workflow model for a batch message generation operation and a batch message sending operation, the method further comprises:

acquiring the execution state of the batch message sending operation;

7. A batch data processing system, comprising:

the generating module is used for generating batch operation request information corresponding to a trigger condition when the trigger condition for indicating the execution of batch operation is triggered;

the receiving module is used for receiving the batch operation request information and obtaining the matching conditions of the message audience groups according to the batch operation request information;

the acquisition module is used for acquiring preset identifications of target audience groups from a database according to the matching conditions;

and the sending module is used for sending the preset identification and the matching condition to a batch calculation engine constructed based on the workflow model to perform batch message generation operation and batch message sending operation.

8. The batch data processing system of claim 7, wherein the sending module is configured to obtain, by a batch computing engine configured to build a workflow model, a target message template corresponding to a preset identifier from a pre-built message template library according to the preset identifier; performing batch message generation operation based on the matching condition and a target message template to obtain a message to be sent corresponding to the preset identifier; and executing batch message sending operation on the messages to be sent.

9. A computer-readable storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the batch data processing method of any one of claims 1 to 6.

10. A terminal device comprising a processor and a memory, the memory storing a plurality of instructions, the processor loading the instructions to perform the batch data processing method of any one of claims 1 to 6.