CN112348713A - QLRunner-based data processing method, device, electronic equipment and medium - Google Patents

QLRunner-based data processing method, device, electronic equipment and medium Download PDF

Info

Publication number
CN112348713A
CN112348713A CN202011025596.2A CN202011025596A CN112348713A CN 112348713 A CN112348713 A CN 112348713A CN 202011025596 A CN202011025596 A CN 202011025596A CN 112348713 A CN112348713 A CN 112348713A
Authority
CN
China
Prior art keywords
message
service
change
data
epx
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011025596.2A
Other languages
Chinese (zh)
Inventor
于志博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beike Technology Co Ltd
Original Assignee
Beike Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beike Technology Co Ltd filed Critical Beike Technology Co Ltd
Priority to CN202011025596.2A priority Critical patent/CN112348713A/en
Publication of CN112348713A publication Critical patent/CN112348713A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/16Real estate
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating

Abstract

The embodiment of the invention provides a data processing method, a device, electronic equipment and a medium based on QLRunner, wherein the method comprises the following steps: the QLRunner engine acquires the customized data message and/or the EPX message generated when the house source service data is changed from the message queue; verifying the customized data message and/or the EPX message according to a preset verification rule to generate a corresponding service change message; and sending the service change message to a corresponding service change output service so that the service party can know the change condition of the house source service data through the service change output service. The embodiment of the invention can determine the changed content according to the house source service data change and send the corresponding change notice in real time, so that a service party can sense the specific change condition of the house source service data in time, and further, the service requirement is better met.

Description

QLRunner-based data processing method, device, electronic equipment and medium
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a QLRunner-based data processing method, apparatus, electronic device, and medium.
Background
The service party has a real-time perception demand for house source service data change when acquiring the house source data, however, at present, the service party can only perform manual query and the like to determine the change condition of the house source service data, which is very troublesome and easy to forget, resulting in information inequality.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a QLRunner-based data processing method, a QLRunner-based data processing device, an electronic device and a medium, which can enable a business party to sense the specific change condition of house source business data in time, further meet business appeal and improve business service experience of the business party.
In order to solve the technical problems, the invention provides the following technical scheme:
in a first aspect, the present invention provides a QLRunner-based data processing method, including:
the QLRunner engine acquires the customized data message and/or the EPX message generated when the house source service data is changed from the message queue;
verifying the customized data message and/or the EPX message according to a preset verification rule to generate a corresponding service change message;
and sending the service change message to a corresponding service change output service so that the service party can know the change condition of the house source service data through the service change output service.
Further, the EPX message comprises changed field content in the message, all field content in the message, a generated unique identifier of a random character string, a database name, a primary key ID in a data table, a data table name, a field for identifying the time of data change, a random character string for tracking the character string and the operation type of the data table, and the customized data message comprises different business type data, a unique primary key in the message change, a unique identifier of message tracing, the generation time of the message change, the generation time of message action, extended field content for adding additional data information and a field for carrying data source information of a data source identifier.
Further, the verifying rule includes a first verifying rule for verifying each field in the EPX message and a second verifying rule for verifying each field in the customized data message, and the verifying the customized data message and/or the EPX message according to a preset verifying rule generates a corresponding service change message, including:
analyzing the EPX message according to the first check rule to obtain each field of the EPX message;
checking each field in the EPX message, determining a change item of the room source service data, and generating a corresponding service change message according to the change item; and/or the presence of a gas in the gas,
analyzing the customized data message according to the second check rule to obtain each field of the customized data message;
and checking each field in the customized data message, determining a change item of the customized data, and generating a corresponding service change message according to the change item.
Further, the service change output service includes a house source message change service, a customer source message change service, a sign-in message change service, and a platform client message change service, and the service change message is issued to the corresponding service change output service, so that a service party can know the change condition of the house source service data through the service change output service, including:
and selecting corresponding service change output service according to the change item of the customized data message and/or the change item of the house source service data, and sending the service change message to the corresponding service change output service, so that a service party can know the change condition of the house source service data through the service change output service.
Further, still include: and after the service change message is sent to the corresponding service change output service, the service change output service pushes the service change message to a service party subscribing the service change output service.
Further, the business party subscribes at least one of the room source message changing service, the customer source message changing service, the sign-on message changing service and the platform client message changing service in advance.
Further, when the customized data message and/or the EPX message are verified according to a preset verification rule and a corresponding service change message is generated, the method further includes:
judging whether the customized data message and/or the EPX message are abnormal or not;
if yes, further judging whether the check rule is normal;
if yes, after delaying for a preset time, checking the customized data message and/or the EPX message again.
In a second aspect, the present invention provides a QLRunner-based data processing apparatus, comprising:
the acquisition module is used for acquiring the customized data message and/or the EPX message generated when the house source service data is changed from the message queue;
the generating module is used for verifying the customized data message and/or the EPX message according to a preset verification rule and generating a corresponding service change message;
and the issuing module is used for issuing the service change message to the corresponding service change output service so that the service party can acquire the change condition of the house source service data through the service change output service.
Further, the EPX message comprises changed field content in the message, all field content in the message, a generated unique identifier of a random character string, a database name, a primary key ID in a data table, a data table name, a field for identifying the time of data change, a random character string for tracking the character string and the operation type of the data table, and the customized data message comprises different business type data, a unique primary key in the message change, a unique identifier of message tracing, the generation time of the message change, the generation time of message action, extended field content for adding additional data information and a field for carrying data source information of a data source identifier.
Further, the check rule includes a first check rule for checking each field in the EPX message and a second check rule for checking each field in the customized data message, and the generating module is specifically configured to:
analyzing the EPX message according to the first check rule to obtain each field of the EPX message;
checking each field in the EPX message, determining a change item of the room source service data, and generating a corresponding service change message according to the change item; and/or the presence of a gas in the gas,
analyzing the customized data message according to the second check rule to obtain each field of the customized data message;
and checking each field in the customized data message, determining a change item of the customized data, and generating a corresponding service change message according to the change item.
Further, the service change output service includes a room source message change service, a customer source message change service, an in-sign message change service, and a platform client message change service, and the issuing module is specifically configured to:
and selecting corresponding service change output service according to the change item of the customized data message and/or the change item of the house source service data, and sending the service change message to the corresponding service change output service, so that a service party can know the change condition of the house source service data through the service change output service.
Further, the service change output service is configured to, after receiving a corresponding service change message, push the service change message to a service party subscribing to the service change output service.
Further, the business party subscribes at least one of the room source message changing service, the customer source message changing service, the sign-on message changing service and the platform client message changing service in advance.
Further, when the generation module verifies the customized data message and/or the EPX message according to a preset verification rule and generates a corresponding service change message, the generation module is further configured to:
judging whether the customized data message and/or the EPX message are abnormal or not;
if yes, further judging whether the check rule is normal;
if yes, after delaying for a preset time, checking the customized data message and/or the EPX message again.
In a third aspect, the present invention provides an electronic device, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the QLRunner-based data processing method when executing the program.
In a fourth aspect, the present invention provides a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, performs the steps of the QLRunner-based data processing method.
According to the technical scheme, the QLRunner-based data processing method, the device, the electronic equipment and the medium provided by the invention have the advantages that when the house source service data is changed, the QLRunner engine can determine the changed content according to the change of the house source service data and send corresponding change notification in real time, so that a service party can sense the specific change condition of the house source service data in real time, further, the service appeal is met, and the service experience of the service party is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart of a QLRunner-based data processing method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a QLRunner-based data processing method according to an embodiment of the present invention;
fig. 3 is a schematic format diagram of an EPX message based on the QLRunner data processing method according to an embodiment of the present invention;
fig. 4 is a schematic format diagram of a customized data message of the QLRunner-based data processing method according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating checking of a customized data message and/or the EPX message in the QLRunner-based data processing method according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a service subscription output component in the QLRunner-based data processing method according to an embodiment of the present invention;
fig. 7 is a schematic diagram of exception data processing in the QLRunner-based data processing method according to an embodiment of the present invention;
fig. 8 is a block diagram of a QLRunner-based data processing apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
A QLRunner-based data processing method, apparatus, electronic device, and medium according to embodiments of the present invention are described below with reference to the accompanying drawings.
Fig. 1 is a flowchart of a QLRunner-based data processing method according to an embodiment of the present invention. As shown in fig. 1, the QLRunner-based data processing method according to an embodiment of the present invention includes the steps of:
s101: the QLRunner engine retrieves from the message queue the customized data message and/or the EPX message generated when the house-sourced business data is changed.
As shown in fig. 2, the data sources mainly include customized data messages and EPX messages generated by the change of the house source business data in the database. In specific application, the house source service data is stored in a MySQl database, and the EPX message can be obtained according to a binlog log.
The customized data message and/or the EPX message generated when the house-sourced business data is changed may be stored in a message queue, respectively, and the QLRunner engine (i.e., internal processing engine) reads the EPX message and the customized data message from the message queue.
The change of the house source business data may be a change of various data in the house source, for example: the rate of the house source changes.
In one embodiment of the invention, an EPX message includes, but is not limited to, the contents of the fields changed in the message, the contents of all the fields in the message, the unique identification of the random string generated, the name of the database, the primary key ID in the data table, the name of the data table, the time of day to identify the data change, the random string used to track the string, and the fields for the type of operation on the data table; the customized data message includes, but is not limited to, different service type data, a unique primary key in a message change, a unique identifier of the message change, a unique identifier of a message tracing back, a generation time of the message change, a generation time of a message action, an extension field content for adding additional data information, and a field for carrying data source information of a data source identifier.
As shown in FIG. 3, the format content of the EPX message is shown, wherein the meaning of the fields in the content is described as follows.
Changed: the contents of the fields changed in the message; content: all field contents in the message; generating a unique identifier of the random character string; dataBase: a database name; id:
primary key ID in data table; table: a data table name; timing and map: a timestamp identifying the time of the data change; traceId: a random string for tracking the string; type: the type of operation on the data table.
As shown in fig. 4, the format content of the customized data message is shown, wherein the meaning of the fields in the content is described as follows.
Type: data representing different types of services, such as house sources, customer sources, sign on, etc.;
key: represents the only primary key in the message change; eventType: a unique identification of the message change; traceId: a unique identifier for message tracing; createTime: the generation time of the message change; actionTime: the time at which the message action occurred; extraParam: expanding field content, wherein the function of the expanding field content is used for adding additional data information; source: and the data source information is used for carrying a data source identifier.
S102: and verifying the customized data message and/or the EPX message according to a preset verification rule to generate a corresponding service change message.
Specifically, the checking rules include, for example, a first checking rule for checking each field in the EPX message and a second checking rule for checking each field in the customized data message, and then the customized data message and/or the EPX message are checked according to a preset checking rule to generate a corresponding service change message, including: analyzing the EPX message according to the first check rule to obtain each field of the EPX message; checking each field in the EPX message, determining a change item of the room source service data, and generating a corresponding service change message according to the change item; and/or analyzing the customized data message according to the second check rule to obtain each field of the customized data message; and checking each field in the customized data message, determining a change item of the customized data, and generating a corresponding service change message according to the change item.
As a specific example, as shown in fig. 5, first, a rule script (i.e., a check rule) is obtained by configuring a first check rule and a second check rule through a rule script configuration platform, and then, a data source (i.e., a customized data message and/or an EPX message) is analyzed through the rule script to determine a corresponding service change message. Namely: and (3) operating the customized data message and/or the EPX message and the configured rule script through a QLRunner engine to generate a room source service dynamic change message, namely analyzing the EPX message and the customized data message in real time through the QLRunner engine.
In the above description, the QLRunner engine operates on the data source according to the rule script, thereby dynamically generating the service change message. For example: for the EPX message, it is assumed that the Changed field is Changed, and the content of the Changed field in the Changed field is the room price, the generated service change message is the room price change message. For another example, for the customized data message, the Type field identifies that the service Type data is in sign, the eventType field may be a unique identifier corresponding to a change in sign, and the generated service change message is a change in sign message.
S103: and sending the service change message to a corresponding service change output service so that the service party can know the change condition of the house source service data through the service change output service.
As shown in fig. 2 and fig. 6, if the service change output service includes, but is not limited to, a house source message change service, a customer source message change service, an in-sign message change service, and a platform client message change service, the service change message is issued to the corresponding service change output service, so that the service party can obtain the change condition of the house source service data through the service change output service, including: and selecting corresponding service change output service according to the change item of the customized data message and/or the change item of the house source service data, and sending the service change message to the corresponding service change output service, so that a service party can know the change condition of the house source service data through the service change output service.
The service of changing the output of the business may also be referred to as an output component, and each output component may be configured in advance, for example: configuring changes of the service data of each room source to correspond to each output component one by one, for example: the room price changing message corresponds to the output component of the room source message change, so after configuration, the QLRunner engine issues different service changing messages to different output components according to the configured output component.
And after the service change message is sent to the corresponding service change output service, the service change output service pushes the service change message to a service party subscribing the service change output service. The service convenience can sense the change condition of the house source service data in time.
According to the data processing method based on the QLRunner, when the house source service data is changed, the QLRunner engine can determine the changed content according to the change of the house source service data and send corresponding change notification in real time, so that a service party can sense the specific change condition of the house source service data in time, further, the service appeal is met, and the service experience of the service party is improved.
Due to the change of the house source business data, various types exist, such as: house price changes, sign changes, etc., and different business parties may be interested in different points, such as: therefore, in order to meet the requirements of different business parties, in the embodiment of the present invention, a business party may subscribe to at least one of a room source message change service, a customer source message change service, a sign message change service, and a platform client message change service in advance, for example: the business party A subscribes the house source message change service, and the business party B subscribes the sign message change service, so that the messages can be pushed to the business party A in the real time when the house price is changed, and the messages can be pushed to the business party B in time when the sign is changed, so that the business party is prevented from receiving data which is not concerned, the concerned points can be automatically focused on the other hand, and the use experience of the business party is improved.
When the customized data message and/or the EPX message are verified according to a preset verification rule and a corresponding service change message is generated, the method further includes: judging whether the customized data message and/or the EPX message are abnormal or not; if yes, further judging whether the check rule is normal; if yes, after delaying for a preset time, checking the customized data message and/or the EPX message again.
In a specific example, as shown in fig. 7, when there is an abnormality in the customized data message and/or the EPX message, firstly, the abnormal data is placed in the compensation queue, a part of the abnormal data information is pulled and placed in the delay queue, whether the configured rule script is normal is determined, if the rule script is normal, the abnormal data is calculated after a predetermined time (e.g., 1 minute) is delayed, a service change message is generated, and the service change message is issued.
Of course, before the abnormal data is operated, if the rule script has a problem, the rule script needs to be changed first, and after the problem of the rule script is solved and is delayed for a preset time, for example, the time is delayed for 1 minute, the abnormal data is operated again until the abnormal data is completely processed. Therefore, the reliability of the method for data processing is effectively improved.
Fig. 8 is a block diagram of a QLRunner-based data processing apparatus according to an embodiment of the present invention. As shown in fig. 8, the QLRunner-based data processing apparatus according to an embodiment of the present invention includes: the system comprises an acquisition module 810, a generation module 820 and a sending module 830, wherein:
an obtaining module 810, configured to obtain, from the message queue, an EPX message generated when the customized data message and/or the room source service data is changed;
a generating module 820, configured to verify the customized data message and/or the EPX message according to a preset verification rule, and generate a corresponding service change message;
the issuing module 830 is configured to issue the service change message to a corresponding service change output service, so that a service party obtains a change condition of the house source service data through the service change output service.
In an embodiment of the present invention, the EPX message includes a field content of a change in the message, a field content of all fields in the message, a unique identifier of a generated random character string, a database name, a primary key ID in a data table, a data table name, a field for identifying a time of data change, a random character string for tracking the character string, and a type of operation on the data table, and the customized data message includes different service type data, a unique primary key in the message change, a unique identifier of message tracing, a generation time of the message change, a generation time of a message action, an extension field content for adding additional data information, and a field for carrying data source information of a data source identifier.
In an embodiment of the present invention, the check rule includes a first check rule for checking each field in the EPX message and a second check rule for checking each field in the customized data message, and the generating module 820 is specifically configured to:
analyzing the EPX message according to the first check rule to obtain each field of the EPX message;
checking each field in the EPX message, determining a change item of the room source service data, and generating a corresponding service change message according to the change item; and/or the presence of a gas in the gas,
analyzing the customized data message according to the second check rule to obtain each field of the customized data message;
and checking each field in the customized data message, determining a change item of the customized data, and generating a corresponding service change message according to the change item.
In an embodiment of the present invention, the service change output service includes a room source message change service, a customer source message change service, an on-sign message change service, and a platform client message change service, and the issuing module 830 is specifically configured to:
and selecting corresponding service change output service according to the change item of the customized data message and/or the change item of the house source service data, and sending the service change message to the corresponding service change output service, so that a service party can know the change condition of the house source service data through the service change output service.
In an embodiment of the present invention, the service change output service is configured to, after receiving a corresponding service change message, push the service change message to a service party subscribing to the service change output service.
In an embodiment of the present invention, the service party subscribes to at least one of the room source message change service, the customer source message change service, the on-sign message change service, and the platform client message change service in advance.
In an embodiment of the present invention, when the generating module 820 verifies the customized data message and/or the EPX message according to a preset verification rule to generate a corresponding service change message, it is further configured to:
judging whether the customized data message and/or the EPX message are abnormal or not;
if yes, further judging whether the check rule is normal;
if yes, after delaying for a preset time, checking the customized data message and/or the EPX message again.
According to the data processing device based on the QLRunner, when the house source service data is changed, the QLRunner engine can determine the changed content according to the change of the house source service data and send corresponding change notification in real time, so that a service party can sense the specific change condition of the house source service data in time, further, the service appeal is met, and the service experience of the service party is improved.
In addition, a specific implementation manner of the QLRunner-based data processing apparatus according to the embodiment of the present invention is similar to a specific implementation manner of the QLRunner-based data processing method according to the embodiment of the present invention, and for a specific description, reference is made to the description of the method section, and details are not described here in order to reduce redundancy.
In an embodiment of the present invention, a specific implementation manner of an electronic device capable of implementing all steps in the QLRunner-based data processing method in the foregoing embodiment is provided, and referring to fig. 9, the electronic device specifically includes the following contents:
a processor (processor)901, a memory (memory)902, a communication Interface (Communications Interface)903, and a bus 904;
the processor 901, the memory 902 and the communication interface 903 complete mutual communication through the bus 904; the communication interface 903 is used for realizing information transmission between the server and the client;
the processor 901 is configured to call the computer program in the memory 902, and the processor implements all the steps in the above embodiments when executing the computer program, for example, the processor implements the following steps when executing the computer program: the QLRunner engine acquires the customized data message and/or the EPX message generated when the house source service data is changed from the message queue; verifying the customized data message and/or the EPX message according to a preset verification rule to generate a corresponding service change message; and sending the service change message to a corresponding service change output service so that the service party can know the change condition of the house source service data through the service change output service.
An embodiment of the present invention provides a computer-readable storage medium capable of implementing all the steps in the QLRunner-based data processing method of the above-described embodiment, where the computer-readable storage medium stores thereon a computer program, and the computer program implements all the steps of the above-described embodiment when being executed by a processor, for example, the processor implements the following steps when executing the computer program: the QLRunner engine acquires the customized data message and/or the EPX message generated when the house source service data is changed from the message queue; verifying the customized data message and/or the EPX message according to a preset verification rule to generate a corresponding service change message; and sending the service change message to a corresponding service change output service so that the service party can know the change condition of the house source service data through the service change output service.
In addition, the logic instructions in the memory may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. Based on such understanding, the above technical solutions may be essentially or partially implemented in the form of software products, which may be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and include instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the index monitoring method according to the embodiments or some parts of the embodiments.
Furthermore, in the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A QLRunner-based data processing method, comprising:
the QLRunner engine acquires the customized data message and/or the EPX message generated when the house source service data is changed from the message queue;
verifying the customized data message and/or the EPX message according to a preset verification rule to generate a corresponding service change message;
and sending the service change message to a corresponding service change output service so that the service party can know the change condition of the house source service data through the service change output service.
2. The QLRunner-based data processing method according to claim 1, wherein the EPX message comprises changed field contents in the message, all field contents in the message, unique identifier of generated random string, database name, primary key ID in data table, data table name, time of identifying data change, random string for tracking string and field of operation type of data table, and the customized data message comprises different service type data, unique primary key in message change, unique identifier of message trace back, generation time of message change, generation time of message action, extended field contents for adding additional data information, and field of data source information for carrying data source identifier.
3. The QLRunner-based data processing method according to claim 2, wherein the check rule comprises a first check rule for checking each field in the EPX message and a second check rule for checking each field in the customized data message, and the checking the customized data message and/or the EPX message according to a preset check rule generates the corresponding service change message, comprising:
analyzing the EPX message according to the first check rule to obtain each field of the EPX message;
checking each field in the EPX message, determining a change item of the room source service data, and generating a corresponding service change message according to the change item; and/or the presence of a gas in the gas,
analyzing the customized data message according to the second check rule to obtain each field of the customized data message;
and checking each field in the customized data message, determining a change item of the customized data, and generating a corresponding service change message according to the change item.
4. The QLRunner-based data processing method according to claim 3, wherein the service change output service comprises a room source message change service, a customer source message change service, an in-sign message change service and a platform client message change service, and the issuing of the service change message to the corresponding service change output service is performed so that the service party can obtain the change condition of the room source service data through the service change output service, comprising:
and selecting corresponding service change output service according to the change item of the customized data message and/or the change item of the house source service data, and sending the service change message to the corresponding service change output service, so that a service party can know the change condition of the house source service data through the service change output service.
5. The QLRunner-based data processing method according to claim 4, further comprising: and after the service change message is sent to the corresponding service change output service, the service change output service pushes the service change message to a service party subscribing the service change output service.
6. The QLRunner-based data processing method according to claim 5, wherein said business party subscribes to at least one of said room-sourced message change service, customer-sourced message change service, in-sign message change service and platform client message change service in advance.
7. The QLRunner-based data processing method according to claim 1, wherein when the customized data message and/or the EPX message is checked according to a preset check rule to generate a corresponding service change message, further comprising:
judging whether the customized data message and/or the EPX message are abnormal or not;
if yes, further judging whether the check rule is normal;
if yes, after delaying for a preset time, checking the customized data message and/or the EPX message again.
8. A QLRunner-based data processing apparatus, comprising:
the acquisition module is used for acquiring the customized data message and/or the EPX message generated when the house source service data is changed from the message queue;
the generating module is used for verifying the customized data message and/or the EPX message according to a preset verification rule and generating a corresponding service change message;
and the issuing module is used for issuing the service change message to the corresponding service change output service so that the service party can acquire the change condition of the house source service data through the service change output service.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the QLRunner-based data processing method according to any of claims 1 to 7 are implemented when the processor executes the program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the QLRunner-based data processing method according to any one of claims 1 to 7.
CN202011025596.2A 2020-09-25 2020-09-25 QLRunner-based data processing method, device, electronic equipment and medium Pending CN112348713A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011025596.2A CN112348713A (en) 2020-09-25 2020-09-25 QLRunner-based data processing method, device, electronic equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011025596.2A CN112348713A (en) 2020-09-25 2020-09-25 QLRunner-based data processing method, device, electronic equipment and medium

Publications (1)

Publication Number Publication Date
CN112348713A true CN112348713A (en) 2021-02-09

Family

ID=74360431

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011025596.2A Pending CN112348713A (en) 2020-09-25 2020-09-25 QLRunner-based data processing method, device, electronic equipment and medium

Country Status (1)

Country Link
CN (1) CN112348713A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140100956A1 (en) * 2012-10-05 2014-04-10 Redfin Corporation Providing fast alerts for rapidly changing real estate data
US20150301875A1 (en) * 2014-04-22 2015-10-22 Andreas Harnesk Persisting and managing application messages
WO2015183016A1 (en) * 2014-05-29 2015-12-03 삼성에스디에스 주식회사 Data processing device and method for checking data recorded on memory of data processing device
CN108229907A (en) * 2017-12-06 2018-06-29 链家网(北京)科技有限公司 A kind of regular variation and system based on expression formula engine
CN109064345A (en) * 2018-08-14 2018-12-21 中国平安人寿保险股份有限公司 Message treatment method, system and computer readable storage medium
CN109474578A (en) * 2018-10-17 2019-03-15 平安健康保险股份有限公司 Message method of calibration, device, computer equipment and storage medium
CN111651471A (en) * 2020-04-30 2020-09-11 中国平安财产保险股份有限公司 Target data query method and device, electronic equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140100956A1 (en) * 2012-10-05 2014-04-10 Redfin Corporation Providing fast alerts for rapidly changing real estate data
US20150301875A1 (en) * 2014-04-22 2015-10-22 Andreas Harnesk Persisting and managing application messages
WO2015183016A1 (en) * 2014-05-29 2015-12-03 삼성에스디에스 주식회사 Data processing device and method for checking data recorded on memory of data processing device
CN108229907A (en) * 2017-12-06 2018-06-29 链家网(北京)科技有限公司 A kind of regular variation and system based on expression formula engine
CN109064345A (en) * 2018-08-14 2018-12-21 中国平安人寿保险股份有限公司 Message treatment method, system and computer readable storage medium
CN109474578A (en) * 2018-10-17 2019-03-15 平安健康保险股份有限公司 Message method of calibration, device, computer equipment and storage medium
CN111651471A (en) * 2020-04-30 2020-09-11 中国平安财产保险股份有限公司 Target data query method and device, electronic equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
奕X: "MySQL实时监听——EPX", 《HTTPS://WWW.INFOQ.CN/ARTICLE/XXYOQEYWXNHXVSCAW060》 *

Similar Documents

Publication Publication Date Title
CN108874558B (en) Message subscription method of distributed transaction, electronic device and readable storage medium
CN113779444B (en) Interface development method, zero code engine and zero code data interface development system
CN105827706A (en) Information push device and method
CA2922129C (en) Automatically generating certification documents
CN106648698A (en) Method and device for displaying message notification and electronic equipment
CN112767113A (en) Account checking data processing method, device and system based on block chain
CN109299193A (en) Method of data synchronization and relevant device
CN110728498A (en) Information interaction method and device
US8843587B2 (en) Retrieving availability information from published calendars
CN111460038A (en) Quasi-real-time data synchronization method and device
US20190089633A1 (en) Reconstructing message flows based on hash values
CN110971447A (en) Test information management method and device, electronic equipment and readable storage medium
CN112348713A (en) QLRunner-based data processing method, device, electronic equipment and medium
CN111582996B (en) Service information display method and device
CN113992352A (en) Message pushing method and device, electronic equipment and storage medium
CN114677138A (en) Data processing method, data processing equipment and computer readable storage medium
CN111209540A (en) Information verification method, device and storage medium
CN109471790A (en) Send nuclear parameter comparison method and device, computer installation and readable storage medium storing program for executing
CN111917633B (en) Message sending method, sending device, electronic equipment and storage medium
CN110019352B (en) Method and apparatus for storing data
CN111045723B (en) Method and device for notifying code change between associated systems
CN116723167A (en) Message sending method and device
CN117793203A (en) Service data processing system, method and cloud server
CN114240564A (en) Order synchronization method and device, electronic equipment and storage medium
CN114676153A (en) Data subscription method and device and proxy subscription equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination