CN110852778A

CN110852778A - Data processing method and device for business object

Info

Publication number: CN110852778A
Application number: CN201910942056.1A
Authority: CN
Inventors: 叶帅; 孙会业; 问志光; 陈峤; 张凯瑞; 罗劼
Original assignee: Oral Communication (beijing) Network Technology Co Ltd
Current assignee: Oral Communication (beijing) Network Technology Co Ltd
Priority date: 2019-09-30
Filing date: 2019-09-30
Publication date: 2020-02-28
Anticipated expiration: 2039-09-30
Also published as: CN110852778B; WO2021062959A1

Abstract

The application discloses a data processing method aiming at a business object, which comprises the steps of obtaining source data related to the business object; acquiring list data of the business object according to the source data, and storing the list data into data storage equipment; then, acquiring data change information related to the business object in the data storage device; and acquiring real-time engine data of the business object according to the data change message. Compared with the mode that additional development work is needed when real-time engine data are acquired in the prior art, the method stores the list data of the business object by adding the data storage device, acquires the data change message of the data storage device, and synchronizes the engine data in the data engine according to the data change message, so that the real-time engine data of the business object can be acquired efficiently in real time.

Description

Data processing method and device for business object

Technical Field

The present application relates to the field of internet, and in particular, to a method, an apparatus, and a system for processing data of a business object. The application further relates to a data processing method, device and system for the store. The application also relates to a data display method and device for the business object and a data display method and device for the store.

Background

In recent years, with the development of internet technology, the use of application programs is distributed in all aspects of people's life, and great convenience is brought to people's life.

In daily life, a user can quickly acquire interesting information through corresponding application programs, for example, the application programs related to diet service can quickly search the information of stores with higher ranks in the diet ranking list, and further can select the stores with higher ranks to have dinner or order for takeout; or, the application program providing the hair cutting service can quickly search the information of the barber shop with higher ranking in the barber ranking list, and then the barber shop is barber at the related barber shop, and the like. When an application needs to provide list data of business objects of different classifications, such as diet, barber, and the like, the corresponding application typically stores the obtained list data of the business objects of different classifications in a data engine used by the application, and when the application needs to provide the list data to an external object, such as a user or other application, the application receives a corresponding data request message, and then obtains the corresponding list data from the engine data stored in the data engine, and provides the obtained list data to the external object.

As described above, although the current application can provide the list data of the business objects of different classifications to the external object, in reality, the same business object may often have a plurality of different list data, and when a new list data is added to the same business object, the data engine used by the application, such as the Hbase database, often needs a lot of development work when accessing the new list data, and the data iteration efficiency is slow; and the problem that the newly added list data cannot be accessed in real time exists. The direct consequence of this is that the application cannot efficiently provide real-time engine data of the business object in real-time.

Disclosure of Invention

The application provides a data processing method for a business object, which aims to solve the problem that the existing application program cannot provide real-time engine data of the business object in real time and high efficiency.

The application provides a data processing method for a business object, which comprises the following steps: acquiring a request message sent by a client for acquiring list data of a business object; acquiring source data related to a business object aiming at the request message; obtaining list data of the business object according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object; acquiring a data change message related to the business object in the data storage device, wherein the data change message comprises the list data; obtaining real-time engine data of the business object according to the data change message, wherein the real-time engine data comprises list data of the business object; and sending the real-time engine data of the business object to the client.

Optionally, the obtaining source data related to the business object includes: acquiring original data which comprises a plurality of data structures and is related to the business object from different data sources; and performing data cleaning on the original data to obtain source data with the same data structure.

Optionally, the obtaining the list data of the business object according to the source data includes: acquiring a service object identifier of the service object; according to the business object identification, obtaining to-be-processed source data associated with the business object from the source data; and carrying out data mining processing on the source data to be processed to acquire list data of the business object.

Optionally, the performing data mining on the source data to be processed to obtain the list data of the business object includes: acquiring service data corresponding to the service object from the source data to be processed; acquiring data of at least one list category of the business object according to the business data; and acquiring the list data of the business object according to the data of at least one list category of the business object.

Optionally, the storing the list data in a data storage device includes: acquiring a service object identifier of the service object and a service classification identifier of the service object, wherein the service classification identifier is used for representing a service class to which the service object belongs; acquiring a list category identification of the business object and data corresponding to the list category identification from the list data; according to the business object identification, the business classification identification, the list category identification and data corresponding to the list category identification, obtaining a record to be stored corresponding to the list data; and storing the record to be stored in the data storage device.

Optionally, the record to be stored includes an identifier indicating whether the record is valid; the obtaining the record to be stored corresponding to the list data according to the business object identifier, the business classification identifier, the list category identifier and the data corresponding to the list category identifier further includes: and obtaining the record to be stored corresponding to the list data according to the business object identifier, the business classification identifier, the identifier whether the record is valid or not, the list category identifier and the data corresponding to the list category identifier.

Optionally, the obtaining of the data change message related to the business object in the data storage device includes: acquiring a service object identifier of the service object; setting a subscription task for monitoring data change related to the business object in the data storage equipment according to the business object identifier; and acquiring data change information related to the service object in the data storage equipment according to the subscription task.

Optionally, the obtaining the real-time engine data of the business object according to the data change message includes: acquiring whether the record is valid or not from the data change message; if the record effective identifier indicates that the list data in the data change message is effective, updating the content in the single engine data corresponding to the business object according to the data change message to obtain real-time single engine data of the business object, wherein the single engine data is the engine data of the business object, and the real-time single engine data is the real-time engine data corresponding to the single engine data; and acquiring real-time engine data of the business object according to the real-time single engine data of the business object.

Optionally, the updating, according to the data change message, content in the individual engine data corresponding to the service object to obtain real-time individual engine data of the service object includes: acquiring a list category identification of the business object and data corresponding to the list category identification from the data change message;

acquiring a single engine data record corresponding to the business object according to the list category identification and the data corresponding to the list category identification; and updating the content in the single engine data corresponding to the business object according to the single engine data record to obtain the real-time single engine data of the business object.

Optionally, the obtaining real-time engine data of the business object according to the real-time individual engine data of the business object includes: and updating the engine data of the business object in a data engine according to the real-time single engine data of the business object to obtain the real-time engine data of the business object, wherein the data engine is used for storing the engine data of the business object.

Optionally, the service data information includes at least one of the following: sales data information of the business object sales business, comment information aiming at the business object, and popularity information of the business object.

The present application further provides a data processing apparatus for a business object, including: the request message acquisition unit is used for acquiring a request message which is sent by a client and used for acquiring list data of a business object; a source data obtaining unit, configured to obtain, for the request message, source data related to the service object; the list data storage unit is used for acquiring list data of the business object according to the source data and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object; a data change message acquiring unit, configured to acquire a data change message related to the business object in the data storage device, where the data change message includes the list data; a real-time engine data obtaining unit, configured to obtain real-time engine data of the business object according to the data change message, where the real-time engine data includes list data of the business object; and the real-time engine data sending unit is used for sending the real-time engine data of the business object to the client.

The present application further provides a data processing system for a business object, comprising: a client and a server; the client is used for sending a request message for acquiring list data of the business object and receiving the list data of the business object returned by the server; the server is used for receiving the request message sent by the client; acquiring list data of the business objects from real-time engine data of the business objects according to the request message and sequencing the list data; sending the ranked list data of the business objects to the client; the real-time engine data of the business object is obtained through the following steps: acquiring source data related to a business object; obtaining list data of the business object according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object; acquiring a data change message related to the business object in the data storage device, wherein the data change message comprises the list data; and obtaining real-time engine data of the business object according to the data change message, wherein the real-time engine data comprises list data of the business object.

The application also provides a data processing method for the store, which comprises the following steps: acquiring a request message sent by a client for acquiring list data of stores; acquiring source data related to stores aiming at the request message; acquiring list data of the store according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the store; acquiring data change messages related to the stores in the data storage device, wherein the data change messages comprise the list data; obtaining real-time engine data of the store according to the data change message; and sending the real-time engine data of the store to the client.

The present application further provides a data processing apparatus for a store, comprising: the system comprises a request message acquisition unit, a list data acquisition unit and a list data acquisition unit, wherein the request message acquisition unit is used for acquiring a request message which is sent by a client and is used for acquiring the list data of stores; a store source data acquisition unit configured to acquire source data related to a store for the request message; the store list data storage unit is used for acquiring list data of stores according to the source data and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the stores; a store data change message changing unit, configured to acquire a data change message related to the store in the data storage device, where the data change message includes the list data; the store real-time engine data obtaining unit is used for obtaining the store real-time engine data according to the data change message; and the store real-time engine data sending unit is used for sending the real-time engine data of the business object to the client.

The present application further provides a data processing system for a store, comprising: a client and a server;

the client is used for sending a request message for acquiring the list data of the stores and receiving the list data of the stores returned by the server; the server is used for receiving the request message sent by the client; acquiring list data of the stores from the real-time engine data of the stores according to the request message and sequencing the list data; sending the ranked list data of the stores to the client; wherein the real-time engine data of the store is obtained by the steps of: acquiring source data related to a store; acquiring list data of stores according to the source data, and storing the list data into a data storage device, wherein the list data comprises data of at least one list category of the stores; acquiring data change messages related to the stores in the data storage device, wherein the data change messages comprise the list data; and obtaining real-time engine data of the store according to the data change message.

The application also provides a data display method for the business object, which comprises the following steps: acquiring source data related to a business object; obtaining list data of the business object according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object; acquiring a data change message related to the business object in the data storage device, wherein the data change message comprises the list data; obtaining real-time engine data of the business object according to the data change message, wherein the real-time engine data comprises list data of the business object; and displaying the real-time engine data of the business object on a screen.

Optionally, the storing the list data in a data storage device includes acquiring a service object identifier of the service object and a service classification identifier of the service object, where the service classification identifier is used to indicate a service category to which the service object belongs; acquiring a list category identification of the business object and data corresponding to the list category identification from the list data; according to the business object identification, the business classification identification, the list category identification and data corresponding to the list category identification, obtaining a record to be stored corresponding to the list data; and storing the record to be stored in the data storage device.

Optionally, the updating, according to the data change message, content in the individual engine data corresponding to the service object to obtain real-time individual engine data of the service object includes: acquiring a list category identification of the business object and data corresponding to the list category identification from the data change message; acquiring a single engine data record corresponding to the business object according to the list category identification and the data corresponding to the list category identification; and updating the content in the single engine data corresponding to the business object according to the single engine data record to obtain the real-time single engine data of the business object.

The present application further provides a data display device for a business object, including: a source data acquisition unit, configured to acquire source data related to a service object; the list data storage unit is used for acquiring list data of the business object according to the source data and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object; a data change message acquiring unit, configured to acquire a data change message related to the business object in the data storage device, where the data change message includes the list data; a real-time engine data obtaining unit, configured to obtain real-time engine data of the business object according to the data change message, where the real-time engine data includes list data of the business object; and the real-time engine data display unit is used for displaying the real-time engine data of the business object on a screen.

The application also provides a data display method for the store, which comprises the following steps: acquiring source data related to a store; acquiring list data of the store according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the store; acquiring data change messages related to the stores in the data storage device, wherein the data change messages comprise the list data; obtaining real-time engine data of the store according to the data change message, wherein the real-time engine data comprises list data of the store; and displaying the real-time engine data of the store on a screen.

The present application further provides a data display device to a store, including: the system comprises a store source data acquisition unit, a store source data acquisition unit and a data processing unit, wherein the store source data acquisition unit is used for acquiring source data related to stores; the store list data storage unit is used for acquiring list data of the stores according to the source data and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the stores; a store data change message acquiring unit, configured to acquire a data change message related to the store in the data storage device, where the data change message includes the list data; the store real-time engine data acquisition unit is used for acquiring real-time engine data of the stores according to the data change message, wherein the real-time engine data comprises list data of the stores; and the store real-time engine data display unit is used for displaying the store real-time engine data on a screen.

Compared with the prior art, the method has the following advantages:

the application provides a data processing method for a business object, which comprises the following steps: acquiring source data related to a business object; obtaining list data of the business object according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object; acquiring a data change message related to the business object in the data storage device, wherein the data change message comprises the list data; and obtaining real-time engine data of the business object according to the data change message, wherein the real-time engine data comprises list data of the business object. Compared with the mode that additional development work is needed when real-time engine data are acquired in the prior art, the method stores the list data of the business object by adding the data storage device, acquires the data change message of the data storage device, and synchronizes the engine data in the data engine according to the data change message, so that the real-time engine data of the business object can be acquired efficiently in real time.

Drawings

Fig. 1 is a schematic application scenario diagram of a data processing method for a business object according to a first embodiment of the present application.

Fig. 2 is a flowchart of a data processing method for a business object according to a first embodiment of the present application.

Fig. 3 is a flowchart of a data processing method for stores according to a second embodiment of the present application.

Fig. 4 is a schematic diagram of a data processing apparatus for business objects according to a third embodiment of the present application.

Fig. 5 is a schematic diagram of a data processing apparatus for stores according to a fifth embodiment of the present application.

Fig. 6 is a flowchart of a data presentation method for a business object according to a seventh embodiment of the present application.

Fig. 7 is a schematic diagram of a data presentation apparatus for business objects according to an eighth embodiment of the present application.

Fig. 8 is a flowchart of a data presentation method for stores according to a ninth embodiment of the present application.

Fig. 9 is a schematic view of a data display device for stores according to a tenth embodiment of the present application.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.

First, in order to make those skilled in the art better understand the solution of the present application, a detailed description is given below to a specific application scenario of an embodiment of a data processing method for a business object provided by the present application. Fig. 1 is a schematic view of an application scenario of a data processing method for a business object according to a first embodiment of the present application.

In a specific implementation process, the data processing method for a business object is implemented by the application, generally, when a user 101 searches for list data of the business object by using an application corresponding to the business object on a computing device 102, the application sends a request message for obtaining the list data of the business object to the computing device 103, and after the computing device 103 receives the request message sent by the application, the computing device 103 obtains source data related to the business object in order to obtain real-time engine data of the business object efficiently in real time and provide the list data in the real-time engine data to the application; then, obtaining list data of the business object according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object; then, acquiring a data change message related to the business object in the data storage device, wherein the data change message comprises the list data; and then, obtaining real-time engine data of the business object according to the data change message, wherein the real-time engine data comprises list data of the business object. After the computing device 103 obtains the real-time engine data of the business object, obtaining real-time list data of the business object from the real-time engine data, and sending the list data to the application program; after receiving the listing data, the application presents the listing data for viewing by the user 101 on a display device carried by or connected to the computing device 102.

It should be noted that, in the above description, for example, the user 101 triggers the application program in the computing device 102 to send a request message for acquiring the list data of the business object, which details a processing flow for the computing device 103 to provide the acquired real-time engine data of the business object to the user 101 for viewing. In the actual processing, other external objects, such as other application programs, may also send a request message for obtaining the list data of the business object to the computing device 103 based on a certain business processing requirement, and after the computing device 103 obtains the request message, provide the list data to the application program.

In addition, in this embodiment, the computing device 102 mainly refers to a mobile terminal device used by the user 101, such as a mobile phone, a tablet computer, and the like, and may also be a computer device used by the user 101; the computing device 103 mainly refers to a server computing device, such as a service server providing real-time engine data;

the Business Object (Business Object) mainly refers to an abstraction of a series of real-world entity objects with the same Business attributes in an application program, and is usually a string of characters composed of english numbers. For example, for a physical store in the real world, the physical store may be abstracted as a store in the application, and in addition, for different business categories in the physical store, such as a store providing a dining service and a store providing a barber service, the physical store may also be abstracted as a business object which is detailed one by one in the application, such as a dining store, a barber store, and the like.

The list data mainly refers to data of at least one list category of the business object.

The list category mainly refers to an identifier of a ranking list divided according to a certain business attribute of the business object. For example: according to the net red attribute of the store, a net red list can be divided; according to whether the store is suitable for the business attribute of the lovers 'appointments, a lovers' appointment ranking list can be divided; a business attribute of whether the store is suitable for weekend play or not can be divided into a weekend play list and the like.

The real-time engine data mainly refers to engine data containing real-time list data of the business object.

Referring to fig. 2, it is a flowchart of a data processing method for a business object according to a first embodiment of the present application, and the following describes the embodiment in detail with reference to fig. 2.

Step S201, acquiring a request message sent by the client for acquiring the list data of the business object.

In the data processing method for a business object shown in this embodiment, generally, when a user searches for list data of the business object by using an application program corresponding to the business object on a client, the client responds to a trigger operation of the user to obtain a business object identifier for identifying the business object, then generates a request message including the business object identifier for obtaining the list data of the business object, and then sends the request message to a server.

Step S202, aiming at the request message, obtaining the source data related to the business object.

In this embodiment, the obtaining of the source data related to the business object may be performed at a server corresponding to the application program, or may be performed at a client capable of running the application program, where obtaining the source data related to the business object by the server corresponding to the application program is illustrated, that is, a server computing device corresponding to the application program obtains business data related to the business object, for example, the business data may be order data, comment data, sales data, or the like related to the business object.

A preferred scheme is that a server computing device corresponding to the application program obtains original data related to the business object, which comprises a plurality of data structures, from different data sources; and performing data cleaning on the original data to obtain source data with the same data structure. That is, the raw data related to the business object, including various data structures, is obtained from the application program or the database containing the business object, and then the raw data is cleaned by using a data cleaning algorithm, and the data fields related to the business object are extracted to obtain the source data of the same data structure.

For example, the business object is taken as a store for explanation, various kinds of raw data related to the store, such as order data, comment data, sales data, store quantity and the like of the store, may be included in different applications or in the same application, and after the computing device 103 acquires the raw data including various data structures, the data is cleaned by using a data cleaning algorithm, so as to acquire source data of the same data structure.

Continuing to refer to fig. 2, after step S202, step S203 is executed to obtain the list data of the business object according to the source data, and store the list data in a data storage device, where the list data includes data of at least one list category in the business object.

In order to synchronize the list data to the engine data used by the application program in real time so that the application program can provide the real-time engine data, in the application, the list data of the business object is acquired according to the source data related to the business object; then, after the list data of the business object is obtained, the list data is stored in an intermediate data storage device, then, a data monitoring and processing platform is used for monitoring data change messages which are related to the business object and contain the list data in the data storage device, and real-time engine data of the business object is obtained according to the data change messages. In the following, a detailed description is made of how to store the data of the business object in the intermediate data storage device, and a detailed processing procedure for obtaining the implementation engine data of the business object after storage will be described in subsequent steps. In addition, it should be noted that, in this embodiment, the data storage device may be a mysql database, and in specific implementation, other data storage devices, such as an oracle database, may also be used according to design requirements, which is not limited herein.

Firstly, list data of the business object is obtained according to source data related to the business object.

The obtaining of the list data of the business object according to the source data includes: acquiring a service object identifier of the service object; according to the business object identification, obtaining to-be-processed source data associated with the business object from the source data; and carrying out data mining processing on the source data to be processed to acquire list data of the business object.

The business object identifier is a unique string of english digits that is used to identify the business object. For example, a business object, store, may be identified by "store".

When obtaining the list data of the business object from the source data associated with the business object, in order to reduce the calculation amount, firstly, according to the business object identifier, obtaining the source data to be processed associated with the business object from the source data, that is, filtering out the source data irrelevant to obtaining the list data of the business object from the source data, and performing the subsequent calculation processing by using the filtered source data as the source data to be processed.

The performing of the data mining on the source data to be processed to obtain the list data of the business object mainly means performing the data mining on the source data to be processed through a list data obtaining model, that is, an algorithm model formed by an algorithm for obtaining the list data, to obtain the list data of the business object, where the list data obtaining model may be an algorithm model formed by different algorithms for obtaining the list data, and different algorithms may be set for the used algorithm for obtaining the list data according to different design requirements, and no special limitation is made here.

The data mining processing is performed on the source data to be processed to acquire list data of the business object, and the method includes: acquiring service data corresponding to the service object from the source data to be processed; acquiring data of at least one list category in the business object according to the business data; and acquiring the list data of the business object according to the data of at least one list category in the business object.

Wherein the service data information includes at least one of the following: sales data information of the business object sales business, comment information aiming at the business object, and popularity information of the business object.

Here, for the same business object, list data of different list categories may be acquired by different list data acquisition models. For example, for a business object-store, a chart related to a scene may be a netpage chart, a lover date chart, a weekend play chart, a night chart, or a combination of area and chart categories, such as a fire chart in XX area, a barbecue chart in XX area, and the like.

In the present application, the business object is taken as a store, and the obtained list data is taken as a web leaderboard, that is, the list category of the obtained list data of the business object of the store is taken as the web leaderboard. And performing data mining on the source data to be processed by using a list data acquisition model aiming at stores, calculating corresponding net red values, namely popularity and love, of at least one store, and marking a label of a net red list for the at least one store, namely setting the list category of the at least one store. For example, if the calculated identifier of the store in the web leaderboard is "XX restaurant", then a web leaderboard tag is played for the store: onlineCel and its corresponding net red value, e.g., net red value — score of 200, are stored.

After the list data of the business object is obtained, the obtained list data of the business object is stored in data storage equipment.

The step of storing the list data into a data storage device comprises the steps of acquiring a business object identifier of the business object and a business classification identifier of the business object, wherein the business classification identifier is used for representing the business class to which the business object belongs; acquiring a list category identification of the business object and data corresponding to the list category identification from the list data; according to the business object identification, the business classification identification, the list category identification and data corresponding to the list category identification, obtaining a record to be stored corresponding to the list data; and storing the record to be stored in the data storage device.

Still here, the business object is a store, and the data storage device is exemplified by a mysql database. For example, for the business object "restaurant in XX", the business object identifier of the store is "201993203920392", the corresponding business classification identifier thereof, that is, the business classification thereof is store-SHOP, may be obtained through a corresponding correspondence, and meanwhile, in the above description, the list category thereof is netbook, that is, onlineCel, and the data in the list category corresponding thereto, that is, the net red value is 200, may be obtained, according to the above, the to-be-stored record { "object _ id" of the list data of "restaurant in XX" may be obtained: "201993203920392", "object _ type": "SHOP", "label _ val": "onlineCel", "score": 200}, wherein object _ id represents a service object representation, object _ type represents a service classification identifier, label _ val represents a list category identifier corresponding to the service object, and score represents a score of the service object in a list category corresponding to the list category identifier.

Wherein, the record to be stored comprises an identifier for judging whether the record is valid or not; the obtaining the record to be stored corresponding to the list data according to the business object identifier, the business classification identifier, the list category identifier and the data corresponding to the list category identifier further includes: and obtaining the record to be stored corresponding to the list data according to the business object identifier, the business classification identifier, the identifier whether the record is valid or not, the list category identifier and the data corresponding to the list category identifier. The valid or invalid identifier is generally directly assigned during the data cleaning process, and the content of the valid or invalid identifier can be 0 or 1, or not; here, it is described by taking the case where the content is 0 or 1, that is, when the value is 0, it indicates that the list data is valid and can be acquired into the real-time engine data, and when the value is 1, it indicates that the list data is invalid and cannot be acquired into the real-time engine data. For example, { "object _ id": "201993203920392", "object _ type": "SHOP", "label _ val": "onlineCel", "score": 200, "delete _ tag", 0 }.

Of course, the record to be stored may further include other fields, such as a field for indicating a service channel or other reserved fields, which are not illustrated herein.

Step S204, acquiring a data change message related to the business object in the data storage device, where the data change message includes the list data.

The acquiring of the data change message related to the service object in the data storage device includes:

acquiring a service object identifier of the service object; setting a subscription task for monitoring data change related to the business object in the data storage equipment according to the business object identifier; and acquiring data change information related to the service object in the data storage equipment according to the subscription task.

Specifically, firstly, on a data monitoring and processing platform, namely a platform for monitoring data change of the data storage device and performing other subsequent data processing, a subscription task for monitoring data change related to the business object in the data storage device can be set on the platform through a business object identifier of the business object; meanwhile, according to the subscription task, a data change message which is related to the business object and contains the list data can be acquired from the data storage device.

Step S205, obtaining real-time engine data of the business object according to the data change message, where the real-time engine data includes list data of the business object.

After the data change message of the business object is obtained through the set subscription task on the data monitoring and processing platform, the real-time engine data of the business object can be obtained according to the data change message, wherein the real-time engine data comprises list data of the business object.

Wherein, the obtaining the real-time engine data of the business object according to the data change message comprises: acquiring whether the record is valid or not from the data change message; if the record effective identifier indicates that the list data in the data change message is effective, updating the content in the single engine data corresponding to the business object according to the data change message to obtain real-time single engine data of the business object, wherein the single engine data is the engine data of the business object, and the real-time single engine data is the real-time engine data corresponding to the single engine data; and acquiring real-time engine data of the business object according to the real-time single engine data of the business object.

The updating the content in the individual engine data corresponding to the business object according to the data change message to obtain the real-time individual engine data of the business object includes: acquiring a list category identification of the business object and data corresponding to the list category identification from the data change message; acquiring a single engine data record corresponding to the business object according to the list category identification and the data corresponding to the list category identification; and updating the content in the single engine data corresponding to the business object according to the single engine data record to obtain the real-time single engine data of the business object.

For example, when the list data { "object _ id" is acquired: "201993203920392", "object _ type": "SHOP", "label _ val": after the data change message of "onlineCel", "score", 200 "," delete _ tag ", 0}, first obtain whether the record is valid or not, i.e. the value of delete _ tag; if the record is valid or not, acquiring a list category identifier as onlineCel and data corresponding to the list category identifier as 200 according to the list data, and acquiring a single engine data record { "shop _ id": "201993203920392", "top _ tags": "onlineCel", "score": 200, and updating the content in the single engine data corresponding to the business object according to the single engine data record to obtain the real-time single engine data of the business object.

The obtaining real-time engine data of the business object according to the real-time monomer engine data of the business object includes: and updating the engine data of the business object in a data engine according to the real-time single engine data of the business object to obtain the real-time engine data of the business object, wherein the data engine is used for storing the engine data of the business object.

After the data monitoring and processing platform obtains the real-time monomer engine data of the service object, the data monitoring and processing platform sends a real-time message to a data engine unit of the server-side computing device, the data engine unit obtains the real-time monomer engine data of the service object from the real-time message, and the real-time engine data of the service object is obtained according to the real-time monomer engine data of the service object.

The data engine is used for storing the engine data of the business object and providing the engine data of the business object for the application program.

In addition, in the present application, the data processing method for the business object is described in detail by taking the business object as a store and taking the list category of the list data of the store as a web-red list, and when the method is specifically implemented, the method may be applied to other business objects or the list data of other list categories, for example, the business object is a commodity or a dish, and the list category is list data such as a marketing list and a beauty list, which is not illustrated here.

After step S205, step S206 is executed to send the real-time engine data of the business object to the client.

After the server side obtains the real-time engine data of the business object, the real-time engine data can be provided for the client side, and after the client side obtains the real-time engine data, the real-time engine data of the business object can be displayed on a screen.

As can be seen from the above description, in the present application, by performing data mining on source data related to the business object, the list data of different list categories of the business object can be automatically obtained, the obtained list data is stored in an intermediate data storage device, a data change message of the data storage device is monitored by the data monitoring and processing platform, and a field for storing the list data in the update engine data is automatically triggered according to the data change message, so as to obtain the real-time engine data of the business object, so that an application program can provide the real-time engine data of the business object in real time and efficiently.

Corresponding to the data processing method for business objects, the present application further provides a data processing method for stores, please refer to fig. 3, which is a flowchart of a data processing method for stores according to a second embodiment of the present application, and since the detailed processing thereof has been described in detail in the foregoing embodiment, the description herein is relatively simple, and for the relevant points, reference may be made to the partial description provided in the foregoing embodiment.

Referring to fig. 3, it is a flowchart of a data processing method for stores according to a second embodiment of the present application, and the embodiment is described in detail below with reference to fig. 3.

In step S301, a request message sent by the client for obtaining list data of the store is obtained.

Step S302, aiming at the request message, acquiring source data related to stores.

Step S303, obtaining list data of the store according to the source data, and storing the list data into a data storage device, wherein the list data comprises data of at least one list category of the store.

Step S304, acquiring a data change message related to the store in the data storage device, where the data change message includes the list data.

And step S305, obtaining real-time engine data of the store according to the data change message.

Step S306, sending the real-time engine data of the store to the client.

After the server side obtains the real-time engine data of the store, the real-time engine data can be provided for the client side, and after the client side obtains the real-time engine data, the real-time engine data of the store can be displayed on a screen.

According to the data processing method for the stores, the source data related to the stores are subjected to data mining, the list data of different list categories of the stores can be automatically obtained, the obtained list data are stored in an intermediate data storage device, such as a mysql database, a data change message of the data storage device is monitored through the data monitoring and processing platform, a field used for storing the list data in the update engine data is triggered according to the data change message, and then the real-time engine data of the stores are obtained, so that an application program can provide the real-time engine data of the stores in real time and efficiently.

Corresponding to the above data processing method for business objects, the present application also provides a data processing apparatus for business objects, please refer to fig. 4, which is a schematic diagram of a data processing apparatus for business objects provided in the third embodiment of the present application. The data processing device for the business object comprises the following parts.

A request message obtaining unit 401, configured to obtain a request message sent by a client and used for obtaining the list data of the business object.

A source data obtaining unit 402, configured to obtain source data related to the business object.

A list data storage unit 403, configured to acquire list data of the business object according to the source data, and store the list data in a data storage device, where the list data includes data of at least one list category of the business object.

A data change message obtaining unit 404, configured to obtain a data change message related to the business object in the data storage device, where the data change message includes the list data.

A real-time engine data obtaining unit 405, configured to obtain real-time engine data of the business object according to the data change message, where the real-time engine data includes list data of the business object.

A real-time engine data sending unit 406, configured to send the real-time engine data of the business object to the client.

Optionally, the source data obtaining unit includes: the original data acquisition subunit is used for acquiring original data which comprises a plurality of data structures and is related to the business object from different data sources; and the source data acquisition subunit is used for carrying out data cleaning on the original data to acquire source data with the same data structure.

Optionally, the list data storage unit includes: a service object identifier acquiring subunit, configured to acquire a service object identifier of the service object; a to-be-processed source data obtaining subunit, configured to obtain, from the source data according to the service object identifier, to-be-processed source data associated with the service object; and the list data acquisition subunit is used for performing data mining processing on the source data to be processed to acquire the list data of the business object.

Optionally, the performing data mining on the source data to be processed to obtain the list data of the business object includes: acquiring service data corresponding to the service object from the source data to be processed; acquiring data of at least one list category in the business object according to the business data; and acquiring the list data of the business object according to the data of at least one list category in the business object.

Optionally, the list data storage unit further includes: a service object identifier obtaining subunit, configured to obtain a service object identifier of the service object and a service classification identifier of the service object, where the service classification identifier is used to indicate a service class to which the service object belongs; the list category identification obtaining subunit is configured to obtain a list category identification of the service object and data corresponding to the list category identification from the list data; a to-be-stored record obtaining subunit, configured to obtain a to-be-stored record corresponding to the list data according to the service object identifier, the service classification identifier, the list category identifier, and the data corresponding to the list category identifier; and the storage subunit is used for storing the record to be stored into the data storage device.

Optionally, the data change message acquiring unit includes: an identifier obtaining subunit, configured to obtain a service object identifier of the service object; a subscription task obtaining subunit, configured to set a subscription task for monitoring data change related to the service object in the data storage device according to the service object identifier; and the data change message acquisition subunit is used for acquiring the data change message related to the service object in the data storage device according to the subscription task.

Corresponding to the above data processing method for business objects, the fourth embodiment of the present application further provides a data processing system for business objects, since the system embodiment is substantially similar to the method embodiment, the description is relatively simple, and for relevant points, reference may be made to the partial description provided in the above embodiment, and the system embodiment described below is only illustrative. The application provides a data processing system for a business object, which comprises:

a client and a server;

the client is used for sending a request message for acquiring list data of the business object and receiving the list data of the business object returned by the server;

the server is used for receiving the request message sent by the client; acquiring list data of the business objects from real-time engine data of the business objects according to the request message and sequencing the list data; sending the ranked list data of the business objects to the client;

the real-time engine data of the business object is obtained through the following steps:

acquiring source data related to a business object; obtaining list data of the business object according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one entity information of the business object in at least one list category; acquiring a data change message related to the business object in the data storage device, wherein the data change message comprises the list data; and obtaining real-time engine data of the business object according to the data change message, wherein the real-time engine data comprises list data of the business object.

Corresponding to the data processing method for stores, the present application also provides a data processing apparatus for stores, please refer to fig. 5, which is a schematic diagram of the data processing apparatus for stores provided in the fifth embodiment of the present application, since the apparatus embodiment is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description provided in the above embodiment, and the apparatus embodiment described below is only schematic. The application provides a data processing device for a store, which comprises the following parts.

A request message obtaining unit 501, configured to obtain a request message sent by a client and used for obtaining list data of a store.

A store source data acquiring unit 502, configured to acquire, for the request message, source data related to a store;

a store list data storage unit 503, configured to obtain list data of a store according to the source data, and store the list data in a data storage device, where the list data includes data of at least one list category of the store;

a store data change message changing unit 504, configured to acquire a data change message related to the store in the data storage device, where the data change message includes the list data;

a store real-time engine data obtaining unit 505, configured to obtain the real-time engine data of the store according to the data change message.

A store real-time engine data sending unit 506, configured to send the real-time engine data of the business object to the client.

Optionally, the store source data obtaining unit includes: the system comprises a store original data acquisition subunit, a data processing unit and a data processing unit, wherein the store original data acquisition subunit is used for acquiring original data which comprise a plurality of data structures and are related to a store from different data sources; and the store source data acquisition subunit is used for performing data cleaning on the original data to acquire source data with the same data structure.

Optionally, the list data storage unit includes: the store identification acquisition subunit is used for acquiring the store identification of the store; a to-be-processed source data acquiring subunit, configured to acquire, from the source data, to-be-processed source data associated with the store according to the store identifier; and the list data acquisition subunit is used for carrying out data mining processing on the source data to be processed to acquire the list data of the stores.

Optionally, the performing data mining on the source data to be processed to obtain list data of the store includes: acquiring business data corresponding to the store from the source data to be processed; acquiring data of at least one list category in the store according to the business data; and acquiring the list data of the store according to the data of at least one list category of the store.

Optionally, the list data storage unit further includes: the system comprises a store identification acquisition subunit, a service classification identification acquisition subunit and a service classification identification acquisition subunit, wherein the store identification acquisition subunit is used for acquiring a store identification of a store and a service classification identification of the store, and the service classification identification is used for representing a service category to which the store belongs; the store list category identification obtaining subunit is used for obtaining the list category identification of the store and data corresponding to the list category identification from the list data; the to-be-stored record obtaining subunit is configured to obtain a to-be-stored record corresponding to the list data according to the store identifier, the service classification identifier, the list category identifier, and data corresponding to the list category identifier; and the storage subunit is used for storing the record to be stored into the data storage device.

Optionally, the record to be stored includes an identifier indicating whether the record is valid; the obtaining the record to be stored corresponding to the list data according to the store identifier, the service classification identifier, the list category identifier and the data corresponding to the list category identifier further includes: and obtaining the records to be stored corresponding to the list data according to the store identification, the service classification identification, whether the records are effective identification, and the list category identification and the data corresponding to the list category identification.

Optionally, the store data change message acquiring unit includes: the store identification acquisition subunit is used for acquiring the store identification of the store; the store subscription task acquisition subunit is used for setting a subscription task for monitoring data change related to the store in the data storage device according to the store identification; and the store data change message acquisition subunit is used for acquiring the data change message related to the store in the data storage device according to the subscription task.

Optionally, the obtaining real-time engine data of the store according to the data change message includes: acquiring whether the record is valid or not from the data change message; if the record effective identification indicates that the list data in the data change message is effective, updating the content in the individual engine data corresponding to the store according to the data change message to obtain real-time individual engine data of the store, wherein the individual engine data is the engine data of the store, and the real-time individual engine data is the real-time engine data corresponding to the individual engine data; and obtaining real-time engine data of the store according to the real-time single engine data of the store.

Optionally, the updating, according to the data change message, content in the individual engine data corresponding to the store to obtain real-time individual engine data of the store includes: acquiring list category identifications of the stores and data corresponding to the list category identifications from the data change message; acquiring a single engine data record corresponding to the store according to the list category identification and the data corresponding to the list category identification; and updating the content in the individual engine data corresponding to the store according to the individual engine data record to obtain the real-time individual engine data of the store.

Optionally, the obtaining real-time engine data of the store according to the real-time individual engine data of the store includes: and updating the engine data of the stores in a data engine according to the real-time single engine data of the stores to obtain the real-time engine data of the stores, wherein the data engine is used for storing the engine data of the business objects.

Optionally, the service data information includes at least one of the following: sales data information of the store sales service, comment information for the store, and popularity information of the store.

Corresponding to the above data processing method for stores, the sixth embodiment of the present application further provides a data processing system for stores, since the system embodiment is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to some descriptions provided in the above embodiments, and the system embodiment described below is only illustrative. The application provides a data processing system to shop, includes:

a client and a server;

the client is used for sending a request message for acquiring the list data of the stores and receiving the list data of the stores returned by the server;

the server is used for receiving the request message sent by the client; acquiring list data of the stores from the real-time engine data of the stores according to the request message and sequencing the list data; sending the ranked list data of the stores to the client;

wherein the real-time engine data of the store is obtained by the steps of:

acquiring source data related to a store; acquiring list data of stores according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one entity store information corresponding to the stores in at least one list category; acquiring data change messages related to the stores in the data storage device, wherein the data change messages comprise the list data; and obtaining real-time engine data of the store according to the data change message.

Corresponding to the above data processing method for business objects, the present application further provides a data display method for business objects, please refer to fig. 6, which is a flowchart of a data display method for business objects according to a seventh embodiment of the present application, and since the detailed processing thereof has been described in detail in the above embodiments, the description herein is relatively simple, and for the relevant points, reference may be made to the partial description provided in the above embodiments.

Step S601, acquiring source data related to the business object.

Step S602, obtaining the list data of the business object according to the source data, and storing the list data in a data storage device, where the list data includes data of at least one list category of the business object.

Step S603, acquiring a data change message related to the business object in the data storage device, where the data change message includes the list data.

Step S604, obtaining real-time engine data of the business object according to the data change message, where the real-time engine data includes list data of the business object.

And step S605, displaying the real-time engine data of the business object on a screen.

Corresponding to the above data presentation method for business objects, the present application further provides a data presentation apparatus for business objects, please refer to fig. 7, which is a schematic diagram of the data presentation apparatus for business objects provided in the eighth embodiment of the present application. The application provides a data display device for business objects, which comprises the following parts.

A source data obtaining unit 701, configured to obtain source data related to a business object;

a list data storage unit 702, configured to obtain list data of the business object according to the source data, and store the list data in a data storage device, where the list data includes data of at least one list category of the business object;

a data change message acquiring unit 703, configured to acquire a data change message related to the service object in the data storage device, where the data change message includes the list data;

a real-time engine data obtaining unit 704, configured to obtain real-time engine data of the business object according to the data change message, where the real-time engine data includes list data of the business object;

the real-time engine data display unit 705 is configured to display the real-time engine data of the business object on a screen.

Corresponding to the data processing method for stores, the present application further provides a data display method for stores, please refer to fig. 8, which is a flowchart of a data display method for stores according to a ninth embodiment of the present application, and since the detailed processing thereof has been described in detail in the foregoing embodiment, the description herein is relatively simple, and for the relevant points, reference may be made to the partial description provided in the foregoing embodiment.

In step S801, source data related to stores is acquired.

Step S802, obtaining list data of the store according to the source data, and storing the list data into a data storage device, wherein the list data comprises data of at least one list category of the store.

Step S803, acquiring a data change message related to the store in the data storage device, where the data change message includes the list data.

Step S804, obtaining real-time engine data of the store according to the data change message, wherein the real-time engine data comprises list data of the store.

And step S805, displaying the real-time engine data of the store on a screen.

Corresponding to the aforementioned data display method for stores, the present application further provides a data display device for stores, please refer to fig. 9, which is a schematic diagram of the data display device for stores according to the tenth embodiment of the present application, since the device embodiment is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description provided in the foregoing embodiment, and the device embodiment described below is only schematic. The application provides a data display device to store, includes following part.

A store source data acquiring unit 901, configured to acquire source data related to a store.

The store list data storage unit 902 is configured to acquire list data of the store according to the source data, and store the list data in a data storage device, where the list data includes data of at least one list category of the store.

A store data change message acquiring unit 903, configured to acquire a data change message related to the store in the data storage device, where the data change message includes the list data.

A store real-time engine data obtaining unit 904, configured to obtain real-time engine data of the store according to the data change message, where the real-time engine data includes list data of the store.

The store real-time engine data display unit 905 is used for displaying the store real-time engine data on a screen.

Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Claims

1. A data processing method for a business object, comprising:

acquiring a request message sent by a client for acquiring list data of a business object;

acquiring source data related to a business object aiming at the request message;

obtaining list data of the business object according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object;

acquiring a data change message related to the business object in the data storage device, wherein the data change message comprises the list data;

obtaining real-time engine data of the business object according to the data change message, wherein the real-time engine data comprises list data of the business object;

and sending the real-time engine data of the business object to the client.

2. A data processing apparatus for a business object, comprising:

the request message acquisition unit is used for acquiring a request message which is sent by a client and used for acquiring list data of a business object;

a source data obtaining unit, configured to obtain, for the request message, source data related to the service object;

the list data storage unit is used for acquiring list data of the business object according to the source data and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object;

a data change message acquiring unit, configured to acquire a data change message related to the business object in the data storage device, where the data change message includes the list data;

a real-time engine data obtaining unit, configured to obtain real-time engine data of the business object according to the data change message, where the real-time engine data includes list data of the business object;

and the real-time engine data sending unit is used for sending the real-time engine data of the business object to the client.

3. A data processing system for a business object, comprising: a client and a server;

acquiring source data related to a business object; obtaining list data of the business object according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the business object; acquiring a data change message related to the business object in the data storage device, wherein the data change message comprises the list data; and obtaining real-time engine data of the business object according to the data change message, wherein the real-time engine data comprises list data of the business object.

4. A data processing method for stores, comprising:

acquiring a request message sent by a client for acquiring list data of stores; acquiring source data related to stores aiming at the request message;

acquiring list data of the store according to the source data, and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the store;

acquiring data change messages related to the stores in the data storage device, wherein the data change messages comprise the list data;

obtaining real-time engine data of the store according to the data change message;

and sending the real-time engine data of the store to the client.

5. A data processing apparatus for a store, comprising:

the system comprises a request message acquisition unit, a list data acquisition unit and a list data acquisition unit, wherein the request message acquisition unit is used for acquiring a request message which is sent by a client and is used for acquiring the list data of stores;

a store source data acquisition unit configured to acquire source data related to a store for the request message;

the store list data storage unit is used for acquiring list data of stores according to the source data and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the stores;

a store data change message changing unit, configured to acquire a data change message related to the store in the data storage device, where the data change message includes the list data;

the store real-time engine data obtaining unit is used for obtaining the store real-time engine data according to the data change message;

and the store real-time engine data sending unit is used for sending the real-time engine data of the business object to the client.

6. A data processing system for a store, comprising: a client and a server;

wherein the real-time engine data of the store is obtained by the steps of:

acquiring source data related to a store; acquiring list data of stores according to the source data, and storing the list data into a data storage device, wherein the list data comprises data of at least one list category of the stores; acquiring data change messages related to the stores in the data storage device, wherein the data change messages comprise the list data; and obtaining real-time engine data of the store according to the data change message.

7. A data display method for a business object is characterized by comprising the following steps:

acquiring source data related to a business object;

and displaying the real-time engine data of the business object on a screen.

8. A data presentation device for a business object, comprising:

a source data acquisition unit, configured to acquire source data related to a service object;

and the real-time engine data display unit is used for displaying the real-time engine data of the business object on a screen.

9. A data presentation method for stores, comprising:

acquiring source data related to a store;

obtaining real-time engine data of the store according to the data change message, wherein the real-time engine data comprises list data of the store;

and displaying the real-time engine data of the store on a screen.

10. A store-specific data presentation device, comprising:

the system comprises a store source data acquisition unit, a store source data acquisition unit and a data processing unit, wherein the store source data acquisition unit is used for acquiring source data related to stores;

the store list data storage unit is used for acquiring list data of the stores according to the source data and storing the list data into data storage equipment, wherein the list data comprises data of at least one list category of the stores;

a store data change message acquiring unit, configured to acquire a data change message related to the store in the data storage device, where the data change message includes the list data;

the store real-time engine data acquisition unit is used for acquiring real-time engine data of the stores according to the data change message, wherein the real-time engine data comprises list data of the stores;

and the store real-time engine data display unit is used for displaying the store real-time engine data on a screen.