CN112148779A - Method, device and storage medium for determining service index - Google Patents
Method, device and storage medium for determining service index Download PDFInfo
- Publication number
- CN112148779A CN112148779A CN201910571501.8A CN201910571501A CN112148779A CN 112148779 A CN112148779 A CN 112148779A CN 201910571501 A CN201910571501 A CN 201910571501A CN 112148779 A CN112148779 A CN 112148779A
- Authority
- CN
- China
- Prior art keywords
- service data
- real
- time
- service
- index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000004364 calculation method Methods 0.000 abstract description 40
- 230000008569 process Effects 0.000 abstract description 6
- 238000012545 processing Methods 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 abstract description 2
- 230000006399 behavior Effects 0.000 description 13
- 238000004458 analytical method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000007547 defect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012958 reprocessing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- Physics & Mathematics (AREA)
- Tourism & Hospitality (AREA)
- Quality & Reliability (AREA)
- General Business, Economics & Management (AREA)
- Operations Research (AREA)
- Marketing (AREA)
- Game Theory and Decision Science (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application discloses a method, a device and a storage medium for determining service indexes, and relates to a data processing technology. The specific scheme comprises the following steps: acquiring message information carrying real-time service data sent by a service server; determining a storage position identifier of historical service data corresponding to the service index in a background database according to the type of the message information; acquiring historical service data within a preset time range from a background database according to the storage position identification, and calculating and determining an offline service index based on the historical service data; and when the message information is acquired each time, calculating and determining a real-time service index based on the real-time service data, and determining a target service index according to the offline service index and the real-time service index. According to the method and the device, the acquisition efficiency of the historical service data is improved, the acquisition and calculation processes of the real-time service data and the historical service data are independent, and the dependence on an offline storage medium is reduced, so that the requirement of a calculation task of a service index on timeliness is met.
Description
Technical Field
The present application relates to data processing technologies, and in particular, to a method, an apparatus, and a storage medium for determining a service indicator.
Background
When statistical information of behavior data generated by using a service by a user is generated by calculating a service index so as to analyze the behavior generated by using the service by the user, joint analysis is often required to be performed by combining calculation results of real-time service data and historical data.
The existing method for realizing the joint calculation of the real-time service data and the historical data is to store the historical service data in an offline storage medium, such as a distributed storage system Hbase cluster, after receiving the real-time service data each time, the historical service data needs to be searched in a database of the Hbase in a traversing manner, and after obtaining the historical service data, the calculation is performed according to the real-time service data and the historical service data. Therefore, the existing service index determining method has the defects of low acquisition efficiency and high dependence degree on an off-line storage medium, and cannot meet the requirement of the calculation task of the service index of second level or even millisecond.
Disclosure of Invention
In view of this, a main object of the present application is to provide a method for determining a service index, which does not need to query and acquire historical service data each time real-time service data is calculated, thereby improving the acquisition efficiency of the historical service data, and reducing the dependence on an offline storage medium by separating the acquisition and calculation processes of the real-time service data and the historical service data, thereby satisfying the requirement of the calculation task of the service index on timeliness.
In order to achieve the purpose, the technical scheme provided by the application is as follows:
in a first aspect, an embodiment of the present application provides a method for determining a service index, including the following steps:
acquiring message information carrying real-time service data sent by a service server; the real-time service data is generated by using services by a user;
determining a storage position identifier of historical service data corresponding to the service index in a background database according to the type of the message information; the historical service data is generated by using services by a user; the service index is statistical information of behavior data generated by aiming at the service used by a user;
acquiring historical service data within a preset time range from the background database according to the storage position identification, calculating based on the historical service data, and determining an offline service index;
and when the message information is acquired each time, calculating based on the real-time service data, determining a real-time service index, and determining a target service index according to the offline service index and the real-time service index.
In a possible implementation manner, when acquiring message information carrying real-time service data sent by a service server, the method further includes:
adding the message information into a message queue; the message queue is the information of each message stored in the form of a queue.
In a possible implementation manner, when acquiring message information carrying real-time service data sent by a service server, the method further includes:
storing the real-time service data carried by the message information into the background database as historical service data;
and recording the storage position identification of the stored historical service data in the background database.
In a possible implementation manner, the step of obtaining the historical service data within a preset time range from the background database according to the storage location identifier and a preset scheduling period includes:
acquiring a scheduling cycle, and judging whether the current time meets a time interval specified by the scheduling cycle;
and if the current time meets the condition specified by the scheduling period, acquiring the historical service data within a preset time range from the background database according to the storage position identification.
In a second aspect, based on the same design concept, an embodiment of the present application further provides an apparatus for determining a service index, including:
the real-time service data acquisition module is used for acquiring message information which is sent by the service server and carries real-time service data; the real-time service data is generated by using services by a user;
the historical data acquisition module is used for determining the storage position identification of the historical service data corresponding to the service index in a background database according to the type of the message information; the historical service data is generated by using services by a user; the service index is statistical information of behavior data generated by aiming at the service used by a user; the system is also used for acquiring the historical service data within a preset time range from the background database according to the storage position identification;
the off-line index determining module is used for calculating based on the historical service data and determining an off-line service index;
the real-time index determining module is used for calculating based on the real-time service data and determining a real-time service index when the message information is acquired each time;
and the service index determining module is used for determining a target service index according to the off-line service index and the real-time service index.
In a possible implementation manner, the real-time service data obtaining module is further configured to:
adding the message information into a message queue; the message queue is the information of each message stored in the form of a queue.
In a possible implementation manner, the real-time service data obtaining module is further configured to:
storing the real-time service data carried by the message information into the background database as historical service data;
and recording the storage position identification of the stored historical service data in the background database.
In a possible implementation manner, the historical data obtaining module is further configured to:
acquiring a scheduling cycle, and judging whether the current time meets a time interval specified by the scheduling cycle;
and if the current time meets the condition specified by the scheduling period, acquiring the historical service data within a preset time range from the background database according to the storage position identification.
In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, which can improve the efficiency of obtaining historical service data and meet the requirement of the calculation task of the service index on timeliness. The specific scheme is as follows:
a computer readable storage medium storing computer instructions which, when executed by a processor, may implement the steps of any one of the possible embodiments of the first aspect and the first aspect.
In a fourth aspect, an embodiment of the present application further provides an electronic device, which can improve the efficiency of obtaining historical service data, and meet the requirement of the calculation task of the service index on timeliness. The specific scheme is as follows:
an electronic device comprising the computer-readable storage medium described above, further comprising a processor that can execute the computer-readable storage medium.
In summary, the present application obtains historical service data within a preset time range from a background database according to a preset scheduling period, determines an offline service index according to the historical service data, the historical service data is not inquired and acquired every time the real-time service data is calculated, the acquisition efficiency of the historical service data is improved, the real-time service data is acquired and calculated every time the real-time service data is generated by the service server, the acquisition and calculation processes of the real-time service data and the historical service data are independent, the dependence on an off-line storage medium is reduced, when real-time service data are acquired each time, only real-time service indexes are needed to be calculated, and target service indexes are determined according to the real-time service indexes and prepared off-line service indexes, so that the requirement of calculation tasks of the service indexes on timeliness is met.
Drawings
FIG. 1 is a schematic flow chart according to a first embodiment of the present disclosure;
FIG. 2 is a system architecture diagram according to a second embodiment of the present application;
FIG. 3 is a schematic structural diagram of a third embodiment of the present application;
fig. 4 is a schematic structural diagram of a fifth embodiment of the present application.
Detailed Description
The method and the device for calculating the service indexes can be applied to any application scene needing to be calculated by combining real-time service data and historical service data to obtain the service indexes. Specifically, for example, the method can be applied to application scenarios such as online shopping malls, offline shopping malls, network finance, logistics information and the like.
To make the objects, technical solutions and advantages of the present application more clear, the present application will be further described in detail with reference to the accompanying drawings and specific embodiments.
Example one
Fig. 1 is a schematic flow chart of a first embodiment of the present application, as shown in fig. 1, the first embodiment mainly includes:
s101: acquiring message information carrying real-time service data sent by a service server; the real-time service data is generated by a user using a service.
The service server is a background server which specifically executes the service according to a service request sent by the client or according to the self setting, and in different application scenes, the service server is different types of servers, for example, when the service server is applied to an online mall scene, the service server is a mall service server; when the method is applied to a network financial scene, the service server is a financial service server; when the method is applied to a logistics scene, the service server is a logistics service server.
And the service server sends the real-time service data in a mode of sending the message information carrying the real-time service data. Here, the message information is used as the communication between the service server and the device for implementing the method provided by the embodiment of the application, and the message information is used as a communication method of the application program to the application program, so that the method has the advantages of convenience in reading and writing and quickness in retrieval.
S102: determining a storage position identifier of historical service data corresponding to the service index in a background database according to the type of the message information; the historical service data is generated by using services by a user; the service index is statistical information of behavior data generated by using the service by the user.
Here, the type of the message information may specifically include: for example, assuming that the number of times of login of a user in one day is used as a service index, each login of each user may be used as real-time service data, the real-time service data includes a user identity identifier for representing the identity of the user and a user login identifier for representing the login behavior of the user, at this time, the data type of the message information that may be generated is the user login message, and the real-time service data carried by the message information includes an identifier for representing the identity of the user and an identifier for representing the login behavior of the user. Therefore, the type of the received message information may specifically include: and receiving a user login message once, or receiving a user identity mark and a user login mark when receiving the message, or receiving message information of logging in a certain user once. As long as the service index can be characterized and distinguished from other service indexes.
Each service index needs to be calculated according to different historical service data, so that the stored historical service data needs to be acquired from background data. According to the embodiment of the application, the historical service data is not acquired in a retrieval mode, but the storage position identification of the historical service data corresponding to the service index in the background database is acquired directly according to the type of the message information, so that the acquisition efficiency of the historical service data is improved.
S103: and acquiring the historical service data within a preset time range from the background database according to the storage position identification and a preset scheduling period, calculating based on the historical service data, and determining an offline service index.
When the real-time service data and the historical service data are combined to carry out service index analysis, in order to overcome the defect that the historical service data needs to be inquired and obtained in an offline storage medium every time the service index calculation is carried out according to the obtained real-time service data in the traditional method, a mode that the historical service data in a preset time range is obtained in each preset scheduling period is adopted, so that the dependence on the offline storage medium is reduced, and the requirement of a calculation task of the service index on timeliness is met. The scheduling period is a time interval that is satisfied for periodically acquiring the historical service data. And when the time interval specified by the scheduling period is met, acquiring the historical service data once, and calculating the offline service index once.
S104: and when the message information is acquired each time, calculating based on the real-time service data, determining a real-time service index, and determining a target service index according to the offline service index and the real-time service index.
The calculation of the real-time service index needs to be performed each time the message information is acquired, and the real-time service index is calculated and updated based on the real-time service data carried by the message information. And when the message information is acquired each time, the real-time service index and the off-line service index are subjected to joint calculation to obtain a real-time target service index.
Example two
Fig. 2 is a system architecture diagram of the method provided in the second embodiment of the present application, which shows a system architecture and a data flow of the method provided in the second embodiment of the present application, and as shown in fig. 2, the data flow of the method provided in the second embodiment of the present application includes:
201: and acquiring message information carrying real-time service data from the service server.
202: and storing the message information into a message queue for convenience of reading, writing, storing and querying. The message queue may generally be a first-in first-out message queue, so that the order of reading messages may be guaranteed without storing time information, and in some embodiments, a first-in first-out message queue may be used. The message information is stored in a message queue mode, so that the acquired message information is prevented from being too late to calculate a real-time service index, and a message information storage mode is provided. However, when the rate of real-time service index calculation and the rate of target service index calculation are fast enough, and when the message information is acquired next time, the calculation required to be completed by the last acquired message information can be completed, the message queue does not need to be set to store the message information. The storage resource can be saved and the calculation process can be simplified without setting a message queue.
203: and acquiring real-time service data carried in the message information. In some possible embodiments, the message information is the real-time service data content, and when the message information is the real-time service data content, the message information content is directly used as the real-time service data without acquiring the real-time service data carried in the message information.
204: and determining the storage position identification of the historical service data corresponding to the service index according to the type of the message information.
In particular, the following possible embodiments may be adopted:
a: and under the condition that the type of the message information is the data type of the message information, determining the storage position identification of the historical service data corresponding to the service index according to the data type of the message information.
B: under the condition that the type of the message information is the type of the real-time service data carried by the message information, the real-time service data carried by the message information is firstly obtained, the type of the real-time service data is determined, and then the storage position identification of the historical service data corresponding to the service index is determined according to the type of the real-time service data. For example, assuming that when the number of times of login of a user in one day is used as a service index, the real-time service data carried in the message information includes a user identity for representing the user identity and a user login identity for representing the user login behavior, the type of the real-time service data may be determined as the user login identity, and according to the type of the real-time service data, the storage location identifier of the historical service data of which the data type is the user login identity is obtained.
C: under the condition that the type of the message information is the meaning of the real-time service data carried by the message information, the real-time service data carried by the message information is firstly obtained, and then the storage position identification of the historical service data corresponding to the service index is determined according to the specific content of the real-time service data. For example, assuming that when the number of times of login of a user in one day is used as a service index, the real-time service data carried in the message information includes a user identification for representing the user identity and a user login identification for representing the user login behavior, and the storage location identifiers of all historical service data corresponding to the user identification can be obtained according to the content of the real-time service data of the user identification.
D: the storage location identification of the historical service data may also be obtained in combination with the above possible embodiments a to C. For example, assuming that when the number of times of login of a user in one day is used as a service indicator, real-time service data carried in message information includes a user identification for representing the identity of the user and a user login identification for representing the login behavior of the user, a storage location identifier of all historical service data corresponding to the user identification may be obtained according to the content of the real-time service data of the user identification, and then a storage location identifier of the historical service data of which the data type is the user login identification may be obtained from the storage location identifiers of all historical service data corresponding to the user identification according to the type of the real-time service data of the user login identification.
The storage location identification of the historical service data is specifically determined according to which off-line storage medium is applied by the background database, for example, when the HADOOP server cluster is used as the off-line storage medium, the HADOOP server cluster stores the data in a manner of combining a library and a table, so that the storage location of the data is identified by using the library identification and the table identification, and at this time, the storage location identification of the historical service data is the library identification and the table identification of the HADOOP server cluster.
205: and storing the real-time service data into a background database. Here, the background database may be any one of the commonly used offline storage media, such as various distributed servers, specifically, for example, a HADOOP server cluster, a Hbase server cluster, and the like. Here, the method provided in the embodiment of the present application may not include the step of storing the real-time service data in the background database. The step of storing the real-time service data in the background database may be performed by the service server, and the real-time service data is stored in the background server when the service server obtains the real-time service data.
206. 207, 208: in order to save the data, the real-time service data, the storage location identification of the historical service data and the message queue storing the message information can be selected to be stored in the database. 206, storing the storage position identification of the historical service data into a database; 207, storing the real-time service data into a database; 208 store the message queue storing the message information in the database. Here, any one of commonly used databases, for example, MySQL database, SQL database, Oracle database, etc., may be used. The database may further store a preset scheduling period, a preset time range for acquiring historical service data, a calculation method for the service index, and the like. Of course, the data may be stored in a memory or the like instead of the database.
Here, the calculation method of the service index may be a set of calculation formulas, or may be a program or the like that can realize calculation of the service index.
209. 210: under the condition that the database is used for storing the storage position identification of the historical service data, the preset scheduling period, the preset time range for acquiring the historical service data and the calculation method of the service index, based on the preset scheduling period, the data flow 209 is used for acquiring the historical service data from the background database according to the storage position identification of the historical service data, and the data flow 210 is used for calculating the historical service data according to the calculation method of the service index to acquire the offline service index. The off-line service index is statistical information of historical behavior data generated by using services by a user, which is calculated based on off-line historical service data. For example, assuming that the number of logins of a user in one day is used as a service index, in order to analyze statistical information of the number of logins of a certain user in one day, it is generally required to analyze the number of logins of a user in one day for 30 consecutive days. Therefore, each day can be used as a preset time period, and 29 days can be used as a preset time range for acquiring historical traffic data. Therefore, the user login identification in one day of the user 29 days before the current day can be acquired as the historical service data according to the storage position identification of the historical service data every day. Then, the historical service data is calculated according to a calculation method stored in a database, that is, the login times of the user in the previous 29 days in one day are calculated based on the login identification of the user in one day of the user in the 29 days before the current day, specifically, the login identification of the user in one day of the user in the previous 29 days can be divided by taking the day as a unit to obtain the login identification data of the user in one day of the user in the previous 29 days, the login identification data of the user in one day of the user in the previous 29 days is counted to obtain the login times of the user in one day of the user in the previous 29 days as an offline service index.
Specifically, the following steps may be adopted to obtain the historical service data from the background database according to the storage location identifier of the historical service data based on a preset scheduling period:
acquiring a scheduling cycle, and judging whether the current time meets a time interval specified by the scheduling cycle; and if the current time meets the condition specified by the scheduling period, acquiring the historical service data within a preset time range from the background database according to the storage position identification.
And calculating the offline service index after acquiring the historical service data. Therefore, the operation of acquiring the historical service data and calculating the off-line service index is executed only under the condition that the time interval specified by the scheduling cycle is met, and the acquisition efficiency of the historical service data is improved.
In actual implementation, an ETL job task can be established to calculate historical service data by using an Extract-Transform-Load (ETL) technique, so as to obtain an offline service index. And acquiring a calculation result of the ETL job task as an offline service index by continuously monitoring the execution state of the ETL job task. By combining the off-line service index and the real-time service index, the defect that the accumulated service scene is lack of application to off-line historical service data can be overcome.
211: and under the condition that the database is adopted to store the real-time service data and the calculation method of the service index, determining the real-time service index according to the real-time service data and the calculation method of the service index stored in the database. For example, assume a case where a user logs in for 30 consecutive days in order to analyze statistical information of the number of times of logging in for a certain user in one day when the number of times of logging in for one user in one day is used as a service index. The number of logins of the user in the first 29 days per day is used as an off-line service index, and the number of logins of the user in the current day is required to be counted in real time to be used as a real-time service index. The real-time service index is statistical information of real-time behavior data generated by using services by a user, which is obtained by calculation based on real-time service data, and the real-time service index is calculated each time the real-time service data is obtained. The real-time service index and the off-line service index are calculated at different time and periods respectively, the acquisition and calculation processes of the real-time service data and the historical service data are independent, and the dependence on an off-line storage medium is reduced.
212: and determining a target service index according to the off-line service index and the real-time service index. And performing joint calculation on the off-line service index and the real-time service index, reprocessing data and determining a target service index. Specifically, what kind of joint calculation is performed on the offline service index and the real-time service index can be determined according to a specific application scenario and an analysis purpose. Illustratively, when the login times of a user in a day of 30 continuous days are analyzed, the offline service index and the real-time service index are displayed together to be used as a target service index; when the total number of times of continuous 30-day login of a user is analyzed, adding the offline service index and the real-time service index to obtain a sum as a target service index; when the distribution trend of the user for continuous 30 days of login is analyzed, the offline service index and the real-time service index are subjected to combined calculation by combining a calculation method of data distribution analysis, so that a target service index is obtained.
When the target service index is calculated, the real-time service index is calculated only when the real-time service data is acquired every time, the target service index is determined according to the real-time service index and the prepared off-line service index, the complex and tedious processes of accessing, inquiring off-line storage media and acquiring off-line historical service data are not needed, the requirement of calculation tasks of the service index on timeliness can be met, and second-level or even millisecond-level service index calculation is realized.
213. 214, 215: the obtained target service index may be utilized in various ways. The data stream 213 may be used to store the target service index into an offline storage medium of the background database, and the target service index is stored for a long time so as to be read and used later. The data stream 214 may be used to store the target service indicator in a volatile memory, such as a Redis, which, although it cannot store data for a long time, reads data quickly and conveniently, and is convenient for reading data from the volatile memory through the data stream 215 and providing the data to a data interface, so as to be called by an external program. The obtained target index task can also be directly displayed; or the target index task is provided for the test program to call, and the method provided by the embodiment of the application is tested.
Based on the same design concept, the embodiment of the application also provides a device and a storage medium for determining the service index.
EXAMPLE III
Fig. 3 is a device 300 for determining a service index according to an embodiment of the present application, including:
a real-time service data obtaining module 301, configured to obtain message information carrying real-time service data sent by a service server; the real-time service data is generated by using services by a user;
a historical data obtaining module 302, configured to determine, according to the type of the message information, a storage location identifier of historical service data corresponding to the service indicator in a background database; the historical service data is generated by using services by a user; the service index is statistical information of behavior data generated by aiming at the service used by a user; the system is also used for acquiring the historical service data within a preset time range from the background database according to the storage position identification;
an offline index determining module 303, configured to perform calculation based on the historical service data to determine an offline service index;
a real-time index determining module 304, configured to perform calculation based on the real-time service data to determine a real-time service index each time the message information is acquired;
a service index determining module 305, configured to determine a target service index according to the offline service index and the real-time service index.
In a possible implementation manner, the real-time service data obtaining module 301 is further configured to:
adding the message information into a message queue; the message queue is the information of each message stored in the form of a queue.
In a possible implementation manner, the real-time service data obtaining module 301 is further configured to:
storing the real-time service data carried by the message information into the background database as historical service data;
and recording the storage position identification of the stored historical service data in the background database.
In a possible implementation, the historical data obtaining module 302 is further configured to:
acquiring a scheduling cycle, and judging whether the current time meets a time interval specified by the scheduling cycle;
and if the current time meets the condition specified by the scheduling period, acquiring the historical service data within a preset time range from the background database according to the storage position identification.
Example four
A computer readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the steps of the method provided in embodiment one or embodiment two. In practice, the computer readable medium may be RAM, ROM, EPROM, magnetic disk, optical disk, etc., and is not intended to limit the scope of protection of this application.
The method steps described herein may be implemented in hardware, for example, logic gates, switches, Application Specific Integrated Circuits (ASICs), programmable logic controllers, embedded microcontrollers, etc., in addition to data processing programs. Such hardware capable of implementing the methods described herein may also constitute the present application.
EXAMPLE five
The embodiment of the present application further provides an electronic device, which may be a computer or a server, and the device for determining a service indicator according to the above device embodiment of the present application may be integrated therein. As shown in fig. 4, an electronic device 400 according to a third embodiment of the apparatus of the present application is shown.
The electronic device may include a processor 401 of one or more processing cores, one or more computer-readable storage media 402. The electronic device may further include a power supply 403 and an input-output unit 404. Those skilled in the art will appreciate that fig. 4 does not constitute a limitation of the electronic device and may include more or fewer components than illustrated, or some components may be combined, or a different arrangement of components.
Wherein:
the processor 401 is a control portion of the electronic device, connects the respective portions using various interfaces and lines, and executes the steps of the method provided in the first or second embodiment by running or executing a software program stored in the computer-readable storage medium 402.
The computer-readable storage medium 402 may be used to store a software program, i.e., a program involved in the method provided in embodiment one or embodiment two.
The processor 401 executes various functional applications and data processing by executing software programs stored in the computer-readable storage medium 402. The computer-readable storage medium 402 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a real-time service index determination function, etc.), and the like; the storage data area may store data and the like (such as real-time service data, offline service indexes, real-time service indexes and the like) used according to needs of the electronic device. Further, the computer-readable storage medium 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the computer-readable storage medium 402 may also include a memory controller to provide the processor 401 access to the computer-readable storage medium 402.
The electronic device further comprises a power supply 403 for supplying power to the various components, and preferably, the power supply 403 is logically connected to the processor 401 through a power management system, so that functions of managing charging, discharging, and power consumption are realized through the power management system. The power supply 403 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
The server may also include an input-output unit 404, such as may be used to receive entered numeric or character information, and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control; such as various graphical user interfaces that may be used to display information entered by or provided to the user, as well as the server, which may be composed of graphics, text, icons, video, and any combination thereof.
In summary, the above description is only a preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A method for determining a traffic indicator, comprising:
acquiring message information carrying real-time service data sent by a service server; the real-time service data is generated by using services by a user;
determining a storage position identifier of historical service data corresponding to the service index in a background database according to the type of the message information; the historical service data is generated by using services by a user; the service index is statistical information of behavior data generated by aiming at the service used by a user;
acquiring historical service data within a preset time range from the background database according to the storage position identification and a preset scheduling period, calculating based on the historical service data, and determining an offline service index;
and when the message information is acquired each time, calculating based on the real-time service data, determining a real-time service index, and determining a target service index according to the offline service index and the real-time service index.
2. The method according to claim 1, wherein when acquiring the message information carrying the real-time service data sent by the service server, the method further comprises:
adding the message information into a message queue; the message queue is the information of each message stored in the form of a queue.
3. The method according to claim 1, wherein when acquiring the message information carrying the real-time service data sent by the service server, the method further comprises:
storing the real-time service data carried by the message information into the background database as historical service data;
and recording the storage position identification of the stored historical service data in the background database.
4. The method according to claim 1, wherein the step of obtaining the historical service data within a preset time range from the background database according to the storage location identifier and a preset scheduling period comprises:
acquiring a scheduling cycle, and judging whether the current time meets a time interval specified by the scheduling cycle;
and if the current time meets the condition specified by the scheduling period, acquiring the historical service data within a preset time range from the background database according to the storage position identification.
5. An apparatus for determining a traffic indicator, comprising:
the real-time service data acquisition module is used for acquiring message information which is sent by the service server and carries real-time service data; the real-time service data is generated by using services by a user;
the historical data acquisition module is used for determining the storage position identification of the historical service data corresponding to the service index in a background database according to the type of the message information; the historical service data is generated by using services by a user; the service index is statistical information of behavior data generated by aiming at the service used by a user; the system is also used for acquiring the historical service data within a preset time range from the background database according to the storage position identification;
the off-line index determining module is used for calculating based on the historical service data and determining an off-line service index;
the real-time index determining module is used for calculating based on the real-time service data and determining a real-time service index when the message information is acquired each time;
and the service index determining module is used for determining a target service index according to the off-line service index and the real-time service index.
6. The apparatus of claim 5, wherein the real-time service data obtaining module is further configured to:
adding the message information into a message queue; the message queue is the information of each message stored in the form of a queue.
7. The apparatus of claim 5, wherein the real-time service data obtaining module is further configured to:
storing the real-time service data carried by the message information into the background database as historical service data;
and recording the storage position identification of the stored historical service data in the background database.
8. The apparatus of claim 5, wherein the historical data obtaining module is further configured to:
acquiring a scheduling cycle, and judging whether the current time meets a time interval specified by the scheduling cycle;
and if the current time meets the condition specified by the scheduling period, acquiring the historical service data within a preset time range from the background database according to the storage position identification.
9. A computer readable storage medium storing computer instructions which, when executed by a processor, implement the steps of the method of any one of claims 1 to 4.
10. An electronic device comprising the computer-readable storage medium of claim 9, further comprising a processor that can execute the computer-readable storage medium.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910571501.8A CN112148779B (en) | 2019-06-28 | 2019-06-28 | Method, device and storage medium for determining business index |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910571501.8A CN112148779B (en) | 2019-06-28 | 2019-06-28 | Method, device and storage medium for determining business index |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112148779A true CN112148779A (en) | 2020-12-29 |
| CN112148779B CN112148779B (en) | 2024-06-21 |
Family
ID=73869026
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910571501.8A Active CN112148779B (en) | 2019-06-28 | 2019-06-28 | Method, device and storage medium for determining business index |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112148779B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112801534A (en) * | 2021-02-19 | 2021-05-14 | 广州市网星信息技术有限公司 | AA shunting experiment method, device, equipment and storage medium |
| CN113051279A (en) * | 2021-03-05 | 2021-06-29 | 北京顺达同行科技有限公司 | Data message storage method, storage device, electronic equipment and storage medium |
| CN113094241A (en) * | 2021-05-07 | 2021-07-09 | 北京京东振世信息技术有限公司 | Method, device and equipment for determining accuracy of real-time program and storage medium |
| CN114095564A (en) * | 2021-11-16 | 2022-02-25 | 百度在线网络技术（北京）有限公司 | Data processing method and device, equipment and medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120140916A1 (en) * | 2009-08-13 | 2012-06-07 | Huawei Technologies Co., Ltd. | Method and apparatus for queue routing |
| CN104361110A (en) * | 2014-12-01 | 2015-02-18 | 广东电网有限责任公司清远供电局 | Mass electricity consumption data analysis system as well as real-time calculation method and data mining method |
| US20160189079A1 (en) * | 2014-12-31 | 2016-06-30 | Dassault Systemes Americas Corp. | Method and system for an information engine for analytics and decision-making |
| CN107122431A (en) * | 2017-04-14 | 2017-09-01 | 浙江数链科技有限公司 | A kind of real-time calculating platform and the method for computing data based on real-time calculating platform |
| CN107122369A (en) * | 2016-02-25 | 2017-09-01 | 阿里巴巴集团控股有限公司 | A kind of business data processing method, device and system |
| CN107705149A (en) * | 2017-09-22 | 2018-02-16 | 平安科技（深圳）有限公司 | Data method for real-time monitoring, device, terminal device and storage medium |
| CN108519914A (en) * | 2018-04-09 | 2018-09-11 | 腾讯科技（深圳）有限公司 | Big data computational methods, system and computer equipment |
| CN109597842A (en) * | 2018-12-14 | 2019-04-09 | 深圳前海微众银行股份有限公司 | Data real-time computing technique, device, equipment and computer readable storage medium |
| CN109756372A (en) * | 2018-12-29 | 2019-05-14 | 亚信科技（中国）有限公司 | A kind of elastic telescopic method and device of telecommunication charging system |
-
2019
- 2019-06-28 CN CN201910571501.8A patent/CN112148779B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120140916A1 (en) * | 2009-08-13 | 2012-06-07 | Huawei Technologies Co., Ltd. | Method and apparatus for queue routing |
| CN104361110A (en) * | 2014-12-01 | 2015-02-18 | 广东电网有限责任公司清远供电局 | Mass electricity consumption data analysis system as well as real-time calculation method and data mining method |
| US20160189079A1 (en) * | 2014-12-31 | 2016-06-30 | Dassault Systemes Americas Corp. | Method and system for an information engine for analytics and decision-making |
| CN107122369A (en) * | 2016-02-25 | 2017-09-01 | 阿里巴巴集团控股有限公司 | A kind of business data processing method, device and system |
| CN107122431A (en) * | 2017-04-14 | 2017-09-01 | 浙江数链科技有限公司 | A kind of real-time calculating platform and the method for computing data based on real-time calculating platform |
| CN107705149A (en) * | 2017-09-22 | 2018-02-16 | 平安科技（深圳）有限公司 | Data method for real-time monitoring, device, terminal device and storage medium |
| CN108519914A (en) * | 2018-04-09 | 2018-09-11 | 腾讯科技（深圳）有限公司 | Big data computational methods, system and computer equipment |
| CN109597842A (en) * | 2018-12-14 | 2019-04-09 | 深圳前海微众银行股份有限公司 | Data real-time computing technique, device, equipment and computer readable storage medium |
| CN109756372A (en) * | 2018-12-29 | 2019-05-14 | 亚信科技（中国）有限公司 | A kind of elastic telescopic method and device of telecommunication charging system |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112801534A (en) * | 2021-02-19 | 2021-05-14 | 广州市网星信息技术有限公司 | AA shunting experiment method, device, equipment and storage medium |
| CN113051279A (en) * | 2021-03-05 | 2021-06-29 | 北京顺达同行科技有限公司 | Data message storage method, storage device, electronic equipment and storage medium |
| CN113051279B (en) * | 2021-03-05 | 2024-05-10 | 北京顺达同行科技有限公司 | Storage method, storage device, electronic equipment and storage medium for data message |
| CN113094241A (en) * | 2021-05-07 | 2021-07-09 | 北京京东振世信息技术有限公司 | Method, device and equipment for determining accuracy of real-time program and storage medium |
| CN113094241B (en) * | 2021-05-07 | 2023-09-05 | 北京京东振世信息技术有限公司 | Method, device, equipment and storage medium for determining accuracy of real-time program |
| CN114095564A (en) * | 2021-11-16 | 2022-02-25 | 百度在线网络技术（北京）有限公司 | Data processing method and device, equipment and medium |
| CN114095564B (en) * | 2021-11-16 | 2024-07-16 | 百度在线网络技术（北京）有限公司 | Data processing method, device, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112148779B (en) | 2024-06-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112148779B (en) | Method, device and storage medium for determining business index | |
| CN111563014B (en) | Interface service performance test method, device, equipment and storage medium | |
| CN108170832B (en) | Monitoring system and monitoring method for heterogeneous database of industrial big data | |
| CN111881221A (en) | Method, device and equipment for customer portrait in logistics service | |
| CN110147470B (en) | Cross-machine-room data comparison system and method | |
| CN114416703A (en) | Method, device, equipment and medium for automatically monitoring data integrity | |
| CN112162980A (en) | Data quality control method and system, storage medium and electronic equipment | |
| CN111314158B (en) | Big data platform monitoring method, device, equipment and medium | |
| CN114741396B (en) | Data service processing method and device, electronic equipment and storage medium | |
| CN113468159A (en) | Data application full-link management and control method and system | |
| CN112328688B (en) | Data storage method, device, computer equipment and storage medium | |
| CN111552546B (en) | Task implementation method and device based on multithreading and storage medium | |
| CN112000703A (en) | Data warehousing processing method and device, computer equipment and storage medium | |
| CN104184601A (en) | Obtaining method and device for user online time | |
| CN114416849A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN112583610A (en) | System state prediction method, system state prediction device, server and storage medium | |
| CN102855297B (en) | A kind of method of control data transmission and connector | |
| CN115617480A (en) | Task scheduling method, device and system and storage medium | |
| CN115905322A (en) | Service processing method and device, electronic equipment and storage medium | |
| CN115438056A (en) | Data acquisition method, device, equipment and storage medium | |
| CN114860851A (en) | Data processing method, device, equipment and storage medium | |
| CN113094241A (en) | Method, device and equipment for determining accuracy of real-time program and storage medium | |
| CN113222223A (en) | Wind control linkage early warning method, system, equipment and storage medium for real-time warehouse | |
| CN111639057A (en) | Log message processing method and device, computer equipment and storage medium | |
| CN112101884B (en) | Reminding message generation and pushing method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176 Applicant after: Jingdong Technology Holding Co.,Ltd. Address before: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Beijing Economic and Technological Development Zone, 100176 Applicant before: JINGDONG DIGITAL TECHNOLOGY HOLDINGS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |