WO2019091216A1

WO2019091216A1 - Data management method and apparatus, computing device and storage medium

Info

Publication number: WO2019091216A1
Application number: PCT/CN2018/105850
Authority: WO
Inventors: 卢申朋
Original assignee: 广东神马搜索科技有限公司
Priority date: 2017-11-10
Filing date: 2018-09-14
Publication date: 2019-05-16
Also published as: CN108052335B; CN108052335A

Abstract

A data management method and apparatus, a computing device and a storage medium, being used for managing data required to be invoked by a service system in implementing a service processing logic, said method comprising: registering data by means of a preset data registration interface, so as to define a predetermined data type for the data (S110); and in response to a data reading request of the service system, reading, by means of a preset data loading interface, target data corresponding to the data reading request (S120). Thus, the invention can separate the service processing logic and data management of the service system, so that the service system can focus on the development of the service processing logic.

Description

Data management method, device, computing device and storage medium

Technical field

The present invention relates to the field of service processing technologies, and in particular, to a data management method, apparatus, computing device, and storage medium in a service processing process.

Background technique

With the rapid development of Internet technologies, business systems for providing online services are emerging, such as search systems, recommendation systems, and the like. The data that the business system needs to call when implementing its business logic is internal data, and the internal data is generally stored in a local file. The management of internal data is an important task in the process of business system processing. If the management of internal data is completely left to the business system, when designing the business system, not only the special business processing logic but also the data management logic needs to be considered. It not only increases the design cost of the business system, but also increases the complexity of the business system processing business process. In this way, on the one hand, it is not conducive to the stability of online services, on the other hand, it is not conducive to the business system to quickly iterate each service

Summary of the invention

The main purpose of the present invention is to provide a data management method, device, computing device and storage medium. The invention can be used to manage internal data involved in the process of implementing business process logic in a business system, so that service processing of the service system can be realized. The separation of logic and data management enables business systems to focus on the development of business process logic.

According to an aspect of the present invention, a data management method is provided for providing a service system with at least part of internal data that needs to be invoked in implementing business process logic, the method comprising: registering an interface pair through a preset data At least part of the internal data is registered to define a predetermined data type for at least part of the internal data; in response to the internal data read request of the service system, the internal data after registration is read and internal through a preset data loading interface The target internal data corresponding to the data read request is provided to the business system.

Thereby, the business process logic and the data management of the business system can be separated, so that the business system can focus on the development of the business process logic.

Preferably, registering the internal data through the data registration interface may include: saving a type generator for creating a predetermined data type in a global static variable; and creating a predetermined data type for the internal data by the type generator to implement the internal data Registration.

Thus, when registering internal data, the corresponding data type can be defined by the type generator, so that the internal data can be registered as a custom data type.

Preferably, after the target data is read from the registered internal data to be provided to the service system by using a preset data loading interface, the method further includes: the data loading interface is configured to identify target data. Version version member variable. The version set can characterize whether the data is up to date.

Preferably, the method may further include: periodically reading the target data and its version member variable through a preset data reloading interface; the version member variable of the target data acquired this time and the last obtained version member variable The target data is updated when the value of the version member variable is updated. Thereby, an automatic update of the data can be achieved.

According to another aspect of the present invention, a data management apparatus is provided for providing a service system with at least part of internal data that needs to be invoked in implementing business processing logic, including: a data registration module, configured to at least partially internal data Registering to define at least part of the internal data to define a predetermined data type; the data loading module for responding to the internal data read request of the business system, reading from the registered internal data corresponding to the internal data read request Target data is provided to the business system.

Preferably, the data registration module saves the type generator for creating a predetermined data type in the form of a global static variable, and creates a predetermined data type by the type generator to implement registration of the internal data.

Preferably, the data loading module is further configured to: after reading the target data from the internal data after registration to provide to the business system, further setting a version member variable for identifying a version of the target data.

Preferably, the data management apparatus may further include: a data reloading module, configured to reread the target data and its version member variable in a predetermined cycle; and a data update module, configured to acquire the target data acquired by the module in the current data reloading module The version member variable is updated with the target data when the version member variable is updated compared to the last obtained version member variable.

According to another aspect of the present invention, there is also provided a computing device comprising: a processor; and a memory having stored thereon executable code for causing the processor to perform the above-described execution when the executable code is executed by the processor Data management method.

According to another aspect of the present invention, there is also provided a non-transitory machine readable storage medium having stored thereon executable code that, when executed by a processor of an electronic device, causes the processor to perform the above And data management methods.

In summary, the data management method, device, computing device and storage medium of the present invention can manage the internal data involved in the process of implementing the business process logic of the service system, so that the business process logic and the data management phase separation of the service system can be realized. So that the business system can focus on the development of business processing logic.

DRAWINGS

The above and other objects, features, and advantages of the present invention will become more apparent from the aspects of the embodiments of the invention. The same parts.

FIG. 1 is a schematic flow chart showing a data management method according to an embodiment of the present invention.

FIG. 2 is a schematic block diagram showing the structure of a data management device according to an embodiment of the present invention.

3 is a schematic block diagram showing the structure of a computing device in accordance with an embodiment of the present invention.

Detailed ways

Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the preferred embodiment of the present invention has been shown in the drawings, it is understood that Rather, these embodiments are provided so that this disclosure will be thorough and complete.

As mentioned above, the management of internal data is an important task in the process of business system processing. If the management of internal data is completely laissez-fed to the business system, it is not conducive to the stability of online services, and is not conducive to the rapid operation of business systems. Iterate through the various businesses.

To this end, the present invention proposes a data management scheme capable of managing at least part of the internal data that the business system needs to invoke in implementing the business processing logic. The data management scheme of the present invention mainly includes two parts: data registration and data loading.

Among them, data registration and data loading can be implemented by different predefined data interfaces. For convenience of description, an interface that implements a data registration function may be referred to as a data registration interface, and an interface that implements a data loading function may be referred to as a data loading interface.

It should be noted that the service system described in the present invention may be an online service system for providing services to users, such as an online search system, an online recommendation system, and the like. It can also be other various forms of systems capable of business processing, such as a distributed task processing system.

The "internal data" referred to in the present invention corresponds to "external data", and the internal data refers to data that needs to be called from a local file in the process of realizing the business process logic of the business system, and the external data refers to the specific business process in which the business system is executing. Need to get external data from the database. Taking the business system as an online search system as an example, the internal data refers to data that the online search system needs to retrieve from the local search logic, for example, initialization information and configuration information required to implement the search logic. The external data refers to data stored in the database, such as user login information, user search history, and the like, which are required for the online search system to perform a search.

Referring to FIG. 1, in step S110, at least part of the internal data that the service system needs to call in implementing the business processing logic is registered through a preset data registration interface to define a predetermined data type for the internal data.

As described above, the internal data referred to in this embodiment mainly refers to internal data that needs to be called when the service system implements the business processing logic, and the internal data may be stored in a file local to the system. The data registration interface can define such data as a custom data type to facilitate data load interface read.

As an optional embodiment of the present invention, a type generator for creating a predetermined data type may be saved in a global static variable (recordMap) to create a predetermined data type for data by the type generator to implement registration of the data. The type generator can be a class factory for creating data types. You can save multiple class factories as global static variables (recordMap). Different factory-wrapped factory functions are used to create different data types. When registering data, you can select the factory function of the corresponding class factory to create the corresponding data type.

In step S120, in response to the data read request of the service system, the target data corresponding to the data read request is read through a preset data load interface.

The data loading interface is mainly used to implement the data reading operation. After the data is registered as a predetermined data type through the data registration interface, when the business processing system needs to retrieve the internal data, the data loading interface can be read. take. In this way, in the entire data reading process, the business system only needs to communicate with the data loading interface, and the data reading operation can be realized, that is, the business party only needs to construct a function interface for calling the data loading interface, and the corresponding function can be obtained. data.

As an optional embodiment of the present invention, after reading the target data, the data loading interface may further set a version member variable for identifying the version of the target data. For the same target data, the version member variable set by the data loading interface may be increased or decreased. The value of the version member variable is larger, indicating that the version of the data is newer.

According to the version member variable set by the data loading interface, the data can be re-read by using a preset data reloading interface to implement data update. Specifically, the data reloading interface can be used to periodically read the data and its version member variable. The value of the version member variable is updated when the version member variable of the acquired data is compared with the version member variable obtained last time. In this case, it can be determined that the data has been updated, and the data can be updated by the predetermined update method. The specific implementation of the data update may be a plurality of modes, such as a dual exchange mode and a lock exchange. The specific implementation of the data update is well known to those skilled in the art, and details are not described herein again.

In a specific embodiment, after the data loading interface reads the target data and sets the version member variable for the target data, the data reloading interface is automatically triggered to re-read the target data and its version member variable. For the same target data, If the version member variable obtained this time has an update of the value of the version member variable compared to the last obtained version member variable, it can be determined that it has been updated. This enables automatic updating of data.

In this embodiment, whether the value of the version member variable exists is updated by comparing whether the version member variable of the target data acquired this time is consistent with the value of the version member variable acquired last time. In the case where the comparison results are inconsistent, it can be determined that the value of the version member variable is updated. The value of the version member variable set by the data loading interface as the target data is an example of the incremental value set with the update of the version. The reloading interface can compare whether the value of the version member variable obtained this time is greater than the version obtained last time. The value of the member variable, if the decision is greater, can be determined that the value of the version member variable is updated.

In summary, with the data management scheme of the embodiment, the service system only needs to be responsible for its own business processing logic, without paying attention to the management of the internal data that needs to be invoked by the business processing logic, thereby realizing the business processing logic and data management of the business system. The logical phase separation allows the business system to focus on the development of business logic.

According to the foregoing description of the data management scheme of the embodiment, the data management scheme of the embodiment can implement the corresponding interface by using the inheritance mode by defining the basic interface of the data (the data registration interface, the data loading interface, and the data reloading interface). In this way, automatic registration of data can be realized, and data can be updated through version management.

As an example of the present invention, in order to facilitate data management, only three basic interfaces may be defined: an initialization interface, a load interface, a reload interface, and a member variable representing a version. In the inherited subclass, you need to implement the corresponding three interfaces. The above three basic interfaces can be encapsulated in a base class, the initialization interface can be used for initializing operations, and the data registration mechanism can also be implemented in the initialization interface. The data registration mechanism has been described in detail above. Let me repeat. During the loading interface implementation process, the value of the version member variable can be set for the loaded data, so that the reloading interface can determine whether the data is updated according to the reloading result. When using the data reload interface for data updates, a new thread can be introduced that can control the data reload interface reload results to periodically check for data updates.

The data management scheme of the present invention can be implemented as a base class including the above interface, such that the service system only needs to implement the corresponding data interface, and the corresponding data can be obtained through a function interface when used, and the use process does not need to be used. Care about the loading and updating of data to facilitate the development of business logic.

So far, the specific implementation process of the data management scheme of the present invention has been described in detail with reference to FIG. 1. In addition, the data management scheme of the present invention can also be implemented as a data management apparatus. FIG. 2 is a schematic block diagram showing the structure of a data management device according to an embodiment of the present invention. The functional modules of the data management device 200 may be implemented by hardware, software, or a combination of hardware and software that implements the principles of the present invention. Those skilled in the art can understand that the functional modules described in FIG. 2 can be combined or divided into sub-modules to implement the principles of the above invention. Accordingly, the description herein may support any possible combination, or division, or further limitation of the functional modules described herein.

In the following, only the functional modules that the data management device 200 can have and the operations that can be performed by the functional modules are briefly described. For the details involved, reference may be made to the above description, and details are not described herein again.

Referring to FIG. 2, the data management apparatus 200 is configured to manage at least part of internal data that the service system needs to invoke in implementing the business processing logic. The data management apparatus 200 includes a data registration module 210 and a data loading module 220.

The data registration module 210 is configured to register at least part of the internal data that the business system needs to invoke in implementing the business processing logic to define a predetermined data type for the internal data. Alternatively, the data registration module 210 may save the type generator for creating a predetermined data type in the form of a global static variable, and create a predetermined data type by the type generator to implement registration of the data.

The data loading module 220 is configured to read the target data corresponding to the internal data read request in response to the internal data read request of the business system. The data loading module 220 may further set a version member variable for identifying a version of the target data after reading the target data.

As an optional embodiment of the present invention, the data management device 200 may further include a data reloading module 230 and a data updating module 240 shown by a broken line in the figure.

The data reload module 230 is configured to reread the target data and its version member variables in a predetermined cycle. The data update module 240 is configured to update the target data when the version member variable of the target data acquired by the data reloading module is updated compared with the last obtained version member variable.

The data management scheme of the present invention can also be implemented by a computing device. FIG. 3 shows a schematic block diagram of a computing device 300 in accordance with one embodiment of the present invention. The computing device 300 can be deployed in a service system or in a third-party platform different from the service system.

As shown in FIG. 3, the computing device 300 of this embodiment may include a processor 310 and a memory 320. Executable code may be stored on the memory 320, and when the executable code is executed by the processor, causes the processor 310 to perform the data management method of the present invention. For a specific implementation, refer to the related description in FIG. 1 above, and details are not described herein again.

The data management method, apparatus, and computing device according to the present invention have been described in detail above with reference to the accompanying drawings.

Furthermore, the method according to the invention may also be embodied as a computer program or computer program product comprising computer program code instructions for performing the various steps defined above in the above method of the invention.

Alternatively, the present invention may be embodied as a non-transitory machine readable storage medium (or computer readable storage medium, or machine readable storage medium) having stored thereon executable code (or computer program, or computer instruction code) When the executable code (or computer program, or computer instruction code) is executed by a processor of an electronic device (or computing device, server, etc.), causing the processor to perform various steps of the above method in accordance with the present invention .

The various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality and operation of possible implementations of systems and methods in accordance with various embodiments of the present invention. In this regard, each block of the flowchart or block diagram can represent a module, a program segment, or a portion of code that includes one or more of the Executable instructions. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in a different order than the ones in the drawings. For example, two consecutive blocks may be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified function or operation. Or it can be implemented by a combination of dedicated hardware and computer instructions.

The embodiments of the present invention have been described above, and the foregoing description is illustrative, not limiting, and not limited to the disclosed embodiments. Numerous modifications and changes will be apparent to those skilled in the art without departing from the scope of the invention. The choice of terms used herein is intended to best explain the principles, practical applications, or improvements of the techniques in the various embodiments of the embodiments, or to enable those of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

A data management method, configured to provide at least part of internal data that needs to be invoked in a business processing logic for a business system, the method comprising:

Registering the at least part of the internal data through a preset data registration interface to define a predetermined data type for the at least part of the internal data;

Responding to the internal data read request of the service system, reading target data corresponding to the internal data read request from the registered internal data through a preset data loading interface to provide to the business system .
The method of claim 1, wherein registering the internal data through the data registration interface comprises:

Saving a type generator for creating a predetermined data type as a global static variable;

A predetermined data type is created for the internal data by the type generator to implement registration of internal data.
The method according to claim 1 or 2, wherein after the target data is read from the registered internal data to be provided to the service system through a preset data loading interface, the method further includes:

The data loading interface sets a version member variable for identifying a version of the target data.
The method of claim 3, further comprising:

Periodically reading the target data and its version member variables through a preset data reloading interface;

When the version member variable of the target data acquired this time is updated compared with the version member variable acquired last time, the value of the version member variable is updated, and the target data is updated.
A data management apparatus, configured to provide a service system with at least part of internal data that needs to be invoked in implementing business processing logic, including:

a data registration module, configured to register the at least part of the internal data to define a predetermined data type for the at least part of the internal data;

And a data loading module, configured to read target data corresponding to the internal data read request from the registered internal data to be provided to the service system in response to an internal data read request of the service system.
The apparatus according to claim 5, wherein said data registration module saves a type generator for creating a predetermined data type in a global static variable, and creates a reservation for said internal data by said type generator The data type to implement the registration of internal data.
The device according to claim 5 or 6, wherein the data loading module is further configured to:

After reading the target data from the internal data after registration to provide to the business system, a version member variable for identifying a version of the target data is also set.
The device according to claim 7, further comprising:

a data reloading module for rereading the target data and its version member variables in a predetermined cycle;

a data update module, configured to: when the version member variable of the target data acquired by the data reloading module is updated compared with the last obtained version member variable, and the value of the version member variable is updated, Update.
A computing device, comprising:

Processor;

A memory having executable code stored thereon that, when executed by the processor, causes the processor to perform the method of any of claims 1-4.
A non-transitory machine readable storage medium having stored thereon executable code that, when executed by a processor of an electronic device, causes the processor to perform as claimed in claims 1 to 4 The method of any of the preceding claims.