WO2019174190A1

WO2019174190A1 - Method for importing data back, apparatus, computer device and storage medium

Info

Publication number: WO2019174190A1
Application number: PCT/CN2018/102607
Authority: WO
Inventors: 陈健鹏; 罗云
Original assignee: 平安科技（深圳）有限公司
Priority date: 2018-03-15
Filing date: 2018-08-28
Publication date: 2019-09-19
Also published as: CN108446371A; CN108446371B

Abstract

A method for importing data back, an apparatus, a computer device and a storage medium. The method comprises: acquiring a current year and a current month which generated business data in a Hadoop server, and a business identification configured in the Hadoop server (S101); creating a table name according to a combination of the current year and the current month of the business data (S102); creating a dynamic table in a MongoDB database server according to the table name, acquiring a creating date of the dynamic table, and acquiring an inheriting class corresponding to the business identification configured in the Hadoop server; and performing corresponding operation on the business data according to the type of the inheriting class and filling in the dynamic table (S103). According to the method, a Hadoop server does not need to call a Java program in a MongoDB database across a wide-area domain, but only needs to import a business identification to the MongoDB database to realize data operations corresponding to the business identification, thereby avoiding the problem of data operation timeout.

Description

Data return method, device, computer device and storage medium

This application claims the priority of the Chinese Patent Application filed on March 15, 2018, the Chinese Patent Office, Application No. 201101214182.0, the application of the name of "data-returning method, device, computer equipment and storage medium", the entire contents of which are incorporated by reference. Combined in this application.

Technical field

The present application relates to the field of database data management technologies, and in particular, to a data return method, device, computer device, and storage medium.

Background technique

Currently, Hadoop servers (Hadoop servers are a distributed file system server) and MongoDB database servers (MongoDB database servers are a distributed document storage database) are generally distributed in different cities or provinces. When it is necessary to delete historical data (such as data from a year ago) in the MongoDB database server through the Hadoop server, the commonly used method is that Hadoop calls the Java program in the MongoDB database across the WAN to implement the deletion of historical data, but The above approach is prone to a large number of timeouts, resulting in inefficient data deletion and updating.

Summary of the invention

The present application provides a data return method, device, computer device and storage medium, and aims to solve the problem that the Java program in the MongoDB database needs to be called when the Hadoop server performs data operations on the historical data in the MongoDB database server in the prior art. In order to achieve the operation of historical data, causing serious problems with timeout.

In a first aspect, the present application provides a data homing method, including:

Obtain the current year and current month of the business data generated by the Hadoop server, and the service identifier configured in the Hadoop server;

Create a table name based on the combination of the current year and the current month of the business data;

Create a dynamic table based on the table name in the MongoDB database server, obtain the creation date of the dynamic table, and obtain the inheritance class corresponding to the service identifier configured in the Hadoop server, and write the dynamic data to the dynamic data according to the type of the inherited class. .

In a second aspect, the present application provides a data feedback device, including:

An information obtaining unit, configured to acquire a current year and a current month of the service data generated by the Hadoop server, and a service identifier configured in the Hadoop server;

a table unit for creating a table name according to a combination of a current year and a current month of the business data;

The data operation unit is configured to create a dynamic table according to the table name in the MongoDB database server, obtain a creation date of the dynamic table, and obtain an inheritance class corresponding to the service identifier configured in the Hadoop server, and perform business data according to the type of the inherited class. The corresponding operation is written to the dynamic table.

In a third aspect, the present application further provides a computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor implementing the computer program The data return method according to any one of the preceding claims.

In a fourth aspect, the present application also provides a storage medium, wherein the storage medium stores a computer program, the computer program comprising program instructions, the program instructions, when executed by a processor, causing the processor to execute the application The data return method of any of the provided.

The application provides a data return method, device, computer device and storage medium. The method obtains the current year and the current month of the service data generated by the Hadoop server, and the service identifier configured in the Hadoop server; creates a table name according to the combination of the current year and the current month of the service data; according to the table name in the MongoDB database The server creates a dynamic table, obtains the creation date of the dynamic table, and obtains an inheritance class corresponding to the service identifier configured in the Hadoop server, and writes the business data to the dynamic table according to the type of the inherited class. The method realizes that the Hadoop server does not need to call the Java program in the MongoDB database across the wide domain, but only needs to pass the service identifier to the MongoDB database, thereby realizing the data operation corresponding to the service identifier, thereby avoiding the problem of data operation timeout.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. Obviously, the drawings in the following description are some embodiments of the present application, For the ordinary technicians, other drawings can be obtained based on these drawings without any creative work.

FIG. 1 is a schematic flowchart of a data return method according to an embodiment of the present application;

FIG. 2 is another schematic flowchart of a data return method according to an embodiment of the present disclosure;

FIG. 3 is another schematic flowchart of a data return method according to an embodiment of the present disclosure;

4 is a schematic diagram of a sub-flow of a data return method provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of another sub-process of a data return method according to an embodiment of the present disclosure;

FIG. 6 is a schematic block diagram of a data returning apparatus according to an embodiment of the present application;

FIG. 7 is another schematic block diagram of a data returning apparatus according to an embodiment of the present application;

FIG. 8 is another schematic block diagram of a data returning apparatus according to an embodiment of the present disclosure;

FIG. 9 is a schematic block diagram of a subunit of a data returning apparatus according to an embodiment of the present disclosure;

FIG. 10 is a schematic block diagram of another subunit of a data returning apparatus according to an embodiment of the present disclosure;

FIG. 11 is a schematic block diagram of a computer device according to an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a data return method provided by an embodiment of the present application. The method is applied to terminals such as desktop computers, laptop computers, and tablet computers. As shown in FIG. 1, the method includes steps S101 to S103.

S101. Obtain a current year and a current month of the service data generated by the Hadoop server, and a service identifier configured in the Hadoop server.

In this embodiment, the current year and the current month of the service data generated by the Hadoop server and the service identifier configured in the Hadoop server are obtained by the Java background; the Java background is connected with the MongoDB database server, and the MongoDB is created and stored. The platform for the collection permission program.

When the Hadoop server generates business data for data running and writes to the MongoDB database server, it will automatically obtain the combination of the current year and the current month of the generated business data by a specified script set in advance in the Java background remotely connected to the Hadoop server. The name of the table, and the service ID configured on the Hadoop server is automatically obtained. The service identifier is pre-configured in the Hadoop server according to the processing requirements of the service data, that is, the service identifier can be visually regarded as a task type identifier, and the service identifier is configured before the Hadoop server transmits the service data.

Because it is the time interval in which the Hadoop server directly informs the Java background that the business data is about to be transmitted, and the service identifier of the operation type for the service data, that is, before the business data is transmitted to the MongoDB database server, it can be received in the Java background. The business data corresponds to the preparation of the table, the deletion of the table, and the like. It is not necessary for the Hadoop server to first call the Java program in the Java background across the wide area to perform corresponding data operations on the business data and then transfer it to the MongoDB database server.

In an embodiment, as shown in FIG. 2, before the step S101, the method further includes:

S101s, an interface class for defining a method, and an inheritance class corresponding to the interface class.

In this embodiment, the interface class is used to define a method, and the inherited class is a specific method for implementing an interface class; for example, an interface class that can be configured in the Java background can define an index creation method, an index deletion method, a table creation method, Methods such as deleting table methods, detecting whether MongoDB tables exist, and renaming table methods.

Among them, the Java interface is a set of method declarations, which is a collection of method features. An interface only has the method features and no method implementation, so these methods can be implemented in different places by different classes, and these implementations can have different Behavior (function). Inheritance is the technique of building a new class based on the definition of an existing class. The definition of a new class can add new data or new functions, or it can use the functionality of a parent class, but it cannot selectively inherit the parent class. That is, you can use the methods defined in the interface class to further refine the concrete implementation method through inheritance. When the interface class and the inheritance class are pre-configured in the Java background, the service identity transmitted in the Hadoop server can be accurately identified.

In an embodiment, as shown in FIG. 3, after the step S101 and before the step S102, the method further includes:

S101a, passing the current year and the current month into the specified script in the Java background;

S101b, transmitting the service identifier configured in the Hadoop server to the Java background;

S101c: Parse the service identifier, and obtain an inheritance class corresponding to the service identifier.

In this embodiment, when the database timing task (such as the timed JOB of the database) is started in the Hadoop server, the Hadoop server generates the service data for data running and writes to the MongoDB database server, and then connects to the Hadoop server remotely. In the Java background, the specified script creates a table name based on the combination of the current year and the current month in which the business data is generated, for example, XXXX201608, where XXXX is the data source department identifier corresponding to the business data, and 201608 indicates August 2016.

The service ID configured on the Hadoop server, including the following identifiers:

ReateCollection, which creates a table;

createIndexs, which creates an index;

dropCollection, which deletes the table;

renameCollection, which renames the table;

After the Java background parses the service identifier, the inheritance class corresponding to the service identifier can be called from the Java background.

When the above service identifiers are specifically represented, each has a customized format. For example, the business identifier of createIndexs includes splitStringByIndexs (the number of indexes), splitStringByUnique (distinguishes the unique index), and splitStringByColumn (the number of columns). These three variables, hypothesis

String splitStringByIndexs="####",

String splitStringByUnique="@@@@",

String splitStringByColumn="::::",

Then the business identifier of createIndexs can be expressed as follows:

Aa::::bb@@@@true####cc@@@@false

That is, a composite unique index is built according to the fields aa and bb, and a non-unique index is built according to the field cc. Java performs segmentation judgment according to this format; the format of other service identifiers is also a similar format, because there are many kinds, and details are not described herein again.

After parsing the service identifier in the Java background, the data operation type that needs to be generated for the business data is known. At this time, the Hadoop server is prevented from first calling the Java program in the Java background across the wide area to perform corresponding data operations on the service data.

In an embodiment, as shown in FIG. 4, the step S101c includes the following sub-steps:

S1011c: Obtain a number N of the first specified character string for distinguishing the number of indexes from the character string corresponding to the service identifier, and divide the service identifier into N+1 segments according to the first specified character string, respectively The first sub-service identification segment to the N+1th sub-service service identification segment;

S1012c, respectively, identifying whether a second designated character string for distinguishing the unique index exists in the first sub-service identifier segment to the N+1th sub-service service identifier segment;

S1013c. If the second specified character string is not identified, the non-unique index is created according to the corresponding sub-service identifier segment.

S1014c: If it is recognized that the second specified character string exists, create a unique index according to the corresponding sub-service identifier segment.

That is, the number N of the first specified character string for distinguishing the number of indexes included in the character string corresponding to the service identifier is obtained, and the service identifier is correspondingly divided into N+1 segments according to the first specified character string, respectively The first sub-service identification segment, the second sub-service service identification segment, ..., the N+1th sub-service service identification segment;

And then identifying the second sub-service identifier segment, the second sub-service service identifier segment, ..., the second designated string in the N+1 sub-service service identifier segment for distinguishing the unique index, if not identified The second specified string creates a non-unique index for the corresponding sub-service identifier segment. If the second specified string exists, the corresponding sub-service identifier segment is created with a unique index. It can be seen that by identifying the specified string, the type of operation on the business data can be identified, thereby quickly creating a dynamic table in the MongoDB database server for operation on the business data.

For example, the first specified character string is set to "####", that is, once there are 4 consecutive # characters in the service identifier, it is regarded as a segment identifier, according to the number N of the first designated string. The service identifier is correspondingly divided into N+1 segments. The second specified string is set to "@@@@", that is, once there are 4 consecutive @ characters in the service identifier, it is regarded as creating a unique index identifier, and the corresponding designated string includes @@ Create a unique index in the @@'s child business identity segment.

In an embodiment, as shown in FIG. 5, the step S1014c further includes the following substeps:

S1015c, respectively, whether a third specified character string for distinguishing the number of columns exists in the first sub-service identifier segment to the N+1th sub-service service identifier segment;

S1016c. If the third specified character string is not identified, the non-composite index is created according to the corresponding sub-service identifier segment.

S1017c: If it is recognized that the third specified character string exists, create a composite index according to the corresponding sub-service identifier segment.

That is, the third specified character string for distinguishing the number of columns in the first sub-service identification segment, the second sub-service service identification segment, ..., the N+1 sub-service service identification segment is respectively identified, if not identified The third specified string is used to create a non-composite index for the corresponding sub-service identifier segment. If the third specified string exists, the corresponding sub-service identifier segment is created with a composite index. It can be seen that by identifying the specified string, the type of operation on the business data can be identified, thereby quickly creating a dynamic table in the MongoDB database server for operation on the business data.

For example, the third specified string is set to "::::", that is, once there are 4 consecutive: characters in the service identifier, it is regarded as creating a composite index identifier, and the corresponding string is included according to the third specified string. Create a composite index in the sub-business identity segment of ::::.

S102. Create a table name according to a combination of a current year of the business data and a current month.

In this embodiment, in the Java background remotely connected to the Hadoop server, the specified script creates a table name according to the current year and the current month combination of the generated service data, for example, XXXX201608, where XXXX is the data source department identifier corresponding to the service data, 201608 Indicates August 2016.

S103: Create a dynamic table in the MongoDB database server according to the table name, obtain a creation date of the dynamic table, and obtain an inheritance class corresponding to the service identifier configured in the Hadoop server, and perform corresponding operations on the service data according to the type of the inherited class. Dynamic table.

In this embodiment, when the inherited class corresponding to the service identifier is parsed, and the service identifier further includes a specific operation condition (for example, deleting a table one year ago), the device may be first created according to the table name in the MongoDB database server. Dynamic table, and then delete the data with the dynamic table creation date interval exceeding the preset time threshold (such as the year set above), and then write the business data to the dynamic table; wherein the dynamic table creation date is the current year and the current month The combination.

It can be seen that the method realizes that the Hadoop server does not need to call the Java program in the MongoDB database across the wide domain, but only needs to pass the service identifier to the MongoDB database, and the data operation corresponding to the service identifier can be realized, thereby avoiding the problem of data operation timeout.

The embodiment of the present application further provides a data returning device, which is used to perform any of the foregoing data return methods. Specifically, please refer to FIG. 6. FIG. 6 is a schematic block diagram of a data returning apparatus provided by an embodiment of the present application. The data retreading device 100 can be installed in a desktop computer, a tablet computer, a laptop computer, or the like.

As shown in FIG. 6, the data returning apparatus 100 includes an information acquiring unit 101, a table building unit 102, and a data operation unit 103.

The information obtaining unit 101 is configured to acquire a current year and a current month of the service data generated by the Hadoop server, and a service identifier configured in the Hadoop server.

In an embodiment, as shown in FIG. 7, the data retrace device 100 further includes:

The configuration unit 101s is configured to pre-configure an interface class for defining a method, and an inheritance class corresponding to the interface class.

In an embodiment, as shown in FIG. 8, the data retrace device 100 further includes:

The first transmission unit 101a is configured to pass the current year and the current month to the specified script in the Java background;

The second transmission unit 101b is configured to transmit the service identifier configured in the Hadoop server to the Java background;

The service identifier parsing unit 101c is configured to parse the service identifier and obtain an inheritance class corresponding to the service identifier.

In an embodiment, as shown in FIG. 9, the service identifier parsing unit 101c includes the following subunits:

The first identifying unit 1011c is configured to obtain the number N of the first specified character string included in the character string corresponding to the service identifier, and divide the service identifier into N according to the first specified character string. The +1 segment is respectively recorded as the first sub-service identification segment to the N+1th sub-service service identification segment;

a first determining unit 1012c, configured to respectively identify, in the first sub-service identifier segment to the N+1th sub-service service identifier segment, a second specified character string for distinguishing the unique index;

a second identifying unit 1013c, configured to create a non-unique index according to the corresponding sub-service identification segment if the second specified character string is not identified;

The third identifying unit 1014c is configured to create a unique index according to the corresponding sub-service identifier segment if it is recognized that the second specified character string exists.

In an embodiment, as shown in FIG. 10, the service identifier parsing unit 101c further includes the following subunits:

a second determining unit 1015c, configured to respectively identify, in the first sub-service identifier segment to the N+1th sub-service service identifier segment, a third designated character string for distinguishing the number of columns;

a fourth identifying unit 1016c, configured to create a non-composite index according to the corresponding sub-service identifier segment if the third specified character string is not identified;

The fifth identifying unit 1017c is configured to create a composite index according to the corresponding sub-service identifier segment if it is recognized that the third specified character string exists.

The table building unit 102 is configured to create a table name according to a combination of a current year of the business data and a current month.

The data operation unit 103 is configured to create a dynamic table according to the table name in the MongoDB database server, obtain a creation date of the dynamic table, and obtain an inheritance class corresponding to the service identifier configured in the Hadoop server, and the business data according to the type of the inherited class. Write the dynamic table by performing the corresponding operation.

It can be seen that the device realizes that the Hadoop server does not need to call the Java program in the MongoDB database across the wide domain, but only needs to pass the service identifier to the MongoDB database, and the data operation corresponding to the service identifier can be realized, thereby avoiding the problem of data operation timeout.

The data return device described above can be implemented in the form of a computer program that can be run on a computer device as shown in FIG.

Referring to FIG. 11, FIG. 11 is a schematic block diagram of a computer device according to an embodiment of the present application. The computer device 500 device can be a terminal. The terminal can be an electronic device such as a tablet computer, a notebook computer, a desktop computer, or a personal digital assistant.

Referring to FIG. 11, the computer device 500 includes a processor 502, a memory, and a network interface 505 connected by a system bus 501, wherein the memory can include a non-volatile storage medium 503 and an internal memory 504.

The non-volatile storage medium 503 can store an operating system 5031 and a computer program 5032. The computer program 5032 includes program instructions that, when executed, cause the processor 502 to perform a data return method.

The processor 502 is used to provide computing and control capabilities to support the operation of the entire computer device 500.

The internal memory 504 provides an environment for operation of the computer program 5032 in the non-volatile storage medium 503, which when executed by the processor 502, may cause the processor 502 to perform a data return method.

The network interface 505 is used for network communication, such as sending assigned tasks and the like. It will be understood by those skilled in the art that the structure shown in FIG. 11 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation of the computer device 500 to which the solution of the present application is applied, and a specific computer device. 500 may include more or fewer components than shown, or some components may be combined, or have different component arrangements.

The processor 502 is configured to run a computer program 5032 stored in the memory to: obtain a current year and a current month of the service data generated by the Hadoop server, and a service identifier configured in the Hadoop server; Create a table name according to the combination of the current year and the current month of the business data; create a dynamic table in the MongoDB database server according to the table name, obtain the creation date of the dynamic table, and obtain an inheritance class corresponding to the service identifier configured in the Hadoop server, The corresponding operation of the business data is written to the dynamic table according to the type of the inherited class.

In an embodiment, the processor 502 also performs the following operations: pre-configuring an interface class for defining a method, and an inheritance class corresponding to the interface class.

In an embodiment, the processor 502 further performs the following operations: the current year and the current month are transmitted to the specified script in the Java background; the service identifier configured in the Hadoop server is transmitted to the Java background; the service identifier is parsed, and the service identifier is obtained. Inherited class.

In an embodiment, the processor 502 further performs the following operations: acquiring the number N of the first specified character string included in the character string corresponding to the service identifier for distinguishing the number of indexes, and according to the first specified character string, The service identifier is correspondingly divided into N+1 segments, which are respectively recorded as the first sub-service identification segment to the N+1th sub-service service identification segment; respectively, whether the first sub-service identification segment to the N+1 sub-service service identification segment are respectively identified. There is a second specified character string for distinguishing the unique index; if the second specified character string is not identified, a non-unique index is created according to the corresponding sub-service identification segment; if it is recognized that the second specified character string exists, according to the corresponding The child business identity segment creates a unique index.

In an embodiment, the processor 502 further performs: separately identifying, in the first sub-service identifier segment to the N+1th sub-service service identifier segment, whether there is a third designated character string for distinguishing the number of columns; The third specified string is identified, and the non-composite index is created according to the corresponding sub-service identifier segment. If the third specified string is found, the composite index is created according to the corresponding sub-service identifier segment.

It will be understood by those skilled in the art that the embodiment of the computer device shown in FIG. 11 does not constitute a limitation on the specific configuration of the computer device. In other embodiments, the computer device may include more or fewer components than illustrated. Or combine some parts, or different parts. For example, in some embodiments, the computer device may include only a memory and a processor. In such an embodiment, the structure and function of the memory and the processor are the same as those of the embodiment shown in FIG. 11, and details are not described herein again.

It should be understood that, in the embodiment of the present application, the processor 502 may be a central processing unit (CPU), and the processor 502 may also be another general-purpose processor, a digital signal processor (DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

In another embodiment of the present application, a storage medium is provided. The storage medium can be a computer readable storage medium. The storage medium stores a computer program, wherein the computer program includes program instructions. The program instruction is implemented by the processor: obtaining the current year and current month of the business data generated by the Hadoop server, and the service identifier configured in the Hadoop server; creating the table name according to the combination of the current year and the current month of the service data Create a dynamic table based on the table name in the MongoDB database server, obtain the creation date of the dynamic table, and obtain the inheritance class corresponding to the business identity configured in the Hadoop server, and perform corresponding operations on the business data according to the type of the inherited class. table.

In an embodiment, the program instructions are implemented by the processor: an interface class for defining a method and an inheritance class corresponding to the interface class are pre-configured.

In an embodiment, when the program instruction is executed by the processor, the current year and the current month are transmitted to the specified script in the Java background; the service identifier configured in the Hadoop server is transmitted to the Java background; the service identifier is obtained, and the service is obtained. Identifies the corresponding inherited class.

In an embodiment, when the program instruction is executed by the processor, obtaining: a number N of the first specified character string included in the character string corresponding to the service identifier for distinguishing the number of indexes, and according to the first specified character The string is divided into N+1 segments, which are respectively recorded as the first sub-service identifier segment to the N+1th sub-service service identifier segment, and respectively identify the first sub-service identifier segment to the N+1-sub-service segment. Whether there is a second specified character string for distinguishing the unique index; if the second specified character string is not identified, a non-unique index is created according to the corresponding sub-service identification segment; if it is recognized that the second specified character string exists, according to A corresponding index is created for the corresponding sub-service identification segment.

In an embodiment, when the program instruction is executed by the processor, respectively: whether a third specified character string for distinguishing the number of columns exists in the first sub-service identifier segment to the N+1th sub-service service identifier segment; If the third specified string is not identified, the non-composite index is created according to the corresponding sub-service identifier segment; if the third specified string is found, the composite index is created according to the corresponding sub-service identifier segment.

The storage medium may be an internal storage unit of the aforementioned device, such as a hard disk or a memory of the device. The storage medium may also be an external storage device of the device, such as a plug-in hard disk equipped on the device, a smart memory card (SMC), a secure digital (SD) card, and a flash memory card. (Flash Card), etc. Further, the storage medium may also include both an internal storage unit of the device and an external storage device.

A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the device, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again. Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both, for clarity of hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

In the several embodiments provided by the present application, it should be understood that the disclosed apparatus, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, or a unit set having the same function. Synthesizing a unit, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, or an electrical, mechanical or other form of connection.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a storage medium. Based on such understanding, the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a removable hard disk, a read-only memory (ROM), a magnetic disk, or an optical disk, and the like, which can store program codes.

The above is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any equivalent person can be easily conceived within the technical scope of the present invention by any person skilled in the art. Modifications or substitutions are intended to be included within the scope of the invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

A data return method, comprising:

Obtain the current year and current month of the business data generated by the Hadoop server, and the service identifier configured in the Hadoop server;

Create a table name based on the combination of the current year and the current month of the business data;

Create a dynamic table based on the table name in the MongoDB database server, obtain the creation date of the dynamic table, and obtain the inheritance class corresponding to the service identifier configured in the Hadoop server, and write the dynamic data to the dynamic data according to the type of the inherited class. .
The data homing method according to claim 1, wherein the obtaining the current year and the current month of the service data generated by the Hadoop server and the service identifier configured in the Hadoop server further includes:

An interface class for defining a method and an inheritance class corresponding to the interface class are pre-configured.
The data homing method according to claim 1, wherein the obtaining the current year and the current month of the service data generated by the Hadoop server, and the service identifier configured in the Hadoop server, further includes:

Pass the current year and the current month into the specified script in the Java background;

Transfer the service identifier configured in the Hadoop server to the Java background;

Parse the business identifier and obtain the inheritance class corresponding to the business identifier.
The data homing method according to claim 3, wherein the parsing the service identifier and obtaining the inheritance class corresponding to the service identifier comprises:

Obtaining, by the string corresponding to the service identifier, the number N of the first specified character string for distinguishing the number of indexes, and dividing the service identifier into N+1 segments according to the first specified character string, respectively a sub-service identification segment to an N+1th sub-service service identification segment;

Identifying, by the first sub-service identifier segment to the N+1th sub-service service identifier segment, respectively, a second designated character string for distinguishing the unique index;

If the second specified string is not identified, a non-unique index is created according to the corresponding sub-service identifier segment;

If it is recognized that the second specified string exists, a unique index is created according to the corresponding sub-service identifier segment.
The data returning method according to claim 4, wherein the identifying the second specified string for distinguishing the unique index from the first sub-service identifier segment to the (N+1)th sub-service service identifier segment respectively After that, it also includes:

Identifying, by the first sub-service identifier segment to the N+1th sub-service service identifier segment, whether there is a third designated character string for distinguishing the number of columns;

If the third specified string is not identified, a non-composite index is created according to the corresponding sub-service identifier segment;

If it is recognized that there is a third specified string, a composite index is created according to the corresponding sub-service identifier segment.
A data feedback device, comprising:

An information obtaining unit, configured to acquire a current year and a current month of the service data generated by the Hadoop server, and a service identifier configured in the Hadoop server;

a table unit for creating a table name according to a combination of a current year and a current month of the business data;

The data operation unit is configured to create a dynamic table according to the table name in the MongoDB database server, obtain a creation date of the dynamic table, and obtain an inheritance class corresponding to the service identifier configured in the Hadoop server, and perform business data according to the type of the inherited class. The corresponding operation is written to the dynamic table.
The data feedback device according to claim 6, further comprising:

A configuration unit for pre-configuring an interface class for defining a method and an inheritance class corresponding to the interface class.
The data feedback device according to claim 7, further comprising:

a first transmission unit, configured to pass the current year and the current month to the specified script in the Java background;

a second transmission unit, configured to transmit the service identifier configured in the Hadoop server to the Java background;

The service identifier parsing unit is configured to parse the service identifier and obtain an inheritance class corresponding to the service identifier.
The data returning device according to claim 8, wherein the service identifier parsing unit comprises:

The first identifying unit is configured to obtain the number N of the first specified character string included in the character string corresponding to the service identifier, and divide the service identifier into N+ according to the first specified character string. The first segment is recorded as the first sub-service identification segment to the N+1th sub-service service identification segment;

a first determining unit, configured to respectively identify, in the first sub-service identifier segment to the N+1th sub-service service identifier segment, a second specified character string for distinguishing the unique index;

a second identifying unit, configured to create a non-unique index according to the corresponding sub-service identification segment if the second specified character string is not identified;

The third identifying unit is configured to create a unique index according to the corresponding sub-service identification segment if the second specified character string exists.
The data redirection device according to claim 9, wherein the service identifier parsing unit further comprises:

a second determining unit, configured to respectively identify whether a third specified character string for distinguishing the number of columns exists in the first sub-service identifier segment to the N+1th sub-service service identifier segment;

a fourth identifying unit, configured to create a non-composite index according to the corresponding sub-service identifier segment if the third specified character string is not identified;

The fifth identifying unit is configured to create a composite index according to the corresponding sub-service identifier segment if the third specified character string exists.
A computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the computer program as claimed in claim 1 The data return method of any of 5.
The computer device according to claim 11, wherein the obtaining the current year and the current month of the service data generated by the Hadoop server and the service identifier configured in the Hadoop server further includes:

An interface class for defining a method and an inheritance class corresponding to the interface class are pre-configured.
The computer device according to claim 11, wherein the obtaining the current year and the current month of the service data generated by the Hadoop server and the service identifier configured in the Hadoop server further includes:

Pass the current year and the current month into the specified script in the Java background;

Transfer the service identifier configured in the Hadoop server to the Java background;

Parse the business identifier and obtain the inheritance class corresponding to the business identifier.
The computer device according to claim 13, wherein the parsing the service identifier and obtaining the inheritance class corresponding to the service identifier comprises:

Obtaining, by the string corresponding to the service identifier, the number N of the first specified character string for distinguishing the number of indexes, and dividing the service identifier into N+1 segments according to the first specified character string, respectively a sub-service identification segment to an N+1th sub-service service identification segment;

Identifying, by the first sub-service identifier segment to the N+1th sub-service service identifier segment, respectively, a second designated character string for distinguishing the unique index;

If the second specified string is not identified, a non-unique index is created according to the corresponding sub-service identifier segment;

If it is recognized that the second specified string exists, a unique index is created according to the corresponding sub-service identifier segment.
The computer device according to claim 14, wherein the identifying the second specified character string for distinguishing the unique index from the first sub-service identification segment to the N+1th sub-service service identification segment respectively Also includes:

Identifying, by the first sub-service identifier segment to the N+1th sub-service service identifier segment, whether there is a third designated character string for distinguishing the number of columns;

If the third specified string is not identified, a non-composite index is created according to the corresponding sub-service identifier segment;

If it is recognized that there is a third specified string, a composite index is created according to the corresponding sub-service identifier segment.
A storage medium, characterized in that the storage medium stores a computer program, the computer program comprising program instructions that, when executed by a processor, cause the processor to perform the following operations:

Obtain the current year and current month of the business data generated by the Hadoop server, and the service identifier configured in the Hadoop server;

Create a table name based on the combination of the current year and the current month of the business data;

Create a dynamic table based on the table name in the MongoDB database server, obtain the creation date of the dynamic table, and obtain the inheritance class corresponding to the service identifier configured in the Hadoop server, and write the dynamic data to the dynamic data according to the type of the inherited class. .
The storage medium according to claim 16, wherein the obtaining the current year and the current month of the service data generated by the Hadoop server, and the service identifier configured in the Hadoop server, further includes:

An interface class for defining a method and an inheritance class corresponding to the interface class are pre-configured.
The storage medium according to claim 16, wherein the obtaining the current year and the current month of the service data generated by the Hadoop server and the service identifier configured in the Hadoop server further includes:

Pass the current year and the current month into the specified script in the Java background;

Transfer the service identifier configured in the Hadoop server to the Java background;

Parse the business identifier and obtain the inheritance class corresponding to the business identifier.
The storage medium according to claim 18, wherein the parsing the service identifier and obtaining the inheritance class corresponding to the service identifier comprises:

Obtaining, by the string corresponding to the service identifier, the number N of the first specified character string for distinguishing the number of indexes, and dividing the service identifier into N+1 segments according to the first specified character string, respectively a sub-service identification segment to an N+1th sub-service service identification segment;

Identifying, by the first sub-service identifier segment to the N+1th sub-service service identifier segment, respectively, a second designated character string for distinguishing the unique index;

If the second specified string is not identified, a non-unique index is created according to the corresponding sub-service identifier segment;

If it is recognized that the second specified string exists, a unique index is created according to the corresponding sub-service identifier segment.
The storage medium according to claim 19, wherein the identifying the second specified character string for distinguishing the unique index from the first sub-service identification segment to the (N+1)th sub-service service identification segment respectively Also includes:

Identifying, by the first sub-service identifier segment to the N+1th sub-service service identifier segment, whether there is a third designated character string for distinguishing the number of columns;

If the third specified string is not identified, a non-composite index is created according to the corresponding sub-service identifier segment;

If it is recognized that there is a third specified string, a composite index is created according to the corresponding sub-service identifier segment.