CN111858587A

CN111858587A - Database data counting method, device, equipment and storage medium

Info

Publication number: CN111858587A
Application number: CN202010663835.0A
Authority: CN
Inventors: 汪杰
Original assignee: Beijing Qingyun Science And Technology Co ltd
Current assignee: Beijing Qingyun Science And Technology Co ltd
Priority date: 2020-07-10
Filing date: 2020-07-10
Publication date: 2020-10-30

Abstract

The embodiment of the invention discloses a method, a device, equipment and a storage medium for counting database data. The method comprises the following steps: generating counting variable quantity data according to the data quantity of the data to be processed; writing the counting variation data into a database; and updating the count value of the database according to the count variable quantity data. The counting method of the database data disclosed by the embodiment of the invention processes the counting variable quantity data together with the database so as to update the counting value of the database according to the counting variable quantity data, can improve the accuracy of data counting, and does not influence the normal service of the database.

Description

Database data counting method, device, equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of data counting, in particular to a method, a device, equipment and a storage medium for counting database data.

Background

The amount of data stored in the database is a very common requirement, and in the SQL database, if the amount of data in one table needs to be counted, a statement such as SELECT COUNT (1) FROM table may be used, and the number of record lines in the table is returned by executing the statement. However, in most kv databases, there is no functional interface to acquire the amount of data, and thus an application is required to implement the logic of statistical counting.

In the prior art, the counting of data is generally realized by the following three ways: the first method adopts a heterogeneous database to store counting, and the counting error is caused by the condition that the information of the two databases is not uniform; the second method adopts key value to store counting information, and the data can only be processed in series in this way, which affects the efficiency of data processing; and in the third method, counting information is not stored, and when the data volume of the database needs to be acquired, the database is scanned in a full disk mode, which consumes a great deal of time in data query.

Disclosure of Invention

The embodiment of the invention provides a method, a device, equipment and a storage medium for counting database data, which are used for counting the data volume of a database, improving the accuracy of data counting and not influencing the normal service of the database.

In a first aspect, an embodiment of the present invention provides a method for counting database data, including:

generating counting variable quantity data according to the data quantity of the data to be processed;

writing the counting variation data into a database;

and updating the count value of the database according to the count variable quantity data.

Further, the counting variation data carries a set identification code.

Further, the data to be processed includes data to be written and data to be deleted.

Further, if the data to be processed is data to be written, writing the count variation data into a database, including:

and calling a batch operation interface, and writing the data to be written and the counting variable quantity data into a database through the batch operation interface.

Further, if the data to be processed is data to be deleted, writing the count variation data into a database, including:

and calling a batch operation interface, writing the counting variable quantity data into a database through the batch operation interface, and deleting the data to be deleted from the database.

Further, updating the count value of the database according to the count variation data includes:

searching the counting variable quantity data in a database according to the set identification code;

determining a change value of the data according to the searched counting change data;

and accumulating the change value and the current count value of the database to obtain an updated count value.

Further, after updating the count value of the database according to the count variation data, the method further includes:

And deleting the counting variable quantity data from a database.

In a second aspect, an embodiment of the present invention further provides a device for counting database data, including:

the counting variable data generating module is used for generating counting variable data according to the data quantity of the data to be processed;

the data writing module is used for processing the counting variable quantity data into a database;

and the count value updating module is used for updating the count value of the database according to the count variable quantity data.

In a third aspect, an embodiment of the present invention further provides a computer device, where the computer device includes: comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the counting method of the database data according to the embodiment of the invention.

In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processing apparatus, implements the counting method for database data according to the embodiment of the present invention.

According to the embodiment of the invention, counting variable quantity data are generated according to the data volume of the data to be processed, then the counting variable quantity data are processed in the database, and finally the counting value of the database is updated according to the counting variable quantity data. The counting method of the database data disclosed by the embodiment of the invention processes the counting variable quantity data together with the database so as to update the counting value of the database according to the counting variable quantity data, can improve the accuracy of data counting, and does not influence the normal service of the database.

Drawings

FIG. 1 is a flowchart of a method for counting database data according to a first embodiment of the present invention;

FIG. 2 is a schematic structural diagram of a database data counting apparatus according to a second embodiment of the present invention;

fig. 3 is a schematic structural diagram of a computer device in a third embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

Example one

Fig. 1 is a flowchart of a method for counting database data according to an embodiment of the present invention, where the method is applicable to a case of counting data amount in a database, and the method may be executed by a database data counting apparatus, which may be composed of hardware and/or software and may be generally integrated in a device with a data access function, where the device may be an electronic device such as a server or a server cluster. As shown in fig. 1, the method specifically includes the following steps:

And step 110, generating counting variable quantity data according to the data quantity of the data to be processed.

The data to be processed may include data to be written and data to be deleted. The data amount can be represented by the number of data pieces. The counting variation data carries a setting identification code, and the setting identification code can be a setting prefix. The count variation data may be in the form of: set identification code + change value. The change value is a positive number for data to be written, and a negative number for data to be deleted. For example, the set identification code may be delta _ count, and assuming that the number of pieces of data to be written is 20, the generated count variation data is expressed as: delta _ count 20.

Specifically, the process of generating the count variation data according to the data amount of the data to be processed may be to acquire the number of pieces of data to be processed, determine the number of pieces of data as a variation value of the data, and then add a set identifier to the variation value to generate the count variation data.

And step 120, writing the counting variable quantity data into a database.

Specifically, if the data to be processed is data to be written, the way of writing the data to be processed and the count variation data into the database may be: and calling a batch operation interface, and writing the data to be processed and the counting variable quantity data into a database through the batch operation interface.

Specifically, if the data to be processed is the data to be deleted, the manner of writing the count variation data into the database may be: and calling a batch operation interface, writing the counting variable quantity data into the database through the batch operation interface, and deleting the data to be deleted from the database.

In this embodiment, the batch operation interface supports batch change operations including data writing and deletion, and can ensure that a batch is an atomic operation, that is, a batch of data is either successfully operated or fails to be operated.

And step 130, updating the count value of the database according to the count variation data.

Specifically, the manner of updating the count value of the database according to the count variation data may be: searching counting variable quantity data in a database according to the set identification code; determining a change value of the data according to the searched counting change data; and accumulating the change value and the current count value of the database to obtain an updated count value.

In this embodiment, if the database includes a plurality of count variation data, the variation values of the plurality of count variation data are accumulated with the current count value of the database. For example, assuming that there are three pieces of count variation data in the database, the variation values are 10, -5 and 20, respectively, and the current count value of the database is 1000, the updated count value is 1000+10-5+20 — 1025.

Optionally, after the count value of the database is updated according to the count variation data, the method further includes the following steps: the count variation data is deleted from the database.

In this embodiment, the count variation data involved in the accumulation is deleted from the database.

According to the technical scheme of the embodiment, counting variable quantity data are generated according to the data volume of the data to be processed, then the counting variable quantity data are processed in the database, and finally the counting value of the database is updated according to the counting variable quantity data. The counting method of the database data disclosed by the embodiment of the invention processes the counting variable quantity data together with the database so as to update the counting value of the database according to the counting variable quantity data, can improve the accuracy of data counting, and does not influence the normal service of the database.

Example two

Fig. 2 is a schematic structural diagram of a database data counting apparatus according to an embodiment of the present invention. As shown in fig. 2, the apparatus includes: a count variation data generation module 210, a data writing module 220 and a count value updating module 230.

A count variable data generating module 210, configured to generate count variable data according to a data amount of data to be processed;

A data writing module 220, configured to write the count variation data into a database;

and a count value updating module 230, configured to update the count value of the database according to the count variation data.

Optionally, the count variation data carries a set identification code.

Optionally, the data to be processed includes data to be written and data to be deleted.

Optionally, if the data to be processed is data to be written, the data writing module 220 is further configured to:

and calling a batch operation interface, and writing the data to be written and the counting variable quantity data into the database through the batch operation interface.

Optionally, if the data to be processed is data to be deleted, the data writing module 220 is further configured to:

and calling a batch operation interface, writing the counting variable quantity data into the database through the batch operation interface, and deleting the data to be deleted from the database.

Optionally, the count value updating module 230 is further configured to:

searching counting variable quantity data in a database according to the set identification code;

Optionally, the method further includes: a count variation data deletion module for:

The count variation data is deleted from the database.

The device can execute the methods provided by all the embodiments of the invention, and has corresponding functional modules and beneficial effects for executing the methods. For details not described in detail in this embodiment, reference may be made to the methods provided in all the foregoing embodiments of the present invention.

EXAMPLE III

Fig. 3 is a schematic structural diagram of a computer device according to a third embodiment of the present invention. FIG. 3 illustrates a block diagram of a computer device 312 suitable for use in implementing embodiments of the present invention. The computer device 312 shown in FIG. 3 is only an example and should not bring any limitations to the functionality or scope of use of embodiments of the present invention. Device 312 is a computing device that typically counts functions of database data.

As shown in FIG. 3, computer device 312 is in the form of a general purpose computing device. The components of computer device 312 may include, but are not limited to: one or more processors 316, a storage device 328, and a bus 318 that couples the various system components including the storage device 328 and the processors 316.

Bus 318 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Computer device 312 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 312 and includes both volatile and nonvolatile media, removable and non-removable media.

Storage 328 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 330 and/or cache Memory 332. The computer device 312 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 334 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 3, and commonly referred to as a "hard drive"). Although not shown in FIG. 3, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk-Read Only Memory (CD-ROM), a Digital Video disk (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 318 by one or more data media interfaces. Storage 328 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.

Program 336 having a set (at least one) of program modules 326 may be stored, for example, in storage 328, such program modules 326 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which may comprise an implementation of a network environment, or some combination thereof. Program modules 326 generally carry out the functions and/or methodologies of embodiments of the invention as described herein.

The computer device 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, camera, display 324, etc.), with one or more devices that enable a user to interact with the computer device 312, and/or with any devices (e.g., network card, modem, etc.) that enable the computer device 312 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 322. Also, computer device 312 may communicate with one or more networks (e.g., a Local Area Network (LAN), Wide Area Network (WAN), and/or a public Network, such as the internet) via Network adapter 320. As shown, network adapter 320 communicates with the other modules of computer device 312 via bus 318. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the computer device 312, including but not limited to: microcode, device drivers, Redundant processing units, external disk drive Arrays, disk array (RAID) systems, tape drives, and data backup storage systems, among others.

Processor 316 executes programs stored in storage 328 to perform various applications and data processing, such as implementing the database data counting method provided by the above-described embodiments of the present invention.

Example four

Embodiments of the present invention provide a computer-readable storage medium on which a computer program is stored, where the computer program, when executed by a processing device, implements a counting method for database data as in embodiments of the present invention. The computer readable medium of the present invention described above may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText transfer protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: generating counting variable quantity data according to the data quantity of the data to be processed; writing the counting variation data into a database; and updating the count value of the database according to the count variable quantity data.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for counting database data, comprising:

writing the counting variation data into a database;

2. The method of claim 1, wherein the count change data carries a set identification code.

3. The method of claim 1, wherein the data to be processed comprises data to be written and data to be deleted.

4. The method according to claim 3, wherein if the data to be processed is data to be written, writing the count variation data into a database comprises:

5. The method according to claim 3, wherein if the data to be processed is data to be deleted, writing the count variation data into a database comprises:

6. The method of claim 2, wherein updating the count value of the database according to the count delta data comprises:

7. The method of claim 1, further comprising, after updating the count value of the database according to the count delta data:

And deleting the counting variable quantity data from a database.

8. An apparatus for counting database data, comprising:

the data writing module is used for writing the counting variable quantity data into a database;

9. A computer device, the device comprising: comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method of counting database data according to any of claims 1-7 when executing the program.

10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processing means, carries out a method of counting database data according to any one of claims 1 to 7.