CN115757408A

CN115757408A - Memory database storage method and device of dictionary and electronic equipment

Info

Publication number: CN115757408A
Application number: CN202211452644.5A
Authority: CN
Inventors: 刘松树; 杨伏敏; 赵欣荷; 何星
Original assignee: GUIYANG BUREAU OF PUBLIC SECURITY; Zhoucun Branch Of Zibo Public Security Bureau; Beijing Ruian Technology Co Ltd
Current assignee: GUIYANG BUREAU OF PUBLIC SECURITY; Zhoucun Branch Of Zibo Public Security Bureau; Beijing Ruian Technology Co Ltd
Priority date: 2022-11-21
Filing date: 2022-11-21
Publication date: 2023-03-07

Abstract

The invention provides a memory database storage method and device of a dictionary and electronic equipment, which relate to the technical field of data storage and comprise the following steps: acquiring the character length of each dictionary in the item to be stored, and replacing the character length of each dictionary according to a preset binary system to obtain a replaced dictionary length; converting the length of the replacement dictionary according to a preset coding rule to obtain a code corresponding to each dictionary; and the codes corresponding to each dictionary are stored in the memory database, so that the technical problem that the storage space of the dictionaries is wasted in the memory storage process is solved.

Description

Memory database storage method and device of dictionary and electronic equipment

Technical Field

The present invention relates to the field of data storage technologies, and in particular, to a method and an apparatus for storing a memory database of a dictionary, and an electronic device.

Background

For field storage of multi-valued attributes, a storage mode of separators is generally adopted, for example, "dictionary 1, dictionary 2, dictionary 3" is used for storage, and due to the existence of separators and the problem of the length of the dictionary, the storage mode can cause the waste of partial storage space; especially in some application scenarios sensitive to the occupied size of the memory, the technical problem of how to save the storage space of the dictionary is to be solved urgently.

Disclosure of Invention

The invention aims to provide a memory database storage method and device of a dictionary and electronic equipment, so as to relieve the technical problem that storage space of the dictionary is wasted in a memory storage process.

In a first aspect, an embodiment of the present invention provides a memory database storage method for a dictionary, including:

acquiring the character length of each dictionary in the item to be stored, and replacing the character length of each dictionary according to a preset system to obtain a replaced dictionary length;

converting the length of the replacement dictionary according to a preset coding rule to obtain a code corresponding to each dictionary;

and storing the codes corresponding to each dictionary in an in-memory database.

With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where the method further includes:

converting codes corresponding to the target dictionary according to the preset coding rule and the preset scale, and restoring to obtain the character length of the target dictionary;

and searching the target dictionary based on the character length.

With reference to the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, where the step of obtaining a character length of each dictionary in the item to be stored includes:

in response to the control instruction for each dictionary, an initial range of character lengths for each dictionary in the items to be stored is obtained.

With reference to the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where the step of obtaining a character length of each dictionary in the item to be stored further includes:

and performing self-increment operation on the character length of each dictionary according to the characteristics of a relational database and a preset step length, wherein each dictionary in the items to be stored is stored in the relational database.

With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, where the method further includes:

and if the target dictionary has a multi-value attribute and the length of the corresponding code of the target dictionary does not meet the length of the replacement dictionary, supplementing preset characters at the front end of the code.

With reference to the first aspect, an embodiment of the present invention provides a fifth possible implementation manner of the first aspect, where before the step of storing the code corresponding to each dictionary in an in-memory database, the method further includes:

and encrypting the code corresponding to each dictionary or the code corresponding to the target dictionary.

With reference to the first aspect, an embodiment of the present invention provides a sixth possible implementation manner of the first aspect, where the preset carry includes a 64 carry.

In a second aspect, an embodiment of the present invention further provides a memory database storage device for a dictionary, including:

the replacement module is used for acquiring the character length of each dictionary in the item to be stored and replacing the character length of each dictionary according to a preset system to obtain the length of a replaced dictionary;

the coding module is used for converting the length of the replacement dictionary according to a preset coding rule to obtain a code corresponding to each dictionary;

and the storage module is used for storing the codes corresponding to each dictionary in an in-memory database.

In a third aspect, an embodiment provides an electronic device, including a memory and a processor, where the memory stores a computer program operable on the processor, and the processor implements the steps of the method described in any one of the foregoing embodiments when executing the computer program.

In a fourth aspect, embodiments provide a machine-readable storage medium having stored thereon machine-executable instructions that, when invoked and executed by a processor, cause the processor to carry out the steps of the method of any preceding embodiment.

The embodiment of the invention provides a memory database storage method, a device and electronic equipment of a dictionary, wherein a corresponding target dictionary can be found according to the codes without storing the dictionary in a memory database, on the basis, the character length of the dictionary is subjected to preset system conversion according to the character length of the dictionary to obtain a replacement dictionary length, the replacement dictionary length is converted into the codes again by using preset coding rules, and the codes corresponding to each dictionary are stored in the memory database, so that the memory saving in the dictionary storage process is realized.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and drawings.

In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 is a flowchart of a memory database storage method for a dictionary according to an embodiment of the present invention;

FIG. 2 is a diagram illustrating a dictionary mapping and transformation relationship according to an embodiment of the present invention;

FIG. 3 is a schematic diagram illustrating a memory database storage of an original dictionary according to an embodiment of the present invention;

fig. 4 is a schematic diagram of a transformed dictionary memory database according to an embodiment of the present invention;

fig. 5 is a functional block diagram of a memory database storage device of a dictionary according to an embodiment of the present invention;

fig. 6 is a schematic diagram of a hardware architecture of an electronic device according to an embodiment of the present invention.

Detailed Description

To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The inventor researches and discovers that in order to save memory space, a dictionary replacement method can be adopted to replace a variable-length (non-fixed-length) dictionary value with a fixed-length dictionary value, and a spacer is omitted at the same time, so as to further save storage space, taking dictionary 1, dictionary 2 and dictionary 3 as examples, and storing the values after replacement by using the following table 1.

TABLE 1

After the replacement, "methylethyl-propyl", in this example, (11-3)/11 x 100% =72.72% of the storage space is saved. The number of characters of the variable-length dictionary value is variable and can be determined according to the service scene corresponding to the dictionary. This dictionary may contain certain business meanings, such as time, type, etc.; for example: according to the national dictionary of GB330491, the character length is mostly 2 bits, and is 1 bit according to the preset system compression; the business scenario may be that the employee dictionary may use an identification card as the character length of the dictionary in calculating the percentage of departure by using the employee name and the company scale.

It should be noted that, in the process of storing the dictionary in the memory database (such as a Redis database), due to the limitation of memory space resources, the corresponding character length of the dictionary is stored, and the dictionaries stored in other databases are searched according to the character length, so as to achieve the purpose of memory space; on the basis, the corresponding character length of the dictionary can be replaced so as to further save the storage space.

Therefore, the memory database storage method, the memory database storage device and the electronic equipment for the dictionary provided by the embodiment of the invention can save the memory storage space of the dictionary in the storage process.

In order to facilitate understanding of the embodiment, a detailed description is first given of a memory database storage method of a dictionary disclosed in the embodiment of the present invention, and the method can be applied to a controller, a memory control unit, an intelligent control device, an upper computer, a server, and other control devices.

Fig. 1 is a flowchart of a method for storing a memory database of a dictionary according to an embodiment of the present invention.

Referring to fig. 1, the method includes:

and S102, acquiring the character length of each dictionary in the item to be stored, and replacing the character length of each dictionary according to a preset system to obtain a replaced dictionary length.

The dictionary can be understood as a data set with a certain data volume and fixed data values; in order to save memory, each dictionary in the items (data items) to be stored is stored in a relational database, and only the character length (sequence number) corresponding to the dictionary is stored in the memory database; the character length of each dictionary is limited, and the aim of saving the storage space can be fulfilled by the embodiment of the invention no matter the type and the content of the dictionary.

Here, each data item includes at least one dictionary.

And step S104, converting the length of the replacement dictionary according to a preset coding rule to obtain a code corresponding to each dictionary.

The length of the replacement dictionary is relative to the length of characters of the dictionary, so that memory space is saved to a certain extent, and on the basis, code conversion can be realized through a preset coding rule, so that memory is further saved.

And step S106, storing the codes corresponding to each dictionary in an in-memory database.

In a preferred embodiment of practical application, the corresponding target dictionary can be found according to the codes without storing the dictionary in a memory database, on the basis, the character length of the dictionary is subjected to preset system conversion according to the character length of the dictionary to obtain a replaced dictionary length, the replaced dictionary length is converted into codes again by using a preset coding rule, and the codes corresponding to each dictionary are stored in the memory database, so that memory saving in the dictionary storage process is realized.

In some embodiments, the step of obtaining the character length of each dictionary in the items to be stored in step S102 includes:

step 1.1), responding to the control instruction aiming at each dictionary, and acquiring an initial range of the character length of each dictionary in the items to be stored.

The initial range of the character length of each dictionary is estimated according to the user, and the estimated range can be input.

And/or the presence of a gas in the gas,

and step 1.2), performing self-increment operation on the character length of each dictionary according to the characteristics of the relational database and preset step length.

In most relational databases, the character length can be increased by a step size of a natural number of 1.

On the basis of the foregoing embodiment, as shown in fig. 2, there is a mapping relationship between the number (character length) of the dictionary and the character of the binary conversion, and the preset binary may be converted according to a formula or a table form, respectively; illustratively, the determinable dictionary has a character length of n, with the inequality n ≦ 64 ⁱ The minimum value of the length i of the replacement dictionary is calculated. The determination can also be made as in table 2 below:

TABLE 2

Dictionary number range	Permuting the length of a dictionary
		1～64	1
64～4,032	2
		4,033～258,048	3
…	…
		64 ^i-1 ～64 ⁱ	i

As an alternative embodiment, the preset number may include 2, 8, 16 and 64, preferably 64. Wherein, the character length of 10 system in dictionary is converted into 64 system, and the character table represented by each bit of 64 bits can be represented according to the following table 3 (this table is referred to from RFC 2045):

TABLE 3

Value of	Encoding	Value of	Encoding	Value of	Coding	Value of	Coding
								0	A	17	R	34	i	51	z
1	B	18	S	35	j	52	0
								2	C	19	T	36	k	53	1
3	D	20	U	37	l	54	2
								4	E	21	V	38	m	55	3
5	F	22	W	39	n	56	4
								6	G	23	X	40	o	57	5
7	H	24	Y	41	p	58	6
								8	I	25	Z	42	q	59	7
9	J	26	a	43	r	60	8
								10	K	27	b	44	s	61	9
11	L	28	c	45	t	62	+
								12	M	29	d	46	u	63	/
13	N	30	e	47	v
								14	O	31	f	48	w
15	P	32	g	49	x
								16	Q	33	h	50	y

Wherein, for 64-ary conversion, single-byte characters as shown in table 3 can be presented, and effective dictionary storage can be performed with minimum space.

For example, if the dictionary sequence number (the aforementioned dictionary character length) of the data item a is 13421 and the dictionary length is 4000, the dictionary parameter may determine that the parameter i is 3 according to table 2, and the 64-ary conversion method performed on the sequence number 13421 is as follows:

13421÷64＝209···45

209÷64＝3···17

then, in order from left to right, each digit of the 64-ary number is sequentially determined to be {3,17,45} in decimal notation, and after the three digits are replaced according to table 3, the dictionary is correspondingly encoded as [ DRt ].

In some embodiments, the aforementioned method further comprises:

and 2.1) if the target dictionary has multi-value attributes and the length of the corresponding codes of the target dictionary does not meet the length of the replacement dictionary, supplementing preset characters at the front end of the codes.

If the dictionary has multi-value attribute, the front end of the dictionary which does not satisfy the length is complemented with 0, namely the character A is complemented in the determined code. For example, if the dictionary has a length of 360 characters, the length of the replacement dictionary is 2 according to table 2; for a dictionary with a character length of 1, the front end of B needs to be added with A after the character is converted into a code, and the code is AB. If the dictionary has a single-valued attribute, then 0 does not need to be complemented.

It should be noted that the single-value attribute may be understood as an attribute having a unique answer, such as gender, nationality, etc., and the multi-value attribute may be understood as an attribute having a non-unique answer, such as a star of interest, a site of interest, a route, etc.

In some embodiments, to further ensure the security of the stored data, before step S108, the method further includes:

and 3.1) encrypting the codes corresponding to each dictionary or the codes corresponding to the target dictionary.

All the dictionaries or the corresponding codes of the target dictionary meeting the corresponding service requirements can be encrypted according to the safety requirements.

In some embodiments, the codes stored in the space-saving storage may be restored and searched to the corresponding dictionary, so as to perform the related service application, where the method further includes:

and 4.1) converting the codes corresponding to the target dictionary according to a preset coding rule and a preset binary system, and restoring to obtain the character length of the target dictionary.

On the basis of the foregoing embodiment, the method for converting coded DRt into dictionary sequence numbers comprises:

DRt is converted to three decimal numbers {3,17,45} according to Table 3, and then according to the formula:

seq＝∑n*64 ^i-1

where n is the decimal number of each digit, i is the digit from right to left, and seq is the order number of the dictionary.

On the basis of the embodiment of the present invention, for the multi-valued attribute a, the data items are dictionary 1, dictionary 2 and dictionary 3, the storage manner is shown in fig. 3, and the storage manner after conversion is shown in fig. 4.

And 4.2) searching the target dictionary based on the character length.

Here, the corresponding target dictionary may be found from the relational database according to the character length.

According to the embodiment of the invention, the dictionary stored in the memory, especially multi-value attribute storage, is realized through binary conversion and code replacement, so that the storage space is saved.

As shown in fig. 5, an embodiment of the present invention provides a memory database storage device for a dictionary, including:

the replacement module is used for acquiring the character length of each dictionary in the item to be stored and replacing the character length of each dictionary according to a preset binary system to obtain the length of a replaced dictionary;

In some embodiments, the method further includes converting codes corresponding to the target dictionary according to the preset coding rule and the preset scale, and restoring to obtain the character length of the target dictionary; and searching the target dictionary based on the character length.

In some embodiments, the replacement module is further specifically configured to, in response to the control instruction for each dictionary, obtain an initial range of character lengths for each dictionary in the item to be stored.

In some embodiments, the replacement module is further specifically configured to perform a self-increment operation on the character length of each dictionary according to a preset step size according to a characteristic of a relational database, where each dictionary in the items to be stored is stored in the relational database.

In some embodiments, the replacement module is further specifically configured to, if the target dictionary has a multi-valued attribute and the length of the code corresponding to the target dictionary does not satisfy the length of the replacement dictionary, supplement a preset character at the front end of the code.

In some embodiments, the encoding module is further specifically configured to encrypt the code corresponding to each dictionary or the code corresponding to the target dictionary.

In some embodiments, the preset bin comprises a 64 bin.

In this embodiment, the electronic device may be, but is not limited to, a Computer device with analysis and processing capabilities, such as a Personal Computer (PC), a notebook Computer, a monitoring device, and a server.

As an exemplary embodiment, referring to fig. 6, the electronic device 110 includes a communication interface 111, a processor 112, a memory 113, and a bus 114, wherein the processor 112, the communication interface 111, and the memory 113 are connected by the bus 114; the memory 113 is used for storing computer programs that support the processor 112 to execute the above-mentioned methods, and the processor 112 is configured to execute the programs stored in the memory 113.

A machine-readable storage medium as referred to herein may be any electronic, magnetic, optical, or other physical storage device that can contain or store information such as executable instructions, data, and the like. For example, the machine-readable storage medium may be: a RAM (random Access Memory), a volatile Memory, a non-volatile Memory, a flash Memory, a storage drive (e.g., a hard drive), any type of storage disk (e.g., an optical disk, a dvd, etc.), or similar storage medium, or a combination thereof.

The non-volatile medium may be non-volatile memory, flash memory, a storage drive (e.g., a hard drive), any type of storage disk (e.g., an optical disk, dvd, etc.), or similar non-volatile storage medium, or a combination thereof.

It can be understood that the specific operation method of each functional module in this embodiment may refer to the detailed description of the corresponding step in the foregoing method embodiments, and details are not repeated here.

The computer-readable storage medium provided in the embodiments of the present invention stores a computer program, and when executed, the computer program code may implement the method described in any of the above embodiments, and for specific implementation, reference may be made to the method embodiment, which is not described herein again.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In addition, in the description of the embodiments of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those skilled in the art that the following descriptions are only illustrative and not restrictive, and that the scope of the present invention is not limited to the above embodiments: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein.

Claims

1. A memory database storage method of a dictionary is characterized by comprising the following steps:

acquiring the character length of each dictionary in the item to be stored, and replacing the character length of each dictionary according to a preset binary system to obtain a replaced dictionary length;

2. The method of claim 1, further comprising:

and searching the target dictionary based on the character length.

3. The method of claim 1, wherein the step of obtaining the character length of each dictionary in the item to be stored comprises:

4. The method according to claim 1 or 3, wherein the step of obtaining the character length of each dictionary in the item to be stored further comprises:

5. The method of claim 1, further comprising:

6. The method of claim 1, wherein prior to the step of storing the code corresponding to each dictionary in an in-memory database, the method further comprises:

7. The method of claim 1, wherein the preset bin comprises a 64 bin.

8. An in-memory database storage device for a dictionary, comprising:

9. An electronic device comprising a memory, a processor, and a program stored on the memory and executable on the processor, the processor implementing the method of any one of claims 1 to 7 when executing the program.

10. A computer-readable storage medium, characterized in that a computer program is stored in the readable storage medium, which computer program, when executed, carries out the method of any one of claims 1-7.