CN111309709B - Method and device for establishing and retrieving database - Google Patents

Abstract

The invention provides a database establishing and retrieving method and device, wherein the database establishing method comprises the following steps: establishing a data characteristic table, wherein the data characteristic table comprises a first data information table, the first data information table is used for storing a plurality of different types of data information, and the data information comprises a data storage path; acquiring a storage path of data in an original data file; obtaining the storage position of the data in the data characteristic table according to the storage path of the data; inserting the data into the data feature table according to the storage position; and constructing a data characteristic database according to the data characteristic table after the data is inserted. By implementing the invention, the data file can be directly obtained aiming at a certain specific information to be detected or a specific condition, and the high efficiency and the flexibility of the data file retrieval are improved.

Description

Method and device for establishing and retrieving database

technical field

The invention relates to the technical field of data processing, in particular to a database establishment and retrieval method and device.

Background technique

With the widespread application of smart meters across the country, the data transmission rate and reliability requirements of the electricity consumption information collection system continue to increase. At present, power line carrier and micro-power wireless are the main methods of local communication in the power consumption information collection system. Taking power line carrier communication as an example, due to the diversity of power grid structure and geographical environment, etc., the characteristics of power line channels include noise, impedance and attenuation of power line channels, which affect the efficiency and reliability of user information transmitted by power information collection systems. . In order to judge the reliability of the electricity consumption information transmitted by the electricity consumption information collection system, it is necessary to analyze the characteristics of the local communication channel of the electricity consumption information collection system. The analysis of communication channel characteristics includes many factors, including geographical environment, weather conditions, Power grid structure, etc., so a large amount of data needs to be stored for subsequent call when performing channel characteristic analysis.

The existing channel data calling method is to store channel measurement scenarios, channel measurement types, and channel measurement data in files in advance, and repeatedly search for file names and file paths in the file directory to obtain different channel measurement scenarios, channel measurement types, and channel measurement data. It is impossible to directly obtain data files for certain specific demand conditions, resulting in low search efficiency of data files.

Contents of the invention

Therefore, the technical problem to be solved by the present invention is to overcome the defect of low search efficiency of data files caused by existing data storage methods, thereby providing a database establishment and retrieval method and device.

According to the first aspect, an embodiment of the present invention provides a method for establishing a database, including: establishing a data feature table, the data feature table includes a first data information table, and the first data information table is used to store a plurality of different types of Data information, the data information includes the storage path of the data; the storage path of the data in the original data file is obtained; according to the storage path of the data, the storage location of the data in the data feature table is obtained; according to the storage position, inserting the data into the data feature table; constructing a data feature database according to the data feature table after inserting the data.

With reference to the first aspect, in the first implementation manner of the first aspect, the data characteristic table further includes a second data information table, and the type of data information stored in the second data information table is different from that stored in the first data information table , the second data information table and the first data information table contain the same data file id value, and the data file id value is used to associate data information in different data tables.

With reference to the first aspect, in the second implementation manner of the first aspect, the obtaining the storage location of the data in the data feature table according to the storage path of the data includes: dividing and analyzing the storage of the data path, to obtain the semantic label; according to the semantic label, search the semantic label table, the semantic label table stores the corresponding relationship between the semantic label and the storage location in the data feature table; determine the position of the data in the data feature table storage location.

With reference to the first aspect, in the third implementation manner of the first aspect, the obtaining the storage location of the data in the data feature table according to the storage path of the data includes: dividing and analyzing the storage of the data The path is to obtain semantic tags; classify and match the semantic tags based on natural language processing, and determine the position of the data in the data feature table.

With reference to the second implementation of the first aspect, in the fourth implementation of the first aspect, the searching the semantic tag table according to the semantic tag includes: when the semantic tag is not found in the semantic tag table, then Adding the correspondence between the semantic label and the storage location of the semantic label in the data feature table to the semantic label table.

With reference to the first implementation manner of the first aspect, in a fifth implementation manner of the first aspect, the data characteristic table includes a channel data characteristic table.

With reference to the fifth implementation manner of the first aspect, in the sixth implementation manner of the first aspect, the second data information table includes: a channel type information table, including the device type used in channel data measurement, measurement content type, measurement time/ Any one or several types of frequency domain information; channel scene information table, including any one or several types of measurement time, measurement environment, measurement location, measurement climate, altitude, humidity, and temperature information.

According to the second aspect, an embodiment of the present invention provides a database retrieval method, including: obtaining the information to be retrieved; in the data feature database obtained by the database establishment method described in the first aspect or any implementation manner of the first aspect, according to The information to be retrieved is retrieved to obtain corresponding one or more storage paths; according to the storage paths, a retrieval result is obtained.

According to a third aspect, an embodiment of the present invention provides a database building device, including: a data feature table building module for building a data feature table, the data feature table includes a first data information table, and the first data information table For storing a plurality of different types of data information, the data information includes the storage path of the data; the storage path acquisition module is used to acquire the storage path of the data in the original data file; the storage location acquisition module is used for according to the data storage path The storage path is used to obtain the storage location of the data in the data feature table; the data insertion module is used to insert the data into the data feature table according to the storage location; the database construction module is used to insert the data into the data feature table according to the inserted The data feature table behind the above data is used to construct a data feature database.

According to the fourth aspect, an embodiment of the present invention provides a database retrieval device, including: an information to be retrieved acquisition module, used to obtain the information to be retrieved; a storage path retrieval module, used in the first aspect or any implementation mode of the first aspect In the data feature database obtained by the database establishment method, one or more corresponding storage paths are retrieved according to the information to be retrieved; the retrieval result acquisition module is used to obtain retrieval results according to the storage paths.

According to a fifth aspect, an embodiment of the present invention provides an electronic device, including a memory, a processor, and a computer program stored in the memory and operable on the processor, when the processor executes the program, the first aspect or the second In one aspect, the steps of the database establishment method described in any one of the implementation manners or the database retrieval method described in the second aspect.

According to the sixth aspect, an embodiment of the present invention provides a storage medium on which computer instructions are stored, and when the instructions are executed by a processor, the database establishment method or the second aspect described in the first aspect or any implementation manner of the first aspect is implemented. The steps of the database retrieval method described in the aspect.

The technical solution of the present invention has the following advantages:

1. The database establishment method/device provided by this embodiment divides the data storage paths in the original data file according to different data types and names by constructing a data feature table, stores them in the data feature table, and establishes a database. In the database, the data storage paths are stored according to different data types, and the stored data are efficiently classified. When searching in the database in this embodiment, the representative data types and names stored in the data feature table Key words can be searched, and all data files that meet specific conditions can be retrieved, realizing efficient and flexible retrieval.

2. In the database establishment method/device provided by the present embodiment, the data feature table includes a first data information table and a second data information table, and the data files with the same data storage path are associated through the same data file id, and the multi-category The data is stored in different data information tables, which is convenient for data expansion and data retrieval. When creating a new data feature table, it is only necessary to keep the data file id consistent, which further improves the scalability of stored data.

3. The method/device for establishing a database provided in this embodiment obtains the semantic tags by segmenting and resolving the storage path, and searches in the pre-stored semantic tag table to determine the specific position of the data in the data feature table, which improves the determination Accuracy of data storage location and efficiency of determining data storage location.

4. In the database establishment method/device provided by this embodiment, when the above-mentioned storage location of the data is determined by the semantic label table, when the semantic label is not found in the semantic label table, other methods are used to determine the storage location of the data, and The obtained correspondence between the semantic label and the storage location of the semantic label in the data feature table is added to the semantic label table to improve the content of the semantic label in the semantic label table, which is beneficial to the subsequent use of the semantic label table to determine the effective storage location of the data. sex.

5. The database retrieval method/device provided by this embodiment retrieves the database in the above-mentioned embodiment through the acquired information to be retrieved, and realizes directly obtaining data files directly for a certain specific information to be detected or a specific condition, improving It improves the efficiency and flexibility of data file retrieval.

Description of drawings

In order to more clearly illustrate the specific implementation of the present invention or the technical solutions in the prior art, the following will briefly introduce the accompanying drawings that need to be used in the specific implementation or description of the prior art. Obviously, the accompanying drawings in the following description The drawings show some implementations of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative effort.

Fig. 1 is the flow chart of a specific example of the database establishment method in the embodiment of the present invention;

Fig. 2 is the flow chart of a specific example of database retrieval method in the embodiment of the present invention;

Fig. 3 is a functional block diagram of a specific example of the database establishment device in the embodiment of the present invention;

Fig. 4 is the functional block diagram of a specific example of the database retrieval device in the embodiment of the present invention;

Fig. 5 is a functional block diagram of a specific example of an electronic device in an embodiment of the present invention.

Detailed ways

The technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer" etc. The indicated orientation or positional relationship is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the referred device or element must have a specific orientation, or in a specific orientation. construction and operation, therefore, should not be construed as limiting the invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and should not be construed as indicating or implying relative importance.

In the description of the present invention, it should be noted that unless otherwise specified and limited, the terms "installation", "connection" and "connection" should be understood in a broad sense, for example, it can be a fixed connection or a detachable connection. Connected, or integrally connected; it can be mechanically or electrically connected; it can be directly connected, or indirectly connected through an intermediary, or it can be the internal communication of two components, which can be wireless or wired connect. Those of ordinary skill in the art can understand the specific meanings of the above terms in the present invention in specific situations.

In addition, the technical features involved in the different embodiments of the present invention described below may be combined with each other as long as there is no conflict with each other.

The present embodiment provides a method for establishing a database, as shown in Figure 1, comprising the following steps:

S110: Establish a data characteristic table, the data characteristic table includes a first data information table, the first data information table is used to store a plurality of different types of data information, and the data information includes a data storage path.

Exemplarily, this embodiment takes the establishment of a database for power line channel characteristic data as an example. Different types of data information may be channel measurement city, channel measurement location, channel measurement phase line type, channel measurement time, channel measurement scene, channel Measured temperature, humidity and other information, channel measurement equipment type, channel measurement bandwidth type, channel measurement content type, channel measurement domain type and other information data. Among them, the type of measurement equipment includes FSH4 handheld spectrum analyzer and PicoScope high-speed data acquisition card in this embodiment; the type of measurement frequency band includes broadband power line carrier and narrowband power line carrier; the type of measurement content includes noise, attenuation and impedance; the type of channel measurement domain includes time domain and frequency domain.

The storage path of the data is represented in the established data feature table for different types of data, correspondingly including the storage path of the data stored in the corresponding folder. When the data is stored in the form of a two-dimensional plane, the two-dimensional plane consists of axis X and vertical axis Y, then the storage path of the data may include the path of the folder to which the data belongs and the names and units of the X-axis and Y-axis of the data in the data file. The specific form of the data feature table can be shown in Table 1. In this embodiment, the types of the multiple data information stored in the first data information table are not limited, and those skilled in the art can determine as required.

Table 1

S120: Obtain a storage path of data in the original data file.

Exemplarily, in this embodiment, the original data file is used as a data file for channel characteristic measurement of a certain cell for illustration. The storage structure of the data file is stored in the form of a multi-level file directory, wherein the first-level directory stores the measurement year/month Information and measurement city information, the second-level directory stores measurement content information, the third-level directory stores measurement frequency band information, the fourth-level directory stores measurement specific time information, and the fifth-level directory stores data files. According to different measurement information, corresponding to different file names.

The storage path of the data in the original data file can be obtained by using the os module of the Python language to obtain the storage path information of all data files under the root directory of the original data file. Wherein, the storage path of each data file is a string, and all data file storage paths form a string list, which is stored in the data file path list variable in the algorithm program for subsequent use. This embodiment does not limit the method for obtaining the storage path of the data in the original data file, which can be determined by those skilled in the art as needed.

S130: Obtain the storage location of the data in the data feature table according to the storage path of the data.

Exemplarily, according to the storage path of the data, the way to obtain the storage location of the data in the data feature table may be to first divide the storage path of the data, and manually define semantic labels for the divided storage paths, for example, the divided If the storage path contains "Handan", manually define "Handan" as Handan, and manually determine the storage location of the data in the data feature table, and the storage location includes the column name to which the data belongs in the data feature table. Specifically, this embodiment does not limit the manner of obtaining the storage location of the data in the data feature table according to the storage path of the data, and those skilled in the art can determine it as needed.

S140: Insert data into the data feature table according to the storage location.

Exemplarily, according to the storage location, the way of inserting data into the data feature table may be to predefine a dictionary, which stores the names of the columns in the data feature table, and the column names obtained in the above step S130 are traversed through the Dictionary to insert data into the data feature table.

S150: Construct a data feature database according to the data feature table after the data is inserted.

Exemplarily, according to the data feature table after the data is inserted, the background application program and the foreground application program of the database retrieval and classification query platform are written. In this embodiment, the Flask framework of Python is used to build the background program, and the web front-end technology is used to build the front-end program. The background program is built through the Flask framework design for the data query interface and data file acquisition interface requested by the front end. The data query interface provides the query entry, and the data file acquisition interface provides the acquisition function of the data file, which is connected with the original data file. The front-end program is realized by static web page files and JavaScript programs.

Write the request function corresponding to the interface based on the http protocol. This function can be a data query request based on javaScript or a data query request based on other languages. The data query request based on javaScript is used to access and manage the database in the browser, and it is based on other languages. The data query request can be combined with UI programming to display the data to the user through the software interface. Write a background server based on the Flask microservice framework. The program preprocesses the data query request by processing the data query request from the front end, converts the request into a database query language, and obtains the returned data from the database by calling the database driver interface. returned to the client for use. The program can read the csv file in the file library according to the data resource requested by the user, and return the read csv file to the client after preprocessing. Write a javaScript-based interface function, send a request to the background server through a data query request, and display the requested data in the browser web page for users to browse and view. This embodiment does not limit the construction method of the data feature database, which can be determined by those skilled in the art as needed.

The database establishment method provided in this embodiment divides the data storage paths in the original data file according to different data types and names by constructing a data characteristic table, stores them in the data characteristic table, and establishes a database. In the database, the data storage paths are stored according to different data types, and the stored data are efficiently classified. When searching in the database in this embodiment, the representative data types and names stored in the data feature table By searching with keywords, all the data files meeting specific conditions can be retrieved, realizing flexible and efficient retrieval.

As an optional implementation of this embodiment, the data feature table further includes a second data information table, the type of data information stored in the second data information table is different from that of the first data information table, and the second data information table is the same as the first data information table. The data information table contains the same data file id value, and the data file id value is used to associate data information in different data tables.

Exemplarily, the second data information table may be one or more tables formed by dividing the data information in the first data information table according to different attributes or characteristics, for example, the channel measurement city in the above step S110 , channel measurement location, channel measurement phase line type, channel measurement time, channel measurement scene, channel measurement temperature, humidity and other information are divided into channel scene information; channel measurement equipment type, channel measurement bandwidth type, channel measurement content type 1. The channel measurement is divided into channel type information in the time domain or frequency domain; then each data information classified as channel scene information can be composed into a channel scene information table and each data information classified as channel type information channel type information table , the channel scene information table and the channel type information table together form the second data information table.

When the second data information table includes the above-mentioned channel scene information table and channel type information table, the content stored in the first data information table is the storage path of the data. When the data is stored in the form of a two-dimensional plan, the two-dimensional When the plane has a horizontal axis X and a vertical axis Y, the data storage path includes the names of the X and Y axes, and the units of the X and Y axes.

In order to associate one or more second data information tables with the first data information table, the same data file id value is established for data information in the same data file. For the column names and data types of the first data information table and the second data information table, see Table 2, 3, and 4 for details, wherein Table 2 represents the column names and data types of the first data information table, and Table 3 represents the first data information table. The column names and data types of the channel type information table in the second data information table, Table 4 shows the column names and data types of the channel scene information table in the second data information table.

Table 2

table 3

column number column name type of data explain 1 id INT Data file id value 2 device SET Channel Measurement Equipment Type 3 band SET Channel measurement bandwidth type 4 content SET Channel Measurement Content Type 5 domain SET Channel Measurement Field Type

Table 4

column number column name type of data explain 1 id INT Data file id value 2 city VARchar channel measurement city 3 position VARchar channel measurement location 4 powerline SET Channel measurement phase wire type 5 time TIMESTAMP channel measurement time 6 sence SET Channel Measurement Scenario 7 temperature FLOAT Channel measurement temperature 8 humidity FLOAT channel measuring humidity

It should be noted that when the data feature table includes the first data information table and the second data information table, and the second data information table includes the channel scene information table and the channel type information table, when inserting data into the data feature later, first insert The first data information table is inserted into the above-mentioned channel type data table and channel scene data table.

When inserting data into the first data information table, before inserting, first obtain the X and Y axis names and unit information of the data in the data file by reading the content information of the data file. At this time, the data storage path, data X-axis name, data X-axis unit, data Y-axis name, and data Y-axis unit in the data table 2 have been determined, only the data file id is unknown, and the data file id column is automatically determined by the database through the id. Additional settings are automatically generated to ensure the uniqueness of id data. After the insertion is completed, the id value of the data file generated by the database is obtained through SQL query for insertion into other tables.

When inserting data in the channel type information table, before inserting, check the completeness of the column name in the dictionary of above-mentioned step S140, when lacking the column name in the channel type information table in this dictionary, add the missing column name in the dictionary, And query whether the column has a default value, if there is a default value, specify the value as the default value, if not, prompt the user to enter the value of the column. After the column information is obtained, insert the data file id value and data corresponding to the first data table into the channel type information table.

When inserting data in the channel scene information table, before inserting, check the completeness of the channel scene column in the dictionary of above-mentioned step S140, if lack the column in the channel scene information table in this dictionary, add lacking column column name in this dictionary , and query whether the column has a default value, if there is a default value, specify the value as the default value, if not, prompt the user to enter the value of the column. After the column information is obtained, insert the data file id value and data corresponding to the first data table into the channel type information table.

In the database establishment method provided by this embodiment, the data feature table includes a first data information table and a second data information table, and the data files with the same data storage path are associated through the same data file id, and the multi-category data are respectively stored in In different data information tables, it is convenient for data expansion and data retrieval, and when creating a new data feature table, it is only necessary to keep the data file id consistent, which further improves the scalability of stored data.

As an optional implementation manner of this embodiment, the above step S130 includes:

First, segment and parse the storage path of the data to obtain semantic tags.

Exemplarily, each item in the string list in the above step S120 is divided into storage paths according to the path separator '\', the underscore separator '_', the blank separator and bracket symbols. Specifically, the Python string processing function split is used. After the function is executed, a string list is returned as a semantic label. The semantic label can be stored in the semantic label list variable in the algorithm program for subsequent use. This embodiment does not limit the storage path division and analysis method of data and the method of obtaining semantic tags, which can be determined by those skilled in the art as needed.

Secondly, according to the semantic label, look up the semantic label table, and the semantic label table stores the corresponding relationship between the semantic label and the storage location in the data feature table.

Exemplarily, the semantic tag table is a pre-stored list representing the correspondence between the semantic tags and the storage locations in the data feature table. The semantic label table may include semantic label values, data information table names, data information table column names, and data information values. The data information value indicates the specific value filled in the data information table, and the value can be text, numbers, etc. In this embodiment, the column names and data types of the semantic tag table are shown in Table 5.

table 5

Regarding Table 5, this embodiment gives a practical example to illustrate Table 5. When the second data information table includes a channel type information table and a channel scene information table, see Table 6 for the practical application of the semantic label table.

Table 6

label table_name column_name column_value Handan Channel Scene Information Table city Handan Yiwu Channel Scene Information Table city Yiwu attenuation Channel Type Information Table content attenuation

According to the semantic label, the way to search the semantic label table may be to query "Handan" in the "label" column in the above table 6 when the obtained semantic label is "Handan".

Then, determine the storage location of the data in the data feature table.

Exemplarily, still taking the actual example in the above table 6 as an example, when Handan is queried, check the information corresponding to "Handan". It can be seen from Table 6 that "Handan" should be inserted into the channel measurement city in the channel scene information table column, and the value of the data information to be stored in this column is "Handan".

The method for establishing a database provided by this embodiment obtains semantic tags by segmenting and analyzing storage paths, and searches in a pre-stored semantic tag table to determine the specific location of data in the data feature table, which improves the efficiency of determining the data storage location. Accuracy and speed of determining where data is stored.

As an optional implementation manner in this embodiment, the above step S130 includes:

First, segment and parse the storage path of the data to obtain semantic tags. For specific manners, refer to corresponding parts in the foregoing embodiments, and details are not repeated here.

Secondly, classify and match the semantic tags based on natural language processing, and determine the position of the data in the data feature table.

Exemplarily, the classification and matching based on natural language processing specifically refers to performing a classification algorithm and a character string matching algorithm on semantic tags. The string matching value adopts the regular expression matching method to judge whether the string satisfies a certain pattern, for example, when the date tag '2012-09-05' satisfies the date regular expression "^[0-9]{2,4}- [0-9]{1,2}-[0-9]{1,2}$", determine the position of the data in the data feature table as the measurement time information column in the channel scene table, and store the data information value as Timestamp format. For another example, when the city label 'Handan' appears, the algorithm will judge whether the label belongs to the city database. The city database is a string dictionary in the algorithm program. The key stored in the dictionary is the Chinese name and pinyin name of all cities in China. The dictionary's The value is the Chinese name of the city. When the label matches the key of the city database, the position of the data in the data feature table is determined as the measured city column in the scene table of the channel database. The data information value is the value of the matching key in the dictionary, that is, the city Chinese name.

The method for establishing a database provided by this embodiment obtains semantic tags by segmenting and analyzing storage paths, and determines the specific location of data in the data feature table through classification and matching based on natural language processing, thereby improving the accuracy of determining the location of data storage and The speed at which data storage locations are determined.

As an optional implementation of this embodiment, searching the semantic label table according to the semantic label includes: when the semantic label is not found in the semantic label table, the correspondence between the semantic label and the storage location of the semantic label in the data feature table Relationships are added to the semantic label table.

For example, when the semantic label is "Handan", but "Handan" is not found in the semantic label table, the position corresponding to "Handan" in the data feature table is obtained through the above-mentioned manual input or based on natural language processing is the channel measurement city column in the channel scene information table, and the data information value is Handan. Add the information obtained above {"Handan", channel scene information table, channel measurement city column, Handan} to the semantic label table.

In the database establishment method provided by this embodiment, when the storage location of the data is determined through the semantic label table, and the semantic label is not found in the semantic label table, other methods are used to determine the storage location of the data, and the obtained semantic The corresponding relationship between the label and the storage location of the semantic label in the data signature is added to the semantic label table to improve the content of the semantic label in the semantic label table, which is conducive to the subsequent use of the semantic label table to determine the validity of the storage location of the data.

This embodiment provides a database retrieval method, as shown in Figure 2, including:

S210. Obtain information to be retrieved.

Exemplarily, the information to be retrieved is input by the user, and there is a data query interface for front-end requests in the database, and the information to be retrieved can be obtained from the data query interface.

S220, in the data feature database obtained by the method for establishing the database in the above embodiment, retrieve one or more corresponding storage paths according to the information to be retrieved.

Exemplarily, the way of obtaining one or more corresponding storage paths according to the information to be retrieved may be to analyze the information to be retrieved after obtaining the information to be retrieved from the data query interface, and obtain the channel type and city to which the information to be retrieved belongs , and generate a sql query statement based on the information to be retrieved, query the sql database for a list of data that meets the conditions through the sql query statement, and encapsulate the query list through the back-end program, and then respond to the front-end for analysis, so as to obtain one or Multiple storage paths.

The specific implementation process is as follows: the data query interface receives the information to be retrieved, the data file acquisition interface obtains the request information received by the data query interface, parses the data file id value corresponding to the request information, and the background system sends the data file id value to the first The data information table extracts query requests to obtain one or more storage paths of data files.

S230. Obtain a retrieval result according to the storage path.

Exemplarily, a read request is initiated to the data file according to one or more storage paths, the data file is read and the file offset information of the data stored in the file is obtained, and the data storage information is fed back to the front-end interface to obtain the retrieval result.

The database retrieval method provided in this embodiment retrieves the database in the above embodiment through the acquired information to be retrieved, and realizes directly obtaining data files for a certain specific information to be detected or specific conditions, which improves the retrieval of data files. efficiency and flexibility.

This embodiment provides a database establishment device, as shown in Figure 3, comprising:

The data feature table building module 310 is used to set up a data feature table, the data feature table includes a first data information table, the first data information table is used to store a plurality of different types of data information, and the data information includes a data storage path; specific implementation For the method, refer to the relevant description of step S110 in the method of the above-mentioned embodiment, and details are not repeated here.

The storage path obtaining module 320 is configured to obtain the storage path of the data in the original data file; for the specific implementation, please refer to the relevant description of step S120 in the method of the above embodiment, and details will not be repeated here.

The storage location obtaining module 330 is used to obtain the storage location of the data in the data feature table according to the storage path of the data; for the specific implementation, please refer to the relevant description of step S130 in the method of the above-mentioned embodiment, which will not be repeated here.

The data insertion module 340 is configured to insert data into the data feature table according to the storage location; for the specific implementation, please refer to the relevant description of step S140 in the method of the above embodiment, which will not be repeated here.

The database construction module 350 is configured to construct a data feature database according to the data feature table after the data is inserted. For a specific implementation manner, refer to the relevant description of step S150 in the method of the above embodiment, and details are not repeated here.

As an optional implementation of this embodiment, the data characteristic table establishment module 310 also includes a second data information table establishment module, which is used to establish a second data information table, and the second data information table is stored with the first data information table The types of data information are different, the second data information table and the first data information table contain the same data file id value, and the data file id value is used to associate data information in different data tables. For the specific implementation manner, refer to the relevant description of the corresponding part in the methods of the above embodiments, which will not be repeated here.

As an optional implementation manner of this embodiment, the storage location acquisition module 330 includes:

The first semantic label acquisition module is used to divide and analyze the storage path of the data to obtain the semantic label; for the specific implementation, please refer to the relevant description of the corresponding part in the method of the above embodiment, which will not be repeated here.

The first semantic label search module is configured to search a semantic label table according to the semantic label, and the semantic label table stores the corresponding relationship between the semantic label and the storage location in the data feature table. For the specific implementation manner, refer to the relevant description of the corresponding part in the methods of the above embodiments, which will not be repeated here.

The first storage location determination module is used to determine the storage location of the data in the data feature table. For the specific implementation manner, refer to the relevant description of the corresponding part in the methods of the above embodiments, which will not be repeated here.

As an optional implementation manner of this embodiment, the storage location acquisition module 330 includes:

The second semantic label acquisition module is used to divide and analyze the storage path of the data to obtain the semantic label; for the specific implementation, please refer to the relevant description of the corresponding part in the method of the above-mentioned embodiment, which will not be repeated here.

The second storage location determining module is used to classify and match the semantic tags based on natural language processing, and determine the location of the data in the data feature table. For the specific implementation manner, refer to the relevant description of the corresponding part in the methods of the above embodiments, which will not be repeated here.

As an optional implementation of this embodiment, the above-mentioned first semantic tag search module includes:

The semantic label adding module is used for adding the corresponding relationship between the semantic label and the storage position of the semantic label in the data feature table to the semantic label table when no semantic label is found in the semantic label table. For the specific implementation manner, refer to the relevant description of the corresponding part in the methods of the above embodiments, which will not be repeated here.

As an optional implementation manner in this embodiment, the data feature table in the data feature table establishing module 310 includes a channel data feature table. For the specific implementation manner, refer to the relevant description of the corresponding part in the methods of the above embodiments, which will not be repeated here.

As an optional implementation manner of this embodiment, the second data information table in the second data information table establishment module includes:

Channel type information table, including any one or several of the equipment type used in channel data measurement, measurement content type, and measurement time/frequency domain information;

Channel scene information table, including any one or more of measurement time, measurement environment, measurement location, measurement climate, altitude, humidity, and temperature information. For the specific implementation manner, refer to the relevant description of the corresponding part in the methods of the above embodiments, which will not be repeated here.

This embodiment provides a database retrieval device, as shown in Figure 4, comprising:

The information to be retrieved acquiring module 410 is configured to acquire the information to be retrieved; for the specific implementation, please refer to the relevant description of step S210 in the method of the above embodiment, which will not be repeated here.

The storage path retrieval module 420 is used to retrieve one or more corresponding storage paths according to the information to be retrieved in the data feature database obtained by the database establishment method in the above embodiment; see step S220 in the method of the above embodiment for specific implementation Some related descriptions will not be repeated here.

The retrieval result obtaining module 430 is configured to obtain the retrieval result according to the storage path. For a specific implementation manner, refer to the relevant description of step S230 in the method of the above embodiment, and details are not repeated here.

An embodiment of the present application also provides an electronic device, as shown in FIG. 5 , a processor 510 and a memory 520, where the processor 510 and the memory 520 may be connected through a bus or in other ways.

The processor 510 may be a central processing unit (Central Processing Unit, CPU). The processor 510 may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application-specific integrated circuits (Application Specific Integrated Circuit, ASIC), field-programmable gate array (Field-Programmable Gate Array, FPGA) or Other chips such as programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or combinations of the above-mentioned types of chips.

The memory 520, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer-executable programs and modules, such as program instructions/ module. The processor executes various functional applications and data processing of the processor by running non-transitory software programs, instructions and modules stored in the memory.

The memory 520 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created by the processor, and the like. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage devices. In some embodiments, memory 520 may optionally include memory located remotely from the processor, and these remote memories may be connected to the processor through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The one or more modules are stored in the memory 520 , and when executed by the processor 510 , execute the database establishment or retrieval method in the embodiment shown in FIG. 1 or FIG. 2 .

Specific details of the foregoing electronic device may be understood by referring to corresponding descriptions and effects in the embodiment shown in FIG. 1 or FIG. 2 , and will not be repeated here.

This embodiment also provides a computer storage medium, the computer storage medium stores computer-executable instructions, and the computer-executable instructions can execute the database establishment or retrieval method in any of the above method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a flash memory (Flash Memory), a hard disk (Hard Disk) Disk Drive, abbreviation: HDD) or solid-state drive (Solid-State Drive, SSD), etc.; the storage medium may also include a combination of the above-mentioned types of memory.

Apparently, the above-mentioned embodiments are only examples for clear description, rather than limiting the implementation. For those of ordinary skill in the art, other changes or changes in different forms can be made on the basis of the above description. It is not necessary and impossible to exhaustively list all the implementation manners here. And the obvious changes or changes derived therefrom are still within the scope of protection of the present invention.

Claims (11)

1. A database creation method, comprising:

establishing a data characteristic table, wherein the data characteristic table comprises a first data information table, the first data information table is used for storing a plurality of different types of data information, and the data information comprises a data storage path;

acquiring a storage path of data in an original data file;

dividing and analyzing the storage path of the data to obtain a semantic tag;

searching a semantic tag table according to the semantic tag, wherein the semantic tag table stores the corresponding relation between the semantic tag and a storage position in a data feature table;

determining a storage position of the data in the data characteristic table;

inserting the data into the data feature table according to the storage position;

and constructing a data characteristic database according to the data characteristic table after the data is inserted.

2. The method of claim 1, wherein the data characterization table further comprises a second data information table, the second data information table being of a different type than the data information stored by the first data information table, the second data information table and the first data information table containing the same data file id value used to correlate data information in different data tables.

3. The method according to claim 1, wherein the obtaining, according to the storage path of the data, the storage location of the data in the data feature table includes:

dividing and analyzing the storage path of the data to obtain a semantic tag;

and classifying and matching the semantic tags based on natural language processing, and determining the position of the data in the data characteristic table.

4. The method of claim 1, wherein said looking up a semantic tag table based on said semantic tags comprises:

and when the semantic tag is not found in the semantic tag table, adding the corresponding relation between the semantic tag and the storage position of the semantic tag in the data feature table to the semantic tag table.

5. The method of claim 2, wherein the data characteristics table comprises a channel data characteristics table.

6. The method of claim 5, wherein the second data information table comprises:

a channel type information table including any one or more of a device type, a measurement content type, and measurement time/frequency domain information used in channel data measurement;

The channel scene information table comprises any one or more of measurement time, measurement environment, measurement place, measurement climate, altitude, humidity and temperature information.

7. A database retrieval method, comprising:

acquiring information to be retrieved;

in the data feature database obtained by the database creation method of any one of claims 1 to 6, retrieving a corresponding one or more storage paths according to the information to be retrieved;

and obtaining a retrieval result according to the storage path.

8. A database creation apparatus, comprising:

the system comprises a data feature table establishing module, a data feature table generating module and a data processing module, wherein the data feature table establishing module is used for establishing a data feature table, the data feature table comprises a first data information table, the first data information table is used for storing a plurality of different types of data information, and the data information comprises a data storage path;

the storage path acquisition module is used for acquiring the storage path of the data in the original data file;

the storage position acquisition module is used for dividing and analyzing the storage path of the data to obtain a semantic tag;

searching a semantic tag table according to the semantic tag, wherein the semantic tag table stores the corresponding relation between the semantic tag and a storage position in a data feature table;

Determining a storage position of the data in the data characteristic table;

the data insertion module is used for inserting the data into the data characteristic table according to the storage position;

and the database construction module is used for constructing a data characteristic database according to the data characteristic table after the data is inserted.

9. A database retrieval apparatus, comprising:

the information to be searched acquisition module is used for acquiring information to be searched;

a storage path retrieval module, configured to retrieve, in a data feature database obtained by the database creation method of any one of claims 1 to 6, one or more storage paths according to the information to be retrieved;

and the retrieval result acquisition module is used for acquiring a retrieval result according to the storage path.

10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the database creation method of any of claims 1-6 or the database retrieval method of claim 7 when the program is executed by the processor.

11. A storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the database creation method of any of claims 1-6 or the database retrieval method of claim 7.

Images