CN117726170A - Data storage method and device - Google Patents
Data storage method and device Download PDFInfo
- Publication number
- CN117726170A CN117726170A CN202311746298.6A CN202311746298A CN117726170A CN 117726170 A CN117726170 A CN 117726170A CN 202311746298 A CN202311746298 A CN 202311746298A CN 117726170 A CN117726170 A CN 117726170A
- Authority
- CN
- China
- Prior art keywords
- data
- target company
- target
- early warning
- unstructured
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 238000013500 data storage Methods 0.000 title claims abstract description 32
- 238000013075 data extraction Methods 0.000 claims abstract description 82
- 230000004048 modification Effects 0.000 claims description 29
- 238000012986 modification Methods 0.000 claims description 29
- 238000000605 extraction Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 239000000284 extract Substances 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012954 risk control Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application discloses a data storage method and device, and relates to the technical field of wind control early warning. The method comprises the following steps: receiving a plurality of to-be-wind control early warning data sent by each target company, wherein the to-be-wind control early warning data are structured data; the method comprises the steps of obtaining unstructured data templates and data extraction rules corresponding to each target company, and extracting a plurality of effective data contents corresponding to each wind control early warning data to be controlled in each wind control early warning data to be controlled corresponding to each target company according to the data extraction rules corresponding to each target company; filling a plurality of effective data contents corresponding to each piece of wind control early warning data to be controlled into a corresponding unstructured data template so as to obtain a plurality of unstructured data corresponding to each target company; and storing a plurality of unstructured data corresponding to each target company into a target unstructured database.
Description
Technical Field
The application relates to the technical field of wind control early warning, in particular to a data storage method and device.
Background
Risk control refers to taking various measures and methods to eliminate or reduce various possibilities of occurrence of a risk event or to reduce losses caused by occurrence of a risk event. The wind control early warning system carries out wind control early warning processing on wind control early warning data to be wind controlled of a target company to obtain wind control early warning results, potential risks can be found in advance according to the wind control early warning results, timely early warning is carried out on the potential risks, and workers are informed of taking corresponding measures, so that risk occurrence is effectively avoided.
After the wind control early warning system receives wind control early warning data to be controlled by the target company, the wind control early warning data to be controlled by the target company is required to be stored in a structured database, and when wind control early warning processing is required to be carried out on the wind control early warning data to be controlled by the target company, the wind control early warning data to be controlled by the target company is acquired in the structured database. Because the wind control early warning data to be wind control of different companies are structured data with different data structure types, when the wind control early warning system needs to provide wind control early warning service for a plurality of target companies, the wind control early warning system needs to build a dedicated structured database for each target company in advance, and when the wind control early warning data to be wind control sent by each target company is received, the wind control early warning data to be wind control corresponding to each target company is stored in the dedicated structured database corresponding to each target company respectively, so that the whole data storage process is complicated and complicated.
Disclosure of Invention
The embodiment of the application provides a data storage method and device, which mainly aim to quickly and conveniently store to-be-winded early warning data which are sent by different target companies and have different data structure types into a database.
In order to solve the technical problems, the embodiment of the application provides the following technical scheme:
in a first aspect, the present application provides a data storage method, where the method is applied to a wind control early warning system, the method includes:
receiving a plurality of to-be-wind control early warning data sent by each target company, wherein the to-be-wind control early warning data are structured data;
the method comprises the steps of obtaining unstructured data templates and data extraction rules corresponding to target companies, and extracting a plurality of effective data contents corresponding to wind control early warning data in the wind control early warning data corresponding to the target companies according to the data extraction rules corresponding to the target companies;
filling a plurality of effective data contents corresponding to each piece of wind control early warning data to be subjected to wind control into a corresponding unstructured data template so as to obtain a plurality of unstructured data corresponding to each target company;
and storing a plurality of unstructured data corresponding to each target company into a target unstructured database.
In a second aspect, the present application further provides a data storage device, the device being applied to a wind-controlled early warning system, the device comprising:
The system comprises a first receiving unit, a second receiving unit and a first control unit, wherein the first receiving unit is used for receiving a plurality of to-be-winded control early warning data sent by each target company, and the to-be-winded control early warning data are structured data;
the extraction unit is used for acquiring unstructured data templates and data extraction rules corresponding to each target company and extracting a plurality of effective data contents corresponding to each to-be-winded early warning data in each to-be-winded early warning data corresponding to each target company according to the data extraction rules corresponding to each target company;
the filling unit is used for filling a plurality of effective data contents corresponding to each piece of to-be-winded early warning data into a corresponding unstructured data template so as to obtain a plurality of unstructured data corresponding to each target company;
and the first storage unit is used for storing a plurality of unstructured data corresponding to each target company into a target unstructured database.
In a third aspect, an embodiment of the present application provides a storage medium, where the storage medium includes a stored program, where the program, when executed, controls a device where the storage medium is located to execute the data storage method described in the first aspect.
In a fourth aspect, embodiments of the present application provide a data storage device comprising a storage medium; and one or more processors coupled to the storage medium, the processors configured to execute the program instructions stored in the storage medium; the program instructions, when executed, perform the data storage method of the first aspect.
By means of the technical scheme, the technical scheme provided by the application has the following advantages:
after the wind control early warning system receives and obtains a plurality of to-be-wind control early warning data sent by each target company, the wind control early warning system firstly obtains unstructured data templates and data extraction rules corresponding to each target company in a local storage space, and extracts a plurality of effective data contents corresponding to each to-be-wind control early warning data in each to-be-wind control early warning data corresponding to each target company according to the data extraction rules corresponding to each target company; filling a plurality of effective data contents corresponding to each piece of wind control early warning data to the corresponding unstructured data templates, so as to obtain a plurality of unstructured data corresponding to each target company; and finally, storing a plurality of unstructured data corresponding to each target company into a target unstructured database, thereby realizing that a plurality of to-be-wind control early warning data which are transmitted by different target companies and have different data structure types are stored into the same unstructured database. Because in the application, a dedicated structured database is not required to be built for each target company in advance, and structured data with different data structure types sent by different target companies are not required to be stored in the dedicated structured database corresponding to each target company, but the structured data with different data structure types sent by different target companies are stored in the same unstructured database, so that the whole data storage process is rapid and convenient.
The foregoing description is only an overview of the technical solutions of the present application, and may be implemented according to the content of the specification in order to make the technical means of the present application more clearly understood, and in order to make the above-mentioned and other objects, features and advantages of the present application more clearly understood, the following detailed description of the present application will be given.
Drawings
The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present application will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present application are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings, in which like reference numerals refer to similar or corresponding parts and in which:
FIG. 1 shows a flow chart of a data storage method provided by an embodiment of the present application;
FIG. 2 illustrates a flowchart of another data storage method provided by an embodiment of the present application;
FIG. 3 illustrates a block diagram of a data storage device provided in an embodiment of the present application;
fig. 4 shows a block diagram of another data storage device provided by an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Furthermore, the terms "first," "second," and the like, as used herein, do not denote any order, quantity, or importance, but rather are used to distinguish one element from another.
It is noted that unless otherwise indicated, technical or scientific terms used herein should be given the ordinary meaning as understood by one of ordinary skill in the art to which this application belongs.
At present, when the wind control early warning system needs to provide wind control early warning service for a plurality of target companies, the wind control early warning system needs to build a dedicated structured database for each target company in advance, and when wind control early warning data to be transmitted by each target company is received, the wind control early warning data to be corresponding to each target company is stored in the dedicated structured database corresponding to each target company, so that the whole data storage process is complex and complicated.
Therefore, in order to ensure that the to-be-wind-control early warning data with different data structure types and sent by different target companies can be stored in the database quickly and conveniently, the embodiment of the application provides a data storage method, which is applied to a wind-control early warning system, as shown in fig. 1, and the method comprises the following steps:
101. and receiving a plurality of to-be-wind control early warning data sent by each target company.
In the embodiment of the present application, the execution subject in each step is a wind control early warning system.
The target companies are companies for which the wind control early warning system is required to provide wind control early warning service, and can be companies in the same industry or companies in different industries; for any target company, the plurality of to-be-wind-control early-warning data sent by the target company are structured data with the same data structure type, and the data structure types of to-be-wind-control early-warning data corresponding to different target companies are different, for example, the data structure type of to-be-wind-control early-warning data corresponding to the target company a is type a, the data structure type of to-be-wind-control early-warning data corresponding to the target company B is type B, and the data structure type of to-be-wind-control early-warning data corresponding to the target company C is type C ….
And each target company sends the data (namely the to-be-winded early-warning data) which is required to be subjected to winded early-warning processing to the winded early-warning system, and at the moment, the winded early-warning system can receive and obtain a plurality of to-be-winded early-warning data sent by each target company.
102. The method comprises the steps of obtaining unstructured data templates and data extraction rules corresponding to each target company, and extracting a plurality of effective data contents corresponding to each wind control early warning data to be detected in each wind control early warning data to be detected corresponding to each target company according to the data extraction rules corresponding to each target company.
The local storage space of the wind control early warning system stores unstructured data templates and data extraction rules corresponding to each target company, and for any one target company, the corresponding data extraction rules are used for extracting effective data content from corresponding to-be-wind control early warning data.
After receiving the multiple to-be-winded early-warning data sent by each target company, the winded early-warning system can obtain unstructured data templates and data extraction rules corresponding to each target company in a local storage space, and extract multiple effective data contents corresponding to each to-be-winded early-warning data in each to-be-winded early-warning data corresponding to each target company according to the data extraction rules corresponding to each target company, namely, for any target company, extract multiple effective data contents corresponding to each to-be-winded early-warning data in each to-be-winded early-warning data corresponding to the target company according to the data extraction rules corresponding to the target company, for example, extract multiple effective data contents corresponding to the to-be-winded early-warning data a1 in the to-be-winded early-warning data a1 corresponding to the target company according to the data extraction rules corresponding to the target company a, the method comprises the steps of extracting a plurality of effective data contents … corresponding to the to-be-winded early-warning data a2 from to-be-winded early-warning data a2 corresponding to a target company A according to a data extraction rule corresponding to the target company A, extracting a plurality of effective data contents corresponding to the to-be-winded early-warning data B1 from to-be-winded early-warning data B1 corresponding to the target company B according to a data extraction rule corresponding to the target company B, extracting a plurality of effective data contents … corresponding to the to-be-winded early-warning data B2 from to-be-winded early-warning data B2 corresponding to the target company B according to a data extraction rule corresponding to the target company N, and extracting a plurality of effective data contents … corresponding to the to-be-winded early-warning data N1 from to-be-winded early-warning data N1 corresponding to the target company N.
103. And filling a plurality of effective data contents corresponding to each piece of to-be-winded early warning data into the corresponding unstructured data templates to obtain a plurality of unstructured data corresponding to each target company.
After extracting a plurality of valid data contents corresponding to each to-be-winded early warning data in each to-be-winded early warning data corresponding to each target company according to a data extraction rule corresponding to each target company, the winded early warning system can fill the plurality of valid data contents corresponding to each to-be-winded early warning data into a corresponding unstructured data template thereof respectively so as to obtain a plurality of unstructured data corresponding to each target company, namely for any target company, filling the plurality of valid data contents corresponding to the first to-be-winded early warning data of the target company into a corresponding unstructured data template of the target company to obtain first unstructured data corresponding to the target company, filling the second valid data contents corresponding to the to-be-winded early warning data of the target company into a corresponding unstructured data template of the target company to obtain second unstructured data … corresponding to the target company, and filling the last valid data contents corresponding to the to-be-winded early warning data of the target company into the corresponding unstructured data template of the target company to obtain the last unstructured data template of the target company.
104. And storing a plurality of unstructured data corresponding to each target company into a target unstructured database.
After the wind control early warning system obtains a plurality of unstructured data corresponding to each target company, the unstructured data corresponding to each target company can be stored in the target unstructured database, so that a plurality of to-be-wind control early warning data which are sent by different target companies and have different data structure types are stored in the same unstructured database, and therefore a dedicated structured database does not need to be built for each target company in advance, and structured data which are sent by different target companies and have different data structure types do not need to be stored in different dedicated structured databases.
The embodiment of the application provides a data storage method, which can obtain a plurality of to-be-winded early warning data sent by each target company after a winded early warning system receives the to-be-winded early warning data, firstly, obtaining an unstructured data template and a data extraction rule corresponding to each target company in a local storage space by the winded early warning system, and extracting a plurality of effective data contents corresponding to each to-be-winded early warning data in each to-be-winded early warning data corresponding to each target company according to the data extraction rule corresponding to each target company; filling a plurality of effective data contents corresponding to each piece of wind control early warning data to the corresponding unstructured data templates, so as to obtain a plurality of unstructured data corresponding to each target company; and finally, storing a plurality of unstructured data corresponding to each target company into a target unstructured database, thereby realizing that a plurality of to-be-wind control early warning data which are transmitted by different target companies and have different data structure types are stored into the same unstructured database. Because in the embodiment of the application, a dedicated structured database is not required to be built for each target company in advance, and structured data with different data structure types sent by different target companies are not required to be respectively stored in the dedicated structured database corresponding to each target company, but the structured data with different data structure types sent by different target companies are stored in the same unstructured database, so that the whole data storage process is rapid and convenient.
For more detailed description below, another data storage method is provided in the embodiments of the present application, specifically as shown in fig. 2, the method includes:
201. and determining unstructured data templates and data extraction rules corresponding to each target company according to the service requirements corresponding to each target company.
In order to ensure that the wind control early warning system can accurately convert a plurality of to-be-wind control early warning data corresponding to each target company into a plurality of unstructured data after receiving the to-be-wind control early warning data sent by each target company, the wind control early warning system needs to determine an unstructured data template and a data extraction rule corresponding to each target company in advance according to the service requirements corresponding to each target company. The following will describe in detail how the wind control early warning system determines unstructured data templates and data extraction rules corresponding to each target company according to the service requirements corresponding to each target company.
Firstly, receiving a service requirement sent by each target company, wherein for any one target company, the service requirement corresponding to the target company is used for indicating a data structure of the pre-warning data to be winded corresponding to the target company, the quantity of effective data content contained in the pre-warning data to be winded corresponding to the target company, the data type corresponding to each effective data content and the value range.
And secondly, determining unstructured data templates and data extraction rules corresponding to each target company according to the service requirements corresponding to each target company.
Specifically, the wind control early warning system may, but is not limited to, determine unstructured data templates and data extraction rules corresponding to each target company according to the service requirements corresponding to each target company in the following two ways:
(1) For any target company, firstly, outputting and displaying the service requirement corresponding to the target company, so that after a worker determines an index set and a rule set corresponding to the target company according to the service requirement corresponding to the target company, generating an unstructured data template and a data extraction rule corresponding to the target company according to the index set and the rule set corresponding to the target company; and secondly, receiving unstructured data templates and data extraction rules corresponding to the target company and input by staff.
(2) For any target company, firstly, extracting a plurality of service keywords corresponding to the target company from service requirements corresponding to the target company according to a first preset rule, wherein the first preset rule records a method for extracting the plurality of service keywords corresponding to the target company from the service requirements corresponding to the target company; secondly, determining an index set and a rule set corresponding to the target company according to a plurality of business keywords corresponding to the target company; finally, generating unstructured data templates and data extraction rules corresponding to the target company according to a second preset rule, an index set and a rule set corresponding to the target company, wherein a method for generating the unstructured data templates and the data extraction rules corresponding to the target company according to the index set and the rule set corresponding to the target company is recorded in the second preset rule; and finally, storing the unstructured data templates and the data extraction rules corresponding to each target company into a local storage space.
Specifically, a plurality of preset keyword sets, preset index combinations corresponding to each preset keyword set and preset rule sets are stored in a local storage space of the wind control early warning system, and for any one preset keyword set, the preset keyword set comprises a plurality of preset keywords; the specific process of the wind control early warning system for determining the index set and the rule set corresponding to the target company according to the plurality of business keywords corresponding to the target company is as follows:
firstly, respectively carrying out matching processing on a plurality of business keywords corresponding to the target company and each preset keyword set, namely, firstly carrying out matching processing on a plurality of business keywords corresponding to the target company and a plurality of preset keywords contained in a first preset keyword set, and then carrying out matching processing … on a plurality of business keywords corresponding to the target company and a plurality of preset keywords contained in a second preset keyword set, and when the plurality of business keywords corresponding to the target company are completely consistent with a plurality of preset keywords contained in a certain preset keyword set, determining that the plurality of business keywords corresponding to the target company are successfully matched with the preset keyword set;
And secondly, combining preset indexes corresponding to the successfully matched preset keyword sets with a preset rule set to determine the index set and the rule set corresponding to the target company.
In the actual use process, after the wind control early warning system generates the unstructured data template and the data extraction rule corresponding to the target company according to the second preset rule, the index set and the rule set corresponding to the target company, the unstructured data template and the data extraction rule corresponding to the target company can be output and displayed, so that a worker can determine whether the unstructured data template and the data extraction rule corresponding to the target company have problems or not; when a worker determines that the unstructured data templates and/or the data extraction rules corresponding to the target company have problems, the worker inputs a modification request to the wind control early warning system, wherein the modification request comprises template modification instructions and/or rule modification instructions; after the wind control early warning system receives the modification request, the unstructured data templates corresponding to the target company can be modified according to template modification instructions included in the modification request; and/or modifying the data extraction rule corresponding to the target company according to the rule modification instruction included in the modification request.
202. And receiving a plurality of to-be-wind control early warning data sent by each target company.
Regarding step 202, receiving the plurality of to-be-winded early warning data sent by each target company, reference may be made to the description of the corresponding portion of fig. 1, and the embodiments of the present application will not be repeated here.
203. The method comprises the steps of obtaining unstructured data templates and data extraction rules corresponding to each target company, and extracting a plurality of effective data contents corresponding to each wind control early warning data to be detected in each wind control early warning data to be detected corresponding to each target company according to the data extraction rules corresponding to each target company.
Regarding step 203, obtaining unstructured data templates and data extraction rules corresponding to each target company, and extracting a plurality of valid data contents corresponding to each to-be-winded early warning data in each to-be-winded early warning data corresponding to each target company according to the data extraction rules corresponding to each target company, description of corresponding portions of fig. 1 may be referred to, and embodiments of the present application will not be repeated here.
204. And filling a plurality of effective data contents corresponding to each piece of to-be-winded early warning data into the corresponding unstructured data templates to obtain a plurality of unstructured data corresponding to each target company.
Regarding step 204, the plurality of valid data contents corresponding to each of the to-be-winded early warning data are respectively filled into the corresponding unstructured data templates thereof to obtain a plurality of unstructured data corresponding to each of the target companies, reference may be made to the description of the corresponding portion of fig. 1, and the embodiments of the present application will not be repeated here.
205. And storing a plurality of unstructured data corresponding to each target company into a target unstructured database.
In step 205, the plurality of unstructured data corresponding to each target company are stored in the target unstructured database, and reference may be made to the description of the corresponding portion of fig. 1, which will not be repeated herein in the embodiment of the present application.
Further, as an implementation of the method shown in fig. 1 and fig. 2, another embodiment of the present application further provides a data storage device, where the device is applied to a wind control early warning system. The embodiment of the device corresponds to the embodiment of the method, and for convenience of reading, details of the embodiment of the method are not repeated one by one, but it should be clear that the device in the embodiment can correspondingly realize all the details of the embodiment of the method. The device is applied to fast and conveniently storing the to-be-winded early warning data which are sent by different target companies and have different data structure types into a database, and particularly as shown in fig. 3, the device comprises:
The first receiving unit 31 is configured to receive a plurality of to-be-wind-controlled early-warning data sent by each target company, where the to-be-wind-controlled early-warning data is structured data;
an extracting unit 32, configured to obtain unstructured data templates and data extraction rules corresponding to each target company, and extract, according to the data extraction rules corresponding to each target company, a plurality of valid data contents corresponding to each of the to-be-wind-controlled early-warning data corresponding to each of the target companies received by the first receiving unit 31;
a filling unit 33, configured to fill in the corresponding unstructured data templates with the plurality of valid data contents corresponding to each of the to-be-winded early warning data extracted by the extracting unit 32, so as to obtain a plurality of unstructured data corresponding to each of the target companies;
a first storage unit 34, configured to store the unstructured data corresponding to each of the target companies, which is obtained by filling in the filling unit 33, in a target unstructured database.
Further, as shown in fig. 4, the apparatus further includes:
the second receiving unit 35 is configured to receive, before the first receiving unit 31 receives the plurality of to-be-wind-controlled early-warning data sent by each target company, a service requirement sent by each target company, where the service requirement corresponding to the target company is used to indicate a data structure of the to-be-wind-controlled early-warning data corresponding to the target company, the number of valid data contents included in the to-be-wind-controlled early-warning data corresponding to the target company, and a data type and a value range corresponding to each valid data content;
A determining unit 36, configured to determine an unstructured data template and a data extraction rule corresponding to each target company according to the service requirement corresponding to each target company received by the second receiving unit 35;
a second storage unit 37, configured to store the unstructured data templates and the data extraction rules corresponding to each of the target companies determined by the determining unit 36 into a local storage space.
Further, as shown in fig. 4, the determining unit 36 is specifically configured to output and display a service requirement corresponding to the target company, so that after determining an index set and a rule set corresponding to the target company according to the service requirement corresponding to the target company, a worker generates an unstructured data template and a data extraction rule corresponding to the target company according to the index set and the rule set corresponding to the target company; and receiving unstructured data templates and data extraction rules corresponding to the target company and input by the staff.
Further, as shown in fig. 4, the determining unit 36 is specifically configured to extract, according to a first preset rule, a plurality of service keywords corresponding to the target company from the service requirements corresponding to the target company; determining an index set and a rule set corresponding to the target company according to a plurality of business keywords corresponding to the target company; and generating unstructured data templates and data extraction rules corresponding to the target company according to a second preset rule, the index set and the rule set corresponding to the target company.
Further, as shown in fig. 4, the determining unit 36 is further configured to output and display an unstructured data template and a data extraction rule corresponding to the target company; receiving a modification request, wherein the modification request comprises a template modification instruction and/or a rule modification instruction; modifying the unstructured data templates corresponding to the target company according to the template modification instruction; and/or modifying the data extraction rule corresponding to the target company according to the rule modification instruction.
Further, as shown in fig. 4, a local storage space of the wind control early warning system stores a plurality of preset keyword sets, preset index combinations and preset rule sets corresponding to each preset keyword set, and the preset keyword sets include a plurality of preset keywords;
a determining unit 36, configured to match a plurality of service keywords corresponding to the target company with each preset keyword set;
and combining the preset indexes corresponding to the successfully matched preset keyword sets with a preset rule set to determine the index set and the rule set corresponding to the target company.
The embodiment of the application provides a data storage method and device, after a wind control early warning system receives and obtains a plurality of to-be-wind control early warning data sent by each target company, the wind control early warning system firstly obtains an unstructured data template and a data extraction rule corresponding to each target company in a local storage space, and extracts a plurality of effective data contents corresponding to each to-be-wind control early warning data in each to-be-wind control early warning data corresponding to each target company according to the data extraction rule corresponding to each target company; filling a plurality of effective data contents corresponding to each piece of wind control early warning data to the corresponding unstructured data templates, so as to obtain a plurality of unstructured data corresponding to each target company; and finally, storing a plurality of unstructured data corresponding to each target company into a target unstructured database, thereby realizing that a plurality of to-be-wind control early warning data which are transmitted by different target companies and have different data structure types are stored into the same unstructured database. Because in the embodiment of the application, a dedicated structured database is not required to be built for each target company in advance, and structured data with different data structure types sent by different target companies are not required to be respectively stored in the dedicated structured database corresponding to each target company, but the structured data with different data structure types sent by different target companies are stored in the same unstructured database, so that the whole data storage process is rapid and convenient.
The embodiment of the application provides a storage medium, which comprises a stored program, wherein the program is used for controlling equipment where the storage medium is located to execute the data storage method.
The storage medium may include volatile memory, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM), among other forms in computer readable media, the memory including at least one memory chip.
The embodiment of the application also provides a data storage device, which comprises a storage medium; and one or more processors coupled to the storage medium, the processors configured to execute the program instructions stored in the storage medium; the program instructions, when executed, perform the data storage method described above.
The embodiment of the application provides equipment, which comprises a processor, a memory and a program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the following steps:
receiving a plurality of to-be-wind control early warning data sent by each target company, wherein the to-be-wind control early warning data are structured data;
The method comprises the steps of obtaining unstructured data templates and data extraction rules corresponding to target companies, and extracting a plurality of effective data contents corresponding to wind control early warning data in the wind control early warning data corresponding to the target companies according to the data extraction rules corresponding to the target companies;
filling a plurality of effective data contents corresponding to each piece of wind control early warning data to be subjected to wind control into a corresponding unstructured data template so as to obtain a plurality of unstructured data corresponding to each target company;
and storing a plurality of unstructured data corresponding to each target company into a target unstructured database.
Further, before the receiving the plurality of pre-warning data to be controlled by wind sent by each target company, the method further includes:
receiving a service requirement sent by each target company, wherein the service requirement corresponding to the target company is used for indicating a data structure of the to-be-wind-control early warning data corresponding to the target company, the quantity of effective data content contained in the to-be-wind-control early warning data corresponding to the target company, the data type corresponding to each effective data content and a value range;
Determining unstructured data templates and data extraction rules corresponding to each target company according to the service requirements corresponding to each target company;
and storing the unstructured data templates and the data extraction rules corresponding to each target company into a local storage space.
Further, the determining, according to the service requirement corresponding to each target company, the unstructured data template and the data extraction rule corresponding to each target company includes:
outputting and displaying the service requirement corresponding to the target company, so that after a worker determines an index set and a rule set corresponding to the target company according to the service requirement corresponding to the target company, generating an unstructured data template and a data extraction rule corresponding to the target company according to the index set and the rule set corresponding to the target company;
and receiving unstructured data templates and data extraction rules corresponding to the target company and input by the staff.
Further, the determining, according to the service requirement corresponding to each target company, the unstructured data template and the data extraction rule corresponding to each target company includes:
Extracting a plurality of business keywords corresponding to the target company from business requirements corresponding to the target company according to a first preset rule;
determining an index set and a rule set corresponding to the target company according to a plurality of business keywords corresponding to the target company;
and generating unstructured data templates and data extraction rules corresponding to the target company according to a second preset rule, the index set and the rule set corresponding to the target company.
Further, after the unstructured data templates and the data extraction rules corresponding to the target company are generated according to the second preset rules, the index set and the rule set corresponding to the target company, the method further comprises:
outputting and displaying unstructured data templates and data extraction rules corresponding to the target company;
receiving a modification request, wherein the modification request comprises a template modification instruction and/or a rule modification instruction;
modifying the unstructured data templates corresponding to the target company according to the template modification instruction; and/or
And modifying the data extraction rule corresponding to the target company according to the rule modification instruction.
Further, a plurality of preset keyword sets, preset index combinations corresponding to each preset keyword set and a preset rule set are stored in a local storage space of the wind control early warning system, and the preset keyword sets comprise a plurality of preset keywords; the determining the index set and the rule set corresponding to the target company according to the plurality of business keywords corresponding to the target company comprises the following steps:
respectively carrying out matching processing on a plurality of business keywords corresponding to the target company and each preset keyword set;
and combining the preset indexes corresponding to the successfully matched preset keyword sets with a preset rule set to determine the index set and the rule set corresponding to the target company.
The present application also provides a computer program product adapted to perform, when executed on a data processing device, a program code initialized with the method steps of: receiving a plurality of to-be-wind control early warning data sent by each target company, wherein the to-be-wind control early warning data are structured data; the method comprises the steps of obtaining unstructured data templates and data extraction rules corresponding to target companies, and extracting a plurality of effective data contents corresponding to wind control early warning data in the wind control early warning data corresponding to the target companies according to the data extraction rules corresponding to the target companies; filling a plurality of effective data contents corresponding to each piece of wind control early warning data to be subjected to wind control into a corresponding unstructured data template so as to obtain a plurality of unstructured data corresponding to each target company; and storing a plurality of unstructured data corresponding to each target company into a target unstructured database.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (10)
1. A data storage method, wherein the method is applied to a wind control early warning system, the method comprising:
receiving a plurality of to-be-wind control early warning data sent by each target company, wherein the to-be-wind control early warning data are structured data;
the method comprises the steps of obtaining unstructured data templates and data extraction rules corresponding to target companies, and extracting a plurality of effective data contents corresponding to wind control early warning data in the wind control early warning data corresponding to the target companies according to the data extraction rules corresponding to the target companies;
Filling a plurality of effective data contents corresponding to each piece of wind control early warning data to be subjected to wind control into a corresponding unstructured data template so as to obtain a plurality of unstructured data corresponding to each target company;
and storing a plurality of unstructured data corresponding to each target company into a target unstructured database.
2. The method of claim 1, wherein prior to said receiving the plurality of pre-warning data to be windcontrolled sent by each target company, the method further comprises:
receiving a service requirement sent by each target company, wherein the service requirement corresponding to the target company is used for indicating a data structure of the to-be-wind-control early warning data corresponding to the target company, the quantity of effective data content contained in the to-be-wind-control early warning data corresponding to the target company, the data type corresponding to each effective data content and a value range;
determining unstructured data templates and data extraction rules corresponding to each target company according to the service requirements corresponding to each target company;
and storing the unstructured data templates and the data extraction rules corresponding to each target company into a local storage space.
3. The method of claim 2, wherein said determining unstructured data templates and data extraction rules for each of said target companies based on business requirements for each of said target companies comprises:
outputting and displaying the service requirement corresponding to the target company, so that after a worker determines an index set and a rule set corresponding to the target company according to the service requirement corresponding to the target company, generating an unstructured data template and a data extraction rule corresponding to the target company according to the index set and the rule set corresponding to the target company;
and receiving unstructured data templates and data extraction rules corresponding to the target company and input by the staff.
4. The method of claim 2, wherein said determining unstructured data templates and data extraction rules for each of said target companies based on business requirements for each of said target companies comprises:
extracting a plurality of business keywords corresponding to the target company from business requirements corresponding to the target company according to a first preset rule;
determining an index set and a rule set corresponding to the target company according to a plurality of business keywords corresponding to the target company;
And generating unstructured data templates and data extraction rules corresponding to the target company according to a second preset rule, the index set and the rule set corresponding to the target company.
5. The method of claim 4, wherein after the generating unstructured data templates and data extraction rules corresponding to the target company according to the second preset rules, the set of metrics and rules corresponding to the target company, the method further comprises:
outputting and displaying unstructured data templates and data extraction rules corresponding to the target company;
receiving a modification request, wherein the modification request comprises a template modification instruction and/or a rule modification instruction;
modifying the unstructured data templates corresponding to the target company according to the template modification instruction; and/or
And modifying the data extraction rule corresponding to the target company according to the rule modification instruction.
6. The method of claim 4, wherein a local storage space of the wind control early warning system stores a plurality of preset keyword sets, preset index combinations corresponding to each preset keyword set, and preset rule sets, and the preset keyword sets comprise a plurality of preset keywords; the determining the index set and the rule set corresponding to the target company according to the plurality of business keywords corresponding to the target company comprises the following steps:
Respectively carrying out matching processing on a plurality of business keywords corresponding to the target company and each preset keyword set;
and combining the preset indexes corresponding to the successfully matched preset keyword sets with a preset rule set to determine the index set and the rule set corresponding to the target company.
7. A data storage device for use in a wind-controlled early warning system, the device comprising:
the system comprises a first receiving unit, a second receiving unit and a first control unit, wherein the first receiving unit is used for receiving a plurality of to-be-winded control early warning data sent by each target company, and the to-be-winded control early warning data are structured data;
the extraction unit is used for acquiring unstructured data templates and data extraction rules corresponding to each target company and extracting a plurality of effective data contents corresponding to each to-be-winded early warning data in each to-be-winded early warning data corresponding to each target company according to the data extraction rules corresponding to each target company;
the filling unit is used for filling a plurality of effective data contents corresponding to each piece of to-be-winded early warning data into a corresponding unstructured data template so as to obtain a plurality of unstructured data corresponding to each target company;
And the first storage unit is used for storing a plurality of unstructured data corresponding to each target company into a target unstructured database.
8. The apparatus of claim 7, wherein the apparatus further comprises:
the second receiving unit is used for receiving the service requirement sent by each target company before the first receiving unit receives the plurality of to-be-controlled early warning data sent by each target company, wherein the service requirement corresponding to the target company is used for indicating the data structure of the to-be-controlled early warning data corresponding to the target company, the quantity of effective data content contained in the to-be-controlled early warning data corresponding to the target company, the data type corresponding to each effective data content and the value range;
the determining unit is used for determining unstructured data templates and data extraction rules corresponding to each target company according to the service requirements corresponding to each target company;
and the second storage unit is used for storing the unstructured data templates and the data extraction rules corresponding to each target company into a local storage space.
9. A storage medium comprising a stored program, wherein the program, when run, controls a device in which the storage medium is located to perform the data storage method of any one of claims 1 to 6.
10. A data storage device, the device comprising a storage medium; and one or more processors coupled to the storage medium, the processors configured to execute the program instructions stored in the storage medium; the program instructions, when executed, perform the data storage method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311746298.6A CN117726170A (en) | 2023-12-18 | 2023-12-18 | Data storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311746298.6A CN117726170A (en) | 2023-12-18 | 2023-12-18 | Data storage method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117726170A true CN117726170A (en) | 2024-03-19 |
Family
ID=90201163
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311746298.6A Pending CN117726170A (en) | 2023-12-18 | 2023-12-18 | Data storage method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117726170A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101477532A (en) * | 2008-12-23 | 2009-07-08 | 北京畅游天下网络技术有限公司 | Method, apparatus and system for implementing data storage and access |
| US20170316068A1 (en) * | 2016-04-27 | 2017-11-02 | Accenture Global Solutions Limited | Machine for generating unstructured syntax |
| US20190050400A1 (en) * | 2017-08-11 | 2019-02-14 | Wipro Limited | Method and system for data conversion and data model optimization |
| CN109344193A (en) * | 2018-10-24 | 2019-02-15 | 中国银行股份有限公司 | A kind of method and system converting structural data to unstructured data |
| CN109669644A (en) * | 2019-01-02 | 2019-04-23 | 浪潮商用机器有限公司 | A kind of method and apparatus of data storage |
| CN110543621A (en) * | 2019-07-29 | 2019-12-06 | 国营芜湖机械厂 | multi-format result document analysis system of aviation detection equipment and use method thereof |
| CN111352917A (en) * | 2020-02-28 | 2020-06-30 | 北京思特奇信息技术股份有限公司 | Information input method and device, electronic equipment and storage medium |
-
2023
- 2023-12-18 CN CN202311746298.6A patent/CN117726170A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101477532A (en) * | 2008-12-23 | 2009-07-08 | 北京畅游天下网络技术有限公司 | Method, apparatus and system for implementing data storage and access |
| US20170316068A1 (en) * | 2016-04-27 | 2017-11-02 | Accenture Global Solutions Limited | Machine for generating unstructured syntax |
| US20190050400A1 (en) * | 2017-08-11 | 2019-02-14 | Wipro Limited | Method and system for data conversion and data model optimization |
| CN109344193A (en) * | 2018-10-24 | 2019-02-15 | 中国银行股份有限公司 | A kind of method and system converting structural data to unstructured data |
| CN109669644A (en) * | 2019-01-02 | 2019-04-23 | 浪潮商用机器有限公司 | A kind of method and apparatus of data storage |
| CN110543621A (en) * | 2019-07-29 | 2019-12-06 | 国营芜湖机械厂 | multi-format result document analysis system of aviation detection equipment and use method thereof |
| CN111352917A (en) * | 2020-02-28 | 2020-06-30 | 北京思特奇信息技术股份有限公司 | Information input method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107957957B (en) | Test case obtaining method and device | |
| CN106897342B (en) | Data verification method and equipment | |
| CN112732641A (en) | Electronic file filing method, device and medium | |
| KR102391839B1 (en) | Method and device for processing user personal, server and storage medium | |
| CN106610931B (en) | Topic name extraction method and device | |
| CN110569330A (en) | text labeling system, device, equipment and medium based on intelligent word selection | |
| CN114511235A (en) | Process evaluation method and system | |
| CN113641592B (en) | Test sequence generation method and device | |
| CN110673828A (en) | Product configuration method | |
| CN113919683A (en) | Method and device for calculating process man-hour, storage medium and processor | |
| CN107016028B (en) | Data processing method and apparatus thereof | |
| CN116595588A (en) | Safety analysis method and device for railway signal system development process | |
| CN117271478A (en) | Data migration method and device, storage medium and electronic equipment | |
| CN113326211B (en) | Test case generation method and device | |
| CN110019357B (en) | Database query script generation method and device | |
| CN117726170A (en) | Data storage method and device | |
| CN110019295B (en) | Database retrieval method, device, system and storage medium | |
| CN112580915A (en) | Project milestone determination method and device, storage medium and electronic equipment | |
| CN111125087A (en) | Data storage method and device | |
| CN112612915B (en) | Picture labeling method and device | |
| CN115129590A (en) | Test case generation method and device, electronic equipment and storage medium | |
| CN114817209A (en) | Monitoring rule processing method and device, processor and electronic equipment | |
| CN113723047A (en) | Map construction method, device and medium based on legal document | |
| CN110968754B (en) | Detection method and device for crawler page turning strategy | |
| CN111967767A (en) | Business risk identification method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |