CN115544024A - Data processing method and device based on common semantic field - Google Patents
Data processing method and device based on common semantic field Download PDFInfo
- Publication number
- CN115544024A CN115544024A CN202211401420.1A CN202211401420A CN115544024A CN 115544024 A CN115544024 A CN 115544024A CN 202211401420 A CN202211401420 A CN 202211401420A CN 115544024 A CN115544024 A CN 115544024A
- Authority
- CN
- China
- Prior art keywords
- data
- field
- semantic
- public
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
Abstract
The application discloses a common semantic field based data processing method and device, the common semantic field table and the common semantic field relation table are constructed, after data to be retrieved are obtained, data matching is carried out based on the common semantic data field table, then identification field information and semantic field information of each data table in the corresponding common semantic data field relation table are determined according to matching results, and finally retrieval of the data to be retrieved is achieved according to the identification field information and the semantic field information of each data table. According to the method and the system, the same type data of each subsystem does not need to be uploaded to the database summary table, and the problem of data loss is avoided. Through the semantic data public field table and the semantic data public field relation table, the two information tables are related through the public semantic field, so that the inquiry problem caused by data dispersion in data retrieval statistics is effectively avoided through the matched use of the two information tables, and the retrieval statistics is more convenient.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data processing method and apparatus based on a common semantic field.
Background
In recent years, the technology development of a comprehensive security platform based on internet, big data and video intelligent analysis is rapid, and the platform can integrate the functions of various security subsystems such as a video monitoring system, an entrance and exit control system, an intrusion and emergency alarm system, an electronic patrol system and a fire-fighting early warning system, so that the functions of uniform alarm receiving and processing, overall management and statistical analysis are provided. Due to the fact that a plurality of security subsystems are involved, data stored by the comprehensive security platform has the characteristic of multi-source heterogeneity, and therefore the problem of retrieval statistics of the data is solved.
In the related art, for example, publication No. CN101388036A discloses a method and an apparatus for summarizing data tables. Wherein the method comprises the following steps: identifying a sub-item segment corresponding to the item segment identification according to the item segment identification preset in the sub-data tables participating in the summary; and extracting the identified sub-item segments, and performing summary processing on the extracted sub-item segments.
Data retrieval statistical logic of the related art comprehensive security platform generally needs to use a database summary table to store various related data transmitted from each security subsystem. The existing data recording, transmitting and storing mode has certain disadvantages. On one hand, the sources of a plurality of security subsystems may relate to different manufacturers, different brands or different business scenes, so that the types of data information contained in the security subsystems are different and limited by the established format of the database summary table, and when the database summary table does not have a universal semantic field of certain data information, the data information of the security subsystems cannot be uploaded to the comprehensive security platform, so that the problem of data information loss exists, and therefore, the database summary table has certain use limitation. On the other hand, the sources of the plurality of security subsystems may relate to different manufacturers, different brands, or different service scenes, the names of the information tables for recording the same attribute category generated by different security subsystems may be different, and the semantic fields for describing the data information with the same meaning in the information tables may also be different, so that the statistical work of searching a certain type of data by using the mixed information tables is inconvenient.
Disclosure of Invention
The embodiment of the application provides a data processing method and device based on a common semantic field, and aims to solve the problems of data loss and inconvenient retrieval statistics in the existing data processing scheme.
In a first aspect, the present application provides a data processing method based on a common semantic field, where the method includes:
acquiring data to be retrieved, and determining target public semantic field identification information corresponding to the data to be retrieved in a semantic data public field table through data matching; in the semantic data public field table, public semantic field identification information corresponding to different data with the same meaning is the same;
determining identification field information and semantic field information of each data table corresponding to the data to be retrieved in a semantic data public field relation table according to the identification information of the target public semantic field;
and retrieving the data to be retrieved according to the identification field information and the semantic field information of each data table.
In a second aspect, the present application provides a data processing apparatus based on common semantic fields, the apparatus comprising:
the first determining module is used for acquiring data to be retrieved and determining target public semantic field identification information corresponding to the data to be retrieved in a semantic data public field table through data matching; in the semantic data public field table, public semantic field identification information corresponding to different data with the same meaning is the same;
the second determining module is used for determining identification field information and semantic field information of each data table corresponding to the data to be retrieved in a semantic data public field relation table according to the target public semantic field identification information;
and the retrieval module is used for retrieving the data to be retrieved according to the identification field information and the semantic field information of each data table.
In a third aspect, the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;
a memory for storing a computer program;
a processor for implementing any of the above method steps when executing a program stored in the memory.
In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the method steps of any of the above.
The application provides a data processing method and device based on a common semantic field, which have the following advantages or beneficial effects:
according to the method and the device, a semantic data public field table and a semantic data public field relation table are established, after the data to be retrieved is obtained, data matching is carried out based on the semantic data public field table, then each data table identification field information and each semantic field information in the corresponding semantic data public field relation table are determined according to matching results, and finally retrieval of the data to be retrieved is achieved according to each data table identification field information and each semantic field information. According to the method and the system, the same type data of each subsystem does not need to be uploaded to the database summary table, and the problem of data loss is avoided. Through the semantic data public field table and the semantic data public field relation table, the two information tables are related through the public semantic field, so that the inquiry problem caused by data dispersion in data retrieval statistics is effectively avoided through the matched use of the two information tables, and the retrieval statistics is more convenient.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a representation of video surveillance device information provided herein;
fig. 2 is an information representation intention of the X-ray apparatus provided in the present application;
FIG. 3 is a schematic diagram of a process for constructing a semantic data public field table provided herein;
FIG. 4 is a schematic diagram of a semantic data public field table provided herein;
FIG. 5 is a schematic diagram of a process for constructing a semantic data common field relationship table according to the present application;
FIG. 6 is a semantic data common field relationship representation provided herein;
FIG. 7 is another semantic data common field relationship representation provided herein;
FIG. 8 is a schematic diagram of a common semantic field-based data processing process provided herein;
FIG. 9 is a schematic diagram of a common semantic field-based data processing apparatus provided in the present application;
fig. 10 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all the embodiments.
It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.
The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the functionality associated with that element.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.
The technical problems of the prior art data processing solutions are illustrated by way of example.
For example, the device information tables of the security subsystems of the two integrated security platforms, i.e. the video monitoring system and the access control system, are respectively as follows: "video monitoring apparatus information table (tb _ video _ reporting _ info)" and "X-ray apparatus information table (tb _ X _ ray _ device _ info)". Fig. 1 is a view illustrating information of a video monitoring apparatus provided by the present application, and fig. 2 is a view illustrating information of an X-ray apparatus provided by the present application. As shown in fig. 1 and fig. 2, the semantic field "monitor responsible person monitor _ user" is recorded in the "video monitor device information table (tb _ video _ monitor _ info)", and the semantic field "device responsible person monitor _ user" is recorded in the "X-ray machine device information table (tb _ X _ ray _ device _ info)".
Based on the above consideration, the application provides a data processing method and device based on a common semantic field, so as to solve the problems of data loss and inconvenient retrieval statistics in the existing data processing scheme. The technical problem is solved through a semantic data public field table and a semantic data public field relation table. Therefore, a description will be first given of a process of constructing a semantic data common field table and a semantic data common field relation table.
Fig. 3 is a schematic diagram of a process for constructing a semantic data public field table provided in the present application, where the process includes the following steps:
s101: and constructing a semantic data public field table, wherein the semantic data public field table comprises a public semantic identification field and a public semantic description field.
S102: acquiring the sub data tables of each subsystem, and dividing the data in each sub data table according to the meanings; distributing unique corresponding public semantic field identification information for data with different meanings, writing the public semantic field identification information into the public semantic identification field, and writing the data in each sub data table into the public semantic description field according to the corresponding relation with the public semantic field identification information.
The semantic data public field table is constructed in the electronic equipment, and the electronic equipment can be a PC, a tablet personal computer and the like, and can also be a server.
As shown in fig. 3, the electronic device first constructs a structure of a semantic data common field table, which includes a common semantic identification field and a common semantic description field. And the data table of each subsystem is called as a sub data table, the respective sub data table of each subsystem is obtained, and then the data in each sub data table is divided according to the meaning. For example, the alarm type, and the event type belong to the same meaning of data; alarm trigger time, alarm time, fire alarm time belong to the same meaning of data and the like. And distributing unique corresponding public semantic field identification information for the data with different meanings, namely that the public semantic field identification information corresponding to the data with different meanings is different, and the public semantic field identification information corresponding to the data with the same meaning is the same. For example, the public semantic field identification information allocated to the alarm type, the alarm type and the event type is A, and the public semantic field identification information allocated to the alarm triggering time, the alarm time and the fire alarm time is B.
And writing the identification information of each public semantic field into the public semantic identification field, and writing the data in each sub-data table into the public semantic description field according to the corresponding relation with the identification information of the public semantic field. Also by way of example, a and B are written into the common semantic identification field, the alarm type and the event type are written into the common semantic description field corresponding to a, and the alarm trigger time, the alarm time and the fire alarm time are written into the common semantic description field corresponding to B. If the common semantic field identification information of the same row in the semantic data common field table corresponds to the data in the sub data table, writing A and the alarm type, the alarm type and the event type into the same row, and writing B and the alarm triggering time, the alarm time and the fire alarm time into the same row.
It should be noted that the semantic data common field table may further include a creation time field, a creator field, an update time field, and an update field. And is not limited to the common semantic identification field, the common semantic description field, the creation time field, the creator field, the update time field, and the update people field. According to actual data of different subsystems, field information of a semantic data public field table can be expanded.
In addition, the common semantic identification field includes at least one of a common semantic sequence number identification field and a common semantic name identification field. The common semantic sequence number identification field is written with a unique sequence number, such as 1, 2, 3, 4, etc., and the unique sequence number can be used as the common semantic field identification information. Written in the common semantic name identification field is the unique corresponding common semantic name information, such as alarm _ a, alarm _ b, and the like, allocated to the data with different meanings. Or the public semantic sequence number identification field and the public semantic name identification field can be used as the public semantic identification field at the same time.
Fig. 4 is a schematic diagram of a semantic data common field table provided by the present application, and as shown in fig. 4, public _ id is a common semantic sequence number identification field, public _ name is a common semantic name identification field, and both the public _ id field and the public _ name field belong to the common semantic identification field. public _ description is a common semantic description field, create _ time is a creation time field, create _ user is a creator field, update _ time is an update time field, and update _ user is an update person field.
As shown in the semantic data common field table shown in fig. 4, each line of data is data having a corresponding relationship. Specifically, the public semantic sequence number identifier 1 and the public semantic name identifier alarm _ a correspond to an alarm type/an event type; the public semantic sequence number identification 2 and the public semantic name identification alarm _ b correspond to alarm triggering time/alarm time/fire alarm time; the public semantic sequence number identification 3 and the public semantic name identification alarm _ c correspond to an alarm level/an alarm hierarchy; the public semantic sequence number identification 4 and the public semantic name identification alarm _ d correspond to processing records/processing results/analysis results; the public semantic sequence number identifier 5 and the public semantic name identifier device _ a correspond to the device name/apparatus name/device name/apparatus name; the public semantic sequence number identifier 6 and the public semantic name identifier device _ b correspond to an installation position/an assembly position/an installation address/an assembly site; the public semantic sequence number mark 7 and the public semantic name mark device _ c correspond to an equipment ip address/an X-ray machine ip address/a mounting point ip/a mounting position ip; the public semantic sequence number identification 8 and the public semantic name identification device _ d correspond to the monitoring responsible person/equipment responsible person/device responsible person.
In this application, the method further comprises:
when a semantic data public field table updating instruction is received, acquiring updating data and an updating position carried in the instruction, wherein the updating data comprises at least one of newly added data, deleted data and changed data;
and updating the semantic data public field table according to the updating data and the updating position.
Also, the following is illustrated in fig. 4 as an example, for example, the information carried in the received semantic data common field table update instruction includes: the update position is "the seventh row and the third column", the update data is the delete "assembly position", and the assembly position in the seventh row and the third column in fig. 4 is deleted according to the update data and the update position carried in the instruction. For another example, the information carried in the received semantic data public field table update instruction includes: the update position is "the third column of the seventh row", the update data is the added "mount address", and the mount address is added at the position of the third column of the seventh row in fig. 4 according to the update data and the update position carried in the instruction. For another example, the information carried in the received semantic data public field table update instruction includes: the updating position is 'the seventh row and the third column', the updating data is to modify 'the assembling position' into 'the assembling address', and the 'the assembling position' in the position of the seventh row and the third column in fig. 4 is modified into 'the assembling address' according to the updating data and the updating position carried in the instruction.
The following describes a process of constructing a semantic data common field relationship table.
Fig. 5 is a schematic diagram of a process for constructing a semantic data common field relationship table provided in the present application, where the process includes the following steps:
s201: and aiming at the data of each meaning, constructing a semantic data public field relation table corresponding to the meaning, wherein the semantic data public field relation table comprises a sub-data table identification field, a semantic data field and a public semantic identification field.
S202: writing public semantic field identification information corresponding to the distributed meaning data into the public semantic identification field; correspondingly writing the sub-data table identification information of each data of the meaning into the sub-data table identification field, and correspondingly writing each data of the meaning into the semantic data field.
The electronic equipment for constructing the semantic data public field relation table and the electronic equipment for constructing the semantic data public field relation table can be the same equipment or different equipment.
As shown in fig. 5, the electronic device first constructs a structure of a semantic data common field relationship table, and it should be noted that, for data of each meaning, a semantic data common field relationship table corresponding to the meaning is constructed. For example, if there are data with 10 meanings, 10 semantic data common field relation tables are constructed. Each semantic data common field relationship table includes a sub-data table identification field, a semantic data field, and a common semantic identification field. And establishing a connection between the semantic data public field relation table and the semantic data public field table through the public semantic identification field.
Writing the distributed public semantic field identification information into a public semantic identification field, correspondingly writing the sub-data table identification information into a sub-data table identification field, wherein the sub-data table identification information can be the name of a sub-data table, and correspondingly writing each data into a semantic data field.
Fig. 6 is a semantic data common field relationship table corresponding to the common semantic sequence number identifier 2 and the common semantic name identifier alarm _ b provided by the present application, and fig. 7 is a semantic data common field relationship table corresponding to the common semantic sequence number identifier 8 and the common semantic name identifier device _ d provided by the present application. In fig. 6 and 7, table _ name is a sub-data table identification field, field _ name is a semantic data field, public _ name is a common semantic name identification field, and public _ id is a common semantic sequence number identification field.
The method further comprises the following steps:
determining common semantic field identification information corresponding to the updated data, determining a corresponding semantic data common field relation table according to the common semantic field identification information, and updating the semantic data common field relation table according to the updated data.
In the application, when a semantic data common field table updating instruction is received, the semantic data common field table is updated, and the corresponding semantic data common field relation table is updated. Specifically, according to the semantic data common field table updating instruction, common semantic field identification information corresponding to the updating data can be determined, and according to the common semantic field identification information corresponding to the updating data, the semantic data common field relation table to be updated can be determined. And then updating the semantic data public field relation table according to the updating data.
For example, if the update content of the semantic data common field table is that the equipment responsible person is deleted, it may be determined that the semantic data common field relationship table to be updated is the semantic data common field relationship table shown in fig. 7 according to the update content of the semantic data common field table, and the data in the line of the equipment responsible person in the semantic data common field relationship table shown in fig. 7 is deleted. For example, if the device responsible person is added to the update content of the semantic data common field table, it may be determined that the semantic data common field relationship table to be updated is the semantic data common field relationship table shown in fig. 7 according to the update content of the semantic data common field table, and the device responsible person and the sub-data table identification information corresponding to the device responsible person are added to the semantic data common field relationship table shown in fig. 7.
The following describes the data processing process based on common semantic field provided in the present application in detail.
Fig. 8 is a schematic diagram of a common semantic field-based data processing process provided in the present application, where the process includes the following steps:
s301: acquiring data to be retrieved, and determining target public semantic field identification information corresponding to the data to be retrieved in a semantic data public field table through data matching; in the semantic data public field table, the public semantic field identification information corresponding to different data with the same meaning is the same.
S302: and determining identification field information and semantic field information of each data table corresponding to the data to be retrieved in a semantic data public field relation table according to the identification information of the target public semantic field.
S303: and retrieving the data to be retrieved according to the identification field information of each data table and the semantic field information.
The data processing method based on the common semantic field is applied to electronic equipment, and the electronic equipment can be equipment such as a PC (personal computer), a tablet personal computer and the like, and can also be a server. The electronic device for data processing based on the common semantic field may be the same as or different from the electronic device for constructing the semantic data common field table, or the electronic device for constructing the semantic data common field relation table.
After receiving the data to be retrieved, the electronic equipment matches the data to be retrieved with the data in the semantic data public field table, and uses the public semantic field identification information corresponding to the successfully matched data as the target public semantic field identification information. It should be noted that, in the semantic data common field table, the common semantic field identification information corresponding to different data with the same meaning is the same.
The semantic data public field table and each semantic data public field relation table are linked through public semantic field identification information, after the target public semantic field identification information is determined, the corresponding semantic data public field relation table is determined according to the target public semantic field identification information, and then each data table identification field information and each semantic field information corresponding to the data to be retrieved are determined in the semantic data public field relation table. And retrieving the data to be retrieved according to the identification field information and the semantic field information of each data table.
In order to improve the efficiency of data retrieval, in the method for determining the common field table of semantic data through data matching, the identification information of the target common semantic field corresponding to the data to be retrieved includes:
acquiring target type information of the data to be retrieved, matching the data to be retrieved with each data of a field corresponding to the target type information in the semantic data public field table, determining target data matched with the data to be retrieved, and determining public semantic field identification information corresponding to the target data as target public semantic field identification information.
The electronic equipment acquires target type information of the data to be retrieved, wherein the target type information can be input to the electronic equipment together when a user inputs the data to be retrieved, or the target type information can be acquired by the electronic equipment through semantic analysis of the data to be retrieved. Taking fig. 4 as an example, each column in fig. 4 may be regarded as a type information, including a common semantic description type, a creator type, a creation time type, and the like. If the data to be retrieved is the alarm time, the target type information of the data to be retrieved can be determined to be the public semantic description type, then the data to be retrieved is matched with each data in the public semantic description field in the semantic data public field table, the target data matched with the data to be retrieved is determined, and the public semantic field identification information corresponding to the target data is determined as the target public semantic field identification information. The data to be retrieved does not need to be matched with all data in the semantic data public field table, so that the data matching efficiency is improved, and the data retrieval efficiency is further improved.
In this application, retrieving the data to be retrieved according to the identification field information and the semantic field information of each data table includes:
and performing statement splicing on the identification field information of each data table and each semantic field information, and determining data indicated by the corresponding semantic field information in the data table corresponding to the identification field information of each data table according to the retrieval statement obtained by splicing.
Specifically, the information of each data table identification field and each semantic field may be subjected to sql statement splicing according to a format of "select @ field _ name from @ table _ name", and then the data indicated by the corresponding semantic field information in the data table corresponding to each data table identification field information is determined according to the search statement obtained by splicing.
Examples are as follows:
for example, the data to be retrieved is "alarm time", the data to be retrieved is matched with information in the "public semantic field interpretation (public _ description)" in the "semantic data public field table" according to the information, the corresponding "public semantic field name" (public _ name) "and" public semantic field identifier (public _ id) "are obtained as" alarm _ b "and" 2 "according to the matching result, and the names of the alarm information tables of all security subsystems matched with the data to be retrieved and the corresponding semantic field names thereof are obtained in the" semantic data public field relation table "by using the obtained" public semantic field name "(public _ name)" and/or "public semantic field identifier (public _ id)", as shown in fig. 6.
For another example, the data to be retrieved is "responsible person", the information matching in the "public semantic field interpretation (public _ description)" of the data to be retrieved and the "public semantic field public field table" is performed, the corresponding "public semantic field name (public _ name)" and the corresponding "public semantic field identifier (public _ id)" are obtained according to the matching result and are "device _ d" and "8", respectively, and the names of the alarm information tables of all security subsystems matched with the data to be retrieved and the corresponding semantic field names thereof are obtained in the "semantic data public field relationship table" by using the obtained "public semantic field name" and/or "public semantic field identifier (public _ id)", as shown in fig. 7.
Traversing according to the data information set contained in the semantic data public field relation table shown in the figure 6 or the figure 7, and splicing the acquired semantic fields by sql statements, thereby realizing that the code logic of the code level is fixed and is not changed along with the change of the service requirement, and only maintaining the semantic data public field table and the semantic data public field relation table.
In the code logic level, the union sql statement is spliced by traversing the data information set, and the method comprises the following steps:
the @ field _ name and the @ table _ name in the "select @ field _ name from @ table _ name" statement are variables, and are changed according to the obtained specific semantic data common field relation table, and the semantic fields queried from the data information set are replaced in the code, for example, "select alarm _ b, trigger _ time from tb _ innovative _ alarm _ info _ all _ b, alarm _ time from tb _ control _ alarm _ info _ all _ b, and fire _ time from tbfire _ protect _ alarm _ info" in fig. 6, so that the security alarm information table of the security subsystem statistically required to obtain can be retrieved from the data of the integrated security platform. Similarly, for "select area _ d, monitor _ user from tb _ video _ survivionarea _ area _ d, device _ user from tb _ x _ ray _ device _ info area _ d, device _ monitor from tb _ door _ device _ info area _ d, device _ person from t b _ device _ gate _ device _ info" in fig. 7, the device information table of the security subsystem with the statistical acquisition requirement can be retrieved from the data of the integrated security platform. Therefore, the logic code is fixed in the code, and the universality and the robustness of the code are improved.
The method comprises the steps of carrying out association configuration on semantic fields of alarm record tables of all security subsystems with an alarm function and semantic data public fields in a semantic data public field table, matching information required to be retrieved with information in public semantic field interpretation (public _ description), associating the information required to be retrieved with corresponding semantic data public field relation tables according to matching results, further obtaining corresponding public semantic field names (public _ names) and public semantic field identifications (public _ ids), further obtaining required semantic data public field relation tables, and conveniently obtaining retrieval logic codes according to names of alarm information tables of all security subsystems matched with the information required to be retrieved and corresponding semantic field names of the alarm information tables, wherein query logic does not need to be fixed in the logic codes every time, and once a newly added security subsystem is met, only the semantic data public field relation tables and the semantic data public field relation tables need to be updated.
Fig. 9 is a schematic structural diagram of a data processing apparatus based on common semantic fields provided in the present application, including:
the first determining module 91 is configured to acquire data to be retrieved, and determine, through data matching, target common semantic field identification information corresponding to the data to be retrieved in a semantic data common field table; in the semantic data public field table, public semantic field identification information corresponding to different data with the same meaning is the same;
a second determining module 92, configured to determine, according to the target public semantic field identification information, identification field information and semantic field information of each data table corresponding to the data to be retrieved in a semantic data public field relationship table;
and the retrieval module 93 is configured to retrieve the data to be retrieved according to the identification field information of each data table and each semantic field information.
The first determining module 91 is specifically configured to acquire target type information of the data to be retrieved, match the data to be retrieved with each data in a field corresponding to the target type information in the semantic data public field table, determine target data that matches the data to be retrieved, and determine public semantic field identification information corresponding to the target data as target public semantic field identification information.
The retrieval module 93 is specifically configured to perform statement concatenation on the identification field information of each data table and each semantic field information, and determine, according to a retrieval statement obtained by the concatenation, data indicated by corresponding semantic field information in a data table corresponding to each identification field information of each data table.
The device further comprises:
a construction module 94, configured to construct a semantic data public field table, where the semantic data public field table includes a public semantic identification field and a public semantic description field; acquiring the sub data tables of each subsystem, and dividing the data in each sub data table according to the meanings; distributing unique corresponding public semantic field identification information for data with different meanings, writing the public semantic field identification information into the public semantic identification field, and writing the data in each sub data table into the public semantic description field according to the corresponding relation with the public semantic field identification information.
The building module 94 is further configured to build, for data of each meaning, a semantic data public field relationship table corresponding to the meaning, where the semantic data public field relationship table includes a sub-data table identification field, a semantic data field, and a public semantic identification field; writing public semantic field identification information corresponding to the distributed meaning data into the public semantic identification field; and correspondingly writing the sub data table identification information of each data with the meaning into the sub data table identification field, and correspondingly writing each data with the meaning into the semantic data field.
The building module 94 is further configured to, when receiving an update instruction of the semantic data public field table, obtain update data and an update position carried in the instruction, where the update data includes at least one of new data, deleted data, and modified data; and updating the semantic data public field table according to the updating data and the updating position.
The building module 94 is further configured to determine public semantic field identification information corresponding to the updated data, determine a corresponding public semantic data field relationship table according to the public semantic field identification information, and update the public semantic data field relationship table according to the updated data.
The present application also provides an electronic device, as shown in fig. 10, including: the system comprises a processor 401, a communication interface 402, a memory 403 and a communication bus 404, wherein the processor 401, the communication interface 402 and the memory 403 complete mutual communication through the communication bus 404;
the memory 403 has stored therein a computer program which, when executed by the processor 401, causes the processor 401 to perform any of the above method steps.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface 402 is used for communication between the above-described electronic apparatus and other apparatuses.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Alternatively, the memory may be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a central processing unit, a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an application specific integrated circuit, a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the like.
A computer-storage-readable storage medium is provided, in which a computer program executable by an electronic device is stored, which program, when run on the electronic device, causes the electronic device to carry out any of the above method steps when executed.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all changes and modifications that fall within the scope of the present application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A method for processing data based on common semantic fields, the method comprising:
acquiring data to be retrieved, and determining target public semantic field identification information corresponding to the data to be retrieved in a semantic data public field table through data matching; in the semantic data public field table, public semantic field identification information corresponding to different data with the same meaning is the same;
determining identification field information and semantic field information of each data table corresponding to the data to be retrieved in a semantic data public field relation table according to the identification information of the target public semantic field;
and retrieving the data to be retrieved according to the identification field information of each data table and the semantic field information.
2. The method of claim 1, wherein the determining, by data matching, target common semantic field identification information corresponding to the data to be retrieved in a semantic data common field table comprises:
acquiring target type information of the data to be retrieved, matching the data to be retrieved with each data of a field corresponding to the target type information in the semantic data public field table, determining target data matched with the data to be retrieved, and determining public semantic field identification information corresponding to the target data as target public semantic field identification information.
3. The method of claim 1, wherein retrieving the data to be retrieved according to the respective data table identification field information and the respective semantic field information comprises:
and performing sentence splicing on the identification field information of each data table and each semantic field information, and determining data indicated by the corresponding semantic field information in the data table corresponding to the identification field information of each data table according to the retrieval sentences obtained by splicing.
4. The method of claim 1, wherein the building of the semantic data common field table comprises:
constructing a semantic data public field table, wherein the semantic data public field table comprises public semantic identification fields and public semantic description fields;
acquiring the sub data tables of each subsystem, and dividing the data in each sub data table according to the meanings; distributing unique corresponding public semantic field identification information for data with different meanings, writing the public semantic field identification information into the public semantic identification field, and writing the data in each sub data table into the public semantic description field according to the corresponding relation with the public semantic field identification information.
5. The method of claim 4, wherein the construction process of the semantic data common field relationship table comprises:
aiming at data of each meaning, a semantic data public field relation table corresponding to the meaning is constructed, wherein the semantic data public field relation table comprises a sub-data table identification field, a semantic data field and a public semantic identification field;
writing public semantic field identification information corresponding to the distributed meaning data into the public semantic identification field; correspondingly writing the sub-data table identification information of each data of the meaning into the sub-data table identification field, and correspondingly writing each data of the meaning into the semantic data field.
6. The method of claim 4, wherein the method further comprises:
when a semantic data public field table updating instruction is received, acquiring updating data and an updating position carried in the instruction, wherein the updating data comprises at least one of newly added data, deleted data and changed data;
and updating the semantic data public field table according to the updating data and the updating position.
7. The method of claim 6, wherein the method further comprises:
determining public semantic field identification information corresponding to the updated data, determining a corresponding semantic data public field relation table according to the public semantic field identification information, and updating the semantic data public field relation table according to the updated data.
8. The method of claim 4, wherein the semantic data common field table further comprises a create time field, a create person field, an update time field, and an update schema field.
9. The method of claim 4, wherein the common semantic identification field comprises at least one of a common semantic sequence number identification field and a common semantic name identification field.
10. A common semantic field based data processing apparatus, the apparatus comprising:
the first determining module is used for acquiring data to be retrieved and determining target public semantic field identification information corresponding to the data to be retrieved in a semantic data public field table through data matching; in the semantic data public field table, public semantic field identification information corresponding to different data with the same meaning is the same;
the second determining module is used for determining identification field information and semantic field information of each data table corresponding to the data to be retrieved in a semantic data public field relation table according to the target public semantic field identification information;
and the retrieval module is used for retrieving the data to be retrieved according to the identification field information and the semantic field information of each data table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211401420.1A CN115544024B (en) | 2022-11-09 | 2022-11-09 | Data processing method and device based on common semantic field |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211401420.1A CN115544024B (en) | 2022-11-09 | 2022-11-09 | Data processing method and device based on common semantic field |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115544024A true CN115544024A (en) | 2022-12-30 |
| CN115544024B CN115544024B (en) | 2023-03-24 |
Family
ID=84720028
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211401420.1A Active CN115544024B (en) | 2022-11-09 | 2022-11-09 | Data processing method and device based on common semantic field |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115544024B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163319A1 (en) * | 2002-02-22 | 2003-08-28 | International Business Machines Corporation | Automatic selection of a disambiguation data field for a speech interface |
| CN102880720A (en) * | 2012-10-15 | 2013-01-16 | 刘超 | Management and semantic retrieval method for information resources |
| US10275292B1 (en) * | 2017-06-27 | 2019-04-30 | Northrup Grumman Systems Corporation | Shadow Java classes provide private metadata |
| US20200125541A1 (en) * | 2017-05-12 | 2020-04-23 | Bae Systems Plc | System for data storage and retrieval |
| CN111461157A (en) * | 2019-01-22 | 2020-07-28 | 大连理工大学 | Self-learning-based cross-modal Hash retrieval method |
| CN112948601A (en) * | 2021-02-02 | 2021-06-11 | 广东工业大学 | Cross-modal Hash retrieval method based on controlled semantic embedding |
| CN113536015A (en) * | 2021-07-02 | 2021-10-22 | 江南大学 | Cross-modal retrieval method based on depth identification migration |
| CN113704546A (en) * | 2021-08-23 | 2021-11-26 | 西安电子科技大学 | Video natural language text retrieval method based on space time sequence characteristics |
-
2022
- 2022-11-09 CN CN202211401420.1A patent/CN115544024B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163319A1 (en) * | 2002-02-22 | 2003-08-28 | International Business Machines Corporation | Automatic selection of a disambiguation data field for a speech interface |
| CN102880720A (en) * | 2012-10-15 | 2013-01-16 | 刘超 | Management and semantic retrieval method for information resources |
| US20200125541A1 (en) * | 2017-05-12 | 2020-04-23 | Bae Systems Plc | System for data storage and retrieval |
| US10275292B1 (en) * | 2017-06-27 | 2019-04-30 | Northrup Grumman Systems Corporation | Shadow Java classes provide private metadata |
| CN111461157A (en) * | 2019-01-22 | 2020-07-28 | 大连理工大学 | Self-learning-based cross-modal Hash retrieval method |
| CN112948601A (en) * | 2021-02-02 | 2021-06-11 | 广东工业大学 | Cross-modal Hash retrieval method based on controlled semantic embedding |
| CN113536015A (en) * | 2021-07-02 | 2021-10-22 | 江南大学 | Cross-modal retrieval method based on depth identification migration |
| CN113704546A (en) * | 2021-08-23 | 2021-11-26 | 西安电子科技大学 | Video natural language text retrieval method based on space time sequence characteristics |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115544024B (en) | 2023-03-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7460149B1 (en) | Video data storage, search, and retrieval using meta-data and attribute data in a video surveillance system | |
| CN102244774B (en) | There is the surveillance of immediate data storehouse service memory | |
| JP5452030B2 (en) | Integrated log generation device, integrated log generation program, and recording medium | |
| CN103248853A (en) | Method, equipment and system for achieving video retrieval | |
| CN100514379C (en) | Intelligent monitoring dynamic alarm system of anti-technical net | |
| KR100518724B1 (en) | Methods for constructing multimedia database and providing multimedia-search service and apparatus therefor | |
| US11783242B2 (en) | Asset management and work order application synchronization for intelligent lockers | |
| CN103488793A (en) | User behavior monitoring method based on information retrieval | |
| US10078624B2 (en) | Method of generating hierarchical data structure | |
| CN111638908A (en) | Interface document generation method and device, electronic equipment and medium | |
| CN112487150A (en) | File management method, system, storage medium and electronic equipment | |
| US20210350141A1 (en) | Systems and methods for creating a story board with forensic video analysis on a video repository | |
| CN115757689A (en) | Information query system, method and equipment | |
| US11475031B2 (en) | Identification and compiling of information relating to an entity | |
| US9747328B2 (en) | Method and apparatus for modifying a row in a database table to include meta-data | |
| CN115544024B (en) | Data processing method and device based on common semantic field | |
| CN109960946B (en) | Block chain-based data heat determination method, device, equipment and medium | |
| US20130290245A1 (en) | Database history management method and system thereof | |
| TW202011231A (en) | Data analysis method and data analysis system thereof | |
| CN113761322B (en) | Data query method, system, electronic device and storage medium | |
| CN115309938A (en) | Method and system for analyzing and mining supervision and law enforcement big data | |
| JP4810113B2 (en) | Database tuning apparatus, database tuning method, and program | |
| CN105096228A (en) | Video image information processing method and apparatus | |
| US20090265311A1 (en) | Intellectual Property Subscribe And Publish Notification Service | |
| JP3478558B2 (en) | Object storage search method in database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |