CN111026936B - Data cognition method, device, terminal and computer storage medium of interaction theme - Google Patents
Data cognition method, device, terminal and computer storage medium of interaction theme Download PDFInfo
- Publication number
- CN111026936B CN111026936B CN201911321838.XA CN201911321838A CN111026936B CN 111026936 B CN111026936 B CN 111026936B CN 201911321838 A CN201911321838 A CN 201911321838A CN 111026936 B CN111026936 B CN 111026936B
- Authority
- CN
- China
- Prior art keywords
- data
- metadata
- resource
- data resource
- query request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 56
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000019771 cognition Effects 0.000 title claims abstract description 37
- 239000012634 fragment Substances 0.000 claims description 13
- 230000002452 interceptive effect Effects 0.000 claims description 9
- 238000013467 fragmentation Methods 0.000 claims description 7
- 238000006062 fragmentation reaction Methods 0.000 claims description 7
- 238000013507 mapping Methods 0.000 claims description 6
- 238000012216 screening Methods 0.000 claims 2
- 230000008520 organization Effects 0.000 abstract description 4
- 238000004891 communication Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 6
- 238000011161 development Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 238000013499 data model Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/90335—Query processing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Library & Information Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data cognition method, a device, a terminal and a computer storage medium of an interaction theme, wherein the data cognition method of the interaction theme comprises the following steps: receiving a data access request sent by an application terminal, and generating a metadata query request according to the data access request; sending the metadata query request to a metadata server to obtain a metadata resource index corresponding to the metadata query request; and based on the metadata resource index, acquiring data resource information corresponding to the metadata query request stored by a data resource server, and sending the data resource information to an application end, wherein when the definition of the data by the functional components of the two parties is inconsistent, the organization, management, discovery, sharing and application of the resources of the two parties can be performed.
Description
Technical Field
The present invention relates to the field of data interaction, and in particular, to a method, an apparatus, a terminal, and a computer storage medium for cognizing data of an interaction theme.
Background
With the rapid development of information processing technology and the continuous expansion of application fields, particularly the rapid popularization of the internet and the gradual development of informationized construction, the number of network information resources is exponentially increased, and meanwhile, for the safety of the network information resources and the high interaction efficiency between the network information resources, the network information resources are stored in a scattered manner according to specific attributes, however, because a large amount of information resources are stored in a scattered environment and the data model, the data structure, the storage environment and the like of the information resources are different, the inquiry of the information resources is difficult, and therefore, metadata are adopted to define the data information of data.
However, since the conventional information interaction manner between the functional components is that the interfaces are interacted by the two parties, if the definitions of the theme data used by the two parties are inconsistent, the conventional manner cannot be relied on to analyze, and the interaction between the functional components cannot be performed.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present invention and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The invention mainly aims to provide a data cognition method, device, terminal and computer storage medium of an interaction theme, and aims to solve the technical problem that information interaction cannot be performed between functional components between two parties when definition of theme data used by the two parties of information interaction is inconsistent at present.
In order to achieve the above object, the present invention provides a data cognition method of an interaction theme, which is applied to a data access proxy server, and the data cognition method of the interaction theme includes the following steps:
receiving a data access request sent by an application terminal, and generating a metadata query request according to the data access request;
sending the metadata query request to a metadata server to obtain a metadata resource index corresponding to the metadata query request;
and acquiring data resource information corresponding to the metadata query request stored by a data resource server based on the metadata resource index, and sending the data resource information to an application terminal.
Preferably, the metadata query request is decomposed into a plurality of sub-logical query requests based on the metadata resource index;
and sending the plurality of sub-logic query requests to the data resource server to acquire data resource information corresponding to the metadata query requests.
Preferably, domain information and/or fragment information of the data resource are acquired based on the metadata resource index;
and decomposing the metadata query request into a plurality of sub-logic requests according to the domain information and/or the fragmentation information of the data resource.
Preferably, the plurality of logic sub-query requests are sent to a plurality of storage nodes corresponding to the plurality of logic sub-query requests, so as to obtain sub-data resource information sets stored by the plurality of storage nodes;
and acquiring the data resource information corresponding to the sub data resource information set based on the query optimizer.
Preferably, judging whether the data resource is located in different domains and/or different slices according to the domain information and/or the slice information of the data resource;
if the data resources are located in different domains, and/or different pieces, the metadata query request is broken down into a number of sub-logical requests.
Preferably, metadata and/or data element items corresponding to the data resources are acquired;
and mapping the data element items with the metadata to obtain metadata resource indexes corresponding to the target data.
Preferably, according to the metadata resource index, the data resource domains and/or fragments are stored in storage nodes corresponding to the data resource server.
In addition, in order to achieve the above object, the present invention further provides a data cognition device for an interaction theme, where the data cognition device for an interaction theme includes:
the receiving module is used for receiving a data access request sent by an application terminal and generating a metadata query request according to the data access request;
the sending module is used for sending the metadata query request to a metadata server so as to obtain a metadata resource index corresponding to the metadata query request;
and the acquisition module is used for acquiring the data resource information corresponding to the metadata query request stored by the data resource server based on the metadata resource index and sending the data resource information to an application terminal.
Preferably, the acquisition module is further configured to,
decomposing the metadata query request into a plurality of sub-logic query requests based on the metadata resource index;
and sending the plurality of sub-logic query requests to the data resource server to acquire data resource information corresponding to the metadata query requests.
Preferably, the acquisition module is further configured to,
acquiring domain information and/or fragment information of a data resource based on the metadata resource index;
and decomposing the metadata query request into a plurality of sub-logic requests according to the domain information and/or the fragmentation information of the data resource.
Preferably, the acquisition module is further configured to,
the logic sub-query requests are sent to a plurality of storage nodes corresponding to the logic sub-query requests, so that a sub-data resource information set stored by the storage nodes is obtained;
and acquiring the data resource information corresponding to the sub data resource information set based on the query optimizer.
Preferably, the acquisition module is further configured to,
judging whether the data resource is positioned in different domains and/or different slices according to the domain information and/or the slice information of the data resource;
if the data resources are located in different domains, and/or different pieces, the metadata query request is broken down into a number of sub-logical requests.
Preferably, the acquisition module is further configured to,
acquiring metadata and/or data element items corresponding to the data resources;
and mapping the data element items with the metadata to obtain metadata resource indexes corresponding to the target data.
Preferably, the acquisition module is further configured to,
and according to the metadata resource index, storing the data resource domain and/or the fragment in a storage node corresponding to the data resource server.
In addition, to achieve the above object, the present invention also provides a terminal including: the system comprises a memory, a processor and a data cognition program of an interaction theme, wherein the data cognition program of the interaction theme is stored in the memory and can run on the processor, and the data cognition program of the interaction theme realizes the steps of the data cognition method of the interaction theme when being executed by the processor.
In addition, in order to achieve the above object, the present invention further provides a computer storage medium, on which a data cognition program of an interaction theme is stored, which when executed by a processor, implements the steps of the data cognition method of an interaction theme described above.
According to the method, the device and the system, the data access request sent by the application end is received, the metadata query request is generated according to the data access request, then the metadata query request is sent to the metadata server to obtain the metadata resource index corresponding to the metadata query request, finally the data resource information corresponding to the metadata query request stored by the data resource server is obtained based on the metadata resource index, the data resource information is sent to the application end, and when the definition of the data by the functional components of the two parties is inconsistent, the organization, management, discovery, sharing and application of the resources of the two parties can be performed.
Drawings
FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart of a first embodiment of a data cognition method of the interactive theme of the present invention;
FIG. 3 is a schematic view of a scenario of an embodiment of a data cognition method of the interactive subject of the present invention;
fig. 4 is a schematic diagram of another scenario of an embodiment of a data cognition method of the interactive subject matter of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, fig. 1 is a schematic diagram of a terminal structure of a hardware running environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention can be a PC, a mobile terminal device with the data cognition function of the interaction subject, such as a smart phone, a tablet personal computer and the like.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the terminal structure shown in fig. 1 is not limiting of the terminal and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a data recognition program of an interaction subject may be included in a memory 1005, which is a computer storage medium.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be used to invoke a data aware program of the interaction topic stored in the memory 1005.
In this embodiment, the data cognition device of the interaction theme includes: the system comprises a memory 1005, a processor 1001 and a data cognition program of an interaction theme stored in the memory 1005 and capable of running on the processor 1001, wherein when the processor 1001 calls the data cognition program of the interaction theme stored in the memory 1005, the following operations are executed:
receiving a data access request sent by an application terminal, and generating a metadata query request according to the data access request;
sending the metadata query request to a metadata server to obtain a metadata resource index corresponding to the metadata query request;
and acquiring data resource information corresponding to the metadata query request stored by a data resource server based on the metadata resource index, and sending the data resource information to an application terminal.
Further, the processor 1001 may call the data aware program of the interaction topic stored in the memory 1005, and further perform the following operations:
decomposing the metadata query request into a plurality of sub-logic query requests based on the metadata resource index;
and sending the plurality of sub-logic query requests to the data resource server to acquire data resource information corresponding to the metadata query requests.
Further, the processor 1001 may call the data aware program of the interaction topic stored in the memory 1005, and further perform the following operations:
acquiring domain information and/or fragment information of a data resource based on the metadata resource index;
and decomposing the metadata query request into a plurality of sub-logic requests according to the domain information and/or the fragmentation information of the data resource.
Further, the processor 1001 may call the data aware program of the interaction topic stored in the memory 1005, and further perform the following operations:
the logic sub-query requests are sent to a plurality of storage nodes corresponding to the logic sub-query requests, so that a sub-data resource information set stored by the storage nodes is obtained;
and acquiring the data resource information corresponding to the sub data resource information set based on the query optimizer.
Further, the processor 1001 may call the data aware program of the interaction topic stored in the memory 1005, and further perform the following operations:
judging whether the data resource is positioned in different domains and/or different slices according to the domain information and/or the slice information of the data resource;
if the data resources are located in different domains, and/or different pieces, the metadata query request is broken down into a number of sub-logical requests.
Further, the processor 1001 may call the data aware program of the interaction topic stored in the memory 1005, and further perform the following operations:
acquiring metadata and/or data element items corresponding to the data resources;
and mapping the data element items with the metadata to obtain metadata resource indexes corresponding to the target data.
Further, the processor 1001 may call the data aware program of the interaction topic stored in the memory 1005, and further perform the following operations:
and according to the metadata resource index, storing the data resource domain and/or the fragment in a storage node corresponding to the data resource server.
The invention further provides a data cognition method of the interaction theme, and referring to fig. 2, fig. 2 is a flow chart of a first embodiment of the data cognition method of the interaction theme.
Step S10, receiving a data access request sent by an application terminal, and generating a metadata query request according to the data access request;
in this embodiment, the data access proxy server corresponds to an intermediate medium between the application end and the metadata server, and it can be understood that, due to the rapid development of the information processing technology and the continuous expansion of the application field, especially the rapid popularization of the internet and the gradual development of informatization construction, the number of network information resources is exponentially increased, and meanwhile, for the safety of the network information resources and the high efficiency of interaction between the network information resources, the network information resources are stored in a scattered manner according to their specific attributes, however, due to the fact that a large number of information resources are stored in a scattered environment, and the differences of the data model, the data structure, the storage environment and the like, the query of the information resources has a plurality of difficulties, so that metadata are adopted to define the data information of the data, specifically, the metadata is a description of the structured code of the information object, and describes the information object itself and various features related to the information object. Metadata sets up a bridge between users and data, and enables users to find, identify, select and acquire information objects, and at the same time enables information managers to better manage information objects and effectively control access thereto. Metadata can be considered as a data set that records, in standardized sets, three aspect descriptions of information object content, context, structure, etc.
However, since the conventional manner of information interaction between the functional components is that the interfaces are interacted by the two parties, as shown in fig. 3, in particular, in a scene of an embodiment of the method of the present invention, as shown in fig. 3, the specific definition content of the theme data is clear between the functional components, when the functional component 1 of the publisher includes TRK-NUM, ID, LAT, LON, ALT, and correspondingly, the subscriber also includes TRK-NUM, ID, LAT, LON, ALT, so that the processing is implemented by parsing, if the definitions of the theme data used by the two parties are inconsistent, the interaction between the functional components cannot be performed by the conventional manner, as shown in fig. 4, in the scene of an embodiment of the method of the present invention, as shown in fig. 4, when the functional component 1 of the publisher includes TRK-NUM, ID, LAT, LON, ALT, if the functional component 2 of the subscriber includes LAT, LON, ALT, TRK-NUM and ID, the definition of the theme data used by the two parties is inconsistent, the interaction between the functional components cannot be performed by the conventional manner.
It can be understood that, in the embodiment of the present invention, in order to solve the problem that the definition of the theme data used by the two parties is inconsistent and cannot be resolved by a conventional manner, the functional components cannot interact with each other, and a data access proxy server is adopted as an intermediate medium between an application end, a metadata server and a data resource server, specifically, the data access proxy server receives a data access request sent by the application end, and generates a corresponding metadata query request according to the data access request.
Specifically, generating a corresponding metadata query request according to the data access request includes acquiring target data corresponding to the data access request, then acquiring metadata corresponding to the target data, and generating a metadata query request. It can be understood that after receiving a data access request sent by an application end, the data access agent acquires target data corresponding to the data access request and acquires metadata information corresponding to the target data, where it can be understood that each piece of data is associated with one piece of metadata, where the metadata is characteristic data information of the data, that is, a data set of three aspect feature descriptions including information object content, background, structure and the like is recorded in a standardized set form, and then after acquiring the metadata corresponding to the target data, a corresponding metadata query request is generated.
Step S20, the metadata query request is sent to a metadata server to obtain a metadata resource index corresponding to the metadata query request;
in this embodiment, after the data access proxy server generates a corresponding metadata query request according to the data access request, the metadata query request is sent to the metadata server, so as to obtain a metadata resource index corresponding to the data query request sent by the metadata server. Specifically, after receiving a data access request sent by an application end, the data access proxy server converts the data access proxy to obtain a corresponding data query request, then the data access proxy sends a metadata query request to a metadata server, and the metadata server obtains a metadata resource index corresponding to the metadata query request after receiving the metadata query request.
Step S30, based on the metadata resource index, obtaining the data resource information corresponding to the metadata query request stored by the data resource server, and sending the data resource information to an application end.
In this embodiment, after acquiring the metadata resource index corresponding to the metadata query request, the data access proxy server then determines the domain and slice status of the data resource and the distribution of the data resource among the storage nodes according to the resource index, and performs search and query of the data resource to acquire the data resource information corresponding to the data query request.
In this embodiment, after the data access proxy server obtains the data resource information, the data resource information is sent to the application end, and further, in the embodiment of the present invention, metadata with a unified structure is adopted in the information management system of the metadata server to describe information attributes most basically, and all metadata is registered in a unified metadata directory, where the metadata directory is a hierarchical and distributed directory structure system, and can well interact and fuse with a metadata model of the application end and a description method of the application end, so as to implement unified description and unified management of the data resource, and improve transparency degree of resource management and use.
Further, before step S30, further comprising,
step S301, metadata and/or data element items corresponding to the data resources are obtained;
step S302, mapping the data element item and the metadata to obtain a metadata resource index corresponding to the target data.
In this step, it can be understood that the data resource is associated with one and/or several metadata correspondingly, and the data resource is provided with corresponding element items correspondingly, specifically, the functional component completes the registration work of the theme, data and metadata in the system, through the maintenance of the data service of the system, the system is pushed to plug and play of the functional component in the data layer, the ID allocation and the corresponding maintenance of the theme data are carried out on the functional component in the system, and the processing of the data resource is realized on the basis of the maintenance of the theme data. Firstly, metadata and/or data element items corresponding to data resources are obtained, wherein the data element items refer to attributes of data, specifically, such as TRK_ NUM, ID, LAT and the like, then the data element items and the metadata are mapped, wherein metadata directory service provides support for the use of the metadata, then basic functions of inserting, updating, deleting, inquiring, filtering, authorizing and the like of the metadata are realized, and finally, the data discovery, the query according to the attributes, the data mining and the like can be provided on the basis.
Further, after step S302, further includes,
step S303, according to the metadata resource index, storing the target data domain and/or the fragment in a storage node corresponding to the data resource server.
In this step, it can be understood that, for the security of the network information resource and the efficient interaction between the network information resources, the network information resources are stored in a scattered manner according to their specific attributes, and specifically, according to a preset storage rule, metadata fields and/or fragments are stored in storage nodes corresponding to the metadata servers.
According to the data cognition method of the interaction theme provided by the embodiment, a data access request sent by an application end is received, a metadata query request is generated according to the data access request, then the metadata query request is sent to a metadata server to obtain a metadata resource index corresponding to the metadata query request, finally data resource information corresponding to the metadata query request stored by the data resource server is obtained based on the metadata resource index, the data resource information is sent to the application end, and when definition of data by the functional components of the two parties is inconsistent, organization, management, discovery, sharing and application of the resources of the two parties can be performed.
Based on the first embodiment, a second embodiment of the data cognition method of the interaction subject of the present invention is presented, in which step S30 comprises,
step S31, decomposing the metadata query request into a plurality of sub-logic query requests based on the metadata resource index;
step S32, transmitting the plurality of sub-logic query requests to the data resource server to obtain data resource information corresponding to the metadata query request.
In this embodiment, after receiving the metadata resource index sent by the metadata server, the data access proxy server decomposes the metadata query request into a plurality of sub-logic query requests according to the metadata resource index, specifically, determines the domain and the segment status of the data resource and the distribution of the data resource among the storage nodes according to the metadata resource index, so as to decompose the metadata query request into a plurality of sub-logic query requests, and then sends the plurality of sub-logic query requests to the data resource server to obtain the data resource information corresponding to the metadata query request.
Specifically, the step S31 further includes,
step S33, obtaining domain information and/or fragment information of the data resource based on the metadata resource index;
and step S34, decomposing the metadata query request into a plurality of sub-logic requests according to the domain information and/or the fragmentation information of the data resource.
In this step, it may be understood that, after receiving the metadata resource index sent by the metadata server, the data access proxy server parses the metadata resource index to obtain data resource domain information and/or fragment information and/or distribution information of the data resource in the storage node, then decomposes the metadata query request into a corresponding plurality of logic sub-queries according to the data resource domain information and/or fragment information and/or the distribution information of the data resource in the storage node, and sends the plurality of logic sub-queries to the metadata server to obtain the data resource information.
Specifically, the step S32 further includes,
step S35, the logic sub-query requests are sent to a plurality of storage nodes corresponding to the logic sub-query requests, so as to obtain sub-data resource information sets stored by the storage nodes;
step S36, based on the query optimizer, the data resource information corresponding to the sub data resource information set is obtained.
In this step, it can be understood that, for the security of the network information resource and the high interaction efficiency between the network information resources, the network information resources are stored in a decentralized manner according to their specific attributes, that is, the data resources are stored in a plurality of storage nodes of the metadata server according to the data attributes, so that after the data access proxy server decomposes the metadata query request into a plurality of corresponding logic sub-queries according to the data resource domain information and/or the fragmentation information and/or the distribution information of the storage nodes, the plurality of logic sub-queries are sent to the data resource server, that is, the plurality of logic sub-queries are sent to a plurality of storage nodes corresponding to the data resource server, so as to obtain a sub-data resource information set corresponding to the plurality of logic sub-queries according to the plurality of storage nodes, the logic sub-queries are in one-to-one correspondence with the storage nodes, then data resource information corresponding to the sub-data resource information sets integrated based on the query optimizer is obtained, namely the storage nodes return a plurality of sub-data resource information query results corresponding to the logic sub-queries, then the sub-data resource information query results are combined based on the query optimizer to obtain data resource information, finally the query optimizer returns the data resource information to the data access proxy server, wherein the query optimizer can be located in the data resource server, namely the storage nodes in the data resource server return the corresponding sub-data resource information to the query optimizer of the data resource server, then the sub-data resource information is screened and integrated based on the query optimizer to obtain the data resource information, and the data resource information is returned to the data access proxy server, optionally, the query optimizer may be located in the data access proxy server, that is, a plurality of storage nodes in the data resource server return corresponding plurality of sub-data resource information to the query optimizer of the data access proxy server, and then the plurality of sub-data resource information is screened and integrated based on the query optimizer to obtain the data resource information.
Further, before step S32, further comprising,
step S37, judging whether the data resource is positioned in different domains and/or different slices according to the domain information and/or the slice information of the data resource;
in step S38, if the data resources are located in different domains and/or different slices, the metadata query request is decomposed into a plurality of sub-logic requests.
In the step, after the domain information and/or the slice information of the data resource and/or the distribution information of the storage node are obtained, whether the data resource is located in different domains and/or different slices is judged according to the domain information and/or the slice information of the data resource and/or the distribution information of the storage node, and if the data resource is located in different domains and/or different slices, the metadata query request is decomposed into a plurality of sub-logic requests.
According to the data cognition method of the interaction subject provided by the embodiment, the metadata query request is decomposed into a plurality of sub-logic query requests based on the metadata resource index, and then the plurality of sub-logic query requests are sent to the data resource server to obtain the data resource information corresponding to the metadata query requests, so that when the definition of the data by the functional components of the two parties is inconsistent, the organization, management, discovery, sharing and application of the resources of the two parties can be performed.
In addition, the embodiment of the invention also provides a data cognition device of the interaction theme, which comprises:
the receiving module is used for receiving a data access request sent by an application terminal and generating a metadata query request according to the data access request;
the sending module is used for sending the metadata query request to a metadata server so as to obtain a metadata resource index corresponding to the metadata query request;
and the acquisition module is used for acquiring the data resource information corresponding to the metadata query request stored by the data resource server based on the metadata resource index and sending the data resource information to an application terminal.
The modules of the data cognition device of the interaction theme are executed by the processor to realize the steps of the data cognition method embodiment of the interaction theme.
In addition, the embodiment of the invention also provides a computer storage medium, wherein the computer storage medium is stored with a data cognition program of the interaction theme, and the data cognition program of the interaction theme realizes the steps of the embodiment of the data cognition method of the interaction theme when being executed by a processor.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (8)
1. The data cognition method of the interaction theme is characterized by comprising the following steps of:
receiving a data access request sent by an application terminal, and generating a metadata query request according to the data access request;
sending the metadata query request to a metadata server to obtain a metadata resource index corresponding to the metadata query request;
acquiring data resource information corresponding to the metadata query request stored by a data resource server based on the metadata resource index, and sending the data resource information to an application terminal;
the step of obtaining the data resource information corresponding to the metadata query request stored by the data resource server based on the metadata resource index includes:
the data resource server comprises a storage node;
decomposing the metadata query request into a plurality of sub-logic query requests based on the metadata resource index;
the plurality of sub-logic query requests are sent to a plurality of storage nodes corresponding to the plurality of sub-logic query requests, so that a sub-data resource information set stored by the plurality of storage nodes is obtained;
and screening and integrating the sub-data resource information sets stored by the storage nodes based on a query optimizer, and acquiring data resource information corresponding to the metadata query request, wherein the query optimizer is positioned in the data resource server.
2. The data cognition method of interactive topics according to claim 1, wherein the step of decomposing the metadata query request into a number of sub-logical queries based on the metadata resource index comprises:
acquiring domain information and/or fragment information of a data resource based on the metadata resource index;
and decomposing the metadata query request into a plurality of sub-logic requests according to the domain information and/or the fragmentation information of the data resource.
3. The method for learning data of an interactive topic according to claim 2, wherein the step of decomposing the metadata query request into a plurality of sub-logical requests according to domain information and/or fragmentation information of the data resource comprises:
judging whether the data resource is positioned in different domains and/or different slices according to the domain information and/or the slice information of the data resource;
if the data resources are located in different domains, and/or different pieces, the metadata query request is broken down into a number of sub-logical requests.
4. The method for learning data of an interactive theme according to claim 3, wherein before the step of acquiring the data resource information corresponding to the metadata query request stored in the data resource server based on the metadata resource index, the method further comprises:
acquiring metadata and/or data element items corresponding to the data resources;
and mapping the data element items with the metadata to obtain metadata resource indexes corresponding to the data resources.
5. The method for learning data of an interactive theme according to any one of claims 1 to 4, wherein after the step of mapping the data element item with the metadata to obtain a metadata resource index corresponding to the data resource, the method further comprises:
and according to the metadata resource index, storing the data resource domain and/or the fragment in a storage node corresponding to the data resource server.
6. A data cognition device for an interactive theme, wherein the data cognition device for an interactive theme comprises:
the receiving module is used for receiving a data access request sent by an application terminal and generating a metadata query request according to the data access request;
the sending module is used for sending the metadata query request to a metadata server so as to obtain a metadata resource index corresponding to the metadata query request;
the acquisition module is used for acquiring data resource information corresponding to the metadata query request stored by the data resource server based on the metadata resource index and sending the data resource information to an application terminal;
wherein, the acquisition module is further configured to:
the data resource server comprises a storage node;
decomposing the metadata query request into a plurality of sub-logic query requests based on the metadata resource index;
the plurality of sub-logic query requests are sent to a plurality of storage nodes corresponding to the plurality of sub-logic query requests, so that a sub-data resource information set stored by the plurality of storage nodes is obtained;
and screening and integrating the sub-data resource information sets stored by the storage nodes based on a query optimizer, and acquiring data resource information corresponding to the metadata query request, wherein the query optimizer is positioned in the data resource server.
7. A terminal, the terminal comprising: memory, a processor and a data-aware program of interaction topics stored on the memory and executable on the processor, which when executed by the processor, implement the steps of the data-aware method of interaction topics of any one of claims 1 to 5.
8. A computer storage medium, wherein a data-aware program of an interaction topic is stored on the computer storage medium, which when executed by a processor, implements the steps of the data-aware method of an interaction topic of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911321838.XA CN111026936B (en) | 2019-12-18 | 2019-12-18 | Data cognition method, device, terminal and computer storage medium of interaction theme |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911321838.XA CN111026936B (en) | 2019-12-18 | 2019-12-18 | Data cognition method, device, terminal and computer storage medium of interaction theme |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111026936A CN111026936A (en) | 2020-04-17 |
| CN111026936B true CN111026936B (en) | 2023-10-20 |
Family
ID=70212311
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911321838.XA Active CN111026936B (en) | 2019-12-18 | 2019-12-18 | Data cognition method, device, terminal and computer storage medium of interaction theme |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111026936B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104731516A (en) * | 2013-12-18 | 2015-06-24 | 腾讯科技（深圳）有限公司 | Method and device for accessing files and distributed storage system |
| WO2016086552A1 (en) * | 2014-12-04 | 2016-06-09 | 中兴通讯股份有限公司 | File processing method and client |
| CN108108456A (en) * | 2017-12-28 | 2018-06-01 | 重庆邮电大学 | A kind of information resources distributed enquiring method based on metadata |
| CN110046133A (en) * | 2019-04-12 | 2019-07-23 | 苏州浪潮智能科技有限公司 | A kind of metadata management method, the apparatus and system of storage file system |
| CN110309334A (en) * | 2018-04-20 | 2019-10-08 | 腾讯科技（深圳）有限公司 | Querying method, system, computer equipment and the readable storage medium storing program for executing of chart database |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9411890B2 (en) * | 2012-04-04 | 2016-08-09 | Google Inc. | Graph-based search queries using web content metadata |
-
2019
- 2019-12-18 CN CN201911321838.XA patent/CN111026936B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104731516A (en) * | 2013-12-18 | 2015-06-24 | 腾讯科技（深圳）有限公司 | Method and device for accessing files and distributed storage system |
| WO2016086552A1 (en) * | 2014-12-04 | 2016-06-09 | 中兴通讯股份有限公司 | File processing method and client |
| CN108108456A (en) * | 2017-12-28 | 2018-06-01 | 重庆邮电大学 | A kind of information resources distributed enquiring method based on metadata |
| CN110309334A (en) * | 2018-04-20 | 2019-10-08 | 腾讯科技（深圳）有限公司 | Querying method, system, computer equipment and the readable storage medium storing program for executing of chart database |
| CN110046133A (en) * | 2019-04-12 | 2019-07-23 | 苏州浪潮智能科技有限公司 | A kind of metadata management method, the apparatus and system of storage file system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111026936A (en) | 2020-04-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9686374B2 (en) | System and method for fragment level dynamic content regeneration | |
| EP2548138B1 (en) | Computer relational database method and system having role based access control | |
| US20190163715A1 (en) | System and method for the dynamic provisioning of static content | |
| US7089246B1 (en) | Overriding content ratings and restricting access to requested resources | |
| US20110276598A1 (en) | System for and method of providing reusable software service information based on natural language queries | |
| CA2858986A1 (en) | Entity identification based on proximity to access points | |
| US8589589B2 (en) | Method and system for creating an overlay structure for management information bases | |
| CN109040300A (en) | The method, apparatus and storage medium of PUSH message | |
| CN112104617A (en) | Authority management method, device, equipment and storage medium of microservice | |
| CN105871919A (en) | Network application firewall system and realization method thereof | |
| US11882154B2 (en) | Template representation of security resources | |
| CN113127906A (en) | Unified authority management platform, method and storage medium based on C/S architecture | |
| CN103067398A (en) | Method and equipment for achieving third-party application accessing user data | |
| CN111026936B (en) | Data cognition method, device, terminal and computer storage medium of interaction theme | |
| KR100931688B1 (en) | Method and system for providing group communication service using group identifier | |
| CN113742369A (en) | Data authority management method, system and storage medium | |
| US10657155B2 (en) | Device for processing large-scale data streams | |
| US20210173729A1 (en) | Systems and methods of application program interface (api) parameter monitoring | |
| CN116450596B (en) | Digital object storage method, digital object storage device, electronic equipment and readable storage medium | |
| CN115714689B (en) | IAM-based UI resource access control method | |
| US20030233356A1 (en) | User interface for facilitating interaction between a user and an information system | |
| CN115828308B (en) | Data access method, data access device, electronic equipment and storage medium | |
| CN113420245B (en) | Page display method and system | |
| Grzejszczyk | Cloud computing as a tool in smart communication with a motor vehicle | |
| KR20100014088A (en) | System for storing and sharing partial data of web-page |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |