WO2024001113A1 - 图谱的确定方法和装置、存储介质及电子装置 - Google Patents

图谱的确定方法和装置、存储介质及电子装置 Download PDF

Info

Publication number
WO2024001113A1
WO2024001113A1 PCT/CN2022/141686 CN2022141686W WO2024001113A1 WO 2024001113 A1 WO2024001113 A1 WO 2024001113A1 CN 2022141686 W CN2022141686 W CN 2022141686W WO 2024001113 A1 WO2024001113 A1 WO 2024001113A1
Authority
WO
WIPO (PCT)
Prior art keywords
task
information
query
graph
knowledge graph
Prior art date
Application number
PCT/CN2022/141686
Other languages
English (en)
French (fr)
Inventor
邓邱伟
杨猛
张旭
翟建光
Original Assignee
青岛海尔科技有限公司
青岛海尔智能家电科技有限公司
海尔智家股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 青岛海尔科技有限公司, 青岛海尔智能家电科技有限公司, 海尔智家股份有限公司 filed Critical 青岛海尔科技有限公司
Publication of WO2024001113A1 publication Critical patent/WO2024001113A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/36Creation of semantic tools, e.g. ontology or thesauri
    • G06F16/367Ontology
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/3331Query processing
    • G06F16/334Query execution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/35Clustering; Classification
    • G06F16/358Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/40Transformation of program code
    • G06F8/41Compilation
    • G06F8/42Syntactic analysis
    • G06F8/427Parsing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/70Software maintenance or management
    • G06F8/71Version control; Configuration management

Definitions

  • the present disclosure relates to the field of smart homes, and specifically, to a method and device for determining a map, a storage medium and an electronic device.
  • Embodiments of the present disclosure provide a method and device for determining a map, a storage medium, and an electronic device, so as to at least solve the problem in the related art that fast data query cannot be performed on complex data link tasks.
  • a method for determining a graph including: obtaining metadata information corresponding to different tasks, wherein the metadata information includes at least one of the following: running information of the task, engineering dimensions of the task information; create a target node according to the metadata information; in the case of determining the logical relationship between the different tasks, use a preset pattern graph structure to connect the target nodes to obtain a graph containing different tasks; The map and the metadata information are packaged to obtain a task knowledge map.
  • a device for determining a graph including: an acquisition module configured to acquire metadata information corresponding to different tasks, wherein the metadata information includes at least one of the following: running of the task Information, engineering dimension information of tasks; a creation module, configured to create target nodes based on the metadata information; a connection module, configured to use a preset pattern diagram structure when determining the logical relationship between the different tasks.
  • the target nodes are connected to obtain a graph containing different tasks;
  • a packaging module is configured to package the graph and the metadata information to obtain a task knowledge graph.
  • a storage medium is also provided, and a computer program is stored in the storage medium, wherein the computer program is configured to execute the steps in any of the above method embodiments when running.
  • an electronic device including a memory and a processor.
  • a computer program is stored in the memory, and the processor is configured to run the computer program to perform any of the above. Steps in method embodiments.
  • metadata information corresponding to different tasks is obtained, where the metadata information includes at least one of the following: task running information, task engineering dimension information; creating target nodes based on metadata information; determining the distance between different tasks
  • the pattern graph structure corresponding to the graph is used to retain the complex task link relationships, so that the determined task knowledge graph can be used to quickly query the task corresponding data. Therefore, it can solve the problem of the inability to query the data link in the existing technology. Problems such as fast data query and complex tasks.
  • Figure 1 is a schematic diagram of the hardware environment of a method for determining a map according to an embodiment of the present disclosure
  • Figure 2 is a flow chart of a method for determining a map according to an embodiment of the present disclosure
  • Figure 3 is a sequence diagram of task metadata management according to an optional embodiment of the present disclosure.
  • Figure 4 is a structural block diagram of a device for determining a map according to an embodiment of the present disclosure
  • Figure 5 is a structural block diagram of another map determination device according to an embodiment of the present disclosure.
  • FIG. 6 is a structural block diagram of an electronic device according to an embodiment of the present disclosure.
  • a method for determining a map is provided.
  • the determination method of this map is widely used in whole-house intelligent digital control application scenarios such as smart home, smart home, smart home device ecology, and smart residence (Intelligence House) ecology.
  • the above method for determining the map can be applied to the hardware environment composed of the terminal device 102 and the server 104 as shown in FIG. 1 .
  • the server 104 is connected to the terminal device 102 through the network and can be used to provide services (such as application services, etc.) for the terminal or the client installed on the terminal.
  • the database can be set on the server or independently of the server, and is set to To provide data storage services for the server 104, cloud computing and/or edge computing services can be configured on the server or independently of the server, and are configured to provide data computing services for the server 104.
  • the above-mentioned network may include but is not limited to at least one of the following: wired network, wireless network.
  • the above-mentioned wired network may include but is not limited to at least one of the following: wide area network, metropolitan area network, and local area network.
  • the above-mentioned wireless network may include at least one of the following: WIFI (Wireless Fidelity, Wireless Fidelity), Bluetooth.
  • the terminal device 102 may be, but is not limited to, a PC, a mobile phone, a tablet, a smart air conditioner, a smart hood, a smart refrigerator, a smart oven, a smart stove, a smart washing machine, a smart water heater, a smart washing equipment, a smart dishwasher, or a smart projection device.
  • smart TV smart clothes drying rack, smart curtains, smart audio and video, smart sockets, smart audio, smart speakers, smart fresh air equipment, smart kitchen and bathroom equipment, smart bathroom equipment, smart sweeping robot, smart window cleaning robot, smart mopping robot, Smart air purification equipment, smart steamers, smart microwave ovens, smart kitchen appliances, smart purifiers, smart water dispensers, smart door locks, etc.
  • Figure 2 is a flow chart of a method for determining a spectrum according to an embodiment of the present disclosure. The process includes the following steps:
  • Step S202 Obtain metadata information corresponding to different tasks, where the metadata information includes at least one of the following: task running information, task engineering dimension information;
  • Step S204 create a target node according to the metadata information
  • a target node can be generated in the target application.
  • the target node records the task running status of a certain task at the current time and the content information of the task.
  • the task running status can be the status of the video being processed at this time, for example, 30% of the video data has been processed
  • the content information can be the data format of the processed video and the video name corresponding to the video, as mentioned above.
  • the contents are only examples and do not limit the above methods.
  • Step S206 When the logical relationship between the different tasks is determined, use the preset pattern graph structure to connect the target nodes to obtain a graph containing different tasks;
  • Step S208 Package the graph and the metadata information to obtain a task knowledge graph.
  • metadata information corresponding to different tasks is obtained, where the metadata information includes at least one of the following: task running information, task engineering dimension information; creating target nodes based on the metadata information; determining the distance between different tasks
  • the pattern graph structure corresponding to the graph is used to retain the complex task link relationships, so that the determined task knowledge graph can be used to quickly query the task corresponding data. Therefore, it can solve the problem of the inability to query the data link in the existing technology. Problems such as fast data query for complex tasks.
  • the knowledge graph of this task supports the query of multi-layer relationships, and the response speed can also be greatly improved compared to traditional databases.
  • Cooperating with the front end will form a timely query of tasks.
  • the ability to view links in real time makes the entire task network more conveniently presented on the front end, making it easier for development and operation and maintenance personnel to find problems in a timely manner.
  • a distributed data flow engine in order to improve the efficiency of obtaining metadata information corresponding to different tasks, can be set up to obtain metadata information, so that any metadata information can be executed in a data parallel and pipeline manner.
  • the data flow acquisition of data information enhances the efficiency of obtaining metadata information; and the automatic acquisition process can also be configured for the distributed data flow engine.
  • the distributed data flow engine starts the reading function, the distributed data flow engine is allowed to directly Collect metadata information corresponding to different tasks.
  • the above method further includes: storing the task knowledge graph in a database, and setting the Query portal; wherein, the query portal includes at least one of the following: task query portal, output table query portal, and application query portal; receive front-end query instructions through the query portal, and obtain information related to the task knowledge graph from the task knowledge graph. The data information matched by the above query command.
  • the task knowledge graph when the task knowledge graph is stored in the database, you can set the task query entry of the task knowledge graph; specifically, use the task node to associate tasks, workflow and other nodes to obtain the entire task link and run the node status and running time. You can also set the output table query entry of the task knowledge graph; specifically, use the output table node to associate tasks, workflow and other nodes to obtain the specific location and operation status of the output table in the entire task link; you can also set task knowledge
  • the application query entry of the graph specifically, use the application node to associate output tables, tasks, workflow and other nodes to obtain how many task links the upper-layer application has and the current running status and running time of each link; finally through Supports querying the task running status from three entrances, and can promptly discover the status of the node where the task runs for a long time, the node where the task runs fails, and the point at which the task runs. It is convenient for development, operation and maintenance, product and other personnel to query and discover the entire task link. problems, timely optimization and adjustment.
  • receiving a front-end query instruction through the query portal, and obtaining data information matching the query instruction from the task knowledge graph includes: receiving the query instruction at the task query portal In the case of , obtain the running status of different nodes in all task links in the task knowledge graph and the corresponding running time of each node in the different nodes, wherein the task knowledge graph includes data links corresponding to different tasks ; Generate a task running graph corresponding to the task knowledge graph based on the running status and the running time; use a preset status identifier to visually identify the task running graph in the task running graph, and run the identified task The graph is used as data information and the data information is sent to the visual display interface.
  • receiving a front-end query instruction through the query portal, and obtaining data information matching the query instruction from the task knowledge graph includes: receiving a query at the output table query portal In the case of instructions, determine the query information of the output table to be queried carried by the query instruction; determine the specific position of the current output table to be queried in all task links in the task knowledge graph and the current The operation status of the output table is to be queried; a visual output table is generated based on the specific location and the operation status, the visual output table is used as data information, and the data information is sent to the visual display interface.
  • receiving a front-end query instruction through the query portal, and obtaining data information matching the query instruction from the task knowledge graph includes: receiving the query instruction at the application query portal In the case of , determine the application requirement information corresponding to the query instruction; wherein the application requirement information is used to indicate obtaining link information corresponding to the application; determine in the task knowledge graph according to the application requirement information that all supported tasks are multiple target data links of the application, and determine the current operating status of each data link in the multiple target data links and the operating time of each data link in the multiple target data links, so
  • the target data link is a partial link in the task knowledge graph that contains data links corresponding to different tasks; using the multiple target data links and the current operation of each link in the multiple target data links
  • the situation and the running time of each link among the multiple target data links are used to construct an application support map, the application support map is used as data information, and the data information is sent to a visual display interface.
  • the above method further includes: obtaining update information corresponding to the metadata information of the target node; parsing the update information to obtain the attributes to be updated;
  • the attribute information to be updated is used to modify the attribute information of the target node, where the attribute information is used to describe the target node.
  • the above method further includes : Obtain the current running time and current running result corresponding to the target node; when the current running time is greater than the preset threshold, determine that the target node is an ultra-long node, and in the map, it is the ultra-long node. Node setting optimization strategy; when the current running result indicates that the task operation fails, prompt information is generated, where the prompt information is used to indicate that the target node in the current graph is an invalid node.
  • Task metadata management based on knowledge graph associates task metadata under the powerful computing power and graph structure relationship of the graph. Come out to form a huge task network to improve retrieval and management capabilities. That is, in view of the intricacies of the links, the entire task link relationship is written into the graph to form a task knowledge graph. With the support of the graph structure, the complex relationships will be retained, and the query of multi-layer relationships will be supported, and the response speed will be improved. It can also be greatly improved. Cooperating with the front end will form the ability to query tasks in real time and view task links in real time.
  • f ink (equivalent to the distributed data flow engine in the embodiment) captures the task metadata database binlog in real time, and writes the obtained results into the library in real time.
  • entities and relationships are called to create logical scripts to complete the creation of graph structures, and the task metadata is formed into a graph network to facilitate front-end calls to obtain the operation status of task links and the relationships between multiple links of tasks.
  • the entire task network is more conveniently presented on the front end, making it easier for development and operation and maintenance personnel to find problems in time and understand the location of task running.
  • FIG. 3 is a sequence diagram of task metadata management according to an optional embodiment of the present disclosure; including the following steps:
  • Step 1 The management object (actor) starts the program (flink);
  • the flink cluster calls the task running log table in the AZK configuration library in the data server; specifically includes: Flink-CDC task running information: using CDC monitoring Binlog to collect the running status of the task; Flink-Jdbc project dimension information: using Flink-Jdbc connects to the database to obtain the dimension information of the project corresponding to the task, mainly obtaining the project description information;
  • Step 2.2 The AZK configuration library returns the running status of the task in real time
  • Step 2.3 The flink cluster periodically requests project metadata
  • Step 2.4 return project metadata
  • Step 3.5 Create new nodes and update node-relationship status according to logical judgment; that is, construct the task knowledge graph: according to the graph mode, create entity relationships and complete the network of task links; according to the capture status of task metadata, timely Update the entity attribute information of the map;
  • Step 3.6 Regularly update the relationship of each node to the Neo4j graph database
  • Step 4.1 The graph database runs status data according to tasks; optionally, the task query entry of the task knowledge graph is run in the following way: using task nodes, associate tasks, workflow and other nodes, obtain the entire task link, and run The node status and running time.
  • Step 4.2 The graph database runs status data according to the output table; optionally, the output table query entry of the task knowledge graph is run as follows: using the output table node, associate tasks, workflows and other nodes to obtain the output table in the entire The specific location and operation status of the task link.
  • Step 4.3 The graph database runs status data according to the application; optionally, the application query entry of the task knowledge graph is run as follows: using the application node to associate the output table, task, workflow and other nodes to obtain the number of nodes owned by the upper-layer application. task links and the current running status and running time of each link.
  • Step 5 Visualize the results on the front end.
  • the knowledge graph as the storage medium and computing engine, use flink to read the task metadata database, obtain the task running metadata information, create entities and relationships according to the graph pattern diagram, write it into the library, and the initialization is completed After that, the entities and relationships are updated in an incremental form.
  • the map is stored, it is used by the front end according to three entrances: the task end, the output table end, and the application end. It supports development, operation and maintenance, product and other personnel to view and use through the front end. .
  • task metadata can also be obtained in real time to achieve incremental updates of the map.
  • the task metadata of the task link is extracted to form a task knowledge graph, and then the overall management of task metadata monitoring and use in the task link is carried out through the task knowledge graph, and further
  • problems occur in the task link they can be discovered in time, providing data support for finding optimization breakthrough points, etc.
  • It also provides real-time capabilities to improve the processing timeliness of the entire link to the sub-second level.
  • It realizes the formation of task metadata into a graph network, which facilitates front-end calls to obtain the operation status of task links and the relationship between multiple links of tasks.
  • the entire task network is more conveniently presented on the front end, making it easier for development and operation and maintenance personnel to find problems in time and understand the location of task running.
  • the method according to the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is Better implementation.
  • the technical solution of the present disclosure can be embodied in the form of a software product in essence or that contributes to the existing technology.
  • the computer software product is stored in a storage medium (such as ROM/RAM, disk, CD), including several instructions to cause a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to perform the determination of the map described in various embodiments of the present disclosure.
  • This embodiment also provides a device for determining a map, which is used to implement the above embodiments and preferred implementations. What has already been described will not be described again.
  • the term "module” may be a combination of software and/or hardware that implements a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
  • Figure 4 is a structural block diagram of a device for determining a map according to an embodiment of the present disclosure. As shown in Figure 4, the device includes:
  • the acquisition module 42 is configured to acquire metadata information corresponding to different tasks, wherein the metadata information includes at least one of the following: task running information, task engineering dimension information;
  • the creation module 44 is configured to create a target node according to the metadata information
  • connection module 46 is configured to use a preset pattern graph structure to connect the target nodes to obtain a graph containing different tasks when the logical relationship between the different tasks is determined;
  • the packaging module 48 is configured to package the graph and the metadata information to obtain a task knowledge graph.
  • metadata information corresponding to different tasks is obtained, where the metadata information includes at least one of the following: running information of the task, engineering dimension information of the task; creating a target node based on the metadata information; determining the distance between different tasks
  • the pattern graph structure corresponding to the graph is used to retain the complex task link relationships, so that the determined task knowledge graph can be used to quickly query the task corresponding data. Therefore, it can solve the problem of the inability to query the data link in the existing technology.
  • Figure 5 is a structural block diagram of another map determination device according to an embodiment of the present disclosure, which not only includes all modules in Figure 4 but also includes: an update module 52, an identification module 54, and a query module 56.
  • the above device further includes: a query module configured to store the task knowledge graph in a database and set a query entry for the task knowledge graph; wherein the query entry includes at least one of the following 1: Task query entrance, output table query entrance, and application query entrance; receive front-end query instructions through the query entrance, and obtain data information matching the query instructions from the task knowledge graph.
  • a query module configured to store the task knowledge graph in a database and set a query entry for the task knowledge graph; wherein the query entry includes at least one of the following 1: Task query entrance, output table query entrance, and application query entrance; receive front-end query instructions through the query entrance, and obtain data information matching the query instructions from the task knowledge graph.
  • the above query module is further configured to obtain the running status of different nodes in all task links in the task knowledge graph and the different status when the task query portal receives a query instruction.
  • the set status identifier visually identifies the task operation map in the task operation map, uses the identified task operation map as data information, and sends the data information to the visual display interface.
  • the above query module is further configured to determine the query information of the output table to be queried carried by the query command when the output table query portal receives a query instruction; according to the query information Determine the specific position of the current output table to be queried in all task links in the task knowledge graph and the operation status of the current output table to be queried; generate a visual output table based on the specific position and the operation status, and put all the The visual output table is used as data information, and the data information is sent to the visual display interface.
  • the above query module is further configured to determine the application requirement information corresponding to the query instruction when the application query portal receives the query instruction; wherein the application requirement information is used to indicate Obtain link information corresponding to the application; determine multiple target data links that support the application in the task knowledge graph according to the application requirement information, and determine each data link in the multiple target data links. The current operating status of the road and the running time of each data link among the multiple target data links.
  • the target data link is a partial link in the task knowledge graph that contains data links corresponding to different tasks; use The multiple target data links, the current operating status of each link in the multiple target data links, and the running time of each link in the multiple target data links construct an application support map, and all The application supports graphs as data information and sends the data information to a visual display interface.
  • the above device further includes: an update module configured to obtain update information corresponding to the metadata information of the target node; parse the update information to obtain the attributes to be updated; and use the attributes to be updated. Modify attribute information of the target node, where the attribute information is used to describe the target node.
  • the above device further includes: an identification module configured to obtain the current running time and current running results corresponding to the target node; in the case where the current running time is greater than a preset threshold, determine the The target node is an ultra-long node, and an optimization strategy is set for the ultra-long node in the graph; when the current running result indicates that the task fails, prompt information is generated, where the prompt information is used to indicate the The target node in the current graph is an invalid node.
  • an identification module configured to obtain the current running time and current running results corresponding to the target node; in the case where the current running time is greater than a preset threshold, determine the The target node is an ultra-long node, and an optimization strategy is set for the ultra-long node in the graph; when the current running result indicates that the task fails, prompt information is generated, where the prompt information is used to indicate the The target node in the current graph is an invalid node.
  • orientation or positional relationship indicated by the terms “center”, “upper”, “lower”, “front”, “back”, “left”, “right”, etc. is based on The orientation or positional relationship shown in the drawings is only to facilitate the description of the present disclosure and simplify the description, and does not indicate or imply that the device or component referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as Limitations on the Disclosure.
  • first and second are used for descriptive purposes only and are not to be understood as indicating or implying relative importance.
  • connection should be understood in a broad sense.
  • it can be a fixed connection or a detachable connection. , or integrally connected; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be an internal connection between two components.
  • a component is referred to as being “fixed” or “mounted to” another component, it can be directly on the other component or intervening components may also be present.
  • a component is said to be “connected” to another component, it may be directly connected to the other component or there may also be an intervening component present.
  • the specific meanings of the above terms in this disclosure can be understood on a case-by-case basis.
  • each of the above modules can be implemented through software or hardware.
  • it can be implemented in the following ways, but is not limited to this: the above modules are all located in the same processor; or the above modules can be implemented in any combination.
  • the forms are located in different processors.
  • Embodiments of the present disclosure also provide a storage medium in which a computer program is stored, wherein the computer program is configured to execute the steps in any of the above method embodiments when running.
  • the above-mentioned storage medium may be configured to store a computer program for performing the following steps:
  • Metadata information corresponding to different tasks includes at least one of the following: task running information and task engineering dimension information;
  • the above-mentioned storage medium may include but is not limited to: U disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as Various media that can store computer programs such as RAM), removable hard drives, magnetic disks or optical disks.
  • ROM read-only memory
  • RAM random access memory
  • removable hard drives magnetic disks or optical disks.
  • An embodiment of the present disclosure also provides an electronic device, including a memory and a processor.
  • a computer program is stored in the memory, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.
  • the above-mentioned electronic device may further include a transmission device and an input-output device, wherein the transmission device is connected to the above-mentioned processor, and the input-output device is connected to the above-mentioned processor.
  • the above-mentioned processor may be configured to perform the following steps through a computer program:
  • Metadata information corresponding to different tasks includes at least one of the following: task running information and task engineering dimension information;
  • the structure shown in Figure 6 is only illustrative, and the electronic device can also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a handheld computer, and a mobile Internet device (Mobile Internet Devices, MID), PAD and other terminal equipment.
  • FIG. 6 does not limit the structure of the above-mentioned electronic device.
  • the electronic device may also include more or fewer components (such as network interfaces, etc.) than shown in FIG. 6 , or have a different configuration than that shown in FIG. 6 .
  • the memory 702 can be used to store software programs and modules, such as program instructions/modules corresponding to the communication connection methods and devices in the embodiments of the present disclosure.
  • the processor 704 executes various software programs and modules by running the software programs and modules stored in the memory 702. Function application and data processing, that is, realizing the above communication connection method.
  • Memory 702 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.
  • the memory 702 may further include memory located remotely relative to the processor 704, and these remote memories may be connected to the terminal through a network.
  • the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.
  • the memory 702 may include, but is not limited to, the acquisition module 42 , the creation module 44 , the connection module 46 , and the packaging module 48 in the communication connection device. In addition, it may also include but is not limited to other modular units in the above-mentioned communication connection device, which will not be described again in this example.
  • the above-mentioned transmission device 706 is used to receive or send data via a network.
  • Specific examples of the above-mentioned network may include wired networks and wireless networks.
  • the transmission device 706 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers through network cables to communicate with the Internet or a local area network.
  • the transmission device 1106 is a radio frequency (Radio Frequency, RF) module, which is used to communicate with the Internet wirelessly.
  • RF Radio Frequency
  • the above-mentioned electronic device also includes: a display 708 configured to display the above-mentioned task knowledge graph; and a connection bus 710 configured to connect various module components in the above-mentioned electronic device.
  • modules or steps of the present disclosure can be implemented using general-purpose computing devices, and they can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices.
  • they may be implemented in program code executable by a computing device, such that they may be stored in a storage device for execution by the computing device, and in some cases may be implemented in a format different from
  • the steps shown or described here are performed sequentially, or are implemented as separate integrated circuit modules, or multiple modules or steps among them are implemented as a single integrated circuit module.
  • the present disclosure is not limited to any specific combination of hardware and software.

Abstract

本公开提供了一种图谱的确定方法和装置、存储介质及电子装置,涉及智慧家庭技术领域,该图谱的确定方法包括:获取不同任务对应的元数据信息,其中,所述元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;根据所述元数据信息创建目标节点;在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱;将所述图谱和所述元数据信息进行打包得到任务知识图谱。

Description

图谱的确定方法和装置、存储介质及电子装置
本公开要求于2022年06月28日提交中国专利局、申请号为202210742676.2、发明名称“图谱的确定方法和装置、存储介质及电子装置”的中国专利申请的优先权,其全部内容通过引用结合在本公开中。
技术领域
本公开涉及智慧家庭领域,具体而言,涉及一种图谱的确定方法和装置、存储介质及电子装置。
背景技术
数据产出的准确性和及时性,在一定程度上依赖与任务是否正常运行,作业元数据,作为整个数据链路的指导方向,其错综复杂,利用传统的处理方法难以胜任,链路复杂时,检索性能和准确性都会严重下降。此外,任务链路错综复杂,在传统数据库存储的情况下,表设计复杂,并且查询使用比较麻烦,在体量比较大的情况下,检索所读将大大下降。
针对相关技术中,无法对数据链路复杂的任务进行快速的数据查询等问题,尚未提出有效的技术方案。
发明内容
本公开实施例提供了一种图谱的确定方法和装置、存储介质及电子装置,以至少解决相关技术中,无法对数据链路复杂的任务进行快速的数据查询等问题。
根据本公开的一个实施例,提供了一种图谱的确定方法,包括:获取不同任务对应的元数据信息,其中,所述元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;根据所述元数据信息创建目标节点;在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱;将所述图谱和所述元数据信息进行打包得到任务知识 图谱。
根据本公开的另一个实施例,提供了一种图谱的确定装置,包括:获取模块,设置为获取不同任务对应的元数据信息,其中,所述元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;创建模块,设置为根据所述元数据信息创建目标节点;连接模块,设置为在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱;打包模块,设置为将所述图谱和所述元数据信息进行打包得到任务知识图谱。
根据本公开的又一个实施例,还提供了一种存储介质,所述存储介质中存储有计算机程序,其中,所述计算机程序被设置为运行时执行上述任一项方法实施例中的步骤。
根据本公开的又一个实施例,还提供了一种电子装置,包括存储器和处理器,所述存储器中存储有计算机程序,所述处理器被设置为运行所述计算机程序以执行上述任一项方法实施例中的步骤。
通过本公开,获取不同任务对应的元数据信息,其中,元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;根据元数据信息创建目标节点;在确定不同任务之间的逻辑关系的情况下,使用预设的模式图结构对目标节点进行连接,得到包含不同任务的图谱;将图谱和元数据信息进行打包得到任务知识图谱,即将不同任务对应的整个任务链路关系写入图谱中,利用图谱对应的模式图结构对复杂的任务链路关系进行保留,使得可以使用确定出的任务知识图谱进行任务对应数据的快速查询,因此,可以解决现有技术中无法对数据链路复杂的任务进行快速的数据查询等问题。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。
为了更清楚地说明本公开实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其 他的附图。
图1是根据本公开实施例的一种图谱的确定方法的硬件环境示意图;
图2是根据本公开实施例的图谱的确定方法的流程图;
图3是根据本公开可选实施例的任务元数据管理的时序图;
图4是根据本公开实施例的图谱的确定装置的结构框图;
图5是根据本公开实施例的另一图谱的确定装置的结构框图;
图6是根据本公开实施例的一种电子装置的结构框图。
具体实施方式
为了使本技术领域的人员更好地理解本公开方案,下面将结合本公开实施例中的附图,对本公开实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本公开一部分的实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本公开保护的范围。
需要说明的是,本公开的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本公开的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
根据本公开实施例的一个方面,提供了一种图谱的确定方法。该图谱的确定方法广泛应用于智慧家庭(Smart Home)、智能家居、智能家用设备生态、智慧住宅(Intelligence House)生态等全屋智能数字化控制应用场景。可选地,在本实施例中,上述图谱的确定方法可以应用于如图1所示的由终端设备102和服务器104所构成的硬件环境中。如图1所示,服务器104通过网络与终端设备102 进行连接,可用于为终端或终端上安装的客户端提供服务(如应用服务等),可在服务器上或独立于服务器设置数据库,设置为为服务器104提供数据存储服务,可在服务器上或独立于服务器配置云计算和/或边缘计算服务,设置为为服务器104提供数据运算服务。
上述网络可以包括但不限于以下至少之一:有线网络,无线网络。上述有线网络可以包括但不限于以下至少之一:广域网,城域网,局域网,上述无线网络可以包括但不限于以下至少之一:WIFI(Wireless Fidelity,无线保真),蓝牙。终端设备102可以并不限定于为PC、手机、平板电脑、智能空调、智能烟机、智能冰箱、智能烤箱、智能炉灶、智能洗衣机、智能热水器、智能洗涤设备、智能洗碗机、智能投影设备、智能电视、智能晾衣架、智能窗帘、智能影音、智能插座、智能音响、智能音箱、智能新风设备、智能厨卫设备、智能卫浴设备、智能扫地机器人、智能擦窗机器人、智能拖地机器人、智能空气净化设备、智能蒸箱、智能微波炉、智能厨宝、智能净化器、智能饮水机、智能门锁等。
在本实施例中提供了一种图谱的确定方法,图2是根据本公开实施例的图谱的确定方法的流程图,该流程包括如下步骤:
步骤S202,获取不同任务对应的元数据信息,其中,所述元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;
步骤S204,根据所述元数据信息创建目标节点;
可选的,在确定元数据信息的情况下,可以在目标应用程序中生成目标节点,该目标节点记录了某一个任务在当前时间对应的任务运行情况以及该任务的内容信息。例如,当是视频处理流程,任务运行情况可以是此时视频被处理的状态,如,处理了30%的视频数据,内容信息可以是处理后的视频的数据格式以及视频对应的视频名称,上述内容仅仅只是举例并不限定上述方法。
步骤S206,在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱;
步骤S208,将所述图谱和所述元数据信息进行打包得到任务知识图谱。
通过上述步骤,获取不同任务对应的元数据信息,其中,元数据信息包括以 下至少之一:任务的运行信息、任务的工程维度信息;根据元数据信息创建目标节点;在确定不同任务之间的逻辑关系的情况下,使用预设的模式图结构对目标节点进行连接,得到包含不同任务的图谱;将图谱和元数据信息进行打包得到任务知识图谱,即将不同任务对应的整个任务链路关系写入图谱中,利用图谱对应的模式图结构对复杂的任务链路关系进行保留,使得可以使用确定出的任务知识图谱进行任务对应数据的快速查询,因此,可以解决现有技术中无法对数据链路复杂的任务进行快速的数据查询等问题,进一步的,该任务知识图谱支持多层关系的查询,并且响应速度相对于传统数据库也能得到很大的提升,配合前端将形成任务及时查询,任务链路及时查看的能力,将整个任务网络更加便利的呈现在前端,方便开发运维人员及时发现问题。
作为一种可选的实施例,为了提升对不同任务对应的元数据信息的获取效率,可以通过设置分布式数据流引擎进行元数据信息的获取,使得可以通过以数据并行和流水线方式执行任意元数据信息的数据流获取,增强元数据信息的获取效率;并且还可以对分布式数据流引擎配置自动获取流程,在分布式数据流引擎启动读取功能的情况下,允许分布式数据流引擎直接进行不同任务对应的元数据信息的采集。
在一个示例性实施例中,将所述图谱和所述元数据信息进行打包得到任务知识图谱之后,上述方法还包括:将所述任务知识图谱存储在数据库中,并设置所述任务知识图谱的查询入口;其中,所述查询入口包括以下至少之一:任务查询入口、输出表查询入口、应用查询入口;通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息。
例如,在任务知识图谱在数据库中存储时,可以设置任务知识图谱的任务查询入口;具体的,以任务节点,进行关联任务、工作流等节点,获取到整个任务链路中,运行到节点情况以及运行时长。还可以设置任务知识图谱的输出表查询入口;具体的,以输出表节点,进行关联任务、工作流等节点,获取该输出表在整个任务链路中具体位置以及运行情况;还可以设置任务知识图谱的应用查询入口;具体的,以应用节点,进行关联输出表、任务、工作流等节点,获取该上层应用拥有几条任务链路以及每条链路当前的运行情况以及运行时长;最终通过支 持从三个入口进行查询任务运行情况,及时发现,任务运行超长节点、任务运行失败节点以及任务运行到那个点位等情况,方便开发、运维、产品等人员查询和发现整个任务链路中的问题,及时优化调整。
在一个示例性实施例中,通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息,包括:在所述任务查询入口接收到查询指令的情况下,获取所述任务知识图谱中所有任务链路中不同节点的运行状态以及所述不同节点中每一个节点对应的运行时长,其中,所述任务知识图谱包含不同任务对应的数据链路;基于所述运行状态和所述运行时长生成所述任务知识图谱对应的任务运行图谱;使用预设的状态标识对所述任务运行图谱中的任务运行图谱进行可视化标识,将完成标识的任务运行图谱作为数据信息,并将所述数据信息发送至可视化显示界面。
在一个示例性实施例中,通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息,包括:在所述输出表查询入口接收到查询指令的情况下,确定所述查询指令携带的待查询输出表的查询信息;根据所述查询信息确定当前待查询输出表在所述任务知识图谱中所有任务链路中的具体位置以及所述当前待查询输出表的运行情况;基于所述具体位置和所述运行情况生成可视化输出表,将所述可视化输出表作为数据信息,并将所述数据信息发送至可视化显示界面。
在一个示例性实施例中,通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息,包括:在所述应用查询入口接收到查询指令的情况下,确定所述查询指令对应的应用需求信息;其中,所述应用需求信息用于指示获取与应用对应的链路信息;根据所述应用需求信息在所述任务知识图谱中确定支持所述应用的多条目标数据链路,以及确定所述多条目标数据链路中每一条数据链路当前的运行情况和所述多条目标数据链路中每一条数据链路的运行时长,所述目标数据链路为所述任务知识图谱包含不同任务对应的数据链路的部分链路;使用所述多条目标数据链路、所述多条目标数据链路中每一条链路当前的运行情况、所述多条目标数据链路中每一条链路的运行时长构建应用支持图谱,将所述应用支持图谱作为数据信息,并将所述数据信息发送至可视化显示界面。
在一个示例性实施例中,根据所述元数据信息创建目标节点之后,上述方法还包括:获取所述目标节点对应元数据信息的更新信息;对所述更新信息进行解析,得到待更新属性;使用所述待更新属性对所述目标节点进行属性信息的变更,其中,所述属性信息用于对目标节点进行描述。
在一个示例性实施例中,在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱之后,上述方法还包括:获取所述目标节点对应的当前运行时间以及当前运行结果;在所述当前运行时间大于预设阈值的情况下,确定所述目标节点为超长节点,在所述图谱中为所述超长节点设置优化策略;在所述当前运行结果指示任务运行失败的情况下,生成提示信息,其中,所述提示信息用于指示对当前图谱中的目标节点为无效节点。
为了更好的理解上述图谱的确定方法的过程,以下结合几个可选实施例对上述图谱的确定方法流程进行说明。
作为一种可选的实施例,提出了一种基于知识图谱的任务元数据管理的方法,基于知识图谱的任务元数据管理,在图谱强大的算力和图结构关系下,将任务元数据关联出来形成一个巨大的任务网络,提升检索和管理的能力。即针对链路的错综复杂,将整个任务链路关系,写入图谱中,形成任务知识图谱,在图结构的加持下,复杂的关系将被保留下来,并且支持多层关系的查询,并且响应速度也能得到很大的提升,配合前端将形成任务及时查询,任务链路及时查看的能力。
可选的,在实际应用中,基于知识图谱作为存储介质和计算引擎,fl ink(相当于实施例中的分布式数据流引擎)实时捕获任务元数据库binlog,将获取到的结果实时写入图库中,另外调用实体、关系创建逻辑脚本,完成图结构创建,将任务元数据形成图网络,便于前端调用,获取任务链路运行情况以及任务多条链路关系。将整个任务网络更加便利的呈现在前端,方便开发运维人员及时发现问题,以及了解任务运行的位置。
图3是根据本公开可选实施例的任务元数据管理的时序图;包括以下步骤:
步骤1、管理对象(actor)启动程序(flink);
步骤2.1、flink集群调用数据服务器中AZK配置库中的任务运行日志表; 具体包括:Flink-CDC任务运行信息:采用CDC监控Binlog的形式,采集任务的运行情况;Flink-Jdbc工程维度信息:采用Flink-Jdbc连接数据库,获取任务对应工程的维度信息,主要获取工程描述信息;
步骤2.2、AZK配置库实时返回任务的运行情况;
步骤2.3、flink集群阶段性请求工程元数据;
步骤2.4、返回工程元数据;
步骤3.5、按照逻辑判断,创建新增节点以及更新节点-关系状态;即进行任务知识图谱构建:按照图模式,进行创建实体关系,完成任务链路的网络;按照任务元数据的捕获情况,及时更新图谱的实体属性信息;
步骤3.6、定期更新各节点关系至Neo4j图形数据库;
步骤4.1、图形数据库按照任务,运行状态数据;可选的,任务知识图谱的任务查询入口的运行方式为:以任务节点,进行关联任务、工作流等节点,获取到整个任务链路中,运行到节点情况以及运行时长。
步骤4.2、图形数据库按照输出表,运行状态数据;可选的,任务知识图谱的输出表查询入口的运行方式为:以输出表节点,进行关联任务、工作流等节点,获取该输出表在整个任务链路中具体位置以及运行情况。
步骤4.3、图形数据库按照应用,运行状态数据;可选的,任务知识图谱的应用查询入口的运行方式为:以应用节点,进行关联输出表、任务、工作流等节点,获取该上层应用拥有几条任务链路以及每条链路当前的运行情况以及运行时长。
步骤5、在前端上进行结果的可视化呈现。
也就是说,通过上述方法,利用知识图谱作为存储介质和计算引擎,使用flink读取任务元数据库,获取任务运行元数据信息,按照图模式图,创建实体和关系,写入图库中,初始化完毕后,按照增量形式进行更新实体和关系,图谱存储完毕后,按照三个入口进行供前端使用,任务端、输出表端、应用端,支持开发、运维、产品等人员通过前端进行查看使用。此外,还可以实时获取任务元数据,实现图谱的增量更新。
综上,通过上述方案,对于错综复杂的任务链路,将任务链路的任务元数据提取出来形成任务知识图谱,进而通过任务知识图谱进行任务链路中任务元数据监控和使用的整体管理,进一步的,当任务链路中出现问题,也可以及时发现,为找到优化突破点等方面提供数据支持,另提供实时能力,将整个链路的处理时效性提升到亚秒级别。实现了将任务元数据形成图网络,便于前端调用获取任务链路运行情况以及任务多条链路关系。将整个任务网络更加便利的呈现在前端,方便开发运维人员及时发现问题,以及了解任务运行的位置。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本公开的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本公开各个实施例所述图谱的确定。
在本实施例中还提供了一种图谱的确定装置,该装置用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。
图4是根据本公开实施例的图谱的确定装置的结构框图,如图4所示,该装置包括:
获取模块42,设置为获取不同任务对应的元数据信息,其中,所述元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;
创建模块44,设置为根据所述元数据信息创建目标节点;
连接模块46,设置为在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱;
打包模块48,设置为将所述图谱和所述元数据信息进行打包得到任务知识图谱。
通过上述装置,获取不同任务对应的元数据信息,其中,元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;根据元数据信息创建目标节点;在确定不同任务之间的逻辑关系的情况下,使用预设的模式图结构对目标节点进行连接,得到包含不同任务的图谱;将图谱和元数据信息进行打包得到任务知识图谱,即将不同任务对应的整个任务链路关系写入图谱中,利用图谱对应的模式图结构对复杂的任务链路关系进行保留,使得可以使用确定出的任务知识图谱进行任务对应数据的快速查询,因此,可以解决现有技术中无法对数据链路复杂的任务进行快速的数据查询等问题,进一步的,该任务知识图谱支持多层关系的查询,并且响应速度相对于传统数据库也能得到很大的提升,配合前端将形成任务及时查询,任务链路及时查看的能力,将整个任务网络更加便利的呈现在前端,方便开发运维人员及时发现问题。
可选的,图5是根据本公开实施例的另一图谱的确定装置的结构框图,不仅包括图4中的所有模块,还包括:更新模块52、识别模块54、查询模块56。
在一个示例性实施例中,上述装置还包括:查询模块,设置为将所述任务知识图谱存储在数据库中,并设置所述任务知识图谱的查询入口;其中,所述查询入口包括以下至少之一:任务查询入口、输出表查询入口、应用查询入口;通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息。
在一个示例性实施例中,上述查询模块,还设置为在所述任务查询入口接收到查询指令的情况下,获取所述任务知识图谱中所有任务链路中不同节点的运行状态以及所述不同节点中每一个节点对应的运行时长,其中,所述任务知识图谱包含不同任务对应的数据链路;基于所述运行状态和所述运行时长生成所述任务知识图谱对应的任务运行图谱;使用预设的状态标识对所述任务运行图谱中的任务运行图谱进行可视化标识,将完成标识的任务运行图谱作为数据信息,并将所述数据信息发送至可视化显示界面。
在一个示例性实施例中,上述查询模块,还设置为在所述输出表查询入口接收到查询指令的情况下,确定所述查询指令携带的待查询输出表的查询信息;根 据所述查询信息确定当前待查询输出表在所述任务知识图谱中所有任务链路中的具体位置以及所述当前待查询输出表的运行情况;基于所述具体位置和所述运行情况生成可视化输出表,将所述可视化输出表作为数据信息,并将所述数据信息发送至可视化显示界面。
在一个示例性实施例中,上述查询模块,还设置为在所述应用查询入口接收到查询指令的情况下,确定所述查询指令对应的应用需求信息;其中,所述应用需求信息用于指示获取与应用对应的链路信息;根据所述应用需求信息在所述任务知识图谱中确定支持所述应用的多条目标数据链路,以及确定所述多条目标数据链路中每一条数据链路当前的运行情况和所述多条目标数据链路中每一条数据链路的运行时长,所述目标数据链路为所述任务知识图谱包含不同任务对应的数据链路的部分链路;使用所述多条目标数据链路、所述多条目标数据链路中每一条链路当前的运行情况、所述多条目标数据链路中每一条链路的运行时长构建应用支持图谱,将所述应用支持图谱作为数据信息,并将所述数据信息发送至可视化显示界面。
在一个示例性实施例中,上述装置还包括:更新模块,设置为获取所述目标节点对应元数据信息的更新信息;对所述更新信息进行解析,得到待更新属性;使用所述待更新属性对所述目标节点进行属性信息的变更,其中,所述属性信息用于对目标节点进行描述。
在一个示例性实施例中,上述装置还包括:识别模块,设置为获取所述目标节点对应的当前运行时间以及当前运行结果;在所述当前运行时间大于预设阈值的情况下,确定所述目标节点为超长节点,在所述图谱中为所述超长节点设置优化策略;在所述当前运行结果指示任务运行失败的情况下,生成提示信息,其中,所述提示信息用于指示对当前图谱中的目标节点为无效节点。
在本公开的描述中,需要理解的是,术语中“中心”、“上”、“下”、“前”、“后”、“左”、“右”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本公开和简化描述,而不是指示或暗示所指的装置或组件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本公开的限制。此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性。
在本公开的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“连接”、“相连”应做广义理解,例如,可以是固定连接,也可以是拆卸连接,或一体地连接;可以是机械连接,也可以是电连接;可以是直接相连,也可以是通过中间媒介间接相连,可以是两个组件内部的连通。当组件被称为“固定于”或“设置于”另一个元件,它可以直接在另一个组件上或者也可以存在居中的组件。当一个组件被认为是“连接”另一个元件,它可以是直接连接到另一个元件或者可能同时存在居中元件。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本公开的具体含义。
需要说明的是,上述各个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述各个模块以任意组合的形式分别位于不同的处理器中。
本公开的实施例还提供了一种存储介质,该存储介质中存储有计算机程序,其中,该计算机程序被设置为运行时执行上述任一项方法实施例中的步骤。
在一个示例性实施例中,在本实施例中,上述存储介质可以被设置为存储用于执行以下步骤的计算机程序:
S1,获取不同任务对应的元数据信息,其中,所述元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;
S2,根据所述元数据信息创建目标节点;
S3,在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱;
S4,将所述图谱和所述元数据信息进行打包得到任务知识图谱。
在一个示例性实施例中,在本实施例中,上述存储介质可以包括但不限于:U盘、只读存储器(Read-Only Memory,简称为ROM)、随机存取存储器(Random Access Memory,简称为RAM)、移动硬盘、磁碟或者光盘等各种可以存储计算机程序的介质。
本公开的实施例还提供了一种电子装置,包括存储器和处理器,该存储器中存储有计算机程序,该处理器被设置为运行计算机程序以执行上述任一项方法实 施例中的步骤。
在一个示例性实施例中,上述电子装置还可以包括传输设备以及输入输出设备,其中,该传输设备和上述处理器连接,该输入输出设备和上述处理器连接。
在一个示例性实施例中,在本实施例中,上述处理器可以被设置为通过计算机程序执行以下步骤:
S1,获取不同任务对应的元数据信息,其中,所述元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;
S2,根据所述元数据信息创建目标节点;
S3,在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱;
S4,将所述图谱和所述元数据信息进行打包得到任务知识图谱。
可选地,本领域普通技术人员可以理解,图6所示的结构仅为示意,电子装置也可以是智能手机(如Android手机、iOS手机等)、平板电脑、掌上电脑以及移动互联网设备(Mobile Internet Devices,MID)、PAD等终端设备。图6其并不对上述电子装置的结构造成限定。例如,电子装置还可包括比图6中所示更多或者更少的组件(如网络接口等),或者具有与图6所示不同的配置。
其中,存储器702可用于存储软件程序以及模块,如本公开实施例中的通信连接方法和装置对应的程序指令/模块,处理器704通过运行存储在存储器702内的软件程序以及模块,从而执行各种功能应用以及数据处理,即实现上述的通信连接方法。存储器702可包括高速随机存储器,还可以包括非易失性存储器,如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中,存储器702可进一步包括相对于处理器704远程设置的存储器,这些远程存储器可以通过网络连接至终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。作为一种示例,如图6所示,上述存储器702中可以但不限于包括上述通信连接装置中的获取模块42、创建模块44、连接模块46、打包模块48。此外,还可以包括但不限于上述通信连接装置中的其他模块单元,本示例中不再赘述。
可选地,上述的传输装置706用于经由一个网络接收或者发送数据。上述的网络具体实例可包括有线网络及无线网络。在一个实例中,传输装置706包括一个网络适配器(Network Interface Controller,NIC),其可通过网线与其他网络设备与路由器相连从而可与互联网或局域网进行通讯。在一个实例中,传输装置1106为射频(Radio Frequency,RF)模块,其用于通过无线方式与互联网进行通讯。
此外,上述电子装置还包括:显示器708,设置为显示上述任务知识图谱;和连接总线710,设置为连接上述电子装置中的各个模块部件。
在一个示例性实施例中,本实施例中的具体示例可以参考上述实施例及可选实施方式中所描述的示例,本实施例在此不再赘述。
显然,本领域的技术人员应该明白,上述的本公开的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,在一个示例性实施例中,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本公开不限制于任何特定的硬件和软件结合。
以上所述仅是本公开的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本公开原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本公开的保护范围。

Claims (16)

  1. 一种图谱的确定方法,包括:
    获取不同任务对应的元数据信息,其中,所述元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;
    根据所述元数据信息创建目标节点;
    在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱;
    将所述图谱和所述元数据信息进行打包得到任务知识图谱。
  2. 根据权利要求1所述的方法,其中,将所述图谱和所述元数据信息进行打包得到任务知识图谱之后,所述方法还包括:
    将所述任务知识图谱存储在数据库中,并设置所述任务知识图谱的查询入口;其中,所述查询入口包括以下至少之一:任务查询入口、输出表查询入口、应用查询入口;
    通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息。
  3. 根据权利要求2所述的方法,其中,通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息,包括:
    在所述任务查询入口接收到查询指令的情况下,获取所述任务知识图谱中所有任务链路中不同节点的运行状态以及所述不同节点中每一个节点对应的运行时长,其中,所述任务知识图谱包含不同任务对应的数据链路;
    基于所述运行状态和所述运行时长生成所述任务知识图谱对应的任务运行图谱;
    使用预设的状态标识对所述任务运行图谱中的任务运行图谱进行可视化 标识,将完成标识的任务运行图谱作为数据信息,并将所述数据信息发送至可视化显示界面。
  4. 根据权利要求2所述的方法,其中,通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息,包括:
    在所述输出表查询入口接收到查询指令的情况下,确定所述查询指令携带的待查询输出表的查询信息;
    根据所述查询信息确定当前待查询输出表在所述任务知识图谱中所有任务链路中的具体位置以及所述当前待查询输出表的运行情况;
    基于所述具体位置和所述运行情况生成可视化输出表,将所述可视化输出表作为数据信息,并将所述数据信息发送至可视化显示界面。
  5. 根据权利要求2所述的方法,其中,通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息,包括:
    在所述应用查询入口接收到查询指令的情况下,确定所述查询指令对应的应用需求信息;其中,所述应用需求信息用于指示获取与应用对应的链路信息;根据所述应用需求信息在所述任务知识图谱中确定支持所述应用的多条目标数据链路,以及确定所述多条目标数据链路中每一条数据链路当前的运行情况和所述多条目标数据链路中每一条数据链路的运行时长,所述目标数据链路为所述任务知识图谱包含不同任务对应的数据链路的部分链路;
    使用所述多条目标数据链路、所述多条目标数据链路中每一条链路当前的运行情况、所述多条目标数据链路中每一条链路的运行时长构建应用支持图谱,将所述应用支持图谱作为数据信息,并将所述数据信息发送至可视化显示界面。
  6. 根据权利要求1所述的方法,其中,根据所述元数据信息创建目标节点之后,所述方法还包括:
    获取所述目标节点对应元数据信息的更新信息;
    对所述更新信息进行解析,得到待更新属性;
    使用所述待更新属性对所述目标节点进行属性信息的变更,其中,所述属性信息用于对目标节点进行描述。
  7. 根据权利要求1所述的方法,其中,在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱之后,所述方法还包括:
    获取所述目标节点对应的当前运行时间以及当前运行结果;
    在所述当前运行时间大于预设阈值的情况下,确定所述目标节点为超长节点,在所述图谱中为所述超长节点设置优化策略;
    在所述当前运行结果指示任务运行失败的情况下,生成提示信息,其中,所述提示信息用于指示对当前图谱中的目标节点为无效节点。
  8. 一种图谱的确定装置,包括:
    获取模块,设置为获取不同任务对应的元数据信息,其中,所述元数据信息包括以下至少之一:任务的运行信息、任务的工程维度信息;
    创建模块,设置为根据所述元数据信息创建目标节点;
    连接模块,设置为在确定所述不同任务之间的逻辑关系的情况下,使用预设的模式图结构对所述目标节点进行连接,得到包含不同任务的图谱;
    打包模块,设置为将所述图谱和所述元数据信息进行打包得到任务知识图谱。
  9. 根据权利要求8所述的装置,其中,所述装置还包括:
    查询模块,设置为将所述任务知识图谱存储在数据库中,并设置所述任务知识图谱的查询入口;其中,所述查询入口包括以下至少之一:任务查询入口、输出表查询入口、应用查询入口;通过所述查询入口接收前端的查询指令,并从所述任务知识图谱中获取与所述查询指令匹配的数据信息。
  10. 根据权利要求9所述的装置,其中,
    所述查询模块,还设置为在所述任务查询入口接收到查询指令的情况下,获取所述任务知识图谱中所有任务链路中不同节点的运行状态以及所述不同节点中每一个节点对应的运行时长,其中,所述任务知识图谱包含不同任务对应的数据链路;基于所述运行状态和所述运行时长生成所述任务知识图谱对应的任务运行图谱;使用预设的状态标识对所述任务运行图谱中的任务运行图谱进行可视化标识,将完成标识的任务运行图谱作为数据信息,并将所述数据信息发送至可视化显示界面。
  11. 根据权利要求9所述的装置,其中,
    所述查询模块,还设置为在所述输出表查询入口接收到查询指令的情况下,确定所述查询指令携带的待查询输出表的查询信息;根据所述查询信息确定当前待查询输出表在所述任务知识图谱中所有任务链路中的具体位置以及所述当前待查询输出表的运行情况;基于所述具体位置和所述运行情况生成可视化输出表,将所述可视化输出表作为数据信息,并将所述数据信息发送至可视化显示界面。
  12. 根据权利要求9所述的装置,其中,
    所述查询模块,还设置为在所述应用查询入口接收到查询指令的情况下,确定所述查询指令对应的应用需求信息;其中,所述应用需求信息用于指示获取与应用对应的链路信息;根据所述应用需求信息在所述任务知识图谱中确定支持所述应用的多条目标数据链路,以及确定所述多条目标数据链路中每一条数据链路当前的运行情况和所述多条目标数据链路中每一条数据链路的运行时长,所述目标数据链路为所述任务知识图谱包含不同任务对应的数据链路的部分链路;使用所述多条目标数据链路、所述多条目标数据链路中每一条链路当前的运行情况、所述多条目标数据链路中每一条链路的运行时长构建应用支持图谱,将所述应用支持图谱作为数据信息,并将所述数据信息发送至可视化显示界面。
  13. 根据权利要求8所述的装置,其中,所述装置还包括:
    更新模块,设置为获取所述目标节点对应元数据信息的更新信息;对所述更新信息进行解析,得到待更新属性;使用所述待更新属性对所述目标节点进行属性信息的变更,其中,所述属性信息用于对目标节点进行描述。
  14. 根据权利要求8所述的装置,其中,所述装置还包括:
    识别模块,设置为获取所述目标节点对应的当前运行时间以及当前运行结果;在所述当前运行时间大于预设阈值的情况下,确定所述目标节点为超长节点,在所述图谱中为所述超长节点设置优化策略;在所述当前运行结果指示任务运行失败的情况下,生成提示信息,其中,所述提示信息用于指示对当前图谱中的目标节点为无效节点。
  15. 一种计算机可读的存储介质,所述计算机可读的存储介质包括存储的程序,其中,所述程序由处理器运行时执行权利要求1至7中任一项所述的方法。
  16. 一种电子装置,包括存储器和处理器,所述存储器中存储有计算机程序,所述处理器被设置为通过所述计算机程序执行权利要求1至7中任一项所述的方法。
PCT/CN2022/141686 2022-06-28 2022-12-23 图谱的确定方法和装置、存储介质及电子装置 WO2024001113A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210742676.2 2022-06-28
CN202210742676.2A CN115168605A (zh) 2022-06-28 2022-06-28 图谱的确定方法和装置、存储介质及电子装置

Publications (1)

Publication Number Publication Date
WO2024001113A1 true WO2024001113A1 (zh) 2024-01-04

Family

ID=83486575

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/141686 WO2024001113A1 (zh) 2022-06-28 2022-12-23 图谱的确定方法和装置、存储介质及电子装置

Country Status (2)

Country Link
CN (1) CN115168605A (zh)
WO (1) WO2024001113A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115168605A (zh) * 2022-06-28 2022-10-11 青岛海尔科技有限公司 图谱的确定方法和装置、存储介质及电子装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108768728A (zh) * 2018-05-31 2018-11-06 康键信息技术(深圳)有限公司 运维任务处理方法、装置、计算机设备和存储介质
US20190188980A1 (en) * 2017-12-15 2019-06-20 Google Llc External video clip distribution with metadata from a smart-home environment
CN111782824A (zh) * 2020-08-14 2020-10-16 中国工商银行股份有限公司 信息查询方法、装置、系统和介质
CN111813963A (zh) * 2020-09-10 2020-10-23 平安国际智慧城市科技股份有限公司 知识图谱构建方法、装置、电子设备及存储介质
CN114510611A (zh) * 2022-04-20 2022-05-17 中信证券股份有限公司 一种构建元数据血缘图谱的方法、装置及相关设备
CN115168605A (zh) * 2022-06-28 2022-10-11 青岛海尔科技有限公司 图谱的确定方法和装置、存储介质及电子装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190188980A1 (en) * 2017-12-15 2019-06-20 Google Llc External video clip distribution with metadata from a smart-home environment
CN108768728A (zh) * 2018-05-31 2018-11-06 康键信息技术(深圳)有限公司 运维任务处理方法、装置、计算机设备和存储介质
CN111782824A (zh) * 2020-08-14 2020-10-16 中国工商银行股份有限公司 信息查询方法、装置、系统和介质
CN111813963A (zh) * 2020-09-10 2020-10-23 平安国际智慧城市科技股份有限公司 知识图谱构建方法、装置、电子设备及存储介质
CN114510611A (zh) * 2022-04-20 2022-05-17 中信证券股份有限公司 一种构建元数据血缘图谱的方法、装置及相关设备
CN115168605A (zh) * 2022-06-28 2022-10-11 青岛海尔科技有限公司 图谱的确定方法和装置、存储介质及电子装置

Also Published As

Publication number Publication date
CN115168605A (zh) 2022-10-11

Similar Documents

Publication Publication Date Title
US20190094824A1 (en) Method and apparatus for controlling device using a service rule
CN101957832B (zh) 对于事件流数据管理的统一的窗口支持
US11874794B2 (en) Entity snapshots partitioning and combining
WO2024001113A1 (zh) 图谱的确定方法和装置、存储介质及电子装置
CN109120461B (zh) 一种业务性能端到端监控方法、系统及装置
CN101651561B (zh) 基于规则引擎的网络拓扑分析方法和系统
CN104865835A (zh) 一种基于ZigBee的智能家居系统
CN104731943A (zh) 一种服务器和数据处理方法
CN104506462A (zh) 一种分布式交换机中mac地址管理方法及设备
CN105490826A (zh) 基于自动发现的配置管理系统及方法
CN111782672B (zh) 多领域数据管理方法及相关装置
US8805982B1 (en) Progressively determining a network topology and using neighbor information to determine network topology
CN113794781B (zh) 数据采集方法、装置、设备及存储介质
CN110784336A (zh) 基于物联网的多设备智能定时延时场景设置方法及系统
WO2024001189A1 (zh) 食物存储信息的确定方法及装置、存储介质及电子装置
CN107679107A (zh) 一种基于图数据库的电网设备可达性查询方法及系统
WO2024021546A1 (zh) 行为偏好表的生成方法和装置、存储介质及电子装置
CN114911535B (zh) 应用程序组件配置方法、存储介质及电子装置
CN116107975A (zh) 设备的控制方法和装置、存储介质及电子装置
CN116225834A (zh) 告警信息的发送方法、装置、存储介质及电子装置
CN105607594B (zh) 基于智能家居的服务器内存查找设备的方法
CN113239074A (zh) 物理端口定位方法、装置、电子设备及存储介质
CN110855803B (zh) 一种数据采集方法和装置
JP5782393B2 (ja) ネットワークリソース分散管理方法およびプログラム
US11916741B1 (en) Discovery of application relationships in clusters

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22949189

Country of ref document: EP

Kind code of ref document: A1