CN108090198B

CN108090198B - Graph database creating method, graph database creating device, graph database loading device, and graph database loading medium

Info

Publication number: CN108090198B
Application number: CN201711408902.9A
Authority: CN
Inventors: 张晨
Original assignee: Zhejiang Create Link Technology Co ltd
Current assignee: Zhejiang Create Link Technology Co ltd
Priority date: 2017-12-22
Filing date: 2017-12-22
Publication date: 2020-12-22
Anticipated expiration: 2037-12-22
Also published as: CN108090198A

Abstract

The invention provides a method, a device and a medium for creating a graph database and loading data, wherein the method comprises the following steps: receiving structured data source file data input by a user, and converting the source file data into a csv format or a tsv format; acquiring nodes selected from the file data after format conversion, and correspondingly selecting node attributes for the nodes; acquiring edges selected in the file data after format conversion, wherein the edges at least comprise 2 selected nodes; selecting 2 nodes from the nodes contained in the edge as the starting point and the end point of the edge, and selecting edge attributes for the edge; and transmitting the nodes and the edges, the node attributes corresponding to the nodes and the edge attributes corresponding to the edges to a server, creating graph data, and storing the graph data into a graph database. According to the method and the system, through the set visual interface, a user carries out graph modeling through a simple flow based on common source file data and imports the graph to the graph database, so that the original very complicated graph establishing process is greatly simplified, the convenience of simple drawing completion is realized, and the processing efficiency is improved.

Description

Graph database creating method, graph database creating device, graph database loading device, and graph database loading medium

Technical Field

The present invention relates to the field of computers, and in particular, to the field of graph database creation and data loading methods, devices, and media.

Background

Graph databases (graph databases) are becoming more popular today, and people mainly use graph databases in which data is stored and manipulated in patterns of "nodes" and "edges", the most direct example of a graph being a social network, where each person is a node and an edge is a friendship. The world's three major open source database is Neo4j, Titan, Orientdb. To use these graph databases, graph structure data must be first created and imported into the databases through some process based on non-graph structure data sources through operations such as data modeling, transformation, and import.

If the data source is a csv file, the data must be loaded using the import method provided by each of the different graph databases. Meanwhile, not only the problem that the file format needs to be converted, but also a certain method is needed to tell the target graph database which data in the data source need to be modeled as the 'node' information import and which data need to be imported as the 'edge' information. At present, data importing methods of various graph databases are very complex, a user who does not understand programming or does not understand a query language of the corresponding graph database or does not understand an execution command line program is difficult to simply complete modeling and importing from a common data source such as a csv file to the graph database, and in a simple way, a process for completing the modeling and importing of the graph by a user without writing any code or script does not exist.

Traditional database export files, or structured data, are in csv or similar format, which is a very different way from the way graph databases store data as points and edges between points. For example, each row of csv contains many fields other than id, all of which are present in the same row; however, in the graph database, some columns or fields of the original row are extracted to be used as a point, so that more than few columns become nodes in the graph, and the edges of the columns need to be designed by people with modeling and rich programming experience, which fields need to be used, which nodes need to be used in the graph database, which computation edges need to be used, and the like, and all the operations need to be finished in real time.

Therefore, the drawbacks of the prior art are: in the prior art, the process for modeling and importing the diagram is complex, and codes or scripts are required to be written to complete the modeling and importing of the diagram.

Disclosure of Invention

In view of the above technical problems, the present invention provides a method, device, and medium for creating a graph database and loading data, which enable a user to perform graph modeling based on common source file data through a simple flow and import a graph to the graph database through a set visual interface, thereby greatly simplifying the original very complicated process of creating a graph, facilitating the completion of simple dragging, and improving the processing efficiency.

In order to solve the technical problems, the technical scheme provided by the invention is as follows:

in a first aspect, the present invention provides a method for creating a graph database and loading data, comprising:

step S1, receiving source file data input by a user, wherein the source file data is structured data, converting the source file data into a csv format or a tsv format, and displaying the format-converted file data through a visual interface;

step S2, acquiring nodes selected by the user in the file data after format conversion through a visual interface, and correspondingly selecting node attributes for the nodes;

step S3, obtaining the edges selected by the user in the file data after format conversion through a visual interface, wherein the edges at least comprise 2 selected nodes;

step S4, selecting 2 nodes from the nodes contained in the edge as the starting point and the end point of the edge, and selecting edge attributes for the edge after the starting point and the end point are selected;

and step S5, transmitting the nodes and the edges, the node attributes corresponding to the nodes and the edge attributes corresponding to the edges to a server, creating graph data, and storing the graph data into a graph database.

The invention provides a graph database creating and data loading method, which adopts the technical scheme that: receiving source file data input by a user, wherein the source file data is structured data, converting the source file data into a csv format or a tsv format, and displaying the converted file data in the format through a visual interface; acquiring nodes selected by the user in the file data after format conversion through a visual interface, and correspondingly selecting node attributes for the nodes; acquiring edges selected by the user in the file data after format conversion through a visual interface, wherein the edges at least comprise 2 selected nodes; selecting 2 nodes from the nodes contained in the edge as a starting point and an end point of the edge, and selecting edge attributes for the edge after the starting point and the end point are selected; and transmitting the nodes and the edges, the node attributes corresponding to the nodes and the edge attributes corresponding to the edges to a server, creating graph data, and storing the graph data into a graph database.

According to the method, the device and the medium for creating and loading the graph database, provided by the invention, through the set visual interface, a user carries out graph modeling through a simple flow based on common source file data and imports a graph to the graph database, so that the original very complicated process of establishing the graph is greatly simplified, the convenience of completing simple dragging is realized, and the processing efficiency is improved.

Preferably, the step S1 specifically includes:

step S11, receiving source file data input by a user, wherein the source file data is structured data;

step S12, determining the format of the source file data, and if the format of the source file data is csv format or tsv format, not processing the source file data, otherwise, converting the format of the source file data into csv format or tsv format.

Preferably, in step S11, the method further includes:

receiving source file data input by a user;

judging the source file data, if the source file data is structured data, jumping to the step S12, and if the source file data is not structured data, re-acquiring the source file data input by the user.

Preferably, the step S2 specifically includes:

converting the file data after format conversion into a form of a preview list head column, and displaying the file data on the visual interface;

and selecting a data column from the preview list head column as a node through the visual interface, and selecting the data column from the preview list head column as a node attribute corresponding to the node.

Preferably, the step S3 specifically includes:

and selecting a data column as an edge in the preview table head column through the visual interface, wherein the edge at least comprises 2 selected nodes.

Preferably, in step S3, the method further includes:

judging the number of the selected nodes contained in the edge, when the number of the selected nodes is not more than 2, reselecting the edge in the file data after format conversion, otherwise, jumping to the step S4.

Preferably, the step S4 specifically includes:

selecting 2 nodes from the nodes contained in the edge as a starting point and an end point of the edge to obtain the edge with the starting point;

and selecting a data column from the preview table head column for the edge with the starting point as an edge attribute.

In a second aspect, the present invention provides a graph database creating and data loading apparatus, comprising: at least one processor, at least one memory, and computer program instructions stored in the memory that, when executed by the processor, implement the method of the first aspect.

In a third aspect, the present invention provides a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the method according to the first aspect.

Compared with the prior art, the invention has the advantages that:

Drawings

In order to more clearly illustrate the detailed description of the invention or the technical solutions in the prior art, the drawings that are needed in the detailed description of the invention or the prior art will be briefly described below.

FIG. 1 is a flow chart of a method for creating a graph database and loading data according to an embodiment of the invention;

FIG. 2 is a diagram illustrating a hardware architecture of a graph database creating and data loading apparatus according to an embodiment of the present invention.

Detailed Description

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and therefore are only examples, and the protection scope of the present invention is not limited thereby.

Examples

FIG. 1 is a flow chart of a method for creating a graph database and loading data according to an embodiment of the invention; as shown in fig. 1, a method for creating a graph database and loading data provided in this embodiment includes:

Preferably, the step S1 specifically includes:

Preferably, in step S11, the method further includes:

receiving source file data input by a user;

Preferably, the step S2 specifically includes:

Preferably, the step S3 specifically includes:

Preferably, in step S3, the method further includes:

Preferably, the step S4 specifically includes:

Based on the graph database creating and data loading method, based on a visual interface of a terminal, a user can create a graph database on the visual interface, and the specific process is as follows:

providing a source data file by a user, judging whether the source data file is structured data or not for the first time, if not, letting the user provide the source data file again, if so, judging for the second time, judging whether the format of the structured source data is in a csv format or a tsv format or not for the second time, if so, directly carrying out the next processing, and if not, converting the source data into the csv format or the tsv format, and then carrying out the next processing;

after format conversion, the source file is converted into a preview list head column form and is displayed on a visual interface, wherein the source file data in the csv format or the tsv format is in the column form, and the data are converted into the preview list head form and are displayed on the visual interface;

on a visual interface, a user selects an adding point as a node, namely selects one or more data columns in a preview list head column as the node, and selects the data columns from the preview list head column as node attributes corresponding to the node;

then, on the visual interface, the user selects the data columns as the edges, that is, selects one or more data columns in the preview list head column as the edges, and the selected nodes included in the selected edges are at least 2, if the number of the selected nodes is less than 2, the edges are reselected, after the edges are selected, a starting point is selected for the selected edges, after the starting point is selected, the edge attributes are selected for the edges after the starting point is selected, and specifically, the data columns are selected as the edge attributes for the edges in the preview list head column.

And transmitting the selected nodes and edges, the node attributes corresponding to the nodes and the edge attributes corresponding to the edges to a background server, creating graph data, and storing the graph data into a graph database. The graph data created by the method does not need modeling and rich programming experience of a user, only needs to select which data are selected as nodes and which are selected as edges through a visual interface, completes the creation of the graph data by a background, and does not need any programming or script writing.

In a second aspect, the method for creating a graph database and loading data according to the embodiment of the present invention described with reference to fig. 2 may be implemented by a graph database creating and loading device. FIG. 2 is a diagram illustrating a hardware architecture of a graph database creation and data loading device according to an embodiment of the present invention.

The graph database creation and data loading device may include a processor 401 and a memory 402 storing computer program instructions.

Specifically, the processor 401 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured as one or more Integrated circuits implementing embodiments of the present invention.

Memory 402 may include mass storage for data or instructions. By way of example, and not limitation, memory 402 may include a Hard Disk Drive (HDD), floppy Disk Drive, flash memory, optical Disk, magneto-optical Disk, tape, or Universal Serial Bus (USB) Drive or a combination of two or more of these. Memory 402 may include removable or non-removable (or fixed) media, where appropriate. The memory 402 may be internal or external to the data processing apparatus, where appropriate. In a particular embodiment, the memory 402 is a non-volatile solid-state memory. In a particular embodiment, the memory 402 includes Read Only Memory (ROM). Where appropriate, the ROM may be mask-programmed ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory or a combination of two or more of these.

The processor 401 reads and executes the computer program instructions stored in the memory 402 to implement any of the graph database creation and data loading methods in the above-described embodiments.

In one example, the graph database creation and data loading apparatus may also include a communication interface 403 and a bus 410. As shown in fig. 2, the processor 401, the memory 402, and the communication interface 403 are connected via a bus 410 to complete communication therebetween.

The communication interface 403 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiments of the present invention.

Bus 410 includes hardware, software, or both that couple the components of the map database creation and data loading device to each other. By way of example, and not limitation, a bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hypertransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus or a combination of two or more of these. Bus 410 may include one or more buses, where appropriate. Although specific buses have been described and shown in the embodiments of the invention, any suitable buses or interconnects are contemplated by the invention.

In a third aspect, in combination with the graph database creating and data loading methods in the foregoing embodiments, embodiments of the present invention may provide a computer-readable storage medium to implement. The computer readable storage medium having stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement any of the graph database creation and data loading methods of the above embodiments.

It is to be understood that the invention is not limited to the specific arrangements and instrumentality described above and shown in the drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present invention are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions or change the order between the steps after comprehending the spirit of the present invention.

The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the invention are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.

It should also be noted that the exemplary embodiments mentioned in this patent describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.

Compared with the prior art, the invention has the advantages that:

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention, and they should be construed as being included in the following claims and description.

Claims

1. A method for creating a graph database and loading data is characterized by comprising the following steps:

step S5, transmitting the nodes and the edges, the node attributes corresponding to the nodes and the edge attributes corresponding to the edges to a server, creating graph data and storing the graph data into a graph database;

the step S2 specifically includes: converting the file data after format conversion into a form of a preview list head column, and displaying the file data on the visual interface; selecting a data column from the preview table head column as a node through the visual interface, and selecting the data column from the preview table head column as a node attribute corresponding to the node;

the step S3 specifically includes: selecting a data column as an edge in the preview table head column through the visual interface, wherein the edge at least comprises 2 selected nodes;

the step S4 specifically includes: selecting 2 nodes from the nodes contained in the edge as a starting point and an end point of the edge to obtain the edge with the starting point; and selecting a data column from the preview table head column for the edge with the starting point as an edge attribute.

2. The method of claim 1,

the step S1 specifically includes:

3. The method of claim 2,

in step S11, the method further includes:

receiving source file data input by a user;

4. The method of claim 1,

in step S3, the method further includes:

5. A graph database creation and data loading apparatus, comprising: at least one processor, at least one memory, and computer program instructions stored in the memory that, when executed by the processor, implement the method of any of claims 1-4.

6. A computer-readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1-4.