WO2021217659A1 - 多源异构数据的处理方法、计算机设备、存储介质 - Google Patents

多源异构数据的处理方法、计算机设备、存储介质 Download PDF

Info

Publication number
WO2021217659A1
WO2021217659A1 PCT/CN2020/088496 CN2020088496W WO2021217659A1 WO 2021217659 A1 WO2021217659 A1 WO 2021217659A1 CN 2020088496 W CN2020088496 W CN 2020088496W WO 2021217659 A1 WO2021217659 A1 WO 2021217659A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
external
database
tree
source heterogeneous
Prior art date
Application number
PCT/CN2020/088496
Other languages
English (en)
French (fr)
Inventor
顾峰巍
冯燕朋
Original Assignee
深圳中砼物联网科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳中砼物联网科技有限公司 filed Critical 深圳中砼物联网科技有限公司
Priority to PCT/CN2020/088496 priority Critical patent/WO2021217659A1/zh
Publication of WO2021217659A1 publication Critical patent/WO2021217659A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures

Definitions

  • the present invention relates to the field of computer technology, in particular to a processing method, computer equipment, and storage medium for multi-source heterogeneous data.
  • the real informatization needs of an enterprise make the data of an enterprise in different business scenarios interoperable, for example, a series of data such as procurement, production scheduling, production and processing, sales, after-sales, etc. are connected.
  • differences in language, platform, and technology between different systems of an enterprise can lead to fragmentation of information.
  • different information sources involved such as commodities, orders, etc.
  • scenario data required by different enterprises is different.
  • an enterprise interacts with the business data of other enterprises, it will face problems such as incompatibility, missing, and excessive data. That is, it is difficult for existing information products to achieve data interoperability. Data between different products and businesses are often isolated, and businesses cannot be coordinated, resulting in fragmentation of information and the inability to achieve the goal of centralized management of information and businesses.
  • the present invention provides a multi-source heterogeneous data processing method, computer equipment, and storage medium, which can process data of various data storage structures into data required by users.
  • the present invention provides a method for processing multi-source heterogeneous data
  • the method for processing multi-source heterogeneous data includes:
  • the method for processing multi-source heterogeneous data further includes:
  • the request instruction of the external data is sent to the external object, so that the external object returns the external data according to the request instruction.
  • the external object includes a third-party platform
  • the request instruction includes a third-party interface data access instruction.
  • the multi-source heterogeneous data processing method further includes:
  • a third-party interface configuration graphic template is generated according to a preset access third-party interface programming statement framework, and the third-party interface configuration graphic template is used for the user to input interface attribute data corresponding to the access third-party interface programming statement framework and the need to access Data, the interface attribute data is used to indicate the type of the external object;
  • the schematic diagram of acquiring the data is configured.
  • the external object includes a database
  • the request instruction includes an instruction to access the database
  • the method specifically includes:
  • the database configuration graphic template is used for the user to input database attribute data corresponding to the access database programming statement frame;
  • the schematic diagram of acquiring the data is configured according to the database attribute data input by the user.
  • the data structure graphical interface includes icons corresponding to the database programming sentence framework for operating the database
  • the database programming sentence framework includes database programming sentence frameworks corresponding to multiple types of software development languages.
  • the programming sentence framework for operating databases in the same type of language also includes database programming sentence frameworks for different types of software development languages that perform the same operation on the database, and the different types of software development languages are used to represent database programming for performing the same operation on the database.
  • the language frame corresponds to the same icon.
  • the method for processing multi-source heterogeneous data further includes:
  • each of the input data corresponds to one of the external data
  • the tree data structure is created according to the input data in the input box of the tree structure and the interconnected nodes.
  • the input data in the tree data storage structure corresponds to all or part of the external data in a one-to-one correspondence.
  • calling the matching mapping function to map the external data to the data model to store the external data specifically includes:
  • the required external data is stored using the tree data structure.
  • the present invention also provides a computer device, which includes:
  • a memory for storing computer executable programs
  • the processor is configured to execute the executable program to implement the multi-source heterogeneous data processing method as described above.
  • the present invention also provides a storage medium for storing a computer-executable program, and the computer-executable program is executed by a processor to implement the multi-source heterogeneous data processing method as described above.
  • the above-mentioned multi-source heterogeneous data processing methods, computer equipment, and storage media can map data of different data structure types according to the tree data structure configured by the user, and support data of various data structures, so that different product businesses Data intercommunication realizes centralized management of information and business.
  • FIG. 1 is a schematic diagram of an operating environment of a software development program with multi-source heterogeneous data processing functions provided by the first embodiment of the present invention.
  • Fig. 2 is a schematic diagram of a tree diagram provided by the first embodiment of the present invention.
  • FIG. 3 is a schematic diagram of the internal structure of a computer device provided by the first embodiment of the present invention.
  • FIG. 4 is a schematic flowchart of a method for processing multi-source heterogeneous data provided by the first embodiment of the present invention.
  • Fig. 5 is a schematic diagram of a processing process for realizing multi-source data provided by the first embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a user interface of a method for processing multi-source data according to the first embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a sub-flow diagram of a processing method for multi-source heterogeneous data provided in the first embodiment according to the first embodiment of the present invention.
  • FIG. 8 is a schematic diagram of a sub-flow diagram of a method for processing multi-source heterogeneous data provided by the first embodiment provided by the second embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a user interface of a method for processing multi-source heterogeneous data according to a second embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a sub-flow of a method for processing multi-source heterogeneous data provided by the third embodiment of the present invention.
  • FIG. 11 is a schematic diagram of a sub-flow of a method for processing multi-source heterogeneous data according to a fourth embodiment of the present invention.
  • FIG. 12 is a schematic diagram of a user interface of a method for processing multi-source heterogeneous data provided by the third embodiment of the present invention.
  • FIG. 1 is a schematic diagram of the running environment of the software development program with multi-source heterogeneous data processing function provided by the first embodiment.
  • the software development system 1000 with multi-source heterogeneous data processing function includes a client 1001, a back-end server 1002, and an external object 1004 that provides source data.
  • the background server 1002 communicates with the client 1001 through the network 1003.
  • the external object 1004 can be a database, a third-party interface, a data table, and so on.
  • Databases include but are not limited to MySQL, Oracle, NOSQL, etc.
  • third-party interfaces include but are not limited to Web Service interfaces, RPC interfaces, HTTP interfaces, etc.
  • data tables can be EXCEL documents, Word documents, etc.
  • the backend server 1002 provides a corresponding graphical configuration interface for the user to configure the information elements represented by the tree data structure.
  • the backend server 1002 maps the information elements contained in the source data provided by the external object 1004 to the tree data structure configured by the user according to the tree data structure configured by the user.
  • the tree diagram T includes a plurality of nodes t1. If the tree diagram T is used to decompose an object, it can be decomposed infinitely. Understandably, if an object is portrayed in a tree structure, the object can be portrayed from various dimensions as required, that is, the tree structure can always portray the information elements required by an object in various business scenarios. For example, when portraying the Chinese government (object), it can be divided according to a tree structure, and then it can be divided into a specific group, such as a family (node). In other words, with the tree data structure, any data/information element in different data structures can be mapped to a node t1 of the tree structure. Therefore, the use of tree data structure can undertake the intelligence elements of the source data of any data structure.
  • FIG. 3 is a schematic diagram of the internal structure of the computer device 800 provided in the first embodiment.
  • the client side 1001 and the server side 1002 are respectively installed with computer equipment of the client side and the server side program of the software development program with the processing function of multi-source heterogeneous data.
  • the computer equipment may be a tablet computer, a desktop computer, or a notebook computer. Computer equipment can be loaded with or Wait for the operating system.
  • the computer device 800 includes a storage medium 801, a processor 802, and a bus 803.
  • the storage medium 801 includes at least one type of readable storage medium.
  • the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, and the like.
  • the storage medium 801 may be an internal storage unit of the computer device 800 in some embodiments, such as a hard disk of the computer device 800. In other embodiments, the storage medium 801 may also be an external computer device 800 storage device, such as a plug-in hard disk equipped on the computer device 800, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital, SD) ) Card, Flash Card, etc. Further, the storage medium 801 may also include both an internal storage unit of the computer device 800 and an external storage device.
  • the storage medium 801 can be used not only to store application software and various data installed in the computer device 800, such as implementing multi-source heterogeneous data processing program instructions, etc., but also to temporarily store data that has been output or will be output.
  • the bus 803 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc.
  • PCI peripheral component interconnect
  • EISA extended industry standard architecture
  • the bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 2, but it does not mean that there is only one bus or one type of bus.
  • the computer device 800 may further include a display component 804.
  • the display component 804 may be an LED (Light Emitting Diode, light emitting diode) display, a liquid crystal display, a touch liquid crystal display, an OLED (Organic Light-Emitting Diode, organic light emitting diode) touch device, and the like.
  • the display component 804 may also be appropriately referred to as a display device or a display unit, which is used to display information processed in the computer device 800 and used to display a visualized user interface.
  • the computer device 800 may also include a communication component 805.
  • the communication component 805 may optionally include a wired communication component and/or a wireless communication component (such as a WI-FI communication component, a Bluetooth communication component, etc.), which is usually used in computer equipment 800 establishes a communication connection with other computer equipment.
  • a wireless communication component such as a WI-FI communication component, a Bluetooth communication component, etc.
  • the processor 802 may be a central processing unit (CPU), controller, microcontroller, microprocessor, or other data processing chip, and is used to run the program code stored in the storage medium 801 or Data processing. Specifically, the processor 802 executes a multi-source heterogeneous data processing program to control the computer device 800 to implement a multi-source heterogeneous data processing method.
  • CPU central processing unit
  • controller microcontroller
  • microprocessor microprocessor
  • FIG. 3 only shows a computer device 800 with components 801-805 and a multi-source heterogeneous data processing program 01.
  • the structure shown in FIG. 3 does not constitute a computer
  • the definition of the device 800 may include fewer or more components than shown, or a combination of certain components, or a different component arrangement.
  • FIG. 4 is a schematic flowchart of a method for processing multi-source heterogeneous data provided by the first embodiment.
  • the processing method for realizing multi-source heterogeneous data includes the following steps.
  • Step S401 Obtain external data from an external object.
  • the external object 1004 is used to provide external data.
  • the external object 1004 may be a database D1, a third-party interface D2, a data table D3, and so on.
  • the database D1 includes but is not limited to MySQL, Oracle, NOSQL, etc.
  • the third-party interface D2 includes but is not limited to Web Service interface, RPC interface, HTTP interface, etc.
  • the data table D3 can be an EXCEL document, a Word document, etc.
  • Different external objects 1004 store different data structures.
  • the user wants to obtain the external data provided by the external object 1004, he can send a request to the corresponding external object by writing code. Then, the external object 1004 responds to the request and returns the requested data, so that the source data provided by the external object 1004 can be obtained from the external object 1004.
  • the user does not need to write code to obtain external data from the external object 1004. It is understandable that the data structures provided by different external objects 1004 are different, and therefore, the methods used to obtain data in different data objects 1004 are also inconsistent. How to obtain external data without writing code by the user will be described in detail below.
  • Step S403 Obtain the type of the external object.
  • the type of the external object 1004 is classified according to the type of the data structure.
  • the type of data structure is represented by attributes.
  • different types of external objects 1004 such as the database D1, the third-party interface D2, and the data table D3, use different attributes/data structures.
  • Even external objects 1004 of the same kind have different attributes/data structures.
  • the database D1 includes MySQL, Oracle, and NOSQL.
  • multiple external objects 1004 are all databases, but different types of databases use different data structures, that is, different data structures are used to store information elements in different databases.
  • Step S405 Provide a graphical data structure interface for the user to configure the schematic diagram of the tree data structure.
  • the graphical schematic diagram 102 constructed by the data structure graphical interface 101 is a flowchart or a relationship diagram composed of multiple interconnected nodes 1021.
  • the data structure graphical interface 101 provides an input box 1010 and an output box 1011 displayed in a tree data structure for the user to configure the input data/intelligence elements and output data/intelligence elements of the corresponding node 1021, thereby limiting the input data and output output data to only Configured in a tree structure.
  • the input data and output output data under each node 1021 can be associated through each node 1021, and the output data of one of the associated nodes 1021 provides input information elements for the other or more, and each node 1021 can be input
  • the data is associated with the output data.
  • the data structure graphical interface 101 also includes an icon 103 corresponding to the data processing logic programming statement frame.
  • the data processing logic programming statement framework includes data processing logic programming statement frameworks corresponding to multiple types of software development languages.
  • the data processing logic programming statement frameworks of the same type of language also include data processing in different types of software development languages that perform the same processing on data.
  • Logic programming statement framework different types of software development languages are used to represent database programming language frameworks that perform the same processing on data corresponding to the same icons. For example, if the user selects the icon 103 by dragging, the corresponding node 1021 is generated.
  • the node 1021 has a connection terminal. The user connects the two nodes 1021 at the connection ends, and then associates the two nodes 1021 through the configuration line 1022.
  • each node 1021 is associated with a database programming sentence framework for operating the database.
  • step S405 further includes the following steps: step S4051, in response to the user's data configuration operation on the icon 103, an input box 1010 and an output box 1011 in a tree structure are provided for the user to input corresponding input data and output data, each The input data corresponds to an external data.
  • step S4052 a graphical schematic diagram 102 is created according to the input data in the input box of the tree structure and the interconnected nodes.
  • Step S407 Construct a tree-shaped data storage structure according to the schematic diagram of the tree-shaped data structure configured by the user.
  • the developer implements the construction of a tree-shaped data storage structure through coding.
  • building a tree-shaped data storage structure does not need to be implemented by the user side through coding.
  • step S407 further includes: step S4071, parsing the schematic diagram of the tree data structure configured by the user to obtain the configuration information of the tree data structure.
  • the configuration information of the tree data structure includes data processing logic programming sentence frame information representing each node 1021, sequence information representing data processing logic programming sentence frame information, and input data and output data information representing each node 1021.
  • Step S4072 Obtain the data processing logic programming statement frame associated with each node 1021 according to the configuration information of the tree data structure, obtain the input data and output data of each data processing logic programming statement frame information, and obtain each data processing logic programming statement frame order.
  • Step S4073 Correspond each input data and output data of each node 1021 with each data processing logic programming statement frame one-to-one, and use the tree data structure to associate to construct a tree that is consistent with the tree data structure configured by the user Shape data storage structure.
  • S409 Match the corresponding mapping function from the preset mapping function set according to the type of the external object. Understandably, when data conversion in different external objects 1004 is stored in a tree data structure configured by the user, different mapping functions are used for one-to-one mapping.
  • the mapping function set N includes mapping functions N 1 to n .
  • the mapping function N 1 is used .
  • the mapping function N n-1 is used .
  • the mapping function N n is used .
  • the mapping function set N may also be divided into multiple mapping function subsets according to the type of the external object 1004. For example, divide the external object 1004 as a database into a mapping function subset; when the external object 1004 is a database with a certain attribute, for example, a MySQL database, it can be searched in the corresponding mapping function subset.
  • Step S4011 calling the matching mapping function to map the external data to the tree-shaped data storage structure to store the external data. Understandably, the mapping function matches the type of the external object 1004. Even if the information elements of an object are stored in different data structures, the information elements required by the user can eventually be obtained according to the user's configuration.
  • step S4011 further includes: step S40110, finding out the required external data according to the input data.
  • step S40111 According to the corresponding relationship between the input data and the output data, the required external data is stored in a tree data structure.
  • step S401 is a schematic diagram of the sub-process of step S401.
  • step S401 includes the following steps.
  • a graphical data acquisition interface is provided for the user to configure a schematic diagram of data acquisition.
  • the data acquisition graphical interface provides controls such as input boxes and buttons for the user to configure schematic diagrams in the form of charts, as shown in FIG. 9 and FIG. 12. The user can configure the required parameters through the input box.
  • Step S803 Create a request instruction for acquiring the external data according to the schematic diagram of acquiring the data.
  • the multi-source heterogeneous data processing function provides a recognition diagram and generates a corresponding request instruction, without the need for isomorphic programming to write code for accessing external data.
  • the multi-source heterogeneous data processing function software development program also provides a preset programming statement framework for accessing external objects.
  • a programming statement frame for accessing external objects includes a programming statement frame for accessing a database and a programming statement frame for accessing a third-party interface.
  • Different types of databases correspond to different programming statement frameworks for accessing the database.
  • the programming statement frameworks of different types of third-party interfaces are different.
  • Creating the request instruction for acquiring the external data according to the schematic diagram of acquiring the data is specifically: creating a request instruction for acquiring the external data according to a combination of a preset programming sentence frame and parameters for accessing an external object.
  • Step S805 Send a request instruction of external data to the external object, so that the external object returns the external data according to the request instruction.
  • FIGS. 10-11 are schematic diagrams of the processes of obtaining source data from the third-party interface D2 provided by the third-party platform.
  • FIG. 11 is a schematic diagram of the process of obtaining source data from the database D1.
  • the multi-source heterogeneous data processing method further includes the following steps.
  • a third-party interface configuration graphic template is generated according to a preset access third-party interface programming statement framework, and the third-party interface configuration graphic template is used for the user to input interface attribute data and requirements corresponding to the access third-party interface programming statement frame Access data, interface attribute data is used to indicate the type of external object 1004.
  • Step S1004 according to the interface attribute data input by the user and the data to be accessed, a schematic diagram of obtaining data is configured.
  • the processing method for multi-source heterogeneous data further includes the following steps.
  • step S1101 a corresponding database configuration graphic template is generated according to the preset access database programming statement frame, and the database configuration graphic template is used for the user to input database attribute data corresponding to the access database programming statement frame;
  • step S1103 a schematic diagram of acquiring data is configured according to the database attribute data input by the user.
  • the invention provides a multi-source heterogeneous data processing method, computer equipment, and storage medium.
  • the information elements and flowcharts stored in a tree-shaped data storage structure are used to realize codeless programming, so that enterprises can be used in independent information construction. There is no need for professionals to write programming languages to complete the required application software, allowing enterprises to quickly and cost-effectively have independent information construction capabilities, and improve the efficiency and rationality of resource allocation in the entire market economy.
  • the computer program product includes one or more computer instructions.
  • the computer equipment may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the computer instruction can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium.
  • the computer instruction can be transmitted from a website, computer, server, or data center through a wired (Such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center.
  • the computer-readable storage medium may be any available medium that can be stored by a computer or a data storage device such as a server or a data center integrated with one or more available media.
  • the usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).
  • the disclosed system, device, and method can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the unit is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or may also be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of the present application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods in the various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes. .
  • sequence numbers of the above-mentioned embodiments of the present invention are only for description, and do not represent the superiority or inferiority of the embodiments.
  • the terms “include”, “include” or any other variants thereof in this article are intended to cover non-exclusive inclusion, so that a process, device, article or method including a series of elements not only includes those elements, but also includes those elements that are not explicitly included.
  • the other elements listed may also include elements inherent to the process, device, article, or method. If there are no more restrictions, the element defined by the sentence "including a" does not exclude the existence of other identical elements in the process, device, article, or method that includes the element.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种多源异构数据的处理的方法,所述源异构数据的处理方法包括:从外部对象获取外部数据(S401);获取所述外部对象的类型(S403);提供数据结构图形化界面以供用户配置树形数据结构的示意图(S405);根据用户配置的树形数据结构示意图,构建树形数据存储结构(S407);根据所述外部对象的类型从预设映射函数集合中匹配对应的映射函数(S409);以及调用所述匹配的映射函数将所述外部数据映射至所述树形数据存储结构以对所述外部数据进行存储(S4011)。此外还提供一种计算机设备、以及存储介质。上述多源异构数据的处理方法可以根据用户配置的树形数据结构将不同数据结构类型的数据相映射,支持各种不同数据结构的数据,使得不同产品业务之间数据互通,实现信息、业务集中管理。

Description

多源异构数据的处理方法、计算机设备、存储介质 技术领域
本发明涉及计算机技术领域,尤其涉及一种多源异构数据的处理方法、计算机设备、存储介质。
背景技术
随着互联网技术在企业应用领域的发展,且为了降低成本以及量产,企业逐步采用了产品信息化。相应地,市场上从基本的财务、HR、OA、CRM系统建设到移动办公、决策分析等系统不断推陈出新。
一方面,企业真正的信息化需求使得一个企业在不同的业务场景下的数据是可以互通,例如,采购、排产、生产加工、销售、售后等一系列数据是连通的。但另一方面,一个企业在不同的系统之间语言、平台、技术的差异会导致信息片段化的产生。例如,每个业务场景内都需要对涉及的不同信息源(比如:商品、订单等)进行数据刻画,而不同的企业所需要的场景数据又各不相同。例如,一个企业在与其他企业业务数据进行交互时,会面临相互数据不兼容、缺失、过多等问题。即,现有的信息化产品很难达成数据互通,不同产品业务之间数据往往被隔离,业务无法协同,导致出现信息片段化以及无法实现信息、业务集中管理的目标。
可见,针对客观的信息源,在各不相同的业务场景需要刻画的结构各不相同,但在产品信息化过程中,需要不同结构的数据进行互通,才能够实现企业的信息化目标,帮助企业实现良好的资源配置,进一步帮助企业在激烈的社会竞争取得优势。因此,在产品信息化过程中,如何实现支持和创建支持各种数据结构的数据已成为亟需解决的问题。
发明内容
本发明提供一种多源异构数据的处理方法、计算机设备、存储介质,可以将各种不同数据存储结构的数据处理成用户所需的数据。
第一方面,本发明提供一种多源异构数据的处理方法,所述多源异构数据的处理方法包括:
从外部对象获取外部数据;
获取所述外部对象的类型;
提供数据结构图形化界面以供用户配置树形数据结构的示意图;
根据用户配置的树形数据结构示意图,构建树形数据存储结构;
根据所述外部对象的类型从预设映射函数集合中匹配对应的映射函数;以及
调用所述匹配的映射函数将所述外部数据映射至所述树形数据存储结构以对所述外部数据进行存储。
在一些可行的实施例中,获取外部数据之前,所述多源异构数据的处理方法还包括:
提供数据获取图形化界面以供用户配置获取数据的示意图;
根据获取数据的示意图创建获取所述外部数据的请求指令;以及
发送所述外部数据的请求指令给所述外部对象,以使所述外部对象根据所述请求指令返回所述外部数据。
在一些可行的实施例中,所述外部对象包括第三方平台,所述请求指令包括第三方接口数据访问指令,提供数据获取图形化界面之前,所述多源异构数据的处理方法还包括:
根据预设的访问第三方接口编程语句框架生成第三方接口配置图形模板,所述第三方接口配置图形模板用于供用户输入所述访问第三方接口编程语句框架相对应的接口属性数据以及需要访问的数据,所述接口属性数据用于表示所述外部对象的类型;以及
根据用户输入的接口属性数据以及需要访问的数据,配置出所述获取数据的示意图。
在一些可行的实施例中,所述外部对象包括数据库,所述请求指令包括访问数据库指令,提供数据获取图形化界面之前,所述方法具体包括:
根据预设的访问数据库编程语句框架生成对应数据库配置图形模板,所述数据库配置图形模板用于供用户输入所述访问数据库编程语句框架相对应的数据库属性数据;以及
根据用户输入的数据库属性数据配置出所述获取数据的示意图。
在一些可行的实施例中,所述数据结构图形化界面包括提供操作数据库的 数据库编程语句框架对应的图标,所述数据库编程语句框架包括多种类型软件开发语言所对应的数据库编程语句框架,所述同类型语言的操作数据库的编程语句框架还包括表示对数据库进行相同操作的不同类型软件开发语言的数据库编程语句框架,所述不同类型软件开发语言用于表示对数据库进行同种操作的数据库编程语言框架对应相同的图标。
在一些可行的实施例中,所述多源异构数据的处理方法还包括:
响应用户对所述图标的搭建操作,生成节点互连的示意图;
响应用户对所述图标的数据配置操作,提供呈树形结构的输入框和输出框以供用户输入相应的输入数据和输出数据,所述每一输入数据与一所述外部数据对应;以及
根据树形结构的输入框中的输入数据和所述互连节点创建出所述树形数据结构。
在一些可行的实施例中,所述树形数据存储结构中的输入数据与全部或者部分所述外部数据一一对应。
在一些可行的实施例中,调用所述匹配的映射函数将所述外部数据映射至所述数据模型以对所述外部数据进行存储,具体包括:
根据所述输入数据找出所需外部数据;以及
根据所述输入数据和所述输出数据的对应关系,将所需的外部数据利用所述树形数据结构进行存储。
本发明还提供一种计算机设备,所述计算设备包括:
存储器,所述存储器用于存储计算机可执行程序;以及
处理器,所述处理器用于执行所述可执行程序以实现如上述所述的多源异构数据的处理方法。
本发明还提供一种存储介质,所述存储介质用于存储计算机可执行程序,所述计算机可执行程序由处理器执行以实现如上述所述的多源异构数据的处理方法。
上述多源异构数据的处理方法、计算机设备、存储介质,可以根据用户配置的树形数据结构将不同数据结构类型的数据相映射,支持各种不同数据结构的数据,使得不同产品业务之间数据互通,实现信息、业务集中管理。
附图说明
图1为本发明第一实施例提供的一种具有多源异构数据的处理功能的软件开发程序运行的环境示意图。
图2为本发明第一实施例提供的树形图示意图。
图3为本发明第一实施例提供的计算机设备的内部结构示意图。
图4为本发明第一实施例提供的实现多源异构数据的处理方法流程示意图。
图5为本发明第一实施例提供的实现多源数据的处理过程示意图。
图6为本发明第一实施例提供多源数据的处理方法的用户界面示意图。
图7为本发明第一实施例提供第一实施例提供多源异构数据的处理方法的子流程示意图。
图8为本发明第二实施例提供第一实施例提供实现多源异构数据的处理方法的子流程示意图。
图9为本发明第二实施例提供多源异构数据的处理方法的用户界面示意图。
图10为本发明第三实施例提供的多源异构数据的处理方法的子流程示意图。
图11为本发明第四实施例提供的多源异构数据的处理方法的子流程示意图。
图12为本发明第三实施例提供的多源异构数据的处理方法的用户界面示意图。
具体实施方式
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外,术语“包括”和“具 有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
需要说明的是,在本发明中涉及“第一”、“第二”等的描述仅用于描述目的,而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。另外,各个实施例之间的技术方案可以相互结合,但是必须是以本领域普通技术人员能够实现为基础,当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在,也不在本发明要求的保护范围之内。
请参看图1,其为第一实施例提供的具有多源异构数据的处理功能的软件开发程序运行的环境示意图。具有多源异构数据的处理功能的软件开发系统1000包括客户端1001、后台服务器端1002、以及提供源数据的外部对象1004。后台服务器端1002通过网络1003与客户端1001通讯。外部对象1004可以为数据库、第三方接口、数据表等。数据库包括但不限于MySQL、Oracle、NOSQL等;第三方接口包括但不限于Web Service接口、RPC接口、HTTP接口等;数据表可以为EXCEL文档、Word文档等。不同的外部对象1004存储的数据结构各不相同。在本实施例中,后台服务器端1002提供相应的图形化配置界面供用户配置出用树形数据结构表示的情报要素。后台服务器端1002根据用户配置的树形数据结构将外部对象1004提供的源数据包含的情报要素映射至用户配置的树形数据结构中。
如图2所示树形图T,树形图T包括多个节点t1。若用树形图T对一个对象进行分解,可以无限极地进行分解。可以理解地,若一个对象用树形结构进行刻画,可以根据需要从各个维度对该对象进行刻画,即利用树形结构总能刻画出一个对象在各种业务场景所需要的情报要素。例如,在刻画中国政府(对象)时,可以按照树形结构划分,则可以划分至具体的某一个小组,如一个家庭(节点)。换句话说,用树形数据结构可以将不同的数据结构中的任一数据/情报要素都对应至树形结构的一个节点t1上。因此,采用树形数据结构可以承接任意一种数据结构的源数据的情报要素。
请结合参看图3,其为第一实施例提供的计算机设备800的内部结构示意图。在本实施例中,客户端1001和服务器端1002分别安装具有多源异构数据的处理功能的软件开发程序的客户端和服务器端程序的计算机设备。计算机设备可以为平板电脑、台式计算机、笔记型计算机。计算机设备可以装载有
Figure PCTCN2020088496-appb-000001
Figure PCTCN2020088496-appb-000002
等操作系统。计算机设备800包括存储介质801、处理器802和总线803。其中,存储介质801至少包括一种类型的可读存储介质,该可读存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如,SD或DX存储器等)、磁性存储器、磁盘、光盘等。存储介质801在一些实施例中可以是计算机设备800的内部存储单元,例如计算机设备800的硬盘。存储介质801在另一些实施例中也可以是的外部计算机设备800存储设备,例如计算机设备800上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进一步地,存储介质801还可以既包括计算机设备800的内部存储单元也包括外部存储设备。存储介质801不仅可以用于存储安装于计算机设备800的应用软件及各类数据,例如实现多源异构数据处理程序指令等,还可以用于暂时地存储已经输出或者将要输出的数据。
总线803可以是外设部件互连标准(peripheral component interconnect,简称PCI)总线或扩展工业标准结构(extended industry standard architecture,简称EISA)总线等。该总线可以分为地址总线、数据总线、控制总线等。为便于表示,图2中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。
进一步地,计算机设备800还可以包括显示组件804。显示组件804可以是LED(Light Emitting Diode,发光二极管)显示器、液晶显示器、触控式液晶显示器以及OLED(Organic Light-Emitting Diode,有机发光二极管)触摸器等。其中,显示组件804也可以适当的称为显示装置或显示单元,用于显示在计算机设备800中处理的信息以及用于显示可视化的用户界面。
进一步地,计算机设备800还可以包括通信组件805,通信组件805可选的可以包括有线通信组件和/或无线通信组件(如WI-FI通信组件、蓝牙通信组件等),通常用于在计算机设备800与其他计算机设备之间建立通信连接。
处理器802在一些实施例中可以是一中央处理器(Central Processing Unit, CPU)、控制器、微控制器、微处理器或其他数据处理芯片,用于运行存储介质801中存储的程序代码或处理数据。具体地,处理器802执行多源异构数据的处理程序以控制计算机设备800实现多源异构数据的处理方法。
可以理解地,图3仅示出了具有组件801-805以及实现多源异构数据处理程序01的计算机设备800,本领域技术人员可以理解的是,图3示出的结构并不构成对计算机设备800的限定,可以包括比图示更少或者更多的部件,或者组合某些部件,或者不同的部件布置。
请参看图4,其为第一实施例提供的实现多源异构数据的处理方法流程示意图。实现多源异构数据的处理方法包括下面步骤。
步骤S401,从外部对象获取外部数据。在一些可行的实施例中,如图5所示,外部对象1004用于提供外部数据。外部对象1004可以为数据库D1、第三方接口D2、数据表D3等。数据库D1包括但不限于MySQL、Oracle、NOSQL等;第三方接口D2包括但不限于Web Service接口、RPC接口、HTTP接口等;数据表D3可以为EXCEL文档、Word文档等。不同的外部对象1004存储的数据结构各不相同。
在一些可行的实施例中,若用户想获取外部对象1004提供的外部数据,可以通过编写代码的方式向相应的外部对象发出请求。然后,外部对象1004响应该请求并返回请求数据,从而可以从外部对象1004获取到外部对象1004提供的源数据。
在一些可行的实施例,从外部对象1004获取外部数据无需通过用户编写代码。可以理解地,不同的外部对象1004提供的数据结构不同,因此,在获取不同的数据对象1004中数据,所采用的获取方式也不一致。如何无需通过用户编写代码实现获取外部数据将具体将在下文描述。
步骤S403,获取外部对象的类型。在一些可行的实施例中,外部对象1004的类型根据数据结构的类型进行划分。数据结构的类型用属性进行表示。例如,不同类的外部对象1004,如数据库D1、第三方接口D2、数据表D3采用的属性/数据结构不同。甚至,同类的外部对象1004,也具有不同的属性/数据结构。例如,数据库D1包括MySQL、Oracle、NOSQL。又例如,多个外部对象1004都是数据库,但不同类型的数据库采用的数据结构不同,即在不同的数据库中对情 报要素采用了不同的数据结构进行存储。
步骤S405,提供数据结构图形化界面以供用户配置树形数据结构示意图。在一些可行的实施例中,如图6所示,数据结构图形化界面101所搭建的图形示意图102为用互连的多个节点1021构成的流程图或者是关系图。数据结构图形化界面101提供以树形数据结构展示的输入框1010和输出框1011以供用户配置相应节点1021的输入数据/情报要素和输出数据/情报要素,从而限制输入数据和输出输出数据仅以树形结构配置。各节点1021下的输入数据和输出输出数据可以通过各节点1021进行关联,关联的节点1021中一者的输出输出数据为另一者或者多者提供输入情报要素,可以将各个节点1021上得输入数据和输出数据进行关联。
数据结构图形化界面101还包括提供数据处理逻辑编程语句框架对应的图标103。数据处理逻辑编程语句框架包括多种类型软件开发语言所对应的数据处理逻辑编程语句框架,同类型语言的数据处理逻辑编程语句框架还包括表示对数据进行相同处理的不同类型软件开发语言的数据处理逻辑编程语句框架,不同类型软件开发语言用于表示对数据进行相同处理的数据库编程语言框架对应相同的图标。例如,用户通过拖拽来选择图标103,则生成相应的节点1021。节点1021具有连接端。用户通过在两个节点1021的连接端进行连接操作,则通过配置线1022将两个节点1021进行关联。在树形数据结构的示意图101中,各节点1021与操作数据库的数据库编程语句框架相关联。
具体地,步骤S405进一步包括下面步骤:步骤S4051,响应用户对图标103的数据配置操作,提供呈树形结构的输入框1010和输出框1011以供用户输入相应的输入数据和输出数据,每一输入数据与一外部数据对应。步骤S4052,根据树形结构的输入框中的输入数据和互连节点创建出图形示意图102。
步骤S407,根据用户配置的树形数据结构示意图,构建树形数据存储结构。在一些可行的实施例中,开发人员通过编码实现构建树形数据存储结构。在一些可行的实施例中,构建树形数据存储结构无需用户端通过编码实现。
如图7所示,步骤S407进一步包括:步骤S4071,解析根据用户配置的树形数据结构示意图获得树形数据结构的配置信息。树形数据结构的配置信息包括用于表示各节点1021的数据处理逻辑编程语句框架信息、表示数据处理逻辑 编程语句框架信息的先后顺序信息、以及表示各节点1021的输入数据和输出数据信息。步骤S4072,根据树形数据结构的配置信息获取各节点1021所关联的数据处理逻辑编程语句框架、获取各数据处理逻辑编程语句框架信息的输入数据和输出数据、和获取各数据处理逻辑编程语句框架顺序。步骤S4073,将各节点1021的各输入数据和输出数据和各数据处理逻辑编程语句框架一一对应,利用树形数据结构进行关联构建出用于表示与用户配置的树形数据结构相一致的树形数据存储结构。
S409,根据外部对象的类型从预设映射函数集合中匹配对应的映射函数。可以理解地,在对不同的外部对象1004中的数据转换都采用用户配置的树形数据结构进行存储时,则会采用不同映射函数一一对应映射。
请结合参看图5,映射函数集N包括映射函数N 1~n。当外部对象1004为某属性的数据库D1时,采用映射函数N 1。当外部对象1004为某属性的第三方接口D2,采用映射函数N n-1。当外部对象1004为某属性的数据表D3时,采用映射函数N n。在一些可行的实施例中,查找匹配的映射函数时,皆需要从映射函数N 1~n中查找。在一些可行的实施例中,为了快速查找到匹配的映射函数,还可以根据外部对象1004的类型将映射函数集N划分为多个映射函数子集。例如,将外部对象1004为数据库划的分为一个映射函数子集;当外部对象1004为某一属性的数据库,例如,MySQL数据库,可以在对应的映射函数子集中查找即可。
步骤S4011,调用匹配的映射函数将外部数据映射至树形数据存储结构以对外部数据进行存储。可以理解地,映射函数与外部对象1004的类型进行匹配,即便一个对象的情报要素采用不同的数据结构存储,最终都可以根据用户的配置获得用户所需的情报要素。具体地,步骤S4011进一步包括:步骤S40110,根据输入数据找出所需外部数据。步骤S40111,根据输入数据和输出数据的对应关系,将所需的外部数据利用树形数据结构进行存储。
请结合参看图8,其为步骤S401子流程示意图。在本实施例中,从外部对象获取外部数据无需通过开发人员编写程序代码。具体地,步骤S401包括下面步骤。
步骤S801,提供数据获取图形化界面以供用户配置获取数据的示意图。在 本实施例中,数据获取图形化界面提供输入框、按钮等控件以供用户配置出用图表形式的示意图,如图9和图12所示。用户可以通过输入框配置所需要参数。
步骤S803,根据获取数据的示意图创建获取所述外部数据的请求指令。在本实施例中,多源异构数据的处理功能提供识别示意图并产生对应的请求指令,无需同构编程的方式编写访问外部数据的代码。具体地,多源异构数据的处理功能的软件开发程序还提供预设的访问外部对象的编程语句框架。例如,访问外部对象的编程语句框架包括访问数据库的编程语句框架、访问第三方接口的编程语句框架。不同类型的数据库所对应的访问数据库的编程语句框架不一样。同理,不同类型的第三方接口的编程语句框架也不一样。根据获取数据的示意图创建获取所述外部数据的请求指令具体为:根据预设的访问外部对象的编程语句框架及参数进行组合创建出获取所述外部数据的请求指令。
步骤S805,发送外部数据的请求指令给外部对象,以使外部对象根据请求指令返回外部数据。
请结合参看图10-图11,不同的外部对象1004提供的数据结构不同,因此,在获取不同的数据对象1004中的数据,所采用的获取方式也不一致。请参看图10,图10是从第三方平台提供的第三方接口D2获取源数据的流程示意图。请参看图11,图11是从数据库D1获取源数据的流程示意图。
请再次参看图10和图12,在提供数据获取图形化界面之前,多源异构数据的处理方法还包括下面步骤。
步骤S1002,根据预设的访问第三方接口编程语句框架生成第三方接口配置图形模板,第三方接口配置图形模板用于供用户输入所述访问第三方接口编程语句框架相对应的接口属性数据以及需要访问的数据,接口属性数据用于表示外部对象1004的类型。
步骤S1004,根据用户输入的接口属性数据以及需要访问的数据,配置出获取数据的示意图。
请结合参看图11和图9,在提供数据获取图形化界面之前,多源异构数据的处理方法还包括下面步骤。
步骤S1101,根据预设的访问数据库编程语句框架生成对应数据库配置图形模板,数据库配置图形模板用于供用户输入访问数据库编程语句框架相对应的 数据库属性数据;以及
步骤S1103,根据用户输入的数据库属性数据配置出获取数据的示意图。
本发明提供的一种多源异构数据的处理方法、计算机设备、存储介质,利用树形数据存储结构进行存储的情报要素和流程图组合来实现无代码编程,从而让企业在自主信息建设时无需通过专业人员编写程序设计语言完成所需应用软件,让企业快速低成本的拥有自主信息化建设能力,提升企业在整个市场经济活动中的资源配置效率与合理性。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。
该计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行该计算机程序指令时,全部或部分地产生按照本发明实施例的流程或功能。该计算机设备可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。该计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一计算机可读存储介质传输,例如,该计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。该计算机可读存储介质可以是计算机能够存储的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。该可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,该单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机 械或其它的形式。
该作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
该集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、流动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
需要说明的是,上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。并且本文中的术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、装置、物品或者方法不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、装置、物品或者方法所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、装置、物品或者方法中还存在另外的相同要素。
以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。

Claims (10)

  1. 一种多源异构数据的处理方法,其特征在于,所述多源异构数据的处理方法包括:
    从外部对象获取外部数据;
    获取所述外部对象的类型;
    提供数据结构图形化界面以供用户配置树形数据结构示意图;
    根据用户配置的树形数据结构示意图,构建树形数据存储结构;
    根据所述外部对象的类型从预设映射函数集合中匹配对应的映射函数;以及
    调用所述匹配的映射函数将所述外部数据映射至所述树形数据存储结构以对所述外部数据进行存储。
  2. 如权利要求1所述的多源异构数据的处理方法,其特征在于,获取外部数据之前,所述方法还包括:
    提供数据获取图形化界面以供用户配置获取数据的示意图;
    根据获取数据的示意图创建获取所述外部数据的请求指令;以及
    发送所述外部数据的请求指令给所述外部对象,以使所述外部对象根据所述请求指令返回所述外部数据。
  3. 如权利要求1所述的多源异构数据的处理方法,其特征在于,所述外部对象包括第三方平台,所述请求指令包括第三方接口数据访问指令,提供数据获取图形化界面之前,所述方法具体包括:
    根据预设的访问第三方接口编程语句框架生成第三方接口配置图形模板,所述第三方接口配置图形模板用于供用户输入所述访问第三方接口编程语句框架相对应的接口属性数据以及需要访问的数据,所述接口属性数据用于表示所述外部对象的类型;以及
    根据用户输入的接口属性数据以及需要访问的数据,配置出所述获取数据的示意图。
  4. 如权利要求1所述的多源异构数据的处理方法,其特征在于,所述外部对象包括数据库,所述请求指令包括访问数据库指令,提供数据获取图形化界面之前, 所述方法具体包括:
    根据预设的访问数据库编程语句框架生成对应数据库配置图形模板,所述数据库配置图形模板用于供用户输入所述访问数据库编程语句框架相对应的数据库属性数据;以及
    根据用户输入的数据库属性数据配置出所述获取数据的示意图。
  5. 如权利要求1所述的多源异构数据的处理方法,其特征在于,所述数据结构图形化界面包括提供操作数据库的数据库编程语句框架对应的图标,所述数据库编程语句框架包括多种类型软件开发语言所对应的数据库编程语句框架,所述同类型语言的操作数据库的编程语句框架还包括表示对数据库进行相同操作的不同类型软件开发语言的数据库编程语句框架,所述不同类型软件开发语言用于表示对数据库进行同种操作的数据库编程语言框架对应相同的图标。
  6. 如权利要求5所述的多源异构数据的处理方法,其特征在于,所述方法还包括:
    响应用户对所述图标的搭建操作,生成节点互连的示意图;
    响应用户对所述图标的数据配置操作,提供呈树形结构的输入框和输出框以供用户输入相应的输入数据和输出数据,所述每一输入数据与一所述外部数据对应;以及
    根据树形结构的输入框中的输入数据和所述互连节点创建出所述树形数据结构。
  7. 如权利要求5所述的多源异构数据的处理方法,其特征在于,所述树形数据存储结构中的输入数据与全部或者部分所述外部数据一一对应。
  8. 如权利要求7所述的多源异构数据的处理方法,其特征在于,调用所述匹配的映射函数将所述外部数据映射至所述数据模型以对所述外部数据进行存储,具体包括:
    根据所述输入数据找出所需外部数据;以及
    根据所述输入数据和所述输出数据的对应关系,将所需的外部数据利用所述树形数据结构进行存储。
  9. 一种计算机设备,其特征在于,所述计算设备包括:
    存储器,所述存储器用于存储计算机可执行程序;以及
    处理器,所述处理器用于执行所述可执行程序以实现如权利要求1~8所述的多源异构数据的处理的方法。
  10. 一种存储介质,其特征在于,所述存储介质用于存储计算机可执行程序,所述计算机可执行程序由处理器执行以实现如权利要求1~8所述的多源异构数据的处理的方法。
PCT/CN2020/088496 2020-04-30 2020-04-30 多源异构数据的处理方法、计算机设备、存储介质 WO2021217659A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/088496 WO2021217659A1 (zh) 2020-04-30 2020-04-30 多源异构数据的处理方法、计算机设备、存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/088496 WO2021217659A1 (zh) 2020-04-30 2020-04-30 多源异构数据的处理方法、计算机设备、存储介质

Publications (1)

Publication Number Publication Date
WO2021217659A1 true WO2021217659A1 (zh) 2021-11-04

Family

ID=78331676

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/088496 WO2021217659A1 (zh) 2020-04-30 2020-04-30 多源异构数据的处理方法、计算机设备、存储介质

Country Status (1)

Country Link
WO (1) WO2021217659A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115439015A (zh) * 2022-10-20 2022-12-06 国家电投集团科学技术研究院有限公司 基于数据中台的局域电网数据管理方法、装置及设备
US20230034198A1 (en) * 2021-07-28 2023-02-02 Red Hat, Inc. Using dynamic data structures for storing data objects
CN116627619A (zh) * 2023-07-24 2023-08-22 山东华科信息技术有限公司 多业务异质资源调度的云边端协同信息交互方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102053987A (zh) * 2009-11-06 2011-05-11 商业对象软件有限公司 用于显示和修改数据数组的统一接口
US20170109352A1 (en) * 2015-10-20 2017-04-20 International Business Machines Corporation Concurrent bulk processing of tree-based data structures
CN107209630A (zh) * 2014-12-19 2017-09-26 汤姆逊许可公司 用于渲染树结构的数据处理设备和方法
CN107491478A (zh) * 2017-07-03 2017-12-19 广东南方数码科技股份有限公司 基于直观流程图的数据处理方法、电子设备及存储介质
CN110377598A (zh) * 2018-04-11 2019-10-25 西安邮电大学 一种基于智能制造过程的多源异构数据存储方法
CN110618983A (zh) * 2019-08-15 2019-12-27 复旦大学 基于json文档结构的工业大数据多维分析与可视化方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102053987A (zh) * 2009-11-06 2011-05-11 商业对象软件有限公司 用于显示和修改数据数组的统一接口
CN107209630A (zh) * 2014-12-19 2017-09-26 汤姆逊许可公司 用于渲染树结构的数据处理设备和方法
US20170109352A1 (en) * 2015-10-20 2017-04-20 International Business Machines Corporation Concurrent bulk processing of tree-based data structures
CN107491478A (zh) * 2017-07-03 2017-12-19 广东南方数码科技股份有限公司 基于直观流程图的数据处理方法、电子设备及存储介质
CN110377598A (zh) * 2018-04-11 2019-10-25 西安邮电大学 一种基于智能制造过程的多源异构数据存储方法
CN110618983A (zh) * 2019-08-15 2019-12-27 复旦大学 基于json文档结构的工业大数据多维分析与可视化方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230034198A1 (en) * 2021-07-28 2023-02-02 Red Hat, Inc. Using dynamic data structures for storing data objects
CN115439015A (zh) * 2022-10-20 2022-12-06 国家电投集团科学技术研究院有限公司 基于数据中台的局域电网数据管理方法、装置及设备
CN115439015B (zh) * 2022-10-20 2023-04-07 国家电投集团科学技术研究院有限公司 基于数据中台的局域电网数据管理方法、装置及设备
CN116627619A (zh) * 2023-07-24 2023-08-22 山东华科信息技术有限公司 多业务异质资源调度的云边端协同信息交互方法及系统
CN116627619B (zh) * 2023-07-24 2023-10-10 山东华科信息技术有限公司 多业务异质资源调度的云边端协同信息交互方法及系统

Similar Documents

Publication Publication Date Title
JP6736173B2 (ja) データベースへの自然言語インタフェースのための方法、システム、記録媒体およびコンピュータ・プログラム
US11030247B2 (en) Layered graph data structure
WO2021217659A1 (zh) 多源异构数据的处理方法、计算机设备、存储介质
WO2021217660A1 (zh) 实现图形化无代码开发用户界面的方法、计算机设备、存储介质
US8438190B2 (en) Generating web services from business intelligence queries
US10180984B2 (en) Pivot facets for text mining and search
US10042921B2 (en) Robust and readily domain-adaptable natural language interface to databases
US10915532B2 (en) Supporting a join operation against multiple NoSQL databases
US9746932B2 (en) Gesture inferred vocabulary bindings
US11561972B2 (en) Query conversion for querying disparate data sources
WO2021217661A1 (zh) 一种实现图形化无代码软件开发平台及方法、计算机设备及存储介质
WO2019134340A1 (zh) 薪资计算方法、应用服务器及计算机可读存储介质
US10261808B2 (en) Access operation with dynamic linking and access of data within plural data sources
JP2009530738A (ja) サービスシーケンス内の変換のための宣言
US20220121632A1 (en) Dynamic inclusion of custom columns into a logical model
US11157467B2 (en) Reducing response time for queries directed to domain-specific knowledge graph using property graph schema optimization
US20190370375A1 (en) Enabling data source extensions
US11609924B2 (en) Database query execution on multiple databases
CN113590085B (zh) 多源异构数据的处理方法、计算机设备、存储介质
WO2021217656A1 (zh) 快速开发软件的方法、计算机设备、及存储介质
US20230027897A1 (en) Rapid development of user intent and analytic specification in complex data spaces
US11797561B2 (en) Reducing character set conversion
US11520842B2 (en) Figure driven search query
US20230259517A1 (en) Business application process and system
WO2021217657A1 (zh) 快速开发软件的方法、计算机设备、及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20933740

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 15.03.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20933740

Country of ref document: EP

Kind code of ref document: A1