KR102199668B1 - Method for providing a service of automatically creating a workflow for processing geo spatial information, and a computer readable storage medium - Google Patents

Abstract

The present invention relates to a method for providing a service for automatically generating a workflow for processing spatial information by a user and a computer readable storage medium storing instructions for executing the method. The method comprises the steps of: (a) providing a user interface for editing a workflow for processing spatial information in response to a user′s request signal; (b) receiving edit inputs from a user; and (c) generating the workflow based on the received edit inputs.

Description

A method of providing a service that automatically creates a workflow for processing spatial information, and a computer-readable storage medium storing instructions for executing this method (METHOD FOR PROVIDING A SERVICE OF AUTOMATICALLY CREATING A WORKFLOW FOR PROCESSING GEO SPATIAL INFORMATION, AND A) COMPUTER READABLE STORAGE MEDIUM}

The present invention relates to a method for providing a service for automatically generating a workflow for processing spatial information by a user and a computer-readable storage medium storing instructions for executing the method.

As computing devices capable of processing large amounts of data have been developed, it has become possible to provide a variety of services, and along with this, the demand for more convenient new services is also constantly increasing. The demand for new services is no exception in the field dealing with spatial information, and the demand to provide various types of services is also continuously increasing by processing data on various spaces in various ways.

Meanwhile, in general, the process of processing data is basically based on the so-called ETL process consisting of extraction, transformation, and loading, and various services using spatial information mentioned above are also based on the process of extracting, transforming, and loading spatial information. Consists of. Therefore, it is expected that more and more users, that is, developers, will be able to actively develop services if an environment is provided so that users who deal with spatial information can easily design the entire process of extraction, transformation, and loading. There is a need to provide a developer environment that can meet these expectations.

The present invention was derived by focusing on such a problem, and invented to provide additional technical elements that can not be easily invented by those of ordinary skill in the art, as well as being able to solve the technical problems of salpin above. Became.

Korean Registered Patent No. 10-1641179 (2016.07.14.)

An object of the present invention is to provide a user environment so that a user can easily design and create a workflow for processing spatial information.

In particular, the present invention allows processing tools essential for spatial information processing, i.e., a tool for extracting spatial information, a tool for transformation, and a tool for loading, to be arranged with only a simple input to process various types of spatial information. It aims to be able to design workflows for use.

In addition, it is an object of the present invention to automatically generate a script in the process of creating a spatial information processing workflow after designing, so that a user-designed workflow for processing spatial information can be immediately utilized.

Meanwhile, the technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

A method of providing a service for automatically generating a workflow for processing spatial information according to an embodiment of the present invention for solving the above technical problem is: (a) Editing the workflow for processing spatial information in response to a user's request signal Providing a user interface for, (b) receiving edit inputs from a user, and (c) generating a workflow based on the received edit inputs,

According to an embodiment, the user interface may include a plurality of processing tools displayed to be selected by a user and an editing area in which processing tools selected by the user are listed.

According to an embodiment, the plurality of processing tools may include an extraction tool for extracting spatial information, a conversion tool for extracting spatial information, and a loading tool for loading spatial information. I can.

According to an embodiment, when the user selects any one of the extraction tool, the conversion tool, or the loading tool, the user interface may further display detailed items of the selected processing tool. .

According to an embodiment, the edit input received in step (b) is,

It may include an input for dragging and dropping an arbitrary processing tool selected by a user among the plurality of processing tools into the editing area.

According to an embodiment, the editing inputs received in the step (b) may include an input for connecting a plurality of processing tools arranged in the editing area with a connecting line.

According to an embodiment, the generating a workflow based on the received edit inputs comprises: defining a workflow based on an order of processing tools arranged in the editing area, and a script for the defined workflow It may include the step of generating.

According to an embodiment, the user interface may further display the generated script.

According to an embodiment, the workflow may be any one of a single workflow, a multiple extraction workflow, a multiple conversion workflow, a multiple loading workflow, or a multiple workflow.

A computer-readable storage medium storing instructions for performing a method of providing a service for automatically generating a workflow for processing spatial information according to an embodiment of the present invention for solving the above technical problem is (a) a user's request Providing a user interface for editing a workflow for processing spatial information in response to a signal, (b) receiving editing inputs from a user, and (c) creating a workflow based on the received editing inputs. Includes.

According to the present invention, there is an effect of allowing a user to easily design a workflow for processing various types of spatial information.

In addition, according to the present invention, even if the user lacks understanding of the source code, it is possible to easily design a workflow for processing spatial information if only the format of the input value and the format of the output value are known.

Meanwhile, the effects of the present invention are not limited to those mentioned above, and other technical effects that are not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram illustrating an environment in which a service providing method for automatically generating a spatial information processing workflow according to the present invention is implemented.
2 shows a process of providing a service according to the present invention.
FIG. 3 is a diagram illustrating tools for processing spatial information and a connection line connecting these tools constituting a single workflow.
4 is a diagram illustrating a user interface provided together when providing a service according to the present invention.
FIG. 5 shows detailed items of a tool for extracting spatial information, FIG. 6 shows detailed items of a tool for converting spatial information, and FIG. 7 shows detailed items of a tool for loading spatial information displayed on a user interface. It is shown.
Figure 8 lists the types of workflows that can be designed and created according to the present invention.
9 shows an actual generation example of a multiple extraction workflow, FIG. 10 is an actual generation example of a multiple transformation workflow, FIG. 11 is an actual generation example of a multiple loading workflow, and FIG. 12 is an actual generation of multiple ELT workflows It shows an example.

Details of the object and the technical configuration of the present invention and the effects of the operation thereof will be more clearly understood by the following detailed description based on the accompanying drawings in the specification of the present invention. Embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

The embodiments disclosed herein should not be construed or used as limiting the scope of the present invention. It is natural to those skilled in the art that the description including the embodiments of the present specification has various applications. Therefore, any of the embodiments described in the detailed description of the present invention are illustrative for better describing the present invention, and it is not intended that the scope of the present invention be limited to the embodiments.

The functional blocks shown in the figures and described below are only examples of possible implementations. In other implementations, other functional blocks may be used without departing from the spirit and scope of the detailed description. Further, while one or more functional blocks of the present invention are represented as individual blocks, one or more of the functional blocks of the present invention may be a combination of various hardware and software configurations that perform the same function.

In addition, the expression to include certain elements is an expression of “open type” and simply refers to the existence of the corresponding elements, and should not be understood as excluding additional elements.

Furthermore, when a component is referred to as being “connected” or “connected” to another component, it should be understood that it may be directly connected or connected to the other component, but other components may exist in the middle. do.

Prior to the full description, first, a method for providing a service for automatically generating a workflow for processing spatial information according to the present invention (hereinafter, abbreviated as a method for providing a workflow service) will be illustrated in which system environment is implemented. Let's take a brief look with reference to 1.

1 schematically shows a system in which a method for providing a workflow service according to the present invention is provided. In this system, a user terminal 100 and a service server 200 may exist in a network connection state as shown in FIG. 1.

When looking at an easy example of the method to be implemented in the present invention, for example, a user (or developer) who wants to provide a service using big data of spatial information is a user interface provided by the service server 200 in a web UI method. Through the user can directly design the workflow to be implemented, the workflow designed in this way can be re-generated in the form of a script on the user interface provided by the service server 200 and provided to the user. It can be provided in JSON format.

Meanwhile, a closer look at each of the components constituting the system shown in FIG. 1 is as follows.

First, with respect to the user terminal 100, the user terminal 100 refers to a terminal possessed or carried by the user, and includes not only an installation type terminal such as a home PC, but also a portable terminal such as a smartphone, PDA, and tablet PC. Possible terminals may also be included. When viewing such a user terminal from the side of the device, it is assumed that each user terminal has a central processing unit (CPU) and a memory. The central processing unit may also be called a controller, a microcontroller, a microprocessor, a microcomputer, or the like. In addition, the central processing unit may be implemented by hardware, firmware, software, or a combination thereof. When implemented using hardware, an application specific integrated circuit (ASIC) or a digital signal processor (DSP) , DSPD (digital signal processing device), PLD (programmable logic device), FPGA (field programmable gate array), etc., when implemented using firmware or software, modules, procedures, or functions that perform the above functions or operations Firmware or software may be configured to include. In addition, the memory is ROM (Read Only Memory), RAM (Random Access Memory), EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, SRAM (Static RAM), It may be implemented as a hard disk drive (HDD) or a solid state drive (SSD).

The user terminal 100 may be connected to one or more other means for physical user input such as a display and a physical keyboard, a mouse and/or a joystick. The user terminal is intended to allow a user to easily input observation information on an object according to a user interface in the descriptions to be described later.

Meanwhile, the service server 200 is a configuration that provides a program for actually implementing the method according to the present invention, that is, a set of commands, and further corresponds to a configuration that stores observation information input and uploaded from a plurality of user terminals. .

The form of the service server 200 may be at least one server PC managed by a specific operator, or a cloud server provided by another company, that is, a cloud server that the operator can use after signing up for membership. have. In particular, when the service server is implemented as a server PC, the service server may include a central processing unit and a memory. This has been described in detail in the process of describing the user terminal, and thus a description thereof will be omitted.

2 is a flowchart illustrating a method of providing a workflow service according to the present invention. 2, the method of providing a workflow service is largely a step of uploading big data for processing spatial information (S101), a step of providing a user interface for editing a workflow (S103), and receiving an edit input from a user. It may include step S105 and step S107 of creating a workflow.

First, the step of uploading big data for spatial information processing (S101) can be understood as a step of uploading a large amount of big data necessary for providing a random spatial information service to the service server 200 in advance by the user, From the perspective of the service server 200 by changing the viewpoint, it may be understood as a step of receiving the data when the user uploads a large amount of data to be processed using the user terminal 100. There may be various types of spatial information to be processed, and for example, shape files, csv files, JSON files, TXT files, and other various formats may exist. On the other hand, the step S101 does not necessarily mean a step of directly uploading designated data files while the user is connected to the service server 200, but accesses a specific location (URL address, etc.) input by the user and It can also be understood as the step of receiving data. That is, it is understood that step S101 can include all of the basic data for processing spatial information in the service server 200, regardless of the situation, as long as basic data for processing spatial information can be stored.

For reference, it is understood that step S101 may be performed after the user logs in according to the web UI provided by the service server 200, and all the steps to be described later may also be performed while the user is logged in.

After step S101, the service server 200 provides a user interface so that the user can edit the workflow, and through this, can receive an edit input from the user. (S103 and S105) The workflow referred to in this detailed description is defined as one workflow that includes all of the process of extracting, transforming, and loading spatial information, and each workflow is It can be designed according to various spatial information processing environments, such as whether it is extracted from a file of a format, in what format spatial information should be converted, and in what database the spatial information should be loaded. In connection with the design of the workflow proposed in the present invention, a simplified conceptual diagram is shown in FIG. 3.

3, one workflow may basically include three tools, and the tools include an extraction tool 10 for extracting spatial information, and a conversion tool for converting spatial information ( 20), a loading tool 30 for loading spatial information may be included. In addition, the meaning of designing a workflow may be understood as including a process of arranging the above tools one by one and connecting each of the arranged tools with a connecting line 50. The connecting line 50 connects one tool to another tool. In this case, the start of the connecting line 50 is a tool that must exist in the previous step, and the end is normally input only when it is connected to a tool that must exist in a later step. Can be. Referring to FIG. 3, each tool is not limited to only one arrangement, and two or more tools may be arranged at the same time, and a plurality of connection lines 50 may also be input accordingly.

Meanwhile, a user interface capable of designing, ie, editing, the workflow as shown in FIG. 3 is shown in FIG. 4. 4 illustrates a user interface that the user can see through the display of the user terminal 100, which may be provided by the service server 200.

Referring to FIG. 4, information on a user currently logged in may be displayed on the left side of the user interface, and several other menus may be displayed. In addition, a tool bar 1000 that a user can select may be displayed at the top of the user interface. Although mentioned above, icons corresponding to each may be displayed on the processing tool collection 1000 so as to select an extraction tool, a conversion tool, and a loading tool. When the user clicks the extraction tool icon, detailed items of the extraction tools may be further displayed as a list on the user interface. This example is shown in FIG. 5.

5 is a listing of various types of extraction tools so that a user can select an extraction tool, and a description 1001 of the role of the corresponding tool may be described for each extraction tool. . For example, a description indicating that importShpFromLocal among the extraction tools is to extract spatial information from a shape-format file stored in a local area may be described. In FIG. 5, it can be seen that other extraction tools such as importCsvFromLocal, importGeoJsonFromLocal, importTwitter, importGeoSensor, etc., and descriptions corresponding to each are described. For reference, among the tools for extraction shown in FIG. 5, a tool for extracting spatial information from a shapefile (importShpFromLocal), a tool for extracting spatial information from a CSV file of Microsoft Corporation (importCsvFromLocal), a JSON file in an open standard format A tool for extracting spatial information from a file (importJsonFromLocal) and a tool for extracting spatial information from a general TXT file (importTxtFromLocal) are tools for extracting spatial information whose spatial information type is a batch type. In addition, among the extraction tools shown in FIG. 5, importTwitter, importGeoSensor, etc. are tools for extracting spatial information having a spatial information type of a stream type. For reference, the stream-type spatial information referred to in this detailed description is understood to mean spatial data that can be collected on the network, and is generated in real time, such as various types of social network services and real-time media networks of portal sites. It can be understood to mean spatial data that can be derived from sources on a network that can be delivered. In addition, the stream-based spatial data referred to in this detailed description may include not only social network services, but also data generated by various types of spatial sensors connected through a network. The spatial sensor referred to in the detailed description herein is generally understood to refer to a sensing device capable of generating other data including location information. For example, a meteorological sensor is a type of spatial sensor, and the meteorological sensor is installed at a specific location to transmit weather information such as temperature, humidity, and illuminance at that location to the control server. The spatial sensor referred to herein is understood as a device capable of generating location information and other data as described above and transmitting it to another device.

Meanwhile, when the user clicks the tool icon for conversion or when the tool icon for loading is clicked, detailed items corresponding to each may be displayed in a list (1002, 1003) on the user interface, examples of which are respectively 6 and 7 are shown. For example, in FIG. 6, as conversion tools, convCoordinate, convInternalRecordSet, and createNewRecordSet, and in FIG. 7 as loading tools, exportToLocalShp, exportToLocalCsv, exportToLocalGeoJson, exportToHdfs, etc. are displayed as detailed items, allowing the user to select. have.

Also, an editing tool bar 1100 for editing a workflow may be displayed at the top of the user interface. In this editing toolbar (1100), a clear icon to delete a workflow design being edited, an import icon to load a previously saved workflow design file, and the contents of the workflow design created so far are saved. And a Save icon to create a script for the designed workflow.

Meanwhile, an editing area 2000 may be displayed below the processing tool collection 1000 and the editing tool collection 1100 above. The editing area 2000 is an area in which a user selects a random tool, arranges it in a drag-and-drop method, and connects each processing tool with a connection line 50. The editing area 2000 may be in a blank state in which nothing is displayed on the background, but preferably, a grid pattern as shown in FIG. 4 may be displayed to increase user convenience. On the other hand, in the editing area 2000, it is possible to relatively freely arrange processing tools and connection lines. For example, the user does not necessarily need to select and place the processing tool according to the order of the workflow, and after placing the loading tool 30 first, the remaining extraction tool 10 and the conversion tool 20 ) Can be placed, and the placement position is also said to be unlimited. In addition, the order of the workflow is finally defined by the connection line 50, and the workflow is defined by the context of the connection line 50 regardless of where the arrangement of each processing tool is located in the editing area. do.

On the other hand, when a user designs an arbitrary workflow on the user interface, the user interface may be implemented to further provide guide information so that the user can point out a wrong part of the design. For example, when inputting the connection line 50, assuming that the context is defined when the end point is connected from the start point, the user selects the loading tool 30 as the start point and the conversion tool 20 to the end point. If determined, a message indicating that the context of the workflow is wrong is popped up on the user interface, thereby inducing the user to correctly input the connection line 50 again. As another example, when the user includes the conversion tool 20 and the loading tool 30 as a configuration in the workflow without placing the extraction tool 10 and clicks the save icon, the user interface is still extracted. It is also possible to convey the correct design direction to the user by displaying a message indicating that the tool 10 is not disposed. As another example, even if processing tools that are incompatible in the context are arranged and connected, a message indicating this may be displayed on the user interface to induce the user to select and deploy another processing tool. In addition, for various error situations, the user interface may display a message so that the user can recognize and correct it.

Meanwhile, referring to FIG. 4 again, a script area 3000 may be further displayed on the user interface. The script area 3000 may be implemented to be displayed or not displayed according to a developer's selection. When implemented to be displayed, for example, when the user clicks the Save icon after completing the workflow design, a script corresponding to the designed workflow is created, and the generated script can be implemented so that it is visible on the user interface. have. Users can review this marked script once again to verify that the workflow they want to implement is designed correctly, or they can copy the script and use it in another application.

Referring back to FIG. 2, after steps S103 and S105, the service server 200 may generate a script for the workflow previously designed by the user, thereby generating a final completed workflow.

The service provided by the service server 200 and a user interface for editing a workflow provided by the service server 200 through the web have been described with reference to FIGS. 2 to 7.

8 is a list of types of workflows that a user (developer) can design using a workflow service according to the present invention. By dividing the types, it is possible to design a total of 5 workflows, specifically 1 extraction tool, 1 conversion tool, a single ETL workflow using 1 loading tool, 2 or more extraction tools, 1 1 conversion tool, multiple extraction ETL workflow using 1 loading tool, 1 extraction tool, 2 or more conversion tools, multiple conversion ETL workflow using 1 loading tool, 1 extraction tool, 1 It is possible to design a multi-load ETL workflow using two or more conversion tools, two or more loading tools, two or more extraction tools, two or more conversion tools, and a multiple ETL workflow using two or more loading tools.

An example in which a single ETL workflow is actually designed and created on the user interface is shown in FIG. 4, whereby one tool is arranged in the editing area 2000, and extraction is used by connection lines 50. The tool 10, the conversion tool 20, and the loading tool 30 are connected, and in response to the finally generated workflow, it can be confirmed that a script is generated as displayed in the script area 3000. have.

The multi-extraction ETL workflow is shown in FIG. 9, whereby, two extraction tools (importShpFromLocal and importCsvFromLocal), one conversion tool (convCoordinate), and one loading tool (exportToHdfs) are arranged. , It can be seen that the connection lines 50 started from the two extraction tools are all directed toward the conversion tool, and the connection line 50 started from the conversion tool is connected toward the loading tool.

The multi-transformation ETL workflow is shown in FIG. 10, whereby, one extraction tool (importShpFromLocal), two conversion tools (convCoordinate and createNewRecordSet), and one loading tool (exportToHdfs) are arranged. , It can be seen that the two connecting lines 50 starting from the extraction tool are connected toward each conversion tool, and the connecting lines 50 starting from the two conversion tools are all connected toward the loading tool.

The multi-loading ETL workflow is shown in Fig. 11, whereby, one extraction tool (importShpFromLocal), one conversion tool (convCoordinate), and two loading tools (exportToHdfs and exportToLocalShp) are arranged. , It can be seen that the connecting line 50 starting from the extraction tool is connected toward the conversion tool, and the two connecting lines 50 starting from the conversion tool are connected toward each of the loading tools.

A method of providing the above workflow service and a storage medium for executing this method have been described. Meanwhile, the present invention is not limited to the specific embodiments and application examples described above, and various modifications are implemented by those of ordinary skill in the art without departing from the gist of the present invention claimed in the claims. Of course, these modifications should not be understood to be distinguished from the technical spirit or prospect of the present invention.

Extraction tool 10
Conversion Tool 20
Stacking Tools 30
Connector 50
User terminal 100
Service Server 200
Processing Toolbar 1000
Edit Toolbar 1100

Claims (10)

In the method of providing a service for automatically generating a workflow for processing spatial information,
(a) providing a user interface for editing a workflow for processing spatial information in response to a user's request signal-the user interface is provided in a web UI method;
(b) receiving edit inputs from a user; And
(c) creating a workflow based on the received edit inputs;
(d) providing the generated workflow to the user in JSON format;
It characterized in that it comprises a,
The user interface,
A plurality of processing tools displayed for the user to select-The plurality of processing tools are an extraction tool for extracting spatial information, a conversion tool for extracting spatial information, and a loading tool for loading spatial information Includes-;
The editing area in which the processing tools selected by the user are arranged in a drag-and-drop method-The editing area displays a grid pattern on the background-; And
A script area in which a script corresponding to the generated workflow is displayed;
Including,
The user interface,
When the user selects any one of the extraction tool, conversion tool, or loading tool, detailed items of the selected processing tool-The detailed items include a plurality of types of processing tools and each processing tool. Include description-to indicate more,
The extraction tool is a tool for extracting spatial information from a shape file (importShpFromLocal), a tool for extracting spatial information from a CSV file (importCsvFromLocal), a tool for extracting spatial information from a JSON file (importJsonFromLocal), and a TXT file. A tool for extracting spatial information (importTxtFromLocal), and stream-type spatial information-The stream-type spatial information is applied to spatial data derived from a source of a social network or a real-time media network, and a plurality of spatial sensors connected through the network. Contains data generated by-contains tools for extracting,
The conversion tool includes a tool for converting coordinates (convCoordinate), a tool for converting an internal record set (convertInternalRecordSet), and a tool for creating a new recordset (createNewRecordSet),
The loading tool is a tool for loading a shape file in local storage (ExportToLocalShp), a tool for loading a CSV file in local storage (ExportToLocalCsv), a tool for loading a GeoJson file in local storage (ExportToLocalGeo-Json), and Contains tools for loading into Hadoop (ExportToHdfs),
In addition, the user interface,
When an incorrect edit input is received among the edit inputs received from the user, an error message is displayed.
The edit input received in step (b) is,
An input for dragging and dropping an arbitrary processing tool selected by a user among the plurality of processing tools into the editing area and an input connecting a plurality of processing tools arranged in the editing area with a connecting line-the start of the connecting line Is a tool that must exist in the previous step, and the end is normally entered only when connected to a tool that must exist in a later step-includes,
Step (c),
Define a workflow based on the order of the processing tools arranged in the editing area-The workflow is defined by the context of the connection line regardless of where the processing tools are arranged in the editing area. -To do; And generating a script for the defined workflow; and
The workflow editable on the user interface is a single workflow, a multiple extraction workflow, a multiple conversion workflow, a multiple loading workflow, and a multiple workflow,
A method of providing a service that automatically generates a workflow for processing spatial information.
delete delete delete delete delete delete delete delete In a computer-readable storage medium storing instructions for performing a method of providing a service for automatically generating a workflow for processing spatial information,
The method of providing a service that automatically generates a workflow for processing spatial information is:
(a) providing a user interface for editing a workflow for processing spatial information in response to a user's request signal-the user interface is provided in a web UI method;
(b) receiving edit inputs from a user; And
(c) creating a workflow based on the received edit inputs;
(d) providing the generated workflow to the user in JSON format;
It characterized in that it comprises a,
The user interface,
A plurality of processing tools displayed for the user to select-The plurality of processing tools are an extraction tool for extracting spatial information, a conversion tool for extracting spatial information, and a loading tool for loading spatial information Includes-;
The editing area in which the processing tools selected by the user are arranged in a drag-and-drop method-The editing area displays a grid pattern on the background-; And
A script area in which a script corresponding to the generated workflow is displayed;
Including,
The user interface,
When the user selects any one of the extraction tool, conversion tool, or loading tool, detailed items of the selected processing tool-The detailed items include a plurality of types of processing tools and each processing tool. Include description-to indicate more,
The extraction tool is a tool for extracting spatial information from a shape file (importShpFromLocal), a tool for extracting spatial information from a CSV file (importCsvFromLocal), a tool for extracting spatial information from a JSON file (importJsonFromLocal), and a TXT file. A tool for extracting spatial information (importTxtFromLocal), and stream-type spatial information-The stream-type spatial information is applied to spatial data derived from a source of a social network or a real-time media network, and a plurality of spatial sensors connected through the network. Contains data generated by-contains tools for extracting,
The conversion tool includes a tool for converting coordinates (convCoordinate), a tool for converting an internal record set (convertInternalRecordSet), and a tool for creating a new recordset (createNewRecordSet),
The loading tool is a tool for loading a shape file in local storage (ExportToLocalShp), a tool for loading a CSV file in local storage (ExportToLocalCsv), a tool for loading a GeoJson file in local storage (ExportToLocalGeo-Json), and Contains tools for loading into Hadoop (ExportToHdfs),
In addition, the user interface,
When an incorrect edit input is received among the edit inputs received from the user, an error message is displayed.
The edit input received in step (b) is,
An input for dragging and dropping an arbitrary processing tool selected by a user among the plurality of processing tools into the editing area and an input connecting a plurality of processing tools arranged in the editing area with a connecting line-the start of the connecting line Is a tool that must exist in the previous step, and the end is normally entered only when connected to a tool that must exist in a later step-includes,
Step (c),
Define a workflow based on the order of the processing tools arranged in the editing area-The workflow is defined by the context of the connection line regardless of where the processing tools are arranged in the editing area. -To do; And generating a script for the defined workflow; and
The workflow editable on the user interface is a single workflow, a multiple extraction workflow, a multiple conversion workflow, a multiple loading workflow, and a multiple workflow,
Computer-readable storage media.

Images