JP2020140588A - Data processing system - Google Patents

Abstract

To provide a data processing system with better operability.SOLUTION: A processing system for performing data processing is provided, comprising a storage unit configured to store data processing processes for an operation target data item in a processing order, and an image generation unit configured to generate the data processing processes to display the same in the processing order. The image generation unit provisionally performs specific data processing to generate a result for display.SELECTED DRAWING: Figure 6

Description

The present disclosure relates to a data processing system in which a user visually displays a processing target and processing contents when performing predetermined processing on a plurality of data.

Conventionally, a plurality of data that are distributed and managed on a daily basis (for example, master data such as store / product data and individual data such as sales data for each store) are integrated for a predetermined purpose such as sales analysis. At that time, data correction (for example, cleansing processing) such as deduplication between data and name identification is performed in advance.

The cleansing process is often executed periodically by a batch process, but a technique for performing the cleansing process in real time and executing data integration in response to a user request is disclosed (Patent Document 1).

Japanese Unexamined Patent Publication No. 2017-08475

However, although Patent Document 1 discloses a technique in which a user selects a table to be processed, executes a predetermined cleansing process, and displays an execution result in a preview through a user interface, it includes beginners. Considering the operability of a wide range of users, it is still difficult to understand the processing contents.

Therefore, an object of the present disclosure is to provide a data processing system with higher operability.

In one aspect of the present disclosure, the processing system that executes data processing stores the data processing for the data item to be operated in the order of processing, and displays the storage unit and the data processing in the order of the processing. The image generation unit has an image generation unit to be generated in the above, and the image generation unit tentatively executes a specific data process and generates a result for display.

According to the present disclosure, it is possible to provide a data processing system with higher operability.

It is a block block diagram which shows the data processing system which concerns on 1st Embodiment of this disclosure. It is a functional block block diagram which shows the server apparatus 100 of FIG. It is a functional block block diagram which shows the terminal apparatus 200 of FIG. It is a schematic diagram which shows an example of the processing target data stored in a server 100. This is an example of a cleansing operation user interface displayed on the terminal device 200 according to the first embodiment of the present disclosure. This is an example of a processing history display user interface displayed on the terminal device 200 according to the first embodiment of the present disclosure. This is an example of a flowchart of the cleansing process according to the first embodiment of the present disclosure. This is an example of a flowchart of the processing history display process according to the first embodiment of the present disclosure. This is another example of the flowchart of the processing history display processing according to the first embodiment of the present disclosure.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. It should be noted that the embodiments described below do not unreasonably limit the contents of the present disclosure described in the claims. In addition, not all of the components shown in the embodiments are essential components of the present disclosure.

(Embodiment 1)
<Composition>
FIG. 1 is a block configuration diagram showing a data processing system 1 according to the first embodiment of the present disclosure. This data processing system 1 performs data processing / correction (for example, cleansing processing) on distributed management data for a predetermined purpose (for example, marketing analysis), executes data combination, and markets. This is a system for outputting as a report. It should be noted that the purpose is marketing analysis, and the output is a marketing report, which is not limited to this, and may be a report for other purposes. Further, as the distributed management data, the number of distributed managed data is not limited as long as at least two or more data are separately managed, regardless of the number of distributed data. Further, the data format is not limited to the csv file as an example.

The data processing system 1 has a server device (data processing device) 100, a terminal device 200, and a network NW. The server device 100 and the terminal device 200 are connected via a network NW. The network NW is composed of the Internet, an intranet, a wireless LAN (Local Area Network), a WAN (Wide Area Network), and the like.

The server device 100 is a device that processes data, and may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing.

The terminal device 200 is an information processing device owned by a user who uses the data processing system 1, for example, a personal computer or a tablet terminal, but may be configured by a smartphone, a mobile phone, a PDA, or the like.

In the present embodiment, the data processing system 1 includes a server device 100 and a terminal device 200, and the terminal device 200 is used to perform an operation on the server device 100. However, the server device 100 is configured as a stand-alone device. The server device 100 itself may be provided with a function for the user to operate.

FIG. 2 is a functional block configuration diagram showing the server device 100 of FIG. The server device 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

The communication unit 110 is a communication interface for communicating with the terminal device 200 and the Web server 300 via the network NW, and the communication is performed according to a communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).

The storage unit 120 stores programs for executing various control processes and each function in the control unit 130, input data, and the like, and is composed of a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. To. Further, the storage unit 120 stores the data to be processed, the processing target data storage unit 121, the icon data storage unit 122 for storing the icon data to be displayed on the user interface, and the individual data processing. Has a processing flow storage unit 123 that stores the data in chronological order. Further, the storage unit 120 temporarily stores the data that has communicated with the terminal device 200 and the Web server 300. A database (not shown) storing data used for each process may be constructed outside the storage unit 120.

The control unit 130 controls the overall operation of the server device 100 by executing a program stored in the storage unit 120, and is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and the like. Will be done. The functions of the control unit 130 include an instruction receiving unit 131 from the user's terminal device 120, a data processing unit 132, and an image generation unit 133. The instruction receiving unit 131, the data processing unit 132, and the image generating unit 133 are started by a program stored in the storage unit 120 and executed by the server device 100 which is a computer (electronic computer).

When the user makes a predetermined request (such as pressing a specific icon) via a user interface such as a web screen provided by the server 100 and displayed on the terminal device 200, the instruction receiving unit 131 is provided. An instruction is received from the terminal device 200 via the communication unit 110.

The data processing unit 132 executes the corresponding data processing when the user's request is related to the data processing (for example, data cleansing or the like).

The image generation unit 133 generates image information for forming a user interface to be displayed on the terminal device 200. In particular, based on the icon data stored in the storage unit 120, various icons are arranged in a predetermined area on the user interface, and an image is generated to display a screen for the user to perform an instruction operation for data processing. To do. The processing related to the image generation unit 133 can also be executed by the GPU (Graphics Processing Unit).

FIG. 3 is a functional block configuration diagram showing the terminal device 200 of FIG. The terminal device 200 includes a communication unit 210, a display operation unit 220, a storage unit 230, and a control unit 240.

The communication unit 210 is a communication interface for communicating with the server device 100 via the network NW, and communication is performed according to a communication protocol such as TCP / IP.

The display operation unit 220 is a user interface used for the user to input an instruction and display text, an image, or the like according to the input data from the control unit 240, and the terminal device 200 is composed of a personal computer. In the case, it is composed of a display, a keyboard and a mouse, and when the terminal device 200 is composed of a tablet terminal, it is composed of a touch panel and the like. The display operation unit 220 is activated by a control program stored in the storage unit 230 and executed by a terminal device 200 which is a computer (electronic computer).

The storage unit 230 stores various control processes, programs for executing each function in the control unit 240, input data, and the like, and is composed of a RAM, a ROM, and the like. In addition, the storage unit 230 temporarily stores the communication content with the server device 100.

The control unit 240 controls the overall operation of the terminal device 200 by executing the program stored in the storage unit 230, and is composed of a CPU, a GPU, and the like.

The server device 100 may be configured to include the function of the display operation unit, and in this case, the server device 200 may not be provided with the terminal device 200.

FIG. 4 is a schematic diagram showing an example of data to be processed stored in the storage unit 120 of the server 100.

The data to be processed is stored as, for example, a csv file, and as shown in FIG. 4, the data included in the csv file alone is managed for each item. Here, the "item" corresponds to the column in the csv file, and in the example shown in FIG. 4, the value is input over a plurality of lines according to a predetermined data type for each item. The data types include integers (eg 0, 1, 2, 3), decimal numbers (eg 0, 1.1, 2.2, 4.4), boolean values (eg t (true), f (eg). (False), text (for example, hoge, hogehoge). The input values of the items include, for example, store ID, store name, member ID, member name, member rank, date of birth, address, age, gender, sales. The amount and the like can be mentioned. As the processing target data, the processing data storage unit 121 can store a plurality of csv files managed for each item.

FIG. 5 is an example of a cleansing operation user interface displayed on the terminal device 200 according to the first embodiment of the present disclosure.

First, as shown in FIG. 5A, the user interface arranges a plurality of operation icons for instructing the server device 100 to perform a predetermined data process so that the user performs a predetermined data process. Area 301 and an area 302 for displaying data items that are candidates for processing.

In the area 301, a row operation icon group 303 that performs an operation on a row of a data item, a data operation icon group 304 that performs an operation on the data included in the data item, and a data item operation icon group 305 that performs an operation on the data item are arranged. Will be done. Here, the icon group includes a plurality of operation icons, but may be composed of a single icon.

In the example shown in FIG. 5, for example, the row operation icon group 303 is composed of a “narrow down” icon that narrows down data items. The row operation icon is an icon for selecting (narrowing down) a data item to be processed with data from a plurality of data items displayed in the area 302.

Further, the data operation icon group 304 is included in, for example, a "replace" icon that replaces the data (value) included in the data item, a "type conversion" icon that converts the data type of the data included in the data item, and a data item. Includes an "extract" icon that extracts some data from the data and a "remove" icon that removes some data from the data contained in the data item.

Further, the item operation icon group 305 includes, for example, a "concatenate" icon for connecting data items, a "split" icon for dividing a data item into a plurality of data items, and a "four-rule operation" for performing four-rule operations on a data item. Includes an icon and an "IF statement" icon that creates another data item subject to the data item.

In FIG. 5A, the user first places a cursor or the like on a data item to be processed data, and selects “item_4” from a plurality of data items displayed in the area 302. In this way, the user can select the data item to be processed while visually grasping what the plurality of displayed data items are.

Subsequently, the user selects, for example, the "replace" icon from the data manipulation icon group 304, and requests the replacement process for the data included in the data item 4. Then, as shown in FIG. 5B, the replacement operation screen is displayed by a pop-up on the user interface. By displaying the operation screen visually different from the background screen in this way, the user can focus on the operation to be performed.

As shown in FIG. 5B, on the replacement operation screen, an item for specifying a condition is displayed for the data (character string) included in the data item, and the user can replace the data with the character string to be replaced. You can set the character string of. In this example, "hoge" is set as the replacement target character string, and "hogehoge" is set as the replacement character string. In addition, the item for setting the item name after the replacement operation is displayed. The user inputs the necessary input for each item and finally presses the "execute" button to execute the data replacement process.

Here, as shown in FIG. 5C, the user can increase the number of items for which conditions are specified by a necessary amount by selecting the "+ add" button on the replacement operation screen. In addition to the "character string" as the replacement target, for example, an empty item can be selected and a condition can be specified.

As a typical example of performing the replacement process, it is conceivable to correct the notational fluctuation of the company name and perform name identification. For example, if the official name "ABC Co., Ltd." is input with the character strings "ABC Co., Ltd." and "ABC Co., Ltd." in addition to "ABC Co., Ltd.", the data item replacement process is requested. Then, on the replacement operation screen, a plurality of "ABC Co., Ltd." and "ABC Co., Ltd." can be specified as replacement targets, and the character string after replacement can be specified as "ABC Co., Ltd.".

In this way, the user can request a predetermined data processing via the operation icon, and can proceed while visually understanding a series of data processing. Therefore, the disclosure of the present embodiment allows the operation. It is possible to provide a highly reliable data processing system and method.

FIG. 6 is an example of a processing history display user interface displayed on the terminal device 200 according to the first embodiment of the present disclosure.

As shown in FIG. 6A, the cleansing operation user interface shown in FIG. 5 may further include a screen for displaying the operation history. For example, the area 401 is a processing content display area adjacent to the display area 404 of the cleansing operation screen, and is an area for displaying the processing content of each processing included in the series of cleansing processing according to the processing order for each processing. is there. For example, in FIG. 6A, titles indicating a total of five processing contents are displayed, and it can be understood that the latest processing history is the replacement operation of “item 4”.

Here, the object 402 is an indicator indicating the position where the temporary processing is completed, and has a bar shape in the example of FIG. 6, and the bar is located at the lower part of the display showing the (current) processing history at the latest time. are doing. Each time the user performs and executes a cleansing operation in the area 404, a display indicating the processing content is generated in the area 401, and the bar 402 moves to the lower part of the display. The display showing the processing content is made into an object (icon in the example of FIG. 6), the user selects the processing content at a desired time point by moving the cursor or the like to the object, and a predetermined operation (processing content in FIG. 6) is displayed. The processing content can be deleted by further adding a delete icon to the described icon and selecting the delete icon). In the present embodiment, the position of the bar 402 for showing the latest processing content is arranged at the lower side, but the present invention is not limited to this, and the bar 402 can be arranged at the upper part, and the object is instead of the bar. A form of identifying and displaying an object indicating the processing content can be used, and for example, a box surrounding the object can be used, or the object can be blinked.

Further, as shown in FIG. 6B, when the user operates the bar 402 to align the bar with the lower part of the object indicating the specific cleansing operation content, the processing content up to the point indicated by the bar snaps. Since it is displayed in the area 404 as a shot screen, the processing content can be confirmed. Then, every time the user moves the bar 402 to the lower part of the object indicating the desired processing content, the processing content up to that point is displayed in the area 404. In this way, the user can go back to the past processing, review the processing content, and re-operate while visually understanding the processing history.

When the user wants to confirm the temporary process, he / she can confirm the process displayed in the process content display area 401 and save it by pressing the save button 403.

<Processing flow>
The processing flow of the data processing method executed by the data processing system 1 of the present embodiment will be described with reference to FIG. 7. FIG. 7 is an example of a flowchart showing a cleansing processing method according to the first embodiment of the present disclosure.

Here, in order to use the data processing system 1, the user accesses the server device 100 by using the Internet browser or the like of the terminal device 200, receives a predetermined authentication such as inputting an ID and a password, and logs in. By doing so, it becomes available. After this authentication, a user interface as shown in FIG. 5 is provided via a web screen or the like, and the process proceeds to step S101 shown in FIG.

First, as the process of step S101, the server device 100 receives the operation request. For example, the user operates the terminal device 200 to select data (for example, a csv file) to be processed, and in the user interface as shown in FIG. 5, a specific operation icon is selected from the operation icon group. Then, the instruction receiving unit 131 of the control unit 130 of the server device 100 receives the data addition instruction request from the terminal device 200 via the communication unit 110.

As the process of step S102, the server device 100 determines which process content the received operation request is related to. As described above, the operation icons include a line operation icon group, a data operation icon group, and an item operation icon group, and each icon group further includes each operation icon. Therefore, the instruction receiving unit of the server device 100 131 determines a specific operation request from an identifier or the like included in the operation request.

If the operation request content in S102 relates to a line operation (in the example shown in FIG. 5, a "narrowing down" operation), the server device 100 performs a line operation process as the process of step S103. For example, the data processing unit 132 of the control unit 130 of the server device 100 further provides the user's terminal device 200 with a selection screen for selecting a specific line in the data item as a line operation, from the user. Accepts the refinement request and performs the process of narrowing down to the selected data item.

When the operation request content in S102 relates to a data operation (in the example shown in FIG. 5, a "replacement" operation), the server device 100 performs a data operation process as the process in step S104. For example, the data processing unit 132 of the control unit 130 of the server device 100 further provides a replacement operation screen for replacing the data in the data item to the user's terminal device 200 as a data operation, and the data item from the user. Accepts a replacement operation request for the data contained in (for example, a condition specification for replacing the character string "hoge" with "hogehoge"), and performs the requested replacement process. Other examples of data manipulation processing include type conversion processing (converting the data type of an item), extraction processing (extracting some data from item data), and exclusion processing (some data from item data). (Remove), format processing (arrange the data format of items), name identification processing (name identification using the value of any item as a key), column sorting processing (sorting of column order), etc. ..

If the operation request content in S102 relates to an item operation (in the example shown in FIG. 5, a "concatenation" operation), the server device 100 performs an item operation process as the process of step S105. For example, the data processing unit 132 of the control unit 130 of the server device 100 provides the user's terminal device 200 with a data item selection screen for linking the data items as an item operation, and the user sends the data items. The selection request (for example, data item 1 and data item 2) is accepted, and the requested data item is concatenated. As another example of the concatenation process, it is conceivable to combine the item in which the month is input and the item in which the day is input with a hyphen. As examples of other item operations, basic processing (converting serial values to date and time), division processing (dividing a specific data item into multiple items), and four-rule calculation processing (four-rule calculation for a predetermined data item) ), "IF statement" processing (create another item on condition of a predetermined data item), additional processing (add data item), delete processing (delete data item), "ranking" processing (yes) Ranking by specific data item), reference processing (based on the ranking given by sorting by a specific item, the value of the first row, the value of the last row, the value of the previous row, 1 (Create the value in the next row, the nth value), etc.

As the process of step S106, the server device 100 further confirms whether or not the operation request has been received, ends the process if there is no operation request, and returns to S102 to confirm the processing content if the operation request is received.

FIG. 8 is an example of a flowchart of the processing history display process according to the first embodiment of the present disclosure.

First, as the process of step S201, the server device 100 receives an operation request regarding the cleansing process from the user, and performs the requested cleansing process. The operation request and the cleansing process related to the specific cleansing process are as described as S103, S104, and S105 in the flowchart shown in FIG. 7.

Subsequently, as the process of step S202, the server device 100 executes a cleansing process. This step is as described as S106 in the flowchart shown in FIG. The processing target data storage unit 121 of the storage unit 120 of the server device 100 stores the processed data, and the processing flow storage unit 123 stores the executed processing contents in order with the previously executed processing contents. ..

When the cleansing process is executed, the server device 100 creates a temporary processing object as the process of step S203. For example, the screen generation processing unit 133 of the control unit 130 of the server device 100 has the executed processing contents stored in the processing flow storage unit 123 of the storage unit 120 and the icon image stored in the icon data storage unit 122. An object describing the processing content (in the example of FIG. 6, the “replacement of item 4” icon) is generated, provided to the terminal device 200, and displayed in the area 401 on the user interface of the terminal device 200.

As the process of step S204, the server device 100 generates an indicator indicating the position of the end of the temporary process in accordance with the process of generating the temporary process object. For example, in the example shown in FIG. 6, the screen generation processing unit 133 of the control unit 130 of the server device 100 generates a temporary processing end position bar according to the generation processing of the temporary processing object, and the bar describes the processing content. Generate to be placed at the bottom of the icon. In addition, an icon describing the original temporary processing content is displayed in advance, the temporary processing end position bar is arranged at the bottom of the icon, a new cleansing process is executed, and a new temporary process is performed accordingly. When the icon describing the content is displayed, the bar arranged at the bottom of the original icon is displayed so as to move to the bottom of the newly displayed icon.

As the process of step S205, the server device 100 subsequently confirms whether or not the request for new process has been received from the terminal device 200.

If a new processing request is received in the processing of step S205, the processing proceeds to step S201, a specific cleansing process is executed, the processing contents are stored, a new temporary processing object is generated, and the temporary processing ends. Move the position indicator from its original position so that it is placed at the bottom of the new temporary processing object.

If the new processing request is not accepted in the processing of step S205, the process proceeds to step S206, and the server device 100 confirms whether the operation of saving the provisional processing contents has been accepted from the terminal device 200.

In the process of step S206, if the save operation is not received, the reception of the new processing request is waited for again, and if the save operation is received, the data processing unit 132 of the control unit 130 of the server 100 temporarily processes. Save the contents.

FIG. 9 is another example of the flowchart of the processing history display processing according to the first embodiment of the present disclosure.

First, in the process of step S301, the server device 100 confirms whether or not the operation of moving the indicator indicating the end of the temporary process has been accepted from the terminal device 200. For example, as shown in FIGS. 6A and 6B, when the user performs an operation of moving the temporary processing end position bar by a cursor or the like via the user interface of the terminal device 100, the server device 100 The instruction receiving unit 131 of the control unit 130 receives the bar movement instruction.

In the process of step S301, when the server device 100 accepts the movement operation of the indicator, subsequently, in the process of step S302, the server device 100 confirms to which data processing content the indicator has moved to the position of the object. , Determine the data processing to be selected. For example, in FIG. 6B, the bar has moved to the bottom of the icon indicating the processing content of "test replacement", and the server 100 determines that the user has selected the processing content of "test conversion". To do. The control unit 130 data processing unit 132 refers to the processing flow storage unit 123 of the storage unit 120, executes the processing contents up to the processing time point of the "test conversion", and the image generation unit 133 captures the execution result on the snapshot screen. The terminal device 200 displays the snapshot screen in the area 404 on the user interface by generating the data as.

Subsequently, in the process of step S303, the server 100 confirms whether or not the operation instructing the cleansing process has been received from the terminal device 200.

When the operation for instructing the cleansing process is accepted in the process of step S303, the server device 100 executes the cleansing process in the process of step S304, and when the instruction operation is not accepted, the server device 100 waits for the instruction.

In the process of step S305, the server device 100 updates the temporary processing object according to the processing content of step S304. For example, in step S304, when the user performs a data item division operation, the screen generation processing unit 133 of the control unit 130 of the server 100 generates an object indicating "test division" and provides it to the terminal device 200. And display the object in area 404 on the user interface.

As described above, the user can review the processing contents retroactively to the processing at an arbitrary time point and freely operate the processing contents while visually understanding the processing history through the objects and indicators indicating the processing contents. As described above, the disclosure of the present embodiment can provide a data processing system and method with high operability.

Although the embodiments related to the disclosure have been described above, these can be implemented in various other embodiments, and can be implemented by making various omissions, substitutions, and changes. These embodiments and modifications as well as those with omissions, substitutions and modifications are included in the technical scope of the claims and the equivalent scope thereof.

1 Data processing system 100 Server device, 110 Communication unit, 120 Storage unit, 130 Control unit, 200 Terminal equipment, NW network

Claims (7)

A processing system that executes data processing
A storage unit that stores data processing for data items to be operated according to the processing order,
A processing system having an image generation unit that generates the data processing in order to display the data processing in the order of the processing, and the image generation unit tentatively executes a specific data processing and generates a result for display. .. The processing system according to claim 1, wherein the data processing corresponds to any of an item operation, a data operation, and a line operation. The processing system according to claim 1, wherein the image generation unit generates an indicator indicating the specific data processing for display. The processing system according to claim 3, wherein the indicator indicating the specific data processing is in the shape of a bar. The processing system according to claim 4, wherein the image generation unit moves the bar to a position corresponding to desired data processing in response to a user request. The processing system according to claim 2, wherein the image generation unit generates an object for displaying the contents of the data processing. The processing system according to claim 1, wherein the image generation unit generates an icon for displaying the content of the data processing.