JP2018041168A - Information processing device, information processing system, information processing program, and information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device, information processing system, information processing program, information processing method capable of reducing processing loads of a data processing device.SOLUTION: An information processing device includes a reception unit and a processing unit. The reception unit receives job information which is input by a user. The processing unit executes first processing and second processing individually. In the first processing, a first data processing device executes tabulation processing specified by the job information with log data, which is specified by the job information, set as a tabulation target; and in the second processing, a second data processing device executes tabulation processing with part of the log data set as a tabulation target.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus, an information processing system, an information processing program, and an information processing method.

  In recent years, with the rapid spread of networks, the log data collected has become enormous. For example, a distributed processing system using a technique such as Hadoop (registered trademark) is used as a data processing apparatus that executes aggregation processing on such a large amount of log data (for example, Patent Document 1). reference).

  In order to easily use such a data processing apparatus, a program for converting job information described in a data operation language such as SQL into a job executed on the data processing apparatus has been provided. By using an information processing apparatus in which such a program is installed, log data aggregation processing by the data processing apparatus can be easily used.

JP 2014-194769 A

  However, the user who operates the information processing apparatus is often unfamiliar with the handling of the data operation language and the log data tabulation method, and the tabulation result intended by the user may not be obtained immediately. In such a case, the user may repeatedly input job information to the information processing apparatus until the intended aggregation result is obtained, and may cause the data processing apparatus to repeatedly execute processing based on the job information. This may increase the load on the data processing apparatus.

  The present application has been made in view of the above, and an object thereof is to provide an information processing apparatus, an information processing system, an information processing program, and an information processing method capable of reducing the processing load of the data processing apparatus.

  The information processing apparatus of the present application includes a reception unit and a processing unit. The reception unit receives job information input by a user. The processing unit includes a first process for causing the first data processing device to execute a totaling process specified by the job information with the log data specified by the job information as a target of aggregation, and a part of the log data as a target of aggregation. As a result, the second process for causing the second data processing apparatus to execute the aggregation process is executed individually.

  According to one aspect of the embodiment, an information processing apparatus, an information processing system, an information processing program, and an information processing method that can reduce the processing load on the data processing apparatus can be provided.

FIG. 1 is a diagram illustrating an example of information processing in the information processing system according to the embodiment. FIG. 2 is a diagram illustrating an example of an information processing system according to the embodiment. FIG. 3 is a diagram illustrating a configuration example of the master server and the slave server illustrated in FIG. FIG. 4 is a diagram illustrating a configuration example of the second data processing device illustrated in FIG. 2. FIG. 5 is a diagram illustrating a configuration example of the information processing terminal illustrated in FIG. 2. FIG. 6 is a diagram illustrating an example of a job information setting screen. FIG. 7 is a diagram illustrating an example of a job result screen. FIG. 8 is a diagram illustrating another example of the job information setting screen. FIG. 9 is a diagram illustrating an example of a test result screen. FIG. 10 is a flowchart illustrating a flow of information processing in the information processing terminal according to the embodiment. FIG. 11 is a diagram illustrating an example of a hardware configuration of a computer that executes a program.

  Hereinafter, a mode for carrying out an information processing device, an information processing system, an information processing program, and an information processing method according to the present application (hereinafter referred to as “embodiment”) will be described in detail with reference to the drawings. Note that the information processing apparatus, the information processing system, the information processing program, and the information processing method according to the present application are not limited by this embodiment.

[1. Information processing in distributed processing systems]
Information processing in the information processing system according to the embodiment will be described with reference to FIG. FIG. 1 is an explanatory diagram of information processing according to the embodiment, and the information processing is processing executed by the information processing system 100.

  As illustrated in FIG. 1, the information processing system 100 according to the embodiment includes a first data processing device 11, a second data processing device 12, and an information processing terminal 13 (an example of an information processing device). The first data processing device 11, the second data processing device 12, and the information processing terminal 13 are connected to be communicable with each other via a network.

  The first data processing apparatus 11 performs a totaling process in response to a request from the information processing terminal 13 by using log data of a service provided by a service providing server (not shown) as a processing target. The first data processing device 11 is a distributed processing system such as Hadoop (registered trademark), for example, and stores log data of services provided by the service providing server in a plurality of servers.

  The second data processing device 12 stores part of the log data held by the first data processing device 11 (hereinafter referred to as sample log data), and the information processing terminal 13 uses the sample log data as a processing target. Aggregation processing is performed according to the aggregation request from. For example, the second data processing device 12 reads a predetermined number or a predetermined ratio of log data held by the first data processing device 11, and stores the read data as sample log data.

  The information processing terminal 13 includes an input receiving unit 55, a processing unit 56, and a processing result acquisition unit 57. The input receiving unit 55 receives job information input by the user. Such job information is information written in a markup language, a data operation language, or the like, and includes information for specifying log data to be aggregated from a plurality of types of log data and information for specifying the content of the aggregation process. It is.

  The processing unit 56 includes a first processing unit 60 and a second processing unit 61. The first processing unit 60 transmits a job request based on the job information received by the input receiving unit 55 to the first data processing device 11. As a result, the first processing unit 60 executes the first process that causes the log data specified by the job information to be aggregated and causes the first data processing apparatus 11 to execute the aggregation process specified by the job information.

  The second processing unit 61 transmits a job request based on the job information received by the input receiving unit 55 to the second data processing device 12. As a result, the second processing unit 61 executes the second process that causes the second data processing device 12 to execute the aggregation process specified by the job information, with the sample log data specified by the job information as an aggregation target. it can.

  The processing result acquisition unit 57 acquires the processing result of the aggregation processing by the first data processing device 11 from the first data processing device 11, and the processing result of the aggregation processing by the second data processing device 12 from the second data processing device 12. get. The information processing terminal 13 displays the processing result of the tabulation processing acquired by the processing result acquisition unit 57 and presents the processing result of the tabulation processing to the user.

  After inputting the job information to the information processing terminal 13, the user of the information processing terminal 13 first causes the second processing unit 61 to execute the second processing, thereby obtaining information on the result of the aggregation processing by the second data processing device 12. It can be presented to the processing terminal 13.

  The tabulation process by the second data processing device 12 is a processing result of the tabulation process for a part of the log data to be tabulated, and is a sample tabulation process. Therefore, the processing time of the aggregation process is short, and the user of the information processing terminal 13 can quickly grasp what aggregation result can be acquired for the input job information.

  Then, the user of the information processing terminal 13 repeatedly inputs job information to the information processing terminal 13 until the aggregation result intended by the user is obtained, and repeats processing based on the job information to the second data processing device 12. Can be executed. Thereby, the user of the information processing terminal 13 can grasp job information that can obtain the aggregation result intended by the user.

  The user of the information processing terminal 13 inputs the job information that can obtain the intended aggregation result as described above, and then causes the first processing unit 60 to execute the first process. As a result, the result of the aggregation process by the first data processing device 11 can be presented to the information processing terminal 13, and the aggregation result intended by itself can be obtained.

  Therefore, in the information processing system 100 according to the embodiment, since the processing result of the sample aggregation process according to the job information input by the user to the information processing terminal 13 can be obtained, the aggregation process that is not intended by the user is performed. Execution by the first data processing apparatus 11 can be suppressed. As a result, the processing load on the first data processing apparatus 11 can be reduced.

  Further, the total processing of the second data processing device 12 has a smaller processing load than the total processing of the first data processing device 11. Therefore, the overall processing load of the data processing device including the first data processing device 11 and the second data processing device 12 can be reduced. In particular, since the processing load decreases as the data size of the sample log data is smaller than the data size of the log data, the overall processing load can be reduced by reducing the data size of the sample log data. .

[2. Information processing system 100]
Next, the information processing system 100 according to the embodiment will be described in more detail. FIG. 2 is a diagram illustrating an example of the information processing system 100 according to the embodiment.

  As illustrated in FIG. 2, the information processing system 100 according to the embodiment includes a plurality of service providing servers 1, a first data processing device 11, a second data processing device 12, and a plurality of information processing terminals 13 (information processing An example of an apparatus). The plurality of service providing servers 1, the first data processing device 11, the second data processing device 12, and the plurality of information processing terminals 13 are connected to be communicable with each other via a network 14. Note that access from the first data processing apparatus 11 to the plurality of service providing servers 1 may be prohibited.

[2.1. Service providing server 1]
The service providing server 1 provides various services to the user of the user terminal 3 via the network 2. The service providing server 1 receives a service providing request from the user terminal 3 and provides a service corresponding to the service providing request to the user terminal 3.

  The service providing server 1 is, for example, a shopping server, an auction server, a moving image distribution server, a music distribution server, a blog server, a mail server, an advertisement distribution server, or the like. The service providing server 1 transmits, for example, information such as music content, moving image content, shopping page, auction page, etc. according to the service provision request to the user terminal 3 or performs a product purchase process according to the service provision request. Or

  In addition, the service providing server 1 internally stores, as log data, information related to the user of the user terminal 3 that has made a service providing request (user attributes, user location, user access time, etc.) and the contents of the provided service. Or the first data processing device 11.

  Such log data includes, for example, data related to shopping pages, auction pages, music content, video content, and the like transmitted to the user terminal 3, data related to the number of advertisement contents distributed and user actions on the advertisement contents. The log data includes, for example, data including information on the user and the contents of the provided service as data of one record (row) for each action of the user terminal 3 with respect to the service providing server 1.

[2.2. First data processing device 11]
The first data processing device 11 is a distributed processing system including a master server 8 and a plurality of slave servers 9. The first data processing apparatus 11 distributes log data input from the service providing server 1 to a plurality of slave servers 9, and makes a job request from the information processing terminal 13 through distributed processing on the log data by the plurality of slave servers 9. The corresponding aggregation process is executed.

  The first data processing apparatus 11 includes, for example, a distributed processing system in which middleware called Hadoop is mounted. The first data processing apparatus 11 includes, for example, a distributed file system HDFS (Hadoop Distributed File System) and a distributed processing framework Hadoop-MapReduce.

  FIG. 3 is a diagram illustrating a configuration example of the master server 8 and the slave server 9. As illustrated in FIG. 3, the master server 8 includes a communication unit 20, a control unit 21, and a storage unit 22, and the control unit 21 includes a data management unit 23 and a job management unit 24. The communication unit 20 is a communication interface that transmits and receives information to and from the network 14.

  The slave server 9 includes a communication unit 30, a control unit 31, and a storage unit 32. The control unit 31 includes a storage processing unit 33 and a task processing unit 34. The communication unit 30 is a communication interface that transmits and receives information to and from the network 14.

  The data management unit 23 of the master server 8 performs overall management of the distributed file system. For example, the data management unit 23 divides the log data of each service providing server 1 in units of a predetermined size, and distributes the divided data that is the divided data to the plurality of slave servers 9. The storage processing unit 33 of the slave server 9 stores the divided data distributed from the master server 8 in the storage unit 32.

  Further, the data management unit 23 manages the metadata of the distributed file system and checks the usage state of the distributed file system. The metadata includes, for example, information on the tree of the distributed file system, information on all files in the tree, and information on directories. As a result, the job management unit 24 can specify the storage position and file name of the divided data in the distributed file system.

  The job management unit 24 performs job management, task assignment to the slave server 9, resource management of the slave server 9, and the like. A job request including information (hereinafter referred to as job information) that defines a job (for example, MapReduce job) is transmitted from the information processing terminal 13 to the master server 8, for example. Such job information includes information such as an input path, an output path, and a processing instruction.

  The input path indicates the storage location of the input data that is the target of the job, and is, for example, a directory on the distributed file system. The output path indicates a storage location of output data that is a result of the job, and is, for example, a directory on the distributed file system.

  The processing instruction is a program for executing distributed processing, and includes, for example, a program for conversion processing (for example, Map processing) and a program for aggregation processing (for example, Reduce processing). The conversion processing program is a program for executing a first task for converting input data into a key-value pair. Further, the aggregation process program executes a second task for aggregating data for each key of the conversion process.

  The first task is processing for generating intermediate data that is key-value pair data, and the second task is a task for totaling values for each identical key from the intermediate data. For example, the job management unit 24 assigns the number of first tasks corresponding to the number of pieces of divided data of the input data to the plurality of slave servers 9. For example, the job management unit 24 assigns the number of second tasks specified by the processing instruction to the plurality of slave servers 9.

  The task processing unit 34 of the slave server 9 executes the first task and the second task assigned from the master server 8. The task processing unit 34 can process the first task and the second task in parallel. The first data processing apparatus 11 stores the job processing result (processing result of the aggregation processing) in the output path specified by the job information, and notifies the information processing terminal 13 that the processing of the job has been completed.

[2.3. Second data processing device 12]
The second data processing device 12 acquires a part of each log data stored in the first data processing device 11 and performs a totaling according to a job request from the information processing terminal 13 with a part of the log data as a totaling target. Execute the process.

  FIG. 4 is a diagram illustrating a configuration example of the second data processing device 12. As shown in FIG. 4, the second data processing device 12 includes a communication unit 40, a control unit 41, and a storage unit 42.

  The communication unit 40 is a communication interface that transmits and receives information to and from the network 14. The control unit 41 includes a data acquisition unit 43, a request reception unit 44, and a data processing unit 45. In addition, the storage unit 42 includes a log data storage unit 46.

  The data acquisition unit 43 samples and acquires a part of log data of each service providing server 1 stored in the first data processing device 11. For example, the data acquisition unit 43 receives a predetermined number (for example, 1%) of records (rows) from the first data processing apparatus 11 up to a predetermined period (for example, 3 days before) from the log data of each service providing server 1. Read out and obtain according to random or predetermined rules. The data acquisition unit 43 stores a part of the acquired log data in the log data storage unit 46 of the storage unit 42 as sample log data.

  The request receiving unit 44 receives a job request from the information processing terminal 13. The job request includes job information including information for specifying a totaling target and information for specifying the content of the totaling process. The data processing unit 45 performs aggregation processing based on job information included in the job request received by the request receiving unit 44.

  Specifically, the data processing unit 45 executes aggregation processing specified by job information using sample log data specified by job information as an aggregation target. The data processing unit 45 stores the job processing result (processing result of the aggregation processing) in the storage unit 42 and notifies the information processing terminal 13 that the processing of the job has been completed.

  Note that the second data processing device 12 can perform a counting process for deriving the same counting result as the first data processing device 11. The second data processing device 12 includes, for example, a relational database, and performs aggregation processing using the relational database. However, like the first data processing device 11, the second data processing device 12 performs aggregation processing using a distributed processing system. There may be.

[2.4. Information processing terminal 13]
The information processing terminal 13 causes the first data processing device 11 and the second data processing device 12 to execute a counting process based on job information input from the user. FIG. 5 is a diagram illustrating a configuration example of the information processing terminal 13.

  As illustrated in FIG. 5, the information processing terminal 13 includes a communication unit 50, a control unit 51, a storage unit 52, a display unit 53, and an input unit 54. The communication unit 50 is a communication interface such as a NIC (Network Interface Card) that transmits and receives information between the control unit 51 and the network 14.

  The storage unit 52 is, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. The display unit 53 is, for example, a small LCD (Liquid Crystal Display) or an organic EL display. The input unit 54 includes a keyboard and a mouse.

  The control unit 51 includes an input reception unit 55, a processing unit 56, a processing result acquisition unit 57, a selection reception unit 58, and a selection unit 59. The processing unit 56 includes a first processing unit 60 and a second processing unit 61. The control unit 51 is realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  The control unit 51 receives a program (an example of an information processing program) stored in an internal storage device by an internal CPU (Central Processing Unit) or an MPU (Micro Processing Unit) by using the RAM as a work area. It functions as a reception unit 55, a processing unit 56, a processing result acquisition unit 57, a selection reception unit 58, and a selection unit 59.

[2.4.1. Input reception unit 55]
The input receiving unit 55 receives input of job information from a user of the information processing terminal 13 (hereinafter sometimes referred to as a terminal user). The job information is information described in a data operation language such as SQL, but may be information described in a markup language such as XML (Extensible Markup Language).

  FIG. 6 is a diagram illustrating an example of a job information setting screen displayed on the display unit 53. The job information setting screen 70 shown in FIG. 6 includes a job information input frame 71, a test total button 72, a formal total button 73, and a completion mail setting box 74.

  In the job information input frame 71, job information input by the terminal user from the input unit 54 (hereinafter sometimes referred to as input job information) is displayed. In the example shown in FIG. 6, the column “timestamp” is specified, “shoping_daily_stream” is specified as the data acquisition source, and “log_data = '20160930'” and “timestamp! = ''” Are specified as the record extraction conditions. , "Timestamp" is specified as the aggregation unit. Thereby, from the log data of “shoping_daily_stream”, a plurality of “timestamp” whose “log_data” is “20160930” is aggregated for each value of “timestamp”.

  Note that the terminal user can input job information so that intended tabulation processing can be performed. For example, the terminal user can input job information for summing up a CTR (Cardio Thoracic Ratio), which is a click rate for advertising content, for each advertising content or for each user. In addition, the terminal user can input job information for totaling product sales in a shopping service and generating a ranking. Further, the terminal user can input job information for counting the number of browsing for each page of the news site, user attributes, and the like.

  In addition, the input receiving unit 55 can display sample job information and past input job information on the display unit 53 in order to assist the terminal user in inputting job information. In this case, the input receiving unit 55 can display only the input job information that has been actually aggregated by the first data processing apparatus 11 among the past input job information on the display unit 53.

  The test tabulation button 72 is a button for causing the second data processing device 12 to execute processing according to the input job information. When the test total button 72 is pressed (selected) by an operation on the input unit 54 of the terminal user, a job request is transmitted from the second processing unit 61 of the processing unit 56 to the second data processing device 12.

  The input receiving unit 55 can display the result of the aggregation processing executed by the second data processing device 12 by the second processing unit 61 on the display unit 53. FIG. 7 is a diagram illustrating an example of a job result screen displayed on the display unit 53. The job result screen 80 illustrated in FIG. 7 includes a total information display frame 81, a return button 82, a formal total button 83, and a completion mail setting box 84.

  In the total information display frame 81, the result of the total processing executed by the second data processing device 12 is displayed. In the example illustrated in FIG. 7, as a result of aggregation corresponding to the job information illustrated in FIG. 6, a plurality of “timestamps” in which “log_data” is “20160930” are obtained for each “timestamp” value from “shoping_daily_stream” The totaled results are displayed in the total information display frame 81.

  A return button 82 shown in FIG. 7 is a button for returning to the job information setting screen 70 shown in FIG. Also, the formal tabulation button 83 and the completion mail setting box 84 shown in FIG. 7 are the same buttons as the formal tabulation button 73 and the completion mail setting box 74 shown in FIG.

  The formal tabulation buttons 73 and 83 are buttons for causing the first data processing apparatus 11 to execute processing according to the input job information. When the formal tab buttons 73 and 83 are pressed by an operation on the input unit 54 of the terminal user, a job request is transmitted from the first processing unit 60 of the processing unit 56 to the first data processing device 11.

  The completion mail setting box 74 is a check box for notifying the terminal user when the aggregation process of the first data processing apparatus 11 corresponding to the input job information is completed. When the terminal user sets a check mark in the completion mail setting box 74, the first data processing apparatus 11 transmits a job completion mail to the terminal user address by mail when the aggregation process according to the input job information is completed. To do.

[2.4.2. Processing unit 56]
Returning to FIG. 5, the description of the control unit 51 is continued. The processing unit 56 of the control unit 51 includes a first processing unit 60 and a second processing unit 61, and can execute the first processing and the second processing individually.

  The first process is a process for causing the first data processing apparatus 11 to execute the aggregation process specified by the input job information with the log data specified by the input job information as an aggregation target, and is executed by the first processing unit 60. . The second process is a process for causing the second data processing device 12 to execute the aggregation process specified by the input job information with a part of the log data specified by the input job information as an aggregation target. 61 is executed.

  The first processing unit 60 converts the input job information into information on a job executed on the first data processing apparatus 11 (hereinafter referred to as first job information). The first job information is information described in a programming language different from the input job information. For example, the input job information is information described in the HighSQL language, and the first job information is information described in the Java (registered trademark) language.

  The first processing unit 60 transmits a job request including the first job information to the first data processing apparatus 11. As a result, the first data processing apparatus 11 executes a totaling process according to the input job information.

  The second processing unit 61 converts the input job information into information on a job executed on the second data processing apparatus 12 (hereinafter referred to as second job information). The second job information is information described in a programming language different from the input job information.

  For example, the input job information is information described in the High SQL language, and the second job information is information described in the SQL language. When the second data processing device 12 includes the same distributed processing system as the first data processing device 11, the second processing unit 61 can perform the same conversion processing as the first processing unit 60.

  If the input job information can be used as it is as the second job information, the second processing unit 61 uses the input job information as it is as the second job information. Thereby, the processing load in the second processing unit 61 can be reduced.

  The second processing unit 61 transmits a job request including the second job information to the second data processing device 12. Thereby, the totaling process according to the input job information is executed by the second data processing device 12. As described above, the processing unit 56 can cause the second data processing device 12 to execute the aggregation processing according to the input job information as well as the first data processing device 11.

  Therefore, since the terminal user can obtain the processing result of the sample aggregation process according to the input job information, the first data processing apparatus 11 is prevented from executing the aggregation process not intended by the terminal user. it can. As a result, the processing load on the first data processing apparatus 11 can be reduced.

[2.4.3. Processing result acquisition unit 57]
The processing result acquisition unit 57 can acquire the processing result of the aggregation processing by the first data processing device 11 and can acquire the processing result of the aggregation processing by the second data processing device 12. The processing result of the aggregation processing is displayed on the display unit 53.

  For example, when the processing result acquisition unit 57 grasps from the notification from the first data processing device 11 that the counting processing executed by the first data processing device 11 has been completed, the processing result acquisition unit 57 performs the counting performed by the first data processing device 11. The processing result of the process is acquired from the first data processing device 11. Similarly, the processing result acquisition unit 57 causes the second data processing device 12 to execute when the second data processing device 12 recognizes that the aggregation processing executed by the second data processing device 12 has been completed. The processing result of the aggregation process is acquired from the second data processing device 12.

[2.4.4. Selection reception part 58]
The selection receiving unit 58 receives a selection of processing by the terminal user. Based on the reception result of the selection reception unit 58, the processing unit 56 executes a process corresponding to the process selected by the user among the first process and the second process.

  The selection accepting unit 58 is activated when, for example, the formal tabulation button 73 included in the job information setting screen 70 or the formal tabulation button 83 included in the job result screen 80 is pressed by an operation on the input unit 54 of the terminal user. The pressing operation is accepted as a selection of the first process by the terminal user. When the selection receiving unit 58 receives the selection of the first process, the first processing unit 60 executes the first process, and causes the first data processing apparatus 11 to execute a totaling process according to the input job information.

  Further, for example, when the test total button 72 included in the job information setting screen 70 is pressed by the terminal user, the selection receiving unit 58 receives the pressing operation as a selection of the second process by the terminal user. When the selection receiving unit 58 receives the selection of the second process, the second processing unit 61 executes the second process, and causes the second data processing device 12 to execute a totaling process according to the input job information. As described above, the terminal user can obtain the processing result of the sample totaling process according to the input job information by pressing the test totaling button 72.

  Note that the selection accepting unit 58 can make the formal tabulation button 73 not temporarily displayed on the job information setting screen 70 displayed on the display unit 53. For example, after the job information is set in the job information input frame 71, the selection receiving unit 58 is pressed after the test totaling button 72 is pressed and the totaling result by the second data processing device 12 is displayed on the display unit 53. Formal counting button 73 can be displayed on job result screen 80 or job information setting screen 70.

  In this way, the selection receiving unit 58 can receive the selection of the first process after the second process is executed, thereby allowing the terminal user to confirm the sample of the counting result and then performing the formal counting process. Can be executed. Therefore, the processing load on the first data processing device 11 can be reduced.

  Note that the selection accepting unit 58 sets the job count setting button 72 and the formal count button 73 to job information so that the first data processing apparatus 11 and the second data processing apparatus 12 do not execute the totaling process according to the input job information at the same time. It can be displayed on the screen 70. For example, the selection accepting unit 58 can prevent the formal aggregation button 73 from being displayed on the job information setting screen 70 while the second data processing apparatus 12 is executing the aggregation process according to the input job information.

  Further, the terminal user may set whether or not to display the test total button 72 and whether or not the formal total button 73 is displayed on the job information setting screen 70 after the test total button 72 is pressed. it can. For this setting, a setting screen (not shown) is displayed on the display unit 53 by input to the input unit 54, and setting input is performed by input from the setting screen to the input unit 54.

  The selection receiving unit 58 stores the setting input information in the storage unit 52. Based on the setting information stored in the storage unit 52, the selection receiving unit 58 displays the test tabulation button 72 and the formal tabulation button 73 on the job information setting screen 70 according to the setting of the terminal user.

  In addition, the selection receiving unit 58 can select the second process under a predetermined condition even when the formal tabulation button 73 is pressed by an operation on the input unit 54 of the terminal user. For example, when the state of the first data processing device 11 satisfies a first condition described later or when a selection history described later satisfies a third condition described later, the selection receiving unit 58 sets the first data processing device 11 regardless of the operation of the terminal user. Two treatments can be selected.

[2.4.5. Selection unit 59]
The selection unit 59 can select a process according to the state of the first data processing device 11 from the first process and the second process.

  For example, the selection unit 59 can select the second process when the state of the first data processing apparatus 11 satisfies the first condition. The first condition is, for example, a condition that the number of input job information in a waiting state in the first data processing device 11 is a predetermined number or more, or all input job information in a waiting state is processed in the first data processing device 11. It is a condition that the time until it is predicted is a predetermined time or more. The first condition may be a condition that the current load state of the first data processing device 11 and the predicted future load state are not less than a predetermined value.

  When the state of the first data processing device 11 satisfies the first condition, the selection unit 59 causes the display unit 53 to display the job information setting screen 90 illustrated in FIG. 8 instead of the job information setting screen 70 illustrated in FIG. 6. be able to. FIG. 8 is a diagram illustrating another example of the job information setting screen displayed on the display unit 53. A job information setting screen 90 shown in FIG. 8 includes a job information input frame 91, a totaling button 92, and a completion mail setting box 93.

  In the job information setting screen 90 shown in FIG. 8, only the total button 92 is displayed, and the test total button 72 and the formal total button 73 are not displayed. When the aggregation button 92 is pressed by an operation of the terminal user on the input unit 54, the selection unit 59 selects the second process and causes the second process unit 61 to execute the second process. Thereby, the total processing according to the input job information is executed by the second data processing device 12. As described above, the selection unit 59 can select the second process when the state of the first data processing apparatus 11 satisfies the first condition.

  The selection unit 59 displays a test result screen on the display unit 53 when the aggregation result obtained by the second data processing device 12 is acquired from the second data processing device 12. FIG. 9 is a diagram illustrating an example of a test result screen displayed on the display unit 53. The test result screen 95 shown in FIG. 9 includes a total information display frame 96, a Yes button 97, and a No button 98.

  In the total information display frame 96, as in the total information display frame 81, the result of the total processing executed by the second data processing device 12 is displayed. The Yes button 97 is a button for causing the first data processing apparatus 11 to execute a totaling process according to the input job information, like the formal totaling button 83.

  When the Yes button 97 included in the test result screen 95 is pressed by an operation on the input unit 54 by the terminal user, the selection receiving unit 58 receives the selection of the first process by the terminal user. When the selection receiving unit 58 receives the selection of the first process, the first processing unit 60 executes the first process, and causes the first data processing apparatus 11 to execute a totaling process according to the input job information.

  Thus, according to the state of the first data processing device 11, first, in order to obtain the processing result of the sample totaling process according to the input job information, the totaling process not intended by the terminal user is the first data processing. It can suppress performing with the apparatus 11. FIG. As a result, the processing load on the first data processing apparatus 11 can be reduced.

  Note that the selection unit 59 can select the first process when the state of the first data processing device 11 satisfies the second condition. The second condition is, for example, a condition that the input job information in the waiting state in the first data processing apparatus 11 is equal to or less than a predetermined number, or that all the input job information in the waiting state is processed in the first data processing apparatus 11 It is a condition that the time until it is done is within a predetermined time. The second condition may be a condition that the current load state of the first data processing device 11 and the predicted future load state are not more than a predetermined value.

  When the state of the first data processing apparatus 11 satisfies the second condition, the selection unit 59 causes the display unit 53 to display the job information setting screen 90 illustrated in FIG. 8 instead of the job information setting screen 70 illustrated in FIG. 6. be able to.

  In this case, when the Yes button 97 included in the test result screen 95 is pressed by an operation on the input unit 54 by the terminal user, the selection receiving unit 58 receives the selection of the first process by the terminal user. When the selection receiving unit 58 receives the selection of the first process, the first processing unit 60 executes the first process, and causes the first data processing apparatus 11 to execute a totaling process according to the input job information.

  As described above, when the state of the first data processing apparatus 11 satisfies the second condition, the first process can be selected. Thereby, the terminal user can grasp | ascertain quickly the total result by the 1st data processing apparatus 11. FIG.

  The selection unit 59 can select one of the first process and the second process based on the selection history of the past process selected by the terminal user. For example, the selection unit 59 selects the second process when the selection history satisfies the third condition, and selects the first process when the selection history satisfies the fourth condition.

  The third condition is, for example, a condition that the ratio that the past process selected by the terminal user on the job information setting screen 70 is the second process is a predetermined ratio (for example, 80%) or more. The third condition is, for example, a condition that the number of past second processes selected by the terminal user on the job information setting screen 70 is a predetermined number or more.

  The fourth condition is a condition that the ratio that the past process selected by the terminal user on the job information setting screen 70 is the first process is a predetermined ratio (for example, 80%) or more. The fourth condition is, for example, a condition that the number of past first processes selected by the terminal user on the job information setting screen 70 is a predetermined number or more.

  When the selection history satisfies the third condition or the fourth condition, the selection unit 59 may cause the display unit 53 to display the job information setting screen 90 shown in FIG. 8 instead of the job information setting screen 70 shown in FIG. it can. When the Yes button 97 is pressed by an operation on the input unit 54 of the terminal user, the selection receiving unit 58 selects the second process by the terminal user if the selection history satisfies the third condition. If the selection history satisfies the fourth condition, the selection of the first process by the terminal user is accepted.

[3. Processing flow of information processing system 100]
First, an information processing procedure in the information processing terminal 13 will be described with reference to FIG. FIG. 10 is a flowchart showing the flow of information processing in the information processing terminal 13.

  As shown in FIG. 10, the control unit 51 of the information processing terminal 13 determines whether or not the first process is selected by the terminal user (step S10). When it determines with the 1st process having been selected (step S10; Yes), the control part 51 determines whether predetermined conditions are satisfy | filled (step S11). For example, the control unit 51 determines that the predetermined condition is satisfied when the state of the first data processing device 11 satisfies the first condition or when the selection history satisfies the third condition.

  When it determines with not satisfy | filling predetermined conditions (step S11; No), the control part 51 performs a 1st process (step S12). Thereby, the totaling process by the 1st data processing apparatus 11 is performed. On the other hand, when it determines with satisfy | filling predetermined conditions (step S11; Yes), the control part 51 performs a 2nd process (step S13). Thereby, the totaling process by the second data processing device 12 is executed.

  When the processes of steps S12 and S13 are completed, or when it is determined that the first process is not selected (step S10; No), the control unit 51 determines whether or not the second process is selected by the terminal user. Determination is made (step S14). When it determines with the 2nd process having been selected (step S14; Yes), the control part 51 performs a 2nd process (step S15). Thereby, the totaling process by the second data processing device 12 is executed.

  When the process of step S15 is completed or when it is determined that the second process is not selected (step S14; No), the control unit 51 performs the aggregation process of the first data processing device 11 by executing the first process. Alternatively, it is determined whether or not the aggregation process of the second data processing device 12 by the execution of the second process is finished (step S16). When the control unit 51 determines that the counting process has been completed (step S16; Yes), the control unit 51 displays the processing result of the counting process on the display unit 53 (step S17).

  When the process of step S17 is completed or when it is determined that the aggregation process has not been completed (step S16; No), the control unit 51 ends the process illustrated in FIG. 11 and performs step S10 at the next process timing. The execution of the process is started.

[4. (Modification)
In the above-described embodiment, the first data processing device 11 and the second data processing device 12 have been described as different devices. However, the second data processing device 12 is partially or entirely the same as the first data processing device 11. It can also be a device.

  Further, the second data processing device 12 can also increase the number of log data samplings as the log data is counted more frequently in the first data processing device 11. Thereby, more records can be acquired as sample log data for log data having a larger number of times to be counted by the first data processing apparatus 11. The second data processing apparatus 12 can also acquire sample log data with the number of samplings corresponding to the log data.

  The control unit 51 can also select the second process for one piece of job information when the time since the start of the input of the job information is long. Thereby, after presenting the processing result of the sample counting process to the terminal user unfamiliar with the input of job information, the first data processing apparatus 11 can execute the counting process.

  The control unit 51 can also select the second process for a single piece of job information when there are many correction points for the job information. Thereby, after presenting the processing result of the sample counting process to the terminal user unfamiliar with the input of job information, the first data processing apparatus 11 can execute the counting process.

[5. Hardware configuration)
Each of the master server 8, the slave server 9, the second data processing device 12, and the information processing terminal 13 in the above-described embodiment is realized by the computer 200 having a configuration as shown in FIG.

  FIG. 11 is a diagram illustrating an example of a hardware configuration of a computer that executes a program. The computer 200 includes a CPU 201, a RAM 202, a ROM 203, an HDD (Hard Disk Drive) 204, a communication interface (I / F) 205, an input / output interface (I / F) 206, and a media interface (I / F) 207.

  The CPU 201 operates based on a program stored in the ROM 203 or the HDD 204 and controls each unit. The ROM 203 stores a boot program executed by the CPU 201 when the computer 200 is started up, a program depending on the hardware of the computer 200, and the like.

  The HDD 204 stores data used by programs executed by the CPU 201. The communication interface 205 corresponds to each of the communication units 20, 30, 40, 50, receives data from other devices via the networks 2, 14 and sends the data to the CPU 201, and the data generated by the CPU 201 is transmitted to the networks 2, 14. To other devices via.

  The CPU 201 controls an output device such as a display and a printer and an input device such as a keyboard and a mouse via the input / output interface 206. The CPU 201 acquires data from the input device via the input / output interface 206. Further, the CPU 201 outputs the generated data to the output device via the input / output interface 206.

  The media interface 207 reads a program or data stored in the recording medium 208 and provides it to the CPU 201 via the RAM 202. The CPU 201 loads the program from the recording medium 208 onto the RAM 202 via the media interface 207, and executes the loaded program. The recording medium 208 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase change rewritable disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. Etc.

  The CPU 201 of the computer 200 implements each function of the control unit (the control unit 21, the control unit 31, the control unit 41, or the control unit 51) described above by executing a program loaded on the RAM 202. Further, each or a part of the control unit may be configured only by hardware.

  The CPU 201 of the computer 200 reads the program from the recording medium 208 and executes it, but as another example, the program may be acquired from another device via the networks 2 and 14.

  The HDD 204 corresponds to each of the storage units 22, 32, 42, 52 and stores data similar to that of the storage units 22, 32, 42, 52. Further, instead of the HDD 204, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as an optical disk may be used.

[6. effect〕
The information processing terminal 13 (an example of an information processing apparatus) according to the embodiment includes an input reception unit 55 (an example of a reception unit) and a processing unit 56. The input receiving unit 55 receives input job information input by a terminal user. The processing unit 56 individually executes the first process and the second process. The first process is a process for causing the first data processing apparatus 11 to execute the aggregation process specified by the input job information with the log data specified by the input job information as an aggregation target. The second process is a process for causing the second data processing device 12 to execute the aggregation process specified by the input job information with a part of the log data specified by the input job information as an aggregation target. The tabulation process by the second data processing device 12 is a processing result of the tabulation process for which a part of log data is to be tabulated, and is a sample tabulation process. Therefore, the processing time of the aggregation process is short, and the user of the information processing terminal 13 can quickly grasp what aggregation result can be acquired for the input job information, while the first data processing device 11 Processing load can be reduced.

  In addition, the information processing terminal 13 includes a selection receiving unit 58 that receives selection of processing by the terminal user. The processing unit 56 executes a process corresponding to the process selected by the terminal user among the first process and the second process. Thereby, the terminal user repeatedly inputs job information to the information processing terminal 13 until the tabulation result intended by the terminal user is obtained, and causes the second data processing device 12 to repeatedly execute processing based on the job information. Can do. Thereby, while reducing the processing load on the first data processing apparatus 11, the terminal user can grasp job information that can obtain the aggregation result intended by the terminal user.

  The selection receiving unit 58 receives the selection of the first process after the processing unit 56 executes the second process. Accordingly, the first data processing apparatus 11 can perform the aggregation process in the first data processing apparatus 11 after confirming the sample aggregation process according to the input job information for the terminal user. It is possible to reduce the number of tabulation processes.

  In addition, the information processing terminal 13 includes a storage unit 52 and a selection unit 59. The memory | storage part 52 memorize | stores the historical information of the process selected in the past by the terminal user. The selection unit 59 selects a process corresponding to the history information from the first process and the second process. Thereby, the appropriate process according to the past operation of the terminal user can be selected.

  In addition, the information processing terminal 13 includes a selection unit 59 that selects a process according to the state of the first data processing device 11 among the first process and the second process. As a result, for example, when there are many jobs waiting in the first data processing apparatus 11, the number of aggregation processes in the first data processing apparatus 11 can be reduced, and the processing in the first data processing apparatus 11 can be reduced. The load can be reduced.

  Part of the log data that is tabulated by the second data processing device 12 is data acquired from the first data processing device 11 by the second data processing device 12. Therefore, it is possible to suppress a decrease in consistency between the aggregation result in the aggregation process of the first data processing device 11 and the aggregation result in the aggregation process of the second data processing device 12.

  In addition, the first data processing device 11 includes a distributed processing system that stores log data in a plurality of slave servers 9 (an example of a server) in a distributed manner and distributes log data in the plurality of slave servers 9. As a result, it is possible to quickly perform the aggregation processing of large-volume log data.

  In addition, the master server 8, the slave server 9, the second data processing device 12, and the information processing terminal 13 described above may be realized by a plurality of server computers, respectively. The configuration can be flexibly changed, for example, by calling with Programming Interface) or network computing.

  Moreover, the above-mentioned “section (module, unit)” can be read as “means”, “circuit”, and the like. For example, the processing unit can be read as processing means or a processing circuit.

  Further effects and modifications can be easily derived by those skilled in the art. Thus, the broader aspects of the present invention are not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications can be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

DESCRIPTION OF SYMBOLS 1 Service provision server 11 1st data processing apparatus 12 2nd data processing apparatus 13 Information processing terminal 50 Communication part 51 Control part 52 Memory | storage part 53 Display part 54 Input part 55 Input reception part 56 Processing part 57 Processing result acquisition part 58 Selection reception Unit 59 Selection unit 60 First processing unit 61 Second processing unit

Claims (10)

A reception unit for receiving job information input by a user;
A first process for causing the first data processing apparatus to execute a totaling process specified by the job information with the log data specified by the job information as a target of aggregation, and the totaling process for a part of the log data as a target of aggregation. An information processing apparatus comprising: a processing unit that individually executes a second process to be executed by the second data processing apparatus. A selection receiving unit for receiving selection of processing by the user;
The processor is
The information processing apparatus according to claim 1, wherein a process corresponding to a process selected by the user among the first process and the second process is executed. The selection receiving unit
The information processing apparatus according to claim 2, wherein after the second process is executed by the processing unit, the selection of the first process is accepted. A storage unit for storing history information of processing selected in the past by the user;
The information processing apparatus according to claim 2, further comprising: a selection unit that selects a process according to the history information among the first process and the second process. The information processing according to any one of claims 1 to 4, further comprising: a selection unit that selects a process according to a state of the first data processing device among the first process and the second process. apparatus. The information processing apparatus according to any one of claims 1 to 5, wherein the part of the log data is data acquired from the first data processing apparatus by the second data processing apparatus. . The first data processing device includes:
The information according to claim 1, further comprising: a distributed processing system that stores the log data in a distributed manner on a plurality of servers, and distributes the log data on the plurality of servers. Processing equipment. The information processing apparatus according to any one of claims 1 to 7,
The first data processing device;
An information processing system comprising: the second data processing device. A reception procedure for receiving job information input by the user;
A first process for causing the first data processing apparatus to execute a totaling process specified by the job information with the log data specified by the job information as a target of aggregation; A processing procedure for selectively executing the second processing to be executed by the second data processing device;
An information processing program for causing a computer to execute. An information processing method executed by a computer,
A reception process for receiving job information input by a user;
A first process for causing the first data processing apparatus to execute a totaling process specified by the job information with the log data specified by the job information as a target of aggregation, and the totaling process for a part of the log data as a target of aggregation. And a processing step of selectively executing a second process to be executed by the second data processing device.

Images