JP5869513B2 - Fault response system and fault response method - Google Patents

Description

  The present invention relates to a failure handling system and a failure handling method. Specifically, in an environment in which applications are linked among a plurality of devices on a network, the location where a failure occurs is efficiently identified when a failure occurs. The present invention relates to a technology that prompts the user to take appropriate measures according to the situation and effectively suppress the influence of the failures.

  When a system failure occurs, in order to identify the cause of the failure that occurred, analyze the log that was output when the application was running on the system, and perform processing according to the failure status to reduce the impact of the failure. There is a technical idea.

  As such a technique, for example, when an information collection unit that collects information from an application program in which failure notification processing is incorporated receives a failure notification from the application program in which a failure has occurred, it responds to the received failure notification. A failure information collection device (see Patent Document 1) that sends a failure collection processing program to the failure notification side has been proposed.

  In addition, a storage unit that stores an error level correspondence table that associates an error code for uniquely identifying an error with an error level that is an error type, and when an error occurs in an application program, An automatic failure recovery system (see Patent Document 2) including an error level determination unit that searches an error level correspondence table using an error code as a key, acquires an error level, and performs failure recovery processing according to the error level is also proposed. Has been.

JP 2001-282671 A JP 2001-5893 A

  On the other hand, in recent years, highly functional portable terminals such as smartphones and tablet terminals are increasing, and these portable terminals have an application execution base that allows a user to install an application freely after purchasing the terminal. Some car navigation devices also have a function that allows a user to freely install an application after purchase. Furthermore, some of such car navigation devices that are connected to a telematics service can provide a function to a user in cooperation with an application that operates on a smartphone. The application that operates on the smartphone can also be freely added by the user after purchasing the car navigation device.

  A plurality of devices such as a mobile terminal, various devices such as a car navigation device connected to the mobile terminal, and a server that provides information to the various devices via the mobile terminal (carriers) are provided on the network. Even if the conventional failure handling method is adopted for a system that cooperates with each other and that executes a plurality of applications that are freely installed by the user after the purchase of the device, a problem remains.

  For example, in the prior art, failure information is collected from a server on which a failed application operates, and when the location of the failure is unknown, the failure is detected from multiple devices operating in cooperation on the network. It has not been realized to automatically collect information, identify the cause, and perform the necessary response processing. Also, when judging the situation based on the error code at the time of the failure and performing the necessary response processing, the error code is not output correctly due to a program quality problem, etc., or the error code output itself is not executed due to the failure I cannot respond to the situation. Moreover, when a failure occurs, it was not possible to cope with a wide range of purposes other than failure recovery, such as adjusting and outputting an appropriate message based on the situation of the affected user at an appropriate timing.

  Accordingly, an object of the present invention is to efficiently identify a failure occurrence location when a failure occurs in an environment in which applications are linked among a plurality of devices on the network, and prompt the user to take appropriate failure countermeasures according to the situation. The object is to provide a technique capable of effectively suppressing the influence.

  The failure handling system of the present invention that solves the above problem is a system that includes a plurality of information processing apparatuses that link applications together via a network, and each information processing apparatus is a first information processing apparatus that is the other information processing apparatus when executing the application. Each time an application call of the information processing apparatus 2 is generated, a process of storing a communication log including an identifier of a process across the information processing apparatuses and a transmission / reception relationship between the information processing apparatuses in a storage device; Processing for storing an application log including an error content and the identifier in a storage device, and when a failure is detected, a search is performed in the communication log using the identifier included in the application log as a key, and the identifier corresponds to the identifier when a failure occurs. A process for specifying the second information processing apparatus used in the process and the second information processing apparatus for the specified second information processing apparatus A module for the third information processing apparatus that the information processing apparatus holds and acquires the application log associated with the identifier and that the second information processing apparatus uses as a communication partner in the process associated with the identifier A process requesting at least one of the operation confirmation, an application log associated with the identifier as a result of the request being executed and returned by the second information processing apparatus, and the third information Processing for acquiring at least one of the information on the operation confirmation result regarding the module in the processing device, and identifying an application or module of the information processing device not performing normal operation as a failure location based on the acquired information; Based on the content of the corresponding action predetermined according to the location, the corresponding action according to the identified failure location is specified, and the corresponding response operation is executed. Characterized in that it comprises an arithmetic unit for the processing of the execution.

  Further, the failure handling method of the present invention is such that each information processing device that links applications with each other via a network each time an application is called from the second information processing device, which is another information processing device, when the application is executed. Processing for storing a communication log including an identifier of processing across information processing devices and a transmission / reception relationship between information processing devices in a storage device, and storing an application log including an error content and the identifier when a failure occurs And a process of performing a search in the communication log using the identifier included in the application log as a key when a failure is detected, and specifying a second information processing apparatus used in the process corresponding to the identifier when the failure occurs And the application log associated with the identifier held by the second information processing apparatus for the specified second information processing apparatus A process for requesting at least one of acquisition and operation check of a module directed to a third information processing apparatus as a communication partner in the process associated with the identifier by the second information processing apparatus; As a result of the request being executed and returned by the second information processing apparatus, at least one of information of an application log associated with the identifier and an operation confirmation result regarding the module in the third information processing apparatus Based on the content of the corresponding operation determined in advance according to the process of identifying the application or module of the information processing apparatus that is not performing normal operation based on the acquired information as a failure location And specifying a corresponding action corresponding to the specified failure location and executing the corresponding action.

  According to the present invention, in an environment in which applications are linked among a plurality of devices on a network, the location of a failure is efficiently identified when a failure occurs, and the user is encouraged to take appropriate measures according to the situation. Can be effectively suppressed.

It is a figure which shows the structural example of the failure response system in this embodiment. It is a figure which shows the structural example of the user terminal in this embodiment. It is a figure which shows the structural example of the server in this embodiment. It is a figure which shows the structural example of the management server in this embodiment. It is a figure which shows the process sequence example 1 of the failure response method in this embodiment. It is a figure which shows the example of an output of the communication log in this embodiment. It is a figure which shows the example of an output of the application log in this embodiment. It is a figure which shows process sequence example 2 of the failure response method in this embodiment. It is a figure which shows process sequence example 3 of the failure response method in this embodiment. It is a figure which shows the process sequence example 4 of the failure response method in this embodiment. It is a figure which shows the example of the failure condition investigation result of this embodiment. It is a figure which shows the example of the module confirmation method data of this embodiment. It is a figure which shows the data structural example of failure response method DB of this embodiment. It is a figure which shows the example of a data structure of the user profile of this embodiment.

  Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a diagram illustrating a configuration example of a failure handling system 1 according to the present embodiment. The failure handling system 1 shown in FIG. 1 efficiently identifies the location of a failure when a failure occurs in an environment in which applications are linked among a plurality of devices on the network, and prompts the user for appropriate failure handling according to the situation. This is a computer system that can effectively suppress the influence of a failure.

  Here, it is assumed that the user terminal 10 used by the user and each server device of the data center 100 are connected by the carrier network 20. In addition, by arranging a predetermined program in each of the user terminal 10 and the server device described above, an application execution platform is realized, and when a failure occurs in an application operating on the application execution platform, appropriate countermeasures are taken. What is automatically executed is the failure handling system 1 of the present embodiment.

  In the network configuration shown in FIG. 1, a user terminal 10 is an information processing apparatus used by an application user. The user terminal 10 uses the function of the server device arranged in the data center 100 via the carrier network 20. In the present embodiment, an in-vehicle device that provides a car navigation function is assumed as the user terminal 10.

  Note that, in the example of FIG. 1, the carrier network 20 that is a mobile phone line is assumed as a network that connects the user terminal 10 and the data center 100, but of course, between the user terminal 10 and the data center 100. An appropriate network may be employed according to the communication protocol between the two.

  On the other hand, in the data center 100, a load balancer 110, an A1 server 130, an A2 server 140, a B server 150, and a management server 120 are arranged, and each device is connected via a network. The network in the data center 100 is connected to the carrier network 20 described above so that it can communicate with the user terminal 10. In addition, each of the devices 110 to 150 of the data center 100 is either a physical server device or a virtual information processing device.

  In such a network configuration, when a predetermined processing request is issued from the user terminal application arranged on the user terminal 10 described above, the server application arranged on the A1 server 130 or the A2 server 140 and the B server 150 performs processing, A response to the above processing request is sent back to the user terminal application of the user terminal 10.

  The load balancer 110 described above has a function of distributing a processing request from a user terminal application executed on the user terminal 10 to one of the plurality of servers 130 and 140. In the present embodiment, it is assumed that the A1 server 130 and the A2 server 140 have the same server application function. Therefore, the load balancer 110 receives a processing request from the user terminal application that operates on the user terminal 10. If it happens, the process is distributed to the A1 server 130 or the A2 server 140. This distribution process is performed by, for example, switching the distribution destination alternately according to the order in which the processing requests are received from the user terminal 10, or measuring the time taken to send a predetermined processing request to each server and receive a response. Take a way to sort the shortest.

  Further, the server application of the B server 150 has a function used from an application arranged in the A1 server 130 or the A2 server 140. For example, the A1 server 130 and the A2 server 140 are provided with a Web server function and an application execution function for executing a predetermined process in response to a processing request received by the Web server, and data used by the application when the application is executed. Are shared by the A1 server 130 and the A2 server 140, the database function is arranged in the B server 150 and cooperates.

  FIG. 2 shows a configuration example of the user terminal 10. The user terminal 10 is an information processing device, and includes a CPU 201, a memory 202, a storage device 220, a display device 203, an input device 204, a position positioning device 205, a communication device 206, an acceleration sensor 207, a gyro sensor 208, and a vehicle information acquisition device 209. Configure. The storage device 220 stores programs 225 and 221 for implementing functions as an information processing device constituting the failure handling system 1 of the present embodiment, and each data. Further, the CPU 201 reads the programs 225 and 221 and data stored in the storage device 220 into the memory 202 as appropriate and processes them.

  The display device 203 is a device that shows the execution results of the above-described programs 225 and 221 to the user, and a display device can be assumed. The input device 204 is a device that receives instructions from the user, and devices such as a keyboard and a mouse can be assumed.

  The position positioning device 205 is a device that measures the position where the user terminal 10 exists, and a GPS unit or the like can be assumed. The communication device 206 is a device that transmits / receives data to / from the servers of the data center 100 via the carrier network 20.

  The acceleration sensor 207 is a device that measures the acceleration of the user terminal 10, and the gyro sensor 208 is a device that measures the angular velocity of the user terminal 10.

  In addition, the vehicle information acquisition device 209 is connected to an in-vehicle network used for control of the vehicle on which the user terminal 10 is mounted, and vehicle information on the vehicle state and the like (e.g., the degree of depression of an accelerator or a brake, the speed of the vehicle, etc.) Information).

  Next, programs and data stored in the storage device 220 will be described. The user terminal application 221 is a program that realizes an application used by the user. The program 225 is a program for implementing functions necessary for the information processing apparatus constituting the failure handling system 1 of the present embodiment.

  The user profile 231 is a database that stores user attributes (eg, age 1402, gender 1403, address 1404, etc.) of the corresponding information processing apparatus (see FIG. 14).

  Further, the communication log file 232 is a file for storing a communication log used for making it possible to track the operation of the program, and the application log file 233 is a file for storing an application log representing failure information generated during the program execution. It is. Note that the communication log file 232 and the application log file 233 may use a DB instead of a file.

  The failure handling method DB 234 is a database that stores behaviors according to the failure status. The failure handling method DB 234 may use a file instead of a DB.

  FIG. 3 shows a configuration example of each server device of the A1 server 130, the A2 server 140, and the B server 150. Each server includes a CPU 301, a memory 302, a storage device 320, a display device 303, an input device 304, and a communication device 305 in the same manner as the user terminal 10 described above. In addition, the storage device 320 stores a server application 321 and a program 325, a communication log file 326, and an application log file 327 for implementing functions necessary as an information processing device constituting the failure handling system 1.

  The server application 321 is a program that provides functions to the user in cooperation with the user terminal application 221. Here, it is assumed that the same server application 321 operates on the A1 server 130 and the A2 server 140, and a server application 321 different from the A1 server 130 and the A2 server 140 operates on the B server 150. Note that the communication log file 326 and the application log file 327 have the same configuration and role as the program and data of the same name stored in the storage device 220 of the user terminal 10 in FIG.

  FIG. 4 shows a configuration example of the management server 120. The management server 120 also includes a CPU 401, a memory 402, a storage device 410, a display device 403, an input device 404, and a communication device 405 in the same manner as the user terminal 10 and the like. Among these, the storage device 410 stores a program 425, an integrated communication log DB 413, and an integrated application log DB 414 for implementing functions necessary as an information processing device constituting the failure handling system 1. The integrated communication log DB 413 and the integrated application log DB 414 may be realized by files. The program 425 receives the communication log or application log transmitted from the above-described A1 server 130, A2 server 140, and B server 150 and stores the communication log or application log in the integrated communication log DB 413 or the integrated application log DB 414, and the integrated communication log DB 413. Alternatively, the integrated application log DB 414 is a program for implementing a process for searching for a log that matches a condition.

  Subsequently, in the network configuration described above, the user terminal application 221 of the user terminal 10 and the A1 server 130 (or A2 server 140) cooperate, and further, the A1 server 130 (or A2 server 140) and the B server 150 The flow of processing to be linked will be described. FIG. 5 is a diagram showing a processing procedure example 1 of the failure handling method in the present embodiment, and more specifically, a diagram showing a flow of processing of the application.

  In this case, the user terminal 10 first generates a transaction ID (hereinafter referred to as a TID) (502) when communication with the server is required in the process (501) in the user terminal application 221. Thereafter, this TID is handed over to other information processing devices during communication across the information processing devices, and the user terminal 10, the A1 server 130, the A2 server 140, the B server 150, etc., when outputting communication logs, application logs, etc. , Output this TID together.

  Next, the user terminal 10 outputs a communication log (request transmission) (503), and then transmits an A server processing request (504) to the carrier network 20. The A server processing request (504) reaches the load balancer 110 according to the destination.

  At this time, the load balancer 110 performs a server distribution destination specifying process (505), and determines which of the A1 server 130 and the A2 server 140 should transmit the A server processing request. The load balancer 110 transmits an A server processing request to the determined transmission destination (A1 server 130 in this example) (506).

  Upon receipt of the above-mentioned A server processing request, the A1 server 130 outputs (507) a communication log (request reception), and executes the A server application processing (508) by the above server application 321. Further, when issuing the B server processing request, the A1 server 130 outputs a communication log (request transmission) (509), and transmits the B server processing request to the B server 150 (510).

  When the B server 150 receives the above-described B server processing request, the B server 150 outputs (511) a communication log (request reception). The B server 150 outputs (513) a communication log (response transmission) and returns a response to the requesting A1 server 130 before returning a response after completing the B server application processing by its own server application.

  In this case, the A1 server 130 receives a response from the B server 150, outputs a communication log (response reception) (514), and executes the A server application process (515) by the server application 321. When the A1 server 130 responds to the requesting user terminal 10, it outputs (516) a communication log (response transmission) and returns a response.

  On the other hand, the user terminal 10 receives a response from the A1 server 130, outputs a communication log (response reception) (517), and executes user terminal application processing (518) by the user terminal application 221. In this way, a communication log is output in accordance with a series of processes between applications of each information processing apparatus. In the example of FIG. 5, the TID is generated at the start of communication by the user terminal application 221, but may be generated every time a user input to the user terminal application 221 occurs. In addition, server application processing that operates when accessed via HTTP is generally executed on the AP server. When the AP server receives a request in cooperation with the AP server, a communication log (request reception) A method of automatically performing output is also conceivable.

  An example of a communication log output as a result of executing the sequence shown in FIG. 5 is shown in FIG. In the example of the communication log 600 illustrated in FIG. 6, the TID generated in the user terminal 10 is “123456abc”, the IP address of the user terminal 10 is “123.1.1.10”, and the IP of the load balancer 110. The address is “210.1.1.110”, the IP address of the A1 server 130 is “210.1.1.130”, and the IP address of the B server 150 is “210.1.1.150”.

  In addition, the communication log 600 is disclosed by the port number “80” for the A server application of the A1 server 130 or the A2 server 140, and to the A server application of the A1 server 130 or the A2 server 140 through the load balancer 110. It shows that it is configured to be accessible with a URL of “http://abc.com/app”. Further, the B server application of the B server 150 is configured to be disclosed with a port number “80” and accessed with a URL “http://210.1.1.150/appB”.

  Items in the communication log 600 are a date 601, a communication type 602, a TID 603, a client IP 604, a client port number 605, a server IP 606, a server port number 607, a program type 608, and a URL 609. Of these, date 601 represents the date and time when the log was output. The communication type 602 is information indicating the type of communication log, SND_REQ (representing that a request has been transmitted), RCV_REQ (representing that a request has been received), SND_RES (representing that a response has been transmitted), There is a type such as RCV_RES (indicating that a response has been received).

  A TID 603 is a transaction ID, and is an ID used to uniquely identify a series of processes across a plurality of information processing apparatuses. The client IP 604 is a client-side IP address in HTTP communication, and the client port number 605 is a client port number in HTTP communication.

  The server IP 606 is a server-side IP address in HTTP communication, and the server port number 607 is a server-side port number in HTTP communication.

  A program type 608 is a type of a program that outputs a log, and a URL 609 is a URL for accessing a server-side application, that is, a server application 321. In this embodiment, the output example of the communication log 600 is described in a table format, but it may be output in a space-delimited text file.

  On the other hand, when a failure occurs in the processing of each application in the above-described user terminal 10 or A1 server 130, A2 server 140, B server 150, etc. of the data center 100, each device records the content of the failure in the application log. Become. FIG. 7 shows an output example of the application log 700. In the application log 700, the date 701 represents the date when the log was output, and the importance 702 represents the importance of the application log. The importance 702 includes, for example, FATAL (representing the occurrence of a failure that prevents the application operation from continuing), ERROR (representing the occurrence of a failure that prevents the transaction processing from continuing), and WARNING (transaction processing can continue, There are values such as the occurrence of a required event), INFORMATION (representing the occurrence of a change in the internal state of the application), and DEBUG (representing the occurrence of a message for debugging).

  A TID 703 is a transaction ID, and is an ID used for uniquely specifying the flow of processing across a plurality of information processing apparatuses.

  The program type 704 is the type of the program that has output the log, and the IP 705 is the IP address of the information processing apparatus that has output the log, and is used to identify the information processing apparatus (the user terminal 10 or servers).

  The message ID 706 is an ID for identifying the error that has occurred, and the content 707 is a character string that represents the content of the error that has occurred.

  In this example, the output example of the application log 700 is described in the form of a table. However, a form of outputting as a space-delimited text file is also conceivable.

  Each of the above-described servers, that is, the A1 server 130, the A2 server 140, and the B server 150, detects the log output by its own server application 321 and transmits the corresponding log to the management server 120. The processing flow in this case is illustrated in FIG.

  As shown in FIG. 8, the A1 server 130, the A2 server 140, the B server 150, and the like detect the log output by the server application 321 as a function implemented by executing the program 325 (801). The transmitted log is transmitted to the management server 120 (802). On the other hand, the log management server 120 stores the logs received from the A1 server 130, the A2 server 140, and the B server 150 in the integrated communication log DB 413 or the integrated application log DB 414 in the storage device 420 (803).

  Similarly to the log management server 120 collectively managing the logs output from the A1 server 130, the A2 server 140, and B150, the logs generated in the user terminal 10 are also transmitted to the management server 120 and sent to the management server 120. May be collected.

  Next, processing when a failure occurs in any of the information processing apparatuses in the above-described network configuration will be described. FIG. 9 is a diagram illustrating a processing procedure example 3 of the failure handling method according to the present embodiment.

  Here, first, the user terminal 10 detects a failure of the user terminal application 221 (901). As a failure detection method, for example, the application log file 233 collected for the user terminal application 221 is monitored by a predetermined function obtained by the user terminal 10 executing the program 225 (hereinafter, the same applies to each process). Then, a method of detecting a failure when the importance 702 value included in the application log file 233 is “ERROR” or “FATAL” can be employed.

  Next, the user terminal 10 reads the value of the TID 703 in the application log 233 having the importance 702 value of “ERROR” or “FATAL”, and the communication log file corresponding to the TID 713 value is read out. The communication partner at the time of failure occurrence is specified from the corresponding communication log (902). In the example of FIG. 7, for example, the value “234567bcd” of the TID 703 in the application log having the importance 702 value of “ERROR” is read, and the communication log associated with the value “234567bcd” of the TID 713 is transmitted. Read from the log file 232. Then, from each value of the client IP 604 and server IP 606 of each communication log output here, the server that is the communication partner of the user terminal 10 (IP address is “123.1.1.10”) at the time of the failure is, for example, The load balancer 110 (IP address is “123.1.1.110”) can be specified.

  Next, the user terminal 10 performs a module confirmation process (903). This process is a process of checking the operation of the information processing apparatus of the communication partner, in this case, that is, the module operating in the load balancer 110. Details of this processing will be described later.

  Subsequently, the user terminal 10 transmits a failure condition investigation request to the load balancer 110 of the communication partner (904). On the other hand, when receiving the processing from the user terminal 10, the load balancer 110 performs the server distribution destination specifying process as described above, and the user is assigned to the communication destination (here, the A2 server 140) as the distribution destination. The above-described failure status investigation request received from the terminal 10 is transmitted (906).

  Subsequently, the A2 server 140 receives the above-described failure status investigation request from the load balancer 110, and corresponds to the value of the above-described TID “234567bcd” included in the failure status investigation request in the same manner as in steps 902 to 904 described above. The communication log is read from the communication log file 326, the process (907) for identifying the communication partner (B server 150 here) at the time of failure from the corresponding communication log, and the B server that is the communication partner of the A2 server 140 A module confirmation process (908) in 150, and a process (909) for transmitting a failure status investigation request to the communication partner B server 150 are executed.

  On the other hand, the B server 150 that has received the above-described failure status investigation request from the A2 server 140 identifies (910) the communication partner in the same manner as in the above-described step 902 and step 907, but in the sequence example illustrated in FIG. Since there is no further communication destination, the processing corresponding to steps 908 and 909 is not performed.

  On the other hand, the B server 150 acquires the application log when there is a failure from its own application log file 327 using the above-mentioned TID “234567bcd” as a key (911), and this is A2 which is the transmission source of the failure state investigation request Return to server 140.

  On the other hand, the A2 server 140 also acquires the application log from its own application log file 327 using the above-mentioned TID “234567bcd” as a key in the same manner as the B-server 150 (912), and receives the failure status investigation request. Return to 10. Further, the application log acquisition process is also performed on the user terminal 10 (913).

  As described above, the failure status investigation process is performed across the information processing apparatuses (the user terminal 10, the load balancer 110, the A2 server 140, and the B server 150) that have participated in the transaction in which the failure has occurred. And the application log information are collected in the user terminal 10.

  Subsequently, the user terminal 10 combines the information collected in this way with information such as the vehicle state in which the user profile 231 and the user terminal 10 are mounted, and specifies an action to respond to the failure (914). Details of the processing for specifying the corresponding operation will be described later. Finally, the user terminal 10 performs an operation for dealing with the failure identified in Step 914 (915). Details of this corresponding operation will be described later.

  Next, a failure status investigation flow executed by the information processing apparatus in response to the above-described failure status investigation request will be described. FIG. 10 is a diagram showing a processing procedure example 4 of the failure handling method in the present embodiment. This flow is processing executed by the user terminal 10, the A1 server 130, the A2 server 140, and B150. This flow is based on the premise that the TID of a transaction in which a failure has occurred is known.

  Also, the failure status investigation is the identification of the communication partner exemplified in the sequence of FIG. 9 (902, 907, 910), the module operation check (903, 908), the failure status investigation request (904, 909), and the application log. Each process of acquisition (911, 912, 913) is included. On the left side of the flowchart, portions corresponding to the respective processes are shown.

  In this case, first, the information processing apparatus that has received the failure status investigation request confirms that there is a communication log associated with the above TID (of the transaction in which the failure occurred) in the storage device of its own information processing apparatus. (1001). If the communication log associated with the above-mentioned TID cannot be specified by this process (1001: N), the information processing apparatus confirms that the log associated with the above-mentioned TID and URL exists for the management server 120. Confirm (1002). When step 1002 is executed on the user terminal 10, the result of step 1002 is always “N”, that is, there is no corresponding log.

  As a result of step 1002, when the management server 120 can identify the log with the above-mentioned TID and URL associated with each other (1002: Y), the information processing apparatus displays the communication partner indicated by the log identified by the management server 120. The information processing apparatus identifies that the redundant configuration is taken, and records “Yes” as the value of the redundant configuration 1104 of the failure status investigation result 1100 (FIG. 11) (1003).

  Further, the information processing apparatus acquires the value of the server IP 606 of all communication logs whose communication type 602 is “SND_REQ” as the IP of the communication partner (1004). On the other hand, as a result of step 1002 described above, when the management server 120 cannot identify the log having the corresponding TID and URL (1002: N), the information processing apparatus determines the failure location 1103 of the failure status investigation result 1100. Is recorded as “communication” (1005).

  Subsequently, the information processing apparatus specifies a communication partner module for each of the communication partner IPs obtained in step 1004 (1007). For example, the module identifying method DB 1200 shown in FIG. 12 is used to specify the communication partner module. In this case, the information processing apparatus acquires an entry whose IP address of the communication partner obtained in step 1004 matches the value of the processing apparatus IP 1201 in the module confirmation method DB 1200. Note that the value of the module 1202 in the module confirmation method DB 1200 is the name of the module, the value of the confirmation order 1203 is the order in which the operation is confirmed between modules, and the value of the confirmation method 1204 is the confirmation of the operation of the module. Shows how to do it.

  For example, in the example of FIG. 12, the information processing apparatus whose processing apparatus IP is “210.1.1.150”, that is, the B server 150, operates “OS” and “DB server” as modules. This indicates that the operation should be confirmed in the order of “OS” and “DB server”. Further, it is shown that the operation check of “OS” in this case is performed based on whether or not the ping command is “reply”, and the operation check of “DB server” is performed depending on whether or not the connection to the DB is successful.

  In the example of the module confirmation method DB 1200 in FIG. 12, the value of the confirmation method 1204 is described in text for easy understanding, but may be stored in a format that can be executed by an information processing apparatus such as a program. . Further, although the module is managed for each processing device IP1201, it may be managed for each URL that is an identifier used when accessing the application.

  After executing step 1007 described above, the information processing apparatus executes a check (operation check) on the communication partner module according to the value of the confirmation order 1203 of each module and the value of the confirmation method 1204 (1009). As a result of this check, if the corresponding module is normal (1010: Y), the information processing apparatus returns the processing to step 1008 and performs the operation check of the next module. The information processing apparatus repeats such module operation confirmation processing for the number of modules, and confirms whether or not the processing has been completed (1008).

  In this embodiment, the module check (1009) processing is performed from the communication source information processing apparatus to the communication partner information processing apparatus. You may close and check in the own information processing apparatus. In other words, when a failure situation investigation request is received, a module operating in the information processing apparatus is identified and its operation is confirmed.

  The description returns to step 1008. If the operation confirmation for the number of modules has not been completed (1008: N), the information processing apparatus executes steps 1009 and 1010. On the other hand, if the operation confirmation for the number of modules has been completed (1008: Y), the information processing apparatus returns the process to step 1006, and the communication partner acquired in step 1004 by performing the processes in steps 1007 to 1010 described above. Repeat for a few minutes.

  On the other hand, if the processes in steps 1007 to 1010 described above have been executed for the number of communication partners acquired in step 1004 (1006: Y), the information processing apparatus advances the process to step 1013.

  If the corresponding module is not normal as a result of the processing in step 1010 described above (1010: N), the information processing apparatus uses the name of the module that is not normal as the value of the failure location 1103 in the failure status investigation result 1100. Is recorded (1011), and a failure status investigation request is transmitted to a communication partner that has not been processed among the communication partners obtained in step 1004 (1012). At this time, the information processing apparatus transmits the communication log information specified in step 1001 or step 1002 described above to the other party.

  Next, in step 1013, the information processing apparatus acquires the application log associated with the above-described TID (TID of the transaction in which the failure has occurred) in its own storage device. If the information processing apparatus is the user terminal 10, a log is acquired from the application log file 233 stored in its own storage device, and if it is a server (A1 server 130, A2 server 140, B server 150), the management server Requested to 120 and acquired from the integrated application log DB 41 of the management server 120.

  Next, the information processing apparatus records the IP of the information processing apparatus as the value of the processing apparatus IP1101 of the failure status investigation result 1100 (1014), and returns the failure status investigation result 1100 to the sender of the failure status investigation request. (1015), and the process ends.

  Note that, as a result of the above processing (1001 to 1015) being performed by the information processing apparatus, the failure state investigation result 1100 shown in FIG. 11 is generated and returned to the sender of the failure state investigation request. The failure status investigation result 1100 is obtained from each value of the processing device IP 1101, the application log 1102 generated in the corresponding processing device, the failure location 1103, and the redundant configuration 1104 for each information processing device used in the failed transaction. It is configured. The method for setting each value is as described above. In the present embodiment, the failure status investigation result 1100 is expressed in a table format, but may be described as structured data such as XML or JSON.

  In the above example, the information processing device on the network is determined whether or not the redundant configuration exists based on the difference between the information processing device called when the failure occurs and the information processing device called when the failure status is investigated. However, a representative IP address (IP address of the load balancer 110) or URL and a table of whether or not there is a redundant configuration are prepared in advance, and a method for determining the presence or absence of a redundant configuration from the URL of the client access destination can also be adopted. .

  Next, the failure handling method DB 234 will be described. FIG. 13 is a diagram showing a data configuration example of the failure handling method DB 234 of the present embodiment. The failure handling method DB 234 exemplified here includes values of an application log 1301, a failure location (observation location) 1302, a redundant configuration 1303, a user profile 1304, a vehicle state 1305, an application property 1306, and a handling method 1307. .

  Among these, the application property 1306 is an attribute managed for each URL for publishing the application (user terminal application 221 and server application 321), and indicates that the application is called by a user operation (acted by the user as a trigger). Example: restaurant search application), background (indicating that the app is called in the background without any user operation. Example: app that acquires traffic information to be displayed on the map of the car navigation device) Assume that there are types. Note that “-” in the DB represents any value. In the example of FIG. 13, the handling method is expressed in text, but can be described by a program that can be executed by an information processing apparatus such as the user terminal 10.

  The information processing apparatus using such a failure response method DB 234 includes the processing device IP 1101, application log 1102, failure location 1103, redundant configuration 1104, and its own, which are included in the failure status investigation result 1100 obtained by the flow of FIG. 10. User profile 231 held in the storage device, information on the vehicle state obtained by connecting to the in-vehicle network used for controlling the vehicle on which the information processing device is mounted, and the application published in the URL recorded in the communication log The property 1306 is stored in the above-described failure response method DB 234 (values stored in the application log 1301, failure location (observation location) 1302, redundant configuration 1303, user profile 1304, vehicle state 1305, application property 1306). To obtain the value of the corresponding method 1307 in which each value matches That. Further, the information processing apparatus executes an operation corresponding to the acquired value of the handling method 1307.

  For example, among the rows in the failure handling method DB 234 of FIG. 13, “# 1” and “# 2” entries are output in the application log 1301 with the content “The user terminal is set to communication disabled and communication is not possible”. The application behavior 1306 defines a corresponding operation when the user operation is “user operation”. In this case, the information processing apparatus refers to the value of the age 1402 of the user profile 1304. If the age of the corresponding user is “60 or more”, the information processing apparatus displays a message including the telephone number of the support center to the corresponding user. On the other hand, if the age is less than 60, a message not including the support center telephone number is displayed on the display device 203 to the user. By performing such control, the number of inquiries to the support center can be controlled.

  The entry of “# 3” corresponds to the case where the failure location 1302 is server communication. Regarding the server, when the value of the failure location 1302 is “communication”, it indicates that communication has been made when the failure status is investigated. In other words, it was not possible to communicate at the time of failure, but it can be predicted that communication was possible at the time of failure status investigation. Therefore, the information processing apparatus in this case executes the handling method 1307 for retransmitting the request from the user terminal.

  The entry “# 4” corresponds to the case where the failure location 1302 is “OS”, the failure location (observation location) is “user terminal”, and the application property 1306 is “user operation”. It becomes. Under such circumstances, the radio wave condition of the carrier network 20 may be bad. Therefore, the information processing apparatus in this case executes a handling method 1307 in which a message indicating that the radio wave status is confirmed is displayed on the display device 203 to the user.

  The entries “# 5” and “# 6” correspond to the case where any of “Web server / AP server / DB server” is invalid and there is no redundant configuration in the module operation check process. Will be. A failure in the middleware of the Web server / AP server / DB server may be recovered by restarting. Therefore, in this case, when the application property 1306 is “user operation”, the information processing apparatus re-executes the corresponding process after 5 minutes or more (the time required for restarting) to the user. Is displayed on the display device 203. On the other hand, when the application property 1306 is “background”, a corresponding method 1307 is executed in which the corresponding process is automatically re-executed after 5 minutes.

  The entry of “# 7” corresponds to the case where the failure location 1302 does not exist (that is, the checked module is normal). At this time, if a redundant configuration is taken, processing may be allocated to a normal server next time. Therefore, the information processing apparatus executes a handling method 1307 that automatically retransmits the request.

  The entry “# 8” corresponds to the case where there is no failure location 1302 and there is no redundant configuration. At this time, since the module is normal, it is considered that a failure has occurred in the application. In this case, it may be time-consuming to recover from the failure. Therefore, if the application property 1306 is “user operation”, the information processing apparatus shows the corresponding message on the display device 203 so as not to request the user for a while, and the URL remains the same for 30 minutes even if the user operates. Suppress the request from being sent. On the other hand, if the application property 1306 is “background”, the information processing apparatus retransmits the request after 30 minutes.

  The entries “# 10” and “# 11” determine whether or not to display the contents of the application log depending on whether or not the application log 1301 exists and the vehicle state 1305 is “driving”. The entry “# 12” corresponds to a case where there is no application log and no other matching condition exists in the failure handling method DB 234. In this case, since the cause is an unknown error, the information processing apparatus executes a handling method 1307 in which a message is displayed on the display device 203 so as to make an inquiry to the support center.

  Although the best mode for carrying out the present invention has been specifically described above, the present invention is not limited to this, and various modifications can be made without departing from the scope of the invention.

  According to this embodiment, in an environment in which applications are linked among a plurality of devices on a network, the location where the failure occurs is efficiently identified and the user is encouraged to respond appropriately according to the situation. Can be effectively suppressed.

  At least the following will be clarified by the description of the present specification. That is, the arithmetic device of the information processing apparatus in the failure handling system according to the present embodiment obtains the application log associated with the identifier and the module for the identified second information processing apparatus held by the information processing apparatus And an application log associated with the identifier obtained from the second information processing apparatus in the process of performing at least one of the operation confirmation and specifying the fault location, and the third information processing apparatus And / or at least one of the operation confirmation result regarding the module in the information processing apparatus itself, the application log associated with the identifier obtained by the information processing apparatus itself, and the operation confirmation result of the module in the second information processing apparatus Based on the information and failure of the application or module of the information processing device that is not operating normally It is to identify as Tokoro may be.

  According to this, it is possible to identify a fault location in the information processing apparatus that senses the occurrence of the fault, and it is possible to deal with the fault more efficiently and accurately.

  In addition, when receiving the request, the arithmetic device of the second information processing apparatus in the failure handling system described above communicates with the third information processing apparatus that was the communication partner in the process corresponding to the identifier. For the identified third information processing apparatus, acquisition of an application log associated with the identifier, which is stored in the third information processing apparatus, and the third information processing apparatus It is also possible to further request at least one of the operation check of the module toward the fourth information processing apparatus as the communication partner in the processing corresponding to.

  This leads to a broader understanding of the range of information processing apparatuses that execute a series of processing via an identifier such as a transaction ID on the network, and as a result, the accuracy of identifying the fault location can be further improved and further accurately determined. It becomes possible to deal with troubles.

  Further, the arithmetic unit of the information processing apparatus in the failure handling system described above has at least each of the second to fourth information processing apparatuses connected in a transmission / reception relationship using the identifier as a key in the process of specifying the fault location. The application log associated with the identifier, output from the second to fourth information processing apparatuses connected as a result of execution of the process in response to the request and returned, and the communication partner Information on at least one of the operation confirmation results regarding the module in the information processing apparatus, the acquired information, the application log associated with the identifier obtained by the information processing apparatus itself, and the second Based on at least one of the information on the module operation check result in the information processing apparatus, the information processing apparatus that is not operating normally It is intended to identify publication or module as a fault location may be.

  According to this, it is possible to grasp a wider range of information processing devices that execute a series of processing via an identifier such as a transaction ID on the network, improve the accuracy of identifying the fault location, and handle the fault more accurately. It becomes.

  In addition, each information processing apparatus in the failure handling system described above includes, for each information processing apparatus or application that can be at least a communication partner in the storage device, an identifier of each module included in the corresponding information processing apparatus or used by the application. , Storing a module confirmation method database that defines the contents of the operation confirmation for each module and the execution order of the operation confirmation between modules, and the arithmetic unit of the second information processing apparatus is configured to store the request When the request includes the confirmation of the operation of the module, a search is performed in its own communication log using the identifier as a key, and the communication partner in the process corresponding to the identifier A third information processing device is identified, and for each module of the identified third information processing device, The content of the operation check of the module and the execution order of the operation check between the modules are identified in the module check method database, the operation check for each module is executed according to the execution order, and the execution result is obtained. It is good also as performing the process which sends in response the operation confirmation result regarding each said module to the said information processing apparatus which is the transmission origin of the said request | requirement.

  According to this, for each of the plurality of modules provided in the information processing apparatus, it is possible to efficiently perform accurate operation confirmation under a suitable execution order, further improving the efficiency and accuracy of identifying the fault location, Accurate failure handling is possible.

  The information processing apparatus in the above-described failure handling system performs a search in each communication log of the information processing apparatus and the second information processing apparatus using the identifier included in the application log as a key when a failure is detected. If there is no communication log associated with the identifier in any of the information processing devices, the second information processing device performs processing for specifying that a redundant configuration is taken in the network, and In the process of specifying the operation, the corresponding operation according to the specified failure location and the presence / absence of the redundant configuration is specified based on the content of the corresponding operation determined in advance according to the presence / absence of the redundant configuration at the failure location, and the corresponding response The operation may be performed.

  According to this, it is possible to cope with a more accurate failure by including the redundant configuration widely existing on the network by including it in the specific criterion of the corresponding operation.

  Further, the information processing apparatus in the failure handling system described above includes a user profile storing attribute information of a user of the information processing apparatus, a fault location on the network, and a user of the information processing apparatus in the storage device. A failure handling method database that associates at least one of an attribute and a state of a predetermined device including the information processing device or a combination of these with a corresponding operation at the time of the corresponding condition; In the process of specifying the corresponding operation, the arithmetic device is configured to acquire the specified failure location, the user attribute of the information processing device obtained from the user profile, and the predetermined device acquired from the predetermined device via a predetermined interface. Status information, or a combination of these, By collating the condition of law database to identify the corresponding operation, and executes the appropriate corresponding operation may be.

  According to this, it becomes possible to switch the system behavior at the time of failure response according to various conditions at the time of failure occurrence, that is, failure location, presence / absence of redundant configuration, user profile, user usage status, etc. The actions that the user should take when a failure occurs can be guided more precisely and appropriately. Therefore, user satisfaction can be improved. Moreover, if the user can take measures without hesitation when a failure occurs, the number of inquiries to the support center prepared by the application development vendor or system vendor and the frequency can be reduced.

  Further, the information processing apparatus in the failure handling system described above may be a user terminal on a network, and the second and third information processing apparatuses may be server apparatuses on the network. According to this, it is possible to identify a fault location regarding the linkage environment between the application of the user terminal and the application of the server device, and to perform accurate and efficient fault handling.

1 Failure response system 10 User terminal (information processing device)
20 Carrier network (network)
100 data center 110 load balancer 120 management server 130 A1 server (second information processing apparatus)
140 A2 server (second information processing apparatus)
150 B server (third information processing apparatus)
201, 301, 401 CPU (arithmetic unit)
202, 302, 402 Memory 203, 303, 403 Display device 204, 304, 404 Input device 205 Positioning device 206, 305, 405 Communication device 207 Acceleration sensor 208 Gyro sensor 209 Vehicle information acquisition device 220, 320, 420 Storage device 225 325, 425 Program 231 User profile 234 Failure response method DB
232, 326 Communication log file 233, 327 Application log file 413 Integrated communication log DB
414 Integrated application log DB

Claims (9)

A system including a plurality of information processing apparatuses that link applications with each other via a network,
Each information processing device
When an application is called from the second information processing apparatus, which is another information processing apparatus, when the application is executed, a communication log including an identifier of the process across the information processing apparatuses and a transmission / reception relationship between the information processing apparatuses is stored. Processing stored in the device;
A process of storing an application log including an error content and the identifier in a storage device when a failure occurs;
A process of performing a search in the communication log using the identifier included in the application log as a key when a failure is detected, and identifying a second information processing apparatus used in a process corresponding to the identifier when a failure occurs;
For the specified second information processing apparatus, acquisition of an application log associated with the identifier held by the second information processing apparatus, and processing in which the second information processing apparatus is associated with the identifier Processing for requesting at least one of the module operation check for the third information processing apparatus as a communication partner in
Information on at least one of an application log associated with the identifier and an operation confirmation result regarding a module in the third information processing apparatus as a result of the request being executed and returned by the second information processing apparatus And, based on the acquired information, a process for identifying an application or module of an information processing apparatus that is not performing normal operation as a failure location;
Based on the content of the corresponding action determined in advance according to the fault location, the corresponding action according to the specified fault location is specified, and the corresponding response operation is executed,
A failure response system comprising an arithmetic device that executes the following. The arithmetic unit of the information processing apparatus includes:
Executing at least one of acquisition of an application log associated with the identifier held by the information processing apparatus and operation check of the module directed to the identified second information processing apparatus;
In the process of identifying the fault location,
Information obtained from the second information processing apparatus, at least one of the application log associated with the identifier and the operation confirmation result regarding the module in the third information processing apparatus, and the information processing apparatus itself. An application or module of an information processing apparatus that is not operating normally based on at least one of the application log associated with the identifier and the module operation confirmation result in the second information processing apparatus Is identified as a failure location,
The failure handling system according to claim 1. The arithmetic unit of the second information processing apparatus is:
When the request is received, the third information processing apparatus that was the communication partner in the process corresponding to the identifier is specified in its own communication log, and the third information processing apparatus is identified with respect to the specified third information processing apparatus. Acquisition of an application log corresponding to the identifier held by the information processing apparatus, and the third information processing apparatus toward the fourth information processing apparatus that is a communication partner in the process corresponding to the identifier It further performs at least one of the request of the operation check of the module,
The failure handling system according to claim 2. The arithmetic unit of the information processing apparatus includes:
In the process of identifying the fault location,
As a result of executing and responding to the request according to the request between at least the second to fourth information processing apparatuses linked in the transmission / reception relationship with the identifier as a key, the linked second to the above Obtaining at least one of the application log output from each of the fourth information processing devices and corresponding to the identifier and the operation confirmation result regarding the module in the information processing device of the communication partner; The information processing apparatus itself performs normal operation based on at least one of the application log associated with the identifier and the module operation check result in the second information processing apparatus. The application or module of a non-information processing device is identified as a failure location.
The failure handling system according to claim 3. Each information processing device
In the storage device, at least for each information processing device or application that can be a communication partner, the identifier of each module included in the information processing device or used by the application, the content of the operation confirmation regarding each module, and between the modules A module confirmation method database that defines the execution order of the operation confirmation of
When the arithmetic unit of the second information processing apparatus receives the request and the request includes an operation check of the module, the arithmetic unit performs a search in its own communication log using the identifier as a key. The third information processing apparatus that was the communication partner in the process corresponding to the identifier is specified, and the operation confirmation contents of the corresponding module and the modules are determined for each module of the specified third information processing apparatus. The operation confirmation execution order in the module confirmation method database is specified in the module confirmation method database, the operation confirmation for each module is executed according to the execution order, and the operation confirmation result for each module, which is the execution result, is requested. A process of sending a reply to the information processing apparatus that is the transmission source of
The failure handling system according to claim 1. The information processing apparatus includes:
When a failure is detected, a search is performed in each communication log of the information processing apparatus and the second information processing apparatus using the identifier included in the application log as a key, and communication with which the identifier is associated with any information processing apparatus If the log does not exist, the second information processing apparatus executes processing for specifying that a redundant configuration is taken in the network,
In the process of specifying the corresponding operation, based on the content of the corresponding operation predetermined according to the presence or absence of the redundant configuration at the failure location, identify the corresponding operation according to the specified failure location and the presence or absence of the redundant configuration, To perform the corresponding action,
The failure handling system according to claim 1. The information processing apparatus includes:
In the storage device,
A user profile storing attribute information of a user of the information processing apparatus;
Associating at least one of the failure location on the network, the attribute of the user of the information processing apparatus, the state of the predetermined apparatus including the information processing apparatus, or a combination thereof with the corresponding action at the time And a database for troubleshooting
In the processing for specifying the corresponding operation, the arithmetic device,
Information of at least one of the identified failure location, the attribute of the user of the information processing device obtained from the user profile, and the state of the predetermined device acquired from the predetermined device via a predetermined interface, or a combination thereof Is to match the condition of the failure handling method database to identify the corresponding action, and execute the corresponding action.
The failure handling system according to claim 1.   The failure handling system according to claim 1, wherein the information processing apparatus is a user terminal on a network, and the second and third information processing apparatuses are server apparatuses on the network. Each information processing device that links applications to each other via a network
When an application is called from the second information processing apparatus, which is another information processing apparatus, when the application is executed, a communication log including an identifier of the process across the information processing apparatuses and a transmission / reception relationship between the information processing apparatuses is stored. Processing stored in the device;
A process of storing an application log including an error content and the identifier in a storage device when a failure occurs;
A process of performing a search in the communication log using the identifier included in the application log as a key when a failure is detected, and identifying a second information processing apparatus used in a process corresponding to the identifier when a failure occurs;
For the specified second information processing apparatus, acquisition of an application log associated with the identifier held by the second information processing apparatus, and processing in which the second information processing apparatus is associated with the identifier Processing for requesting at least one of the module operation check for the third information processing apparatus as a communication partner in
Information on at least one of an application log associated with the identifier and an operation confirmation result regarding a module in the third information processing apparatus as a result of the request being executed and returned by the second information processing apparatus And, based on the acquired information, a process for identifying an application or module of an information processing apparatus that is not performing normal operation as a failure location;
Based on the content of the corresponding action determined in advance according to the fault location, the corresponding action according to the specified fault location is specified, and the corresponding response operation is executed,
A failure response method characterized by executing

Images