JP2013168072A - Support device, support program and support method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To execute setting operations of an object device using a mouse.SOLUTION: A support device 100 includes an analysis unit 171 and an execution unit 172 . The analysis unit 171 analyzes control information in which a series of mouse operations for executing setting operations of an object PC is described in advance, and generates pseudo operation signals for performing mouse operations of the object PC on the basis of the analysis results. An execution unit 172 transmits operation signals generated by the analysis unit 171 to the object device so as to execute the mouse operations of the object PC.

Description

  The present invention relates to a support device and the like.

  Conventionally, when a PC (Personal Computer) is shipped to a customer, a setting operation for customizing the PC environment according to the customer's request is performed. Such setting work is manually performed by an operator. For example, the worker presses the power button of the PC and starts up the PC, and then operates the keyboard to input the password and logs in to the PC. Then, the worker operates the keyboard and mouse to input information to each item displayed on the PC screen, and performs setting work.

  Here, when the number of PCs to be set is large, the burden on the worker becomes large. For this reason, there exist various conventional techniques for automating a part of setting work for the PC.

  For example, the prior art 1 discloses a technique for capturing a PC screen and transmitting a key for logging in to the PC when the logon screen is recognized. Conventional technology 2 discloses a technology in which a script for automatically setting an application is incorporated in a PC to be set. In the prior art 3, there is a technique in which the server screen data is displayed on the client, and the server setting can be remotely operated from the client.

Japanese Patent Laid-Open No. 2003-316577 Japanese Patent Laid-Open No. 11-143613 JP 2010-20757 A

  However, the above-described prior art has a problem that it is not possible to execute a setting operation using a mouse for a PC.

  For example, in the above-described prior art 1, only the key for logging in to the PC is transmitted, and the load on the operator regarding the login operation can be reduced, but other setting work is not executed. Further, in the above-described prior art 2, it is assumed that the script is incorporated into the PC, and after all, the operator himself performs the setting operation.

  The disclosed technology has been made in view of the above, and an object thereof is to provide a support device, a support program, and a support method capable of executing a setting operation using a mouse for a target device.

  The disclosed support apparatus includes an analysis unit and an execution unit. The analysis unit analyzes control information in which a series of mouse operations for executing the setting operation of the target device is described in advance, and generates a pseudo operation signal for performing the mouse operation on the target device based on the analysis result. The execution unit executes a mouse operation on the target device by transmitting the operation signal generated by the analysis unit to the target device.

  According to the disclosed support device, there is an effect that the setting operation using the mouse for the target device can be executed.

FIG. 1 is a diagram illustrating a configuration of a system according to the present embodiment. FIG. 2 is a diagram illustrating an example of the data structure of the management table. FIG. 3 is a functional block diagram illustrating the configuration of the support device according to the present embodiment. FIG. 4 is a diagram illustrating an example of the data structure of the control script. FIG. 5 is a diagram illustrating an example of a display screen. FIG. 6 is a diagram (1) for supplementarily explaining the process of calculating the degree of coincidence. FIG. 7 is a diagram (2) for supplementarily explaining the process of calculating the degree of coincidence. FIG. 8 is a diagram (3) for supplementarily explaining the process of calculating the degree of coincidence. FIG. 9 is a diagram (4) for supplementarily explaining the process of calculating the degree of coincidence. FIG. 10 is a flowchart illustrating the processing procedure of the support device according to the present embodiment. FIG. 11 is a flowchart (1) showing the processing procedure of the script analysis processing. FIG. 12 is a flowchart (2) illustrating the processing procedure of the script analysis processing. FIG. 13 is a flowchart showing a processing procedure of key input transmission processing. FIG. 14 is a flowchart showing the processing procedure of the mouse click transmission processing. FIG. 15 is a flowchart illustrating a processing procedure of the matching degree calculation processing.

  Embodiments of a support device, a support program, and a support method disclosed in the present application will be described below in detail with reference to the drawings. Note that the present invention is not limited to the embodiments.

  The configuration of the system according to the present embodiment will be described. FIG. 1 is a diagram illustrating a configuration of a system according to the present embodiment. As shown in FIG. 1, this system includes a target PC (Personal Computer) 10 a, a management server 50, and a support device 100. For example, the support apparatus 100 is connected to the target PC 10a via a USB (Universal Serial Bus) or the like. The support device 100 is connected to the management server 50 via a LAN (local area network) or the like. The management server 50 is connected to a DB (Data Base) 50a.

  The target PC 10a is a PC that is an environment setting target. The target PC 10a has a plurality of USB ports, and an operator can operate the target PC 10a by connecting a mouse or a keyboard to the USB port. For example, the target PC 10a is connected to the support apparatus 100 via a USB port.

  A barcode 20 is attached to the target PC 10a. For example, the barcode 20 is converted into a code by a barcode reader or the like. The converted code includes identification information for uniquely identifying the target PC 10a.

  The management server 50 transmits the data stored in the DB 50 a to the support device 100 in response to a request from the support device 100. For example, the DB 50a stores a management table. FIG. 2 is a diagram illustrating an example of the data structure of the management table. As shown in FIG. 2, the management table has attributes of identification information, control script, and comparison source image data.

  The identification information is information that uniquely identifies the target PC. In this embodiment, as an example, the identification information of the target PC 10a is “PC10a”. The control script is information describing a series of operations for executing an environment setting operation of the target PC. Specific description regarding the control script will be described later. The comparison source image data is image data used to determine whether or not the display screen of the target PC is an appropriate screen when the support apparatus 100 performs the setting operation of the target PC.

  For example, when the management server 50 receives the identification information “PC10a” from the support apparatus 100, the management server 50 refers to the management table, and sends the control script corresponding to the identification information “PC10a” and the comparison source image data to the support apparatus. To 100.

  The support device 100 is a device that sets the environment of the target PC 10a. An example of the configuration of the support device 100 will be described. FIG. 3 is a functional block diagram illustrating the configuration of the support device according to the present embodiment. As illustrated in FIG. 3, the support apparatus 100 includes an input unit 110, a display unit 120, a camera 130, a USB transmission / reception unit 140, a LAN transmission / reception unit 150, a storage unit 160, and a control unit 170.

  The input unit 110 is an input device that inputs information on each tumor to the support device 100. For example, the input unit 110 corresponds to a touch panel, an input key, or the like. The display unit 120 is a display device that displays information on each tumor output from the control unit 170. For example, the display device corresponds to a display, a touch panel, or the like.

  The camera 130 is an imaging device that captures an image in response to an instruction from the control unit 170. The camera 130 also has a barcode reader function. The camera 130 receives an image shooting command or a barcode shooting command from the control unit 170.

  Processing when the camera 130 receives an image shooting command will be described. The camera 130 captures an image of the display screen of the target PC 10 a and outputs image data of the captured display screen to the control unit 170. In the following description, the image data on the display screen of the target PC 10a is referred to as comparison destination image data.

  Processing when the camera 130 receives a barcode shooting command will be described. The camera 130 captures an image of the barcode 20 of the target PC 10a, and converts the captured barcode into a code. The converted code becomes identification information for identifying the target PC 10a. The camera 130 outputs the identification information of the target PC 10a to the control unit 170.

  Although FIG. 3 shows a single camera 130 as an example, the present invention is not limited to this. For example, the support apparatus 100 may include a camera for capturing comparison target image data and a camera for capturing a barcode.

  The USB transmission / reception unit 140 is a processing unit that receives an operation signal from the control unit 170 and outputs the received operation signal to the target PC 10a. This operation signal is a signal that artificially reproduces the signal when the target PC 10a is operated with the mouse or the keyboard. Here, the mouse operation corresponds to the movement, click, double-click, drag, etc. of the mouse pointer. The keyboard operation corresponds to each tumor key input, button input while pressing Ctrl, Shift, and the like.

  The LAN transmission / reception unit 150 is a processing unit that executes data communication with the management server 50. For example, the LAN transmission / reception unit 150 receives the identification information of the target PC 10 a from the control unit 170 and transmits the received identification information to the management server 50. Further, the LAN transmission / reception unit 150 outputs the data received from the management server 50 to the control unit 170. For example, the LAN transmission / reception unit 150 receives a control script and comparison source image data corresponding to the identification information from the management server 50.

  The storage unit 160 stores a control script 161, comparison source image data 162, and comparison destination image data 163. For example, the storage unit 160 corresponds to a semiconductor memory device such as a random access memory (RAM), a read only memory (ROM), and a flash memory, or a storage device such as a hard disk or an optical disk.

The control script 161 is data describing a series of operations for executing an environment setting operation for the target PC. The control script 161 is obtained from the management server 50 described above. FIG. 4 is a diagram illustrating an example of the data structure of the control script. As shown in FIG. 4, the control script 161 has attributes of standby time, function, and content. Explanation regarding the standby time, function, and contents will be described later.

  The comparison source image data 162 is image data used for determining whether or not the display screen of the target PC 10a is an appropriate screen. For example, the comparison source image data 162 is image data of an arbitrary setting screen of the target PC 10a.

  The comparison destination image data 163 is image data of the display screen of the comparison PC 10a and is taken by the camera 130.

  The control unit 170 includes an analysis unit 171 and an execution unit 172. The control unit 170 corresponds to, for example, an integrated device such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). Moreover, the control part 170 respond | corresponds to electronic circuits, such as CPU and MPU (Micro Processing Unit), for example.

  The analysis unit 171 is a processing unit that sequentially reads and analyzes the lines of the control script 161 and generates a pseudo operation signal for performing a mouse operation and a key operation on the target PC 10a based on the analysis result. The analysis unit 171 outputs the generated operation signal to the execution unit 172. Hereinafter, the processing of the analysis unit 171 will be specifically described. The analysis unit 171 performs a preparation process and a script analysis process.

  A preparation process executed by the analysis unit 171 will be described. The analysis unit 171 receives a setting work start command from the input unit 110 and outputs a barcode shooting command to the camera 130. The analysis unit 171 acquires the identification information of the target PC 10 a from the camera 130 and outputs the identification information to the LAN transmission / reception unit 150. The identification information is transmitted to the management server 50 by the LAN transmission / reception unit 150.

  After the identification information is transmitted to the management server 50, the analysis unit 171 receives a control script and comparison source image data corresponding to the control information from the management server 50 via the LAN transmission / reception unit 150. The analysis unit 171 stores the control script and comparison source image data in the storage unit 160.

  Next, script analysis processing executed by the analysis unit 171 will be described. The analysis unit 171 extracts records for one line in order from the first line of the control script 161. The analysis unit 171 analyzes the record and identifies the standby time, function, and content. The analysis unit 171 performs various processes according to the function after waiting for the record standby time. Functions include comments, messages, keystrokes, clicks, and screen waits.

  Processing of the analysis unit 171 when the function is “comment” will be described. The analysis unit 171 skips the record analysis, extracts the record of the next line from the control script 161, and repeatedly executes the above processing.

  Processing of the analysis unit 171 when the function is “message” will be described. The analysis unit 171 outputs the content of the read record to the display unit 120 to display the content. For example, as shown in the second row from the top in FIG. 4, a case will be described in which a record with a function “message” and a content “turn on the target PC” is acquired. In this case, a display screen “Please turn on the target PC” is displayed on the display unit 120. FIG. 5 is a diagram illustrating an example of a display screen. The display screen 30 shown in FIG. 5 includes an OK button 31.

  After displaying the display screen, the analysis unit 171 waits until the OK button 31 on the display screen 30 is pressed. For example, the worker operates the input unit 110 and presses the OK button 31. When the OK button 31 is pressed, the analysis unit 171 takes out the record of the next line from the control script 161 and repeatedly executes the above processing.

  Processing of the analysis unit 171 when the function is “key input” will be described. The analysis unit 171 performs lexical analysis on the content of the read record and converts it into a corresponding input key. For example, when the content is “A”, the analysis unit 171 converts the input key “A”. The analysis unit 171 generates an operation signal corresponding to the input key, and outputs the operation signal to the execution unit 172. After outputting the operation signal, the analysis unit 171 takes out the record of the next line from the control script 161 and repeatedly executes the above processing.

  An example of processing in which the analysis unit 171 generates and outputs an input key operation signal will be described. Here, as an example, the input key is “A”. For example, the analysis unit 171 sequentially executes the following processes (1) to (4).

  (1) The analysis unit 171 generates an operation signal that means that the Shift key is down, and outputs the operation signal to the execution unit 172. The analysis unit 171 waits for a predetermined time after executing the process (1). (2) The analysis unit 171 generates an operation signal that means that the a key is down, and outputs the operation signal to the execution unit 172. The analysis unit 171 waits for a predetermined time after executing the process (2). (3) The analysis unit 171 generates an operation signal that means that the a key is up, and outputs the operation signal to the execution unit 172. The analysis unit 171 waits for a predetermined time after executing the process (3). (4) The analysis unit 171 generates an operation signal that means that the Shift key is up, and outputs the operation signal to the execution unit 172. The execution unit 172 sequentially outputs operation signals to the USB transmission / reception unit 140.

  By executing the processes (1) to (4), the same operation signal as when the input key “A” on the keyboard is pressed is input to the target PC 10a.

  Processing of the analysis unit 171 when the function is “click” will be described. The analysis unit 171 analyzes the content of the read record and determines the type of click and the movement position in the x and y directions. The analysis unit 171 outputs an operation signal corresponding to the determination result to the execution unit 172.

  A case where the content is “SCLICK (x1, y1)” will be described. x1 and y1 are arbitrary numerical values. The analysis unit 171 moves the mouse pointer from the current coordinate to the position of x1 in the x direction and y1 in the y direction from the origin, and outputs an operation signal meaning to left click to the execution unit 172. For example, the upper left corner of the display screen of the target PC 10a is set as the origin of the mouse pointer. Further, the direction from the left side to the right side of the display screen of the target PC 10a is defined as the positive direction of the x axis. A direction from the upper side to the lower side of the display screen of the target PC 10a is defined as a positive direction of the y axis.

  A case where the content is “RCLICK (x1, y1)” will be described. The analysis unit 171 moves the mouse pointer from the current coordinate to the position of x1 in the x direction and y1 in the y direction from the origin, and outputs an operation signal meaning to right click to the execution unit 172.

  A case where the content is “WCLICK (x1, y1)” will be described. The analysis unit 171 moves the mouse pointer from the current coordinates to the position of x1 in the x direction and y1 in the y direction from the origin, and outputs an operation signal meaning to double-click to the execution unit 172.

  A case where the content is “DRAG (x1, y1)” will be described. This operation corresponds to a drag operation. The analysis unit 171 moves an operation signal that means that the left button is up after moving the current coordinate from the current coordinate to the position of x1 in the x direction and y1 in the y direction while the left button of the mouse pointer is down. The data is output to the execution unit 172.

  Here, as an example, a process when the content is “SCLICK (500, 360)” will be described. For example, the analysis unit 171 sequentially executes the following processes (1) to (4).

  (1) The analysis unit 171 outputs to the execution unit 172 an operation signal meaning that the mouse pointer is moved by −1000 in the x direction and −1000 in the y direction. The operation (1) corresponds to an operation for moving the mouse pointer to the origin. The analysis unit 171 waits for a predetermined time after executing the process (1). (2) The analysis unit 171 outputs, to the execution unit 172, an operation signal that means moving the mouse pointer by 500 in the x direction and 360 in the y direction. The analysis unit 171 waits for a predetermined time after executing the process (2). (3) The analysis unit 171 outputs an operation signal meaning that the left button of the mouse has been down to the execution unit 172. The analysis unit 171 waits for a predetermined time after executing the process (3). (4) The analysis unit 171 outputs to the execution unit 172 an operation signal meaning that the left button of the mouse is up.

  By executing the above processes (1) to (4), the mouse pointer is moved from the current coordinate to the position of 500 in the x-direction and 360 in the y-direction, and then the same operation as when left-clicked. A signal is input to the target PC 10a.

  Processing of the analysis unit 171 when the function is “screen standby” will be described. The analysis unit 171 outputs an image shooting command to the camera 130. The analysis unit 171 acquires comparison destination image data from the camera 130 and stores the acquired comparison destination image data in the storage unit 160.

  The analysis unit 171 compares the comparison source image data 162 and the comparison destination image data 163 in the storage unit 160 and calculates the degree of coincidence. If the degree of coincidence is greater than or equal to the threshold value, the analysis unit 171 extracts the record on the next line from the control script 161 and repeatedly executes the above processing.

  On the other hand, when the degree of coincidence is less than the threshold, the analysis unit 171 outputs the image capturing command to the camera 130 again after a predetermined time, and acquires the comparison destination image data 163 from the camera 130. The analysis unit 171 updates the comparison target image data 163 in the storage unit 160, calculates the degree of coincidence, and repeatedly executes the above processing.

  Processing in which the analysis unit 171 calculates the degree of coincidence will be described. 6 to 9 are diagrams for supplementarily explaining the process of calculating the degree of coincidence. The analysis unit 171 binarizes the comparison source image data 162 and detects the shortest point from the four corners. As illustrated in FIG. 6, the analysis unit 171 detects points 162a to 162d.

  As illustrated in FIG. 7, the analysis unit 171 binarizes the comparison destination image data 163 and extracts the contour of the comparison destination image data 163. Then, as illustrated in FIG. 8, the analysis unit 171 detects the points 163 a to 163 d that are shortest from the four corners of the comparison target image data 163.

  As illustrated in FIG. 9, the analysis unit 171 compares the comparison target image data 162 so that the positions of the points 162 a to 162 d of the comparison source image data 162 coincide with the positions of the points 163 a to 163 d of the comparison target image data 163. Data 163 is processed. For example, the analysis unit 171 adds processing such as rotation, enlargement, and reduction to the comparison target image data 163.

  The analysis unit 171 calculates the degree of coincidence after the positions of the points 162a to 162d in the comparison source image data 162 and the positions of the points 163a to 163d in the comparison destination image data 163 are matched. The analysis unit 171 compares the comparison source image data 162 and the comparison destination image data 163 for each pixel, and counts the number of matching pixels. The analysis unit 171 calculates the ratio of the number of matching pixels with respect to the total number of pixels of the comparison source image data 162 as the matching degree.

  As described above, the analysis unit 171 executes various processes according to the function and outputs an operation signal to the execution unit 172.

  The execution unit 172 is a processing unit that receives an operation signal from the analysis unit 171 and outputs the received operation signal to the USB transmission / reception unit 140.

  Next, a process in which the analysis unit 171 takes out the record of each line of the control script 161 illustrated in FIG. 4 and executes the process will be described.

  The analysis unit 171 takes out the record in the first line of the control script 161 in FIG. The function of the record on the first line is “comment”. For this reason, the analysis unit 171 skips the processing and takes out the record in the second row.

  The function of the record on the second line is “message”. Therefore, the analysis unit 171 displays the display screen 30 shown in FIG. 5 and waits until the OK button 31 is pressed. The analysis unit 171 takes out the record in the third row after the OK button is pressed.

  The function of the record in the third line is “screen standby”. Further, the standby time is “0025”. The analysis unit 171 performs the function “screen standby” after waiting for the standby time “25 seconds”. That is, the analysis unit 171 compares the comparison source image data 162 and the comparison destination image data 163 to calculate the degree of coincidence. The content of the record on the third line in FIG. 4 is “WinLogon.jpg.80%”. Here, “WinLogon.jpg” is a name for identifying comparison source image data. Further, “80%” indicates that the threshold value of coincidence is “80%”. The analysis unit 171 repeatedly executes the process of the function “screen standby” until the degree of coincidence becomes “80%” or more. The analysis unit 171 takes out the record in the fourth row when the degree of coincidence is “80%” or more.

  The function of the record on the fourth line is “key input”. Therefore, the analysis unit 171 converts the content “password” into a corresponding input key “password”. The analysis unit 171 generates an input key operation signal and inputs it to the target PC 10a. The analysis unit 171 takes out the record in the fifth row.

  The function of the record in the fifth line is “click”. Therefore, the analysis unit 171 analyzes the content “SCLICK (500, 360)” of the record. The analysis unit 171 generates an operation signal for performing a left click after moving the mouse pointer from the current coordinates to the position of 500 in the x direction and 360 in the y direction from the origin, and inputs the operation signal to the target PC 10a.

  Next, a processing procedure of the support device 100 according to the present embodiment will be described. FIG. 10 is a flowchart illustrating the processing procedure of the support device according to the present embodiment. For example, the process illustrated in FIG. 10 is executed when a setting work start command is received from the input unit 110.

  As illustrated in FIG. 10, the support apparatus 100 outputs a barcode shooting command to the camera 130, and acquires identification information of the target PC 10a (step S101). The support device 100 transmits the identification information to the management server 50, and receives the control script and the target image data from the management server 50 (step S102).

  The support apparatus 100 stores the control script 161 and the target original image data in the storage unit 160 (step S103). The support device 100 extracts one line from the control script 161 (step S104) and executes a script analysis process (step S105).

  The support apparatus 100 determines whether all lines have been extracted from the control script 161 (step S106). When all the rows are extracted (step S106, Yes), the support device 100 ends the process.

  On the other hand, when not all the lines have been extracted (No at Step S106), the support apparatus 100 extracts the next line from the control script 161 (Step S107), and proceeds to Step S104.

  Next, the script analysis process shown in step S105 of FIG. 10 will be described. 11 and 12 are flowcharts showing the processing procedure of the script analysis processing. As illustrated in FIG. 11, the support apparatus 100 analyzes one line of the control script 161 and specifies the standby time, function, and content (step S110).

  The support device 100 waits for the waiting time (step S111), and determines whether the function is a comment (step S112). If the function is a comment (Yes in step S112), the support apparatus 100 skips (step S113) and ends the script analysis process.

  On the other hand, when the function is not a comment (No at Step S112), the support apparatus 100 determines whether the function is a message (Step S114). When the function is a message (Yes in step S114), the support apparatus 100 displays a message on the display unit 120 of the support apparatus 100 (step S115) and determines whether the OK button has been pressed (step S115). Step S116).

  When the OK button is not pressed (No at Step S116), the support device moves to Step S116 again. On the other hand, if the OK button is pressed (step S116, Yes), the script analysis process is terminated.

  If the function is not a message in step S114 (step S114, No), the support apparatus 100 determines whether the function is a key input (step S117).

  If the function is key input (step S117, Yes), the contents of the key are analyzed (step S118), and the words are converted into corresponding keys (step S119). The support apparatus 100 executes a key input transmission process (step S120), and ends the script analysis process.

  In step S117, when the function is not a key input in step S117 (step S117, No), the support apparatus 100 proceeds to step S121 in FIG. The support device 100 determines whether or not the click is made (step S121). If the function is a click (step S121, Yes), the support apparatus 100 executes a mouse click transmission process (step S122), and ends the script analysis process.

  When the function is not a click (step S121, No), the support apparatus 100 determines that the function is a screen standby (step S123). The support apparatus 100 captures an image of the target PC 10a (step S124), and executes a matching degree calculation process (step S125).

  The support device 100 determines whether or not the degree of coincidence is greater than or equal to a threshold (step S126). When the degree of coincidence is less than the threshold (No at Step S126), the support apparatus 100 waits for a predetermined time (Step S127), and proceeds to Step S124. If the degree of coincidence is equal to or greater than the threshold (Yes in step S126), the support device 100 ends the script analysis process.

  Next, the key input transmission process shown in step S120 of FIG. 11 will be described. FIG. 13 is a flowchart showing a processing procedure of key input transmission processing. In FIG. 13, as an example, a case where an operation of key input of “A” is performed will be described.

  As shown in FIG. 13, the support apparatus 100 transmits an operation signal meaning that the Shift key is down to the target PC 10a (step S150), and waits for a predetermined time (step S151).

  The support apparatus 100 transmits an operation signal meaning that the a key is down to the target PC 10a (step S152), and waits for a predetermined time (step S153).

  The support device 100 transmits an operation signal meaning that the a key is up to the target PC 10a (step S154), and waits for a predetermined time (step S155). The support apparatus 100 transmits an operation signal in the sense that the Shift key is up to the target PC 10a (step S156).

  Next, the mouse click transmission process shown in step S122 of FIG. 12 will be described. FIG. 14 is a flowchart showing the processing procedure of the mouse click transmission processing. As an example, FIG. 14 illustrates a case where the mouse pointer is moved from the origin to a position of 500 in the x direction and 360 in the y direction to perform a left click mouse operation.

  The support apparatus 100 transmits an operation signal meaning to move the mouse pointer by (−1000, −1000) to the target PC 10a, and moves the mouse pointer to the upper left corner (step S160).

  The support apparatus 100 waits for a predetermined time (step S161), and transmits an operation signal meaning to move the mouse pointer by (500, 360) to the target PC 10a (step S162). The support apparatus 100 waits for a predetermined time (step S163), and transmits an operation signal meaning that the left button of the mouse is down to the target PC 10a (step S164).

  The support apparatus 100 waits for a predetermined time (step S165), and transmits an operation signal that means that the left button of the mouse is up to the target PC 10a (step S166).

  Next, the matching degree calculation process shown in step S125 of FIG. 12 will be described. FIG. 15 is a flowchart illustrating a processing procedure of the matching degree calculation processing. As illustrated in FIG. 15, the support apparatus 100 detects the shortest point from the four corners of the comparison source image data 162 (step S170).

  The support apparatus 100 extracts a contour from the comparison destination image data 163 (step S171), and detects the shortest point from the four corners of the comparison destination image data 163 (step S172).

  The support apparatus 100 rotates, enlarges, or reduces the comparison target image data 163 so that the comparison target image data 163 matches the outer frame of the comparison target image data 163 with the outer frame of the comparison source image data 162. Conversion is performed (step S173).

  The support apparatus 100 compares the comparison-destination image data 163 and the comparison-source image data 162 for each pixel, and calculates the degree of coincidence (step S174).

  Next, effects of the support device 100 according to the present embodiment will be described. The support apparatus 100 analyzes a control script 161 in which a series of mouse operations for executing the setting operation of the target PC 10a is described in advance, and targets a pseudo operation signal for performing a mouse operation on the target PC 10a based on the analysis result. It transmits to PC10a. For this reason, according to the support apparatus 100, the setting operation | work using the mouse | mouth with respect to object PC10a can be performed.

  Further, the support apparatus 100 analyzes the control script 161 and transmits a pseudo operation signal for performing not only a mouse operation but also a key operation to the target PC 10a. For this reason, according to the support apparatus 100, a composite setting operation by a mouse operation and a key operation can be executed.

  In addition, the support apparatus 100 compares the comparison source image data 162 and the comparison destination image data 163, calculates the degree of coincidence, and transmits an operation signal when the degree of coincidence exceeds a threshold value. For this reason, according to the support apparatus 100, after confirming that the display screen of the target PC 10a is the screen that is surely the target of the setting work, the setting work can be executed, and the accuracy of the setting work can be improved. .

  Further, when transmitting an operation signal for performing a mouse operation, the support device 100 includes a signal for moving the position of the mouse pointer to the initial position of the upper left corner in the operation signal. Therefore, regardless of the position of the mouse pointer, various mouse operations can be executed after the mouse pointer is temporarily returned to the initial position, and the accuracy of the setting operation by the mouse operation can be improved. Note that the initial position in the above embodiment is an example, and may be, for example, the upper right corner, the lower left corner, the lower right corner, or the center of the display screen of the target PC 10a.

  Further, the support device 100 reads one line of the control script 161, adjusts the time interval for generating the operation signal according to the waiting time of the read line, and transmits the operation signal to the target PC 10a. For this reason, according to the assistance apparatus 100, the operation signal corresponding to a mouse operation and a key operation can be transmitted at an appropriate timing. For example, it is possible to avoid a situation in which a login password is transmitted when the display screen of the login screen of the target PC 10a is not displayed.

  Further, in addition to the above effects, the manual operation by the worker during the setting operation in the conventional mouse interface is eliminated, and the setting operation can be automated. In addition, human error and the like are eliminated, and improvement in the quality of setting work can be expected. In addition, the number of workers can be reduced, and the cost can be reduced.

  By the way, among the processes described in the present embodiment, all or a part of the processes described as being automatically performed can be manually performed, or the processes described as being performed manually can be performed. All or a part can be automatically performed by a known method. In addition, the processing procedure, control procedure, specific name, and information including various data and parameters shown in the above-described document and drawings can be arbitrarily changed unless otherwise specified.

  Further, each component of the support device 100 shown in the embodiment is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. Furthermore, each processing function performed by each device may be realized by a CPU and a program that is analyzed and executed by the CPU, or may be realized as hardware by wired logic.

10a Target PC
50 Management server 100 Support device

Claims (15)

Analyzing control information describing in advance a series of mouse operations for performing setting operations of the target device, and generating a pseudo operation signal for performing mouse operations on the target device based on the analysis results;
A support device comprising: an execution unit that performs a mouse operation on the target device by transmitting the operation signal generated by the analysis unit to the target device.   The control information further includes a series of key operations for executing a setting operation of the target device, and the analysis unit analyzes the control information and performs a pseudo operation for performing a mouse operation and a key operation on the target device. The support device according to claim 1, wherein an operation signal is generated, and the execution unit executes a mouse operation and a key operation on the target device by transmitting the operation signal to the target device. The control information further includes a shooting command for the screen of the target device, and the analysis unit acquires a comparison target image indicating an image of the screen of the target device using the imaging device according to the shooting command. , Calculating the degree of coincidence between the comparison target image and a predetermined comparison source image,
The support device according to claim 1, wherein the execution unit transmits the operation signal to the target device based on the degree of coincidence.   4. The support apparatus according to claim 1, wherein the analysis unit includes a pseudo signal for moving a mouse pointer to an initial position before the mouse operation.   The control information includes information on standby time, and the analysis unit adjusts a time interval for generating the operation signal according to the standby time. The support apparatus described. On the computer,
Analyzing the control information describing a series of mouse operations for performing the setting operation of the target device in advance, and generating a pseudo operation signal for performing the mouse operation on the target device based on the analysis result,
A support program for executing a mouse operation on the target device by transmitting the operation signal to the target device. The control information further includes a series of key operations for executing a setting operation of the target device,
The process of generating the operation signal analyzes the control information, generates a pseudo operation signal for performing mouse operation and key operation on the target device,
The support program according to claim 6, wherein the process of transmitting the operation signal executes a mouse operation and a key operation on the target device by transmitting the operation signal to the target device. The control information further includes a shooting command for the screen of the target device,
In accordance with the photographing command, a computer further acquires a comparison destination image indicating an image of the screen of the target device using an imaging device, and calculates a degree of coincidence between the comparison destination image and a predetermined comparison source image To run
The support program according to claim 6 or 7, wherein the process of transmitting the operation signal transmits the operation signal to the target device based on the degree of coincidence.   9. The support program according to claim 6, wherein the processing for generating the operation signal includes a pseudo signal for moving the mouse pointer to an initial position before the mouse operation in the operation signal. .   The control information includes standby time information, and the process of generating the operation signal adjusts a time interval for generating the operation signal according to the standby time. The support program as described in one. A support method executed by a computer,
Analyzing the control information describing a series of mouse operations for performing the setting operation of the target device in advance, and generating a pseudo operation signal for performing the mouse operation on the target device based on the analysis result,
A support method comprising: performing each process of performing a mouse operation on the target device by transmitting the operation signal to the target device. The control information further includes a series of key operations for executing a setting operation of the target device,
The process of generating the operation signal analyzes the control information, generates a pseudo operation signal for performing mouse operation and key operation on the target device,
12. The support method according to claim 11, wherein the process of transmitting the operation signal performs a mouse operation and a key operation on the target device by transmitting the operation signal to the target device. The control information further includes a shooting command for the screen of the target device,
In response to the shooting command, the image acquisition device is used to acquire a comparison destination image indicating an image of the screen of the target device, and further execute a process of calculating the degree of coincidence between the comparison destination image and a predetermined comparison source image And
The support method according to claim 11 or 12, wherein in the process of transmitting the operation signal, the operation signal is transmitted to the target device based on the degree of coincidence.   14. The support method according to claim 11, wherein the processing for generating the operation signal includes, in the operation signal, a pseudo signal for moving a mouse pointer to an initial position before a mouse operation. .   The control information includes information on a standby time, and the process for generating the operation signal adjusts a time interval for generating the operation signal according to the standby time. The support method as described in one.

Images