JP6544413B2 - Information processing apparatus, control method, program - Google Patents

Description

The present invention relates to an information processing apparatus, a control method, a program, even if not a regular user third party was terminated the process of transmitting the acquired image obtained by photographing the front of the information processing apparatus, information technique that allows to transmit an image captured in front of the processing device acquires and.

  In recent years, interest in teleworking has increased in each company. Telework has issues such as preventing third parties' access to confidential information and optimizing labor management, and these issues must be solved in order to be introduced.

  At present, in order to solve those problems, a telework management support system using face recognition technology is being developed. By using this system, it is possible to authenticate the person from the camera image, detect the status of a spoof or a look-ahead by a third party, and notify the administrator.

  In a telework management support system using such face recognition technology, if the accuracy of face detection / recognition is not high, the labor situation of the teleworker will be misjudged. Therefore, improvement in face detection / recognition accuracy is desired.

  In Patent Document 1, an information processing apparatus capable of acquiring an image obtained by capturing the front of a display unit registers trail data including image data of a screen displayed on the display unit in a server according to a person in the image. The mechanism is described.

JP, 2015-222555, A

  However, for example, if the teleworker PC used by the teleworker himself is being used by a third party other than the teleworker himself as the teleworker himself, the third party is afraid that the trail data will be taken. It is conceivable that the program for acquiring trail data, which is operated by the teleworker PC, is terminated (forced) so that the trail data of a third party can not be acquired.

  Also, a third party who is looking through the display of the teleworker PC is forced to terminate the program for acquiring the trail data which is running on the teleworker PC, for fear that the trail data will be taken. It is conceivable to make it impossible to obtain trail data of third parties.

  In such a case, the administrator could not confirm the image of the third party or the screen image of the teleworker PC operated by the third party.

  Also, for example, when a third party other than the authorized teleworker himself gives an instruction to end the process of the agent with an attitude that does not appear on the camera, the administrator can see that the terminal forward state is not normal. I could not confirm the screen image.

An object of the present invention, the acquisition is not a regular user third party, even to end the process of transmitting the acquired image obtained by photographing the front of the information processing apparatus, an image taken in front of the information processing apparatus to provide a mechanism that enables to send.

The present invention is an information processing apparatus having an imaging unit, an obtaining transmission means said imaging means and transmits the acquired image obtained by photographing the front of the information processing apparatus, authentication by the image pickup means possible states face of the user is not captured, or in a state where the face is not in the user is photographed, when the process of executing the acquisition and transmission process by the acquisition and transmission unit has been completed, start the process A process of performing acquisition and transmission processing by the acquisition and transmission unit, and executing acquisition and transmission processing by the acquisition and transmission unit while the face of the user who can be authenticated is captured by the imaging unit; And a control unit configured to control not to start the process when it is finished .

Further, the present invention includes the acquisition and transmission process of a control method in an information processing apparatus having an imaging means, the imaging means is transmitted to acquire an image obtained by photographing the front of the information processing apparatus, the state in which the face of possible authentication user by the imaging means is not taken, or in a state in which the non-user face is photographed, when the process of executing the acquisition and transmission processing by said acquisition and transmission process is completed, the A process is activated to control acquisition and transmission processing by the acquisition and transmission step, while acquiring and transmitting processing by the acquisition and transmission step while the face of the user who can be authenticated is captured by the imaging unit. And a control step of controlling not to start the process when the process of executing the step is terminated .

According to the present invention, the acquisition is not a regular user third party, even to end the process of transmitting the acquired image obtained by photographing the front of the information processing apparatus, an image taken in front of the information processing apparatus and it is possible to be able to transmit.

It is a figure which shows an example of a system configuration | structure of the telework management system 100 of this invention. It is a block diagram showing an example of the hardware constitutions of an information processor applicable to management server 101, PC for teleworkers 111, and PC for administrators in an embodiment of the present invention. The respective devices have the same configuration, and therefore will be described using the same reference numerals. It is a flowchart which shows an example of the control processing which PC 111 for teleworkers which a teleworker uses. It is a figure which shows an example of the flowchart of a detailed process of the telework monitoring / management process of S304. It is a figure which shows an example of the flowchart of a detailed process of the telework monitoring / management process of S304. It is a figure which shows an example of the flowchart of a detailed process of the monitoring process of the monitoring program 703 of S305. FIG. 7 is a diagram showing an example of a conceptual diagram for explaining the operation of a telework program 701 including a monitoring program 702 and a monitoring program 703. It is a figure which shows an example of the camera image which the camera 113 of PC 111 for teleworkers determined as "spoofing" by S407 image | photographed. It is a figure which shows an example of the camera image which the camera 113 of PC 111 for teleworkers determined as "peep watch" by S415 was image | photographed. It is a figure which shows an example of the flowchart of a detailed process of the telework monitoring / management process of S304.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing an example of a system configuration of a telework management system 100 of the present invention.

  The telework management system 100 is configured such that one or more management servers 101, one or more teleworker PC 111, one or more administrator PC 121 are connected via the Internet 130.

  The management server 101 is a server that centrally manages information on the presence and absence status of teleworkers and information (telework information (trail information)) such as peeping in and spoofing by a third party, and is constructed on the service environment network 104 It is done.

  When the teleworker PC 111 and the administrator PC 121 connect to the management server 101 by authentication processing using an account ID (user ID) and a password, and the management server 101 receives telework information from the teleworker PC 111, It is stored in the database of the management server 101. Further, when the management PC 101 receives a telework information acquisition request from the administrator PC 121, the management server 101 acquires necessary telework information from the database of the management server 101, transmits it to the administrator PC 121, and displays it.

  The teleworker PC 111 receives an application (reporting) on work from the teleworker and whether it is working or not at work, and the state in front of the terminal (image) taken by the camera 113 (imaging device) connected to the teleworker PC 111 Terminal This is a terminal that detects the front state (whether a teleworker is present / apart, whether a watching or spoofing has occurred). The teleworker PC 111 exists on a remote home network 110 (not a home network but may be, for example, a network such as a cafe), and the terminal forward state is a management server via the router 112, the Internet 130, and the router 103. It is sent to 101. The camera 113 (imaging device) is a camera for imaging the front of the teleworker PC 111.

  The teleworker PC 111 is an application example of the information processing apparatus of the present invention, is a terminal used by a user who performs telework, and includes an imaging unit such as a camera 113 or the like.

  The administrator's PC 121 is a terminal for confirming telework information, exists on the in-house network 120, and uses a web management console (operating on a web browser) to confirm the telework information. 130, and connects to the management server 101 via the router 103.

  In the present embodiment, the teleworker PC 111 detects the forward state of the terminal and transmits information to the management server 101. However, only the video (image) is transmitted from the teleworker PC 111 to the management server 101. The management server 101 may be configured to detect the terminal front state from the video (image).

  FIG. 2 is a block diagram showing an example of the hardware configuration of an information processing apparatus applicable to the management server 101, the teleworker PC 111, and the administrator PC 121 according to the embodiment of this invention. The respective devices have the same configuration, and therefore will be described using the same reference numerals.

  As shown in FIG. 2, the information processing apparatus includes a central processing unit (CPU) 201, a read only memory (ROM) 202, a random access memory (RAM) 203, a storage device 204, an input controller 205, and a system bus 200. An audio input controller 206, a video controller 207, a memory controller 208, and a communication I / F controller 209 are connected.

  The CPU 201 centrally controls the devices and controllers connected to the system bus 200.

  The ROM 202 or the storage device 204 is a control program executed by the CPU 201, such as a BIOS (Basic Input / Output System) or an OS (Operating System), a computer readable and executable program for realizing the information processing method, and various necessary items. It holds data (including data tables).

  The RAM 203 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 loads programs and the like necessary for execution of processing from the ROM 202 or the storage device 204 to the RAM 203, and implements various operations by executing the loaded programs.

  The input controller 205 controls an input from the input device 210. Examples of the input device 210 include a keyboard, a touch panel, a pointing device such as a mouse, and an imaging device such as the camera 113.

  The imaging device such as the camera 113 is a camera for imaging the front of the terminal, and the teleworker PC 111 is in front of the terminal according to the photographed image (the terminal front state (teleworker is present / apart) Can be identified)).

  When the input device 210 is a touch panel, various instructions can be given by the user pressing (touching with a finger or the like) according to an icon, a cursor or a button displayed on the touch panel.

  Further, the touch panel may be a touch panel capable of detecting a position touched by a plurality of fingers, such as a multi-touch screen.

  When the microphone / speaker 211 operates as a microphone function, the voice input controller 206 can control voice input from the microphone / speaker 211 and can recognize voice input from the microphone / speaker 211. Further, when the microphone / speaker 211 operates as a speaker function, the audio input controller 206 can control audio output to the microphone / speaker 211 and can output audio to the microphone / speaker 211.

  The video controller 207 controls display on an external output device such as the display 212. The display shall also include the display of a notebook computer integrated with the main unit. The external output device is not limited to the display, and may be, for example, a projector. In addition, an input device 210 is provided for a device that can be received by the above-described touch operation.

  The video controller 207 can control a video memory (VRAM) for display control, and can use a part of the RAM 203 as a video memory area, or can separately provide a dedicated video memory. It is possible.

  In the present invention, the first video memory area used for display when the user normally uses the information processing apparatus and the display content of the first video memory area when the predetermined screen is displayed It has a second video memory area used for display. The video memory area is not limited to two, and can be plural as long as the resource of the information processing apparatus permits.

  The memory controller 208 controls access to the external memory 213. The external memory is connected via an adapter to an external storage device (hard disk) that stores a boot program, various applications, font data, user files, editing files, various data, etc., a flexible disk (FD), or a PCMCIA card slot. Compact flash (registered trademark) memory etc. can be used.

  The communication I / F controller 209 connects / communicates with an external device via the network 214 (104, 110, 120), and executes communication control processing in the network. For example, communications using TCP / IP, telephone lines such as ISDN, and 3G lines of mobile phones are possible.

  The storage device 204 is a medium for permanently storing information, and the form thereof is not limited to a storage device such as a hard disk. For example, a medium such as a solid state drive (SSD) may be used.

  Moreover, it can also be used as a temporary memory area at the time of various processes performed by the communication terminal in the present embodiment.

  The CPU 201 enables display on the display 212 by executing, for example, outline font rasterization processing on a display information area in the RAM 203. In addition, the CPU 201 enables user instruction with a mouse cursor (not shown) or the like on the display 212.

  FIG. 3 is a flowchart showing an example of control processing executed by the teleworker PC 111 used by the teleworker.

  The processing shown in each step shown in FIG. 3 is realized by the CPU 201 of the teleworker PC 111 loading a telework program 701 (also referred to simply as an agent) stored in storage means such as the external memory 213 into the RAM 203 and executing it. Be done.

  FIG. 7 is a diagram showing an example of a conceptual diagram for explaining the operation of the telework program 701 including the monitoring program 702 and the monitoring program 703.

  That is, the telework program 701 (acquisition unit, transmission unit) includes a monitoring program 702 (second monitoring unit).

  FIG. 7A is a diagram showing an example of a conceptual diagram showing that a telework program 701 to be described later and a monitoring program 703 for monitoring whether the processing of the telework program 701 has ended mutually monitor each other. is there.

  As shown in FIG. 7A, the teleworker PC 111 stores a telework program 701 (agent), a monitoring program 702, and a monitoring program 703.

  Also, the telework program 701 (agent) includes a monitoring program 702.

  The monitoring program 702 is a program for monitoring whether or not the process (processing) of the monitoring program 703 has ended.

  The monitoring program 702 is an application example of the second monitoring means of the present invention, and monitors a process for executing a monitoring process by the monitoring program 703 (first monitoring means).

  The monitoring program 703 is a program for monitoring whether the process (process) of the telework program 701 has ended.

  The monitoring program 703 is an application example of the first monitoring means of the present invention, and monitors a process for executing acquisition processing (processing of the telework program 701) by the acquisition means.

  First, the teleworker PC 111 reads out and starts the telework program 701 (S301). Since the telework program 701 also includes the monitoring program 702, the monitoring program 702 is also activated here.

  Then, in the teleworker PC 111, the telework program 701 reads out the monitoring program 703 and starts up (S302).

  Next, the teleworker PC 111 establishes communication with the management server 101 so that trail information can be transmitted in step S413.

  Specifically, the telework program 701 displays a login screen for logging in to the management server 101. The login screen displayed here includes an input field for receiving an account ID (user ID) and a password.

  When the telework program 701 receives an input of an account ID (user ID) and a password by the user via the login screen, the telework program 701 transmits the user ID and the password of the received input to the management server 101.

  Here, the means for accepting the input of the account ID (user ID) and password by the user via the login screen is an application example of the accepting means of the present invention, and the telework program 701 is an authentication information by the operation of the user. Accept the input of

  Here, the means for transmitting the user ID and password received the input to the management server 101 is an application example of the authentication request means of the present invention, and authentication information for which the input is received by the reception means is provided with an authentication means. By transmitting to the management server 101, a user authentication request is made.

  When the management server 101 receives the user ID and password (a combination of a user ID and a password is referred to as authentication information) transmitted from the telework program 701, the management server 101 sends the authentication information (user ID and password) to the management server 101 in advance. The user authentication process is executed by determining whether the registered authentication information (account ID (user ID), password) matches. Then, in the authentication process of the user, it is determined whether communication with the management server 101 and the use of a service described later are permitted. The authentication process of the user here is an application example of the authentication means of the present invention, and the reception means authenticates the user according to the authentication information accepted by the operation of the user by the user.

  Then, the management server 101 is determined that the authentication information matches, and it is determined that the user authentication is successful (authenticated) (permission of communication with the management server 101 and use of a service described later) In the case where it is determined, the notification that the user has been authenticated is transmitted to the telework program 701.

  When the telework program 701 receives a notification that the user has been authenticated from the management server 101, the telework program 701 stores the input authentication information (user ID, password) in a predetermined storage location. , Setting and registering the authentication information (S303).

  Here, the means for the telework program 701 to receive a notification that the user has been authenticated from the management server 101 is an application example of the authentication result acquisition means of the present invention, and in response to the authentication request by the authentication request means The authentication result of the user by the authentication unit is acquired from the management server.

  Then, the telework program 701 executes the telework monitoring / management processing (S304) and the monitoring processing (S305) of the monitoring program 703 in parallel processing.

  The detailed processing of the telework monitoring and management processing (S304) will be described with reference to FIGS.

  Further, detailed processing of the monitoring processing (S305) of the monitoring program 703 will be described using S601 to S605 in FIG.

  Further, detailed processing of the monitoring program 703 activated in S302 will be described using S606 to S609 in FIG.

  When the telework program 701 (agent) determines that the end instruction is pressed by the user in a state not in the agent continuation processing mode described later, the execution (process) of the processing in S304 and S305 ends, and the processing is performed. finish.

  Also, each process of the telework program 701 (agent) and the monitoring program is displayed as each process displayed by, for example, a task manager or the like, and the process of each process is received by receiving a user's end instruction (kill command etc.). Can be terminated.

  Next, detailed processing of the telework monitoring / management processing of S304 will be described using FIG.

  FIG. 4 is a view showing an example of a flowchart of detailed processing of telework monitoring / management processing of S304.

  The processing shown in each step shown in FIG. 4 is realized by the CPU 201 of the teleworker PC 111 loading a telework program 701 (also referred to simply as an agent) stored in storage means such as the external memory 213 into the RAM 203 and executing it. Be done.

  First, the telework program 701 acquires an image (camera image) captured by the connected camera 113 (S401). The image acquired here is stored in the RAM 203.

  S401 is an application example of the image acquisition unit of the present invention, and acquires an image obtained by the imaging unit such as the camera 113 photographing the front of the teleworker PC 111 (information processing apparatus).

  That is, S401 is an application example of the acquisition means of the present invention, and the image pickup means (camera 113) acquires an image obtained by photographing in front of the information processing apparatus (teleworker PC 111).

  Next, the telework program 701 detects the face of the user included in the image by analyzing the image acquired in step S401 (S402). For example, known techniques are used for face detection. The detection result is stored in the RAM 203.

  Then, the telework program 701 determines the number of faces detected in S402. Specifically, it is determined whether the number of faces detected in S402 is one, two or more, or zero (whether a face could not be detected (a face is not detected)). (S403).

  Then, if it is determined that the number of faces detected in step S402 is 0 (no faces can not be detected (faces are not detected)) in step S403, the telework program 701 performs processing. The process shifts to step S416, and the terminal forward state (working state of the teleworker) is determined and set as "away" (S416). That is, it is determined that the teleworker is away from the seat.

  If it is determined in S403 that the number of faces detected in S402 is two or more, the telework program 701 shifts the processing to S415 and the terminal forward state (teleworker work) State) is determined and set as "peeping" (peeping in). That is, it is determined that the display unit is being peeped from another unauthenticated third party (S415). The face authentication process of S404 may be performed in S415 to determine whether the teleworker himself / herself is present.

  If it is determined in S403 that the number of faces detected in S402 is one, the telework program 701 shifts the processing to S404, and the detected faces are teleworkers. A face authentication process is performed to confirm whether the face is the face of the person (S404). Specifically, the telework program 701 calculates the similarity between the face image of the face detected from the image captured by the camera 113 in S402 and the face image of the teleworker registered in advance in the teleworker PC 111.

  Then, the telework program 701 compares the degree of similarity calculated in step S404 with a preset threshold value relating to the degree of similarity, and determines whether the face detected from the image in step S402 is the face of the teleworker himself . Specifically, if the similarity calculated in S404 satisfies the predetermined threshold, it is determined to be the teleworker itself, and if it does not satisfy the predetermined threshold, it is determined to be the third party (others) other than the teleworker itself. Do.

  S404 is an application example of the face authentication means of the present invention, and face authentication is performed using the image acquired by the acquisition means of S401.

  That is, when the degree of similarity calculated in S404 satisfies the predetermined threshold, the telework program 701 determines that the user of the face detected from the image in S402 is the user (teleworker himself) authenticated in S303. On the other hand, when the similarity calculated in S404 does not satisfy the predetermined threshold, the user of the face detected from the image in S402 is a third party (the user who is the teleworker) authenticated in S303 It is determined that the other person). Then, the telework program 701 acquires the determination result (S405).

  S405 is an application example of the determination result acquisition means of the present invention, and the determination result of whether or not the image acquired by the image acquisition means of S401 includes the face of a third party other than the user is acquired. .

  The determination process of S405 may be performed by, for example, the management server 101, and the teleworker PC 111 may obtain the determination result from the management server 101 in S405. In that case, the teleworker PC 111 transmits the image acquired by the image acquiring unit in step S401 to the management server 101, and the management server 101 transmits the image of the face detected from the image to the management server 101 in advance. Calculate the degree of similarity with the registered teleworker's face image. Whether the image acquired by the image acquisition unit of S401 includes the face of a third party other than the user by determining whether the management server 101 satisfies the predetermined threshold. It judges whether or not.

  That is, the determination result acquisition unit of S405 is a user other than the user who has been authenticated by the authentication unit that authenticates the user according to the authentication information that the input unit receives by the user operation on the image acquired by the image acquisition unit. The determination result as to whether or not the third party's face is included is acquired.

  That is, in the process of calculating the degree of similarity, the degree of similarity between the face image of the user authenticated by the authentication means and the image (face image) acquired by the image acquisition means of S401 is calculated.

  When the image acquired by the image acquiring means includes the face of only one third party other than the user, the judgment result acquiring means acquires the judgment result that the user is impersonating the person. .

  Then, if it is determined that the user of the face detected from the image in S402 is the user (teleworker himself) authenticated in S303 in S405, the telework program 701 shifts the processing to step S406, and the terminal Set the forward status (working status of the teleworker) to "present". That is, it is determined that the teleworker himself is present (S406).

  If it is determined in S405 that the user of the face detected from the image in S402 is a third party (other) other than the user (the teleworker himself) authenticated in S303 in the telework program 701, The process shifts to step S407 to set the terminal forward state (working state of the teleworker) to "spoofing". That is, it is determined that a third person (other) who is not the teleworker himself is present as the impersonator (S407).

  FIG. 8 is a view showing an example of a camera image captured by the camera 113 of the teleworker PC 111 determined as “spoofing” in S407.

  FIG. 9 is a view showing an example of a camera image photographed by the camera 113 of the teleworker PC 111 determined as “peeping” in S415.

  As shown in FIG. 9, not only the face of the teleworker but the face of the third person who is watching is detected, so it is determined in S 415 as “viewing”.

  Further, as shown in FIG. 8, since the face of the third party who is not the face of the teleworker himself is clearly detected, it is determined as "spoofing" in S407.

  After the process of S407 is performed, the process proceeds to step S408.

  Also, when the processes of S406, S415, and S416 are executed, the process proceeds to step S409.

  The telework program 701 performs processing to shift the operation mode to the agent continuation processing mode in S408 (S408). In the agent continuous processing mode, an instruction to end processing (process) of an agent processing that is a telework program 701 is received from the user, and even if processing (process) of the agent ends, processing of an agent processing that is a new telework program 701 ( Process) is a processing mode that starts up and does not terminate agent processing (process).

  When the teleworking program 701 shifts the operation mode to the agent continuation processing mode in S408, it shifts the processing to S411.

  The control means indicates that the determination result acquired by the determination result acquisition means of S405 and S407 is the impersonation of the user, and the process by the image acquisition means of S401 and / or of S413 by the determination means of S607. When it is determined that the process for executing the process by the transmitting means is ended by the user operation, the process determined to be ended is activated (S609), and the process by the image acquiring means in S401 (ie, the acquiring means Control processing) and the processing by the transmission unit of step S413.

  The telework program 701 determines in S409 whether the current operation mode is the agent continuation processing mode (S409), and if it is determined that the current operation mode is the agent continuation processing mode (S409) S409: YES), cancel the agent continuation processing mode, and shift to the operation mode before shifting to the agent continuation processing mode (S410). On the other hand, if it is determined that the current operation mode is not the agent continuation processing mode (S409: NO), the process proceeds to S411.

  In S411, the telework program 701 determines whether or not the terminal front state (the working state of the teleworker) currently set most recently is "peeping" or "spoofing" (S411).

  Then, when it is determined that the terminal front state (the working state of the teleworker) set most recently is “peeping” or “spoofing” (S411: YES), the telework program 701 is currently the teleworker. The screen shot of the screen displayed on the display unit (display or the like) of the PC 111 is acquired as a screen screen (S412). The screen shots acquired here include screen captures and screen captures.

  Also, in the telework program 701, at S411, the terminal front state currently set most recently (working state of the teleworker) is not "peeping" or "spoofing" but "present" or "away" If it is determined that (S411: NO), the process proceeds to step S413.

  In S413, the telework program 701 transmits, as trail information, to the management server 101, the terminal forward state (the working state of the teleworker) most recently set, the date and time, the camera image acquired in S401, and the screen image acquired in S412. (S413). Here, when the telework program 701 does not acquire the screen image in S412, in S413, the terminal front state (the teleworker's working status) set most recently, the date and time, and the camera image acquired in S401. And transmit to the management server 101 as trail information.

  S413 is an application example of the transmission unit of the present invention, and the administrator terminal (the administrator's PC 121) includes trail data including an image (image (captured data) acquired by the acquisition unit) captured by the image acquisition unit of S401. To the management server 101 for browsing in

  That is, the transmission unit of S413 displays the image captured by the image acquisition unit of S401 (image (captured data) acquired by the acquisition unit) and the screen image acquired in S412 (displayed on the display unit of the information processing apparatus) Data (trailing data) including the displayed image) is sent to the administrator for viewing.

  Then, when the telework program 701 executes the process of S413, the process returns to S401, and repeatedly executes the process of FIG. Since this repeated process is repeated in units of several milliseconds, currently the user in front of the teleworker PC 111 is the teleworker himself, a third party other than the teleworker himself, or a peek The management server 101 can manage whether or not the teleworker himself is away.

  In addition, when the user who is in front of the teleworker PC 111 is watching a third party other than the teleworker himself or a third party, the telework program 701 acquires the camera image acquired in S401 in S413, Since the screen image is transmitted to the management server 101 as trail information in step S412 and S412, what kind of information the user has viewed on the display unit of the teleworker PC 111, and how the user's face is The administrator can confirm whether the face is a good face.

  If it is determined in S407 that the third person (other) who is not the teleworker himself is spoofingly present in the telework program 701, the operation mode is switched to the agent continuation processing mode in S408. In order to perform the process, the user in front of the teleworker PC 111 receives an instruction to end the process (process) of the agent that is the telework program 701 from a third party who is impersonating the person who is the teleworker, and the agent process Even if the (process) ends, the process (process) of the agent that is the new telework program 701 starts up, and the camera image acquired in S401 and the screen image in S412 without terminating the process (process) of the agent Management server 101 and trail information And the third party (user) is displayed on the display unit of the teleworker PC 111, even if the third party issues an instruction to end the process of the agent (process). The administrator can confirm and monitor whether such information has been browsed and what the face of the user is.

  Next, detailed processing of the telework monitoring / management processing of S304 will be described using FIG.

  FIG. 5 is a view showing an example of a flowchart of detailed processing of telework monitoring / management processing of S304.

  The processing shown in each step shown in FIG. 5 is realized by the CPU 201 of the teleworker PC 111 loading a telework program 701 (also referred to simply as an agent) stored in storage means such as the external memory 213 into the RAM 203 and executing it. Be done.

  FIG. 5 shows a modification of the telework monitoring / management process described with reference to FIG. 4. The same processes as those described with reference to FIG. 4 are denoted by the same reference numerals. Therefore, the description of the processes with the same reference numerals is omitted here.

  Specifically, in FIG. 4, the operation mode is shifted to the agent continuation processing mode only when it is determined in S407 that the terminal forward state (working state of the teleworker) is spoofing (S408). Then, in S407, if it is determined that the terminal forward state (working state of the teleworker) is spoofing, or if it is determined in S415 that it is a peep, the operation mode is shifted to the agent continuous processing mode. It is different.

  Therefore, in FIG. 4, when it is determined that the terminal front state (working state of the teleworker) is any of presence, peeping, and leaving, it is determined that the agent continuous processing mode is currently present (S409) : The agent continuation processing mode has been canceled (S410), but in FIG. 5, it is determined that the terminal front state (working state of the teleworker) is either presence or absence (S501: NO) ), When it is determined that the agent continuation processing mode is currently in progress (S 503: YES), the agent continuation processing mode is canceled (S 504).

  As shown in FIG. 5, when the telework program 701 executes the processes of S407, S406, S415, and S416, the process proceeds to S501.

  In S501, the telework program 701 determines whether or not the terminal front state currently set most recently (working state of the teleworker) is "peeping" or "spoofing". Then, the determination result is acquired (S501).

  S403, S405, and S501 are application examples of the determination result acquisition unit of the present invention, and it is determined whether the image acquired by the image acquisition unit of S401 includes the face of a third party other than the user. Get the result.

  The determination process of S403 may be performed by, for example, the management server 101, and the teleworker PC 111 may obtain the determination result from the management server 101 in S403. In that case, the teleworker PC 111 transmits the image acquired by the image acquiring unit in S401 to the management server 101, and the management server 101 detects a face from the image, and the number of detected faces is one. If it is determined that the number is 2 or more, it is determined that the image includes the face of a third party other than the user. Do. When it is determined that the number of faces detected is one, the management server 101 detects the face image of one face detected from the image and the teleworker himself registered in advance in the management server 101. The image acquired by the image acquiring unit of S401 is calculated by calculating the degree of similarity with the face image of the person, and determining whether the degree of similarity satisfies a predetermined threshold value. It is determined whether a face is included.

  In this manner, the management server 101 determines whether the image acquired by the image acquisition unit in S401 includes the face of a third party other than the user, and the result of the determination is used for the teleworker. The teleworker PC 111 transmits the determination result to the PC 111. Then, in the teleworker PC 111, in S501, as a result of the determination, the image acquired by the image acquiring unit in S401 includes the face of the third party other than the user himself (that is, “peeping”, Or, if it indicates that it is "spoofing" (S501: YES), processing to shift the operation mode to the agent continuation processing mode is performed (S502).

  If it is determined in S501 that the terminal front state currently set most recently (working state of the teleworker) is "peep" or "spoofing" in S501 (S501: YES), A process of shifting the operation mode to the agent continuation processing mode is performed (S502). On the other hand, in the telework program 701, if it is determined in S501 that the terminal front state currently set most recently (working state of the teleworker) is "present" or "away" (S501: (NO), it is determined whether the current operation mode is the agent continuation processing mode (S503), and if it is determined that the current operation mode is the agent continuation processing mode (S503: YES), The agent continuation processing mode is canceled, and the operation mode before the transition to the agent continuation processing mode is performed (S504). If it is determined in S503 that the current operation mode is not the agent continuation processing mode (S503: NO), the telework program 701 shifts the processing to S413.

  After executing the processing of S504, the telework program 701 shifts the processing to S413.

  After executing the processing of S502, the telework program 701 shifts the processing to S412 and acquires a screen shot of the screen currently displayed on the display unit (display or the like) of the teleworker PC 111 as a screen (S412). . The screen shots acquired here include screen captures and screen captures.

  Then, the telework program 701 sends trail information to the management server 101 of the terminal front state (the working status of the teleworker) most recently set, the date and time, the camera image acquired in S401, and the screen image acquired in S412 in S413. As (S413). Here, when the telework program 701 does not acquire the screen image in S412, in S413, the terminal front state (the teleworker's working status) set most recently, the date and time, and the camera image acquired in S401. And transmit to the management server 101 as trail information.

  As described above, when it is determined in S407 that the terminal front state (teleworking worker working state) is spoofing or when it is determined in S415 that it is peeping (S501: YES), the operation mode is switched to the agent continuation processing mode The terminal forward state (the working state of the teleworker) set most recently, the date and time, the camera image acquired in S401, and the screen image acquired in S412 are transmitted as trail information to the management server 101. Therefore, even if the user in front of the teleworker PC 111 receives an instruction to end the process (process) of the agent that is the telework program 701 from a third party other than the teleworker himself, and the process (process) of the agent is ended. Agent process (process) that is a new telework program 701 is started, and the camera image acquired in S401 and the screen image in S412 are transmitted as trail information to the management server 101 without ending the agent process (process). Even if a third party issues an instruction to end the agent process (process), the third party (user) views what information is displayed on the display unit of the teleworker PC 111. Also, what is the face of the user? Such of whether the administrator is possible to check and monitor.

  Next, detailed processing of the monitoring processing of the monitoring program 703 in S305 will be described using FIG.

  FIG. 6 is a diagram showing an example of a flowchart of detailed processing of monitoring processing of the monitoring program 703 in S305.

  The processing shown in S601 to S605 shown in FIG. 6 is performed by the CPU 201 of the teleworker PC 111 loading a telework program 701 (also referred to simply as an agent) stored in storage means such as the external memory 213 into the RAM 203 and executing it. To be realized.

  Further, the processing shown in S606 to S609 shown in FIG. 6 is realized by the CPU 201 of the teleworker PC 111 loading a monitoring program 703 stored in storage means such as the external memory 213 into the RAM 203 and executing it.

  First, the processing of the telework program 701 will be described.

  The telework program 701 determines whether the current operation mode is the agent continuation processing mode (S601).

  Then, if it is determined that the current operation mode is the agent continuation processing mode (S601: YES), the telework program 701 determines whether the monitoring program 703 is currently activated, and If it is determined that the monitoring program 703 has not been activated, the monitoring program 703 is activated (S602). Here, when it is determined that the monitoring program 703 is currently activated, the monitoring program 703 is not newly activated.

  Next, the monitoring program 702 included in the telework program 701 monitors whether the process (process) of the monitoring program 703 is currently being executed (S603).

  The monitoring program 703 also monitors whether the process (process) of the telework program 701 is being executed in S606. As described above, the monitoring program 702 included in the telework program 701 and the monitoring program 703 monitor whether or not the process (process) is mutually executed.

  Next, the telework program 701 determines whether the process (process) of the monitoring program 703 is being executed or the process (process) of the monitoring program 703 has ended as a result of the monitoring in S603 (S604).

  Then, when it is determined that the process (process) of the monitoring program 703 is ended (finished) (S604: YES), the telework program 701 starts the monitoring program 703 and processes the monitoring program 703. The (process) is executed (S605).

  That is, the monitoring control means (S605) starts the process when the monitoring program 702 (second monitoring means) detects that the process for executing the process of the monitoring program 703 has ended (S604: YES). To control.

  Then, the telework program 701 returns the process to S601.

  Also, if it is determined that the process (process) of the monitoring program 703 is being executed as a result of the monitoring in S603, the telework program 701 returns the process to S603, and the monitoring program 702 is currently the monitoring program. It is monitored whether the process (process) 703 is being executed.

  If it is determined in S601 that the current operation mode is not the agent continuation processing mode (S601: NO), the telework program 701 returns the process to S601 again, and the current operation mode is It is determined whether it is in the agent continuation processing mode.

  The telework program 701 ends the process (process) of the telework program 701 whenever an instruction to end the process (process) of the telework program 701 is received from the user, for example, by a kill command or the like.

  FIG. 7C shows that the monitoring program 702 of the telework program 701 starts processing of the monitoring program 703B (703) triggered by detecting that the processing of the monitoring program 703A (703) is completed. FIG.

  As shown in FIG. 7C, in the agent continuation processing mode, the monitoring program 702 included in the telework program 701 monitors whether or not the processing (process) of the monitoring program 703A is currently executed (S603) If it is determined that the process (process) of the monitoring program 703A is completed (S604: YES), the monitoring program 703B is activated to execute the process (process) of the process (process) of the monitoring program 703B (S605) .

  Next, the processing of the monitoring program 703 will be described.

  The monitoring program 703 monitors whether the process (process) of the telework program 701 is currently executed (S606).

  Then, the monitoring program 703 (first monitoring means) determines whether the process (process) of the telework program 701 is currently executed or the process (process) of the telework program 701 has ended as a result of the monitoring in S606. Is determined (S607).

  S607 is an application example of the determination means of the present invention, and it is determined whether the process (process of the telework program 701) for executing the process by the image acquisition means of S401 and / or the process by the transmission means of S413 has ended. Do.

  If it is determined that the processing (process) of the telework program 701 has ended (is ended) (S607: YES), the monitoring program 703 shifts the processing to S608, while the telework program 701 is currently being processed. If it is determined that the process (process) is being executed (S 607: NO), the process returns to S 606 to monitor whether the process (process) of the telework program 701 is currently being executed.

  If the monitoring program 703 determines that the processing (process) of the telework program 701 has ended (it has ended) (S 607: YES), whether the current operation mode is the agent continuation processing mode or not Is determined (S608).

  Then, if it is determined that the current operation mode is the agent continuation processing mode (S608: YES), the monitoring program 703 shifts the processing to S609, while the current operation mode is the agent continuation processing. If it is determined that the mode is not set (S608: NO), the processing of the monitoring program 703 is ended.

  In S609, the monitoring program 703 activates the telework program 701 as the agent continuation processing mode, and executes the processing (process) of the telework program 701 in the agent continuation processing mode.

As described above, when the monitoring program 703 (first monitoring means) detects that the process for executing the process of the telework program 701 has ended (S607: YES), the control means starts the process. It controls (S609).
In addition, when the monitoring program 703 activates the telework program 701 as an agent continuation processing mode, the monitoring program 703 acquires the authentication information set and registered in S303 from the predetermined storage destination, and the activated telework program 701 is selected. The authentication information is transmitted to the management server 101 (a user authentication request is made) (S609). Alternatively, when the monitoring program 703 activates the telework program 701 as the agent continuation processing mode (S609), the activated telework program 701 acquires the authentication information set and registered in S303 from the predetermined storage destination, The authentication information is sent to the management server 101 to request authentication of the user. As described above, when the process of the telework program 701 determined to be ended is started by the control unit of S609, the authentication request unit of the started telework program 701 is newly operated by the user in the reception unit of S303. Without accepting the input of the authentication information, the reception unit of S303 transmits the authentication information input last time to the management server to request authentication of the user (authentication request unit).

  Then, upon receiving the authentication request, the management server 101 determines whether the authentication information (user ID and password) transmitted from the telework program 701 matches the authentication information registered in advance in the management server 101. The user authentication process is executed by determining the. Then, in the authentication process of the user, it is determined whether communication with the management server 101 and the use of a service described later are permitted.

  Then, in response to the authentication request by the authentication request means, the management server 101 transmits the user authentication result to the teleworker PC 111 as a result of performing the user authentication process by the authentication means, and the teleworker PC 111 The authentication result is received (acquired) from 101 (authentication result acquiring means).

  The management server 101 is determined that the authentication information matches, and it is determined that the user authentication is successful (authenticated) (determination is made that communication with the management server 101 and use of a service described later are permitted. If it is determined that the user has been authenticated, the telework program 701 is notified that the user has been authenticated.

  Then, when receiving the notification that the user has been authenticated from the management server 101, the telework program 701 determines that the user has been authenticated, and executes the processing of S304 and S305.

Therefore, the determination result acquisition unit of the telework program 701 has a face of a third party other than the user himself indicating that the authentication result acquired by the authentication result acquisition unit has been authenticated in the image acquired by the image acquisition unit of S401. The judgment result as to whether or not contained is acquired (S405, S501)
After executing the process of S609, the monitoring program 703 returns the process to S606, and monitors whether the process (process) of the started telework program 701 is executed (S606).

  The monitoring program 703 ends the process (process) of the monitoring program 703 whenever an instruction to end the process (process) of the monitoring program 703 is received from the user at any time by, for example, a kill command or the like.

  FIG. 7B is triggered by the monitoring program 703 detecting that the processing of the telework program 701A (701) including the monitoring program 702A (702) is a trigger, the telework program 701B including the monitoring program 702B (702). It is a figure showing starting processing of (701).

  As shown in FIG. 7B, the monitoring program 703 monitors whether the process (process) of the telework program 701A is currently executed (S606), and the process (process) of the telework program 701A ends. If it is determined that the current operation mode is the agent continuation processing mode (S608: YES), the monitoring program 703 selects the monitoring program 702B (702) (702). ) Is activated (S609).

  As described above, the user in front of the teleworker PC 111 receives an instruction to end the process (process) of the telework program 701 or the monitoring program 703 from a third party other than the teleworker himself, and the telework program 701 or the monitoring program 703 Even if the process (process) of the process ends, a process (process) of a new telework program 701 or monitoring program 703 is started, and the camera image acquired in step S401 and the process of step S412 do not end the process (process) of the agent. Since the screen image can be transmitted to the management server 101 as trail information, even if the third party instructs the end of the process (process) of the telework program 701 or the monitoring program 703, the third party (user ) , What was viewed by any information that is displayed on the display unit of teleworkers for the PC111, also, that the user's face what face thing is, the administrator is possible to check and monitor.

  S609 is an application example of the control means of the present invention, and the determination result acquired by the determination result acquisition means of S405 and S501 is the face of a third party other than the user himself in the image acquired by the image acquisition means of S401. When it is determined that the process of executing the process by the image acquisition unit and / or the process by the transmission unit is ended by the user operation. Control (S607: YES, S608: YES) to activate the process (telework program 701) determined to have ended, and to execute the process of the image acquisition unit of S401 and the process of the transmission unit of S413. Do.

  Specifically, S609 is an application example of the control means of the present invention, and the determination result acquired by the determination result acquisition means of S405 and S501 is an image acquired by the image acquisition means of S401, which is other than the user. It indicates that it is determined that the third party's face is included, and after the determination result is acquired by the determination result acquiring unit in S405 and S501, it is acquired next by the image acquiring unit in S401. Before the determination result acquisition unit in S405 and S501 acquires the determination result indicating that it is determined that the image does not include the face of a third party other than the user, the image acquisition unit in S607 When it is determined that the process of executing the process by the process and / or the process by the transmission unit is ended by the user's operation (S607: YES, S608: YES) Start the determined process (teleworking program 701) that, processing by the image acquisition means S401, and performs control to execute the processing by the transmitting means S413.

  Next, detailed processing of the telework monitoring / management processing of S304 will be described using FIG.

  FIG. 5 is a view showing an example of a flowchart of detailed processing of telework monitoring / management processing of S304.

  The processing shown in each step shown in FIG. 5 is realized by the CPU 201 of the teleworker PC 111 loading a telework program 701 (also referred to simply as an agent) stored in storage means such as the external memory 213 into the RAM 203 and executing it. Be done.

  FIG. 5 shows a modification of the telework monitoring / management process described with reference to FIG. 4. The same processes as those described with reference to FIG. 4 are denoted by the same reference numerals. Therefore, the description of the processes with the same reference numerals is omitted here.

  Specifically, in FIG. 4, the operation mode is shifted to the agent continuation processing mode only when it is determined in S407 that the terminal forward state (working state of the teleworker) is spoofing (S408). Then, in S407, if it is determined that the terminal forward state (working state of the teleworker) is spoofing, or if it is determined in S415 that it is a peep, the operation mode is shifted to the agent continuous processing mode. It is different.

  Therefore, in FIG. 4, when it is determined that the terminal front state (working state of the teleworker) is any of presence, peeping, and leaving, it is determined that the agent continuous processing mode is currently present (S409) : The agent continuation processing mode has been canceled (S410), but in FIG. 5, it is determined that the terminal front state (working state of the teleworker) is either presence or absence (S501: NO) ), When it is determined that the agent continuation processing mode is currently in progress (S 503: YES), the agent continuation processing mode is canceled (S 504).

  As shown in FIG. 5, when the telework program 701 executes the processes of S407, S406, S415, and S416, the process proceeds to S501.

  In S501, the telework program 701 determines whether or not the terminal front state currently set most recently (working state of the teleworker) is "peeping" or "spoofing". Then, the determination result is acquired (S501).

  S403, S405, and S501 are application examples of the determination result acquisition unit of the present invention, and it is determined whether the image acquired by the image acquisition unit of S401 includes the face of a third party other than the user. Get the result.

  The determination process of S403 may be performed by, for example, the management server 101, and the teleworker PC 111 may obtain the determination result from the management server 101 in S403. In that case, the teleworker PC 111 transmits the image acquired by the image acquiring unit in S401 to the management server 101, and the management server 101 detects a face from the image, and the number of detected faces is one. If it is determined that the number is 2 or more, it is determined that the image includes the face of a third party other than the user. Do. When it is determined that the number of faces detected is one, the management server 101 detects the face image of one face detected from the image and the teleworker himself registered in advance in the management server 101. The image acquired by the image acquiring unit of S401 is calculated by calculating the degree of similarity with the face image of the person, and determining whether the degree of similarity satisfies a predetermined threshold value. It is determined whether a face is included.

  In this manner, the management server 101 determines whether the image acquired by the image acquisition unit in S401 includes the face of a third party other than the user, and the result of the determination is used for the teleworker. The teleworker PC 111 transmits the determination result to the PC 111. Then, in the teleworker PC 111, in S501, as a result of the determination, the image acquired by the image acquiring unit in S401 includes the face of the third party other than the user himself (that is, “peeping”, Or, if it indicates that it is "spoofing" (S501: YES), processing to shift the operation mode to the agent continuation processing mode is performed (S502).

  If it is determined in S501 that the terminal front state currently set most recently (working state of the teleworker) is "peep" or "spoofing" in S501 (S501: YES), A process of shifting the operation mode to the agent continuation processing mode is performed (S502). On the other hand, in the telework program 701, if it is determined in S501 that the terminal front state currently set most recently (working state of the teleworker) is "present" or "away" (S501: (NO), it is determined whether the current operation mode is the agent continuation processing mode (S503), and if it is determined that the current operation mode is the agent continuation processing mode (S503: YES), The agent continuation processing mode is canceled, and the operation mode before the transition to the agent continuation processing mode is performed (S504). If it is determined in S503 that the current operation mode is not the agent continuation processing mode (S503: NO), the telework program 701 shifts the processing to S413.

  After executing the processing of S504, the telework program 701 shifts the processing to S413.

  After executing the processing of S502, the telework program 701 shifts the processing to S412 and acquires a screen shot of the screen currently displayed on the display unit (display or the like) of the teleworker PC 111 as a screen (S412). . The screen shots acquired here include screen captures and screen captures.

  Then, the telework program 701 sends trail information to the management server 101 of the terminal front state (the working status of the teleworker) most recently set, the date and time, the camera image acquired in S401, and the screen image acquired in S412 in S413. As (S413). Here, when the telework program 701 does not acquire the screen image in S412, in S413, the terminal front state (the teleworker's working status) set most recently, the date and time, and the camera image acquired in S401. And transmit to the management server 101 as trail information.

  As described above, when it is determined in S407 that the terminal front state (teleworking worker working state) is spoofing or when it is determined in S415 that it is peeping (S501: YES), the operation mode is switched to the agent continuation processing mode The terminal forward state (the working state of the teleworker) set most recently, the date and time, the camera image acquired in S401, and the screen image acquired in S412 are transmitted as trail information to the management server 101. Therefore, even if the user in front of the teleworker PC 111 receives an instruction to end the process (process) of the agent that is the telework program 701 from a third party other than the teleworker himself, and the process (process) of the agent is ended. Agent process (process) that is a new telework program 701 is started, and the camera image acquired in S401 and the screen image in S412 are transmitted as trail information to the management server 101 without ending the agent process (process). Even if a third party issues an instruction to end the agent process (process), the third party (user) views what information is displayed on the display unit of the teleworker PC 111. Also, what is the face of the user? Such of whether the administrator is possible to check and monitor.

  Next, detailed processing of the telework monitoring / management processing of S304 will be described using FIG.

  FIG. 10 is a diagram showing an example of a flowchart of detailed processing of telework monitoring / management processing of S304.

  The processing shown in each step shown in FIG. 10 is realized by the CPU 201 of the teleworker PC 111 loading a telework program 701 (also referred to simply as an agent) stored in storage means such as the external memory 213 into the RAM 203 and executing it. Be done.

  FIG. 10 shows a modification of the telework monitoring and management process described with reference to FIGS. 4 and 5. The same processes as those described with reference to FIGS. 4 and 5 are denoted by the same reference numerals. Therefore, the description of the processes with the same reference numerals is omitted here.

  Specifically, in FIG. 5, when it is determined in S407 that the terminal front state (teleworking worker's working state) is spoofing, or when it is determined in S415 that it is peeping (S501: YES), the agent continuous processing mode If it is determined that the seat is present at S406, or if it is determined that the seat is not present at S416 (S501: NO), if it is currently operating in the agent continuation processing mode. (S503: YES), the agent continued processing mode has been canceled (S504), in FIG. 10, when it is determined in S407 that the terminal front state (teleworking worker's working state) is spoofing, or in S415 with peeping If it is determined, or if it is determined in S416 that the user is not in the seat (if it is determined that the user is not present) (S1001: YES), the agent The operation mode is shifted to the job continuance processing mode, and it is determined that the user is present at S406 (S1001: NO), and the agent is currently operating in the agent continuance processing mode (S503: YES). The difference is that the continuous processing mode is released.

  As shown in FIG. 10, when the telework program 701 executes the processes of S407, S406, S415, and S416, the process proceeds to S1001.

  In the telework program 701, at S1001, the terminal front state (the working state of the teleworker) currently set most recently is the person "not present" ("away", "peep", or "spoofing") To determine if Then, the determination result is acquired (S1001).

  S403, S405, and S1001 are application examples of the determination result acquisition means of the present invention, and it is determined whether the image acquired by the image acquisition means of S401 includes the face of a third party other than the correct user. The determination result as to whether or not any face is included is acquired.

  The determination process of S403 may be performed by, for example, the management server 101, and the teleworker PC 111 may obtain the determination result from the management server 101 in S403. In that case, the teleworker PC 111 transmits the image acquired by the image acquiring unit in S401 to the management server 101, and the management server 101 detects a face from the image, and the number of detected faces is one. It is determined whether the image is an image, 2 or more, or 0 (no one's face is included). It is determined that the face of the third party is included. When it is determined that the number of faces detected is one, the management server 101 detects the face image of one face detected from the image and the teleworker himself registered in advance in the management server 101. The image acquired by the image acquiring unit of S401 is calculated by calculating the degree of similarity with the face image of the person, and determining whether the degree of similarity satisfies a predetermined threshold value. It is determined whether a face is included.

  In this way, the management server 101 determines whether the image acquired by the image acquisition unit in step S401 includes the face of a third party other than the user itself, and does not include the face of anyone. The determination result is transmitted to the teleworker PC 111, and the teleworker PC 111 obtains the determination result. Then, in the teleworker PC 111, the result of the determination in S1001 includes the face of a third party other than the user itself in the image acquired by the image acquiring unit in S401 (that is, “peeping”, Or, if it indicates that it is "spoofing" or if it indicates that no one's face is included ("away") (S1001: YES), the operation mode is set to the agent continuation processing mode. A process to migrate is performed (S502).

  In the telework program 701, the terminal front state (the working state of the teleworker) currently set most recently at S1001 is not "present" ("away", "peep", or "spoofing") If it is determined (S1001: YES), processing to shift the operation mode to the agent continued processing mode is performed (S502). On the other hand, when it is determined that the terminal front state (the teleworker's working status) currently set most recently is "present" in S1001 (S1001: NO), the telework program 701 is currently operating. It is determined whether the mode is the agent continuation processing mode (S 503), and when it is determined that the current operation mode is the agent continuation processing mode (S 503: YES), the agent continuation processing mode is canceled. To shift to the operation mode before shifting to the agent continuation processing mode (S504). If it is determined in S503 that the current operation mode is not the agent continuation processing mode (S503: NO), the telework program 701 shifts the processing to S413.

  After executing the processing of S504, the telework program 701 shifts the processing to S413.

  After executing the processing of S502, the telework program 701 shifts the processing to S412 and acquires a screen shot of the screen currently displayed on the display unit (display or the like) of the teleworker PC 111 as a screen (S412). . The screen shots acquired here include screen captures and screen captures.

  Then, the telework program 701 sends trail information to the management server 101 of the terminal front state (the working status of the teleworker) most recently set, the date and time, the camera image acquired in S401, and the screen image acquired in S412 in S413. As (S413). Here, when the telework program 701 does not acquire the screen image in S412, in S413, the terminal front state (the teleworker's working status) set most recently, the date and time, and the camera image acquired in S401. And transmit to the management server 101 as trail information.

  Thus, if it is determined in S407 that the terminal front state (teleworking worker's working status) is spoofing, or if it is determined in S415 that it is a peeping view, or if it is determined in S416 that it is out of seat (only the person itself If it is determined that the user is not "present" (S1001: YES), the operation mode is switched to the agent continuation processing mode, and the terminal forward state set most recently (teleworking worker working state), the date and time, S401 The acquired camera image and the screen image acquired in S412 are transmitted as trail information to the management server 101.

  Therefore, the user who is in front of the teleworker PC 111 receives an instruction to terminate the process (process) of the agent (the telework program 701) from a third party other than the teleworker himself while only the teleworker himself is not photographed. Even if the process (process) of the process ends, the process (process) of the agent that is the new telework program 701 starts up, and the camera image acquired in S401 and the screen in S412 do not end the process (process) of the agent. Since the image can be transmitted as trail information to the management server 101, for example, a third party other than the authorized teleworker himself gave an instruction to end the processing (process) of the agent in an attitude that does not appear on the camera. Even if, soon, aeger Preparative process (process) rises, the administrator will be able to verify the terminal and the forward state, the screen image is not normal. Also, even if a third party who is not the legitimate teleworker himself gives an instruction to end the process of the agent, what kind of the third party (user) is displayed on the display unit of the teleworker PC 111 The administrator can confirm and monitor whether the information has been browsed and the face of the user.

As described above, the control unit of the teleworker PC 111 acquires the authentication result indicating that the authentication is successful by the authentication result acquisition unit, and then the face of the user (the user who successfully authenticates) who can be authenticated by the face authentication unit (No state where the face of the user authenticated by the authentication means for authenticating the user is not photographed by the imaging means) (state of S407, S415, S416), or a face that is not the user is the When the process for executing the acquisition process by the acquisition means (the process for executing the transmission process by the transmission means) (the process of 701) is ended by the operation of the user in the state photographed by the imaging means (states of S407 and S415) (S607: YES), without accepting the user's operation (by the accepting means, the user enters the authentication information Without accepting again) to start the process, obtaining process by the acquiring means, and performs control to execute the transmission processing by the transmission means (S609).

  As described above, according to the present invention, even if a third party who is not a legitimate user terminates the process of acquiring or transmitting an image taken in front of the information processing apparatus, the image taken in front of the information processing apparatus It becomes possible to make it possible to perform acquisition or transmission of

  Further, according to the present invention, even if a third party other than the teleworker himself / herself instructs the end of the program for acquiring trail data, the trail data of the third party can be acquired.

  In the present embodiment, the process of each step shown in the flowcharts shown in the drawings is described as being executed by the teleworker PC 111, but one of the processes (a part of the process) is executed by the management server 101. It may be configured. In this case, for example, the photographed image is transmitted from the teleworker PC 111 to the management server, and the management server executes the processing of S402 to S407, S415, S416, etc. instead of the teleworker PC 111.

  The present invention can be embodied as, for example, a system, an apparatus, a method, a program, or a recording medium. Specifically, the present invention may be applied to a system constituted by a plurality of devices, or may be applied to an apparatus comprising a single device.

  Further, the program in the present invention is a program capable of executing the processing method of the flowcharts shown in FIGS. 3 to 6 and FIG. 10, and the storage medium of the present invention is a computer having the processing method shown in FIGS. Executable programs are stored. The program in the present invention may be a program for each processing method of each device in FIGS.

  As described above, the recording medium recording the program for realizing the functions of the above-described embodiments is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing.

  In this case, the program itself read out from the recording medium realizes the novel function of the present invention, and the recording medium recording the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, non-volatile memory card, ROM, EEPROM, silicon A disk etc. can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiment are realized, but also an operating system (OS) or the like running on the computer is actually executed based on the instructions of the program. It goes without saying that the processing is partially or entirely performed, and the processing realizes the functions of the above-described embodiments.

  Furthermore, after the program read from the recording medium is written to the memory provided to the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is read based on the instruction of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiment are realized by the processing.

  Further, the present invention may be applied to a system constituted by a plurality of devices or to an apparatus comprising a single device. It goes without saying that the present invention can also be applied to the case where it is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can receive the effects of the present invention.

  Further, by downloading and reading out a program for achieving the present invention from a server on a network, a database or the like by a communication program, the system or apparatus can receive the effects of the present invention. In addition, the structure which combined each embodiment mentioned above and its modification is also contained in this invention altogether.

101 Management Server 111 Teleworker PC
121 Administrator's PC

Claims (13)

An information processing apparatus comprising an imaging means, wherein
Acquisition and transmission means for acquiring and transmitting an image obtained by the imaging means photographing the front of the information processing apparatus;
The state in which the face of possible authentication user by the imaging means is not taken, or in a state where the face is not in the user is photographed, when the process of executing the acquisition and transmission process by the acquisition and transmission unit has been completed, the A process is activated to control acquisition and transmission processing by the acquisition and transmission means, while acquisition and transmission processing by the acquisition and transmission means while the face of the user who can be authenticated is captured by the imaging means Control means for controlling the process so as not to start the process when executing the process is terminated ;
An information processing apparatus comprising: Includes a face authentication means for performing face authentication using the image acquired by the pre-Symbol acquisition and transmission unit,
The control unit is acquired by the acquisition and transmission unit in a state in which the face of the user who can be authenticated by the face authentication unit is not photographed by the imaging unit, or in a state in which a face other than the user is photographed by the imaging unit. when the process of executing a transmission process has been completed, start the process, and controls so as to perform the acquisition and transmission processing by said acquisition and transmission means, whereas, the face of possible authentication user by the face authentication unit while being photographed by the imaging unit, when the process of executing the acquisition and transmission processing by said acquisition and transmission means is completed, according to claim 1, wherein the controller controls so as not to start the process Information processing device. The system further comprises first monitoring means for monitoring a process for executing acquisition and transmission processing by the acquisition and transmission means;
Wherein, the state in which the face authentication can be user by the image pickup means is not captured, or in a state in which the non-user face is photographed by the imaging means, said first monitoring means, the process is terminated when it is detected that the an information processing apparatus according to claim 1 or 2, characterized in that for controlling to start the process. Second monitoring means for monitoring the monitoring process by the first monitoring means,
Monitoring control means for controlling to start the monitoring process by the first monitoring means when it is detected by the second monitoring means that the monitoring process by the first monitoring means has ended;
The information processing apparatus according to claim 3 , further comprising: The information processing apparatus according to claim 4 , wherein the acquisition unit includes the second monitoring unit. Wherein, the state in which the face of possible authentication user by the imaging means is not taken, or in a state where the face is not in the user is captured, the process of executing the acquisition and transmission processing by said acquisition and transmission means of the user If ended by the operation, start the process without accepting the user's operation, any one of claims 1 to 5, wherein the controller controls to perform the acquisition and transmission process by the acquisition and transmission unit 1 The information processing apparatus according to any one of the above. The apparatus further comprises a receiving unit for receiving an input of authentication information by a user operation,
The control means is in a state where the face of the user authenticated by the authentication information authentication means for authenticating the user according to the authentication information received by the reception means is not photographed by the imaging means, or a face which is not the user is the in a state of being captured by the imaging unit, when the process of executing the acquisition and transmission process by the acquisition and transmission unit has been completed, start the process, and controls so as to perform the acquisition and transmission process by the acquisition and transmission unit, On the other hand, when the process for executing the acquisition and transmission process by the acquisition and transmission means ends while the face of the user authenticated by the authentication information authentication means is photographed by the imaging means, the process is not activated. The information processing apparatus according to any one of claims 1 to 6 , wherein the control is performed as follows. The control means is configured such that the face of the user authenticated by the authentication information authentication means for authenticating the user according to the authentication information received by the reception means is not photographed by the imaging means, or the face is not the user When the process for executing the acquisition and transmission process by the acquisition and transmission means ends in a state of being photographed by the imaging means, the process is activated and the reception means accepts the user's input of authentication information again. no information processing apparatus according to claim 7, wherein the controller controls to perform the acquisition and transmission process by the acquisition and transmission unit. Authentication request means for requesting an authentication of the user by transmitting the authentication information received by the reception means to the server including the authentication information authentication means;
Authentication result acquisition means for acquiring an authentication result by the authentication information authentication means from the server in response to the authentication request by the authentication request means;
And further
After the control means acquires an authentication result indicating success in authentication by the authentication result acquisition means, a state in which the face of the user who has succeeded in authentication is not photographed by the imaging means, or a face that is not the user When the process for executing the acquisition and transmission process by the acquisition and transmission means ends in the state of being photographed by the imaging means, the process is activated and the reception means does not receive the user's input of the authentication information again. and wherein the authentication request unit performs an authentication request of the user authentication information entered last by said receiving means and transmitted to the server, performs control to execute the acquisition and transmission process by the acquisition and transmission unit The information processing apparatus according to claim 8 . The acquisition and transmission unit, wherein, wherein the image captured by the imaging means, the data and a display image displayed on the display unit of the information processing apparatus, that you send in order to browse the administrator 10. An information processing apparatus according to any one of items 1 to 9 . Said imaging means, information according to any one of claims 1 to 1 0, characterized in that to shoot in front of the information processing apparatus to capture a user who performs teleworking using the information processing apparatus Processing unit. A control method in an information processing apparatus provided with an imaging unit, the control method comprising:
An acquisition and transmission step of acquiring and transmitting an image obtained by imaging the front of the information processing apparatus by the imaging unit;
The state in which the face of possible authentication user by the imaging means is not taken, or in a state in which the non-user face is photographed, when the process of executing the acquisition and transmission processing by said acquisition and transmission process is completed, the A process is activated to control acquisition and transmission processing by the acquisition and transmission step, while acquiring and transmitting processing by the acquisition and transmission step while the face of the user who can be authenticated is captured by the imaging unit. And a control step of controlling not to start the process when the process to execute
A control method comprising: A program for causing a computer to function as the information processing apparatus according to any one of claims 1 to 11 .

Images