JP2017062757A - Controller system, and support device thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a controller system and a support device thereof capable of identifying when, from which and by whom the controller program has been updated.SOLUTION: When a support device 20 which includes a camera, a support software 21 and an AR application 22 executes a download onto any PLC 10, the AR application 22 recognizes an AR marker disposed at the position and an AR marker carried by a worker in an image picked up by the camera and creates an extended virtual image in which a piece of predetermined information corresponding to the respect recognized AR markers are combined with the pick-up images. The support software 21 also downloads the extended virtual image and stores together therewith.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a system for updating a controller program from a support device that allows a user to edit the controller program.

  When downloading a program to the controller, the collation function is used to check whether the project in the support device corresponds to the connection destination controller, and the program is downloaded.

  As a method, it is determined whether the project in the support device matches the connected controller based on the system configuration definition including not only the target controller model but also peripheral modules. In online update, as proposed in Patent Document 1, the continuity of the update program is guaranteed by an identifier.

  With such a mechanism, the program is downloaded to the connected controller from the project in the support device that matches the controller.

JP 2013-168031 A

  In the conventional technique, a program is downloaded to a connection destination controller from a project in a support device that matches the controller, and the mechanism is as described above.

  However, as shown in FIG. 12, the controller (PLC 100; hereinafter referred to as the controller 100) accepts a program from the project as long as the validity of the project in the connected support device 110 is guaranteed. As long as there is a project corresponding to the controller 100, the program of the controller 100 can be replaced at any time.

  Moreover, neither the project in the support apparatus 110 nor the controller 100 has a record regarding the program download operation, and these are separately managed by operations by the user. In such a conventional technique, when a program update is performed at a timing different from the original operation due to a human error or the like, a program different from the program managed by the user is downloaded to the controller 100. Become.

  In such a situation, when a problem is found in the program of the controller 100, there is no information regarding the program update in the controller 100, so that it is possible to identify the cause of when and by whom the program was updated. Since it is not easy, there is a problem that it is difficult to take measures such as preventing recurrence.

  Therefore, there is a demand for a mechanism that can identify when, from where, and by whom a program downloaded to the controller 100 is executed by an unspecified place or person.

  An object of the present invention is to save an update evidence image generated using an AR marker when a program is downloaded from an arbitrary support device to an arbitrary controller. It is to provide a controller system or the like that makes it possible to identify from where and where a program update has been executed.

  The controller system of the present invention is a controller system in which one or more controllers are installed, and a program is downloaded from the support device to the controller when updating the program of any controller, and the first is installed in an arbitrary place. AR markers and a second AR marker to be carried by the operator are provided.

The support apparatus includes the following units.
・ Photographing means;
-Support means for activating AR means when downloading the program;
-The AR means.

  Then, when both the first AR marker and the second AR marker are detected in the image captured by the imaging unit, the AR unit detects the detected first AR marker and second AR marker. A composite image formed by combining predetermined information corresponding to each of the captured images is generated.

  The support means does not download the program when the composite image is not generated, and when the composite image is generated or when the composite image is generated and a predetermined condition is satisfied, The program is downloaded and the composite image is downloaded together.

  According to the controller system or the like of the present invention, when a program is downloaded from an arbitrary support device to an arbitrary controller, the updated evidence image generated using the AR marker is saved, so that the updated evidence image can be referred to later. For example, it is possible to specify when, from where, and by whom the program update was executed.

It is a block diagram of the controller system of the 1st Example of this example. It is a process flowchart figure of the support software of a 1st Example. It is a process flowchart figure of AR application. It is a functional block diagram of the controller system of a 1st Example. It is a figure for demonstrating the subject of a 2nd Example. It is a block diagram of the controller system of a 2nd Example. It is a process flowchart figure of the support software of a 2nd Example. It is a processing flowchart figure of a face authentication application. It is a detailed flowchart figure of the process of step S66 of FIG. It is a figure which shows a modification. It is a functional block diagram of the controller system of a 2nd Example. It is a figure for demonstrating the conventional controller system.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a configuration diagram of a controller system according to a first embodiment of the present example.
First, this method uses an existing AR marker and an AR application mechanism (AR technology). These are existing technologies, and will not be described in detail, but will be briefly described below.

  The AR marker is an image of a predetermined pattern that serves as a mark for designating a position for displaying additional information in an image recognition type AR (Augmented Reality) system. What pattern is used as the AR marker varies depending on the type of the system, but simple and clear black and white figures and QR codes are often used. In a specific example of this description, simple figures such as a circle (◯), a triangle (Δ), a square (□), and a star (☆) are used as the AR marker.

  When the AR marker is installed in the real world by printing or the like, the AR system displays the specified information on the portion where the image is captured. An application program that realizes such an AR system process is the AR application.

  When the AR application is mounted on an information processing terminal equipped with a camera or the like, and the AR application includes an AR marker in an image captured by the camera or the like, predetermined information corresponding to the AR marker is displayed on the image. Overlay (composite) and display. Of course, for this purpose, an image of each AR marker, predetermined information corresponding thereto, and the like are stored in advance in the information processing terminal.

  Then, the captured image (referred to as an augmented reality image) synthesized with the predetermined information is stored and stored. However, the AR application of this example does not permit the storage / storage of the augmented reality image unless a predetermined condition is satisfied. Alternatively, the generation of the augmented reality image itself may not be permitted unless a predetermined condition is satisfied. The predetermined condition will be described later. The AR application 22 of this example may be regarded as a function of an existing general AR application plus such a function related to predetermined conditions and permission.

The functions of the existing general AR marker and AR application are briefly described above, and the AR application 22 of this example is also described briefly.
Hereinafter, the system configuration of FIG. 1 will be described.

  In the controller system of this example, there may be a plurality of support devices 20 and a plurality of controllers (PLC (programmable controller) 10 in this example). It is up to each user to decide which PLC 10 is to be updated using which support device 20 at what time. For this reason, as described above, in the past, when any trouble occurred in the operation of an arbitrary controller, it was not possible to specify who was the trouble of the updated program and when. This method can solve this problem.

  The controller system of this example is not limited to the example of the programmable controller (PLC) system, and may be a DCS (distributed control system), for example.

  The support device 20 can be realized by a general-purpose general computer device such as a personal computer or a server device. Therefore, although not particularly illustrated, the support device 20 includes, for example, a not-illustrated CPU, a storage device such as a hard disk and a memory, a communication function unit, a display unit such as a liquid crystal display, and an operation unit such as a keyboard and a mouse.

  A predetermined application program is stored in advance in the storage device (not shown), and when the CPU executes the application program, various processing functions of the support device 20 (the processing shown in FIGS. Various processing function units shown in FIG. 4 are realized. An example of the application program is an AR application 22 and support software (support software) 21 described later, but is not limited to these examples.

  The controller (PLC (programmable controller) 10) also includes an arithmetic processor such as a CPU / MPU (not shown), a memory, and the like, and a predetermined application program is stored in the memory in advance. When the arithmetic processor executes this application program, predetermined processing (control processing or the like) of the PLC 10 is executed. This is not particularly described because it is a well-known existing technology.

  First, AR markers having different figures are installed at locations where the controllers (PLCs 10) are installed. In other words, a plurality of AR markers having the same graphic are not present. In the present example, a print of the simple graphic is set as an AR marker. In the figure, each controller (PLC 10) is a PLC 10a shown. PLC 10b or the like.

  The AR marker is not limited to the place where each controller is installed, but is installed at a specific location (security room or the like) on the network that permits connection of the support apparatus 20 to the controller. It may be a thing.

  In addition, an AR marker as a worker ID is distributed in advance to each user (a worker who updates the program). Of course, this also prevents a plurality of AR markers having the same figure from being present.

  The support device 20 is loaded with software (support software 21) that provides a function for supporting a user to create a controller program and an AR application 22 corresponding to the AR marker.

  The support software 21 basically has the functions of conventional support software, but also has the functions described below. The functions of the conventional support software include a function for assisting the user in creating the controller program, a function for compiling the created program, and downloading the program to the controller.

  In addition to the above-described conventional function, the support software 21 further has a function of starting the AR application 22 before executing the download when a PLC program download is instructed, and an update described later. It has a function of checking the existence of a certification file and not permitting download if there is no update certification file. Needless to say, the download destination is an arbitrary controller (PLC 10).

  Further, the support device 20 of this example corresponds to the “information processing terminal including a camera”. Thus, when the AR application 22 is activated by the support software 21, first, the camera is operated to acquire a captured image and recognize an AR marker on the video. If there is no AR marker on the video, nothing is done. As a result, there is no update certification file as described above, so the support software 21 cannot download the program.

  If an AR marker is displayed on the video, the AR application 22 recognizes the AR marker by using the existing function, acquires information corresponding to the AR marker (attached information), and superimposes the attached information on the video. (Composite) and display (generate and display augmented reality image).

  Here, each AR marker (its figure) is stored in the support device 20 in advance. As an example, this is classified and stored into two types of equipment and workers, for example. For example, all AR markers (the figure) relating to the equipment are stored in the equipment folder. Similarly, all the AR markers (the figure) relating to the worker are stored in the worker folder. Then, the AR application 22 determines in which of the two folders the same AR marker (graphic) as the AR marker (graphic) recognized by the existing function is stored. For example, when it is stored in the equipment folder, it is determined that the AR marker related to the equipment has been detected.

  The AR application 22 basically generates an update certification file when two AR markers are shown on the video. As an example, for example, when two AR markers are shown on the image, and one of them is an AR marker related to equipment, and the other is an AR marker related to a worker, the update certification file is To be generated.

  Therefore, as an example, when the AR markers of both the facility and the worker are recognized as described above, the imaging function is enabled. Of course, until then, since the shooting function is disabled, even if the augmented reality image is displayed on the liquid crystal display as described above, the augmented reality image is not saved, and even if the user presses the shutter. Nothing happens when you operate it.

Note that when the shooting function is enabled as described above, the user may be notified by voice or display.
When the user operates the shutter while the shooting function is valid, shooting data (augmented reality image) obtained by synthesizing the extended information and the actual video by the shooting operation is stored in a specific storage area. Accordingly, the support software 21 takes in the augmented reality image as an update certification file into a project (a predetermined folder or the like) of the support software 21, for example. For example, when the above photographing operation is performed, an augmented reality image is generated (that is, no augmented reality image has been generated so far) and is stored in a specific storage area. You may do it.

  After the AR application 22 is activated, the support software 21 checks the specific storage area at any time to check for the presence of the augmented reality image (update certification file). If an augmented reality image exists, it is saved as an update certification file as described above, and the download of the program is executed assuming that the download of the program is permitted. At that time, the augmented reality image (update certification file) is also downloaded.

FIG. 1 also shows how an augmented reality image is generated.
In the illustrated example, as an AR marker corresponding to the PLC 10a, an AR marker of a circular figure (◯) is installed in the vicinity of the PLC 10a as illustrated. Similarly, an AR marker having a square figure (□) is provided in the vicinity of the PLC 10b as shown in the figure as an AR marker corresponding to the PLC 10b. Alternatively, an AR marker having a triangular figure (Δ) shown in the figure is installed at the specific location (security room or the like) described above.

  Further, here, the AR marker of the worker's identification of a certain worker is a rectangular figure shown in the figure. FIG. 1 shows how an augmented reality image is generated when this worker performs a program update operation of the PLC 10a using an arbitrary support device 20c.

  The worker takes the support apparatus 20c to the installation location of the PLC 10a, connects the support apparatus 20c to the PLC 10a through a communication line, and then issues a program download instruction.

In response to this instruction, the support software 21 of the support device 20c activates the AR application 22 and enters a state of waiting for augmented reality image generation.
In the AR application 22, first, an imaging function is activated, and thereby, a captured image (image through the camera) is displayed on the display of the support device 20c. When a user operates a displayed shooting button (not shown), a composite image (augmented reality image) based on this image is generated and stored in a file. However, the shooting button is disabled in the initial state.

  The worker changes the direction of the camera of the support apparatus 20c while watching the display of the captured image so that the AR marker “circular figure (◯)” corresponding to the PLC 10a appears. Thus, the AR application 22 recognizes this marker, acquires information corresponding to the recognized marker, and displays the information superimposed on the marker position of the captured image. In this example, the information (equipment information) corresponding to the marker related to the equipment is, for example, the equipment name, the location, etc. The information corresponding to the AR marker “circle (○)” is the equipment name “PLC1” and the place “building” “A, first room”, and these are displayed so as to overlap the display position of the “round figure (◯)” as shown. Furthermore, in this example, the current date and time is acquired from the clock function, and this is also displayed so as to overlap the display position of the “round figure (◯)”.

  The worker further brings his / her worker ID within the photographing range of the camera so that the AR marker “rectangle” of the worker ID is also reflected. Thus, the AR application 22 also recognizes this marker “rectangle”, acquires information corresponding to the recognized marker, and displays the information superimposed on the marker position of the captured image. In this example, the information (worker information) corresponding to the marker related to the worker is, for example, affiliation, name, contact information, etc. These pieces of information corresponding to “rectangle” are displayed as “rectangle” as shown in the figure. It is displayed so as to overlap.

The extended information such as the facility information and the worker information can also be displayed on the AR application screen.
In this state, the AR application 22 recognizes both of the above-described two types of AR markers, and thus enables the shooting function (shooting button). Thus, when the operator operates the shooting button, a photograph is created by combining the actual image in the shooting range of the camera and the extended information corresponding to each AR marker displayed on the AR application screen. That is, the augmented reality image is generated. Then, the generated augmented reality image is stored in a specific place (storage area) arbitrarily determined in advance.

Above, the process of AR application 22 is complete | finished.
When the support software 21 recognizes that there is an augmented reality image in the specific storage area, the support software 21 determines that the download is permitted and downloads the program to the PLC 10a. Further, the augmented reality image is taken into the project as an update certification file, and the update certification file is also downloaded to the PLC 10a.

  The PLC 10a stores and stores the downloaded program and the update certificate file. The PLC 10a executes this program and performs some control. Later, if there is any problem with this program, refer to the update certificate file to find out when and who updated this program.

FIG. 2 is a process flowchart of the support software 21.
FIG. 3 is a processing flowchart of the AR application 22.
As described above, the support software 21 has an existing function for supporting a programmer or the like to create an arbitrary PLC 10 program (version-up version or the like). Then, when a programmer or the like instructs to download the created program, the processing of FIG. 2 is executed. That is, FIG. 2 is a processing flow related to the download processing by the support software 21.

  The support software 21 first activates the AR application 22 (step S11), and then waits until the AR application 22 ends (step S12). When the AR application 22 is finished (step S12, YES), the processes after step S13 are executed.

  When activated, the AR application 22 executes the process of FIG. Although the process of FIG. 3 will be described later, as a result of this process, an augmented reality image may be stored in the specific storage area.

  As a result, when the AR application 22 ends (YES in step S12), the support software 21 checks the presence or absence of an augmented reality image with reference to the specific storage area (step S13), and if there is no augmented reality image. (Step S13, NO), it is determined that the download is not permitted, and the download is not executed and the process ends abnormally. Even if a person who does not have a valid worker ID tries to download the program, step S13 is NO, and the download is not permitted. As a result, for example, it is possible to prevent a malicious program from being downloaded.

  On the other hand, if there is an augmented reality image in the specific storage area (step S13, YES), it is assumed that the download is permitted, and the augmented reality image is imported as an update certification file into the project ( Step S14), program download to the controller (PLC10) is started. In this example, the update certificate file is downloaded together with the controller program (steps S15 and S16).

Hereinafter, the process of FIG. 3 will be described.
When activated in step S11, the AR application 22 first activates the camera and displays the captured image on the screen of the AR application (step S21). The AR application screen is a screen generated by the AR application 22, but it may be considered that a captured image is simply displayed on the display of the support device 20. A shooting button (not shown) is also displayed on the screen generated by the AR application 22, and the AR application 22 can recognize whether or not the shooting button has been operated.

  Thereafter, if the shooting button is pressed at any time (step S22, YES), the processes of steps S31 and S32 are executed, and the process of the AR application 22 is terminated. However, even if the operator depresses the shooting button while the shooting function is disabled, the determination in step S22 is not YES. Only when the shooting button is pressed in a state where the shooting function is valid, step S22 becomes YES and the processing of steps S31 and S32 is executed.

  The AR application 22 always executes a verification process for checking whether or not an AR marker registered in advance exists in the video within the shooting range of the camera. As described above, these are classified and registered into two types of equipment folders and worker folders. However, this is an example, and the present invention is not limited to this example.

Basically, a plurality of AR markers (referred to as registered AR markers) are stored in each folder.
When the AR application 22 detects an arbitrary AR marker (figure) as a result of analyzing the video captured by the camera, the AR application 22 compares the AR marker (figure) with each registered AR marker in the equipment folder, and matches. Find what to do (step S23). If there is no match (step S24, NO), the imaging function is disabled (step S28), and the process returns to step S23. The shooting function is disabled in the initial state.

  If the detected AR marker matches any registered AR marker in the equipment folder (step S24, YES), the equipment information (equipment name, location, etc. in this example) corresponding to this AR marker is acquired. Further, the current date and time is acquired from the clock function, and the acquired information is displayed on the screen of the AR application (step S25). This is displayed, for example, at the detection position of the AR marker.

  In addition, information corresponding to each AR marker is registered in advance. For each registered AR marker in the equipment folder, the corresponding equipment information is registered. Similarly, the corresponding worker information is registered for each registered AR marker in the worker folder.

  Here, in the case of the work procedure described with reference to FIG. 1, if the camera is in a normal state, the AR marker related to the equipment is first displayed in the image within the shooting range of the camera, and then the worker ID is further displayed. The AR marker will be displayed. As a result, when the AR application 22 analyzes the video captured by the camera, the AR marker related to the facility is first detected, and then the AR marker of the worker ID is further detected. The processing example of FIG. 3 is processing according to such a work procedure, and is not limited to this example.

  In the case of the processing example of FIG. 3, the AR application 22 performs the process of step S23 and the like for the AR marker detected first, and executes the process of step S26 and the like for the AR marker detected later.

  That is, the AR marker (graphic) detected later is compared with each registered AR marker in the worker folder to find a matching one (step S26). If there is no match (step S27, NO), the imaging function is disabled (step S28), and the process returns to step S23.

  When the detected AR marker matches any registered AR marker in the worker folder (step S27, YES), the worker information corresponding to this AR marker (in this example, affiliation, name, contact information, etc.) ) And this acquired information is displayed on the screen of the AR application (step S29). Then, the photographing function is enabled (step S30), and the process returns to step S22. In the process of step S30, the operator may be notified by sound or display that the photographing function has been enabled.

  Thus, when the worker operates the shooting button, the shooting function is now enabled, so the determination in step S22 is YES, and the processing in steps S31 and S32 is executed.

  That is, the augmented reality image formed by synthesizing the actual photographing data within the photographing range of the camera and the augmented information (equipment information, worker information) corresponding to each detected AR marker is generated (step S31), this is saved in a specific storage area (step S32), and this process is terminated. In this case, the determination in step S13 is YES.

  Although not particularly illustrated, if the determination in step S22 does not become YES even after a predetermined time has elapsed from the time of activation, the present process is terminated without generating an augmented reality image. In this case, the determination in step S13 is NO.

  It should be noted that the present invention is not limited to the above-described example. For example, by incorporating a GPS function in the support device 20, when the AR marker is recognized in the AR application, collation is performed together with the GPS information, so that the AR marker can be installed more reliably. Can ensure operation on site.

  As described above, the present technique relates to a system for updating a controller program by connecting a support device for creating a controller program to the controller. The method of connecting the support device to the controller is not limited to the method described with reference to FIG. 1, and may be a method of connecting from a security room or the like via a network such as a LAN. As described above, the place where the support device is connected to the controller is not limited to the place where the controller is installed, and may be a security room or the like.

  In the system, first, a specific AR marker corresponding to each “location where the support device is connected to the controller” is installed. For example, AR markers having different figures are installed at the installation locations of the controllers (in the vicinity of the controllers, etc.). The AR marker may be installed not only in this example but also in a specific location (security room or the like) on the network that permits connection of the support device to the controller, for example. The “location where the support device is connected to the controller” can also be said to be “a regular connection location to the controller”.

  In this method, by performing processing using the AR system, even if an attempt is made to download a program to the controller from a place other than the “regular connection place to the controller”, the download is not permitted. Therefore, according to this method, it is possible to obtain an effect that it is guaranteed that the program stored and executed in the controller is downloaded from the “regular connection place to the controller”.

  Furthermore, a specific AR marker corresponding to each person in charge (worker) is distributed and possessed. Again, the graphic of each AR marker is unique (different from each other).

Furthermore, an AR application corresponding to the AR marker is previously installed in the support device. Further, the graphic image of each AR marker installed above is stored in advance in the support device.
In addition, the AR marker installed in each of the above-mentioned places and the AR marker possessed by the person in charge are those obtained by printing the above figures (in the real world).

  Then, when updating the program of an arbitrary controller, support software that provides existing functions such as support for creation, compilation, and download of a controller program in the support device further activates the AR application, thereby augmenting the reality image A function is provided so that downloading is not executed unless is generated.

  The AR application recognizes the AR marker through the video of the camera built in the support device, thereby creating data (augmented reality image) in which the corresponding extended information is synthesized with the actual video, and this is used as an update evidence image ( Update certificate file).

  In the support device, an AR application corresponding to the AR marker is activated when a program is downloaded by software (support software) that provides a program creation support function or the like of the controller. The “AR application corresponding to the AR marker” is, for example, an AR application corresponding to an AR marker having a simple figure such as the above-mentioned ○, Δ, □, but is not limited to this example.

  When the worker points the camera of the support device toward the AR marker, the AR application recognizes the AR marker, obtains extended information corresponding to the AR marker, and generates a composite image obtained by combining the extended information and the actual video. . If a composite image is not generated, program download to the controller is not permitted. When the composite image is generated, the support software downloads the program to the controller and also downloads the composite image (update certification file). The composite image is stored in a project in the support apparatus.

  The extended information included in the composite image includes information related to the worker who performed the download operation, information indicating the download execution date and time, the download target equipment (controller), the download execution location, and the like. When a problem occurs later, by referring to this composite image, it is possible to know who, when and where the download was performed. Furthermore, by referring to the actual video included in the synthesized image, the location where the download operation was performed can be confirmed with the actual video.

FIG. 4 is a functional configuration diagram of the controller system of the first embodiment.
The controller system 30 of this example is a controller system in which a plurality of controllers 31 are installed, and a program is downloaded from an arbitrary support device 32 to the controller 31 when the program of the arbitrary controller 31 is updated.

In addition, a plurality of first AR markers 33 installed at each arbitrary location and a plurality of second AR markers 34 to be carried by each worker are provided.
The support device 32 includes the following processing function units. The support device 20 is an example of the support device 32, and the PLC 10 is an example of the controller 31.

The support device 32 includes a photographing unit 41, a support unit 42, an AR unit 43, and the like.
The imaging unit 41 is a camera function of the support device 20, for example.
For example, the support unit 42 is the support software 21 described above, and activates the AR unit 43 when a program is downloaded to an arbitrary controller 31.

An example of the AR unit 43 is the AR application 22 described above.
The AR unit 43 analyzes the image captured by the image capturing unit 41, and when both the first AR marker 33 and the second AR marker 34 are detected in the captured image, the detected first A composite image is generated by combining predetermined information corresponding to each of the AR marker 33 and the second AR marker 34 with the captured image. An example of the composite image is the augmented reality image.

  The support unit 42 does not download the program when the composite image is not generated. When the composite image is generated, the program is downloaded and the composite image is downloaded together.

The AR unit 43 may further acquire the current date and time from a clock function or the like, and include the current date and time information in the predetermined information and synthesize it with the captured image.
In addition, the support device 32 stores in advance each facility information storage unit 44 that stores each facility information corresponding to each first AR marker in advance, and each worker information corresponding to each second AR marker in advance. A worker information storage unit 45 may be further provided.

  In this case, the AR unit 43 acquires the facility information corresponding to the detected first AR marker from the facility information storage unit 44, and the worker information corresponding to the detected second AR marker. , Acquired from the worker information storage unit 45. Then, the acquired information is combined with the captured image as the predetermined information to generate the combined image.

  The upper equipment information is, for example, information indicating the installation location of the detected first AR marker or the controller installed at the installation location. The worker information is information indicating a worker who possesses the detected second AR marker, for example.

  The AR unit 43 determines whether or not the first AR marker 33 and the second AR marker 34 are present in the captured image by collating with images of the respective AR markers (graphics) stored in advance.

For example, each said 1st AR marker is each provided in the installation place of each arbitrary controller.
According to the present invention, at the time of downloading a controller program, the AR marker can recognize the place, facility (controller), and person in charge for executing the program download, and the person in charge who has recognized the controller in the support device. And information about the equipment (and the download execution date, etc.) are saved as an update certificate file, so that the program download is not executed from an unspecified place or person, and the cause when a problem is found in the program is tracked. It has the effect of becoming easier.

  In addition, the update certificate file can contain not only the extended information corresponding to the AR marker but also the actual program download location as a photo, so that other staff members can edit the project at a later date. When executing the program download, it is possible to expect an effect that it is easy to specify the location where the corresponding controller is installed.

The first embodiment of the present invention has been described above.
The second embodiment of the present invention will be described below.
According to the system of the first embodiment described above, not only the program is downloaded from the project in the support device 20 that matches the controller to the connected controller (PLC 10), but also the AR marker. The recognition can prevent the download from being executed by an unspecified location / person, and the information specifying the download location and the worker is saved as an update evidence image. Yes, the mechanism is as described above.

  However, the first embodiment described above is a mechanism in which additional information (location of download execution, worker, etc.) corresponding to the AR marker is stored in the update evidence image by recognition of the AR marker. It does not represent the actual location or worker that was recognized. The updated evidence image may include a photographed image, but it does not always reflect the operator's face, and it is possible to avoid the face being reflected. Therefore, if it can be recognized as an AR marker (even if it is not an original AR marker), the download can be executed. In this case, the download execution location and operator, and the additional information stored in the update evidence image However, there may be different cases.

  As a countermeasure to such a problem, the above-mentioned “AR marker related to equipment” for specifying the download execution location is combined with the positional information by GPS, for example, so that the recognized AR marker exists at the correct position. It can be judged whether it is a thing. For example, as shown in FIG. 5, this can be realized by installing a GPS function in the support device 20 and a program for making the above determination, and this also applies to the support device 50 shown in FIG. 5.

  However, with regard to the above “AR marker for workers” (AR marker of worker ID), it is possible to be executed by a person who is not the principal of the worker ID by lending, or due to loss or forgery of AR marker, There is a possibility of being downloaded from unspecified people.

  That is, for example, as shown in FIG. 5, an AR marker (an AR marker of the worker ID; here, a rectangular figure) related to an arbitrary worker is the worker who is the rightful owner of the worker ID. Of course, download permission is granted. However, even if this worker lends this "rectangular AR marker" to another worker and another worker performs the work, the download is permitted. Furthermore, the augmented reality image is created using the affiliation and name of the operator.

Although not shown in FIG. 1, also in the first embodiment, the support device 20 may have a GPS function as shown in FIG.
Similarly, even if a third party forges an AR marker or acquires a lost AR marker, there is a possibility that the download is permitted, and the augmented reality image is the affiliation and name of the worker. May be created using.

  In such a situation, when the updated evidence image (augmented reality image) stored in the controller is referred to later, the worker information in the updated evidence image is not actually updated by the worker. It is the person's data. Furthermore, there is a possibility that the program is updated in a situation that the worker himself does not know, and there is a problem that it does not make sense as evidence data.

  As described above, the first embodiment shows whether the program downloaded to the controller is executed by an unspecified location / person, when, from where, by whom (basically Provides a mechanism that can be specified). In addition to this, the second embodiment also provides a mechanism for preventing unauthorized use of the AR marker on the worker ID.

  In the second embodiment, as information corresponding to the AR marker of the worker ID, an image (photo data) of the owner ID of the worker ID is held in the support device separately from the additional information for the AR application. deep. In the support device, after the AR marker is collated by the AR application at the time of program download execution, the photo data corresponding to the collated “AR marker of the worker ID” is obtained, and the above-mentioned acquisition is performed in the video by the camera in the support device. By performing a process for determining whether or not a person's face in the photograph data can be recognized (authentication by the face authentication application), unauthorized use of the AR marker on the worker ID is prevented. Further, after collating the AR marker, during the authentication by the face authentication application, when the video in the camera in the support device is recorded and the authentication fails (or cancels), the recorded data is used as unauthorized access data, and the support device Save to the project and download to the controller.

Hereinafter, the second embodiment will be described in detail.
FIG. 6 is a configuration diagram of the controller system of the second embodiment.
6 is the same as FIG. 1 in that AR markers having different figures (AR markers related to equipment) are installed at locations where each controller (PLC 10) is installed. As in the first embodiment, the “AR marker related to equipment” may be installed in a security room or the like.

  Also in the second embodiment, as in the first embodiment, each user (worker who performs program update, etc.) is given an “AR marker as a worker ID” (AR marker related to the worker). Distribute in advance. Of course, this also prevents a plurality of AR markers having the same figure from being present.

  The support device 50 according to the second embodiment shown in FIG. 6 includes software (support software 51) that provides a function for supporting a user to create a controller program, and an AR application corresponding to the AR marker. 22 is mounted. The AR application 22 itself may be the same as that of the first embodiment, and therefore the same reference numerals are given, and the description thereof is simplified. The support software 51 has substantially the same function as the support software 21 of the first embodiment, but also has different functions, which will be described in detail later.

  The support device 50 can also be realized by a general-purpose general computer device such as a personal computer or a server device. Therefore, although not particularly illustrated, the support device 50 includes, for example, a not-shown storage device such as a CPU, a hard disk, and a memory, a communication function unit, a display unit such as a liquid crystal display, and an operation unit such as a keyboard and a mouse.

  A predetermined application program is stored in advance in the storage device (not shown), and when the CPU executes the application program, various processing functions of the support device 50 (FIGS. 7, 8, and 9 described later). And the above-described processing of FIG. 3 and various processing function units shown in FIG. An example of the application program is the AR application 22, the face authentication application 52 described later, support software (support software) 51, and the like, but is not limited to these examples.

The support device 50 further includes a face authentication application 52 and a worker verification DB (database) 53.
The face authentication application 52 is activated by the support software 51 after the processing of the AR application 22 (similar to the first embodiment) is executed, and the processing result of the AR application 22 and the operator verification DB (database) 53 In general, for example, the following processing is executed.

  That is, first, the face authentication application 52 searches the worker verification DB 53 for face photo data corresponding to the “AR marker on worker ID” recognized by the AR app 22 (“corresponding face photo” Data ”). Here, face photograph data of the owner (the worker himself / herself) is registered in advance in the worker verification DB 53 in association with each “AR marker of the worker card”. Note that the face photo data only needs to include a face image. Therefore, the face photo data is not limited to the face, and may include, for example, the entire body. Further, the face photo data may be simply referred to as photo data or the like.

  Subsequently, the face authentication application 52 acquires a captured image taken by the camera of the support device 50, extracts a person's face on the video, and extracts it from the “corresponding face photo data”. The face is checked to see if it matches (face recognition is performed). If they match, the verification is successful. The video of the camera is recorded until the collation is completed, and when the collation fails (or is canceled), the recorded data is stored in a specific location. The face recognition itself may be performed using an existing technology (existing face recognition system or the like), and is not particularly described here. The “extracting“ face ”” may be, for example, an extraction of some “feature” used in the existing technology. As is well known, such “features” include, for example, the relative position and size of the facial parts, the shape of the eyes, nose, cheekbones, and jaws, but of course not limited to this example. . In addition, the “face” (feature) previously extracted from the face photograph data may be registered in the operator verification DB 53 instead of the face photograph data.

  As described above, the support software 51 activates the face authentication application 52 after the AR marker is recognized by the AR application 22 at the time of program download execution, and when the verification by the face authentication application 52 is successful, the first implementation is performed. Similar to the example, the update certificate file is downloaded to the controller (PLC 10) together with the program.

  On the other hand, if the verification fails (or is canceled), downloading of the program is not permitted, and the recorded data stored in the specific location is taken into the project of the support software 51 as unauthorized access data, This unauthorized access data is downloaded to the controller.

The processing function of the support device 50 will be described in more detail below.
In the support device 50, when the program is downloaded, the support software 51 activates the AR application 22, and the AR application 22 executes, for example, the processing of FIG. 3 described above, thereby various information corresponding to the recognized AR marker. (Equipment information or worker information to be downloaded) is identified and acquired. In this example, for “AR marker on worker ID”, for example, worker information corresponding to the AR marker “rectangle” shown in the figure is acquired, and for “AR marker related to equipment”, for example, AR marker “○” is supported. Equipment information (for example, equipment name “PLC1”, location “building A, first room”, etc.) is acquired. Then, the augmented reality image is generated using the acquired information.

  When the process of the AR application 22 is normally completed (when an augmented reality image is generated), the support software 51 activates the face authentication application 52 this time. The face authentication application 52 acquires the type of “AR marker on worker ID” recognized by the AR application 22. This is because a number corresponding to the AR marker type is determined in advance (for example, number “2” = type “rectangular” or the like), and this number is exchanged with the AR application 22 via a file. It can be acquired. In this example, for example, the AR application 22 also performs processing for storing the number corresponding to the recognized type of “AR marker of worker ID” in a predetermined file or the like. Although processing for acquiring a file is performed, the present invention is not limited to this example.

The face authentication application 52 acquires photo data corresponding to the acquired type from the worker verification DB 53.
This photograph data is the face photograph data of the worker himself / herself corresponding to the “AR marker on worker ID” recognized by the AR application 22, and is set in advance. In FIG. 6, it is assumed that the illustrated smile mark represents the face photograph data of the owner of the “rectangular” worker ID. The face photo data may be anything as long as it includes a face image, and is not limited to data of only the face, and may be, for example, an image of the upper body.

  Subsequently, the face authentication application 52 activates another camera included in the support device 50 (or switches the camera, etc.) so that the operator enters the shooting range of the camera, and until collation is completed, Record video from the camera's shooting range.

  Thereafter, it is determined whether or not the face of the person in the acquired photograph data can be recognized from the video in the shooting range of the camera by the operation of the collation button by the user. If it is determined that the worker is the person corresponding to the marker, the process ends normally (successful authentication). If the recognition fails, the recorded data is saved in a specific storage area and the process ends abnormally (authentication failure). ).

  When the processing of the face recognition application 52 ends, the support software 51, if the face authentication application 52 has succeeded in authentication, performs an update certificate file (augmented reality image) together with the program in the same manner as the first support software 21. ) To the controller.

  However, if the authentication has failed, the recorded data (stored in the specific storage area) created by the face authentication application 52 is taken into the project as unauthorized access data, and then this unauthorized access data only. Is downloaded to the controller. Of course, in this case, downloading the program to the controller is not permitted.

  In consideration of the fact that the recorded data is not saved in the case of a cancel operation, it is desirable to mount the recorded data so that it starts when the app starts and stops after collation. In some cases, it is possible to take an image of the worker at the time of collation and substitute the imaged data.

  The face determination process in the face authentication application 52 can be implemented by using a face recognition library or commercially available software, and the determination algorithm is not within the scope of the present invention.

FIG. 7 is a process flowchart of the support software 51.
This shows the processing at the time of download, as in FIG.
7 may be the same as the processes in steps S11, S12, S13, and S14 in FIG. 2, and will not be particularly described here. However, if they are described briefly, the processes in steps S41, S42, S43, and S44 in FIG. When the program download is executed, the support software 51 starts the AR application 22 (step S41) and waits until the program ends before downloading the program to the controller (step S42).

  When the AR application 22 ends (YES in step S42), the AR application 22 confirms whether shooting data (extended reality image) including extended information corresponding to the AR marker is stored in a specific location. (Step S43) If not saved (Step S43, NO), it is regarded as canceled and the program ends abnormally (program download failure), and if saved (Step S43, YES), the shooting data (the augmented reality) Image) is taken into the project as an update certification file (step S44).

In FIG. 2, the processes of steps S15 and S16 are performed following the process of step S14. However, in FIG. 7, the processes of steps S45 to S51 shown in the figure are performed following the process of step S44.
Hereinafter, the processing of steps S45 to S51 will be described.

  In the process of FIG. 7, after the process of step S44 is executed, the face authentication application 52 is subsequently activated (step S45), and the process waits until the process of the face authentication application 52 ends (step S46). The processing of the face authentication application 52 is shown in FIGS. 8 and 9 and will be described later.

  When the process of the face authentication application 52 is completed (step S46, YES), it is confirmed whether or not the authentication is successful by the face authentication application 52 (step S47). If the authentication is successful (step S47, YES), FIG. Steps S48 and S49, which are the same as steps S15 and S16, are executed. That is, the program download is started, and the update certification file is downloaded to the controller together with the controller program (steps S48 and S49).

  However, if the authentication has failed (step S47, NO), after recording data stored in a specific location is taken into the project as unauthorized access data (step S50), only this unauthorized access data is stored in the controller. Download (step S51). In this case as well, the program ends abnormally (program download failure), and naturally program download is not permitted.

The above “recorded data stored in a specific location” will be described when the processing of the face authentication application 52 in FIGS. 8 and 9 is described.
Note that the processing of the AR application 22 activated in step S41 may be the same as that of the first embodiment. For example, the processing of FIG. 3 is executed, and therefore no particular illustration or description is given here. However, this will be briefly described below.

  The AR application 22 always checks whether or not the AR marker registered in the AR application 22 is present in the video within the shooting range of the camera, and when the AR marker is recognized, information corresponding to the marker is detected. Is displayed on the screen of the AR application in accordance with the position of the marker that has been recognized. When both the AR marker related to the update location and the AR marker related to the person in charge are recognized, if the shooting function in the AR application is enabled and the shooting button is operated, the actual image in the shooting range of the camera and the AR application screen are displayed. Shooting data (augmented reality image) obtained by synthesizing the extended information corresponding to the AR marker displayed inside is created and stored in a specific location.

FIG. 8 is a processing flowchart of the face authentication application 52. FIG. 9 is a detailed flowchart of the process in step S66 of FIG.
Hereinafter, an example of processing of the face authentication application 52 will be described with reference to FIGS. 8 and 9.

  When the face authentication application 52 is activated as described above, it first activates the camera (or switches the camera or the like so that the operator enters the shooting range of the camera) and displays the screen in the application. A captured image of the camera is displayed (step S61).

  Subsequently, the AR marker type recognized by the AR application 22 is acquired (by determining a number corresponding to the AR marker type in advance and exchanging this number via a file) (step S62). Furthermore, photograph data corresponding to the type of AR marker acquired in step S62 is acquired from the operator verification DB 53 (step S63).

Then, the recording of the video in the shooting range of the camera is started (step S64).
Thereafter, when the collation button is operated by the user (step S65, YES), first, it is determined whether or not the face of the person in the acquired photo data can be recognized from the video in the shooting range of the camera (step S66). . A specific example of the process in step S66 is shown in FIG. Note that the processing of FIG. 9 (particularly face detection and face data matching processing) may be regarded as processing of an existing general face authentication application.

  In the example shown in FIG. 9, first, face detection is performed from the photograph data acquired in step S63 to extract face data (existing technique) (step S81). Subsequently, face data is extracted from the image within the shooting range of the camera to extract face data (step S82). This assumes that there may be a situation where there are a plurality of people in the field, and extracts face data of all faces in the video.

  Then, the face data extracted in step S82 is collated with the face data extracted in step S81 (step S84). If there is a match (step S85, YES), the process ends as successful face authentication. . On the other hand, if none of the face data extracted in step S82 matches the face data extracted in step S81 (step S83, YES), the process ends as face authentication failure.

  Note that the processing in FIG. 9 is a subroutine called from the processing in FIG. 8, for example, and returns a determination result (success in face authentication or face authentication failure) to the caller process (returns a response) when the process ends.

  In the process of FIG. 8, when the process of step S66 (the process of FIG. 9) is completed and the response is received, the video recording of the shooting range of the camera is stopped (step S67), and the determination result is the face. If the authentication is successful (step S68, YES), it is determined that the worker is the worker corresponding to the AR marker recognized by the worker, the recorded data is deleted (step S69), and the process ends normally. If the determination result is the face authentication failure (step S68, NO), the recorded data is stored in a specific location (step S70), and the process ends abnormally.

  If the process ends abnormally, the determination in step S47 is NO, and the processes in steps S50 and S51 are executed. As a result, for example, an image of a person who attempted to gain unauthorized access by illegally using another person's “AR marker on worker ID” is stored as evidence. Note that the present invention is not limited to this example. For example, as the processing in step S70, face detection may be performed from the recorded data, and the face data may be stored in the specific location. In the case of normal termination, the determination in step S47 is YES.

FIG. 11 is a functional configuration diagram of the controller system of the second embodiment.
11, the same reference numerals are given to the same components as those of the first embodiment shown in FIG. 4, and the description thereof is omitted or simplified.

  As in the controller system 30 shown in FIG. 4, the controller system 60 of this example is provided with a plurality of controllers 31, and a program is downloaded from an arbitrary support device 61 to the controller 31 when the program of the arbitrary controller 31 is updated. Controller system. The function of the support device 61 is slightly different from that of the support device 32 of FIG.

Similarly to FIG. 4, a plurality of first AR markers 33 installed at arbitrary locations and a plurality of second AR markers 34 to be carried by each worker are provided.
The support device 61 includes the following processing function units. The support device 50 is an example of the support device 61, and the PLC 10 is an example of the controller 31.

  The support device 61 includes a photographing unit 41, an AR unit 43, an equipment information storage unit 44, and an operator information storage unit 45 that have the same functions as the support device 32. Therefore, these are not specifically described. Further, a support unit 71 is provided instead of the support unit 42. The function of the support unit 71 is slightly different from the function of the support unit 42, and here, different points will be mainly described.

  The support device 61 further includes an operator image storage unit 72 and a face authentication unit 73. An example of the worker image storage unit 72 is the worker verification DB 53, and an example of the face authentication unit 73 is the face authentication application 52. However, the present invention is not limited to this example.

  For example, the support unit 71 is, for example, the support software 51. Like the support unit 42, the AR unit 43 is activated when the program is downloaded to an arbitrary controller 31, and the AR unit 43 generates the composite image. If not, do not download the program. On the other hand, when the composite image is generated, unlike the support unit 42, it is further determined whether or not a predetermined condition is satisfied, and if the predetermined condition is satisfied, the program is downloaded. At the same time, the composite image is downloaded together.

  The case where the predetermined condition is satisfied is, for example, that face data extracted from a new captured image for photographing an operator matches valid face data corresponding to the detected second AR marker. This is the case.

  Here, the worker image storage unit 72 stores in advance image data (a face photograph, a feature, or the like) of the worker who is the proper owner in association with each second AR marker 34. DB (database) or the like. The support unit 71 further activates the face authentication unit 73 when the composite image is generated. The activated face authentication unit 73 acquires the image data (face photo, etc.) of the worker himself corresponding to the second AR marker 34 detected by the AR unit 43 from the worker image storage unit 72, and acquires the acquired image data. Face data is extracted from the image data to obtain valid face data, and face data is extracted from the new photographed image. If the extracted face data matches the valid face data, the collation is successful.

The photographed image of the worker is a worker who is currently trying to download, and there is no guarantee that this worker is the worker himself. The reason is as described above.
When the face authentication unit 73 succeeds in collation, the support unit 71 determines that the predetermined condition is satisfied.

  When the collation fails by the face authentication unit 73, the support unit 71 records the new captured image or the face data extracted from the captured image as unauthorized access data. For example, this is transferred to and recorded in the controller 31 to be downloaded, but is not limited to this example, and may be recorded in the support device 61.

As described above, according to the second embodiment, the following effects can be obtained in addition to the effects of the first embodiment.
In other words, when the program is downloaded, the AR application and the face authentication application cooperate with each other, and the face authentication is performed by the face authentication application using the photo data corresponding to the AR marker collated by the AR application. It has the effect that it can be prevented.

  In addition, when face authentication fails (or is canceled) by the face authentication application, the recorded data at the time of authentication is saved in the controller as unauthorized access data, so if you refer to unauthorized access data later, when, from where, by whom In addition to being able to identify whether unauthorized access has been attempted, it can be expected to have the effect of suppressing unauthorized use itself.

FIG. 10 shows a modification.
For example, the worker verification DB 53 is not limited to the example stored in the support device 50 as shown in FIG. 6, and may be stored in the controller (PLC 10) as shown in FIG. 10, for example. In this example, the worker verification DB 53 is held by the management server and may be stored in each controller (PLC 10) in a form distributed in advance from the management server or the like via the network. Not exclusively. In the case of this example, since the photo data necessary for collation by the face authentication application 52 is on the controller side, the support device 50 transmits the AR marker type to the controller, and the response data is necessary for the collation. Get photo data.

  A plurality of people may be registered for one AR marker. That is, there may be a plurality of legitimate persons or owners of an arbitrary “worker ID AR marker”. The example shown in FIG. 10 shows an example in which photographic data of two people are registered for the AR marker “rectangle”. As described above, there may be a plurality of pieces of photo data corresponding to the AR marker. In this case, the face authentication application 52 only needs to succeed in the face authentication.

  The camera attached to the support device 50 is preferably a camera that can be adjusted separately, such as a rear camera for the AR application and a front camera for the face authentication application. By implementing the app as part of the AR app function, it is possible to perform smoother operations by automatically switching the target camera (or adjusting the shooting range) after recognizing the AR marker. It becomes.

10 (10a, 10b) PLC
20 (20a, 20b, 20c) Support device 21 Support software 22 AR application 30 Controller system 31 Controller 32 Support device 33 First AR marker 34 Second AR marker 41 Imaging unit 42 Support unit 43 AR unit 44 Equipment information unit 45 Worker information storage unit

Claims (14)

A controller system in which one or more controllers are installed, and a program is downloaded from the support device to the controller when the program of any controller is updated,
A first AR marker installed at an arbitrary location;
A second AR marker to be carried by the operator is provided,
The support device includes:
Photographing means;
Support means,
AR means,
The support means activates the AR means when downloading the program,
The activated AR means, when both the first AR marker and the second AR marker are detected in the photographed image by the photographing means, the detected first AR marker, the second AR marker, Generating a composite image formed by combining predetermined information corresponding to each AR marker with the captured image;
The support means does not download the program when the composite image is not generated, and when the composite image is generated or when the composite image is generated and a predetermined condition is satisfied, A controller system that downloads the program and downloads the combined image together.   When the predetermined condition is satisfied, the face data extracted from the new captured image for photographing the worker matches the legitimate face data corresponding to the detected second AR marker. The controller system according to claim 1, wherein there is a controller system. Worker image storage means in which image data of the worker who is the proper owner is stored in advance in association with each second AR marker;
Face authentication means;
Further comprising
The support means further activates the face authentication means when the composite image is generated,
The activated face authentication means acquires the operator's own image data corresponding to the second AR marker detected by the AR means from the worker image storage means, and uses the acquired image data to obtain a face The data is extracted as valid face data, and the face data is extracted from the new photographed image. When the extracted face data matches the valid face data, the verification is successful.
3. The controller system according to claim 2, wherein when the collation is successful by the face authentication unit, the support unit satisfies the predetermined condition. 4.   3. The controller according to claim 2, wherein, when the verification by the face authentication unit fails, the support unit records the new captured image or the face data extracted from the captured image as unauthorized access data. 4. system. Facility information storage means for previously storing facility information corresponding to the first AR marker;
Worker information storage means for storing worker information corresponding to the second AR marker in advance;
The AR means includes the facility information corresponding to the detected first AR marker and the worker information corresponding to the detected second AR marker in the captured image as the predetermined information. The controller system according to claim 1, wherein the controller system is synthesized.   6. The controller system according to claim 5, wherein the AR means further acquires the current date and time and includes the current date and time information in the predetermined information and synthesizes it with the captured image. The facility information is information indicating an installation location of the detected first AR marker or the controller installed at the installation location,
6. The controller system according to claim 5, wherein the worker information is information indicating a worker who possesses the detected second AR marker.   5. The controller according to claim 1, wherein a plurality of the controllers are provided, and the first AR marker is a plurality of first AR markers provided at each installation location of each controller. The controller system described.   5. The controller system according to claim 1, wherein the second AR marker is a plurality of second AR markers that the plurality of workers respectively carry. One or more controllers are installed, and the support device is configured to be able to update a program in an arbitrary controller,
Photographing means;
Support means,
AR means,
The support means activates the AR means when downloading the program,
When the activated AR means detects both the first AR marker and the second AR marker in the image taken by the photographing means, the detected first AR marker and second AR marker are detected. Generating a composite image formed by combining predetermined information corresponding to each marker with the captured image;
The support means does not download the program when the composite image is not generated, and when the composite image is generated or when the composite image is generated and a predetermined condition is satisfied, An assisting device that downloads the program and downloads the composite image together.   When the predetermined condition is satisfied, the face data extracted from the new captured image for photographing the worker matches the legitimate face data corresponding to the detected second AR marker. The support apparatus according to claim 10, wherein the support apparatus is provided. Worker image storage means in which image data of the worker who is the rightful owner is stored in association with each second AR marker;
Face authentication means;
Further comprising
The support means further activates the face authentication means when the composite image is generated,
The activated face authentication means acquires the operator's own image data corresponding to the second AR marker detected by the AR means from the worker image storage means, and uses the acquired image data to obtain a face The data is extracted as valid face data, and the face data is extracted from the new photographed image. When the extracted face data matches the valid face data, the verification is successful.
12. The support apparatus according to claim 11, wherein the support unit satisfies the predetermined condition when the collation is successful by the face authentication unit.   12. The support according to claim 11, wherein, when the collation fails by the face authentication unit, the new captured image or the face data extracted from the captured image is recorded as unauthorized access data. apparatus. The first AR marker to be detected is one of a plurality of first AR markers installed at each arbitrary location;
14. The support according to claim 10, wherein the detected second AR marker is one of a plurality of second AR markers to be carried by each of a plurality of workers. apparatus.