JP2020038463A - Testing work support system and program - Google Patents

Abstract

To cause an unskilled worker having little experiment of testing to appropriately arrange a sample in a tasting bath.SOLUTION: A testing work support system 100 supports work on a tester 5 which comprises a testing bath allowing a sample 7 to be arranged therein and adjusts an environment in the testing bath in accordance with a prescribed test condition to test the sample 7, and the testing work support system 100 comprises: a portable terminal 4 which handles the sample 7 with sample identification information D7 added thereto, which is indicative of an identifier of the sample, and comprises a camera 41 and a display unit 43; a storage unit 14 in which the identifier of the sample 7 and arrangement-relevant information about arrangement of the sample 7 in the testing bath are stored beforehand in association with each other; and test control units 40 and 10 which display the arrangement-relevant information stored in the storage unit 14 in association with the identifier of the sample 7 indicated by the sample identification information D7, in a display region of the display unit 43 when the sample identification information D7 is included in an image captured by the camera 41.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a test operation support system including a tester and a program.

  2. Description of the Related Art Conventionally, there has been known a tester that includes a test tank capable of storing a sample, and performs a test in which an environment in the test tank is adjusted according to predetermined test conditions after the sample is placed in the test tank. Further, in recent years, a so-called AR (Augmented Reality) technique of superimposing and displaying an image showing a character string or the like on an image obtained by photographing a real space is known.

  For example, Patent Document 1 discloses that when an identification image is included in a captured image of a camera during operation of an environment forming apparatus, the operating state of the environment forming apparatus and the sample managed in association with the identifier indicated by the identification image Is displayed on a smart glass worn by an operator.

JP 2018-82338 A

  Workers who are inexperienced in the work of causing a test device such as the above environment forming device to execute a test, when placing the sample in the test tank before the start of the work, apply the sample to the environment according to the test conditions. There is a possibility that the sample is placed in a position where the sample cannot be exposed. In this case, an appropriate test result may not be obtained. Further, if the position of the sample in the test chamber is changed after the test in the tester is started, the sample cannot be sufficiently exposed to an environment corresponding to the test condition, and an appropriate test result may not be obtained. . For this reason, in the operation of causing the tester to execute the test, it is required to appropriately arrange the sample in the test tank before the start of the test.

  However, Patent Literature 1 does not disclose displaying information regarding the arrangement of samples on a smart glass before the operation of the environment forming apparatus is started.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a test operation support system that allows an inexperienced operator to appropriately arrange a sample in a test tank.

  The test operation support system according to the present invention includes a test tank in which a sample can be placed, and supports an operation on a test device that performs a test on the sample by adjusting an environment in the test tank according to predetermined test conditions. A test operation support system, wherein the sample is handled in a state where sample identification information indicating its own identifier is added, and a portable terminal including a camera and a display unit; and an identifier of the sample. A storage unit that stores in advance the placement-related information regarding the placement of the sample in the target test tank that is the test tank that is the test tank that is the test device that performs the test on the sample, and the sample identification information is When included in an image captured by the camera, the storage unit stores the placement-related information associated with the sample identifier indicated by the sample identification information in a display area of the display unit. And a test control section that displays.

  According to this configuration, when the worker carries the mobile terminal and the sample identification information indicating the sample identifier comes to be included in the image captured by the camera, the sample to the test tank is displayed in the display area of the display unit of the mobile terminal. Is displayed. For this reason, the worker can appropriately arrange the sample in the test tank based on the arrangement-related information even if the operator has little experience in the test.

  Further, it is to support the operation of one or more of the test devices, wherein the placement related information is identification information for identifying the target test device, and an area for placing the sample in the target test tank. And placement area information shown.

  According to this configuration, even if the operator is not experienced in the test, the target test for performing the test on the sample based on the identification information and the arrangement area information displayed in the display area of the display unit of the mobile terminal. The device can be properly grasped, and the sample can be appropriately disposed in a predetermined region in the test tank of the target test device.

  In addition, the tester is handled in a state where tester identification information indicating its own identifier is added to an outer surface, and the storage unit further includes an identifier of the tester and tester information related to the tester. The test control unit stores the target tester in the photographed image when the tester identification information indicating the identifier of the target tester is included in the photographed image. The storage unit may display the tester information associated with the identifier of the target tester in such a manner that the tester information is associated with an area in the display area corresponding to the area in which the test is performed.

  It is assumed that when the worker is moving in the room where the target tester is located, the tester identification information indicating the identifier of the target tester is included in the image captured by the camera. In this case, according to this configuration, the storage unit associates the target tester with the identifier of the target tester in the storage image so as to correspond to the area in the display area corresponding to the area where the target tester is arranged in the captured image. Tester information is displayed.

  Therefore, even if the worker does not know the information on the target tester and the location of the target tester, the worker can easily grasp the information on the target tester based on the tester information displayed in the display area. be able to. Further, the worker can easily grasp the location of the target test device based on the position where the test device information is displayed in the display area.

  Further, the test device is handled in a state where test tank identification information indicating an identifier of the test tank is added to a position visible when the opening and closing door of the test tank is opened. The control unit, when the test tank identification information indicating the identifier of the target test tank is included in the photographed image, the display corresponding to the region where the region indicated by the arrangement region information is arranged in the photographed image. The region in the region may be displayed in an emphasized manner.

  The worker opened the opening / closing door for opening and closing the target test tank of the target tester, and photographed the inside of the target test tank with the camera of the mobile terminal, so that the test tank identification information indicating the identifier of the target test tank was captured by the camera. Is now included in In this case, according to this configuration, an area in the display area corresponding to the area where the area indicated by the arrangement area information is arranged in the captured image is displayed in an emphasized manner.

  For this reason, even if the worker has little experience in arranging the sample in the test tank, based on the area that is highlighted in the display area, the operator may use the area indicated by the arrangement area information in the target test tank. The sample can be easily arranged.

  Further, the test control unit may further display the captured image as a background image in the display area.

  The worker opened the opening / closing door for opening and closing the target test tank of the target tester, and photographed the inside of the target test tank with the camera of the mobile terminal, so that the test tank identification information indicating the identifier of the target test tank was captured by the camera. Is now included in In this case, according to this configuration, the area indicated by the arrangement area information included in the background image displayed in the display area is displayed with emphasis.

  For this reason, even if the worker has little experience in arranging the sample in the test tank, based on the area that is highlighted in the display area, the operator may use the area indicated by the arrangement area information in the target test tank. The sample can be easily arranged.

  The arrangement-related information may include arrangement direction information indicating a direction in which the sample faces when the sample is arranged in the target test tank.

  According to this configuration, even if the operator has little experience in placing the sample in the test tank, the sample is oriented in the direction indicated by the placement direction information displayed in the display area of the display unit of the mobile terminal. The sample can be appropriately arranged in the target test tank.

  Further, the arrangement-related information may include arrangement method information indicating a method of arranging the sample.

  According to this configuration, even if the operator has little experience in arranging the sample in the test chamber, the operator places the sample in the target test chamber according to the method indicated by the arrangement method information displayed in the display area of the display unit of the mobile terminal. The sample can be arranged in a suitable way.

  Further, the arrangement-related information may include instrument attachment information indicating a method of attaching an instrument necessary for the test to the sample.

  According to this configuration, even if an operator is not experienced in attaching an instrument necessary for the test to the sample, the operator does not need to perform the test according to the method indicated by the instrument attachment information displayed in the display area of the display unit of the mobile terminal. Instrument can be appropriately attached to the sample placed in the target test tank.

  Further, the test operation support system having the above configuration is an information processing apparatus including: a remote microphone that collects sound, a remote display unit that displays an image, and a remote communication unit that communicates with the mobile terminal. The portable terminal further comprises a microphone for collecting sound, an operation unit for performing an input operation of a support request instruction for requesting support for work related to the placement of the sample, and an information processing device. A communication unit that performs communication between the communication unit and the test control unit, when the support request instruction is input by the operation unit, causes the captured image of the camera to be displayed on the remote display unit; The remote communication unit may cause the microphone and the sound collected by the remote microphone to communicate with each other.

  According to this configuration, the worker who has abundant experience in the test is able to view the same image captured by the camera of the mobile terminal on the remote display unit of the information processing device, while the worker is carrying the mobile terminal. You can have a conversation with For this reason, the worker can easily receive the support of the work related to the placement of the sample from the work supporter even if he or she is not experienced in the test.

  Further, in the above configuration, the information processing apparatus further includes a remote operation unit for performing a drawing operation on the captured image displayed on the remote display unit, and the test control unit is configured to perform the operation by the remote operation unit. When a drawing operation is performed, a drawn image drawn on the captured image by the drawing operation may be displayed in the display area.

  According to this configuration, the work supporter with abundant test experience performs a drawing operation on the same image captured by the camera of the mobile terminal displayed on the remote display unit of the information processing device, and performs the drawing operation by the drawing operation. The drawn image thus drawn can be displayed in the display area of the display unit of the mobile terminal.

  For this reason, the worker can perform voice communication with the work supporter while visually recognizing the drawn image displayed in the display area of the display unit of the mobile terminal even if the worker has little experience in the test. As a result, the worker can receive more detailed support for the work related to the placement of the sample from the work supporter.

  The portable terminal further includes an operation unit for performing an input operation of the test start instruction, and the storage unit further includes an identifier of the target test device and an identifier of the target test device arranged in the test tank. Test progress information indicating the progress of the test with respect to each of all the samples, and the test control unit can store the sample in the target test tank and perform the operation. When the input operation of the start instruction is performed using the unit, after starting the test in the target test device, the test progress information associated with the identifier of the target test device in the storage unit The information may be displayed in the display area.

  According to this configuration, after the execution of the test on the sample by the target tester, the progress of the test on each of all the samples arranged in the target test tank is displayed in the display area. Therefore, the operator can easily grasp the progress of the test on each of all the samples arranged in the target test tank.

  The storage unit can further store an identifier of the target test device and operation information indicating an operation state of the target test device in association with each other, and the test control unit is disposed in the target test tank. After the start of the test on the sample, if the test image identification information indicating the identifier of the target test device is included in the captured image, the storage unit is associated with the identifier of the target test device Driving information may be displayed in the display area.

  According to this configuration, when the tester identification information indicating the identifier of the target tester is included in the image captured by the camera after the start of the test on the sample placed in the target tester, the target tester Is displayed in the display area. Therefore, the operator can easily grasp the operating state of the target tester.

  The storage unit further stores an identifier of the target tester and test information on a test executable in the target tester in association with each other in advance, and the operation unit is further displayed in the display area. It is possible to perform an operation of selecting information corresponding to one sample from the test progress information, and the test control unit performs the selection operation using the operation unit. Information corresponding to the one sample included in the test information associated with the identifier of the target tester may be displayed in the display area.

  According to this configuration, the operator individually selects information on the test for each sample from the test progress information displayed in the display area of the display unit of the mobile terminal by performing an operation of selecting information on each sample. Can be grasped.

  Further, the test operation support system according to the present invention includes a test tank in which a sample can be placed, and adjusts an environment in the test tank according to a predetermined test condition to perform a test on a test device that performs a test on the sample. A program that causes a computer to function as an information processing device that supports the computer, wherein, when sample identification information indicating an identifier of the sample is included in an image captured by a camera, a test on the sample identifier and the sample is performed. In the information previously associated with the placement-related information related to the placement of the sample in the test tank provided in the tester, the placement-related information associated with the sample identifier indicated by the sample identification information, It is made to function so that it is displayed in the display area of the display unit.

  According to this configuration, when the sample identification information indicating the sample identifier is included in the image captured by the camera, the arrangement-related information relating to the arrangement of the sample in the test tank is displayed in the display area of the display unit. For this reason, the worker can appropriately arrange the sample in the test tank based on the arrangement-related information even if the operator has little experience in the test.

  ADVANTAGE OF THE INVENTION According to this invention, the test operation support system which can arrange | position a sample to a test tank appropriately for the worker who has not experienced a test can be provided.

It is a figure showing an example of the whole picture of a test work support system. It is a block diagram showing an example of the detailed composition of a test work support system. It is a figure showing an example of a tester table. It is a figure which shows an example of the arrangement | positioning figure in a tank contained in tester information, and an arrangement | positioning figure. FIG. 4 is a diagram illustrating an example of a test pattern table. FIG. 3 is a diagram illustrating an example of a sample table. FIG. 4 is a diagram illustrating an example of a test table. FIG. 3 is a diagram illustrating an example of a sample arrangement table. It is a figure showing an example of a tester monitor table. FIG. 5 is a diagram illustrating an example of a sample monitor table. It is a flowchart which shows an example of operation | movement of the test operation support system before a test start. It is a figure showing the example of a display of sample related information. It is a figure showing the example of a display of test device information. It is a figure showing the example of highlighting of the arrangement field. It is a figure showing the example of support of the work related to arrangement of a sample. It is a flowchart which shows an example of operation | movement of the test operation support system after a test start. It is a figure showing the example of a display of test related information. It is a figure which shows the example of a display of driving | operation related information, test related information, and tester related information. FIG. 9 is a diagram illustrating a display example of test information of a selected test. It is a flowchart which shows an example of operation | movement of the test operation support system at the time of a test end. 13 is a flowchart illustrating a modification of the operation of the test operation support system at the end of the test.

(First embodiment)
Hereinafter, a first embodiment of the test work support system according to the present invention will be described. FIG. 1 is a diagram illustrating an example of the overall image of the test operation support system 100. As shown in FIG. 1, the test operation support system 100 includes a smart glass 4 (portable terminal), an information processing device 3 disposed in an office or the like of an office, and a LAN (Local Area Network) or the Internet. And a server 1 that communicates via the network 9. The server 1 is further communicably connected to one or more test devices 5 and measuring devices 6 arranged in one or more test rooms 2 via a network 9.

  The tester 5 includes a test tank in which one or more samples 7 (see FIG. 12) can be arranged, and an opening / closing door 51 that opens and closes the test tank. After the sample 7 is placed in the test tank, the tester 5 executes a test for adjusting the environment in the test tank according to predetermined test conditions. For example, the sample 7 includes an electric device such as a smartphone, a control board, an electronic component, and the like. The environment in the test tank includes the temperature, humidity, and pressure of the air in the test tank, vibration applied to the sample 7 in the test tank, artificial rain and snow falling around the sample 7, and the like.

  The test device 5 includes a measuring device (not shown) that periodically measures the temperature and humidity of the air in the test tank. After the start of the test, the tester 5 periodically transmits the measurement results of the temperature and humidity of the air in the test tank by the measuring device to the server 1 via the network 9.

  On the outer surface of the tester 5, a tester marker (tester identification information) D5 indicating its own identifier is attached or printed (added). The tester marker D5 is composed of, for example, a barcode, a two-dimensional barcode, or a character string of an identifier. A sample marker (sample identification information) D7 indicating its own identifier is affixed or printed (added) to the sample 7 placed in the test tank, similarly to the tester 5 (see FIG. 12). . In addition, similarly to the tester 5, a test tank marker (test tank identification information) D52 indicating the identifier of the test tank is attached or printed at a position where the opening / closing door 51 in the test tank is visible when the door 51 is opened. (See FIG. 14).

  The measuring instrument 6 can be carried to each test room 2. The measuring device 6 includes a device for measuring the surface temperature of the sample 7 accommodated in the test tank of each test device 5, the current flowing through the sample 7, the voltage applied to the sample 7, and the like.

  Specifically, an operator attaches a thermocouple or a signal wire to the sample 7 in the test tank, and measures the attached thermocouple or signal wire through a hole provided in a wall of the test tank or the like. Connected to the vessel 6. Then, the identifier of the sample 7 is input to the measuring device 6 by the operator. As a result, when the preparation for measurement is completed, the measuring instrument 6 starts measuring the surface temperature of the sample 7 at the place where the thermocouple is attached and the current or voltage flowing through the place where the signal line is attached to the sample 7. The measuring device 6 periodically performs the measurement, and transmits each measurement result to the server 1 via the network 9 together with the identifier of the sample 7 to be measured input by the operator.

  The smart glass 4 is configured to be attachable to a worker's head. FIG. 2 is a block diagram illustrating an example of a detailed configuration of the test operation support system 100. As shown in FIG. 2, the smart glass 4 includes a camera 41, a microphone 42, a screen 43 (display unit), a speaker 46, an operation unit 44, a communication unit 45, and a control unit 40 (test control unit).

  The camera 41 uses the same direction as the line of sight of the worker wearing the smart glass 4 as the photographing direction, and photographs substantially the same image as the real space image seen by the worker. Note that the captured image of the camera 41 includes a still image in addition to a moving image. The microphone 42 collects the voice uttered by the worker. The speaker 46 outputs an instructed sound under the control of the control unit 40.

  The screen 43 is a so-called transmission screen, and has a substantially transparent display area capable of displaying an image. The screen 43 displays an image received from the server 1 via the network 9 in the display area. Thereby, the worker wearing the smart glass 4 can visually recognize an image in which the image displayed in the display area is superimposed on the image in the real space viewed through the display area of the screen 43. it can.

  The operation unit 44 includes an operation button for displaying an operation screen and a software keyboard on the screen 43, an operation button for moving a cursor (pointer) displayed on the screen 43, and an operation button designated by the cursor in the operation screen. Operation buttons such as operation buttons for pressing soft keys are provided. The operation unit 44 outputs to the control unit 40 an instruction associated with an operation performed using each operation button and information input using each operation button.

  The communication unit 45 includes a communication interface circuit for the smart glass 4 to communicate with the server 1 via the network 9 (FIG. 1). The communication unit 45 communicates with the server 1 under the control of the control unit 40. Further, the communication unit 45 communicates with the information processing device 3 via the server 1 under the control of the control unit 40.

  The control unit 40 includes a non-volatile memory such as a CPU (Central Processing Unit), a volatile memory such as a RAM (Random Access Memory), a nonvolatile memory such as an EEPROM (Electrically Erasable Programmable Read-Only Memory), and a current time. It consists of a microcomputer. The control unit 40 controls each unit of the smart glass 4 by causing the CPU to execute a control program stored in the nonvolatile memory.

  The information processing device 3 is configured by a personal computer or a tablet terminal. The information processing device 3 includes a microphone 32 (remote display unit), a display 33 (remote display unit), a speaker 36, an operation unit 34, a communication unit 35 (remote communication unit), and a control unit 30.

  The microphone 32 collects sounds around the information processing device 3. The display 33 is configured by, for example, a liquid crystal display. The display 33 has a display area for displaying an image, and displays the specified image in the display area under the control of the control unit 30. The speaker 36 outputs an instructed voice under the control of the control unit 30.

  The operation unit 34 includes, for example, a touch panel device provided on a display area of the display 33. The operation unit 34 detects various operations performed on the display area of the display 33 by the user, and outputs an instruction associated with the detected operation to the control unit 30. Operations performed in the display area include a touch operation, a drag (swipe) operation, a long tap (long press) operation, a double tap operation, and the like. Further, the operation unit 34 includes an input device such as a keyboard and a mouse, and outputs an instruction associated with an operation performed using the input device and information input using the input device to the control unit 30. I do.

  The communication unit 35 includes a communication interface circuit for the information processing device 3 to communicate with the server 1 via the network 9 (FIG. 1). The communication unit 35 communicates with the server 1 under the control of the control unit 30. The communication unit 35 communicates with the smart glasses 4 via the server 1 under the control of the control unit 30.

  The control unit 30 is configured by a microcomputer including a CPU, a volatile memory such as a RAM, a non-volatile memory such as an EEPROM, a timer circuit for measuring the current time, and the like. The control unit 30 controls each unit of the information processing device 3 by causing the CPU to execute a control program stored in the nonvolatile memory.

  Note that the communication unit 35 may be capable of communicating with one or more test devices 5 and the measurement devices 6 under the control of the control unit 30. Then, the control unit 30 may control the test device 5 and the measuring device 6 via the communication unit 35.

  The server 1 includes a control unit 10 (test control unit), a communication unit 11, and a storage unit 14, as shown in FIG. The server 1 may include a display unit similar to the display 33 and an operation unit similar to the operation unit 34.

  The control unit 10 includes a microcomputer including a CPU, a volatile memory such as a RAM, a non-volatile memory such as an EEPROM, a timer circuit for measuring the current time, and the like. The control unit 10 controls each unit of the server 1 by causing the CPU to execute a control program stored in the nonvolatile memory.

  The communication unit 11 includes a communication interface circuit for allowing the server 1 to communicate with a device external to the server 1 via the network 9 (FIG. 1). The communication unit 11 communicates with each of the test devices 5, the measuring device 6, the smart glasses 4, and the information processing device 3 under the control of the control unit 10.

  The storage unit 14 is configured by a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 14 stores in advance various kinds of information necessary for causing each tester 5 to execute a test. Further, under the control of the control unit 10, the storage unit 14 stores various information received by the communication unit 11 during execution of the test in each tester 5, information instructed by the control unit 10, and the like.

(Information stored in storage unit 14)
Hereinafter, details of the information stored in the storage unit 14 will be described. FIG. 3 is a diagram illustrating an example of the tester table. FIG. 4 is a diagram showing an example of a layout in a tank and a layout included in the tester information.

  As illustrated in FIG. 3, the storage unit 14 stores an identifier of the tester 5 (hereinafter, tester ID) (eg, “111”) and tester information that is information on the tester 5 corresponding to the tester ID. Are stored in advance. The tester table is connected to the server 1 via the communication unit 35 by the operation of the operation unit 34 of the information processing device 3 by, for example, an administrator of the tester 5 or an operator who has a great deal of experience in testing the tester 5. By performing the communication, the information is stored in the storage unit 14 in advance.

  The tester information includes the name of the tester 5 (hereinafter, tester name) (for example, “Cold and thermal shock device C-11”) and the identifier of a test tank provided in the tester 5 (hereinafter, tester ID) (example) : “1111”).

  Further, the tester information includes, for example, as shown in section (A) of FIG. 4, an area where the sample 7 can be arranged in a test tank provided in the tester 5 (hereinafter, an arrangement area) (eg, “A”). , “B”, “C”, “D”). For example, in the tank arrangement diagram shown in section (A) of FIG. 4, two sample shelves 521 and 522 are provided in the test tank, and the upper sample shelf 521 has an arrangement area “A” for two samples 7. And "B" are provided, and the lower sample shelf 522 is provided with the placement areas "C" and "D" for the two samples 7.

  Further, the tester information includes the test room 2 (eg, “1F test room”) in which the tester 5 is arranged, and the test in the test room 2 as shown in, for example, section (B) of FIG. Image data of a layout drawing indicating the location of the container 5 (eg, a shaded portion).

  FIG. 5 is a diagram illustrating an example of the test pattern table. As shown in FIG. 5, the storage unit 14 stores a test related to a tester ID (eg, “111”) and a test condition pattern (hereinafter, a test pattern) that can be set in the tester 5 corresponding to the tester ID. A test pattern table associated with the pattern information is stored in advance. The test pattern table is stored in the storage unit 14 in advance by, for example, the operation of the operation unit 34 of the information processing device 3 by the administrator of the test device 5 or an operator who has abundant experience in testing with the test device 5. .

  The test pattern information includes a test pattern identifier (hereinafter, test pattern ID) (eg, “12”), a test pattern name (hereinafter, test pattern name) (eg, “test pattern 1”), and a test condition. (Eg, "High temperature bath (175 ° C, manual), low temperature bath (-75 ° C, manual), high temperature exposure (150 ° C, 0:30), normal temperature exposure (0:05), low temperature exposure (-65 ° C, 0:30), test time (76:45), ... ").

  FIG. 6 is a diagram illustrating an example of the sample table. As illustrated in FIG. 6, the storage unit 14 stores a sample 7 in which an identifier of the sample 7 (hereinafter, sample ID) (eg, “358D-4458575269”) is associated with sample information on the sample 7 corresponding to the sample ID. The table is stored in advance. The sample table is stored in the storage unit 14 before execution of the test in each tester 5 by, for example, an operation of the operation unit 34 of the information processing device 3 by an operator who has a lot of experience in the test.

  The sample information includes the name of the sample 7 (hereinafter, sample name) (eg, “test board C”) and an operator who stores the sample information in the storage unit 14 (hereinafter, sample registrant) (eg, “base board”). Development Department ○ Δ △ ”) and image data indicating the image of the sample 7.

  FIG. 7 is a diagram illustrating an example of the test table. As shown in FIG. 7, the storage unit 14 stores an identifier of each test (hereinafter, test ID) (eg, “45367”), test information related to each test, and test progress information indicating the progress of each test. A storage area for a test table to be associated is provided.

  The test information includes a tester ID (eg, “111”) of a tester 5 (hereinafter, a target tester) that performs a test on a sample and a test tank ID of a test tank (hereinafter, a target tester) provided in the target tester. (For example, “1111”) and the sample ID of the sample 7 to be subjected to each test (for example, “358D-4457875269”). The test information includes the scheduled start date and time of each test (eg, “2018/5/30 13:00”), the scheduled end date and time of each test (eg, “2018/6/2 17:45”), A test pattern ID (see FIG. 5) (eg, “12”) which is an identifier of a test pattern corresponding to a test condition used in the test is included. The test information is stored in the test table before the start of the test, for example, by operating the operation unit 34 of the information processing device 3 by the work instructor who instructed the worker to perform the work related to the test.

  The test progress information includes the start date and time of each test (eg, “2018/5/30 13:00”), the end date and time of each test, the status of each test (hereinafter, status) (eg, “under test”), The remaining time of each test (eg, “46:54”) and the remaining cycle of each test (eg, “112”) are included. The remaining time of each test indicates a time obtained by subtracting the accumulated time that has been executed from the start of each test to the present time from the test time set as the test condition. The remaining cycle of each test is the number of times the environment in the target test chamber has been changed from the start of each test to the present, from the number of times the environment in the target test chamber is changed during the test set as test conditions Is the number of times obtained by subtracting. After the start of each test, the test progress information is updated periodically or irregularly by communication between the tester 5 and the server 1.

  FIG. 8 is a diagram illustrating an example of the sample arrangement table. As shown in FIG. 8, the storage unit 14 stores a sample ID of the sample 7 (eg, “358D-4457875269”) and information related to the arrangement of the sample 7 in the target test tank. A storage area is provided. The placement-related information is stored in the test placement table before the start of the test, for example, by operating the operation unit 34 of the information processing apparatus 3 by the work instructor who instructed the worker on the work related to the test.

  The placement-related information includes the test ID of the test for the sample 7 (eg, “45367”), the tester ID of the target tester (eg, “111”), and the test tank ID of the target test tank (eg, “1111”). And the tester name of the target tester (for example, “Cool and thermal shock device C-11”) (identification information). In addition, the placement-related information includes a placement area (hereinafter referred to as a placement area) selected as an area in which the sample 7 is placed from placement areas (see section (A) in FIG. 4) provided in the target test tank. (Example: “C”) (arrangement area information) is included.

  The placement-related information further includes placement direction information (eg, “marker left front”) indicating the direction in which the sample 7 faces when the sample 7 is placed in the target test tank. For example, when the arrangement direction information is the character string “marker left front”, the operator places the sample marker D7 (marker) attached to the sample 7 on the left front when placing the sample 7 from the opening of the target test tank. The direction of the sample 7 may be determined and arranged so that the position of the sample 7 is obtained. The arrangement direction information is not limited to a character string, and may be moving image, image, or audio data indicating a direction in which the sample 7 faces when the sample 7 is arranged in the target test tank.

  The placement-related information further includes placement method information (eg, “direct placement”) indicating a method of placing the sample 7. For example, when the arrangement method information is a character string “directly placed”, the operator may directly place the sample 7 in the arrangement area. If the arrangement method information is the character string “fixed with jig”, the operator may fix the sample 7 with the jig in the arrangement area. The arrangement method information is not limited to a character string, and may be moving image, image, or audio data indicating a method of arranging the sample 7.

  The arrangement-related information further includes instrument attachment information (eg, “two arbitrary thermocouples”) indicating a method for attaching an instrument required for a test such as a thermocouple to the sample 7. For example, when the instrument mounting information is the character string “two arbitrary thermocouple locations”, the operator may attach thermocouples to any two locations of the sample 7. Note that the arrangement-related information is not limited to a character string, and may be moving image, image, or audio data indicating a method of attaching an instrument necessary for a test to the sample 7.

  Note that the placement-related information does not need to include one or more of the placement direction information, the placement method information, and the appliance attachment information.

  FIG. 9 is a diagram illustrating an example of the tester monitor table. As shown in FIG. 9, the storage unit 14 stores a storage area of a tester monitor table that associates a tester ID (eg, “111”) of the target tester with operation information indicating an operation state of the target tester. Is provided.

  The operation information includes an operation state of the target tester (eg, “operating”).

  The operation information includes an identifier (hereinafter, operation pattern ID) of an operation pattern currently executed by the target tester among patterns (hereinafter, operation patterns) for adjusting the environment in the target test tank included in the test conditions. ) (Example: “5”) and the name of the operation pattern (hereinafter, operation pattern name) (example: “test pattern 1”).

  Further, the operation information includes alarm information (for example, “0”) indicating the number of alarms that have been notified in the target tester, and information information (for example, “0”) indicating the number of information such as warnings in the target tester. 4 ") and cycle information (eg, 456/1000). Cycle information is the number of times that the environment in the target test chamber is changed after starting the operation of the target test device, which is set as the test conditions, until the operation is stopped, and the number of times the operation starts in the target test device. Shows the number of times the environment in the target test tank has been changed so far.

  Further, the operation information includes high-temperature tank temperature information (eg, “144 ° C.”) indicating the current temperature in the high-temperature tank used for adjusting the environment in the target test tank, and indicating the current temperature in the target test tank. The test area temperature (eg, “44 ° C.”) and low-temperature tank temperature information (eg, “−75 ° C.”) indicating the current temperature in the low-temperature tank used for adjusting the environment in the target test tank are included.

  While the test is being executed in the target tester, the operation information is periodically or irregularly transmitted from the target tester to the server 1 by the control unit 10 based on the information transmitted to the server 1. Is stored or updated.

  FIG. 10 is a diagram illustrating an example of the sample monitor table. As shown in FIG. 10, the storage unit 14 associates the sample ID of the sample 7 to be tested (for example, “358D-445875269”) with the sample monitor information indicating the state of the sample 7. A storage area for the sample monitor table is provided. The sample monitor information includes temperature information (eg, “44 ° C.”) indicating the temperature of the sample 7 most recently measured by a thermocouple or the like attached to the sample 7. After the start of the test in the target tester, the sample monitor information is stored or updated in the sample monitor table by the control unit 10 based on the information transmitted from the measuring device 6 to the server 1 regularly or irregularly. .

(Operation of Test Operation Support System 100 Before Starting Test)
Hereinafter, the operation of the test operation support system 100 before the start of the test will be described. FIG. 11 is a flowchart illustrating an example of the operation of the test operation support system 100 before the start of the test. FIG. 12 is a diagram illustrating a display example of the sample-related information R7. As shown in FIG. 11, the control unit 40 first determines whether or not the sample marker D7 is included in the image captured by the camera 41 by executing a known image recognition process (step S101).

  For example, as shown in section (A) of FIG. 12, after the worker wears the smart glass 4 on his / her head and turns his / her gaze on the sample 7, the sample marker D7 is added to the image captured by the camera 41. Is included. In this case, in step S101, the control unit 40 determines that the sample marker D7 is included in the image captured by the camera 41 (YES in step S101).

  In this case, for example, as shown in section (B) of FIG. 12, the control unit 40 displays a part R7 of the sample related information associated with the sample ID indicated by the sample marker D7 in the storage unit 14 on the screen 43. (Step S102).

  Specifically, in step S102, the control unit 40 converts the sample marker D7 recognized in step S101 into a character string by a predetermined conversion method, and acquires the character string as a sample ID. Then, the control unit 40 sends an instruction (command) for requesting transmission of the sample-related information associated with the sample ID in the storage unit 14 to the server 1 via the communication unit 45 together with the obtained sample ID. Send.

  In the server 1, when the control unit 10 receives the instruction for requesting transmission of the sample ID and the sample-related information received by the communication unit 11, the control unit 10 associates the instruction with the received sample ID from the storage unit 14 according to the instruction. Obtain relevant sample information. Then, the control unit 10 returns the acquired sample-related information via the communication unit 11. When receiving the sample-related information received by the communication unit 45, the control unit 40 displays a part R7 of the received sample-related information on the display area of the screen 43.

  In the part R7 of the sample-related information displayed on the screen 43, for example, as shown in the section (B) of FIG. 12, the test NO (eg, “358D-445875269”), the image of the sample 7, and the test start schedule Date and time (example: "2018/5/30 13:00"), test time (example: "76:45"), scheduled test end date and time (example: "2018/6/2 17:45"), tester name (Example: "Thermal shock device C-11"), placement area (Example: "C"), test conditions (Example: "Test pattern 1"), and requester (Example: "Board development department ○○ △△") Is included.

  Although not displayed on the screen 43 in the sample-related information, the tester ID of the target tester and the test tank ID of the target test tank for performing a test on the sample 7 of the sample ID indicated by the sample marker D7 recognized in step S101. Is included.

  The control unit 10 acquires each piece of information included in the sample-related information as follows. The control unit 10 acquires the sample ID received by the communication unit 11 as a test number included in the sample-related information. The control unit 10 stores the image data of the sample 7 and the sample registrant included in the sample information associated with the sample ID in the sample table (FIG. 6) with the image of the sample 7 included in the sample-related information and the requester. To get as

  The control unit 10 obtains the scheduled start date and time and the scheduled end date and time included in the test information including the sample ID in the test table (FIG. 7) as the scheduled test start date and time and the scheduled test end date and time included in the sample related information. I do. The control unit 10 converts the test device ID, the test tank ID, the test device name, and the placement area included in the placement-related information associated with the sample ID in the sample placement table (FIG. 8) into the sample-related information. It is acquired as the included tester ID, test tank ID, tester name, and arrangement area.

  The control unit 10 determines the tester ID (eg, “111”) and the test included in the test information including the sample ID (eg, “358D-445875269”) received from the communication unit 11 in the test table (FIG. 7). A pattern ID (for example, “12”) is obtained. Then, the control unit 10 refers to the test pattern information including the acquired test pattern ID among the test pattern information associated with the acquired test device ID in the test pattern table (FIG. 5). Then, the control unit 10 sets the test time (eg, “76:45”) and the test pattern name (eg, “test pattern 1”) included in the setting contents of the test condition included in the referred test pattern information. Is obtained as the test time and test condition included in the sample-related information.

  Note that the part R7 of the sample-related information displayed on the screen 43 is not limited to the information exemplified in the section (B) of FIG. 12, but the sample ID acquired by the control unit 40 in the sample arrangement table (FIG. 8). One or more pieces of information among the arrangement direction information, the arrangement method information, and the appliance attachment information included in the arrangement-related information associated with the information may be further included.

  When the placement direction information is included in a part R7 of the sample-related information, the operator can view the placement direction information displayed on the display area of the screen 43 even if he or she is not experienced in placing the sample 7 in the test tank. The sample can be appropriately arranged in the target test tank such that the sample faces in the direction indicated by. When the placement method information is included in a part R7 of the sample-related information, the operator does not know the placement method information displayed in the display area of the screen 43 even if he or she is not experienced in placing the sample in the test tank. According to the method shown, the sample 7 can be arranged in an appropriate manner in the target test tank. When the instrument mounting information is included in the part R7 of the sample-related information, even if the operator has little experience in attaching the instruments necessary for the test to the sample, the operator can display the instrument mounting information displayed on the display area of the screen 43. According to the method indicated by the information, the instruments necessary for the test can be appropriately attached to the sample 7 arranged in the target test tank.

  The sample-related information does not need to include information other than the tester ID of the target tester, the test tank ID of the target test tank, the tester name, and the arrangement area. The sample-related information does not have to include the tester name. In this case, the part R7 of the sample-related information may include the tester ID of the target tester instead of the tester name of the target tester as identification information for identifying the target tester.

  According to the above-described configuration, even if the operator is not experienced in the test, the operator can use the tester name or the tester of the target tester included in the part R7 of the sample-related information displayed in the display area of the screen 43. Based on the ID and the placement area, it is possible to appropriately grasp the target tester on which the test for the sample 7 is to be performed, and to appropriately place the sample in a predetermined area in the test tank of the target tester.

  If the control unit 40 determines in step S101 that the sample marker D7 is not included in the image captured by the camera 41 (NO in step S101), the control unit 40 executes the processing from step S101.

  After execution of step S102, the control unit 40 performs a known image recognition process to determine whether or not the tester marker D5 indicating the tester ID of the target tester is included in the image captured by the camera 41. (Step S103).

  Specifically, in step S103, the control unit 40 performs a known image recognition process to convert all the tester markers D5 included in the captured image into a character string by a predetermined conversion method. The converted character string is acquired as the tester ID of all the testers 5 included in the captured image. Then, when the acquired tester ID includes the tester ID of the target tester included in the sample-related information, the control unit 40 tests the tester marker D5 indicating the tester ID of the target tester. Is included in the image captured by the camera 41 (YES in step S103).

  FIG. 13 is a diagram illustrating a display example of the tester information R5. For example, it is assumed that the operator visually recognizes the test device name of the target test device included in the sample-related information R7 displayed on the screen 43 in step S102. Then, as shown in FIG. 13, for example, the worker enters the test room 2 in which the target tester T5 is disposed, and faces the direction in which the target tester T5 is disposed while looking around. Suppose you were. As a result, it is assumed that the image captured by the camera 41 includes the tester marker D5 indicating the tester ID of the target tester T5. In this case, the control unit 40 determines that the tester marker D5 indicating the tester ID of the target tester T5 is included in the image captured by the camera 41 in step S103 (YES in step S103).

  In this case, for example, as illustrated in FIG. 13, the control unit 40 associates the target tester T5 with an area in the display area of the screen 43, which corresponds to the area where the target tester T5 is arranged in the image captured by the camera 41. The storage unit 14 displays the tester information R5 associated with the tester ID of the target tester T5 (step S104).

  Specifically, in step S104, the control unit 40 stores the target tester in the storage unit 14 together with the tester ID of the target tester T5 included in the sample-related information received from the server 1 in step S102, as in step S102. An instruction to request transmission of the tester information R5 associated with the tester ID of T5 is transmitted to the server 1.

  In the server 1, when the control unit 10 receives an instruction to request transmission of the tester ID of the target tester T5 and the tester information R5 via the communication unit 11, the control unit 10 receives the instruction from the storage unit 14 according to the instruction. The tester information R5 associated with the tester ID is obtained. Then, the control unit 10 returns the obtained test device information R5 via the communication unit 11.

  When receiving the test device information R5 received by the communication unit 45, the control unit 40 generates a balloon-shaped image (hereinafter, a balloon image) indicating the received test device information R5. Then, as shown in FIG. 13, for example, the control unit 40 determines that the starting point of the balloon in the generated balloon image corresponds to the region where the target tester T5 is arranged in the captured image of the camera 41. The generated balloon image is displayed in the display area of the screen 43 such that the balloon image is positioned near the area inside the balloon 43. Thereby, the control unit 40 displays the tester information R5 in such a manner that the tester information R5 is associated with an area in the display area of the screen 43 corresponding to the area where the target tester T5 is arranged in the image captured by the camera 41.

  It should be noted that the method of displaying the tester information R5 by associating the control unit 40 with the area in the display area of the screen 43 corresponding to the area where the target tester T5 is arranged in the image captured by the camera 41 is described below. Not limited to For example, the control unit 40 displays the tester information R5 in an area in the display area of the screen 43 corresponding to the area where the target tester T5 is arranged in the image captured by the camera 41 and the vicinity of the area. Is also good.

  The control unit 40 displays the tester information R5 when the tester marker D5 is included in the image captured by the camera 41. In other words, when the tester information R5 is displayed, the captured image of the camera 41 includes at least a part of the outer surface of the target tester T5 to which the tester marker D5 is added. Therefore, the control unit 40 may display the tester information R5 at a position in the display area of the screen 43 corresponding to an arbitrary position in the captured image of the camera 41 including the target tester T5.

  The tester information R5 includes, for example, the tester name of the target tester T5 (for example, “cooling thermal shock device C-11”) as shown in FIG. Specifically, the control unit 10 includes, in the tester table (FIG. 3), the tester information associated with the tester ID of the target tester T5 received from the smart glass 4 via the communication unit 11. Of the target tester T5 included in the tester information R5.

  The information included in the tester information R5 is not limited to the tester name of the target tester T5 illustrated in FIG. 13, but may be a test of the target tester acquired by the controller 40 in the tester table (FIG. 3). Information different from the tester name included in the tester information associated with the device ID may be included.

  According to the configuration described above, even if the worker does not know the information on the target tester T5 and the location of the target tester T5, the worker displays the tester table (FIG. 3) displayed in the display area of the screen 43. Based on the tester information associated with the tester ID of the target tester, information on the target tester T5 can be easily grasped. Further, the worker can easily grasp the location of the target tester T5 based on the position where the tester information is displayed in the display area of the screen 43.

  After execution of step S104, the control unit 40 executes a known image recognition process, similarly to step S101, to thereby obtain a test tank marker D52 indicating a test tank ID of a test tank of a target tester (hereinafter, a target test tank). It is determined whether or not (see FIG. 14) is included in the image captured by the camera 41 (step S105).

  FIG. 14 is a diagram illustrating an example of highlighting the arrangement area. For example, after moving to a position where the target tester T5 is disposed in the test chamber 2 where the target tester T5 is disposed, a predetermined operation for opening the opening / closing door 51 in the target tester T5 is performed. Is performed and the door 51 is opened. Then, it is assumed that, as a result of the worker visually recognizing the test tank marker D52, the image captured by the camera 41 includes the test tank marker D52 indicating the test tank ID of the target test tank. In this case, the control unit 40 determines in step S105 that the test tank marker D52 indicating the test tank ID of the target test tank is included in the image captured by the camera 41 (YES in step S105).

  In this case, for example, as illustrated in FIG. 14, the control unit 40 determines that the area indicated by the arrangement area (eg, “C”) included in the sample-related information R7 (FIG. A region (eg, region A52) in the display region of the screen 43 corresponding to the region arranged in is highlighted and displayed (step S106).

  Specifically, in step S106, the control unit 40 sets the tester ID of the target tester T5 and the test tank of the target test tank included in the captured image of the camera 41 and the sample-related information (FIG. 12) acquired in step S102. An instruction to highlight the area corresponding to the arrangement area is transmitted to the server 1 via the communication unit 45 together with the ID and the arrangement area.

  In response to this, in the server 1, the control unit 10 transmits the captured image of the camera 41, the tester ID of the target tester T <b> 5, the test tank ID of the target test tank, the placement area and the placement area, It is assumed that an instruction to highlight the area corresponding to is received.

  In this case, the control unit 10 sets the test tank ID of the received target test tank in the tester information associated with the received tester ID of the target tester T5 in the tester table (FIG. 3). With reference to the included tester information, the image data of the in-tank layout included in the referred tester information is acquired.

  The control unit 10 performs a known image recognition process to recognize, in the received image captured by the camera 41, an area where an image corresponding to the in-tank layout diagram indicated by the obtained image data is arranged. The control unit 10 generates a transparent image having the same shape and size as the received image of the camera 41. The control unit 10 controls an area A52 (FIG. 14) corresponding to the received arrangement area among the areas on the transparent image corresponding to the area where the recognized area is arranged in the received image captured by the camera 41. Is surrounded by a bold line. Then, the control unit 10 superimposes an image on which the message indicating the received layout area (eg, “layout area: C” (FIG. 14)) is superimposed so as to correspond to the area surrounded by the thick line in the transparent image. , Via the communication unit 11. In response to this, when receiving the image received by the communication unit 45, the control unit 40 displays the received image on the display area of the screen 43.

  According to the above configuration, the area in the display area of the screen 43, in which the area indicated by the arrangement area corresponds to the area arranged in the image captured by the camera 41, is displayed with emphasis. For this reason, even if the worker has little experience in arranging the sample 7 in the test tank, based on the area highlighted in the display area, the operator can move to the area indicated by the arrangement area in the target test tank. The sample 7 can be easily arranged.

  Note that when the control unit 40 determines that the tester marker D5 is not included in the captured image of the camera 41 in step S103 (NO in step S103), the control unit 40 sets the test tank marker D52 to the captured image of the camera 41 in step S105. If it is determined that it is not included (NO in step S105), the processing from step S103 is performed.

  After execution of step S106, it is assumed that a support request instruction for requesting support for a work related to the arrangement of the sample 7 is input by an operation of the operation unit 44 by the operator (YES in step S107). The work related to the arrangement of the sample 7 includes, for example, an operation of determining the orientation of the sample 7 when the sample 7 is arranged in the target test tank, and an operation of attaching an instrument such as a thermocouple to the sample 7.

  In this case, the control unit 40 displays the image captured by the camera 41 on the display 33 of the information processing device 3 (Step S108). Then, the control unit 40 transmits the sound collected by the microphone 42 of the smart glass 4 and the microphone 32 of the information processing device 3 to the smart glass 4 by the communication unit 45 of the smart glass 4 and the communication unit 35 of the information processing device 3. And the information processing apparatus 3 are caused to communicate with each other (step S109).

  Specifically, in step S108, the control unit 40 transmits the support request instruction input in step S107 to the server 1 together with the image captured by the camera 41. In response to this, in the server 1, when the control unit 10 receives the captured image and the support request instruction via the communication unit 11, the control unit 10 transfers the received captured image and the support request instruction to the information processing device 3 by the communication unit 11. Let it. In response to this, in the information processing device 3, when the control unit 30 receives the captured image and the support request instruction via the communication unit 35, the control unit 30 displays the received captured image on the display 33 according to the received support request instruction. Let it.

  In step S109, the control unit 40 transmits a voice communication request instruction to the server 1 together with the voice collected by the microphone 42. In the server 1, when the control unit 10 receives the voice and the voice communication request instruction collected by the microphone 42 via the communication unit 11, the communication unit 11 processes the received voice and the voice communication request instruction by the communication unit 11. The data is transferred to the device 3. In the information processing device 3, upon receiving the voice collected by the microphone 42 and the request instruction of the voice communication via the communication unit 35, the control unit 30 converts the received voice according to the received voice communication request instruction. The output is made to the speaker 36.

  Then, the control unit 30 transmits a voice communication request instruction to the server 1 together with the voice collected by the microphone 32. In the server 1, when the control unit 10 receives the voice and the voice communication request instruction collected by the microphone 32 via the communication unit 11, the communication unit 11 transmits the received voice and the voice communication request instruction to the smart glass. 4 In the smart glass 4, when receiving the voice collected by the microphone 32 and the request instruction of the voice communication via the communication unit 45, the control unit 40 transmits the received voice to the speaker according to the received voice communication request instruction. 46 is output.

  On the other hand, after execution of step S106, if a support request instruction for requesting support for work related to the placement of the sample 7 is not input by an operation of the operation unit 44 by the operator (NO in step S107), step S113 and subsequent steps are performed. Is performed.

  In step S109, after the voice communication for causing the smart glass 4 and the information processing device 3 to communicate voices with each other is started, in the information processing device 3, the user is displayed on the display 33 using the operation unit 34. It is assumed that a drawing operation has been performed on the captured image (YES in step S110). In this case, the control unit 30 displays the drawn image drawn by the drawing operation on the display area of the screen 43 of the smart glass 4 (Step S111).

  Specifically, in step S111, the control unit 30 transmits a display instruction of the drawn image to the server 1 together with the drawn image. In the server 1, when receiving the drawing image and the display instruction of the drawing image via the communication unit 11, the control unit 10 causes the communication unit 11 to transfer the received drawing image and the display instruction of the drawing image to the smart glass 4. In the smart glass 4, when receiving the drawing image and the display instruction of the drawing image via the communication unit 45, the control unit 40 displays the received drawing image on the display area of the screen 43 according to the received display instruction.

  Until an operator's operation of the operation unit 44 inputs a support end instruction for ending the support of the work related to the placement of the sample 7, the processing from step S108 is repeated. Thereafter, when a support end instruction to end the support of the work related to the placement of the sample 7 is input by the operation of the operation unit 44 by the operator (YES in step S112), the support of the work related to the placement of the sample 7 is supported. Is completed, and the processing after step S113 is performed.

  FIG. 15 is a diagram illustrating an example of support for work related to the arrangement of the sample 7. For example, FIG. 15 illustrates a case where the operator P1 places the sample 7 in the target test tank, then attaches a thermocouple to the sample 7 and performs a wiring operation to connect the thermocouple to the measuring instrument 6. This illustrates a scene when the processing after step S108 is performed by inputting the support request instruction.

  When step S108 is performed, an image captured by the camera 41 is displayed on the screen 43 of the smart glass 4 and the display 33 of the information processing device 3, as shown in FIG. When step S109 is performed, the uttered voice of the worker P1 collected by the microphone 42 of the smart glass 4 and the uttered voice of the user P2 collected by the microphone 32 of the information processing device 3 communicate with each other, thereby performing the work. A conversation takes place between the person P1 and the user P2. At this time, when the user P2 performs a drawing operation of the drawn image D30 using the operation unit 34, step S111 is performed, and the drawn image D30 drawn by the drawing operation is also displayed on the screen 43 of the smart glass 4. .

  According to the above configuration, a work supporter with abundant test experience wears the smart glass 4 while visually recognizing the same image as the captured image of the camera 41 of the smart glass 4 on the display 33 of the information processing device 3. Can talk with workers For this reason, the worker can easily receive the support of the work related to the placement of the sample from the work supporter even if he or she is not experienced in the test.

  Further, according to the above configuration, the work supporter with abundant test experience performs a drawing operation on the same image as the captured image of the camera 41 of the smart glass 4 displayed on the display 33 of the information processing device 3, and The drawn image D30 drawn by the drawing operation can be displayed in the display area of the screen 43.

  For this reason, even if the operator has little experience in the test, the operator can perform voice communication with the work supporter while visually recognizing the drawn image D30 displayed in the display area of the screen 43. As a result, the worker can receive more detailed support for the work related to the placement of the sample from the work supporter.

  In step S113, the control unit 40 determines whether or not a test tank marker D52 (FIG. 14) indicating the test tank ID of the target test tank is included in the image captured by the camera 41, as in step S105 (step S105). S113). In step S113, when the control unit 40 determines that the test tank marker D52 (FIG. 14) is included in the image captured by the camera 41 (YES in step S113), the open / close door 51 of the target test tank is open. It is determined that it is in the state, and the processing after step S107 is performed. In step S113, when the control unit 40 determines that the test tank marker D52 (FIG. 14) is not included in the image captured by the camera 41 (NO in step S113), after the sample 7 is placed in the target test tank. It is determined that the door 51 has been closed, and the operation of the test operation support system 100 before the start of the test ends.

(Operation of the test operation support system 100 after the start of the test)
Next, the operation of the test operation support system 100 after the start of the test will be described. FIG. 16 is a flowchart illustrating an example of the operation of the test work support system 100 after the start of the test. FIG. 17 is a diagram illustrating a display example of the test-related information R11. After the operation of the test operation support system 100 before the start of the test described above is completed, as shown in FIG. 16, it is assumed that a test start instruction to start a test is input by an operation of the operation unit 44 by the operator (Step S201). YES).

  For example, in step S201, the control unit 40 displays an input screen R10 of a test start instruction for starting a test by operating the operation unit 44 by the operator, as shown in section (A) of FIG. When the soft key K10 indicating a test start instruction to start (eg, “Yes”) is selected, it is determined that the test start instruction has been input.

  In this case, the control unit 40 controls the communication unit 45 to communicate directly or indirectly (via the server 1) with the target test device, and causes the target test device to start a test (step S1). S202). Then, the control unit 40 displays the test-related information R11 associated with the tester ID of the target tester in the storage unit 14 in the display area of the screen 43, for example, as shown in section (B) of FIG. (Step S203).

  Specifically, in step S203, the control unit 40 is associated with the test device ID in the storage unit 14 together with the test device ID of the target test device T5 included in the sample-related information received from the server 1 in step S102. An instruction (command) requesting transmission of the relevant test-related information R11 is transmitted to the server 1 via the communication unit 45.

  In the server 1, when receiving an instruction requesting transmission of the tester ID and the test-related information R11 received by the communication unit 11, the control unit 10 stores the received tester ID from the storage unit 14 according to the instruction. The associated test-related information R11 is acquired. Then, the control unit 10 returns the acquired test-related information R11 via the communication unit 11. When receiving the test-related information R11 received by the communication unit 45, the control unit 40 displays the received test-related information R11 on the display area of the screen 43.

  The test-related information R11 displayed on the screen 43 includes, for example, as shown in section (B) of FIG. 17, the respective placement areas of all the samples 7 placed in the target test tank (for example, “C )), Each sample No. of all the samples 7 (eg, “358D-445875269”), the remaining time (eg, “186: 54”) and the remaining cycle of each test of all the samples 7 (eg, “ "502").

  The control unit 10 acquires each piece of information included in the test-related information R11 as follows. The control unit 10 refers to the test progress information associated with the test information including the tester ID (eg, “111”) received by the communication unit 11 in the test progress table (FIG. 7), and performs the reference. Of the test progress information obtained, the test progress information for which the end date and time is not stored is acquired as the target test progress information (test progress information associated with the identifier of the target tester in the storage unit).

  Then, the control unit 10 refers to the test information associated with the acquired target test progress information and obtains the sample ID (eg, “476K-5777939433”, “125T-24587357”) included in the referenced test information. , “358D-445587269” and “125S-44578381”) are acquired as the sample numbers included in the test-related information R11.

  Then, in the sample arrangement table (FIG. 8), the control unit 10 obtains the sample IDs (for example, “476K-5777439433”, “125T-24587357”, and “358D-4457875269”) acquired as the sample numbers included in the test related information R11. , "125S-44578331"). Then, the control unit 10 acquires the placement area (eg, “D”, “A”, “C”, “B”) included in the referenced placement-related information as the placement area included in the test-related information R11. I do.

  Further, the control unit 10 acquires the remaining time and the remaining cycle included in the target test progress information as the remaining time and the remaining cycle included in the test-related information R11.

  The test-related information R11 displayed on the screen 43 is not limited to the information illustrated in the section (B) of FIG. 17 and may further include other information included in the target test progress information. Some information may be omitted.

  After the execution of step S203, the control unit 10 updates the target test progress information to the latest information regularly or irregularly (step S204). For example, the target tester T5 periodically or irregularly changes the tester ID of the target tester T5, the time elapsed since the start of the operation, and the environment in the target test tank after the start of the operation. The number of times the test has been performed and an instruction for requesting an update of the target test progress information are transmitted to the server 1.

  In the server 1, it is assumed that the control unit 10 receives an instruction requesting updating of the tester ID, the elapsed time, the number of times, and the target test progress information received by the communication unit 11. In this case, for example, the control unit 10 subtracts, from the elapsed time and the number of times received this time, the elapsed time and the number of times previously received together with the same tester ID as the received tester ID, respectively. Then, the control unit 10 sets the end date and time of the test progress information associated with the received test information including the tester ID in the test progress table (FIG. 7). Is subtracted from the remaining time and the remaining cycle included in the target test progress information that is not stored, thereby updating the test progress information to the latest information.

  When the result of the subtraction is a negative value, the control unit 10 updates the remaining time and the remaining cycle included in the target test progress information to 0, and updates the end date and time included in the target test progress information. And the status, information indicating the current date and time and the end of the test are stored.

  According to the above configuration, after the execution of the test on the sample 7 by the target tester, the progress of the test on each of all the samples 7 arranged in the target test tank is displayed in the display area of the screen 43. . For this reason, the operator can easily grasp the progress of the test on each of all the samples 7 arranged in the target test tank.

  After the execution of step S203, the control unit 10 periodically or irregularly updates the operation information associated with the test device ID of the target test device in the storage unit 14 to the latest information (step S205). ).

  Specifically, the target test device T5 periodically or irregularly transmits the test device ID of the target test device T5, information corresponding to the operation information, and an instruction to update the operation information to the latest information. Send to server 1. The information corresponding to the operation information includes the operation state, the operation pattern ID, the operation pattern name, the alarm, the information, the cycle, the high temperature bath temperature, and the test area included in the operation information stored in the tester monitor table (FIG. 9). This is information including the temperature and the low temperature bath temperature.

  In the server 1, each time the control unit 10 receives the tester ID, the information corresponding to the operation information, and the instruction to update the operation information to the latest information received by the communication unit 11, the tester monitor table (FIG. 9) In, the operation information associated with the received test device ID is updated with the information corresponding to the received operation information.

  After execution of step S205, the control unit 40 determines whether or not the tester marker D5 indicating the tester ID of the target tester is included in the captured image of the camera 41 as in step S103 (step S206). .

  FIG. 18 is a diagram illustrating a display example of the operation-related information R13, the test-related information R11, and the tester-related information R14. For example, as shown in section (A) of FIG. 18, after the operator starts the test of the target tester T5 in step S202, the operator turns to the direction in which the tester marker D5 is attached, and as a result, the camera 41 It is assumed that the captured image includes a tester marker D5 indicating the tester ID of the target tester T5. In this case, the control unit 40 determines that the tester marker D5 indicating the tester ID of the target tester T5 is included in the image captured by the camera 41 in Step S206 (YES in Step S206).

  In this case, the control unit 40 stores the driving-related information R13 associated with the tester ID of the target tester in the storage unit 14 in the display area of the screen 43, for example, as shown in section (B) of FIG. It is displayed (step S207).

  Specifically, in step S207, the control unit 40 stores the relevant tester ID in the storage unit 14 together with the tester ID of the target tester T5 corresponding to the tester marker D5 determined to be included in the image captured by the camera 41. An instruction to request transmission of the driving-related information R13 associated with the tester ID is transmitted to the server 1 via the communication unit 45.

  In the server 1, when receiving the instruction to request the transmission of the tester ID and the operation-related information R13 received by the communication unit 11, the control unit 10 sends the received tester ID from the storage unit 14 according to the instruction. The associated driving-related information R13 is acquired. Then, the control unit 10 returns the obtained driving-related information R13 via the communication unit 11. When receiving the driving-related information R13 received by the communication unit 45, the control unit 40 displays the received driving-related information R13 in the display area of the screen 43.

  The operation-related information R13 displayed on the screen 43 includes, for example, as shown in section (B) of FIG. 18, the name of the target tester (for example, “Cold and thermal shock device C-11”), the operation of the target tester. Pattern (eg, “test pattern 1”), operating state of target tester (eg, “stopped”), cycle information (eg, “456/1000 times”), number of alarms reported in target tester (Eg, “0”) and the number of information items (eg, “4”) reported in the target tester.

  Further, the operation-related information R13 displayed on the screen 43 includes, for example, information on a set value of the temperature in the high-temperature chamber used for adjusting the environment in the target test chamber as shown in section (B) of FIG. (Eg, “+ 175 ° C.”, “manual”) and measured values (eg, “+ 175 ° C.”). In addition, the operation-related information R13 includes information on a set value of the temperature of the test area indicating the temperature in the target test chamber (eg, high temperature exposure “+ 150 ° C. 0:30”, normal temperature exposure “0:05”), low temperature exposure. Exposure “−65 ° C. 0:30”) and measured values (eg, “+ 44 ° C.”) are included.

  The control unit 10 acquires each piece of information included in the driving-related information R13 as follows. In the tester table (FIG. 3), the controller 10 sets the tester name associated with the tester ID of the target tester received by the communication unit 11 with the tester name of the target tester included in the operation-related information R13. Get as name.

  In the tester monitor table (FIG. 9), the control unit 10 includes, among the operation information associated with the tester ID of the target tester received by the communication unit 11, the operation pattern name, the operation state, the alarm information, Information information, cycle information, high-temperature bath temperature information, test area temperature and low-temperature bath temperature information are stored in the operation-related information R13, including the operation pattern, operation state, number of alarms, number of information, cycle information, and high-temperature bath temperature. It is acquired as a measured value, a measured value of the temperature of the test area, and a measured value of the temperature of the low temperature bath.

  Further, the control unit 10 sets the setting included in the test pattern information associated with the tester ID (eg, “111”) of the target tester received by the communication unit 11 in the test pattern table (FIG. 5). Browse the contents. Then, the control unit 10 includes information on the set value of the temperature in the high-temperature bath (eg, “high-temperature bath (175 ° C., manual)”) included in the referred setting content, and information on the set value of the temperature in the test area. (Example: “High temperature exposure (150 ° C., 0:30), normal temperature exposure (0:05), low temperature exposure (−65 ° C., 0:30)”), and information on the set value of the temperature in the low temperature bath (Example) : “Low temperature bath (−75 ° C., manual)”) is acquired as information on the set values of the high temperature bath temperature, the test area temperature, and the low temperature bath temperature included in the operation-related information R13.

  According to the above configuration, after the start of the test on the sample 7 arranged in the target test tank, when the tester marker D5 indicating the tester ID of the target tester is included in the captured image of the camera 41, Operation information indicating the operation state of the target tester is displayed in the display area of the screen 43. Therefore, the operator can easily grasp the operating state of the target tester.

  After the execution of step S207, the control unit 40 tests the test-related information associated with the tester ID of the target tester in the storage unit 14 as in step S203, for example, as shown in section (B) of FIG. R11 is displayed in the display area of the screen 43 (step S208).

  Also, the control unit 40 displays the tester related information R14 associated with the tester ID of the target tester in the storage unit 14 in the display area of the screen 43, for example, as shown in section (B) of FIG. (Step S209).

  Specifically, in step S209, the control unit 40 stores the relevant tester ID in the storage unit 14 together with the tester ID of the target tester T5 corresponding to the tester marker D5 determined to be included in the image captured by the camera 41. An instruction requesting transmission of the tester related information R14 associated with the tester ID is transmitted to the server 1 via the communication unit 45.

  In the server 1, when receiving the instruction to request the transmission of the tester ID and the tester-related information R14 received by the communication unit 11, the control unit 10 reads the received tester ID from the storage unit 14 according to the instruction. To obtain the tester related information R14 associated with. Then, the control unit 10 returns the acquired tester related information R14 via the communication unit 11. When receiving the tester-related information R14 received by the communication unit 45, the control unit 40 displays the received tester-related information R14 on the display area of the screen 43.

  The tester-related information R14 displayed on the screen 43 includes, for example, an in-tank layout of the target test tank as shown in section (B) of FIG. Specifically, the control unit 10 converts the image data of the in-tank layout map associated with the test device ID of the target test device received by the communication unit 11 into the test device table (FIG. 3). It is acquired as image data of the in-tank layout of the target test tank included in the related information R14.

  FIG. 19 is a diagram illustrating a display example of the test information of the selected test. After the execution of step S209, as shown in section (A) of FIG. 19, the operator operates the operation unit 44 to select, for example, the test-related information R11 displayed in the display area of the screen 43 in step S208. An operation of selecting information (eg, arrangement area “C”, sample No. “358D-4458575269”, remaining time “46:54”, remaining cycle “112”) corresponding to one sample 7 indicated by the cursor CUR is performed. It is assumed that the operation has been performed (YES in step S210).

  In this case, as shown in the section (B) of FIG. 19, the control unit 40 stores the selected information included in the test information (FIG. 7) associated with the tester ID of the target tester in the storage unit 14. The detailed test information R15 including the information corresponding to one sample 7 is displayed on the display area of the screen 43 (step S211).

  Specifically, in step S211, the control unit 40 selects the tester ID of the target tester T5 corresponding to the tester marker D5 determined to be included in the image captured by the camera 41, and selects the tester in step S210. The sample ID of the one sample 7 indicated by the sample No. included in the information corresponding to the one sample 7 is transmitted to the server 1 via the communication unit 45. Further, the control unit 40 stores the detailed test information R15 including the information corresponding to the transmitted sample ID included in the test information (FIG. 7) associated with the transmitted tester ID in the storage unit 14. An instruction to request transmission is transmitted to the server 1 via the communication unit 45.

  In the server 1, upon receiving the instruction for requesting the transmission of the tester ID, the sample ID, and the detailed test information R <b> 15 received by the communication unit 11, the control unit 10 stores the received test in the storage unit 14 according to the instruction. The test information associated with the device ID is obtained. Then, the control unit 10 includes information corresponding to the received sample ID included in the acquired test information, and information associated with the received test device ID and sample ID in the storage unit 14. The detailed test information R15 is returned via the communication unit 11. When receiving the detailed test information R15 received by the communication unit 45, the control unit 40 displays the received detailed test information R15 on the display area of the screen 43.

  The detailed test information R15 displayed on the screen 43 includes, for example, as shown in section (B) of FIG. 19, an image of the one sample 7 and a start time of the test for the one sample 7 (for example, “2018”). -05-30 13:00 ”), the test time of the test for the one sample 7 (eg, 76:45), and the scheduled end time of the test for the one sample 7 (eg,“ 2018-06-02 17: 45 ”, the pattern name of the test condition of the test on the one sample 7 (eg,“ test pattern 1 ”), and the requester of the test on the one sample 7 (eg,“ Foundation Development Department ○ Δ ○ ”) included.

  The control unit 10 acquires each piece of information included in the detailed test information R15 as follows. The control unit 10 transmits the image data of the sample 7 included in the sample information associated with the sample ID (eg, “358D-4458575269”) received by the communication unit 11 in the sample table (FIG. 6). A sample registrant (for example, “Foundation Development Department ○ Δ △”) is acquired as the image data of the image of the one sample 7 included in the detailed test information R15 and the client of the test for the one sample 7.

  The control unit 10 is associated with the test information including the tester ID (eg, “111”) and the sample ID (eg, “358D-4458875269”) received by the communication unit 11 in the test table (FIG. 7). The start date and time (for example, “2018-05-30 13:00”) included in the test progress information in which the end date and time are not stored in the test progress information of the one sample 7 included in the detailed test information R15. Obtained as the start time of the test for.

  In the test table (FIG. 7), the control unit 10 associates the test information including the tester ID (eg, “111”) received by the communication unit 11 with the test progress information in which the end date and time are not stored. Referenced test information is referred to as candidate test information. Then, the control unit 10 refers to, as the target test information, the test information including the sample ID (for example, “358D-445875269”) received by the communication unit 11 among the referenced candidate test information. Then, the control unit 10 acquires the scheduled end date and time (for example, “2018-06-02 17:45”) and the test pattern ID (for example, “12”) included in the referenced target test information. The control unit 10 sets the acquired scheduled end date and time as the scheduled end time of the test on the one sample 7 included in the detailed test information R15.

  In addition, the control unit 10 determines, in the test pattern table (FIG. 5), among the test pattern information associated with the tester ID (eg, “111”) received by the communication unit 11, the acquired test pattern Reference is made to test pattern information including an ID (eg, “12”). Then, the control unit 10 acquires a test pattern name (eg, “test pattern 1”) included in the referred test pattern information as a pattern name of a test condition included in the detailed test information R15. Further, the control unit 10 refers to the setting content included in the referenced test pattern information, and includes the test time (eg, “76:45”) included in the referenced setting content in the detailed test information R15. Obtain as test time.

  According to the above configuration, the operator individually obtains information on the test on each sample by performing an operation of selecting information on each sample from the test-related information R11 displayed on the display area of the screen 43. can do.

  FIG. 20 is a flowchart illustrating an example of the operation of the test operation support system 100 at the end of the test. If it is determined in step S206 that the tester marker D5 indicating the tester ID of the target tester is not included in the image captured by the camera 41 (NO in step S206), the process proceeds to step S210. When the operation for selecting the information corresponding to one sample 7 is not performed (NO in step S210), and when step S211 is performed, as illustrated in FIG. It is determined whether or not all tests have been completed (step S300).

  More specifically, in step S300, the control unit 40 determines all of the target testers T5 along with the tester ID of the target tester T5 corresponding to the tester marker D5 determined to be included in the image captured by the camera 41. Is transmitted to the server 1 via the communication unit 45.

  In response to this, it is assumed that, in the server 1, the control unit 10 receives the tester ID received by the communication unit 11 and an instruction requesting determination of whether or not all tests on the target tester have been completed. In this case, in the test progress table (FIG. 7), among the test progress information associated with the received test information including the tester ID, the control unit 10 sets the test progress information or the test progress information for which the end date and time are not stored. It is determined whether or not the test progress information indicating that the status is under test is included. As a result of the determination, the control unit 10 determines that all tests are completed in the target tester when it is determined that the test is not included, and ends in the target tester when it is determined that the test is included. It is determined that there is a test that has not been performed.

  Then, the control unit 10 returns the above determination result via the communication unit 11. The control unit 40 receives the above determination result received by the communication unit 45. When the received determination result indicates that there is a test that has not been completed in the target tester, the control unit 40 determines that there is a test that has not been completed in the target tester (NO in step S300). After that, the processing after step S204 is performed. On the other hand, if the received determination result indicates that all tests have been completed in the target tester, the control unit 40 determines that all tests have been completed in the target tester (step (YES in S300).

  In this case (YES in step S300), the control unit 40 displays a message (eg, “Please take out the sample because the test is completed”) for guiding the sample 7 to be taken out of the target test tank on the display area of the screen 43. (Step S301).

  Next, as in step S105 (FIG. 11), the control unit 40 executes a known image recognition process, so that the test tank marker D52 (see FIG. 14) indicating the test tank ID of the target test tank is moved to the camera 41. It is determined whether or not the image is included in the photographed image (step S302).

  When the control unit 40 determines in step S302 that the test tank marker D52 indicating the test tank ID of the target test tank is included in the image captured by the camera 41 (YES in step S302), the open / close door 51 is opened. As a result, it is determined whether or not the sample 7 is present in the target test tank by executing a known image recognition process (step S303). Thereby, the control unit 40 determines whether or not all the samples 7 placed in the target test tank have been taken out.

  On the other hand, when the control unit 40 determines in step S302 that the test tank marker D52 indicating the test tank ID of the target test tank is not included in the image captured by the camera 41 (NO in step S302), the opening / closing door 51 is opened. Assuming that it is in the closed state, the processing after step S301 is performed.

  When determining that the sample 7 does not exist in the target test tank in step S303 (YES in step S303), the control unit 40 executes a known image recognition process in the same manner as in step S302, so that the control of the target test tank is performed. It is determined whether or not the test tank marker D52 indicating the test tank ID (see FIG. 14) is included in the image captured by the camera 41 (step S304). On the other hand, when it is determined in step S303 that the sample 7 exists in the target test tank (NO in step S303), the control unit 40 performs the processing of step S302 and subsequent steps.

  If the control unit 40 determines in step S304 that the test tank marker D52 is not included in the image captured by the camera 41 (NO in step S304), the control unit 40 opens and closes after removing all the samples 7 from the target test tank. The process ends assuming that the door 51 is closed. On the other hand, when it is determined in step S304 that the test tank marker D52 is included in the image captured by the camera 41 (YES in step S304), the control unit 40 keeps the door 51 open. Then, the processing after step S303 is performed.

(Modified embodiment)
Note that the above embodiment is merely an example of an embodiment according to the present invention, and is not intended to limit the present invention to the above embodiment. For example, a modified embodiment described below may be used.

  (1) In the test operation support system 100 of the above embodiment, the removal of the sample 7 is guided after the completion of the test on all the samples 7 in the target test tank. However, as described below, even if not all tests have been completed in the target tester, the test operation support system 100 may be configured to guide the removal of the sample 7 from the sample 7 that has completed the test. Good.

  FIG. 21 is a flowchart illustrating a modified example of the operation of the test work support system 100 at the end of the test. Specifically, when it is determined in step S206 (FIG. 16) that the tester marker D5 indicating the tester ID of the target tester is not included in the image captured by the camera 41 (NO in step S206), step S210 is performed. When the operation of selecting information corresponding to one sample 7 from the test-related information R11 is not performed (NO in step S210), and when step S211 is performed, the control unit 40 The processing after step S400 shown in FIG. 21 may be performed.

  As shown in FIG. 21, in step S400, the control unit 40 determines whether or not there is a test that has been completed in the target tester (step S400). Specifically, in step S400, the control unit 40 terminates the processing in the target tester together with the tester ID of the target tester T5 corresponding to the tester marker D5 determined to be included in the image captured by the camera 41. An instruction requesting determination of whether there is a test being performed (hereinafter, a determination request instruction) is transmitted to the server 1 via the communication unit 45.

  In the server 1, it is assumed that the control unit 10 has received the tester ID and the determination request instruction received by the communication unit 11. In this case, the control unit 10 stores the end date and time of the test progress information associated with the received test information including the tester ID in the test progress table (FIG. 7), and the status indicates that the test has been completed. It is determined whether or not the indicated test progress information (hereinafter referred to as end test information) is included.

  When determining that the end test information is included, the control unit 10 acquires a sample ID included in the test information associated with the end test information in the test progress table (FIG. 7). The control unit 10 acquires the sample information associated with the acquired sample ID in the sample table (FIG. 6), and associates the sample information with the acquired sample ID in the sample arrangement table (FIG. 8). Get related placement information. Further, the control unit 10 acquires, in the tester table (FIG. 3), the tester information associated with the tester ID received by the communication unit 11.

  Then, the control unit 10 returns a determination result indicating that there is a test that has been completed in the target test device via the communication unit 11 together with the obtained sample ID, sample information, arrangement-related information, and test device information. I do.

  When the determination result received via the communication unit 45 indicates that there is no test that has been completed in the target tester, the control unit 40 determines that there is no test that has been completed in the target tester (step S400). NO). In this case, the processing after step S204 (FIG. 16) is performed.

  On the other hand, when the determination result received via the communication unit 45 indicates that there is a test that has been completed in the target test device, the control unit 40 determines that there is a test that has been completed in the target test device ( (YES in step S400). In this case, the control unit 40 removes the target sample from the target test tank on the assumption that the test on the sample 7 (hereinafter, the target sample) corresponding to the sample ID received together with the determination result via the communication unit 45 has been completed. Is displayed in the display area of the screen 43 (step S401).

  The information displayed in step S401 includes, for example, at least the sample ID or the sample name (FIG. 6) of the sample ID and the sample information received by the control unit 40 in step S400 together with the above determination result. Therefore, the operator can grasp which sample 7 can be taken out of the target test tank based on the sample ID or the sample name included in the message displayed in step S401.

  The information displayed in step S401 includes the placement area and the inside of the tank indicated by the image data of the in-tank layout diagram, which are included in the placement-related information and the tester information received by the control unit 40 together with the above determination result in step S400. A layout drawing may be included. In this case, the operator can appropriately take out the target sample placed in the region indicated by the placement area in the target test tank based on the displayed placement area and the in-tank placement drawing.

  Next, as in step S302 (FIG. 20), the control unit 40 executes a known image recognition process, so that the test tank marker D52 (see FIG. 14) indicating the test tank ID of the target test tank is moved to the camera 41. It is determined whether or not the image is included in the photographed image (step S402).

  When the control unit 40 determines in step S402 that the test tank marker D52 indicating the test tank ID of the target test tank is included in the image captured by the camera 41 (YES in step S402), the operator removes the sample 7 Assuming that the opening / closing door 51 has been opened for removal, it is determined whether the number of samples 7 in the target test tank has decreased (step S403).

  For example, when the control unit 40 determines that the test tank marker D52 is included in the captured image of the camera 41 in step S402 performed immediately after step S401, the captured image of the camera 41 is set as the initial captured image. Store in memory. After a predetermined time has elapsed after the start of step S403, the control unit 40 stores the image captured by the camera 41 in the memory as the target captured image. Then, the control unit 40 determines whether the number of the samples 7 recognized from the target captured image is smaller than the number of the samples 7 recognized from the initial captured image by executing a known image recognition process.

  If the control unit 40 determines that the number of the samples 7 recognized from the target captured image is not less than the number of the samples 7 recognized from the initial captured image, the controller 40 determines that the number of the samples 7 in the target test tank has not decreased. A determination is made (NO in step S403). In this case, processing after step S402 is performed. On the other hand, when the control unit 40 determines that the number of the samples 7 recognized from the target captured image is smaller than the number of the samples 7 recognized from the initial captured image, the number of the samples 7 in the target test tank decreases. Is determined to be present (YES in step S403).

  In this case (YES in step S403), the control unit 40 determines whether or not the sample 7 taken out of the target sample tank is the target sample for which the test has been completed (step S404). For example, in step S404, the control unit 40 executes a known image recognition process, and among the samples 7 recognized from the initial captured image in step S403, the sample 7 different from the sample 7 recognized from the target captured image is obtained. The region arranged in the initial photographed image is grasped as the region where the sample 7 taken out from the target test tank was placed (hereinafter, the taken-out sample placement region).

  The control unit 40 performs a known image recognition process, compares the initial captured image with the in-tank layout indicated by the image data included in the tester information received in step S400, and Among the included placement areas, the placement area corresponding to the removal sample placement area is grasped as the placement area of the sample 7 removed from the target test tank.

  When the grasped placement area does not match the placement area included in the placement-related information received in step S400, the control unit 40 determines that the sample 7 removed from the target test tank is not a target sample (step S404). NO). In this case, the control unit 40 displays warning information indicating that the wrong sample 7 has been removed in the display area of the screen 43 (step S408). After that, the processes after step S403 are performed. In step S408, the control unit 40 may further cause the speaker 46 to output a predetermined warning sound indicating that the wrong sample 7 has been removed.

  On the other hand, when the grasped arrangement area matches the arrangement area included in the arrangement-related information received in step S400, the control unit 40 determines that the sample 7 removed from the target sample tank is the target sample. (YES in step S404). In this case, as in step S402, the control unit 40 executes a known image recognition process so that the test tank marker D52 (see FIG. 14) indicating the test tank ID of the target test tank is added to the image captured by the camera 41. It is determined whether or not it is included (step S405).

  If the control unit 40 determines in step S405 that the test tank marker D52 is included in the image captured by the camera 41 (YES in step S405), the control unit 40 determines that the open / close door 51 remains open. The processing after step S403 is performed. On the other hand, if the control unit 40 determines in step S405 that the test tank marker D52 is not included in the image captured by the camera 41 (NO in step S405), the control unit 40 opens and closes the test sample after removing it from the target test tank. It is determined that the door 51 has been closed. In this case, the control unit 40 determines whether or not all the tests have been completed in the target tester, as in step S300 (FIG. 20) (step S406).

  When determining in step S406 that all tests have been completed in the target tester (YES in step S406), the control unit 40 determines whether all the samples 7 have been removed from the target test tank (step S406). Step S407). Specifically, in step S407, the control unit 40 performs a known image recognition process to recognize that the target captured image stored in the memory in step S403 does not include any sample 7, If it is determined that all of the samples 7 have been removed from the target test tank, and it is recognized that one or more samples 7 are included in the target captured image, it is determined that there is a sample 7 that has not been removed in the target test tank. I do.

  In step S407, when the control unit 40 determines that all the samples 7 have been taken out of the target test tank (YES in step S407), all the tests are completed in the target tester, and Assuming that the sample 7 has been taken out, the processing is terminated.

  On the other hand, when it is determined in step S406 that there is a test that has not been completed in the target tester (NO in step S406), control unit 40 determines that sample 7 that has not been removed exists in the target test tank in step S407. If so (NO in step S407), the process proceeds to step S204 (FIG. 16). Thus, the processing is continued until all tests are completed in the target tester and all the samples 7 in the target test tank are taken out.

  Note that a configuration may be adopted in which a new test target sample 7 is placed in a test tank while the test-completed sample 7 is taken out. For example, when the processing after step S204 is being executed, the above-described information corresponding to the test on the new sample 7 to be tested is added to the storage unit 14, and then the operator looks at the new sample 7. It is assumed that the sample marker D7 indicating the identification ID of the new sample 7 is included in the image captured by the camera 41 due to the pointing. In this case, the processing being executed among the processing after step S204 may be interrupted, and the processing after step S102 (FIG. 11) may be performed.

  (2) Instead of the smart glasses 4, a camera 41, a microphone 42, a screen 43, a speaker 46, an operation unit 44, a communication unit 45, and a display device such as a liquid crystal display, a speaker, and an operation similar to those of the control unit 40. For example, a mobile terminal device such as a smartphone or a tablet terminal that includes a unit, a communication unit, and a control unit may be used. In this case, the control unit of the portable terminal device may display the image captured by the camera as a background image in the display area of the display device.

  In this case, in step S106 (FIG. 11), the area indicated by the arrangement area included in the background image displayed on the display device of the portable terminal device is displayed in an emphasized manner. For this reason, even if the worker has little experience in arranging the sample 7 in the test tank, the operator can move the sample 7 to the area indicated by the arrangement area in the target test tank based on the area highlighted on the display device. The sample 7 can be easily arranged.

  (3) After step S108 (FIG. 11), a period until the support end instruction to end the support of the work related to the placement of the sample 7 is input by the operation of the operation unit 44 by the operator (NO in step S112) For example, communication may be performed by a character string between the smart glass 4 and the information processing apparatus 3 such as a chat. Specifically, the control unit 40 and the control unit 30 convert the character string input using the operation unit 44 of the smart glass 4 and the character string input using the operation unit 34 of the information processing device 3 into the server 1. May be transmitted to and received from each other, and the received character string may be displayed on the screen 43 and the display 33.

  (4) In step S105 (FIG. 11), the control unit 40 determines whether or not the test tank marker D52 indicating the test tank ID of the target test tank is included in the captured image of the camera 41, It may be determined whether or not the opening and closing door 51 is in an open state, and when it is determined that the opening and closing door 51 is in an open state, step S106 may be performed.

  Specifically, the control unit 40 may determine that the door 51 is open when information indicating that the door 51 is open using the operation unit 44 is input. Good. Alternatively, the control unit 40 performs a known image recognition process when the image captured by the camera 41 and the opening / closing door 51 stored in advance in a memory or the like of a microcomputer configuring the control unit 40 are closed. It may be determined whether or not the opening and closing door 51 is in an open state based on a result of comparing the image obtained by photographing the opening and closing door 51 with the camera 41.

  Alternatively, when the target tester is provided with an open / close sensor that detects the open / closed state of the open / close door 51, the communication unit 45 may be configured to be able to communicate with the target tester via the server 1 or directly. . Then, the control unit 40 controls the communication unit 45 to perform communication with the target test device, thereby acquiring a detection result of the open / close state of the opening / closing door 51 by the open / close sensor from the target test device, and performing the detection. The above determination may be made based on the result.

  Similarly, also in step S302 and step S304 (FIG. 20), the control unit 40 determines whether or not the test tank marker D52 indicating the test tank ID of the target test tank is included in the image captured by the camera 41. Instead of the determination, it may be determined whether or not the open / close door 51 is open.

  (5) Steps S210 and S211 (FIG. 16) may be omitted. Further, steps S205 and S207 (FIG. 16) may be omitted. Further, the configuration may be such that the test operation support system 100 does not perform the operation shown in FIG.

  (6) Steps S110 and S111 (FIG. 11) may be omitted. Further, steps S107 to S112 (FIG. 11), microphones 32 and 42, and speakers 36 and 46 may be omitted. Further, steps S105 and S106 (FIG. 11) may be omitted.

  Further, when the test operation supporting system 100 includes one tester 5, steps S103 and S104 (FIG. 11) are further omitted, and in step S102 (FIG. 11), the control unit 10 includes Only the placement area acquired from the placement related information stored in the sample placement table (FIG. 8) may be included. Then, in step S102, the control unit 40 may include only the arrangement area included in the sample-related information in the part R7 of the sample-related information. In this case, even if the operator has little experience with the test, the operator can determine the predetermined area in the test tank of the target tester based on the arrangement area included in the part R7 of the sample-related information displayed on the display area of the screen 43. The sample can be appropriately arranged in the region of.

  (7) The test work support system 100 may be configured not to include the server 1. Then, the control unit 30 of the information processing device 3 may be configured to acquire a captured image of the camera 41 included in the smart glass 4 via the communication unit 35. Then, for example, the same information as the storage unit 14 may be stored in a storage unit provided in the information processing device 3, such as a memory of a microcomputer constituting the control unit 30. Then, the communication unit 35 and the control unit 30 may be configured to function similarly to the communication unit 11 and the control unit 40 of the server 1.

  With this, when the sample marker D7 indicating the identifier of the sample 7 is included in the image captured by the camera 41, the control unit 30 sets the sample of the sample 7 stored in the storage unit provided in the information processing device 3. In the information in which the ID and the placement-related information related to the placement of the sample 7 in the target test tank provided in the target tester that performs the test on the sample 7, the ID is associated with the sample ID indicated by the sample marker D7. The arrangement-related information may be displayed in a display area of the screen 43.

  In this case, when the worker uses the smart glass 4 and the sample marker D7 indicating the sample ID of the sample 7 is included in the captured image of the camera 41, the display on the screen 43 provided in the smart glass 4 is performed. In the area, arrangement related information regarding the arrangement of the sample D7 in the test tank is displayed. For this reason, the worker can appropriately arrange the sample 7 in the test tank based on the arrangement-related information, even if the operator has little experience in the test.

1 server 3 information processing device 4 smart glass (mobile terminal)
5 Tester 7 Sample 10 Control unit (test control unit)
11 communication unit 14 storage unit 30 control unit 32 microphone 33 display (remote display unit)
34 Operation unit (remote operation unit)
35 Communication unit (remote communication unit)
36 speaker 40 control unit (test control unit)
41 Camera 42 Microphone 43 Screen (Display)
44 Operation unit 45 Communication unit 46 Speaker 51 Opening / closing door 100 Test work support system D30 Drawing image D5 Test equipment marker (Test equipment identification information)
D52 Test tank marker (test tank identification information)
D7 Sample marker (sample identification information)
R5 Tester information R7 Sample related information R11 Test related information R13 Operation related information R14 Tester related information R15 Detailed test information T5 Target tester

Claims (14)

A test operation support system that includes a test tank in which a sample can be arranged, and adjusts an environment in the test tank according to predetermined test conditions to support an operation on a test device that performs a test on the sample.
The sample is handled in a state where sample identification information indicating its own identifier is added,
A mobile terminal having a camera and a display unit,
A storage unit that stores in advance the identifier of the sample and the placement-related information relating to the placement of the sample in the target test tank that is the test tank that is the target test device that is the test device that performs a test on the sample,
When the sample identification information is included in the captured image of the camera, the arrangement related information associated with the identifier of the sample indicated by the sample identification information in the storage unit, in the display area of the display unit. A test control unit to display;
A test work support system comprising: Supporting work on one or more of the testers,
The test work support system according to claim 1, wherein the placement-related information includes identification information for identifying the target test device, and placement region information indicating a region where the sample is placed in the target test tank. . The tester is to be handled in a state where tester identification information indicating its own identifier is added to an outer surface,
The storage unit further stores an identifier of the test device and test device information related to the test device in association with each other in advance,
The test control unit, when the tester identification information indicating the identifier of the target tester is included in the captured image, the display area corresponding to the area where the target tester is arranged in the captured image 3. The test operation support system according to claim 2, wherein the tester information associated with the identifier of the target tester is displayed in the storage unit so as to correspond to an area in the tester. In the state where the test chamber identification information indicating the identifier of the test tank is added to a position visible when the open / close door of the test tank is opened, the test device is handled,
The test control unit, when the test tank identification information indicating the identifier of the target test tank is included in the captured image, the area indicated by the arrangement area information corresponds to the area arranged in the captured image The test operation support system according to claim 2, wherein an area in the display area is highlighted and displayed. The test operation support system according to claim 4, wherein the test control unit further displays the captured image as a background image in the display area. The test work support system according to any one of claims 1 to 5, wherein the placement-related information includes placement direction information indicating a direction in which the sample faces when the sample is placed in the target test tank. The test work support system according to claim 1, wherein the placement-related information includes placement method information indicating a method of placing the sample. The test work support system according to any one of claims 1 to 7, wherein the arrangement-related information includes instrument attachment information indicating a method of attaching an instrument necessary for the test to the sample. A remote microphone that collects voice, a remote display unit that displays an image, and a remote communication unit that communicates with the mobile terminal, further comprising an information processing apparatus,
The portable terminal communicates between the microphone for collecting sound, an operation unit for performing an input operation of a support request instruction for requesting support for work related to the placement of the sample, and the information processing device. And a communication unit for performing
The test control unit, when the support request instruction is input by the operation unit, causes the captured image of the camera to be displayed on the remote display unit, and the communication unit and the remote communication unit to use the microphone and the remote microphone. The test work support system according to any one of claims 1 to 8, wherein the collected sounds are communicated with each other. The information processing apparatus further includes a remote operation unit for performing a drawing operation on the captured image displayed on the remote display unit,
The test operation according to claim 9, wherein, when the drawing operation is performed by the remote operation unit, the test control unit displays a drawn image drawn on the captured image by the drawing operation in the display area. Support system. The mobile terminal further includes an operation unit for performing an input operation of the test start instruction,
The storage unit can further store an identifier of the target test device and test progress information indicating a progress status of the test for each of all the samples arranged in the test tank of the target test device in association with each other. And
The test control unit, after the sample is placed in the target test tank, when the input operation of the start instruction is performed using the operation unit, after starting the test in the target test device after the The test operation support system according to any one of claims 1 to 10, wherein the test progress information associated with the identifier of the target test device in the storage unit is displayed in the display area. The storage unit can further store an identifier of the target test device and operation information indicating an operation state of the target test device in association with each other,
The test control unit,
After the start of the test on the sample placed in the target test tank, if tester identification information indicating the identifier of the target tester is included in the captured image, the identifier of the target tester is stored in the storage unit. The test operation support system according to any one of claims 1 to 11, wherein the driving information associated with the test information is displayed in the display area. The storage unit further stores an identifier of the target tester and test information relating to a test executable in the target tester in association with each other in advance,
The operation unit is further capable of performing an operation of selecting information corresponding to one sample from the test progress information displayed in the display area,
The test control unit,
When the selection operation is performed using the operation unit, the information corresponding to the one sample included in the test information associated with the identifier of the target tester in the storage unit is displayed in the display area. The test operation support system according to claim 11, wherein the test operation support system displays the test work support information. A computer is provided as a data processing device that includes a test chamber in which a sample can be arranged, and adjusts an environment in the test chamber according to predetermined test conditions to support a test device that performs a test on the sample. A program,
Said computer,
When the sample identification information indicating the identifier of the sample is included in the captured image of the camera, the identifier of the sample and arrangement related information regarding the arrangement of the sample in the test tank provided in the test device that performs a test on the sample, A program that causes the arrangement-related information associated with the identifier of the sample indicated by the sample identification information to be displayed in a display area of a display unit in the information in which the information is previously associated.