CN110873690B

CN110873690B - Test work assistance system and recording medium

Info

Publication number: CN110873690B
Application number: CN201910806481.8A
Authority: CN
Inventors: 胜川洋介; 清水洋志; 吉田记大
Original assignee: Espec Corp
Current assignee: Espec Corp
Priority date: 2018-09-03
Filing date: 2019-08-28
Publication date: 2022-11-04
Anticipated expiration: 2039-08-28
Also published as: CN110873690A; JP2020038463A; DE102019123444A1; JP6931342B2

Abstract

The invention provides a test work assistance system and a recording medium. A test work assistance system for assisting a test device, which is provided with a test cell in which a sample can be placed, and which performs a test on the sample by adjusting an environment in the test cell in accordance with a predetermined test condition, the test work assistance system operating the sample in a state in which sample identification information indicating an identifier of the test work assistance system is added to the sample, the test work assistance system including: a mobile terminal provided with a camera and a display unit; a storage unit that stores in advance an identifier of a sample and information relating to arrangement of the sample in a test cell in association with each other; and a test control unit that displays, in a display area of the display unit, the arrangement-related information associated with the identifier of the sample indicated by the sample identification information in the storage unit, when the sample identification information is included in the image captured by the camera. Accordingly, the operator with less experience in the test can appropriately arrange the sample in the test chamber.

Description

Test work assistance system and recording medium

Technical Field

The present invention relates to a test work assistance system provided with a tester and a recording medium.

Background

Conventionally, there is known a tester having a test cell capable of accommodating a sample, the tester placing the sample in the test cell and performing a test by adjusting an environment in the test cell according to a predetermined test condition. In recent years, an AR (Augmented Reality) technique has been known in which an image representing a character string or the like is superimposed on an image captured in real space and displayed.

For example, japanese patent laid-open publication No. 2018-82338 describes a technique of displaying, on smart glasses worn by an operator, an operating state of an environment forming apparatus and a state of a sample, which are managed in association with an identifier indicated by an identification image when the image captured by a camera includes the identification image during operation of the environment forming apparatus.

An operator who has not experienced enough work to cause a tester such as the environment forming apparatus to perform a test is allowed to place a sample in a test cell before starting the test. In this case, the operator may place the sample at a position where the sample cannot be appropriately placed in an environment corresponding to the test conditions. As a result, appropriate test results may not be obtained. After the start of the test in the tester, the operator changes the position of the sample in the test cell. In this case, the sample may not be sufficiently placed in an environment corresponding to the test conditions, and appropriate test results may not be obtained. Therefore, in the operation of causing the tester to perform the test, it is required to appropriately dispose the sample in the test cell before starting the test.

However, japanese patent laid-open publication No. 2018-82338 does not disclose a technique of displaying information on the arrangement of the sample on smart glasses before the start of the operation of the environment forming apparatus.

Disclosure of Invention

The present invention has been made in view of the above circumstances, and an object thereof is to provide a test work assistance system and a recording medium that enable an operator with insufficient test experience to appropriately place a sample in a test cell.

A test work assistance system according to an aspect of the present invention assists a test of a tester having a test cell in which a sample can be placed, and performing a test of the sample by adjusting an environment in the test cell according to a predetermined test condition, the test work assistance system performing a test work of the sample in a state in which sample identification information indicating an identifier of the test work assistance system is added to the sample, the test work assistance system including: a mobile terminal provided with a camera and a display unit; a storage unit that stores an identifier of the sample and information on arrangement of the sample in a target test cell provided as a target test device that is the test device for testing the sample, in association with each other in advance; and a test control unit that displays the arrangement-related information corresponding to the identifier of the sample indicated by the sample identification information in the storage unit in a display area of the display unit when the sample identification information is included in the image captured by the camera.

A recording medium according to another aspect of the present invention is a recording medium storing a program that causes a computer to function as an information processing device that assists an operation of a tester that includes a test cell in which a sample can be placed and performs a test on the sample by adjusting an environment in the test cell according to a predetermined test condition, the program causing the computer to function as: when sample identification information indicating an identifier of the sample is included in an image captured by a camera, the arrangement-related information corresponding to the identifier of the sample indicated by the sample identification information is displayed in a display area of a display unit, among information in which the identifier of the sample and arrangement-related information are associated with each other in advance, wherein the arrangement-related information is information on arrangement of the sample in the test cell provided in the tester performing a test on the sample.

According to the test work assistance system and the recording medium, an operator with insufficient test experience can appropriately place a sample in a test cell.

Drawings

Fig. 1 is a diagram showing an example of the overall situation of the test work assistance system.

Fig. 2 is a block diagram showing an example of a detailed configuration of the test work assistance system.

FIG. 3 is a diagram showing an example of a tester table.

Fig. 4 is a diagram showing an example of an in-slot arrangement diagram and an arrangement diagram included in tester information.

Fig. 5 is a diagram showing an example of the test pattern table.

FIG. 6 is a diagram showing an example of a sample table.

Fig. 7 is a diagram showing an example of the test table.

FIG. 8 is a diagram showing an example of a sample arrangement table.

FIG. 9 is a diagram showing an example of the tester monitoring table.

Fig. 10 is a diagram showing an example of a sample monitoring table.

Fig. 11 is a flowchart showing an example of the operation of the test work assistance system before the start of the test.

Fig. 12 is a diagram showing an example of display of sample-related information.

Fig. 13 is a diagram showing an example of display of tester information.

Fig. 14 is a diagram showing an example of highlighting the arrangement region.

Fig. 15 is a diagram showing an example of assistance regarding the operation of disposing a sample.

Fig. 16 is a flowchart showing an example of the operation of the test work assistance system after the start of the test.

Fig. 17 is a diagram showing an example of display of test-related information.

Fig. 18 is a diagram showing examples of display of the operation-related information, the test-related information, and the tester-related information.

Fig. 19 is a diagram showing an example of display of test information of a selected test.

Fig. 20 is a flowchart showing an example of the operation of the test work assistance system at the end of the test.

Fig. 21 is a flowchart showing a modification of the operation of the test work assistance system at the end of the test.

Detailed Description

(first embodiment)

Next, a first embodiment of the test work assistance system according to the present invention will be described. Fig. 1 is a diagram showing an example of the overall situation of the test work assistance system 100. As shown in fig. 1, the test work assistance system 100 includes: smart glasses 4 (mobile terminal); an information processing device 3 disposed in a work room of an office building or the like; and a server 1 communicating with them via a Network 9 such as a LAN (Local Area Network) or the internet. The server 1 is also communicably connected to one or more testers 5 and measuring instruments 6 disposed in one or more test rooms 2 via a network 9.

The tester 5 includes: a test cell in which one or more samples 7 (see fig. 12) can be arranged; and an opening/closing door 51 for opening/closing the test cell. The tester 5 performs a test in which the environment in the test chamber is adjusted according to a predetermined test condition after the sample 7 is placed in the test chamber. For example, the sample 7 includes electric devices such as a smartphone, a control board, electronic components, and the like. The environment in the test chamber includes the temperature, humidity, and pressure of the air in the test chamber, vibration applied to the sample 7 in the test chamber, artificial rain or snow around the sample 7, and the like.

The tester 5 includes a not-shown measuring device that periodically measures the temperature and humidity of the air in the test chamber. After the start of the test, the tester 5 periodically transmits the measurement results of the temperature and humidity of the air in the test chamber measured by the tester to the server 1 via the network 9.

A tester mark (tester identification information) D5 indicating its own identifier is attached to the outer surface of the tester 5 by pasting, printing, or the like. The tester mark D5 is formed of, for example, a barcode, a two-dimensional barcode, a character string of an identifier, or the like. Similarly to the tester 5, the sample 7 disposed in the test chamber is provided with a sample mark (sample identification information) D7 (see fig. 12) indicating its own identifier by pasting, printing, or the like. Similarly to the tester 5, a test chamber mark (test chamber identification information) D52 (see fig. 14) indicating an identifier of the test chamber is attached by pasting, printing, or the like to a position where the open/close door 51 of the test chamber can be seen in a state where it is opened.

The measuring device 6 can be transported to each test room 2. The measuring instrument 6 includes a measuring instrument and the like for measuring the surface temperature of the sample 7 accommodated in the test cell of each tester 5, the current flowing through the sample 7, and the voltage applied to the sample 7.

Specifically, the operator mounts the thermocouple and the signal line to the sample 7 in the test cell. Next, the worker connects the thermocouple and the signal line thus attached to measuring instrument 6 through a hole provided in a wall of the test cell or the like. Then, the operator inputs the identifier of the sample 7 to the measuring device 6. Accordingly, if the measurement is ready, the measuring device 6 starts measurement of the surface temperature of the thermocouple mounting portion of the sample 7 and the current or voltage flowing to the mounting portion of the signal line of the sample 7. The measuring instrument 6 periodically performs the above-described measurement, and transmits each measurement result to the server 1 through the network 9 together with the identifier of the sample 7 to be measured, which is input by the operator.

The smart glasses 4 can be worn on the head of the worker. Fig. 2 is a block diagram showing an example of the detailed configuration of the test work assistance system 100. As shown in fig. 2, the smart glasses 4 include a camera 41, a microphone 42, a screen 43 (display unit), a speaker 46, an operation unit 44, a communication unit 45, and a control unit 40 (test control unit).

The camera 41 takes an image of substantially the same image as the image of the real space viewed by the worker wearing the smart glasses 4, with the same direction as the line of sight of the worker as the shooting direction. The image captured by the camera 41 includes a still image in addition to a moving image. Microphone 42 collects the sound emitted by the operator. The speaker 46 outputs the instructed sound under the control of the control section 40.

The screen 43 is a so-called transmissive screen having a substantially transparent display region capable of displaying an image. The screen 43 displays an image received from the server 1 through the network 9 in the display area. Accordingly, the worker wearing the smart glasses 4 can see an image in which the image displayed in the display area of the screen 43 is superimposed on the image of the real space seen through the display area.

The operation unit 44 includes various operation buttons. The operation buttons include operation buttons for displaying an operation screen and a soft keyboard on the screen 43. The operation buttons include an operation button for moving a cursor (pointer) displayed on the screen 43, an operation button for pressing each soft key in an operation screen indicated by the cursor, and the like. The operation unit 44 outputs instructions corresponding to the operations performed by the operation buttons and information input by the operation buttons to the control unit 40.

The communication unit 45 is formed of a communication interface circuit for the smart glasses 4 to communicate with the server 1 via the network 9 (fig. 1). The communication unit 45 communicates with the server 1 under the control of the control unit 40. The communication unit 45 communicates with the information processing apparatus 3 through the server 1 under the control of the control unit 40.

The control Unit 40 is formed of a microcomputer including a volatile Memory such as a CPU (Central Processing Unit) or a RAM (Random Access Memory), a nonvolatile Memory such as an EEPROM (Electrically Erasable Programmable Read-Only Memory), and a timer circuit for counting the current time. The control unit 40 controls each unit of the smart glasses 4 by causing the CPU to execute a control program stored in the nonvolatile memory.

The information processing apparatus 3 is formed of a personal computer or a tablet terminal. The information processing apparatus 3 includes a microphone 32 (remote microphone), a display 33 (remote display unit), a speaker 36, an operation unit 34, a communication unit 35 (remote communication unit), and a control unit 30.

The microphone 32 collects sounds around the information processing apparatus 3. The display 33 is formed of, for example, a liquid crystal display. The display 33 has a display area for displaying an image, and displays an instructed image in the display area under the control of the control unit 30. The speaker 36 outputs the instructed sound under the control of the control section 30.

The operation unit 34 is formed of, for example, a touch panel device provided on the display area of the display 33. The operation unit 34 detects various operations performed by the user on the display area of the display 33, and outputs an instruction corresponding to the detected operations to the control unit 30. The operations performed in the display area include a touch operation, a drag (slide) operation, a long-click (long-press) operation, a double-click operation, and the like. The operation unit 34 includes an input device such as a keyboard and a mouse, and outputs an instruction corresponding to an operation performed by the input device and information input by the input device to the control unit 30.

The communication unit 35 is formed of a communication interface circuit for the information processing apparatus 3 to communicate with the server 1 via the network 9 (fig. 1). The communication unit 35 communicates with the server 1 under the control of the control unit 30. The communication unit 35 communicates with the smart glasses 4 through the server 1 under the control of the control unit 30.

The control unit 30 is formed of a microcomputer including a volatile memory such as a CPU or a RAM, a nonvolatile memory such as an EEPROM, a timer circuit for counting the current time, and the like. The control unit 30 controls each unit of the information processing apparatus 3 by causing the CPU to execute a control program stored in the nonvolatile memory.

The communication unit 35 can communicate with one or more testers 5 and measuring instruments 6 under the control of the control unit 30. The control unit 30 can control the tester 5 and the measuring instrument 6 through the communication unit 35.

As shown in fig. 2, the server 1 includes a control unit 10 (test control unit), a communication unit 11, and a storage unit 14. The server 1 may include a display unit similar to the display 33 and an operation unit similar to the operation unit 34.

The control unit 10 is formed of a microcomputer including a volatile memory such as a CPU or a RAM, a nonvolatile memory such as an EEPROM, a timer circuit for counting the current time, and the like. The control unit 10 controls each unit of the server 1 by causing the CPU to execute a control program stored in the nonvolatile memory.

The communication unit 11 is formed of a communication interface circuit for the server 1 to communicate with devices outside the server 1 via the network 9 (fig. 1). The communication unit 11 communicates with each tester 5, the measuring device 6, the smart glasses 4, and the information processing device 3 under the control of the control unit 10.

The storage unit 14 is formed of a storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive). The storage unit 14 stores various information necessary for the testers 5 to perform the tests. Various information received by the communication unit 11 and information instructed from the control unit 10 during the execution of the test by each tester 5 under the control of the control unit 10 are stored in the storage unit 14.

(information stored in the storage unit 14)

Next, details of the information stored in the storage unit 14 will be described. Fig. 3 is a diagram showing an example of a tester table. Fig. 4 is a diagram showing an example of the in-tank arrangement diagram and the arrangement diagram included in the tester information.

As shown in fig. 3, a tester table in which an identifier of a tester 5 (hereinafter, tester ID) (example: "111") and information on the tester 5 corresponding to the tester ID (hereinafter, tester information) are associated with each other is stored in advance in the storage unit 14. The tester table is stored in the storage unit 14 in advance by, for example, an operation of the operation unit 34 of the information processing apparatus 3 by a manager of the tester 5 or an experienced operator who performs a test with the tester 5, and the information processing apparatus 3 and the server 1 communicate with each other via the communication unit 35.

The tester information includes the name of the tester 5 (hereinafter, tester name) (example: "cold-thermal shock device C-11") and the identifier of the test cell provided in the tester 5 (hereinafter, test cell ID) (example: "1111").

As shown in part (a) of fig. 4, the tester information includes image data indicating an in-tank arrangement diagram of a region (hereinafter, arrangement region) in which the sample 7 can be arranged in the test tank provided in the tester 5 (for example, "a", "B", "C", and "D"). For example, in the in-cell arrangement diagram shown in part (a) of fig. 4, a case where two

sample holders

521 and 522 are provided in a test cell is shown. In addition, the arrangement regions "a" and "B" of the two samples 7 are provided in the upper stage sample holder 521, and the arrangement regions "C" and "D" of the two samples 7 are provided in the lower stage sample holder 522.

The tester information includes a test chamber 2 in which the tester 5 is disposed (example: a "1F test chamber") and image data showing a layout of a portion (example: a hatched portion) of the test chamber 2 in which the tester 5 is disposed, as shown in part (B) of fig. 4.

Fig. 5 is a diagram showing an example of the test pattern table. As shown in fig. 5, the storage unit 14 stores in advance a test pattern table in which a tester ID (example: "111") is associated with test pattern information on a pattern (hereinafter, test pattern) of test conditions settable in the tester 5 corresponding to the tester ID. The test pattern table is stored in the storage unit 14 in advance by an operation of the operation unit 34 of the information processing apparatus 3 by, for example, a manager of the tester 5 or an experienced worker performing a test with the tester 5.

The test pattern information includes an identifier of the test pattern (hereinafter, test pattern ID) (example: "12") and a name of the test pattern (hereinafter, test pattern name) (example: "test pattern 1"). The test pattern information includes the setting contents of the test conditions (examples: "high temperature bath (175 ℃, manual), low temperature bath (-75 ℃, manual), high temperature placement (150 ℃, 0.

FIG. 6 is a diagram showing an example of a sample table. As shown in fig. 6, the storage unit 14 stores in advance a sample table in which an identifier (hereinafter, sample ID) of the sample 7 (example: "358D-445875269") is associated with sample information on the sample 7 corresponding to the sample ID. The sample information is stored in the storage unit 14 before the test in each tester 5 is executed, for example, by an operation of the operation unit 34 of the information processing device 3 by an operator having a high experience in the test.

The sample information includes the name of the sample 7 (hereinafter, sample name) (example: "test substrate C"), an operator (hereinafter, sample registrant) who stores the sample information on the sample 7 in the storage unit 14 (example: the base development unit Δ) and image data indicating an image of the sample 7.

Fig. 7 is a diagram showing an example of the test table. The storage unit 14 is provided with a storage area for the test table. As shown in fig. 7, in the test table, an identifier (hereinafter, test ID) (example: "45367") of each test is stored in association with test information on each test and test progress information indicating the progress of each test.

The test information includes a tester ID (example: "111") of a tester 5 (hereinafter, target tester) for testing a sample, a test cell ID (example: "1111") of a test cell (hereinafter, target test cell) provided in the target tester, and a sample ID (example: "358D-445875269") of a sample 7 as a target of each test. The test information includes a scheduled start date and time of each test (example: "2018/5/30/00"), a scheduled end date and time of each test (example: "2018/6/2 17") and a test pattern ID (see fig. 5) as an identifier of a test pattern corresponding to the test conditions used in each test (example: "12"), and the like. The test information is stored in the test table before the start of the test by, for example, an operation instructing person who instructs an operation related to the test to the operator operating the operation unit 34 of the information processing apparatus 3.

The test progress information includes the start date and time of each test (example: "2018/5/30 00". The remaining time of each test is obtained by subtracting the cumulative time from the start of each test to the current time from the test time set as the test condition. The remaining cycle of each test is obtained by subtracting the number of times the environment in the target test cell is changed from the start of each test to the present time from the number of times the environment in the target test cell is changed in the test set as the test condition. The test progress information is updated periodically or aperiodically by the communication of the tester 5 with the server 1 after each test is started.

FIG. 8 is a diagram showing an example of a sample arrangement table. As shown in fig. 8, the storage unit 14 is provided with a storage area of a sample arrangement table in which the sample ID (example: "358D-445875269") of the sample 7 is associated with information on arrangement of the sample 7 in the target test cell. The arrangement-related information is stored in the test arrangement table before the start of the test by, for example, operating the operation unit 34 of the information processing apparatus 3 by an operation instructing person who instructs an operation related to the test to the operator.

The arrangement-related information includes a test ID of a test on the sample 7 (example: 45367), a tester ID of the target tester (example: 111), a test bath ID of the target test bath (example: 1111), and a tester name of the target tester (example: the cold-thermal shock device C-11) (identification information). The arrangement-related information includes an arrangement region (hereinafter, arrangement region) (example: "C") (arrangement region information) selected as a region in which the sample 7 is arranged from arrangement regions (see part (a) of fig. 4) provided in the target test chamber.

The arrangement-related information also includes arrangement direction information (for example, "left front marked") indicating a direction in which the sample 7 faces when the sample 7 is arranged in the target test cell. For example, the arrangement direction information is set to the character column "mark left front". At this time, when the sample 7 is disposed from the opening of the target test cell, the worker may determine the orientation of the sample 7 so that the sample mark D7 (mark) attached to the sample 7 is positioned in front of the left. The arrangement direction information is not limited to a character string, and may be data representing a moving image, an image, or sound of a direction in which the sample 7 is oriented when the sample 7 is arranged in the target test cell.

The information on the arrangement further includes information on the arrangement method (for example, "direct placement") indicating the method of arranging the sample 7. For example, when the arrangement method information is the character string "direct placement", the operator may place the sample 7 directly in the arrangement region. In the case where the arrangement method information is a character string "fixed by a jig", the operator may fix the sample 7 by a jig in the arrangement area. The arrangement method information is not limited to a character string, and may be data of a moving image, an image, or sound indicating the direction in which the sample 7 is arranged.

The arrangement-related information also includes instrument attachment information (for example, "two arbitrary positions of thermocouples") indicating a method of attaching an instrument necessary for a test, such as a thermocouple, to the sample 7. For example, when the instrument attachment information is a character string "two arbitrary locations of thermocouples", the operator may attach thermocouples to two arbitrary locations of the sample 7. The arrangement-related information is not limited to a character string, and may be moving images, or audio data indicating a method of attaching an instrument necessary for the test to the sample 7.

The arrangement-related information may not include one or more of arrangement direction information, arrangement method information, and appliance installation information.

FIG. 9 is a diagram showing an example of the tester monitoring table. As shown in fig. 9, the storage unit 14 is provided with a storage area of a tester monitoring table in which a tester ID (example: "111") of a target tester is correlated with operation information indicating an operation state of the target tester.

The operation information includes the operation state of the target test device (example: "in operation").

The operation information includes an identifier (hereinafter, operation mode ID) of an operation mode in which the target test device is executing in a mode (hereinafter, operation mode) for adjusting the environment in the target test chamber included in the test conditions (example: "5") and a name (hereinafter, operation mode name) of the operation mode (example: "test mode 1").

The operation information includes alarm information (example: 0), notification information (example: 4), and cycle information (example: 456/1000). The alarm information indicates the number of alarms issued in the subject test machine. The notification information indicates the number of notifications such as alarms issued by the target test device. The cycle information indicates the number of times the environment in the target test cell is changed from the start of the operation of the target test device to the stop of the operation (example: 1000) and the number of times the environment in the target test cell is changed from the start of the operation of the target test device to the present (example: 456). The former number of times is set as a test condition.

The operation information includes high-temperature tank temperature information (example: "175 ℃"), test zone temperature information (example: "44 ℃"), low-temperature tank temperature information (example: "-75 ℃"), and the like. The high-temperature bath temperature information indicates a current temperature in the high-temperature bath used for adjustment of the environment in the target test bath. The test area temperature information indicates the current temperature in the subject test cell. The cold box temperature information indicates a current temperature in the cold box used for adjusting the environment in the target test box.

The operation information is stored in the test monitoring table or updated periodically or aperiodically by the control unit 10 based on information periodically transmitted from the target tester to the server 1 while the test is being executed by the target tester.

Fig. 10 is a diagram showing an example of a sample monitoring table. As shown in fig. 10, the storage unit 14 is provided with a storage area of a sample monitoring table in which a sample ID (example: "358D-445875269") of a sample 7 to be tested and sample monitoring information indicating a state of the sample 7 are associated with each other. The sample monitoring information includes temperature information (for example, "44 ℃ C") indicating the temperature of the sample 7 measured recently by a thermocouple or the like attached to the sample 7, and the like. The sample monitoring information is stored in the sample monitoring table or updated by the control unit 10 periodically or aperiodically based on the information transmitted from the measuring device 6 to the server 1 after the test in the target tester is started.

(operation of the test work support System 100 before the start of the test)

Next, the operation of the test work assistance system 100 before the start of the test will be described. Fig. 11 is a flowchart showing an example of the operation of the test work assistance system 100 before the start of the test. Fig. 12 is a diagram showing an example of display of sample-related information. As shown in fig. 11, the control unit 40 first determines whether or not the sample mark D7 is included in the image captured by the camera 41 by executing a known image recognition process (step S101).

For example, as shown in part (a) of fig. 12, the sample marker D7 is included in the image captured by the camera 41 when the worker wears the smart glasses 4 on the head and directs his or her line of sight to the sample 7. At this time, in step S101, the control unit 40 determines that the sample mark D7 is included in the image captured by the camera 41 (yes in step S101).

At this time, the control unit 40 displays a part R7 of the sample-related information corresponding to the sample ID indicated by the sample mark D7 in the storage unit 14 in the display area of the screen 43, for example, as shown in part (B) of fig. 12 (step S102).

Specifically, in step S102, the control unit 40 converts the sample marker D7 recognized in step S101 into a character string by a predetermined conversion method, and obtains the character string as a sample ID. Then, the control unit 40 transmits an instruction (command) requesting transmission of the sample-related information corresponding to the sample ID in the storage unit 14 to the server 1 together with the acquired sample ID through the communication unit 45.

The server 1 is provided with a control unit 10 that receives the sample ID received by the communication unit 11 and an instruction requesting transmission of sample-related information. At this time, the control unit 10 acquires sample-related information corresponding to the received sample ID from the storage unit 14 in accordance with the instruction. Then, the control unit 10 returns the acquired sample-related information through the communication unit 11. Upon receiving the sample-related information received by the communication unit 45, the control unit 40 displays a part R7 of the received sample-related information in the display area of the screen 43.

For example, as shown in part (B) of fig. 12, part R7 of the sample-related information displayed on the screen 43 includes a test No (example: "358D-445875269"), an image of the sample 7, a predetermined test start date and time (example: "2018/5/3013 00"), a test time (example: "76.

Although not shown on the screen 43, the sample-related information includes the tester ID of the target tester and the test cell ID of the target test cell for testing the sample 7 having the sample ID indicated by the sample mark D7 recognized in step S101.

The control unit 10 acquires each piece of information included in the sample-related information as follows. The control unit 10 acquires the sample ID received by the communication unit 11 as a test No included in the test-related information. The control unit 10 acquires image data of the sample 7 included in the sample information corresponding to the sample ID in the sample table (fig. 6) and a sample registrant as an image and a principal of the sample 7 included in the sample-related information.

The control unit 10 acquires the predetermined start date and time and the predetermined end date and time included in the test information including the sample ID in the test table (fig. 7) as the predetermined start date and time and the predetermined end date and time of the test included in the sample-related information. The control unit 10 acquires the tester ID, the test cell ID, the tester name, and the arrangement region included in the arrangement related information corresponding to the sample ID in the sample arrangement table (fig. 8) as the tester ID, the test cell ID, the tester name, and the arrangement region included in the sample related information.

The control unit 10 acquires the tester ID (example: "111") and the test pattern ID (example: "12") included in the test information including the sample ID (example: "358D-445875269") received from the communication unit 11 in the test table (fig. 7). Then, the control unit 10 refers to the test pattern information corresponding to the acquired tester ID in the test pattern table (fig. 5) and includes the test pattern information of the acquired tester ID. The control unit 10 then acquires, as the test time and the test condition included in the sample-related information, the test time (example: 76.

The information included in the part R7 of the sample-related information displayed on the screen 43 is not limited to the information illustrated in part (B) of fig. 12. The test placement table (fig. 8) may further include one or more pieces of information of placement direction information, placement method information, and instrument attachment information included in the placement-related information corresponding to the sample ID acquired by the control unit 40.

It is assumed that a part R7 of the sample-related information includes arrangement direction information. At this time, even if the operator has insufficient experience in disposing the sample 7 in the test cell, the sample can be appropriately disposed in the target test cell so that the sample is oriented in the direction indicated by the disposition direction information displayed in the display area of the screen 43. Further, it is assumed that a part R7 of the sample-related information includes arrangement method information. At this time, even if the operator has insufficient experience in placing the sample in the test cell, the sample 7 can be placed in the target test cell by an appropriate method according to the method indicated by the placement method information displayed in the display area of the screen 43. It is assumed that a part R7 of the sample-related information includes instrument attachment information. At this time, even if the operator has insufficient experience in mounting the instrument necessary for the test on the sample, the instrument necessary for the test can be appropriately mounted on the sample 7 placed in the target test cell according to the method indicated by the instrument mounting information displayed in the display area of the screen 43.

The sample-related information may not include the tester ID of the target tester, the test cell ID of the target test cell, the tester name, and information other than the arrangement region. The sample-related information may not include the name of the tester. In this case, a part R7 of the sample-related information includes a tester ID of the target tester instead of the tester name of the target tester as identification information for identifying the target tester.

According to the above configuration, even if the test experience of the operator is insufficient, the tester name or the tester ID of the target tester included in a part R7 of the sample-related information displayed in the display area of the screen 43 and the arrangement area can be seen. The operator can appropriately grasp the target test device for testing the sample 7 based on the viewed information, and can appropriately dispose the sample in a predetermined region in the test cell of the target test device.

When the control unit 40 determines in step S101 that the sample mark D7 is not included in the image captured by the camera 41 (no in step S101), the process from step S101 onward is executed.

After step S102 is executed, the control unit 40 performs a known image recognition process to determine whether or not the tester mark D5 indicating the tester ID of the target tester is included in the captured image of the camera 41 (step S103).

Specifically, in step S103, the control unit 40 executes known image recognition processing to change all the tester marks D5 included in the captured image into character strings by a predetermined conversion method, and acquires the converted character strings as the tester IDs of all the testers 5 included in the captured image. When the acquired tester ID includes the tester ID of the target tester included in the sample-related information, the control unit 40 determines that the tester mark D5 indicating the tester ID of the target tester is included in the image captured by the camera 41 (yes in step S103).

Fig. 13 is a diagram showing an example of display of tester information R5. For example, the operator is assumed to see the tester name of the target tester included in a part R7 of the sample-related information displayed on the screen 43 in step S102. Further, for example, as shown in fig. 13, the worker enters the test room 2 in which the target test device T5 is disposed, and faces the direction in which the target test device T5 is disposed while looking around the periphery. As a result, the tester mark D5 indicating the tester ID of the target tester T5 is included in the captured image of the camera 41. At this time, the control unit 40 determines in step S103 that the tester mark D5 indicating the tester ID of the target tester T5 is included in the captured image of the camera 41 (yes in step S103).

At this time, as shown in fig. 13, for example, the control unit 40 displays tester information R5 corresponding to the tester ID of the target tester T5 in the storage unit 14 so as to correspond to an area within the display area of the screen 43 corresponding to an area where the target tester T5 is arranged in the captured image of the camera 41 (step S104).

Specifically, in step S104, the control unit 40 generates, in the same manner as in step S102, an instruction requesting transmission of the tester information R5 corresponding to the tester ID of the target tester T5 in the storage unit 14, together with the tester ID of the target tester T5 included in the sample-related information received from the server 1 in step S102, to the server 1.

In the server 1, the control unit 10 receives the tester ID of the target tester T5 and an instruction to request transmission of the tester information R5 through the communication unit 11. At this time, the control unit 10 acquires tester information R5 corresponding to the acquired tester ID from the storage unit 14 in accordance with the instruction. Then, the control unit 10 returns the acquired tester information R5 through the communication unit 11.

Upon receiving the tester information R5 received by the communication unit 45, the control unit 40 generates an image (hereinafter, a label image) indicating the label shape of the received tester information R5. For example, as shown in fig. 13, the control unit 40 displays the generated annotation image in the display area of the screen 43 such that the start point of the annotation of the generated annotation image is located in the vicinity of an area within the display area of the screen 43 corresponding to the area where the target test device T5 is arranged in the captured image of the camera 41. Accordingly, the control section 40 displays the tester information R5 so as to correspond to an area within the display area of the screen 43, which corresponds to the area where the target tester T5 is arranged in the captured image of the camera 41.

The method by which the control unit 40 displays the tester information R5 so as to correspond to an area within the display area of the screen 43 corresponding to the area where the target tester T5 is arranged in the captured image of the camera 41 is not limited to this. For example, the control unit 40 may display the tester information R5 in an area corresponding to the area where the target tester T5 is arranged in the captured image of the camera 41 and the display area of the screen 43 near the area.

Further, the control unit 40 displays the tester information R5 when the tester mark D5 is included in the captured image of the camera 41. In other words, when the tester information R5 is displayed, at least a partial area of the outside of the subject tester T5 to which the tester mark D5 is attached is included in the captured image of the camera 41. Therefore, the control unit 40 can display the tester information R5 at a position within the display area of the screen 43 corresponding to an arbitrary position within the captured image of the camera 41 including the target tester T5.

For example, as shown in FIG. 13, the tester information R5 includes the tester name (example: "Cold thermal shock device C-11") of the target tester T5. Specifically, the control unit 10 acquires, as the tester name of the target tester T5 included in the tester information R5, the tester name included in the tester information corresponding to the tester ID of the target tester T5 received from the smart glasses 4 through the communication unit 11 in the tester table (fig. 3).

The information included in the tester information R5 is not limited to the tester name of the target tester T5 illustrated in fig. 13. The tester table (fig. 3) may include information different from the tester name included in the tester information corresponding to the tester ID of the target tester acquired by the control unit 40.

According to the above configuration, even when the operator does not know the information on the target test device T5 and the arrangement position of the target test device T5, the operator can see the test device information corresponding to the test device ID of the target test device in the test device table (fig. 3) displayed in the display area of the screen 43. The operator can easily grasp the information on the target test device T5 based on the viewed information. Further, the worker can easily grasp the arrangement position of the target test device T5 based on the position where the test device information is displayed in the display area of the screen 43.

After executing step S104, the control unit 40 executes known image recognition processing in the same manner as step S101 to determine whether or not a test chamber mark D52 (see fig. 14) indicating a test chamber ID of a test chamber (hereinafter, a target test chamber) of the target tester is included in the captured image of the camera 41 (step S105).

Fig. 14 is a diagram showing an example of highlighting the arrangement region. For example, after the operator moves to a position where the subject test device T5 is disposed in the test chamber 2 where the subject test device T5 is disposed, the predetermined operation for opening the opening/closing door 51 is performed in the subject test device T5, and the opening/closing door 51 is opened. Then, the operator is assumed to see the result of the test well mark D52, and the test well mark D52 indicating the test well ID of the target test well is included in the image captured by the camera 41. At this time, the control unit 40 determines in step S105 that the test well mark D52 indicating the test well ID of the target test well is included in the captured image of the camera 41 (yes in step S105).

At this time, for example, as shown in fig. 14, the control unit 40 grasps the region in which the region indicated by the arrangement region (example: "C") included in the part R7 (fig. 12) of the sample-related information displayed in step S102 is arranged in the captured image of the camera 41. Then, the control unit 40 highlights 0 the area (for example, the area A52) within the display area of the screen 43 corresponding to the grasped area (step S106).

Specifically, in step S106, the control unit 40 transmits an instruction to highlight the area corresponding to the placement area to the server 1 through the communication unit 45 together with the camera 41 captured image and the tester ID of the target tester T5, the test chamber ID of the target test chamber, and the placement area included in the sample-related information (fig. 12) acquired in step S102.

In response to this, the server 1 is provided with a control unit 10 that receives the image captured by the camera 41, the tester ID of the target tester T5, the test chamber ID of the target test chamber, the arrangement area, and an instruction to highlight the area corresponding to the arrangement area, which are received by the communication unit 11.

At this time, the control unit 10 refers to the tester information corresponding to the received tester ID of the target tester T5 in the tester table (fig. 3) and includes the tester information of the test cell ID of the target test cell. Then, the control unit 10 acquires image data of the in-groove layout included in the tester information referred to.

The control unit 10 executes a known image recognition process to recognize, from the received image captured by the camera 41, an area in which an image corresponding to the in-groove arrangement map shown in the acquired image data is arranged. The control unit 10 generates a transparent image having the same shape and size as the received image captured by the camera 41. The control section 10 encloses, with a thick line, an area a52 (fig. 14) corresponding to the received placement area among the areas on the transparent image corresponding to the identified area placed in the captured image of the received camera 41. The control unit 10 returns an image on which a message indicating the received placement area (for example, "placement area: C" (fig. 14)) is superimposed, through the communication unit 11, so as to correspond to the area surrounded by the thick line in the transparent image. In response to this, if the control section 40 receives the image received through the communication section 45, the received image is displayed in the display area of the screen 43.

According to the above configuration, the region indicated by the arrangement region is highlighted in the display region of the screen 43 corresponding to the region arranged in the captured image of the camera 41. Therefore, even if the operator has insufficient experience in placing the sample 7 in the test cell, the operator can easily place the sample 7 in the region indicated by the placement region in the target test cell based on the region highlighted in the display region.

Further, the control unit 40 executes the processing after step S103 if it is determined in step S103 that the tester mark D5 is not included in the captured image of the camera 41 (no in step S103) and if it is determined in step S105 that the test chamber mark D52 is not included in the captured image of the camera 41 (no in step S105).

After step S106 is executed, an instruction for requesting assistance for an operation for assisting the arrangement of the sample 7 is input by an operation of the operation unit 44 by an operator (yes in step S107). The operation related to the arrangement of the sample 7 includes, for example, an operation of determining the orientation of the sample 7 when the sample 7 is arranged in the target test cell, an operation of attaching an instrument such as a thermocouple to the sample 7, and the like.

At this time, the control unit 40 causes the display 33 of the information processing apparatus 3 to display the image captured by the camera 41 (step S108). Then, the control unit 40 causes the communication unit 45 of the smart glasses 4 and the communication unit 35 of the information processing device 3 to communicate the sounds collected by the microphone 42 of the smart glasses 4 and the microphone 32 of the information processing device 3 between the smart glasses 4 and the information processing device 3 (step S109).

Specifically, in step S108, the control unit 40 transmits the assistance request instruction input in step S107 to the server 1 together with the captured image of the camera 41. In contrast, in the server 1, if the photographed image and the assistance request instruction are received by the communication unit 11, the control unit 10 transfers the received photographed image and the assistance request instruction to the information processing device 3 by the communication unit 11. In response to this, in the information processing device 3, if the photographed image and the assistance request instruction are received via the communication unit 35, the control unit 30 displays the received photographed image on the display 33 in accordance with the received assistance request instruction.

Then, in step S109, the control unit 40 transmits a request instruction for voice communication to the server 1 together with the voice collected by the microphone 42. In the server 1, if the communication unit 11 receives the voice collected by the microphone 42 and the request instruction for voice communication, the control unit 10 transmits the received voice and the request instruction for voice communication to the information processing apparatus 3 via the communication unit 11. In the information processing apparatus 3, if the communication unit 35 receives the voice collected by the microphone 42 and the request instruction for voice communication, the control unit 30 outputs the received voice to the speaker 36 in accordance with the received request instruction for voice communication.

Then, the control unit 30 transmits a request instruction for voice communication to the server 1 together with the voice collected by the microphone 32. In the server 1, if the communication unit 11 receives the voice collected by the microphone 32 and the request instruction for voice communication, the control unit 10 transmits the received voice and the request instruction for voice communication to the smart glasses 4 through the communication unit 11. In the smart glasses 4, if the sound collected by the microphone 32 and the request instruction for the sound communication are received by the communication unit 45, the control unit 40 outputs the received sound to the speaker 46 in accordance with the received request instruction for the sound communication.

On the other hand, after step S106 is executed, if the operator does not input an assistance request instruction requesting assistance for the operation of arranging the sample 7 by the operation of the operation unit 44 (no at step S107), the process proceeds to step S113.

In step S109, after the voice communication of the voice communication between the smart glasses 4 and the information processing apparatus 3 is started, the user performs the drawing operation on the captured image displayed on the display 33 in the information processing apparatus 3 using the operation unit 34 (yes in step S110). At this time, the control unit 30 causes the drawing image drawn by the drawing operation to be displayed in the display area of the screen 43 of the smart glasses 4 (step S111).

Specifically, in step S111, the control unit 30 transmits an instruction to display the drawing image to the server 1 together with the drawing image. In the server 1, if the drawing image and the instruction to display the drawing image are received by the communication unit 11, the control unit 10 transmits the received drawing image and the instruction to display the drawing image to the smart glasses 4 via the communication unit 11. In the smart glasses 4, if the drawing image and the display instruction of the drawing image are received via the communication unit 45, the control unit 40 causes the received drawing image to be displayed in the display area of the screen 43 in accordance with the received display instruction.

Until the operator inputs an instruction to end the assistance of the operation for ending the operation for arranging the sample 7 by the operation of the operation unit 44 (no at step S112), the process from step S108 is repeated. Thereafter, if an instruction to end the assistance of the operation related to the operation of arranging the sample 7 is input by the operator through the operation of the operation unit 44 (yes in step S112), the assistance of the operation related to the arrangement of the sample 7 is ended, and the processing in and after step S113 is performed.

Fig. 15 is a diagram showing an example of assistance in the operation related to the arrangement of the sample 7. For example, the worker P1 arranges the sample 7 in the target test cell, attaches the thermocouple to the sample 7, and performs wiring work for connecting the thermocouple to the measuring instrument 6. Fig. 15 illustrates a case where the worker P1 performs the processing of step S108 and thereafter by inputting the assistance request instruction through the operation unit 44.

If step S108 is performed, the captured image of the camera 41 is displayed on the screen 43 of the smart glasses 4 and the display 33 of the information processing apparatus 3 as shown in fig. 15. If step S109 is performed, the sound of the operator P1 collected by the microphone 42 of the smart glasses 4 and the sound of the user P2 collected by the microphone 32 of the information processing apparatus 3 communicate with each other, and a conversation is performed between the operator P1 and the user P2. At this time, the user P2 performs the drawing operation of the drawing image D30 by using the operation unit 34. In this case, step S111 is performed, and the drawing image D30 drawn by the drawing operation is also displayed on the screen 43 of the smart glasses 4.

According to the above configuration, the operation assistant having a large experience can make a conversation with the operator wearing the smart glasses 4 while looking at the same image as the image captured by the camera 41 of the smart glasses 4 on the display 33 of the information processing device 3. Therefore, even if the test experience is insufficient, the operator can be easily assisted by the operation assisting person with respect to the operation of arranging the sample.

Further, according to the above configuration, the work assistant having a large experience in the test can perform the drawing operation on the same image as the image captured by the camera 41 of the smart glasses 4 displayed on the display 33 of the information processing device 3. The drawing image D30 drawn by this drawing operation is displayed in the display area of the screen 43.

Therefore, even if the test experience is insufficient, the operator can perform audio communication with the work assistant while looking at the drawing image D30 displayed in the display area of the screen 43. As a result, the operator receives more detailed assistance from the operation assistant with respect to the operation related to the arrangement of the sample.

In step S113, the control unit 40 determines whether or not a test bath mark D52 (fig. 14) indicating a test bath ID of the target test bath is included in the image captured by the camera 41, as in step S105 (step S113). In step S113, if it is determined that the test chamber mark D52 (fig. 14) is included in the image captured by the camera 41 (yes in step S113), the control unit 40 determines that the open/close door 51 of the target test chamber is open, and performs the processing of step S107 and subsequent steps. In step S113, if it is determined that the test chamber mark D52 (fig. 14) is not included in the image captured by the camera 41 (no in step S113), the control unit 40 determines that the open/close door 51 is in the closed state after the sample 7 is disposed in the target test chamber, and ends the operation of the test work assistance system 100 before the start of the test.

(operation of the test work support system 100 after the start of the test)

Next, the operation of the test work assistance system 100 after the start of the test will be described. Fig. 16 is a flowchart showing an example of the operation of the test work assistance system 100 after the start of the test. Fig. 17 is a diagram showing an example of display of the sample-related information R11. After the operation of the test work assistance system 100 before the start of the test is completed, as shown in fig. 16, it is assumed that a test start instruction to start the test is input by the operation of the operation unit 44 by the operator (yes in step S201).

For example, as shown in part (a) of fig. 17, an input screen R10 for displaying a test start instruction to start a test by an operation of the operation unit 44 by the operator is provided, and a software key K10 for selecting a test start instruction (for example, "yes") to start a test is provided. At this time, in step S201, the control unit 40 determines that a test start instruction is input.

Then, the control unit 40 controls the communication unit 45 to directly or indirectly (via the server 1) communicate with the target test device, and causes the target test device to start the test (step S202). Then, the control unit 40 displays the test-related information R11 corresponding to the tester ID of the target tester in the storage unit 14 in the display area of the screen 43, for example, as shown in part (B) of fig. 17 (step S203).

Specifically, in step S203, the control unit 40 transmits the tester ID of the target tester T5 included in the sample-related information received from the server 1 in step S102 to the server 1 through the communication unit 45 together with an instruction (command) requesting transmission of the test-related information R11 corresponding to the tester ID in the storage unit 14.

In the server 1, the control unit 10 receives the tester ID received by the communication unit 11 and an instruction to request transmission of the test-related information R11. At this time, the control unit 10 acquires the test-related information R11 corresponding to the received tester ID from the storage unit 14 in accordance with the instruction. Then, the control unit 10 returns the acquired test-related information R11 through the communication unit 11. The control part 40, if receiving the trial related information R11 received through the communication part 45, displays the received trial related information R11 in the display area of the screen 43.

The test-related information R11 displayed on the screen 43 includes, for example, as shown in part (B) of fig. 17, an arrangement region (example: "C") of each of all the samples 7 arranged in the target test chamber and a sample No (example: "358D-445875269") of each of all the samples 7. The test-related information R11 includes the remaining time (example: "186.

The control unit 10 acquires each piece of information included in the test-related information R11 as follows. The control unit 10 refers to the test progress information corresponding to the test information including the tester ID (example: "111") received by the communication unit 11 in the test progress table (fig. 7). The control unit 10 acquires, as the target test progress information (test progress information corresponding to the identifier of the target test device in the storage unit), test progress information for which the end date and time is not stored in the referenced test progress information.

Then, the control unit 10 refers to the test information corresponding to the acquired target test progress information. The control unit 10 acquires the sample IDs (for example, "476K-577739433", "125T-24583357", "358D-445875269", and "125S-445783381") included in the reference test information as the sample Nos. included in the test-related information R11.

The control unit 10 refers to the sample arrangement table (fig. 8) and includes the arrangement-related information of the sample IDs (examples: "476K-577739433", "125T-24583357", "358D-445875269", and "125S-445783381") obtained as the sample nos contained in the test-related information R11. The control unit 10 then acquires the placement areas (for example, "D", "a", "C", and "B") included in the referenced placement-related information as the placement areas included in the test-related information R11.

The control unit 10 acquires the remaining time and the remaining cycle included in the target test progress information as the remaining time and the remaining cycle included in the test-related information R11.

The test-related information R11 displayed on the screen 43 is not limited to the information illustrated in part (B) of fig. 17, and may include other information included in the subject test progress information, or may omit some information.

After executing step S203, the control unit 10 updates the target test progress information to the latest information periodically or aperiodically (step S204). For example, the target test device T5 transmits, to the server 1, a test device ID of the target test device T5, an elapsed time from the start of operation, the number of times of changing the environment in the target test chamber after the start of operation, and an instruction to request updating of the target test progress information, periodically or aperiodically.

In the server 1, the control unit 10 is configured to receive the tester ID, the elapsed time, the number of times, and an instruction requesting the update of the target test progress information, which are received by the communication unit 11. In this case, for example, the control unit 10 subtracts the elapsed time and the count of times that have been received previously together with the tester ID that is the same as the tester ID that has been received this time from the elapsed time and the count of times that have been received this time, respectively. The control unit 10 refers to the test progress table (fig. 7) in which the target test progress information having the end date and time is not stored in the test progress information corresponding to the test information including the received tester ID. Then, the control unit 10 updates the target test progress information to the latest information by subtracting the time and number of times of the subtraction result from the remaining time and remaining cycle included in the target test progress information in the test progress table (fig. 7).

When the subtraction result is a negative value, the control unit 10 updates the remaining time and the remaining cycle included in the target test progress information to 0, and stores the current date and time and information indicating the end of the test in the end date, time, and state included in the target test progress information.

According to the above configuration, after the test of the sample 7 is started by the target test device, the progress of the test for each of all the samples 7 arranged in the target test chamber is displayed in the display area of the screen 43. Therefore, the operator can easily grasp the progress of the test with respect to each of all the samples 7 arranged in the target test cell.

After step S203 is executed, the control unit 10 updates the operation information corresponding to the tester ID of the target tester in the storage unit 14 to the latest information periodically or aperiodically.

Specifically, the target tester T5 periodically or aperiodically transmits the tester ID of the target tester T5, the information corresponding to the operation information, and an instruction to update the operation information to the latest information to the server 1. The information corresponding to the operation information is information including the operation state, the operation mode ID, the operation mode name, the alarm, the notification, the cycle, the high temperature tank temperature, the test area temperature, and the low temperature tank temperature, which is included in the operation information stored in the tester monitoring table (fig. 9).

In the server 1, each time the control unit 10 receives the tester ID, the information corresponding to the operation information, and the instruction to update the operation information to the latest information, which are received through the communication unit 11, the control unit updates the operation information corresponding to the received tester ID to the information corresponding to the received operation information in the tester monitoring table (fig. 9).

After executing step S205, the control unit 40 determines whether or not the tester mark D5 indicating the tester ID of the target tester is included in the captured image of the camera 41, in the same manner as step S103 (step S206).

Fig. 18 is a diagram showing an example of display of the operation-related information R13, the test-related information R11, and the tester-related information R14. For example, as shown in part (a) of fig. 18, the operator starts the test of the target tester T5 at step S202 and then faces the direction in which the tester mark D5 is attached. As a result, the image captured by the camera 41 includes a tester mark D5 indicating the tester ID of the target tester T5. At this time, the control unit 40 determines in step S206 that the tester mark D5 indicating the tester ID of the target tester T5 is included in the captured image of the camera 41 (yes in step S206).

At this time, the control unit 40 displays the operation related information R13 corresponding to the tester ID of the target tester in the storage unit 14 in the display area of the screen 43, for example, as shown in part (B) of fig. 18 (step S207).

Specifically, in step S207, the control unit 40 transmits the tester ID of the target tester T5 corresponding to the tester mark D5 determined to be included in the captured image of the camera 41 to the server 1 through the communication unit 45 together with an instruction requesting the transmission of the operation-related information R13 corresponding to the tester ID in the storage unit 14.

In the server 1, if the control unit 10 receives the tester ID received by the communication unit 11 and an instruction to request transmission of the operation-related information R13, the control unit acquires the operation-related information R13 corresponding to the received tester ID from the storage unit 14 in accordance with the instruction. Then, the control unit 10 returns the acquired operation-related information R13 through the communication unit 11. The control part 40, if receiving the operation related information R13 received through the communication part 45, displays the received operation related information R13 in the display area of the screen 43.

For example, as shown in part (B) of fig. 18, the operation-related information R13 displayed on the screen 43 includes the name of the target test device (example: "thermal shock apparatus C-11"), the operation mode of the target test device (example: "test mode 1"), the operation state of the target test device (example: "in operation"), the cycle information (example: "456/1000 times"), the number of alarms issued by the target test device (example: "0 devices"), and the number of notifications issued by the target test device (example: "4 devices").

For example, as shown in part (B) of fig. 18, the operation-related information R13 displayed on the screen 43 includes information (for example: "+175 ℃", "manual") on a temperature set value in the high-temperature bath for adjusting the environment in the target test bath, and a measured value (for example: "+175 ℃"). The operation-related information R13 includes information on a set value of the temperature of the test area indicating the temperature in the target test chamber (for example, "+150 ℃ c. 0", 30 "in a high-temperature state," 0 "in a normal-temperature state," 05 "in a low-temperature state," -65 ℃ c. 0 ".

The control unit 10 acquires each piece of information included in the operation-related information R13 as follows. The control unit 10 acquires the tester name corresponding to the tester ID of the target tester received by the communication unit 11 in the tester table (fig. 3) as the name of the target tester included in the operation-related information R13.

The control unit 10 refers to the operation mode name, the operation state, the alarm information, the notification information, the cycle information, the high-temperature bath temperature information, the test area temperature information, and the low-temperature bath temperature information in the operation information corresponding to the tester ID of the target tester received by the communication unit 11 in the tester monitoring table (fig. 9). The control unit 10 acquires the referenced information as the operation mode, the operation state, the number of alarms, the number of notifications, the cycle information, the temperature measurement value of the high-temperature tank, the temperature measurement value of the test area, and the temperature measurement value of the low-temperature tank, which are included in the operation-related information R13.

The control unit 10 refers to the setting contents included in the test pattern information corresponding to the tester ID (example: "111") of the target tester received by the communication unit 11 in the test pattern table (fig. 5). The control unit 10 also acquires information on the temperature set value of the high-temperature tank (for example, "high-temperature tank (175 ℃, manual)") included in the setting content of the reference, as the information on the temperature set value of the high-temperature tank included in the operation-related information R13. Similarly, the control unit 10 acquires information on the temperature set value of the test area included in the setting content of the reference (for example, "high temperature placement (150 ℃,0 ℃, 30)," normal temperature placement (0), "low temperature placement (-65 ℃, 0). The control unit 10 also acquires information on the temperature set value of the low-temperature tank (for example, "low-temperature tank (-75 ℃, manual)") included in the setting content of the reference, as the information on the temperature set value of the low-temperature tank included in the operation-related information R13.

According to the above configuration, when the tester mark D5 indicating the tester ID of the target tester is included in the image captured by the camera 41 after the test of the sample 7 placed in the target test cell is started, the operation information indicating the operation state of the target tester is displayed in the display area of the screen 43. Therefore, the operator can easily grasp the operating state of the target test device.

After step S207 is executed, the control unit 40 displays the test-related information R11 corresponding to the tester ID of the target tester in the storage unit 14 in the display area of the screen 43, as shown in part (B) of fig. 18, for example, in the same manner as step S203 (step S208).

Further, the control unit 40 displays tester-related information R14 corresponding to the tester ID of the subject tester in the storage unit 14 in the display area of the screen 43, as shown in part (B) of fig. 18, for example (step S209).

Specifically, in step S209, the control unit 40 transmits the tester ID of the target tester T5 corresponding to the tester mark D5 determined to be included in the captured image of the camera 41 to the server 1 through the communication unit 45 together with an instruction to request transmission of the tester-related information R14 corresponding to the tester ID in the storage unit 14.

In the server 1, if the control unit 10 receives the tester ID received by the communication unit 11 and an instruction to request transmission of the tester-related information R14, the control unit acquires the tester-related information R14 corresponding to the received tester ID from the storage unit 14 in accordance with the instruction. Then, the control unit 10 returns the acquired tester-related information R14 through the communication unit 11. The control part 40, if receiving the tester-related information R14 received through the communication part 45, displays the received tester-related information R14 in the display area of the screen 43.

For example, as shown in part (B) of fig. 18, the tester-related information R14 displayed on the screen 43 includes an in-tank arrangement diagram of the target test tank. Specifically, the control unit 10 acquires the image data of the in-groove layout pattern of the target test groove in the tester table (fig. 3) corresponding to the tester ID of the target tester received by the communication unit 11 as the image data of the in-groove layout pattern of the target test groove included in the tester-related information R14.

Fig. 19 is a diagram showing an example of display of test information of a selected test. After step S209, as shown in part (a) of fig. 19, the operator operates the operation unit 44, and selects, for example, information corresponding to one sample 7 indicated by a cursor from the test-related information R11 displayed in step S208 (for example, arrangement region "C", sample No "358D-445875269", remaining time "46", and remaining cycle "112") (yes in step S210).

At this time, the control unit 40 refers to the test information (fig. 7) corresponding to the tester ID of the target tester in the storage unit 14, as shown in part (B) of fig. 19. The control unit 40 displays the detailed test information R15 including the information corresponding to the selected one sample 7 included in the reference test information in the display area of the screen 43 (step S211).

Specifically, in step S211, the control unit 40 transmits the tester ID of the target tester T5 corresponding to the tester mark D5 determined to be included in the image captured by the camera 41 and the sample ID of the one sample 7 indicated by the sample No included in the information corresponding to the one sample 7 selected in step S210 to the server 1 through the communication unit 45. The control unit 40 transmits an instruction to request transmission of detailed test information R15 to the server 1 via the communication unit 45, the detailed test information R15 including information corresponding to the transmitted sample ID included in the test information (fig. 7) corresponding to the transmitted tester ID in the storage unit 14.

In the server 1, if the control unit 10 receives the tester ID and the sample ID received by the communication unit 11 and an instruction requesting transmission of the detailed test information R15, it acquires the test information corresponding to the received tester ID in the storage unit 14 in accordance with the instruction. Then, the control unit 10 returns detailed test information R15 including information corresponding to the received sample ID included in the acquired test information and information corresponding to the received tester ID and sample ID in the storage unit 14, through the communication unit 11. The control part 40, if receiving the detailed trial information R15 received through the communication part 45, displays the received detailed trial information R15 in the display area of the screen 43.

For example, as shown in part (B) of fig. 19, the detailed test information R15 displayed on the screen 43 includes an image of the one sample 7, a start time of the test on the one sample 7 (example: "2018/5/30 00"), a test time of the test on the one sample 7 (example: 76.

The control unit 10 acquires each piece of information included in the detailed test information R15 as follows. The control unit 10 refers to the image data of the sample 7 included in the sample information corresponding to the sample ID (example: "358D-445875269") received by the communication unit 11 in the sample table (FIG. 6) and the sample registrant (example: "the base development unit. Smallcircle."). The control unit 10 acquires the information of the reference as image data indicating the image of the one sample 7 and a principal of the test on the one sample 7 included in the detailed test information R15.

The control unit 10 refers to the test progress information corresponding to the test information including the tester ID ("example:" 111 ") and the sample ID (" example: "358D-445875269") received by the communication unit 11 in the test table (fig. 7). The control unit 10 acquires, as the start time of the test for the one sample 7 included in the detailed test information R15, the start date and time (example: "2018-05-30 00".

The control unit 10 refers to test information corresponding to test progress information in which the end date and time is not stored, among test information including the tester ID ("example:" 111 ") received by the communication unit 11 in the test table (fig. 7), as candidate test information. The control unit 10 refers to the candidate test information referred to as target test information, including the test information of the sample ID (example: "358D-445875269") received by the communication unit 11. The control unit 10 then acquires the predetermined end date and time (example: "2018-06-02 17") and the test pattern ID (example: "12") included in the reference target test information. The control unit 10 sets the acquired scheduled end date and time as the scheduled end time of the test on the one sample 7 included in the detailed test information R15.

The control unit 10 refers to the test pattern information corresponding to the tester ID ("example:" 111 ") received by the communication unit 11 in the test pattern table (fig. 5) and includes the test pattern information of the acquired test pattern ID (" example: "12"). The control unit 10 then acquires the test pattern name included in the referred test pattern information (example: "test pattern 1") as the pattern name of the test condition included in the detailed test information R15. The control unit 10 refers to the setting contents included in the referred test pattern information, and acquires the test time (example: 76.

According to the above configuration, the operator can individually grasp information on a test for each sample by performing an operation of selecting information on each sample from the test-related information R11 displayed in the display area of the screen 43.

Fig. 20 is a flowchart showing an example of the operation of the test work assistance system 100 at the end of the test. If it is determined in step S206 that the tester mark D5 indicating the tester ID of the target tester is not included in the image captured by the camera 41 (no in step S206), the control unit 40 determines whether or not all the tests in the target tester are completed as shown in fig. 20 (step S300). In the case where the operation of selecting information corresponding to one sample 7 from the test-related information R11 is not performed in step S210 (no in step S210) or in the case where step S211 is performed, the control unit 40 also determines whether or not all the tests in the target test device have been completed (step S300).

Specifically, in step S300, the control unit 40 transmits, to the server 1, the tester ID of the target tester T5 corresponding to the tester mark D5 determined to be included in the captured image of the camera 41, together with an instruction to request determination of whether or not all tests in the target tester have been completed, through the communication unit 45.

In response to this, the server 1 is provided with a control unit 10 that receives the tester ID received by the communication unit 11 and an instruction requesting determination of whether or not all tests in the target tester have been completed. At this time, the control unit 10 determines whether or not the test progress information corresponding to the test information including the received tester ID in the test progress table (fig. 7) includes test progress information indicating that the end date and time is not stored or test progress information indicating that the state is in the test. If the control unit 10 determines that the information is not included as a result of the determination, it determines that all the tests in the target test device have been completed. When the control unit 10 determines that the information is included as a result of the determination, it determines that the test has not been completed in the target test device.

Then, the control unit 10 returns the determination result to the communication unit 11. The control unit 40 receives the determination result received through the communication unit 45. If the received determination result indicates that there is an unfinished test in the target test device, the control unit 40 determines that there is an unfinished test in the target test device (no in step S300). Thereafter, the processing from step S204 onward is performed. On the other hand, if the received determination result indicates that all the tests in the target test device have been completed, the control unit 40 determines that all the tests in the target test device have been completed (yes in step S300).

At this time (yes at step S300), the control unit 40 displays a message (for example, "test is completed, sample is taken out") notifying that the sample 7 is taken out from the target test cell in the display area of the screen 43 (step S301).

Next, the control unit 40 performs a known image recognition process in the same manner as in step S105 (fig. 11), and determines whether or not a test bath mark D52 (see fig. 14) indicating a test bath ID of the target test bath is included in the captured image of the camera 41 (step S302).

If it is determined in step S302 that the test well mark D52 indicating the test well ID of the target test well is included in the captured image of the camera 41, the control unit 40 (yes in step S302). At this time, the control unit 40 determines whether or not the sample 7 is present in the target test cell by executing a known image recognition process with the open/close door 51 being in the open state (step S303). Accordingly, the control unit 40 determines whether or not all of the samples 7 arranged in the target test cell have been taken out.

On the other hand, the control unit 40 determines in step S302 that the test well mark D52 indicating the test well ID of the target test well is not included in the captured image of the camera 41 (no in step S302). At this time, the control unit 40 regards the opening/closing door 51 as being closed, and performs the processing of step S301 and thereafter.

The control unit 40 determines in step S303 that the sample 7 is not present in the target test cell (yes in step S303). At this time, the control unit 40 performs a known image recognition process in the same manner as step S302, and determines whether or not a test bath mark D52 (see fig. 14) indicating a test bath ID of the target test bath is included in the captured image of the camera 41 (step S304). On the other hand, when it is determined in step S303 that the sample 7 is present in the target test chamber (no in step S303), the control unit 40 performs the processing after step S302.

If the control unit 40 determines in step S304 that the test slot mark D52 is not included in the captured image of the camera 41 (no in step S304). At this time, the control unit 40 considers that all the samples 7 are taken out from the target test cell, and then the open/close door 51 is closed, thereby ending the process. On the other hand, if it is determined in step S304 that the test chamber mark D52 is included in the image captured by the camera 41 (yes in step S304), the control unit 40 regards that the open/close door 51 is still open, and performs the processing of step S303 and thereafter.

(modified embodiment)

The above-described embodiments are merely examples of the embodiments according to the present invention, and the present invention is not limited to the above-described embodiments. For example, the following modified embodiments are possible.

(1) In the test work assistance system 100 of the above-described embodiment, the sample 7 is notified of the removal after the end of the test of all the samples 7 in the target test cell. However, as described below, the test task assistance system 100 may be configured to notify the sample 7 from the sample 7 that the test is completed, even if all the tests in the target test device are not completed.

Fig. 21 is a flowchart showing a modification of the operation of the test work assistance system 100 at the end of the test. Specifically, it is determined in step S206 (fig. 16) that the tester mark D5 indicating the tester ID of the target tester is not included in the captured image of the camera 41 (no in step S206). In this case, the control unit 40 may perform the processing of step S400 and subsequent steps shown in fig. 21. Note that, when the operation of selecting information corresponding to one sample 7 from the test-related information R11 is not performed in step S210 (no in step S210) or when step S211 is performed, the control unit 40 may perform the processing of step S400 and subsequent steps shown in fig. 21.

As shown in fig. 21, in step S400, the control unit 40 determines whether or not there is a test that has ended in the target tester (step S400). Specifically, in step S400, the control unit 40 transmits, to the server 1, the tester ID of the target tester T5 corresponding to the tester mark D5 determined to be included in the captured image of the camera 41, together with an instruction (hereinafter, a determination request instruction) requesting determination of whether or not there is a test for which termination is determined in the target tester, through the communication unit 45.

In the server 1, the control unit 10 receives the tester ID and the determination request instruction received by the communication unit 11. At this time, the control unit 10 determines whether or not test progress information (hereinafter, end test information) in which an end date and time are stored and a state indicating the end of the test is included in the test progress information corresponding to the test information including the received tester ID in the test progress table (fig. 7).

When determining that the test completion information is included, the control unit 10 acquires the sample ID included in the test information corresponding to the test completion information in the test progress table (fig. 7). The control unit 10 acquires sample information corresponding to the acquired sample ID in the sample table (fig. 6), and acquires arrangement-related information corresponding to the acquired sample ID in the sample arrangement table (fig. 8). The control unit 10 acquires tester information corresponding to the tester ID received by the communication unit 11 in the tester table (fig. 3).

Then, the control unit 10 returns the acquired sample ID, sample information, arrangement-related information, and tester information, and a determination result indicating that the test in the target tester has been completed, to the communication unit 11.

If the determination result received by the communication unit 45 indicates that the test has not been completed in the target test device, the control unit 40 determines that the test has not been completed in the target test device (no in step S400). In this case, the processing of step S204 (fig. 16) and subsequent steps is performed.

On the other hand, when the determination result received by the communication unit 45 indicates that the test subject has a completed test, the control unit 40 determines that the test subject has a completed test (yes at step S400). At this time, the control unit 40 displays information notifying that the target sample is taken out from the target test cell in the display area of the screen 43, assuming that the test for the sample 7 (hereinafter, the target sample) corresponding to the sample ID received together with the determination result by the communication unit 45 is completed (step S401).

The information displayed in step S401 includes, for example, the sample ID and at least the sample ID or sample name of the sample information received by the control unit 40 together with the determination result in step S400 (fig. 6). Therefore, the operator can grasp which sample 7 is taken out from the target test cell based on the sample ID or sample name included in the message displayed in step S401.

The information displayed in step S401 may include the in-groove layout shown in the image data of the arrangement region and the in-groove layout included in the arrangement-related information and the tester-related information received by the control unit 40 together with the determination result in step S400. In this case, the operator can appropriately take out the target sample arranged in the region indicated by the arrangement region in the target test cell based on the displayed arrangement region and the in-cell arrangement diagram.

Next, the control unit 40 performs a known image recognition process in the same manner as step S302 (fig. 20), and determines whether or not a test bath mark D52 (see fig. 14) indicating the test bath ID of the target test bath is included in the captured image of the camera 41 (step S402).

If the control unit 40 determines in step S402 that the test well mark D52 indicating the test well ID of the target test well is included in the image captured by the camera 41 (yes in step S402). At this time, the control unit 40 determines whether or not the number of samples 7 in the target test cell has decreased by considering that the operator opens the open/close door 51 to take out the sample 7 (step S403).

For example, when the control unit 40 determines that the test chamber mark D52 is included in the captured image of the camera 41 in step S402 performed after step S401, the captured image of the camera 41 is stored in the memory as an initial captured image. If a predetermined time has elapsed after the start of step S403, the control unit 40 stores the captured image of the camera 41 in the memory as the subject captured image. Then, the control unit 40 performs a known image recognition process to determine whether or not the number of samples 7 recognized from the target captured image is smaller than the number of samples 7 recognized from the initial captured image.

When determining that the number of samples 7 identified from the subject captured image is not less than the number of samples 7 identified from the initial captured image, the control unit 40 determines that the number of samples 7 in the subject test cell is not decreased (no in step S403). In this case, the processing in and after step S402 is performed. On the other hand, when determining that the number of samples 7 recognized from the target captured image is smaller than the number of samples 7 recognized from the initial captured image, the control unit 40 determines that the number of samples 7 in the target test cell is decreased (yes in step S403).

At this time (yes at step S403), the control unit 40 determines whether or not the sample 7 taken out of the target test cell is a test-completed target sample (step S404). For example, in step S404, the control unit 40 grasps, as the region where the sample 7 taken out from the target test cell is disposed (hereinafter, the sample-taking-out disposition region), the region where the sample 7 different from the sample 7 recognized from the target captured image is disposed in the initial captured image, among the samples 7 recognized from the initial captured image in step S403. The control unit 40 performs a known image recognition process to grasp the sample arrangement region to be extracted.

The control unit 40 executes a known image recognition process to compare the initial captured image with the in-groove arrangement map shown in the image data included in the tester information received in step S400, and thereby recognizes an arrangement region corresponding to the sample extraction arrangement region from the arrangement regions included in the in-groove arrangement map as the arrangement region of the sample 7 extracted from the target test groove.

When the grasped arrangement region does not match the arrangement region included in the arrangement-related information received in step S400, the control unit 40 determines that the sample 7 taken out from the target test cell is not the target sample (no in step S404). At this time, the control unit 40 displays warning information indicating that the sample 7 has been taken out erroneously in the display area of the screen 43 (step S408). Thereafter, the processing in and after step S403 is performed. In step S408, the control unit 40 may further output a warning sound indicating the designation of the sample 7 which has been taken out incorrectly to the speaker 46.

On the other hand, when the grasped arrangement region matches the arrangement region included in the arrangement-related information received in step S400, the control unit 40 determines that the sample 7 taken out of the target test cell is the target sample (yes in step S404). At this time, the control unit 40 executes a known image recognition process in the same manner as step S402, and determines whether or not a test bath mark D52 (see fig. 14) indicating the test bath ID of the target test bath is included in the captured image of the camera 41 (step S405).

If it is determined in step S405 that the test chamber mark D52 is included in the image captured by the camera 41 (yes in step S405), the control unit 40 regards that the open/close door 51 is still open, and performs the processing of step S403 and subsequent steps. On the other hand, if it is determined in step S405 that the test chamber mark D52 is not included in the image captured by the camera 41 (no in step S405), the control unit 40 determines that the open/close door 51 is closed after the target sample is taken out from the target test chamber. In this case, the control unit 40 determines whether or not all of the tests of the target test device have been completed (step S406), as in step S300 (fig. 20).

If it is determined in step S406 that all the tests in the target test device have been completed (yes in step S406), the control unit 40 determines whether or not all the samples 7 have been taken out from the target test cell (step S407). Specifically, in step S407, the control unit 40 determines that all samples 7 have been taken out from the target test cell when it is recognized by performing a known image recognition process that none of the target captured images stored in the memory in step S403 is included in one sample 7. On the other hand, when recognizing that one or more samples 7 are included in the subject captured image, the control unit 40 determines that there is no sample 7 taken out of the subject test cell.

In step S407, if it is determined that all the samples 7 have been taken out of the target test chamber (yes in step S407), the control unit 40 determines that all the tests in the target test apparatus have been completed and that all the samples 7 in the target test chamber have been taken out, and ends the process.

On the other hand, if it is determined in step S406 that there is a test that has not been completed in the target test device (no in step S406) and if it is determined in step S407 that there is a sample 7 that has not been taken out of the target test cell (no in step S407), the control unit 40 shifts the process to step S204 (fig. 16). With this, the processing is continued until all the tests in the target test device are completed and all the samples 7 in the target test cell are taken out.

Alternatively, the sample 7 after the test may be taken out and a new sample 7 to be tested may be placed in the test cell. For example, when the processing in step S204 and subsequent steps is executed, the above-described information corresponding to the test on the sample 7 to be newly tested is added to the storage unit 14. Then, the operator directs his or her line of sight to the new sample 7, so that the sample mark D7 indicating the identification ID of the new sample 7 is included in the image captured by the camera 41. In this case, the processing in progress in the processing of step S204 and thereafter may be interrupted, and the processing of step S102 (fig. 11) and thereafter may be performed.

(2) Instead of the smart glasses 4, a mobile terminal device such as a smartphone or a tablet terminal may be used which includes a display device such as a camera, a microphone, or a liquid crystal display, a speaker, an operation unit, a communication unit, and a control unit similar to the camera 41, the microphone 42, the screen 43, the speaker 46, the operation unit 44, the communication unit 45, and the control unit 40. In this case, the control unit of the mobile terminal device may display the image captured by the camera as a background image in the display area of the display device.

At this time, in step S106 (fig. 11), the region indicated by the placement region included in the background image displayed on the display device of the mobile terminal device is highlighted. Therefore, even if the operator has insufficient experience in placing the sample 7 in the test cell, the operator can easily place the sample 7 in the region indicated by the placement region in the target test cell based on the region highlighted in the display device.

(3) After step S108 (fig. 11), the operator can communicate with the information processing device 3 by a character string, for example, in a chat or the like, between the smart glasses 4 and the information processing device 3 until the operator operates the operation unit 44 and inputs an instruction to end the assistance of the work related to the placement of the sample 7 (no at step S112). Specifically, the control unit 40 and the control unit 30 can transmit and receive a character string input using the operation unit 44 of the smart glasses 4 and a character string input using the operation unit 34 of the information processing device 3 to and from each other through the server 1, and display the received character strings on the screen 43 and the display 33.

(4) In step S105 (fig. 11) described above, the control unit 40 determines whether or not the test bath mark D52 indicating the test bath ID of the target test bath is included in the captured image of the camera 41. Alternatively, the control unit 40 may determine whether the openable and closable door 51 is in the opened state at step S105 (fig. 11), and perform step S106 when determining that the openable and closable door 51 is in the opened state.

Specifically, when the information indicating that the opening/closing door 51 is in the opened state is input using the operation unit 44, the control unit 40 can determine that the opening/closing door 51 is in the opened state. Alternatively, the control unit 40 may determine whether or not the opening/closing door 51 is in the opened state by comparing the image captured by the camera 41 with an image of the opening/closing door 51 captured by the camera 41 when the opening/closing door 51 is in the closed state, which is stored in advance in a memory of a microcomputer constituting the control unit 40 or the like, by a known image recognition process.

Alternatively, when the target test device includes an open/close sensor for detecting the open/close state of the open/close door 51, the communication unit 45 may be configured to be able to communicate with the target test device through the server 1 or directly. The communication unit 45 is controlled by the control unit 40 to communicate with the subject tester, and thereby the detection result of the open/close state of the open/close door 51 detected by the open/close sensor is acquired from the subject tester, and the determination is performed based on the detection result.

Similarly, in step S302 and step S304 (fig. 20), instead of determining whether or not the control unit 40 includes the test well mark D52 indicating the test well ID of the target test well in the image captured by the camera 41, it may be determined whether or not the opening/closing door 51 is in the opened state.

(5) Steps S210 and S211 (fig. 16) may be omitted. Further, step S205 and step S207 (fig. 16) may also be omitted. Further, the test work assistance system 100 may be configured not to perform the operation shown in fig. 16.

(6) Step S110 and step S111 (fig. 11) may be omitted. Also, steps S107 to S112 (fig. 11), the

microphones

32, 42, and the

speakers

36, 46 may also be omitted. Further, step S105 and step S106 (fig. 11) may also be omitted.

If there is one tester 5 provided in the test work assistance system 100, step S103 and step S104 (fig. 11) may be omitted. In step S102 (fig. 11), the control unit 10 may include only the arrangement region acquired from the arrangement-related information stored in the sample arrangement table (fig. 8) in the sample-related information. In step S102, the control unit 40 may include only the placement region included in the sample-related information in a part R7 of the sample-related information. At this time, even if the test experience is insufficient, the operator can appropriately place the sample in a predetermined region in the test cell of the target test device based on the placement region included in a part R7 of the sample-related information displayed in the display region of the screen 43.

(7) The test work assistance system 100 may not include the server 1. The control unit 30 of the information processing device 3 may acquire the captured image of the camera 41 provided in the smart glasses 4 through the communication unit 35. The storage unit provided in the information processing device 3, such as a memory of a microcomputer constituting the control unit 30, can store the same information as the storage unit 14. The communication unit 35 and the control unit 30 may also function similarly to the communication unit 11 and the control unit 40 of the server 1.

Accordingly, when the sample mark D7 indicating the identifier of the sample 7 is included in the image captured by the camera 41, the control unit 30 can function as follows. That is, the control unit 30 may refer to information stored in the storage unit of the information processing device 3, which is associated with the sample ID of the sample 7 and the arrangement-related information on the target test cell provided in the target test device for testing the sample 7. The control unit 30 may display the arrangement-related information corresponding to the sample ID indicated by the sample mark D7 in the reference information in the display area of the screen 43.

At this time, when the worker uses the smart glasses 4, the sample mark D7 indicating the sample ID of the sample 7 is included in the image captured by the camera 41. At this time, the display area of the screen 43 provided in the smart glasses 4 displays information on the arrangement of the sample 7 in the test cell. Therefore, even if the test experience is insufficient, the operator can appropriately dispose the sample 7 in the test cell based on the disposition-related information.

The embodiments are described in general terms as follows.

A test work assistance system according to an aspect of the embodiment: the present invention provides a test operation support system for supporting an operation of a tester which includes a test cell in which a sample can be placed and which performs a test on the sample by adjusting an environment in the test cell according to a predetermined test condition, the test operation support system performing a test operation on the sample in a state in which sample identification information indicating an identifier of the test operation support system is added to the sample, the test operation support system including: a mobile terminal provided with a camera and a display unit; a storage unit that stores an identifier of the sample and information on arrangement of the sample in a target test cell provided in a target test device as the test device for testing the sample in association with each other in advance; and a test control unit that displays the arrangement-related information corresponding to the identifier of the sample indicated by the sample identification information in the storage unit in a display area of the display unit when the sample identification information is included in the image captured by the camera.

According to this configuration, if the operator carries the mobile terminal and sample identification information indicating an identifier of the sample is included in the image captured by the camera, the arrangement-related information relating to the arrangement of the sample in the test cell is displayed in the display area of the display unit of the mobile terminal. Therefore, even if the test experience is insufficient, the operator can appropriately arrange the sample in the test cell based on the arrangement-related information.

Further, the test work assistance system may be configured to assist the work of one or more of the testers, and the configuration-related information may include: identification information for identifying the subject tester; and arrangement region information indicating a region in the target test cell in which the sample is arranged.

According to this configuration, even if the test experience is insufficient, the operator can appropriately grasp the target test device for testing the sample based on the identification information and the arrangement region information displayed on the display region of the display unit of the mobile terminal. The operator can appropriately dispose the sample in a predetermined region in the test cell of the target test device.

In the test work assistance system according to the above configuration, the storage unit may further store therein an identifier of the tester and tester information related to the tester in association with each other in advance, and the test control unit may display the tester information associated with the identifier of the target tester in the storage unit in association with an area in the display area corresponding to an area where the target tester is arranged in the captured image, when the tester identification information indicating the identifier of the target tester is included in the captured image.

When a worker moves in a room where a target tester is disposed, tester identification information indicating an identifier of the target tester is included in a captured image of a camera. In this case, according to this configuration, the tester information corresponding to the identifier of the target tester in the storage unit is displayed so as to correspond to the area within the display area corresponding to the area in which the target tester is arranged in the captured image.

Therefore, even when the operator does not know the information on the target test device and the arrangement position of the target test device, the operator can easily grasp the information on the target test device based on the test device information displayed in the display area. In addition, the operator can easily grasp the arrangement position of the target test device based on the position where the test device information is displayed in the display area.

In the test work support system configured as described above, the test work can be performed on the tester in a state where test bath identification information indicating an identifier of the test bath is added to a position where the open/close door of the test bath is visible in a state where the open/close door of the test bath is opened, and the test control unit highlights an area in the display area corresponding to an area in the captured image, the area being indicated by the arrangement area information, when the test bath identification information indicating the identifier of the target test bath is included in the captured image.

An operator opens an opening/closing door for opening/closing a target test chamber of a target test device, and images the inside of the target test chamber with a camera of a portable terminal, whereby test chamber identification information indicating an identifier of the target test chamber is included in an image captured by the camera. In this case, according to this configuration, the region within the display region corresponding to the region in which the region indicated by the arrangement region information is arranged in the captured image is highlighted.

Therefore, even if the operator has insufficient experience in placing the sample in the test cell, the operator can easily place the sample in the region indicated by the placement region information in the target test cell based on the region highlighted in the display region.

In addition, the test control unit may further display the captured image as a background image in the display area.

An operator opens an opening/closing door for opening/closing a target test chamber of a target test device, and images the inside of the target test chamber with a camera of a portable terminal, whereby test chamber identification information indicating an identifier of the target test chamber is included in an image captured by the camera. In this case, according to this configuration, the region indicated by the arrangement region information included in the background image displayed in the display region is highlighted.

Therefore, even if the operator has insufficient experience in arranging the sample in the test cell, the operator can easily arrange the sample in the region indicated by the arrangement region information in the target test cell based on the region highlighted in the display region.

The arrangement-related information may include arrangement direction information indicating a direction in which the sample faces when the sample is arranged in the target test cell.

According to this configuration, even if the operator has insufficient experience in disposing the sample in the test cell, the operator can appropriately dispose the sample in the target test cell so that the sample is oriented in the direction indicated by the disposition direction information displayed in the display area of the display unit of the mobile terminal.

The arrangement-related information may include arrangement method information indicating a method of arranging the sample.

According to this configuration, even if the operator has insufficient experience in disposing the sample in the test cell, the operator can dispose the sample in the target test cell in an appropriate manner according to the method indicated by the disposition method information displayed in the display area of the display unit of the mobile terminal.

The arrangement-related information may include instrument attachment information indicating a method of attaching an instrument necessary for the test to the sample.

According to this configuration, even if the operator has insufficient experience in mounting the instrument necessary for the test on the sample, the operator can properly mount the instrument necessary for the test on the sample arranged in the target test cell by the method indicated by the instrument mounting information displayed on the display area of the display unit of the portable terminal.

In addition, the test work assistance system configured as described above may further include an information processing device including: a remote microphone to collect sound; a remote display unit for displaying an image; and a remote communication unit that communicates with the mobile terminal, wherein the mobile terminal further includes: a remote microphone to collect sound; an operation unit for performing an input operation of an assistance request instruction for requesting assistance for work related to the arrangement of the sample; and a communication unit that communicates with the information processing device, wherein the test control unit causes the remote display unit to display a captured image of the camera and causes the communication unit and the remote communication unit to communicate with each other the sounds collected by the microphone and the remote microphone, when the assistance request instruction is input through the operation unit.

According to this configuration, the operator having a large experience in the test can have a conversation with the operator carrying the portable terminal while looking at the same image as the image captured by the camera of the portable terminal on the remote display unit of the information processing device. Therefore, even if the test experience is insufficient, the operator can easily receive assistance from the operation assistance person regarding the operation of arranging the sample.

In the above configuration, the information processing apparatus may further include a remote operation unit configured to perform a drawing operation on the captured image displayed on the remote display unit, and the test control unit may display, in the display area, a drawing image drawn on the captured image by the drawing operation when the drawing operation is performed by the remote operation unit.

According to this configuration, the operation assistant having a large experience can perform a drawing operation on the same image as the image captured by the camera of the portable terminal, which is displayed on the remote display unit of the information processing apparatus, and display the drawing image drawn by the drawing operation on the display area of the display unit of the portable terminal.

Therefore, even if the test experience is insufficient, the operator can perform audio communication with the operation assistant while viewing the drawing image displayed in the display area of the display unit of the mobile terminal. Accordingly, the operator can receive more detailed assistance from the operation assistant for the sample arrangement operation.

The mobile terminal may further include an operation unit configured to perform an input operation for instructing a start of the test, wherein the storage unit may further store an identifier of the target test device and test progress information indicating a progress status of the test for each of all samples arranged in the test bath of the target test device in association with each other, and the test control unit may cause the display area to display the test progress information corresponding to the identifier of the target test device in the storage unit after the target test device starts the test when the input operation for instructing the start is performed by the operation unit after the sample is arranged in the target test bath.

According to this configuration, after the test of the sample is started by the target test device, the progress of the test of all the samples arranged in the target test chamber is displayed in the display area. Therefore, the operator can easily grasp the progress of the test of each of the samples disposed in the target test cell.

The storage unit may further store an identifier of the target test device and operation information indicating an operation state of the target test device in association with each other, and the test control unit may display the operation information corresponding to the identifier of the target test device in the storage unit in the display area when the test identification information indicating the identifier of the target test device is included in the captured image after the test of the sample arranged in the target test cell is started.

According to this configuration, when tester identification information indicating an identifier of a target tester is included in an image captured by the camera after a test of a sample arranged in a target test cell is started, operation information indicating an operation state of the target tester is displayed in the display area. Therefore, the operator can easily grasp the operation state of the target test device.

The storage unit may store an identifier of the target test device and test information on a test executable by the target test device in association with each other, the operation unit may further perform a selection operation of selecting information corresponding to one sample from the test progress information displayed in the display area, and the test control unit may display, in the display area, information corresponding to the one sample included in the test information corresponding to the identifier of the target test device in the storage unit when the selection operation is performed by the operation unit.

According to this configuration, the operator can individually grasp the information on the test for each sample by performing an operation of selecting the information on each sample from the test progress information displayed in the display area of the display unit of the mobile terminal.

A recording medium according to another aspect of the embodiment stores a program that causes a computer to function as an information processing device that assists an operation of a tester that includes a test cell in which a sample can be placed and performs a test on the sample by adjusting an environment in the test cell according to a predetermined test condition, and that is readable by the computer, the program causing the computer to function as: when sample identification information indicating an identifier of the sample is included in an image captured by a camera, the arrangement-related information corresponding to the identifier of the sample indicated by the sample identification information is displayed in a display area of a display unit, among information in which the identifier of the sample and arrangement-related information are associated with each other in advance, wherein the arrangement-related information is information on arrangement of the sample in the test cell provided in the tester performing a test on the sample.

According to this configuration, if sample identification information indicating an identifier of a sample is included in an image captured by the camera, information on the arrangement of the sample in the test chamber is displayed in the display area of the display unit. Therefore, even if the test experience is insufficient, the operator can appropriately arrange the sample in the test cell based on the arrangement-related information.

Claims

1. A test operation support system for supporting an operation of a tester having a test cell in which a sample can be placed, and performing a test on the sample by adjusting an environment in the test cell in accordance with a predetermined test condition,

the test work assistance system performs a test work on the sample with sample identification information indicating an identifier of the sample attached thereto, and includes:

a mobile terminal provided with a camera and a display unit;

a storage unit that stores an identifier of the sample and information on arrangement of the sample in a target test cell provided as a target test device that is the test device for testing the sample, in association with each other in advance; and

and a test control unit configured to display the arrangement-related information corresponding to the identifier of the sample indicated by the sample identification information in the storage unit in a display area of the display unit when the sample identification information is included in the captured image of the camera.

2. The trial work assistance system according to claim 1,

the test work assistance system assists the work performed by one or more of the testers,

the configuration-related information includes: identification information for identifying the subject tester; and arrangement region information indicating a region in the target test cell in which the sample is arranged.

3. The trial work assistance system according to claim 2,

the test work assistance system performs a test work with the tester attached with tester identification information indicating an identifier of the tester,

the storage unit also stores an identifier of the tester and tester information on the tester in association with each other in advance,

the test control unit displays, in the storage unit, the tester information corresponding to the identifier of the target tester so as to correspond to an area within the display area corresponding to an area in which the target tester is arranged in the captured image, when the tester identification information indicating the identifier of the target tester is included in the captured image.

4. The trial work assistance system according to claim 2 or 3,

the test work assistance system performs a test work on the tester in a state where test bath identification information indicating an identifier of the test bath is added to a position where the open/close door of the test bath is visible in a state where the open/close door is opened,

the test control unit highlights an area within the display area corresponding to an area in the captured image in which the area indicated by the arrangement area information is arranged, when the test cell identification information indicating the identifier of the target test cell is included in the captured image.

5. The trial work assistance system according to claim 4,

the test control unit further displays the captured image in the display area as a background image.

6. Trial work assistance system according to any one of claims 1 to 3,

the arrangement-related information includes arrangement direction information indicating a direction in which the sample faces when the sample is arranged in the target test cell.

7. Trial work assistance system according to any one of claims 1 to 3,

the arrangement-related information includes arrangement method information indicating a method of arranging the sample.

8. Trial work assistance system according to any one of claims 1 to 3,

the arrangement-related information includes instrument attachment information indicating a method of attaching an instrument necessary for the test to the sample.

9. The trial work assistance system according to any one of claims 1 to 3, characterized by further comprising:

an information processing device includes: a remote microphone to collect sound; a remote display unit for displaying an image; and a remote communication part communicating with the mobile terminal, wherein,

the mobile terminal further includes: a remote microphone to collect sound; an operation unit for performing an input operation of a support request instruction for requesting support of a task related to the arrangement of the sample; and a communication unit that communicates with the information processing apparatus,

the test control unit causes the remote display unit to display a captured image of the camera and causes the communication unit and the remote communication unit to communicate sounds collected by the microphone and the remote microphone with each other when the assistance request instruction is input through the operation unit.

10. The trial work assistance system according to claim 9,

the information processing apparatus further includes a remote operation unit for performing a drawing operation on the captured image displayed on the remote display unit,

the test control unit displays, in the display area, a drawing image drawn on the captured image by the drawing operation when the drawing operation is performed by the remote operation unit.

11. Trial work assistance system according to any one of claims 1 to 3,

the mobile terminal further includes an operation unit for performing an input operation for instructing the start of the test,

the storage unit further stores an identifier of the target test device and test progress information indicating a progress status of the test for each of all samples arranged in the test cell of the target test device in association with each other,

the test control unit causes the target test device to start the test and then displays the test progress information corresponding to the identifier of the target test device in the storage unit in the display area when the input operation of the start instruction is performed by the operation unit after the sample is placed in the target test cell.

12. Trial work assistance system according to any one of claims 1 to 3,

the storage unit further stores an identifier of the target test device and operation information indicating an operation state of the target test device in association with each other,

the test control unit displays the operation information corresponding to the identifier of the target test instrument in the storage unit in the display area when tester identification information indicating the identifier of the target test instrument is included in the captured image after the test of the sample arranged in the target test cell is started.

13. The trial work assistance system according to claim 11,

the storage unit further stores an identifier of the target test device and test information on a test that can be executed in the target test device in association with each other in advance,

the operation unit may further perform a selection operation of selecting information corresponding to one sample from the test progress information displayed in the display region,

the test control unit displays, in the display area, information corresponding to the one sample included in the test information corresponding to the identifier of the target test instrument in the storage unit, when the selection operation is performed by the operation unit.

14. A recording medium storing a program readable by a computer, the program causing the computer to function as an information processing device that assists an operation of a tester having a test cell in which a sample can be placed, the test being performed by adjusting an environment in the test cell according to a predetermined test condition,

the program causes the computer to function as:

when sample identification information indicating an identifier of the sample is included in an image captured by a camera, the arrangement-related information corresponding to the identifier of the sample indicated by the sample identification information is displayed in a display area of a display unit, among information in which the identifier of the sample and arrangement-related information are associated with each other in advance, wherein the arrangement-related information is information on arrangement of the sample in the test cell provided in the tester performing a test on the sample.