WO2022009802A1

WO2022009802A1 - Operating system, processing system, operating method, program, and storage medium

Info

Publication number: WO2022009802A1
Application number: PCT/JP2021/025172
Authority: WO
Inventors: 康徳渕上
Original assignee: 株式会社東芝
Priority date: 2020-07-06
Filing date: 2021-07-02
Publication date: 2022-01-13
Also published as: JP2023014104A; JP7174014B2; JP2022014215A

Abstract

An operating system according to an embodiment of the present invention is provided with an acquiring unit, a computing unit, and a generating unit. The acquiring unit acquires an output from a first device which is to be operated. The computing unit generates an operation instruction on the basis of the output acquisition result and an action file created in advance. The generating unit generates an operation signal corresponding to the first device on the basis of the operation instruction, and transmits the same to the first device. The action file includes a first file in which a generation action for generating the operation instruction is described, and a second file which is referred to when the generation action is executed, and which includes information used to identify the output and to generate the operation signal.

Description

Operation system, processing system, operation method, program, and storage medium

Embodiments of the present invention relate to an operation system, a processing system, an operation method, a program, and a storage medium.

There is a system that automatically operates the device. This system is required to reduce the burden on the user.

Japanese Unexamined Patent Publication No. 2004-110489

An object to be solved by the present invention is to provide an operation system, a processing system, an operation method, a program, and a storage medium that can reduce the burden on the user.

The operation system according to the embodiment includes an acquisition unit, a calculation unit, and a generation unit. The acquisition unit acquires the output from the first device to be operated. The arithmetic unit generates an operation instruction based on the acquisition result of the output and the operation file created in advance. The generation unit generates an operation signal corresponding to the first device based on the operation command and transmits it to the first device. The operation file includes a first file in which a generation operation for generating the operation instruction is described, and information referred to when the generation operation is executed and used for identification of the output and generation of the operation signal. Includes a second file.

It is a schematic diagram which shows the operation system which concerns on embodiment. It is a schematic diagram which illustrates the screen of a display device. It is a schematic diagram which illustrates the screen of a display device. It is a schematic diagram which illustrates a part of the 1st file and a part of a 2nd file. It is a flowchart which shows the procedure for operation by the operation system which concerns on embodiment. It is a flowchart which shows a part of the trial of the operation by the operation system which concerns on embodiment. It is a schematic diagram which shows the operation system which concerns on the 1st modification. It is a schematic diagram which shows the operation system which concerns on the 2nd modification. It is a schematic diagram which shows the operation system which concerns on the 3rd modification. It is a schematic diagram which shows the operation system which concerns on 4th modification. It is a schematic diagram which shows the hardware configuration of the operation system which concerns on embodiment.

Hereinafter, each embodiment of the present invention will be described with reference to the drawings.
In the present specification and each figure, the same elements as those already described are designated by the same reference numerals, and detailed description thereof will be omitted as appropriate.

FIG. 1 is a schematic diagram showing an operation system according to an embodiment.
As shown in FIG. 1, the operation system 10 according to the embodiment includes an acquisition unit 11, a calculation unit 12, a generation unit 13, and a storage device 14. The operation system 10 is used to automatically operate the processing device 21 (first device).

The processing device 21 processes the work. The treatment is, for example, at least one selected from transport, processing, washing, heating, cooling, and drying. Processing is, for example, at least one selected from film formation, etching, polishing, lithography, and joining.

The processing device 21 includes a control unit 21a. Each component of the processing device 21 operates based on the instruction transmitted from the control unit 21a to process the work. The control unit 21a includes, for example, a central processing unit (CPU), a read-only memory (ROM), a random access memory (RAM), a storage device, an input interface, an output interface, a communication interface, and a bus connecting them. The control unit 21a may be a dedicated computer for the processing device 21 or a general-purpose computer. The function of the control unit 21a may be realized by the collaboration of a plurality of computers.

The input device 22 is used by the user to input information to the processing device 21. The user is, for example, an operator in charge of processing executed by the processing device 21. The input device 22 includes, for example, at least one selected from a keyboard, mouse, touchpad, and microphone (voice input).

The display device 23 displays the signal output from the processing device 21 so that the user can visually recognize it. The display device 23 includes a monitor.

The acquisition unit 11 acquires the output from the processing device 21 which is the operation target to the display device 23.

For example, the output includes a video signal transmitted from the processing device 21 to the display device 23. The acquisition unit 11 receives the video signal. The acquisition unit 11 acquires the video signal and transmits the video signal to the display device 23. The acquisition unit 11 includes, for example, a video signal distributor and a capture unit. The acquisition unit 11 acquires the video signal as a moving image or a still image and transmits it to the calculation unit 12.

Alternatively, the output may be light emitted from the processing device 21. For example, the acquisition unit 11 includes an image pickup device. The acquisition unit 11 takes a picture of the light emitting device that emits light. The acquisition unit 11 acquires a moving image or a still image and transmits it to the calculation unit 12.

Alternatively, the output may be a sound emitted from the processing device 21. For example, the acquisition unit 11 includes a microphone. The acquisition unit 11 acquires the sound emitted from the processing device 21 as an electric signal and transmits it to the calculation unit 12.

The calculation unit 12 recognizes the acquisition result by the acquisition unit 11. For example, the calculation unit 12 recognizes the image acquired by the acquisition unit 11. In image recognition, processing such as pattern matching, character recognition, and color matching is executed. Alternatively, the calculation unit 12 recognizes the sound acquired by the acquisition unit 11. In sound recognition, processing such as pattern matching is executed.

The calculation unit 12 refers to the operation file created in advance. The operation file includes the first file and the second file. The first file describes the generation operation for generating the operation instruction. For example, the first file is a program file in which an operation sequence for generating an operation instruction and transmitting it to the generation unit 13 is described. The second file is referenced when the generation operation is executed. The second file contains the information used in the identification of the output signal and the generation of the operation signal described below. For example, the second file contains coordinates selected by the input device 22, data information referred to during image recognition, and the like.

The calculation unit 12 executes the generation operation of the first file based on the acquisition result by the acquisition unit 11 while referring to the information included in the second file. As a result, an operation command for operating the processing device 21 is generated. The arithmetic unit 12 transmits an operation instruction to the generation unit 13.

The arithmetic unit 12 includes, for example, a CPU, a ROM, a RAM, a storage device, an input interface, an output interface, a communication interface, and a bus connecting these. The arithmetic unit 12 is a dedicated or general-purpose computer. The function of the arithmetic unit 12 may be realized by the collaboration of a plurality of computers.

The generation unit 13 generates an operation signal corresponding to the processing device 21 based on the operation command. The generation unit 13 inputs the generated operation signal to the processing device 21 (control unit 21a). For example, when the input device 22 includes a mouse or keyboard, the operation signal corresponds to a signal transmitted from the mouse or keyboard. When the processing device 21 receives the operation signal, the processing device 21 moves the pointer, inputs characters, and the like according to the operation signal. The generation unit 13 includes, for example, a microcomputer programmed to generate an operation signal corresponding to a signal transmitted from the input device 22.

The storage device 14 stores various data necessary for operating the processing device 21. For example, the storage device 14 stores an operation file. The storage device 14 stores reference data necessary for image recognition. The storage device 14 includes a hard disk drive (HDD), a solid state drive (SSD), a network-attached hard disk (NAS), and the like.

The operation file and the reference data necessary for recognizing the acquisition result are prepared in advance by the user using the input device 15 and the display device 16. The input device 15 is used by the user to input information to the calculation unit 12. The input device 15 includes, for example, at least one selected from a keyboard, mouse, touchpad, and microphone. The display device 16 displays the signal output from the calculation unit 12 so that the user can visually recognize it. The display device 16 includes a monitor.

Here, a case where the acquisition unit 11 mainly acquires the video signal output from the processing device 21 will be described.

In image recognition, at least one selected from template matching, character recognition, and color recognition is executed. The user prepares reference data necessary for these processes in advance and stores them in the storage device 14.

In the preparation of the template image, the acquisition unit 11 acquires the video signal from the processing device 21 to the display device 23 when performing image recognition. The calculation unit 12 causes the display device 16 to display an image based on the video signal. The user uses the input device 15 to select a portion of the displayed image. The selected image is stored in the storage device 14 as a template image. The user describes the file name of the template image to be referred to in the second file described later. For example, the template image is prepared for all the screens on which the automatic operation by the operation system 10 is executed.

For example, when the processing device 21 is operated, the screen changes. For example, the displayed screen transitions to another screen, or a window is displayed. A partial image that is not included in the screen before the change but is included in the screen after the change is used as the template image.

In the preparation of the character recognition range, the acquisition unit 11 acquires the video signal from the processing device 21 to the display device 23 when it is necessary to recognize the character. The calculation unit 12 causes the display device 16 to display an image based on the video signal. The user confirms the range in which character recognition is executed in the displayed image by using the input device 15. The user describes the range in the second file described later.

In preparation for color recognition, the acquisition unit 11 acquires a video signal from the processing device 21 to the display device 23 when it is necessary to recognize the color. The calculation unit 12 causes the display device 16 to display an image based on the video signal. The user uses the input device 15 to select a range in which color recognition is performed in the displayed image. The images in the selected range are stored in the storage device 14. The user describes the range in the second file described later.

In image recognition using a template image, the calculation unit 12 determines whether an image similar to the template image is included in the image based on the video signal. In character recognition, the arithmetic unit 12 cuts out an image in a range stored in advance. The arithmetic unit 12 executes character recognition processing such as Optical Character Recognition (OCR) on the image. In color recognition, the calculation unit 12 cuts out an image in a range stored in advance. The calculation unit 12 determines whether or not the colors of the respective units match between the image stored in advance and the image cut out. By recognizing the image by these processes, the calculation unit 12 determines whether or not the operation on the processing device 21 by the operation signal is completed.

In the preparation of the operation file, the first file and the second file are created. The first file is described in a general-purpose programming language such as C language. In the second file, the selected coordinates of the pointing device, the template image to be referenced, the characters to be input, and the like are described in a text format.

Regarding a pointing device such as a mouse, the user describes the coordinates to be selected (clicked) in the second file and stores them in the storage device 14. For example, the acquisition unit 11 acquires a video signal from the processing device 21 to the display device 23 when operating the pointing device. The calculation unit 12 causes the display device 16 to display an image based on the video signal. The user points the pointer at the selected part of the displayed image and confirms the coordinates. The user describes the coordinates in the second file.

Regarding the keyboard, the acquisition unit 11 acquires the video signal from the processing device 21 to the display device 23 when inputting characters with the keyboard. The calculation unit 12 causes the display device 16 to display an image based on the video signal. In the displayed image, the user points the pointer at the text box for inputting characters and confirms the coordinates. The user describes the coordinates and one or more characters to be entered in the text box in the second file.

After the operation signal is sent to the processing device 21, the calculation unit 12 determines whether the processing device 21 has been operated according to the operation signal by performing image recognition. If it is determined that the operation is not performed, the calculation unit 12 may send a notification to the display device 16 or another terminal device that the operation cannot be performed. The file name of the template image used for image recognition, the range used for character recognition, the image and range used for color recognition, and the like are described in the second file as described above.

The operation system 10 will be described with reference to a specific example.
2 and 3 are schematic views illustrating the screen of the display device.
FIG. 4A is a schematic diagram illustrating a part of the first file. FIG. 4B is a schematic diagram illustrating a part of the second file.

In a part of the processing process by the processing device 21, the screens shown in FIGS. 2 and 3 are displayed on the display device 23 based on the video signal output from the processing device 21. On the screen A1 shown in FIG. 2A, icons B1 to B7 and information C1 regarding the work processed by the processing device 21 are displayed. On the screen A2 shown in FIG. 2B, icons B1 to B4, icons B11 to B14, and a schematic diagram D of the processing device 21 are displayed. On the screen A3 shown in FIG. 3A, icons B1 to B4, icons B21 to B24, and schematic diagram D are displayed. On the screen A4 shown in FIG. 3B, icons B1 to B4, icons B21 to B24, and information C2 regarding processing conditions are displayed by the processing device 21.

For example, when the operation system 10 is not used, the user moves the pointer to the icon B3 on the screen A1 shown in FIG. 2A and selects the icon B3. The screen A2 shown in FIG. 2B is displayed on the display device 23. The user moves the pointer to the icon B14 on the screen A2 and selects the icon B14. The screen A3 shown in FIG. 3A is displayed on the display device 23. The user moves the pointer to the icon B21 on the screen A3 and selects the icon B21. The screen A4 shown in FIG. 3B is displayed on the display device 23.

When the processing device 21 is operated by the operation system 10, the calculation unit 12 causes the screen A1 to be displayed on the display device 16. The user confirms the coordinates of the icon B3 on the screen A1 and describes them in the second file. Next, the calculation unit 12 causes the display device 16 to display the screen A2. The user cuts out a template image for determining the transition from the screen A1 to the screen A2 from the screen A2. For example, any of the schematic diagram D and the icons B11 to B14 is used as a template image. The user stores the cut out template image as image data in the storage device 14. The user describes the file name of the template image referred to at the time of determining the transition from the screen A1 to the screen A2 in the second file.

After that, the storage of the template image and the description of the file name in the second file are repeated in the same manner. For example, when the screen A3 is displayed on the display device 16, the user cuts out a template image for determining the transition of the screen from the screen A3 and stores it in the storage device 14 as image data. The user describes the file name of the template image in the second file.

For example, as shown in FIGS. 4 (a) and 4 (b), the first file and the second file are prepared for the operation by the operation system 10. In the first file, the operation executed by the calculation unit 12, such as the generation of the operation instruction for selecting a specific icon and the reference of the template image described above, is described. In the second file, the selected coordinates, the file name of the template image to be referenced, and the like are described.

The trigger for starting the operation by the operation system 10 is arbitrary. For example, the operation may be started based on a signal input to the processing device 21, a signal sent from another sensor, a measuring instrument, or the like. The operation may be initiated in response to a signal transmitted from another operating system 10 or a signal transmitted from another processing device 21 operated by another operating system 10. The signal may be transmitted at the time of operation by another operation system 10, or may be transmitted at a time other than the operation by another operation system 10. The operation may be started when a specific screen is displayed on the display device 23. The operation may be started when the user inputs a specific instruction to the arithmetic unit 12.

FIG. 5 is a flowchart showing a procedure for operation by the operation system according to the embodiment.
The user creates the first file (step S1). Next, the user creates reference data (step S2) and creates a second file (step S3). The operation system 10 automatically operates the processing device 21 using the created first file, reference data, and second file (step S4).

The effect of the embodiment will be described.
The operation system 10 acquires an output signal from the processing device 21 and inputs an operation signal corresponding to the processing device 21. Therefore, the operation system 10 can be applied to the existing processing device 21. By applying the operation system 10 to the processing device 21 whose operation is not automated, the operation of the processing device 21 can be automated. For example, the operation of the processing device 21 can be automated without modifying the processing device 21 or rewriting the program.

In the operation system 10, when operating the processing device 21, the operation file is referred to. The operation file includes the first file and the second file. The first file describes the generation operation for generating the operation instruction. The second file is created separately from the first file and is referred to when the generation operation based on the description of the first file is executed.

At the manufacturing site, a plurality of processing devices 21 of the same type may be used. The plurality of processing devices 21 can be automatically operated by the plurality of operation systems 10. In this case, a common operation file and a common reference data may be used. For example, when an operation file and reference data for operating one processing device 21 are prepared, the operation file and reference data are duplicated and used in the operation by each operation system 10.

The displayed screens may differ slightly even between processing devices 21 of the same type. For example, the positions of the same icons on the same screen may be slightly different between the processing devices 21. As a result, when the coordinates described in the second file are selected by the pointing device, the desired icon may not be selected. Even among processing devices 21 of the same type, the appearance of the template image may differ due to the influence of noise, deterioration of the video signal output unit of the processing device 21 over time, and the like. As a result, the accuracy of image recognition may decrease.

In the conventional operation system, when such a machine difference exists, it was necessary to create a new program file that corrected the machine difference. That is, a program for generating an operation instruction even though the basic operations executed by the arithmetic unit 12, the reference data used, the characters to be input, and the like are almost the same between the processing devices 21. I had to recreate the file.

In the operation system 10 according to the embodiment, the information used when generating the operation instruction is described in a second file separate from the first file. For example, if there is a deviation in the coordinates of the icon, the description of the coordinates may be changed so as to correct the deviation. When the appearance of the template image is different, the template image having a different appearance may be prepared, and the description of the second file may be changed so as to refer to the image data. According to the embodiment, the machine difference can be easily corrected, and the burden on the user required for preparing the operation system 10 can be reduced.

According to the embodiment, a processing system 1 including an operation system 10 and a processing device 21 that can reduce the burden on the user is provided.

The second file is, for example, a text file. Therefore, even a user who has no knowledge about programming can describe the second file in a text format and can easily modify the second file.

The user may try the operation in order to confirm whether there is a problem in the operation by the operation system 10 before the operation of the production line. For example, the user confirms whether the icon is properly selected, whether the image is recognized normally, and the like in the operation attempt. When a malfunction in the operation is confirmed, the user appropriately corrects the description in the second file.

The calculation unit 12 may automatically correct the coordinates described in the second file. For example, in an operation trial, the arithmetic unit 12 generates a selection operation command for selecting the coordinates described in the second file and transmits it to the generation unit 13. The generation unit 13 generates an operation signal based on the selection operation command and transmits it to the processing device 21. The calculation unit 12 recognizes the image acquired by the acquisition unit 11 after the operation signal is transmitted, and determines whether or not the template image prepared in advance is displayed. When the template image is not displayed, the arithmetic unit 12 generates another selection operation command for selecting another coordinate different from the coordinates described in the second file. For example, the other coordinates are randomly determined from the vicinity of the coordinates described in the second file. The arithmetic unit 12 transmits another selection operation command to the generation unit 13. The generation unit 13 generates another operation signal based on another selection operation command and transmits it to the processing device 21. The generation of another selection operation instruction is repeated, for example, until a prepared template image is displayed or a preset number of times is reached. The arithmetic unit 12 generates another selection operation command so as to select another coordinate different from the previous coordinates.

FIG. 6 is a flowchart showing a part of an operation trial by the operation system according to the embodiment.
For example, in the flowchart shown in FIG. 5, an operation using the first file, the second file, and the reference data is tried after steps S1 to S3 and before step S4. In a part of the trial, the arithmetic unit 12 generates a selection operation instruction for selecting a part of the screen (step S11). The generation unit 13 generates an operation signal based on the selection operation command and transmits it to the processing device 21. Based on the recognition result of the screen, the calculation unit 12 determines whether the operation to the processing device 21 by the operation signal is completed (step S12).

When the operation is not completed, the calculation unit 12 determines whether the number of trials of the selection operation is less than the specified number (step S13). When the number of trials is less than the specified number of times, the arithmetic unit 12 generates another selection operation instruction for selecting another coordinate (step S14). The generation unit 13 generates an operation signal based on the selection operation command and transmits it to the processing device 21. When the number of trials of the selection operation reaches the specified number of times, the calculation unit 12 notifies the user (step S15). For example, the display device 16 displays information informing that the operation cannot be properly executed.

When it is determined in step S12 that the operation corresponding to the selection operation command is completed, the arithmetic unit 12 changes the coordinates described in the second file to the coordinates used for the selection operation command capable of executing the selection operation. Modify (step S16). If the selection operation can be executed with the original coordinates described in the second file, the modification of the second file is not executed.

If it is necessary to correct the coordinates described in the second file by the processing according to the flowchart shown in FIG. 6, the coordinates are automatically corrected. Therefore, the convenience of the operation system 10 can be further improved.

Note that when an operation signal is input to the processing device 21, the response by the processing device 21 may be delayed. When it is determined whether the operation corresponding to the selection operation command is completed, the screen does not change due to the delay, and the screen may change normally after the determination. Therefore, for the processing device 21 where the display of the screen on the display device 23 may be delayed, the interval for transmitting the operation signal is set longer, or the operation signal based on the selection operation command is transmitted a plurality of times. For example, in the flowchart shown in FIG. 6, when the operation is not completed after a certain operation signal is input to the processing device 21, the same operation signal is input to the processing device 21 again from the generation unit 13.

(First modification)
FIG. 7 is a schematic diagram showing an operation system according to the first modification.
An input display device having a function as an input device and a display device may be connected to the processing device 21. For example, as shown in FIG. 7, a touch panel 24 is provided as an input display device. The operation system 10a according to the first modification further includes a switching unit 17. The processing system 1a includes an operation system 10a and a processing device 21.

The generation unit 13 generates an operation signal corresponding to the signal transmitted from the touch panel 24. The switching unit 17 switches the signal input to the processing device 21. Specifically, a signal transmitted from the touch panel 24 and an operation signal transmitted from the generation unit 13 are input to the switching unit 17. The switching unit 17 switches between a state in which the signal transmitted from the touch panel 24 is input to the processing device 21 and a state in which the operation signal transmitted from the generation unit 13 is input to the processing device 21. During the operation by the operation system 10a, the switching unit 17 inputs the operation signal to the processing device 21.

The switching unit 17 can prevent the user from operating the processing device 21 by the touch panel 24 during the operation by the operation system 10a. For example, it is possible to avoid the transition to another screen by the user's operation and the interruption of the operation by the operation system 10a.

The switching unit 17 includes, for example, a relay circuit or a switching circuit. By providing the switching unit 17, the processing device 21 in which the touch panel 24 is used can be operated by the operation system 10a.

Regarding the touch panel 24, even if the devices are of the same type, the coordinate deviation of the generated operation signal is large. This is because the coordinates of the sensor that detects touch and the positional relationship of the display are individually adjusted. Therefore, even when a plurality of touch panels 24 of the same type are used for a plurality of processing devices 21 of the same type, the coordinates selected or referred to at the time of automatic operation must be corrected for each processing device 21. be.

According to the embodiment, by correcting the coordinates described in the second file, it is possible to easily correct the machine difference regarding the deviation of the coordinates. Therefore, the invention according to the embodiment is particularly suitable for the processing device 21 in which the touch panel 24 is used. According to the first modification, the burden on the user on the processing system 1a including the touch panel 24 can be reduced.

(Second modification)
FIG. 8 is a schematic diagram showing an operation system according to the second modification.
The operation system 10b according to the second modification further includes a switching unit 17 as compared with the operation system 10. The signal transmitted from the generation unit 13 or the input device 22 to the processing device 21 is input to the processing device 21 via the switching unit 17. The switching unit 17 switches between a state in which the signal transmitted from the input device 22 is input to the processing device 21 and a state in which the operation signal transmitted from the generation unit 13 is input to the processing device 21.

During operation by the operation system 10b, the switching unit 17 inputs an operation signal to the processing device 21. This makes it possible to prevent the user from operating the processing device 21 using the input device 22 during the operation by the operation system 10b. According to the second modification, the convenience of the processing system 1b including the operation system 10b and the processing device 21 can be improved.

(Third modification example)
FIG. 9 is a schematic diagram showing an operation system according to the third modification.
As shown in FIG. 9, the operation system 10c according to the third modification further includes

reading devices

18a and 18b as compared with the operation system 10. The

reading devices

18a and 18b read the identification information. As the identification information, a one-dimensional bar code, a two-dimensional bar code, or a Radio Frequency IDentifier (RFID) can be used. The

readers

18a and 18b are barcode readers or RFID readers. For example, the reading device 18a reads the identification information of the operator in charge of the processing device 21. The reading device 18b reads the identification information of the work processed by the processing device 21.

For example, when executing the process by the processing device 21, the user (operator) places the work in a place where the reading device 18b can read the identification information of the work. After that, the user causes the reading device 18a to read his / her identification information. The calculation unit 12 starts the operation of the processing device 21 in response to the reading of the identification information by the reading device 18a. For example, the arithmetic unit 12 causes the reading device 18b to read the identification information of the work, and then starts generating an operation command.

The operation system 10c may generate an operation signal according to the read identification information and input it to the processing device 21. Alternatively, the identification information may be directly input from the arithmetic unit 12 to the processing device 21 via a communication port or the like by serial communication or the like.

As in the third modification, the operation system 10c may include other devices related to the processing executed by the processing device 21. The operation of the processing device 21 may be started according to the operation of the other device. This eliminates the need for the user to operate the

input device

15 or 22 to initiate the operation. According to the third modification, the convenience of the operation system 10c can be improved. The convenience of the processing system 1c including the operation system 10c and the processing device 21 can be improved.

(Fourth modification)
FIG. 10 is a schematic diagram showing an operation system according to the fourth modification.
As shown in FIG. 10, the operation system 10d according to the fourth modification is connected to the management device 30 (second device). For example, the arithmetic unit 12 is connected to the management device 30 by network, wired communication, or wireless communication. The management device 30 is a higher-level device that transmits a command to the processing device 21.

When the management device 30 transmits a command to the processing device 21, the operation system 10d receives the command. The operation system 10d executes an operation in response to an instruction. For example, the arithmetic unit 12 generates an operation instruction according to the instruction and transmits it to the generation unit 13.

For example, a plurality of operation files are stored in the storage device 14. The arithmetic unit 12 selects one of the plurality of operation files according to the instruction transmitted from the management device 30. The arithmetic unit 12 executes the program included in the selected operation file and generates an operation instruction. Alternatively, the instruction transmitted from the management device 30 may be used as a trigger for starting the operation.

The management device 30 may be connected to a plurality of operation systems 10d. The operation by the operation system 10d may be started in response to the signal transmitted from another operation system 10c or the signal transmitted from another processing device 21 operated by another operation system 10d. The signal may be transmitted at the time of operation by another operation system 10d, or may be transmitted at a time other than the operation by another operation system 10d. By transmitting and receiving signals for starting operations between three or more of the plurality of operation systems 10d, the plurality of processing devices 21, and the management device 30, for example, the plurality of processing devices 21 can be efficiently operated. can.

The operation system 10d may input parameters related to the processing executed by the processing device 21 to the processing device 21. The parameters are the number of workpieces to be processed, conditions at the time of processing execution, and the like. The conditions are, for example, temperature, pressure, gas or liquid flow rate, current, voltage, processing time and the like. The operation system 10d generates an operation signal for inputting a numerical value of a parameter and transmits it to the processing device 21. As a result, a numerical value is input to the text box or the like displayed on the display device 23.

The management device 30 may transmit parameters input from the operation system 10d to the processing device 21 to the operation system 10d. The operation system 10d receives a numerical value input as a parameter and generates an operation signal according to the numerical value. As a result, the numerical value transmitted from the management device 30 is input to the processing device 21.

The management device 30 may transmit information about the workpiece to be processed to the operation system 10d. For example, the management device 30 transmits the work identification information (ID) to the operation system 10d. The operation system 10d inputs the identification information to the processing device 21 via the communication port. Alternatively, the operation system 10d may generate an operation signal according to the identification information and input it to the processing device 21.

At the manufacturing site, higher-level equipment may be installed to manage multiple processing equipment. On the other hand, there are cases where a command cannot be directly transmitted from the management device 30 to the processing device 21 due to compatibility of communication IFs between the processing device 21 and the management device 30, differences in communication standards, and the like. For example, if the processing device 21 is old, the processing device 21 may not accept the command transmitted from the management device 30. In this case, by using the operation system 10d, the processing device 21 can be managed by the management device 30. For example, it is not necessary to modify the processing device 21, and the production efficiency can be improved more easily. By using the operation system 10d, the operating status of a single or a plurality of processing devices 21 can be transmitted to the management device 30. Therefore, the management device 30 can easily acquire information on the operating rate or the operating status of the single or a plurality of processing systems 1d.

FIG. 11 is a schematic diagram showing the hardware configuration of the operation system according to the embodiment.
For example, the arithmetic unit 12 is a computer and includes a ROM 12a, a RAM 12b, a CPU 12c, and an HDD 12d. The ROM 12a stores a program that controls the operation of the computer. The ROM 12a stores programs necessary for realizing various processes in a computer.

The RAM 12b functions as a storage area in which the program stored in the ROM 12a is expanded. The CPU 12c includes a processing circuit. The CPU 12c reads the control program stored in the ROM 12a and controls the operation of the computer according to the control program. The CPU 12c expands various data obtained by the operation of the computer into the RAM 12b. The HDD 12d stores data necessary for reading and data obtained in the process of reading. The HDD 12d may function as the storage device 14 shown in FIG.

Convenience can be improved by using the operation system, processing system, or operation method described above. Similarly, the convenience of the operation system can be improved by using a program for causing the computer to execute the above-mentioned processing or a storage medium in which the program is stored.

The above-mentioned various data processing can be performed by a computer as a program that can be executed by a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, CD-R, CD-RW, DVD-ROM, DVD ± R). , DVD ± RW, etc.), and may be recorded on a non-transitory computer-readable storage medium such as a semiconductor memory.

For example, the data recorded on the recording medium can be read by a computer (or embedded system). In the recording medium, the recording format (storage format) is arbitrary. For example, the computer reads a program from the recording medium and causes the CPU to execute the instructions described in the program based on the program. In the computer, the acquisition (or reading) of the program may be performed through the network.

Although some embodiments of the present invention have been exemplified above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other embodiments, and various omissions, replacements, changes, and the like can be made without departing from the gist of the invention. These embodiments and variations thereof are included in the scope and gist of the invention, and are also included in the scope of the invention described in the claims and the equivalent scope thereof. Each of the above embodiments can be implemented in combination with each other.

Claims

An acquisition unit that acquires the output from the first device that is the operation target, and
An arithmetic unit that generates operation instructions based on the output acquisition result and the operation file created in advance.
A generation unit that generates an operation signal corresponding to the first device based on the operation command and transmits it to the first device.
Equipped with
The operation file is
The first file in which the generation operation for generating the operation instruction is described, and
A second file that is referenced during the execution of the generation operation and contains information used to identify the output and generate the operation signal.
Including the operation system.
The output includes a video signal transmitted from the first device to the display device.
The operation system according to claim 1, wherein the second file includes coordinates on which a selection operation to the first device by an input device is executed on the screen of the display device.
The operation system according to claim 2, wherein the calculation unit recognizes an image indicated by the video signal, and determines whether or not the operation of the operation signal to the first device is completed based on the recognition result of the image.
When the operation command includes a selection operation command for selecting the coordinates and the operation to the first device by the operation signal based on the selection operation command is not completed, the calculation unit is different from the coordinates. The operation system according to claim 3, wherein another selection operation instruction for selecting coordinates is generated.
The operation system according to claim 3 or 4, wherein the calculation unit executes at least one selected from pattern matching, character recognition, and color recognition in the recognition of the image.
The operation system according to any one of claims 1 to 5, further comprising a switching unit for transmitting a signal from one of the input device and the generation unit to the first device.
The second file is the operation system according to any one of claims 1 to 6, which is described in a text format.
The arithmetic unit
The command is received from the second device that transmits the command to the first device, and the command is received.
In response to the instruction, the generation of the operation instruction is started.
The operation system according to any one of claims 1 to 7.
Further equipped with a reader to read the identification information,
The operation system according to any one of claims 1 to 8, wherein the calculation unit starts generating the operation instruction in response to reading the identification information by the reading device.
The operation system according to any one of claims 1 to 8.
The first device that executes the processing of the work and
Processing system equipped with.
Acquires the output from the first device that is the operation target,
An operation instruction is generated based on the acquisition result of the output and the operation file created in advance.
An operation method for generating an operation signal corresponding to the first device based on the operation command and transmitting the operation signal to the first device.
The operation file is
The first file in which the generation operation for generating the operation instruction is described, and
A second file that is referenced during the execution of the generation operation and contains information used to identify the output and generate the operation signal.
Operation method including.
The output includes a video signal transmitted from the first device to the display device.
The operation method according to claim 11, wherein the second file includes coordinates on which a selection operation to the first device by an input device is executed on the screen of the display device.
The operation method according to claim 12, wherein the image indicated by the video signal is identified, and based on the recognition result of the image, it is determined whether or not the operation to the first device by the operation signal is completed.
When the operation command includes a selection operation command for selecting the coordinates and the operation to the first device by the operation signal based on the selection operation command is not completed, another coordinate different from the coordinates is selected. 13. The operation method according to claim 13, wherein the selection operation command of the above is generated.
A program that causes a computer to generate an operation command in response to the reception of the output acquisition result from the first device that is the operation target.
Includes a description of the generation operation for generating the operation instruction.
A program that causes the computer to refer to a file containing information used to identify the output and generate an operation signal when performing the generation operation.
The output includes a video signal transmitted from the first device to the display device.
The program according to claim 15, wherein the file includes coordinates on which a selection operation to the first device by an input device is executed on the screen of the display device.
The program according to claim 16, wherein the computer recognizes an image indicated by the video signal, and based on the recognition result of the image, determines whether or not the operation of the operation signal to the first device is completed.
When the operation command includes a selection operation command for selecting the coordinates and the operation to the first device by the operation signal based on the selection operation command is not completed, the computer has coordinates different from the coordinates. 17. The program of claim 17, which causes another selection operation instruction to select.
A storage medium that stores the program according to any one of claims 15 to 18.