AU2021302559B2 - Operating system multiplexing device - Google Patents

Abstract

An operating system multiplexing device according to an embodiment comprises: an image signal acquisition unit of an information processing device having a GUI output unit that outputs a GUI image combined with state information of a to-be-controlled device, a GUI operating unit that receives operating input pertaining to the GUI image, and a communication terminal that is compatible with the EIA-232 standard, the image signal acquisition unit being provided so as to be connectable to the GUI output unit, and receiving input of the GUI image; an image state recognition unit that acquires numerical value information of a control element of the to-be-controlled device expressed in the GUI image acquired by the image signal acquisition unit, converts the numerical value information to a numerical value, and associates the same with the control element; and a state information output terminal that outputs the numerical value and the GUI image using the TCP/IP protocol.

Description

Docket No. PTIA-22147-IN, AU, EA: FINAL

DESCRIPTION OPERATION SYSTEM MULTIPLEXING DEVICE TECHNICAL FIELD

[0001] Embodiments of the present invention relate to an

operation system multiplexing device.

BACKGROUND ART

[0002] Controllers for controlling input/output (I/O)

devices and the like have been used in control systems of

industrial plants (hereinafter, also simply referred to as

"plants"), for example. Furthermore, a plant monitoring

device such as a human machine interface (HMI) is used in

order for a worker to monitor a situation and the like of

processing in such a controller and give an instruction to

a control systemas necessary.

[0003] For example, the plant monitoring device displays

a situation in the plant on a display screen, and the

worker looks at the display screen and performs operation

input with an input device (e.g., keyboard) as necessary.

Furthermore, the content (e.g., alarm occurrence) of the

display screen and the content (e.g., device stop

instruction) of operation input of the worker often have

correspondence relation. Thus, the plant monitoring device

may be modified for automating (at least a part of (the

same applies hereinafter)) operation thereof such that,

when a predetermined display screen is generated, the plant

monitoring device automatically acquires the content of the

corresponding operation input.

1 20367277_1(GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

CITATION LIST

Patent Literature

[0004] Patent Literature 1: Japanese Patent No. 5740634

Patent Literature 2: Japanese Patent No. 6591937

Patent Literature 3: Japanese Patent No. 6679247

Patent Literature 4: Japanese Patent Application Laid

open No. 2002-244702

Patent Literature 5: Japanese Patent Application Laid

open No. H11-327627

SUMMARY OF INVENTION

[0005] However, in conventional technology, automation

cannot be achieved when a plant monitoring device is old

and cannot be modified for automation, or when a user does

not desire to modify the plant monitoring device due to

various circumstances.

[0006] Therefore, one or more embodiments of the present

invention provide an operation system multiplexing device

capable of multiplexing an operation system including

automation without modifying a target device such as the

plant monitoring device.

[0007] An operation system multiplexing device according

to embodiments includes:

an image signal acquisition unit configured to receive

a graphical user interface (GUI) image combined with state

information on a control target device, the image signal

acquisition unit being able to be connected to a GUI output

unit of an information processing device, and the

information processing device including: the GUI output

unit that outputs the GUI image; a GUI operating unit that

receives operation input to the GUI image; and a

communication terminal compatible with an electronic

industries alliance (EIA)-232 standard;

2 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

an operation information table storage unit configured

to store operation information in accordance with an image

state of the GUI image;

an image state recognition unit configured to

recognize the image state of the GUI image acquired by the

image signal acquisition unit, and acquire numerical

information expressed in the GUI image as a numerical

value; and

an operation information generation unit configured to

refer to the operation information table storage unit in

accordance with the image state recognized by the image

state recognition unit, and acquire corresponding operation

information;

an operation information output terminal configured to

output the operation information, the operation information

output terminal being able to be connected to the

communication terminal;

a state information output terminal configured to

output the numerical value in accordance with a TCP/IP

protocol; and

a first operation system multiplexing device and a

second operation system multiplexing device as a duplexed

configuration of the operation system multiplexing device,

wherein:

each of the first operation system multiplexing

device and the second operation system multiplexing device

is connected to the information processing device, and

the second operation system multiplexing device

includes a monitoring unit configured to switch, in a case

where the first operation system multiplexing device is in

an operating state and the second operation system

multiplexing device is in a standby state, a state of the

second operation system multiplexing device from the

3 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

standby state to the operating state when a periodic signal

to be transmitted by the first operation system

multiplexing device has not been received for a

predetermined period of time or more since previous

reception time.

[0007A] An operation system multiplexing device according

to embodiments includes:

an image signal acquisition unit configured to receive

a GUI image combined with state information on a control

target device, the image signal acquisition unit being able

to be connected to a GUI output unit of an information

processing device, and the information processing device

including: the GUI output unit that outputs the GUI image;

a GUI operating unit that receives operation input to the

GUI image; and a communication terminal compatible with an

EIA-232 standard;

an operation information table storage unit configured

to store operation information in accordance with an image

state of the GUI image;

an image state recognition unit configured to

recognize the image state of the GUI image acquired by the

image signal acquisition unit, and acquire numerical

information expressed in the GUI image as a numerical

value;

an operation information generation unit configured to

refer to the operation information table storage unit in

accordance with the image state recognized by the image

state recognition unit, and acquire corresponding operation

information;

an operation information output terminal configured to

output the operation information, the operation information

output terminal being able to be connected to the

communication terminal; and

4 20367277_1(GHMatters) P1 20524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

a state information output terminal configured to

output the numerical value in accordance with a TCP/IP

protocol, wherein

the operation information generation unit is

connected to an external device connected to the

information processing device via an input/output card and

performs input/output of information with the external

device, the input/output card being mounted in an extension

slot of the operation system multiplexing device and

including a contact output terminal that simulates on/off

of a switch.

BRIEF DESCRIPTION OF DRAWINGS

[0008] FIG. 1 is an overall configuration diagram of a

control system according to a first embodiment.

FIG. 2 is a configuration diagram of an operation

system multiplexing device and a plant monitoring device

according to the first embodiment.

FIG. 3A illustrates an example of a display screen of

a display device according to the first embodiment.

FIG. 3B illustrates an example of the display screen

of the display device according to the first embodiment.

FIG. 4 illustrates an example of the display screen of

the display device according to the first embodiment.

FIG. 5 is a flowchart illustrating the overall

processing of the operation system multiplexing device

according to the first embodiment.

FIG. 6 is a flowchart illustrating details of

processing in Step S1 in FIG. 5.

FIG. 7 is a flowchart illustrating details of

processing in Step S2 in FIG. 5.

FIG. 8 is an overall configuration diagram of a

control system according to a second embodiment.

5 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

FIG. 9 is an overall configuration diagram of a

control system according to a third embodiment.

FIG. 10 is an overall configuration diagram of a

control system according to a fourth embodiment.

FIG. 11 is an overall configuration diagram of a

control system according to a fifth embodiment.

FIG. 12 is an overall configuration diagram of a

control system according to a seventh embodiment.

FIG. 13 is an overall configuration diagram of a

control system according to an eighth embodiment.

FIG. 14 illustrates an example of a notification

destination information table according to the eighth

embodiment.

FIG. 15 is an overall configuration diagram of a

control system according to a ninth embodiment.

FIG. 16 illustrates an example of an authority

information table according to the ninth embodiment.

DESCRIPTION OF EMBODIMENTS

[0009] Embodiments of an operation system multiplexing

device of the present invention will be described with

reference to the drawings. In the following embodiments,

an example of a case where the operation system

multiplexing device is applied to a control system of an

industrial plant will be described.

[0010] (First Embodiment)

FIG. 1 is an overall configuration diagram of a

control system S according to a first embodiment. FIG. 2

is a configuration diagram of an operation system

multiplexing device 1 and a plant monitoring device 2

according to the first embodiment. The control system S

includes the operation system multiplexing device 1 and the

plant monitoring device 2. The plant monitoring device 2

6 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

includes an information processing device 21, a display

device 22, and a keyboard 23 (graphical user interface

(GUI) operating unit). Note that, in FIG. 2, lines

connecting configurations indicate main connection

relations, and configurations that are not connected by a

line may be actually connected.

[0011] The information processing device 21 is connected

to a controller, and transmits and receives information to

and from the controller. The controller controls an I/O

device and a sensor, an actuator, and the like

(hereinafter, also referred to as control target device)

connected to the I/O device. Furthermore, the information

processing device 21 displays a situation of a plant on the

display device 22 based on information collected from the

controller and the like.

[0012] The information processing device 21 includes a

GUI output unit P23, a port P21, and a communication

terminal (port P22) for control signals. The GUI output

unit P23 outputs a VGA image of a GUI combined with state

information (e.g., information illustrated in water level

display region A2 in FIGS. 3A and 3B) on a control target

device. A man-machine interface such as a keyboard, a

mouse, and a touch panel for operating the GUI is connected

to the port P21. The port P22 is compatible with an

electronic industries alliance (EIA)-232 standard.

[0013] The port P23 of the information processing device

21 is connected to a port P12 of the operation system

multiplexing device 1 via a cable (reference sign R2) such

as a video graphics array (VGA) and a digital visual

interface (DVI). This configuration allows the information

processing device 21 to transmit image information to a

signal distribution unit 11 of the operation system

multiplexing device 1. Furthermore, a port P13 of the

7 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

operation system multiplexing device 1 is connected to the

display device 22 via a cable (reference sign R3) such as a

VGA and a DVI. This configuration causes the signal

distribution unit 11 of the operation system multiplexing

device 1 to serve as an image relay unit having a function

of distributing image signals and relay image information

output from the information processing device 21 to output

the image information to the display device 22. Therefore,

the display device 22 displays the same image as a

conventional image.

[0014] The operation system multiplexing device 1

converts numerical information expressed in an image input

from the port P23 into a numerical value capable of being

computed by a CPU. The numerical value is subjected to

computation processing or accumulated. The result is

output from a LAN port P14 serving as a state information

output terminal in accordance with a transmission control

protocol/internet protocol (TCP/IP) at predetermined timing

or in response to a request from the outside.

[0015] Hardware of the information processing device 21

is not assumed to be modified, so that the original

operation system is maintained. The information processing

device 21 may be connected to the keyboard 23 via a cable

such as a personal system/2 (PS/2) (registered trademark)

through the port P21, and wait for input. Furthermore, for

example, UNIX (registered trademark) and an operation

systems (OSs) whose manufacturer support (e.g., security

measure) has been ended are assumed as an OS of the

information processing device 21, the OS is not limited

thereto.

[0016] Note, however, that, in a sequence of control

operation of the information processing device 21, it may

be necessary to wait for a control signal input from the

8 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

communication terminal, and, when a specific control signal

is input, perform setup for performing internal processing

in accordance with the control signal or software

implementation.

[0017] A worker looks at a display screen of the display

device 22, operates the keyboard 23 that receives operation

input to the GUI image, and inputs information to the

information processing device 21. For example, the worker

can operate the keyboard 23 and instruct the information

processing device 21 to stop the device by looking at a

screen, indicating alarm occurrence, displayed on the

display device 22.

[0018] FIG. 3A illustrates an example of a display

screen of the display device 22 according to the first

embodiment. In the screen example, a GUI screen includes a

screen selection region Al and a screen region based on a

control element input from the controller. Then, the

screen region based on a control element input from the

controller includes, for example, a tank T, pipes El and

E2, a first solenoid valve Bl, a second solenoid valve B2,

a water level sensor W, the screen selection region Al, and

the water level display region A2. In FIG. 3A, the tank T,

the pipes El and E2, the first solenoid valve Bl, and the

second solenoid valve B2 serve as examples of the control

element.

[0019] The screen selection region Al is provided in an

upper left portion of the screen. The screen selection

region Al performs display for a user to select a screen

such as a state monitoring screen (screen in FIG. 3A), an

operating screen (screen in FIG. 4), a parameter setup

screen, a trend graph display screen, and the like.

[0020] The tank T schematically illustrates a tank,

which is a liquid storage facility in the plant. The pipes

9 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

El and E2 schematically illustrate pipes, which are liquid

flow paths. The first solenoid valve B1 and the second

solenoid valve B2 schematically illustrate solenoid valves

for allowing and blocking a flow of liquid in the pipes El

and E2. The water level sensor W schematically illustrates

a sensor that measures a water level of liquid in the tank

T.

[0021] The water level display region A2 is provided in

a lower right portion of the screen. A numerical value of

a water level in the tank T measured by the water level

sensor W and the like are displayed on the water level

display region A2. As described above, in the present

embodiment, an image related to a water level of a control

element (e.g., tank T) of the controller is displayed.

[0022] The worker can grasp the situation of the water

level of the tank T in the plant and the like by looking at

such a screen. Furthermore, in the screen example, at the

time of alarm occurrence, a predetermined region (e.g.,

water level display region A2) in the screen is blinked in

red, for example.

[0023] Furthermore, in the screen example, at the time

of alarm occurrence due to an excessively increased water

level, as illustrated in FIG. 3B, "water level OVER" may be

displayed in the water level display region A2, for

example.

[0024] Furthermore, FIG. 4 illustrates an example of a

display screen of the display device 22 according to the

first embodiment. In the screen example, the screen

selection region Al and operating regions A3 to A5 are

illustrated.

[0025] The screen selection region Al is similar to that

in FIG. 3A. The operating regions A3 to A5 are provided in

a central portion of the screen. In the operating regions

10 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

A3 to A5, for example, a plurality of controls that can be

executed by control elements is displayed in a selectable

manner for each control element of the controller. For

example, in the operating region A3, display is performed

for operating start, stop, and the like of operation of the

tank T and a facility related thereto. Furthermore, for

example, in the operating regions A4 and A5, display is

performed for operating start, stop, and the like of

operation of other facilities in the plant.

[0026] The worker can perform various operations (e.g.,

instruction to start or stop operation of predetermined

facility) in the operating regions A3 to A5 by using such a

screen.

[0027] Returning to FIGS. 1 and 2, the operation system

multiplexing device 1 is a computer device, and includes

the signal distribution unit 11, an acquisition unit 12

(image signal acquisition unit), a computation unit 13, and

a storage unit 14 as main configurations. A port P11

(operation information output terminal) can be connected to

the port P22 of the information processing device 21, and

outputs operation information in response to an instruction

from the computation unit 13. The computation unit 13

(operation information generation unit) is connected to the

information processing device 21 via the port P11

(operation information output terminal) and a cable

(reference sign R1). In this case, the information

processing device 21 uses an existing interface, which

eliminates the need for modification.

[0028] The signal distribution unit 11 receives an image

signal from the information processing device 21, and

outputs the image signal to the display device 22 and the

acquisition unit 12. The acquisition unit 12 acquires the

image signal from the signal distribution unit 11.

11 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

[0029] The storage unit 14 includes, for example, a

random access memory (RAM), a read only memory (ROM), and a

hard disk drive (HDD), and stores various pieces of

information. The storage unit 14 includes an operation

information table storage unit 14a that stores operation

information in accordance with an image state of a GUI

image. The operation information table storage unit 14a

stores the correspondence relation between the content of

the display screen configured by an image signal output by

the information processing device 21 and an operation

signal output from the keyboard 23 to the information

processing device 21 by operation of the worker, for

example. Furthermore, the storage unit 14 stores an

engineering tool as software. The engineering tool has,

for example, an engineering function of recording and

setting operation of the worker and an operation

reproducing function of reproducing the set operation.

[0030] The computation unit 13 includes, for example, a

central processing unit (CPU), and implements various

pieces of computation processing by executing an

application program. For example, the computation unit 13

recognizes the content of the display screen by performing

image processing based on the image signal acquired by the

acquisition unit 12. In that case, for example, the

computation unit 13 recognizes that a predetermined region

in the screen blinks in red on the screen of FIG. 3A.

Furthermore, in the image processing of the computation

unit 13, characters (including numerical value) are

recognized by using character recognition technology used

for optical character recognition (OCR), converted into

character information, and held.

[0031] Specifically, for example, the computation unit

13 functions as an image state recognition unit that

12 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

recognizes the image state of the GUI image acquired by the

acquisition unit 12 and acquires numerical information

expressed in the GUI image as a numerical value. For

example, in the GUI screen in FIG. 3A, numerical

information indicating a water level is displayed as an

image in the water level display region A2. Then, the

computation unit 13 acquires, as the image state

recognition unit, numerical information represented as an

image in the water level display region A2 as a numerical

value. That is, for example, the computation unit 13 can

recognize the image state indicated in the water level

display region A2 by recognizing a water level as a

numerical value. Furthermore, for example, the computation

unit 13 can recognize the image state indicated in the

water level display region A2 by recognizing an image

related to a water level.

[0032] The computation unit 13 refers to the operation

information table storage unit 14a of the storage unit 14

in accordance with the recognized image state, and acquires

corresponding operation information. Then, the computation

unit 13 outputs the operation information to the

information processing device 21. For example, the

operation information table storage unit 14a stores an

image related to a water level (e.g., image including

characters "water level OVER" in water level display region

A2 in FIG. 3B) as an image state of the GUI image and the

corresponding operation information in association with

each other. This causes the computation unit 13 to acquire

operation information associated with the recognized image

related to a water level.

[0033] As a specific example, for example, a case in

which the content of the display screen relates to alarm

occurrence and an operation signal gives an instruction to

13 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

stop a device is conceivable. In addition, for example, a

case in which the content of the display screen relates to

a predetermined parameter value and the operation signal

changes a setting value of a controller (e.g., indicates

numerical value) is conceivable.

[0034] Furthermore, for example, the computation unit 13

functions as a notification unit that outputs, from the

port P13, an image signal for a notification screen

indicating that the worker should respond when a recognized

image state is not stored in the operation information

table storage unit 14a. As a specific example of a case

where notification is given, for example, a case where the

content of the display screen indicates the state of

unexpected changes in water level in a tank for storing

liquid in a plant is conceivable.

[0035] Furthermore, for example, in the content of the

display screen, a predetermined region in the screen is

colored in any of green, red, and yellow as state display

related to the water level in the tank for storing liquid

in the plant. In that case, for example, in a case of

green, it is determined that there is no problem and no

response is required to be made. In a case of red, it is

determined that there is a problem, and a predetermined

operation signal is required to be generated to be

transmitted to the information processing device 21. In a

case of yellow, notification is required to be given.

[0036] Next, overall processing of the operation system

multiplexing device 1 according to the first embodiment

will be described with reference to FIG. 5. FIG. 5 is a

flowchart illustrating the overall processing of the

operation system multiplexing device 1 according to the

first embodiment.

[0037] In Step S1, the operation system multiplexing

14 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

device 1 performs setting processing. FIG. 6 is a

flowchart illustrating details of the processing in Step Sl

in FIG. 5. In Step Sl, the computation unit 13 stores an

operation execution image in the storage unit 14. That is,

for this setting processing, the worker performs a series

of operations, and captures an image (moving image) at the

time (stores the image in the storage unit 14). For

example, in the screen of FIG. 3B associated with a case

where the water level of the tank excessively increases,

the worker designates the water level display region A2,

and the computation unit 13 captures an image including the

characters of "water level OVER" in the water level display

region A2 (stores the image in the storage unit 14).

[0038] Next, in Step S12, the computation unit 13 sets

an operation desired to be reproduced by using a recorded

image. Specifically, a moving image is stopped by a user

operation at the timing when an operation is desired to be

reproduced in the middle of the image, and an operation

signal associated with an image of a specific region of the

still image is set in accordance with the user operation.

For example, the computation unit 13 sets an operation

signal related to closing of the first solenoid valve B1 as

an operation signal associated with the screen of FIG. 3B.

[0039] The teaching operation is repeated, and the

operation content associated with the state of a specific

region image is tabulated and accumulated in the storage

unit 14 to generate the operation information table storage

unit 14a. Note that Step Sl is performed offline.

[0040] Returning to FIG. 5, after Step S1, in Step S2,

the operation system multiplexing device 1 performs

operation reproduction processing. FIG. 7 is a flowchart

illustrating details of processing in Step S2 in FIG. 5.

In Step S21, the acquisition unit 12 acquires an image

15 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

signal from the information processing device 21 via the

signal distribution unit 11.

[0041] Next, in Step S22, the computation unit 13

recognizes the content of the display screen based on the

image signal acquired in Step S21.

[0042] Next, in Step S23, the computation unit 13

determines whether or not the content of the display screen

recognized in Step S22 is in the correspondence relation

stored in the storage unit 14. If Yes, the processing

proceeds to Step S24. If No, the processing proceeds to

Step S26.

[0043] Here, specific examples of Steps S22 and S23 will

be described. For example, when an image in the water

level display region A2 includes the characters of "water

level OVER" as illustrated in the screen of FIG. 3B, the

computation unit 13 makes a determination of Yes in Step

S23 based on the image signal acquired in Step S21.

[0044] In Step S24, the computation unit 13 generates an

operation signal associated with the content of the display

screen based on the content of the display screen

recognized in Step S22 and the correspondence relation

stored in the operation information table storage unit 14a

of the storage unit 14. In Step S25, the computation unit

13 outputs the operation signal to the information

processing device 21. This enables the information

processing device 21 to perform processing based on the

input operation signal.

[0045] In Step S26, the computation unit 13 notifies the

worker to respond. This causes the worker to know that the

worker should respond, and the worker can appropriately

respond. Note that Step S2 is performed online.

[0046] Returning to FIG. 5, after Step S2, in Step S3,

the operation system multiplexing device 1 determines

16 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

whether or not to perform resetting. If Yes, the

processing returns to Step S1. If No, the processing

returns to Step S2. Note that, when the user performs an

operation of resetting start with the keyboard 23, a

determination of Yes is made in Step S3.

[0047] As described above, according to the operation

system multiplexing device 1 of the first embodiment, an

operation system can be multiplexed including automation

without modifying the plant monitoring device 2 by

generating an operation signal associated with the content

of the recognized display screen based on an image signal

output by the information processing device 21 and

outputting the operation signal to the information

processing device 21.

[0048] That is, even when the plant monitoring device 2

is too old to be modified for automation, or when a user

does not desire to modify the plant monitoring device 2 due

to various circumstances, the plant monitoring device 2 can

be automated, and labor saving and telework can be easily

achieved.

[0049] In contrast, in such a case, in order to achieve

labor saving and telework by a conventional technique, the

plant monitoring device 2 needs to be replaced with the

latest device to use techniques such as robotic process

automation (RPA) and a remote desktop. This places a great

burden in terms of cost and labor.

[0050] According to the present embodiment, only a small

burden is placed in terms of cost and labor. That is, it

is only required to produce the operation system

multiplexing device 1 mounted with software (created by

engineering tool) capable of generating an operation signal

in accordance with a change in the content of the display

screen and operate the operation system multiplexing device

17 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

1 by connecting the operation system multiplexing device 1

to the plant monitoring device 2 with a cable having an

existing specification.

[0051] Then, since the operation system multiplexing

device 1 can perform operation of the worker instead, labor

can be saved. Labor saving and manpower saving are

important in a site in an age of manpower shortage due to

aging population with fewer children. It is meaningful

that operations of conventional facilities can be

automated.

[0052] (Second Embodiment)

Next, a second embodiment will be described.

Description and illustration of matters similar to the

matters described so far will be appropriately omitted (the

same applies to the third and subsequent embodiments). In

the second embodiment, a case where work originally

performed by a plurality of workers is performed by one

worker will be described. FIG. 8 is an overall

configuration diagram of a control system S according to

the second embodiment.

[0053] In a plant P, an I/O device 10 connected to

various sensors (not illustrated) and the like is connected

to a controller C. An information processing device 21 is

connected to the controller C. An operation system

multiplexing device 1 is connected to a plant monitoring

device 2 via a cable. A display device D with high

resolution is connected to the operation system

multiplexing device 1, and aggregates and displays display

screens of four display devices 22. At that time,

information for identifying each display screen is assigned

to each display screen. Furthermore, a storage unit 14

(FIG. 2) of the operation system multiplexing device 1

stores correspondence relations related to a plurality of

18 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

workers.

[0054] Furthermore, operations of a worker includes

routine work and non-routine work (e.g., alarm processing

that needs complicated determination). The operation

system multiplexing device 1 automates the former work.

The worker performs the latter work.

[0055] A worker M can concentrate on non-routine work by

automating the routine work with the operation system

multiplexing device 1. That is, the number of workers can

be reduced.

[0056] As described above, according to the operation

system multiplexing device 1 of the second embodiment, the

number of workers can be reduced by automating the routine

work with the operation system multiplexing device 1.

[0057] (Third Embodiment)

Next, a third embodiment will be described. In the

third embodiment, a case where work originally performed by

a plurality of workers is performed by one worker and the

worker performs telework will be described. FIG. 9 is an

overall configuration diagram of a control system S

according to a third embodiment. An operation system

multiplexing device 1 is connected to a display device D

via a cloud CL (e.g., cloud server).

[0058] A worker M can monitor a state by telework by

looking at a display screen of the display device D in a

facility H outside a plant P. When a non-routine work is

needed, the operation system multiplexing device 1 notifies

the worker of the fact with the display device D and the

like. Then, the worker M responds.

[0059] As described above, according to the operation

system multiplexing device 1 of the third embodiment, the

worker can monitor a state and perform non-routine work at

a remote place outside the plant P.

19 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

[0060] (Fourth Embodiment)

Next, a fourth embodiment will be described. For a

fail-safe purpose, an operation system multiplexing device

1 can be duplicated. FIG. 10 is an overall configuration

diagram of a control system S according to the fourth

embodiment. Note that, in FIG. 10, illustration of a

configuration not changed from FIG. 2 is appropriately

omitted (the same applies to FIG. 11 and subsequent

drawings). The control system S in FIG. 10 includes a

first operation system multiplexing device la and a second

operation system multiplexing device lb as a duplexed

configuration of the operation system multiplexing device

1.

[0061] States of connection of the first operation

system multiplexing device la and the second operation

system multiplexing device lb to the plant monitoring

device 2 and data flows are as follows. Data of RS-232C

from the first operation system multiplexing device la and

the second operation system multiplexing device lb is input

to the information processing device 21 of the plant

monitoring device 2 by a bifurcated cable (reference sign

R1).

[0062] Furthermore, image signals from the information

processing device 21 of the plant monitoring device 2 are

input to the first operation system multiplexing device la

and the second operation system multiplexing device lb by a

bifurcated cable (reference sign R2).

[0063] Furthermore, image signals from the first

operation system multiplexing device la and the second

operation system multiplexing device lb are input to the

display device 22 of the plant monitoring device 2 by a

bifurcated cable (reference sign R3).

[0064] Note that, since the first operation system

20 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

multiplexing device la and the second operation system

multiplexing device lb do not simultaneously output data

and image signals to the plant monitoring device 2, a

problem such as simultaneous transmission of data and image

signals does not occur even when the above-described

bifurcated cable is used.

[0065] Then, when the first operation system

multiplexing device la is in an operating state and the

second operation system multiplexing device lb is in a

standby state, a periodic signal transmitting unit 16 of

the first operation system multiplexing device la transmits

a periodic signal (e.g., heartbeat signal) to the second

operation system multiplexing device lb via a twisted pair

cable R4 that couples local area network (LAN) ports with

each other. A monitoring unit 17 of the second operation

system multiplexing device lb switches the state of the

second operation system multiplexing device lb from the

standby state to the operating state when the monitoring

unit 17 has not received the periodic signal for a

predetermined period of time or more since the previous

reception time.

[0066] In this way, according to the operation system

multiplexing device 1 of the fourth embodiment, the

operation system multiplexing device 1 is duplexed, so

that, even when the first operation system multiplexing

device la fails, processing can be continued by switching

the state of the second operation system multiplexing

device lb from the standby state to the operating state.

[0067] (Fifth Embodiment)

Next, a fifth embodiment will be described. FIG. 11

is an overall configuration diagram of a control system S

according to the fifth embodiment. A computation unit 13

of an operation system multiplexing device 1 is connected

21 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

to an external device 102 (e.g., mechanical switch (e.g.,

emergency button), graphic panel, emergency light, and

speaker of another system) connected to an information

processing device 21 via an input/output card 101. The

input/output card 101 is mounted in an extension slot 18

(e.g., peripheral component interconnect (PCI) express

slot) of the operation system multiplexing device 1 and

includes a contact output terminal that simulates on/off of

a switch. The computation unit 13 performs input/output of

information with the external device 102.

[0068] For example, when the external device 102 is an

emergency button having a mechanical switch, the

computation unit 13 recognizes that the emergency button

has been pressed by receiving a contact signal via the

input/output card 101. Furthermore, for example, when the

external device 102 is a speaker that outputs a warning

sound by input of a contact signal, the computation unit 13

can cause the speaker to output the warning sound by

transmitting the contact signal to the speaker via the

input/output card 101.

[0069] In this way, according to the operation system

multiplexing device 1 of the fourth embodiment, the

existing external device 102 can be effectively used.

[0070] (Sixth Embodiment)

Next, a sixth embodiment will be described. In an

operation system multiplexing device 1 in FIG. 2, a

computation unit 13 functions as a storage control unit

that causes a storage unit 14 (semiconductor storage

device) to store data including a log related to an

information processing device 21. Here, the data including

a log includes, for example, an operation log and trend

data, may include the content of a display screen

recognized by an image signal acquired by an acquisition

22 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

unit 12 or by performing image processing based on the

acquired image signal, and includes, for example, data

indicating that a predetermined region in a screen in the

screen of FIG. 3A blinks in red and character information

and numerical information acquired by the computation unit

13 by using OCR.

[0071] The old information processing device 21 has a

small storage capacity so that only data for three days can

be stored. The data needs to be transferred to another

storage medium every three days. In contrast, according to

the operation system multiplexing device 1 of the sixth

embodiment, if data for one month can be stored by the

computation unit 13 causing the storage unit 14 to store

the data by using the storage unit 14 having large storage

capacity, the frequency of such data migration work can be

beneficially reduced.

[0072] (Seventh Embodiment)

Next, a seventh embodiment will be described. FIG. 12

is an overall configuration diagram of a control system S

according to the seventh embodiment. An operation system

multiplexing device 1 includes a permission information

table storage unit 14b (part of storage unit 14) and an ID

reader 19. The permission information table storage unit

14b stores permission information that permits use of a

plant monitoring device 2. The ID reader reads a worker

ID. The ID reader 19 is, for example, a card reader that

reads information of a security card possessed by a worker.

The ID reader 19 is connected to the operation system

multiplexing device 1 via a universal serial bus (USB) port

P15.

[0073] Then, for example, the computation unit 13 refers

to the permission information table storage unit 14b, and,

when there is permission information associated with the

23 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

worker ID read by the ID reader 19, functions as a

permission unit that permits use of the plant monitoring

device 2.

[0074] In this way, according to the operation system

multiplexing device 1 of the seventh embodiment, security

in the control system S can be enhanced.

[0075] (Eighth Embodiment)

Next, an eighth embodiment will be described. FIG. 13

is an overall configuration diagram of a control system S

according to the eighth embodiment. FIG. 14 illustrates an

example of a notification destination information table

according to the eighth embodiment.

[0076] The storage unit 14 includes a notification

destination information table storage unit 14c that stores

a notification destination information table (FIG. 14) in

which the content of a display screen and notification

destination information are associated with each other. As

illustrated in FIG. 14, in the notification destination

information table, information indicating a notification

destination A is associated with a screen indicating an

abnormality A, information indicating a notification

destination B is associated with a screen indicating an

abnormality B, and information indicating a notification

destination C is associated with a screen indicating an

abnormality C. When an image matching a specific image

corresponding to not only an abnormal state but a state of

a control target device is input, notification processing

for the content in accordance with the state can be

performed. Assumed notification processing includes e-mail

transmission from a LAN port, activation of a power output

device for driving alarm activation of an alarm device, and

the like.

[0077] For example, when the content of the recognized

24 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

display screen is in the notification destination

information table stored in the notification destination

information table storage unit 14c, the computation unit 13

of the operation system multiplexing device 1 outputs the

content of the display screen to a notification destination

associated with the display screen. In the embodiment, the

notification destination is a display device 3.

[0078] The display device 3 includes a reception unit 31

and a display unit 32. The reception unit 31 receives

information transmitted from the computation unit 13 of the

operation system multiplexing device 1, and outputs the

information to the display unit 32. The display unit 32

displays the information from the reception unit 31. The

display device 3 may be any device such as a tablet

terminal and a PC as long as the device can display

information transmitted from the computation unit 13.

Examples of a screen to be displayed on the display device

3 of a notification destination in a case where the

recognized display screen indicates the abnormality A

include a screen in FIG. 3B.

[0079] In this way, according to the control system S of

the eighth embodiment, a function of notifying an observer

and the like of an abnormality of a conventional facility

can be safely and easily added by externally attaching the

operation system multiplexing device 1 to the existing

plant monitoring device 2.

[0080] (Ninth Embodiment)

Next, a ninth embodiment will be described. FIG. 15

is an overall configuration diagram of a control system S

according to the ninth embodiment. FIG. 16 illustrates an

example of an authority information table according to the

ninth embodiment.

[0081] The storage unit 14 includes an authority

25 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

information table storage unit 14d that stores a plurality

of pieces of data in which operator identification

information and authority information are associated with

each other. As illustrated in FIG. 16, in this data, an

operator A is associated with authority of confirmation

processing at the time of abnormality and restoration

processing at the time of abnormality, and an operator B is

associated with authority of confirmation processing at the

time of abnormality, restoration processing at the time of

abnormality, and shutdown.

[0082] An operator device 4 includes a reception unit

41, a display unit 42, an external input unit 43, and an

information output unit 44. The external input unit 43

receives input of operator identification information. The

external input unit 43 is only required to be capable of

inputting the operator identification information, and

includes, but not limited to, a keyboard, a mouse, a card

reader, and the like. The operator identification

information includes a login ID and ID information

associated with a card read by a reader. The information

output unit 44 outputs operation information input by the

external input unit 43 to a computation unit 13 of an

operation system multiplexing device 1.

[0083] The computation unit 13 of the operation system

multiplexing device 1 acquires authority information from

the authority information table storage unit 14d based on

the operator identification information received from the

information output unit 44, and outputs the acquired

authority information to the operator device 4.

Furthermore, the computation unit 13 outputs the operation

information received from the information output unit 44 to

the information processing device 21.

[0084] The reception unit 41 transmits display screen

26 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

information to the display unit 42 based on the received

authority information. For example, in the example of FIG.

16, when the operator A has logged in, a button, a menu,

and the like are displayed on the display unit 42 so that

the operator A can perform the confirmation processing at

the time of abnormality and the restoration processing at

the time of abnormality. Furthermore, when the operator B

has logged in, a button, a menu, and the like are displayed

on the display unit 42 so that the operator B can further

perform shutdown in addition to the confirmation processing

at the time of abnormality and the restoration processing

at the time of abnormality.

[0085] In this way, according to the control system S of

the ninth embodiment, the content that can be operated by

the operator can be changed in accordance with user

authority setting by externally attaching the operation

system multiplexing device 1 to the existing plant

monitoring device 2.

[0086] Note that the ninth embodiment can be combined

with the eighth embodiment. When the operator receives a

notification of an abnormality and the operator logs in to

the operator device 4, for example, authority to respond is

limited, and the operator can respond to the abnormality

within the scope of the authority. This prevents

processing from being performed beyond the authority, and

allows safe operation. In particular, when it is desired

to divide the authority between an administrator and other

general responders, such an access limiting function can be

easily added by externally attaching the operation system

multiplexing device 1 to the existing plant monitoring

device 2.

[0087] Note that a program executed by the operation

system multiplexing device 1 of each of the above-described

27 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

embodiments is provided by being stored in a computer

readable storage medium such as a CD-ROM, a flexible disk

(FD), a CD-R, and a digital versatile disk (DVD) in a file

in an installable format or an executable format.

[0088] Furthermore, the program may be stored on a

computer connected to a network such as the Internet, and

provided by being downloaded via the network. Furthermore,

the program may be provided or distributed via a network

such as the Internet. Furthermore, the program may be

provided by being preliminarily incorporated in a ROM or

the like.

[0089] The program executed by the operation system

multiplexing device 1 of each embodiment has a module

configuration including each of the above-described units

(acquisition unit 12 and computation unit 13). As actual

hardware, each of the above-described units is loaded on a

main storage device by a CPU (processor) reading the

program from the storage medium and executing the program,

and generated on the main storage device.

[0090] Although some embodiments of the present

invention have been described, these embodiments have been

presented as examples, and are not intended to limit the

scope of the invention. These novel embodiments can be

performed in various other forms, and various omissions,

substitutions, and changes can be made without departing

from the gist of the invention. These embodiments and

variations thereof are included in the scope and gist of

the invention, and included in the invention set forth in

the claims and the equivalent scope thereof.

[0091] For example, although, in the above-described

embodiments, an example of a case where an operation system

multiplexing device is applied to a control system of an

industrial plant has been described, this is not a

28 20367277_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

limitation. The operation system multiplexing device of

the present invention can be applied to all target devices

having correspondence relation between the content of a

display screen and the content of operation input from a

worker who has looked at the content of the display screen.

[0092] Furthermore, although the keyboard 23 has been

described as an example of an input device, the input

device is not limited to the keyboard 23. Other input

devices such as a mouse and a touch panel may be used.

[0093] Furthermore, the operation system multiplexing

device 1 may acquire information on operation content from

a higher-level device (cloud controller) to transmit the

information to the information processing device 21.

Furthermore, the operation system multiplexing device 1 may

accumulate and analyze operational data, and transmit a

parameter adjusted based on the analysis result to the

information processing device 21.

[0094] It is to be understood that, if any prior art

publication is referred to herein, such reference does not

constitute an admission that the publication forms a part

of the common general knowledge in the art, in Australia or

any other country.

[0095] In the claims which follow and in the preceding

description of the invention, except where the context

requires otherwise due to express language or necessary

implication, the word "comprise" or variations such as "comprises" or "comprising" is used in an inclusive sense,

i.e. to specify the presence of the stated features but not

to preclude the presence or addition of further features in

various embodiments of the invention.

29 20367277_1 (GHMatters) P120524.AU

Claims (4)

Docket No. PTIA-22147-IN, AU, EA: FINAL CLAIMS

1. An operation system multiplexing device comprising:

an image signal acquisition unit configured to receive

a graphical user interface (GUI) image combined with state

information on a control target device, the image signal

acquisition unit being able to be connected to a GUI output

unit of an information processing device, and the

information processing device including: the GUI output

unit that outputs the GUI image; a GUI operating unit that

receives operation input to the GUI image; and a

communication terminal compatible with an electronic

industries alliance (EIA)-232 standard;

an operation information table storage unit configured

to store operation information in accordance with an image

state of the GUI image;

an image state recognition unit configured to

recognize the image state of the GUI image acquired by the

image signal acquisition unit, and acquire numerical

information expressed in the GUI image as a numerical

value;

an operation information generation unit configured to

refer to the operation information table storage unit in

accordance with the image state recognized by the image

state recognition unit, and acquire corresponding operation

information;

an operation information output terminal configured to

output the operation information, the operation information

output terminal being able to be connected to the

communication terminal;

a state information output terminal configured to

output the numerical value in accordance with a TCP/IP

protocol; and

30 20752369_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

a first operation system multiplexing device and a

second operation system multiplexing device as a duplexed

configuration of the operation system multiplexing device,

wherein

each of the first operation system multiplexing device

and the second operation system multiplexing device is

connected to the information processing device, and

the second operation system multiplexing device

includes a monitoring unit configured to switch, in a case

where the first operation system multiplexing device is in

an operating state and the second operation system

multiplexing device is in a standby state, a state of the

second operation system multiplexing device from the

standby state to the operating state when a periodic signal

to be transmitted by the first operation system

multiplexing device has not been received for a

predetermined period of time or more since previous

reception time.

2.The operation system multiplexing device according to

claim 1, further comprising a notification unit configured

to output from the state information output terminal an

image signal for a notification screen indicating that a

worker is required to respond when the operation

information table storage unit does not store the image

state recognized by the image state recognition unit.

3.The operation system multiplexing device according to

claim 1, further comprising a storage control unit

configured to cause a semiconductor storage device to store

data including a log related to the information processing

device.

31 20752369_1 (GHMatters) P120524.AU

Docket No. PTIA-22147-IN, AU, EA: FINAL

4.The operation system multiplexing device according to

claim 1, further comprising:

a permission information table storage unit configured

to store permission information permitting use of the

information processing device;

an ID reader configured to read a worker ID; and

a permission unit configured to refer to the

permission information table storage unit and, when there

is permission information corresponding to the worker ID

read by the ID reader, to permit use of the information

processing device.

32 20752369_1 (GHMatters) P120524.AU