JP6124594B2 - Power system monitoring and control apparatus and control program therefor - Google Patents

Description

  The present invention relates to a power system monitoring control device and a control program thereof, and more particularly, to a power system monitoring control device and a control program for performing processing for electronically adding a memo to a display screen.

  As an example of a monitoring control device, Japanese Patent Application Laid-Open No. 11-249727 (hereinafter referred to as Patent Document 1) inputs a result of inspection from a field inspector as an audio signal, and quantizes and stores the audio signal. Is disclosed.

  In this system, for each facility to be inspected, a process of receiving an input of an audio signal in accordance with an audio input and storing it as quantized audio memo information is started, and then ended. In the display screen including the inspection area for each facility, an icon indicating the presence of the voice memo is added to the area where the voice memo is recorded (FIG. 3). When a site inspector or other user clicks an icon on this display screen, a voice memo is reproduced.

JP 11-249727 A

  It is conceivable that the principle of the system disclosed in Patent Document 1 is applied to a power system monitoring and control device and memo information is added to the display screen by voice.

  However, when the technique of Patent Document 1 is used, the user may not be able to specify an arbitrary position on the display screen as a pasting position, and may not be able to add memo information at a desired position. .

  In addition, in Patent Document 1, since voice information is added as memo information, when adding memo information with text displayed on the screen, a special screen is opened and text is input or stored. An operation is required to display a list of texts that are displayed and select from the list. Therefore, the operation for adding memo information may be complicated.

  Therefore, an object of the present invention is to provide a power system monitoring control apparatus and a control program therefor that can add memo information to a desired position on the screen for power system monitoring control with an easy operation.

  In order to achieve the above object, according to one aspect of the present invention, a power system monitoring and control device is connected to a voice input device and a display device, and a voice input interface for receiving voice input from the voice input device; A control means for causing the power system control device to execute power system monitoring control and a program for realizing processing for adding an image including text to a specified position on a display screen for power system monitoring control are stored. And a memory. The process of adding the image proceeds by sequentially switching the processing state according to a user instruction, accepting voice input from the voice input device through the voice input interface, and input in the process of adding the image to the input voice When the voice command is predefined for the processing state at the time, the processing state prescribed for the processing state at the time of input is executed, and the next processing state prescribed in advance from the processing state at the time of input And displaying the next processing state. The control means starts the process of adding the image according to the utterance to the voice input device, adds the image to the designated position on the display screen, displays the image on the display screen, and ends the process of adding the image. .

  According to another aspect of the present invention, a control program causes a computer connected to a voice input device and a display device to function as a power system monitoring control device, and text is displayed at a designated position on a display screen for power system monitoring control. Is a program for executing a process of adding an image including. The processing for adding the image proceeds by sequentially changing the processing state in accordance with a user instruction. The program is prescribed in advance for the processing state at the time of input when the step of accepting voice input from the voice input device and the input voice is a voice command prescribed in advance for the processing state at the time of input. The computer executes voice input by causing the computer to execute a step of transitioning from the processing state at the time of input to the next predetermined processing state and a step of displaying the next processing state. In accordance with the utterance to the apparatus, the process for adding the image is started, the image is added to the designated position on the display screen and displayed on the display screen, and the process for adding the image is ended.

  According to the present invention, the user of the power system monitoring control device can add memo information as image information to a desired position on the screen by an easy operation using voice without performing a complicated operation. it can. Furthermore, since the operation is simplified, it is possible to prevent erroneous input and erroneous operation. In addition, since the operation is performed using voice, even if the user has no advanced operation technology or operation knowledge, it is possible to add memo information as image information on the display screen for power system monitoring control. Operation becomes possible.

It is a figure which shows the specific example of a structure of the electric power grid | system monitoring control system (henceforth a system) concerning embodiment. It is a block diagram which shows the specific example of the hardware constitutions of the computer as a power system monitoring control apparatus contained in a system. It is a figure showing the specific example of the screen transition during the process which pastes a memo on the display screen for electric power system monitoring control with a computer. It is a figure showing the specific example of the screen transition during the process which pastes a memo on the display screen for electric power system monitoring control with a computer. It is a figure showing the specific example of the screen transition during the process which pastes a memo on the display screen for electric power system monitoring control with a computer. It is a figure showing the specific example of the screen transition during the process which pastes a memo on the display screen for electric power system monitoring control with a computer. It is a figure showing the specific example of the screen transition during the process which pastes a memo on the display screen for electric power system monitoring control with a computer. It is a figure showing the specific example of the screen transition during the process which pastes a memo on the display screen for electric power system monitoring control with a computer. It is a figure showing the specific example of the screen transition during the process which pastes a memo on the display screen for electric power system monitoring control with a computer. It is a block diagram which shows the specific example of a function structure of a computer. It is a figure which shows the specific example of management information. It is a figure which shows the specific example of a text database. It is a flowchart showing the flow of control operation of CPU in the process which pastes the memo in a computer. It is a flowchart showing the specific flow of the process which pastes a memo.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

<Device configuration>
FIG. 1 is a diagram illustrating a specific example of a configuration of a power system monitoring control system (hereinafter, abbreviated as a system) according to the present embodiment.

  Referring to FIG. 1, this system includes a computer 100 as a power system monitoring and control device, a microphone 200 as a voice input device, a display 300, and a mouse 400 as a pointing device. Microphone 200, display 300, and mouse 400 are electrically connected to computer 100.

  The computer 100, the microphone 200, and the mouse 400 are examples of a power system monitoring control device, a voice input device, and a pointing device, respectively. The pointing device may be a keyboard, a touch pad, or other pad type device. Further, the pointing device may be a touch panel mounted on the computer 100 as an input device. Further, in this case, the touch panel as a pointing device may be used also as the display 300.

  FIG. 2 is a block diagram showing a specific example of the hardware configuration of the computer 100 as the power system monitoring control device. The computer 100 may be a general-purpose computer.

  Referring to FIG. 2, a computer 100 executes a program by a CPU (Central Processing Unit) 10, a ROM (Read Only Memory) 11 for storing a program executed by the CPU as an example of a memory, and the CPU. A RAM (Random Access Memory) 12 serving as a work area at the time of recording, an HD (Hard Disk) 13 for storing image data, etc., and a microphone 200 as an example of an audio input device to input audio signals. A microphone interface (hereinafter referred to as I / F) 14 for receiving, a display I / F 15 for receiving a connection of the display 300 and outputting a signal based on display data, and a mouse 400 as an example of a position specifying device are connected. A mouse I / F 16 for receiving an input of an instruction signal.

  Since the hardware configuration illustrated in FIG. 2 is a general computer configuration, detailed description will not be repeated. The computer 100 as the power system monitoring control device may further include another hardware configuration shown in FIG.

<Overview of operation>
In this system, the CPU 10 of the computer 100 starts a process of attaching (adding) a memo on the display screen for power system monitoring control according to the utterance to the microphone 200, and is designated on the display screen according to the utterance to the microphone 200. The memo is pasted at the selected position and displayed on the display screen, and the processing for pasting the memo is ended according to the utterance to the microphone 200.

  Here, the “memo” refers to an image displayed on the display screen in an overlapping manner, and the image includes designated or input text. “Paste a memo” means that an image as a memo is electronically added to a specified position on the display screen, and the image is superimposed on the display screen (or synthesized at the specified position). ) Refers to display.

  The process of pasting a memo proceeds by sequentially switching a plurality of processing states (status) according to a user instruction. The CPU 10 notifies the user of the current state in the above process by displaying the current status in the process of pasting a memo on the screen.

  3 to 9 are diagrams showing specific examples of display screen transition in the process of pasting a memo.

  FIG. 3 shows a specific example of a display screen for power system monitoring control before the CPU 10 starts the above processing. As an example, the display screen of FIG. 3 includes images representing respective monitoring targets such as power generation devices, power distribution devices, power transformation devices, and shut-off devices installed in various places. In the above process, the status before the CPU 10 starts the process is referred to as an “initial state”.

  In an initial state, the CPU 10 waits for an instruction input to start processing by voice from the microphone 200 as an example. As illustrated in FIG. 3, when the user utters “start memo” toward the microphone 200, the CPU 10 starts a process of pasting a memo.

  When the process of pasting a memo is started, the CPU 10 shifts from the initial state to a status of waiting for an instruction of a memo pasting position as the next status. The status in which the CPU 10 waits for a memo pasting position instruction is set to “paste position input waiting state”.

  When the process of pasting a memo starts, the display screen changes from the screen of FIG. 3 to the screen of FIG. FIG. 4 shows a specific example of the display screen in a waiting state for pasting position input.

  The CPU 10 notifies the user by displaying the current status on the display screen. FIG. 4 shows an image (in the example of FIG. 4, the CPU 10 displays a pointer image (in the example of FIG. 3, an arrow image) indicating the position of the mouse displayed in the initial state and is in a state of waiting for a pasting position input. In this example, the current status is a waiting state for input of a pasting position by displaying the image after changing to (notepad image).

  The method of notifying the status to the user is not limited to the method of changing the pointer image to an image representing the current status, and any other method may be used as long as the current status is notified by displaying on the display screen. There may be. As another example, the CPU 10 may display an image representing the current status at a predetermined position on the display screen, or display the current status as a text at a predetermined position on the display screen. Alternatively, the background color of the display screen may be changed to a color corresponding to the status. A specific example of the status notification method is the same even when the status is changed to the subsequent status.

  As an example, the CPU 10 waits for a position instruction input by the mouse 400 while waiting for a paste position input. FIG. 5 shows a state where the designation of the pasting position is accepted on the display screen of FIG. 4 which is waiting for the pasting position input. FIG. 5 shows an example in which the CPU 10 moves the image representing the current status in the same manner as the pointer image according to the movement of the mouse 400 and determines the position displayed when the mouse 400 is clicked as the pasting position. It represents.

  The method for inputting the position instruction is not limited to the method shown in FIG. 5, and may be another method. As another example, the CPU 10 may determine the position as the pasting position when a specific operation is performed with the mouse 400.

  Further, the position instruction input is not limited to the method using the mouse 400, and may be a voice input from the microphone 200. In this case, as an example, information (for example, coordinates) for specifying a position with respect to the display screen is defined in advance, and by speaking information specifying a position that the user desires to paste toward the microphone 200, The CPU 10 can specify the position to be pasted. Information for specifying the position (for example, coordinates) may be displayed over the display screen. Alternatively, as another example, a memo pasting range for each image representing a monitoring target included in the display screen and information (for example, a device name) associated with each monitoring target may be defined in advance. In this case, the user utters information associated with the monitoring target corresponding to the range desired to be pasted toward the microphone 200. The CPU 10 can specify the monitoring target based on the voice input, and can specify the position to be pasted based on the image representing the monitoring target.

  When the CPU 10 receives the paste position instruction, the CPU 10 shifts from the paste position input waiting state to a status that waits for the designation of the text included in the paste image as the next status. The status in which the CPU 10 waits for the designation of the text is set to “waiting for memo input”.

  When the paste position is instructed by clicking with the mouse 400, the display screen changes from the screen of FIG. 5 to the screen of FIG. FIG. 6 shows a specific example of a display screen in a memo input waiting state.

  Again, the CPU 10 notifies the user by displaying the current status on the display screen. FIG. 6 shows that the CPU 10 is in the memo input waiting state for the image (in the example of FIGS. 4 and 5, the notepad image) indicating that the CPU 10 is in the state of waiting for the paste position input. This shows an example of notifying that the current status is a memo input waiting state by changing to an image (image of a microphone in the example of FIG. 6) and displaying it on the display screen.

  CPU10 waits for the input which designates the text by the sound from the microphone 200 as an example in the memo input waiting state. As illustrated in FIG. 6, when the user utters “working” toward the microphone 200, the CPU 10 pastes an image including the text as a memo at a specified position. That is, the HD 13 is configured to store text included in an image to be pasted as a memo. The CPU 10 extracts registered text corresponding to voice input, generates an image including the text, and pastes it as a memo at a specified position on the display screen.

  When the memo is pasted, the CPU 10 shifts from the memo input waiting state to the pasting position input waiting state as the next status. When a transition is made to the paste position input waiting state after the memo is pasted, the display screen transitions from the screen of FIG. 6 to the screen of FIG. The CPU 10 waits for a position instruction input as a paste position input waiting state, and informs the user of the current status by displaying the paste position input wait state as a current status on the display screen.

  FIG. 7 shows an image (notepad image) indicating that a paste position input waiting state is displayed on a display screen in which an image including a text indicating “working” input by voice at the designated position is pasted as a memo. ) Is displayed.

  Thereafter, the CPU 10 repeats the pasting position input waiting state and the memo input waiting state until the processing ends. FIG. 8 is a diagram illustrating an example of a display screen on which a memo is pasted. As illustrated in FIG. 8, the computer 100 pastes an image including text input for each designated position as a memo by repeating the pasting position input waiting state and the memo input waiting state.

  In the state of waiting for the pasting position input, as an example, when an instruction to end the process by voice is input from the microphone 200, that is, as shown in FIG. By speaking, the CPU 10 ends the process of pasting a memo.

  When the memo pasting process ends, the CPU 10 shifts from the pasting position input waiting state to the initial state. Further, the display screen shifts from the screen of FIG. 8 to the screen of FIG. FIG. 9 is a diagram illustrating an example of the display screen in that state. As shown in FIG. 9, the CPU 10 changes the image (notepad image) indicating the pasting position input waiting state displayed on the display screen to a pointer image (arrow image) indicating the original mouse position. This notifies the user that the current status is the initial state.

<Functional configuration>
FIG. 10 is a block diagram showing a specific example of a functional configuration of the computer 100 for performing the above processing. Each function in FIG. 10 is realized mainly by the CPU 10 when the CPU 10 reads a program stored in the ROM 11 into the RAM 12 and executes the program. However, at least some of the functions may be realized by the hardware configuration shown in FIG. 2 or other circuit elements.

  Referring to FIG. 10, in HD 13, management information storage unit 301 which is a storage area for storing management information as information for managing the status in the memo pasting process, and text candidates to be included in the image And a text database 302 which is a storage area for storing.

  The management information may be stored in advance in the management information storage unit 301, or registered by a specific user who has been given a pre-registered operation for registration or change, or authority for registration or change. Or may be changeable.

  FIG. 11 is a diagram illustrating a specific example of management information. Referring to FIG. 11, the management information defines a command to be accepted, a next status to be transferred, a display for notifying the next status, and a process to be executed for each status in the process of pasting a memo. Information.

  More specifically, in FIG. 11, in the case where the current status is an initial state that is the state before the processing, “start memo” by voice is defined as an inputable command. As a command that can be entered, multiple types of voices such as “start memo” and “start memo” synonymous with “start memo” may be specified, or one type of voice such as “start memo”. Only may be specified. The same applies to other statuses.

  Furthermore, when the current status is the initial state, the status of the transition destination when the above command is received is the waiting state for waiting for the pasting position input, and the pointer image displayed in the initial state to notify the next status It is defined that the (arrow image) is changed to an image of a memo pad and that a process of pasting a memo is started as a process to be executed.

  In addition, when the current status is the paste position input waiting state, a click at any position on the display screen by the mouse 400 as a command that can be input, and the status of the transfer destination when the command is accepted is a memo input wait State, changing the notepad image displayed in the current status to the microphone image to notify the next status, and determining the position to paste the note as a process to be executed Has been.

  In addition, when the current status is a memo input waiting state, input by voice of a text registered in advance as an inputable command, the status of the transition destination when the command is accepted is a paste position input waiting state, In order to notify the next status, the microphone image displayed in the current status is changed to a notepad image, and an image including registered text that matches the voice input as a process to be executed. A process for generating and pasting at a specified position on the display screen is defined.

  In addition, when the current status is waiting for memo input, the voice memo end is entered as a command that can be entered, and the status of the transition destination when the command is accepted is the initial status, the next status That the microphone image displayed in the current status is changed to a pointer image (arrow image) and the process of pasting a memo is terminated as a process to be executed.

  In addition, even when the current status is waiting for a paste position input, it is possible to further input a voice “memo end” as a command that can be entered, and the status of the transition destination when the command is accepted is in the initial state. It is specified to change the image of the memo pad displayed in the current status to a pointer image (arrow image) to notify the status, and to end the processing of pasting the memo as processing to be executed. Yes.

  In the text database 302, candidates for text to be included in the image may be registered in advance, registered as an operation for registering the text in advance, or registered by a specific user having authority to register the text Or may be changeable.

  FIG. 12 is a diagram showing a specific example of the text database 302. Referring to FIG. 12, text database 302 stores in advance a plurality of texts (character strings) that are candidates for inclusion in a memo pasted on the display screen for power system monitoring control. Furthermore, attributes such as a typeface, character color, character size, background color, and image size may be associated with these texts in advance.

  Referring to FIG. 10 again, CPU 10 converts voice signal input by voice analysis 101 and voice input unit 101 for receiving voice signal input from microphone 200 via microphone I / F 14 into text. A voice analysis unit 102 for managing the status, a status management unit 103 for managing the status in the process of pasting a memo, and a position input unit 104 for receiving an input of an operation signal from the mouse 400 via the mouse I / F 16 And a processing unit 105 for executing a process defined for each status in the process of pasting a memo, and displaying on the display 300 via the display I / F 15 to notify the user of the current status. A notification unit 106.

  The processing unit 105 stores the voice input text in the text database 302 and the pasting position determination unit 107 for determining the position to paste the memo based on the position instruction by the mouse 400 or the position instruction by voice input. The text determination unit 108 for determining the text to be included in the image to be a memo by collating with the text being generated, and the image including the determined text are generated and pasted as a memo at the determined position on the display screen By attaching (combining), a memo processing unit 109 for performing processing for generating a screen on which an image as a memo is pasted, and a display screen on which the memo is pasted on the display 300 via the display I / F 15 And a display processing unit 110 for performing processing for displaying.

  When receiving a voice input or an instruction input with the mouse 400, the status management unit 103 determines whether the input is a command that is defined to be input for the current status. As a result, when the command is specified for the current status, the status management unit 103 instructs the processing unit 105 to execute the specified process. In addition, the status management unit 103 shifts to the next status, and instructs the notification unit 106 to display on the display 300. The status management unit 103 does not execute the specified process when the voice input or the instruction input with the mouse 400 is not a command that can be input with respect to the current status. In this case, the status management unit 103 may shift to the next status or may wait for the next input with the current status.

  For example, if the voice input accepted in the memo input wait state does not match the text stored in the text database 302, the status management unit 103 assumes that the command input specified in the memo input wait state is not input, Without performing the process of pasting, it may be shifted to the pasting position input waiting state, or the next input may be waited in the memo input waiting state. Further, in the case of the latter example, the status management unit 103 may instruct the processing unit 105 to display a message prompting voice input on the display 300 again.

<Operation flow>
FIG. 13 is a flowchart showing the flow of the control operation of the CPU 10 in the processing for pasting a memo in the computer 100. The operation shown in the flowchart of FIG. 13 is realized by the CPU 10 of the computer 100 reading out the program stored in the ROM 11 onto the RAM 12 and executing it, thereby exhibiting the functions of FIG.

  Referring to FIG. 13, when CPU 10 receives an input of an audio signal via microphone I / F 14 (YES in step S1), CPU 10 analyzes the audio signal and pastes a memo in the management information. It is determined whether or not the command is specified for the current status. If the input voice is a voice command corresponding to the current status (YES in step S3), the CPU 10 executes the process defined in the management information (step S5). And CPU10 transfers to the next status prescribed | regulated in said management information from the present status (step S7), and notifies a user by displaying the status on the display 300 (step S9).

  If the next status to be transferred is not the initial state indicating the end of the process (NO in step S11), the CPU 10 returns the process to step S1 and waits for the next voice input. That is, the CPU 10 repeats the above steps S1 to S9 until the next status to be transferred becomes an initial state indicating the end of the process.

  If the next status to be transferred is the initial state indicating the end of the process (YES in step S11), CPU 10 ends the series of operations.

  FIG. 14 is a flowchart showing a specific flow of processing for pasting a memo. The processing shown in the flowchart of FIG. 14 is also realized by the CPU 10 of the computer 100 reading out the program stored in the ROM 11 onto the RAM 12 and executing it, thereby exhibiting the functions of FIG.

  Referring to FIG. 14, CPU 10 accepts voice input in the initial state and analyzes the voice signal. As a result of the analysis, if the input voice is “start memo” defined in the management information (YES in step S101), the CPU 10 starts a process of pasting a memo. And CPU10 transfers to the sticking position input waiting state from an initial state. Further, the CPU 10 changes the image representing the status from a pointer image to a memo pad image (step S103).

  When the CPU 10 accepts an operation input instructing the position specified by the management information in the pasting position input waiting state (YES in step S105), the CPU 10 sets the position specified by the operation signal on the display screen as the pasting position. It decides and shifts from the paste position input waiting state to the memo input waiting state. Then, the CPU 10 changes the image representing the status from the memo pad image to the microphone image (step S107). The operation input in step S105 may be performed by voice, or may be performed using a pointing device such as a click with the mouse 400.

  In step S105, the CPU 10 may accept designation of a plurality of locations. For example, a predetermined operation (for example, a double click) for completing the position specification and shifting to the memo input waiting state which is the next status is defined in advance, and a plurality of operations are performed until the predetermined operation is detected. The CPU 10 can accept the designation of a plurality of locations by accepting the designation of the position by the prescribed operation (for example, single click).

  When the operation input received in the pasting position input waiting state is not defined by the above management information (NO in step S105 and NO in step S115), the CPU 10 waits for the operation input in the pasting position input waiting state. To do. Alternatively, the CPU 10 may end a series of processes without performing the subsequent operations, or does not accept an operation input for a predetermined time after shifting to the pasting position input waiting state, or in a predetermined operation input. A series of processes may be ended when only a non-operation input is accepted.

  When the CPU 10 accepts voice input in the memo input waiting state (YES in step S109), the CPU 10 analyzes the voice signal and converts it into text. The CPU 10 determines whether or not the text is text stored in the text database 302, and extracts text that matches the input voice. At this time, the CPU 10 may extract a combination of two or more texts that match the voice signal from the text database 302.

  In step S109, as an example, the CPU 10 stores a threshold value of a period without sound (silence period) in advance, and when a silence period exceeding the threshold value occurs after voice input starts, the silence is generated. You may make it handle the audio | voice to a period as a series of input audio | voice signal. Alternatively, when the voice input is completed, a predetermined voice such as “above” is added to the memory in advance, and when the CPU 10 detects the voice specified after the voice input is started, The sound up to that sound may be handled as a series of input sound signals. In this way, the CPU 10 can determine the end of voice input.

  If no voice input is made after a lapse of a predetermined time from the transition to the memo input waiting state in step S107 (NO in step S109), the CPU 10 is specified in the management information. It may shift to the pasting position input waiting state which is the next status, or the processing for pasting the memo may be terminated. Alternatively, a message for prompting voice input may be displayed on the display 300.

  If the input voice matches the text stored in the text database 302 (YES in step S111), the CPU 10 extracts the text that matches the input voice. The CPU 10 generates an image including the text and pastes it as a memo at the position determined in step S107 on the display screen. At this time, if a memo attribute is associated with the text stored in the text database 302, the CPU 10 also reads the attribute and generates an image using the attribute. Alternatively, the CPU 10 may receive an image attribute instruction by voice input or instruction input with the mouse 400 and generate an image using the instructed attribute.

  Thereafter, the CPU 10 shifts to a paste position input waiting state. Then, the CPU 10 changes the image representing the status from the microphone image to the memo pad image (step S113).

  If the designation of a plurality of locations is accepted in step S105, the CPU 10 performs a process of pasting the generated image on the plurality of locations in step S113. Thereby, the operability when pasting the same memo on a plurality of places is remarkably improved.

  On the other hand, if the input voice does not match the text stored in the text database 302, and is not a “memo end” voice command for ending the memo pasting process (NO in step S111). In step S115, the CPU 10 goes to the next status of waiting for a pasting position input without performing the processing in step S113, and changes the status image from a microphone image to a notepad image. (Step S117).

  The CPU 10 may accept a voice input in a paste position input waiting state or a memo input waiting state. As a result of the CPU 10 analyzing the audio signal, if the input audio is “end of memo” defined in the management information (YES in step S115), the CPU 10 pastes a series of memos. The process ends. Then, the CPU 10 shifts from the pasting position input waiting state or the memo input waiting state to the initial state. In addition, the CPU 10 changes the image representing the status from a notepad image or a microphone image to a pointer image (step S119). Thus, a series of processing ends.

<Effect of Embodiment>
When the above processing is executed by the computer 100 as the power system monitoring control device, the user can easily create a memo to be pasted when electronically pasting an image including text on the display screen as a memo. be able to. That is, for each memo, the user performs complicated operations such as an operation for inputting text by opening a dedicated screen for text input, and an operation for displaying a list of stored texts and selecting from among them. The memo can be generated simply by speaking.

  Thereby, the user's operability at the time of making the computer 100 as an electric power system monitoring control apparatus perform the process which pastes an image as a memo on the screen for electric power system monitoring control can be improved significantly. Further, it is possible to prevent erroneous input or erroneous operation.

  In particular, text included in a memo to be pasted on a screen for power system monitoring control is often patterned. Therefore, as illustrated in FIG. 12, necessary text may be registered in the text database 302 in advance. Then, the text may be automatically selected by simply speaking. By doing so, the trouble of performing the same operation a plurality of times can be saved, and a memo can be attached efficiently. Further, it is possible to prevent erroneous input or erroneous operation.

<Modification 1>
In the process of pasting a memo, the CPU 10 first accepts designation of a pasting position and then accepts designation of text. This processing order is not limited to the above order, and may be reversed. That is, the CPU 10 may accept the designation of the text first and then accept the designation of the position to be pasted.

<Modification 2>
The CPU 10 may store, in a memory, text included in an image pasted as a memo at least in the process of pasting the latest memo, and may be a candidate for text included in the image pasted in the next processing. At this time, the CPU 10 displays the text on the display 300, and in that state, a new text is not designated for a predetermined time, an instruction input of a pasting position is accepted, or a selection state of the text is determined. By accepting a predetermined operation, the text included in the image pasted by the latest processing displayed can be determined as the text to be included in the image pasted by the current processing. In this way, frequently used memos can be pasted without repeating the designation of text, and the operability for the user can be further improved.

<Modification 3>
In the process of pasting a memo, the computer 100 accepts text designation by voice input. However, the mouse 400 can input characters from a keyboard (not shown) or a character string candidate registered in advance. An instruction input with a pointing device such as a selection instruction may be accepted. At this time, the CPU 10 may also accept voice input and generate an image including the text when the text input by the pointing device matches the text specified by the voice input. By doing so, it is possible to prevent erroneous input with an easy operation.

<Modification 4>
Furthermore, it is possible to provide a program for causing the CPU 10 of the computer 100 as an existing power system monitoring and control device to execute the process of pasting the memo described above. Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  The program may be a program module provided as a part of an operating system (OS) of a computer, in which necessary modules are called at a predetermined timing and executed at a predetermined timing. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  10 CPU, 11 ROM, 12 RAM, 13 HD, 14 Microphone I / F, 15 Display I / F, 16 Mouse I / F, 100 Computer, 101 Audio input unit, 102 Audio analysis unit, 103 Status management unit, 104 Position Input unit, 105 processing unit, 106 notification unit, 107 sticking position determination unit, 108 text determination unit, 109 memo processing unit, 110 display processing unit, 200 microphone, 300 display, 301 management information storage unit, 302 text database, 400 mouse .

Claims (7)

A power system monitoring and control device connected to a voice input device and a display device,
A voice input interface for receiving voice input from the voice input device;
Control means for causing the power system monitoring control device to execute power system monitoring control,
A position input interface for accepting designation of a position on the display screen as an instruction input from a pointing device;
A program for realizing a process of displaying a display screen including a plurality of monitoring target images in power system monitoring control and adding an image including text to a position designated by the pointing device corresponding to the monitoring target A stored memory,
The process of adding the image is as follows:
Processing state proceeds by switching to the order in accordance with the User over The instruction,
Receiving voice input from the voice input device through the voice input interface;
When the input voice is a voice command defined in advance for the processing state at the time of input in the process of adding the image, the processing specified in advance for the processing state at the time of input is executed, Transition from the processing state at the time of the input to the next processing state defined in advance;
Displaying the next processing state;
Displaying an image added in the processing state at the time of input after transitioning from the processing state at the time of input to the next processing state,
Wherein,
According utterance to the previous SL voice input device, ends the process the image to start the process of adding, by adding the image displayed on the display screen at a specified position on the display screen, adds the image image to which also displays the in after,
An image representing a current processing state in the process of adding the image is displayed on the display device, and the image representing the processing state at the time of the input is changed to an image representing the next processing state and is displayed on the display device. Display
An electric power system monitoring and control apparatus that changes an image representing a position designated by the pointing device from a pointer image to an image representing the current processing state . The memory is configured to store text included in the image;
The processing for adding the image includes a first state that is a processing state for receiving an input of information for specifying text included in the image,
The control means receives a voice input in the first state, whereby an image including text corresponding to the input voice among texts stored in the memory is designated on the display screen. The power system monitoring and control device according to claim 1 , wherein the power system monitoring and control device is added to the position. The control means, when the voice input in the first state does not correspond to any text stored in the memory, at least the first state from the processing state that is the first state The power system monitoring and control device according to claim 2 , wherein the power system monitoring and control device shifts to an earlier processing state. The control means sets the image added in the process of adding the image that has been completed most recently as a target image to be added in the process of adding the next image, and at the end of the process of adding the next image. The power system monitoring control device according to any one of claims 1 to 3 , wherein when the image is an image to be added, the image is added to a specified position on the display screen. The process of adding the image includes a second state that is a process state of receiving an instruction of a position to add the image,
The said control means adds the said image to the position applicable to the said input audio | voice of the positional information prescribed | regulated on the said display screen by accepting an audio | voice input in said 2nd state. The electric power system monitoring control apparatus in any one of 1-4 . An additional range of the image is defined for each image to be monitored on the display screen,
The control means is defined for any one of the monitoring targets when the voice input received in the second state is a voice associated with any one of the plurality of monitoring targets. The power system monitoring and control device according to claim 5 , wherein the image is added to the additional range. The computer connected to the voice input device and the display device functions as a power system monitoring control device, displays a display screen including images of a plurality of monitoring targets in power system monitoring control, and is designated corresponding to the monitoring target. A control program for executing a process of adding an image including text at a specified position,
The computer includes a position input interface for accepting designation of a position on the display screen from a pointing device, and a designated position corresponding to the monitoring target is designated by the pointing device,
The process of adding the image proceeds by sequentially changing the processing state according to a user instruction,
The control program is
Receiving voice input from the voice input device;
When the input voice is a voice command defined in advance for the processing state at the time of input in the process of adding the image, the processing specified in advance for the processing state at the time of input is executed, Transitioning from the processing state at the time of input to the next processing state defined in advance;
Displaying the next processing state;
Even after the transition from the processing state at the time of input to the next processing state, the computer causes the computer to execute the step of displaying an image added in the processing state at the time of input. After starting the process of adding the image according to the utterance to the input device, adding the image to the designated position on the display screen and displaying it on the display screen, and after finishing the process of adding the image Is also displayed ,
The control program is
An image representing a current processing state in the process of adding the image is displayed on the display device, and the image representing the processing state at the time of the input is changed to an image representing the next processing state and is displayed on the display device. Steps to display;
A control program causing the computer to further execute a step of changing an image representing a position designated by the pointing device from a pointer image to an image representing the current processing state .

Images