JP6843305B1 - Display control device and display terminal - Google Patents

Abstract

The display control device (2) determines the display area to be displayed on the two-dimensional display screen of the virtual screen so that the object requiring attention is displayed on the two-dimensional display screen, and the display control unit (17) and the display of the virtual screen. A drawing unit (16) for extracting the display data of the display area from the data and displaying the display area on the two-dimensional display screen is provided, and the display control unit (17) has a plurality of objects requiring attention when there are a plurality of objects requiring attention. The range of the display area is adjusted so that the object requiring attention is included in the display area, and the drawing unit (16) adjusts the display data of the display area so that the adjusted display area can be displayed on the two-dimensional display screen. Is displayed on the two-dimensional display screen.

Description

The present disclosure relates to a display control device and a display terminal that control the contents to be displayed on the screen.

A two-dimensional display device that displays display data on a screen cannot display display data having a resolution higher than the screen resolution because the range that can be displayed on one screen is limited. Therefore, a technique has been proposed in which a virtual screen exceeding the range that can be displayed on one screen of the two-dimensional display device is formed, and a part of the virtual screen is displayed on the two-dimensional display device.

For example, in the plant operation monitoring system of Patent Document 1, when an event requiring attention such as a failure or non-operation occurs, the portion of the virtual screen where the position of the event requiring attention is displayed is displayed. It is displayed on a small area monitoring screen. That is, the plant operation monitoring system of Patent Document 1 displays a cautionary event by moving a fixed area having the same size as the screen resolution of the two-dimensional display screen to a position where the cautionary event has occurred in the virtual screen. There is.

Japanese Unexamined Patent Publication No. 52-116024

However, in the technique of Patent Document 1, since a fixed area having the same size as the screen resolution of the two-dimensional display screen is only moved in the virtual screen, a plurality of cautionary events occur at the same time in a wider range than the fixed area. Then, there was a problem that a plurality of events requiring attention could not be displayed at once.

The present disclosure has been made in view of the above, and even if a plurality of cautionary events occur simultaneously in a range wider than the screen resolution of the two-dimensional display screen in the virtual screen, a plurality of necessary events are required. Attention The purpose is to obtain a display control device that can display events at once.

In order to solve the above-mentioned problems and achieve the object, the display control device of the present disclosure determines whether or not a cautionary event has occurred based on the information acquired from the monitored device. A judgment unit and an object control unit that controls the state of an object based on the judgment result for an object that indicates the presence or absence of an event requiring attention in a virtual screen that exceeds the range of screen resolution that can be displayed on the two-dimensional display screen. , Equipped with. Further, the display control device of the present disclosure provides a display area to be displayed on the two-dimensional display screen of the virtual screen so that the object requiring attention, which is an object indicating that an event requiring attention has occurred, is displayed on the two-dimensional display screen. It includes a display control unit for determining, and a drawing unit for extracting display data of the display area from the display data of the virtual screen and displaying the display area on the two-dimensional display screen. When there are a plurality of objects requiring attention, the display control unit expands the range of the display area so that the plurality of objects requiring attention are included in the display area. When the screen resolution of the enlarged display area is larger than the screen resolution that can be displayed on the two-dimensional display screen, the drawing unit displays the enlarged display area so that the enlarged display area can be displayed on the two-dimensional display screen. The data is reduced and the display area is displayed on the two-dimensional display screen. The drawing unit displays a navigation window indicating which area of the virtual screen is the display area on the two-dimensional display screen. On the navigation window, the drawing unit displays a figure indicating the area of the virtual screen and a figure indicating the position of the display area in the figure indicating the virtual screen on the virtual screen and the two-dimensional display screen. The positional relationship is displayed as a graphic so that the positional relationship with the displayed display area can be understood, and the size of the graphic is controlled according to the size of the display area.

The display control device according to the present disclosure displays a plurality of cautionary events at once even when a plurality of cautionary events occur simultaneously in a range wider than the screen resolution of the two-dimensional display screen in the virtual screen. It has the effect of being able to do it.

The figure which shows the structure of the display terminal provided with the display control device which concerns on Embodiment 1. A block diagram schematically showing a hardware configuration of a display terminal according to the first embodiment. A flowchart showing a processing procedure until the device monitoring is started in the display system according to the first embodiment. A flowchart showing a processing procedure of display control processing in the display terminal according to the first embodiment. The figure for demonstrating the screen which the display terminal which concerns on Embodiment 1 displays when one event requiring attention occurs. The figure for demonstrating the screen displayed by the display terminal which concerns on Embodiment 1 when a plurality of events requiring attention have occurred. The figure for demonstrating the screen displayed by the display terminal which concerns on Embodiment 1 when the display area is enlarged. The figure which shows the structure of the display terminal provided with the display control device which concerns on Embodiment 2. A flowchart showing a processing procedure of display control processing in the display terminal according to the second embodiment.

Hereinafter, the display control device and the display terminal according to the embodiment of the present disclosure will be described in detail with reference to the drawings. It should be noted that the disclosure is not limited by these embodiments.

Embodiment 1.
FIG. 1 is a diagram showing a configuration of a display terminal provided with a display control device according to the first embodiment. FIG. 1 shows a display system 1A including a display terminal 10A and a device 30. The device 30 is a device to be monitored that is operated or monitored by the display terminal 10A. The device 30 is, for example, a PLC (Programmable Logic Controller), a servo amplifier, or the like. The display terminal 10A is a terminal connected to the device 30 and capable of displaying and monitoring the state of the device 30 and operating the device 30. The display terminal 10A is, for example, a programmable display.

In the first embodiment, the mounting parts (switches, lamps, etc.) as hardware to be mounted on the operation panel are realized by software, and the display terminal 10A can display and operate the mounting parts on the two-dimensional display screen. A case where it is applied to a programmable display will be described.

The display terminal 10A includes a two-dimensional display device that displays display data on the screen. An example of a two-dimensional display device is a display panel. The display terminal 10A selects a display area having a screen resolution that can be displayed on the screen from a virtual screen having a screen resolution that is larger than the range that can be displayed on the screen, and displays the display area on the screen. That is, the display terminal 10A takes out and displays a part of the display area of the continuous virtual screen. The screen resolution is the total number of pixels that can be displayed on the screen. The virtual screen is drawn by the drawing device using drawing software.

The display terminal 10A of the first embodiment determines an area to be displayed on the screen by moving the display area in the virtual screen. Further, the display terminal 10A enlarges or reduces the display area so that all the objects to be displayed among the objects arranged on the virtual screen are included in the display area. The object is information indicating the state of the device 30.

The display terminal 10A includes a communication unit 11, a display control device 2, a display unit 18, and an input unit 19. The display control device 2 is a computer that controls information to be displayed on the display unit 18. The display control device 2 includes a memory device 12, a device monitor unit 13, a caution event determination unit 14, an object control unit 15, a drawing unit 16, and a display control unit 17.

The communication unit 11 communicates with the device 30 and transmits / receives information to / from the device 30. For example, the communication unit 11 connects the device 30 to the display control device 2 using Ethernet (registered trademark), a serial port, USB (Universal Serial Bus), or the like, and transmits information (signals) sent from the device 30. It is transmitted to the memory device 12 of the display control device 2. The communication unit 11 receives, for example, information indicating the state of the device 30 from the device 30. Examples of information indicating the state of the device 30 include information indicating that the input condition is satisfied, information indicating a failure or abnormality of the device 30, and the like.

The display terminal 10A includes a memory device 12 for each device 30. In the display system 1A, one or more display terminals 10A may monitor one or more devices 30. In the first embodiment, the case where the display terminal 10A includes the memory device 12 corresponding to the device 30 will be described.

The memory device 12 stores a counter corresponding to the device 30. The memory device 12 receives information indicating the state of the device 30 acquired from the device 30 via the communication unit 11. When the memory device 12 receives the specific information sent from the device 30, for example, the memory device 12 counts up the counter corresponding to the device 30.

The device monitor unit 13 monitors the state of the memory device 12. The device monitor unit 13 monitors, for example, whether or not the counter of the memory device 12 exceeds the upper limit value. When the counter of the memory device 12 exceeds the upper limit value, the device monitor unit 13 notifies the object control unit 15 that the counter of the memory device 12 exceeds the upper limit value.

The object control unit 15 controls the state of objects such as characters, figures, and images corresponding to the state of the device 30 to be monitored according to the state of the memory device 12. At this time, the object control unit 15 updates the state of the object based on the notification from the device monitor unit 13. When the object control unit 15 receives a notification from the device monitor unit 13 indicating that the counter of the memory device 12 has exceeded the upper limit value, the object control unit 15 manages the objects so that the object corresponding to the memory device 12 can be identified.

The object control unit 15 associates, for example, a state in which the counter of the memory device 12 is less than the upper limit value with an image of the OFF display of the lamp object. Further, the object control unit 15 associates the state in which the counter of the memory device 12 is equal to or higher than the upper limit value with the image of the ON display of the lamp object. As a result, the object control unit 15 switches between the ON display image and the OFF display image of the lamp object according to the state of the counter of the memory device 12. When the object control unit 15 updates the state of the object, the object control unit 15 transmits the updated state of the object to the caution-required event determination unit 14.

The attention-requiring event determination unit 14 determines whether or not a caution-requiring event that requires the user's attention has occurred when the state of the object is updated. That is, the caution-requiring event determination unit 14 determines whether or not a caution-required event has occurred when the state of the memory device 12 changes.

In the caution event determination unit 14, for example, a state in which the counter of the memory device 12 corresponding to the device 30 exceeds the upper limit value and the lamp object associated with the memory device 12 is turned on is displayed as a caution event. Register in advance as. As a result, the cautionary event determination unit 14 can determine that the cautionary event has occurred if the lamp object is turned on after the device monitor is started. When the drawing software draws the drawing data of the virtual screen on the display terminal 10A, the state of a specific object is registered in advance as an event requiring attention. As a result, the attention-requiring event determination unit 14 can determine whether or not it corresponds to the caution-requiring event based on the state of the object. Hereinafter, an object corresponding to a caution event may be referred to as a caution object. When the attention-requiring event determination unit 14 determines that the attention-requiring event has occurred, the object control unit 15 is notified that the attention-requiring event has occurred. As a result, the object control unit 15 manages an object when an event requiring attention occurs, that is, an object requiring attention.

The display control unit 17 refers to the object control unit 15 and identifies an object indicating that an event requiring attention has occurred. The display control unit 17 executes at least one of moving, enlarging, and reducing the display area so that the object when an event requiring attention occurs is included, and which area of the virtual screen is used as the display area. Decide whether to display in. The display terminal 10A enlarges or reduces the display area so that all the objects to be displayed are included in the display area. The display terminal 10A enlarges the display area and displays it when all the objects to be displayed fit in the display area smaller than the screen resolution that can be displayed on the screen. When the range of all the objects to be displayed is a display area larger than the screen resolution that can be displayed on the screen, the display terminal 10A reduces the display area and displays the display area. The display terminal 10A does not make the screen resolution of the display area smaller than the screen resolution that can be displayed on the screen.

For example, when there is a lamp object indicating that an event requiring attention has occurred, the display control unit 17 determines an area including the lamp object in the virtual screen as a display area to be displayed on the screen. When there are a plurality of objects indicating that an event requiring attention has occurred, the display control unit 17 determines an area including the plurality of objects as a display area to be displayed on the screen. The display control unit 17 transmits the determined display area to the drawing unit 16 and also transmits a display instruction for displaying the determined display area to the drawing unit 16.

The drawing unit 16 generates display data for the display screen based on the display area determined by the display control unit 17 from the display data of the virtual screen configured by combining one or a plurality of objects. When the drawing unit 16 receives a display instruction from the display control unit 17, the drawing unit 16 causes the display unit 18 to display the display area using the generated display data.

When the screen resolution of the display area including a plurality of objects is larger than the screen resolution of the display unit 18, the drawing unit 16 reduces the entire virtual screen so that the display area can be displayed by the display unit 18. As a result, the drawing unit 16 matches the screen resolution of the display area with the screen resolution of the display terminal 10A, and causes the display unit 18 to display the area indicated by the display area. In this way, the drawing unit 16 reduces the screen resolution of the display area by reducing the entire virtual screen, and causes the display unit 18 to display the display area using the display data of the display area in which the screen resolution is reduced.

The display unit 18 displays the display area by drawing the display data generated by the drawing unit 16 on the screen. The display unit 18 is, for example, a touch panel display, and displays a display area that is a part of a virtual screen on the touch panel display. In this way, the display terminal 10A executes at least one of moving, enlarging, and reducing the display area, and displays the display area so that the display area including the plurality of objects requiring attention fits in the screen. ..

The input unit 19 accepts a user operation for the content displayed on the display unit 18. For example, when the display unit 18 is a touch panel display, the input unit 19 detects the movement of the user's finger on the screen and moves the display area to be displayed on the touch panel display in the virtual screen based on the detected movement. ..

FIG. 2 is a block diagram schematically showing the hardware configuration of the display terminal according to the first embodiment. The display terminal 10A includes a processor 21 that processes instructions of various programs, a memory, a communication IF (Interface) device 24, an HDD (Hard Disc Drive) 25, an input device 26, and a display device 27.

The memory includes a ROM (Read Only Memory) 22 and a RAM (Random Access Memory) 23. The ROM 22 stores a memory device 12, a device monitor unit 13, a caution event determination unit 14, an object control unit 15, a drawing unit 16, a control program for controlling the display control unit 17, and the like. The RAM 23 is a memory capable of high-speed writing and reading that temporarily stores the intermediate results of operations performed by the processor 21.

An example of the processor 21 is a CPU (Central Processing Unit, a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor)), or a system LSI (Large Scale Integration).

The processor 21 executes various processes according to the program stored in the ROM 22, the program stored in the HDD 25, or the program stored in the RAM 23. Further, the processor 21 temporarily or permanently stores the data required for each process in the RAM 23 or the HDD 25.

The display terminal 10A is realized by reading a display program, which can be executed by a computer, from the ROM 22 and executing the display program for the processor 21 to display the display area. It can be said that the display program, which is a program for executing the operation of the display terminal 10A, causes the computer to execute the procedure or method of the display terminal 10A.

The processor 21 controls the entire display terminal 10A. That is, the memory device 12, the device monitor unit 13, the caution event determination unit 14, the object control unit 15, the drawing unit 16, and the display control unit 17 of the display terminal 10A are realized by the processor 21. In other words, the display program executed by the display terminal 10A has a modular configuration including a memory device 12, a device monitor unit 13, a caution event determination unit 14, an object control unit 15, a drawing unit 16, and a display control unit 17. These are loaded onto the main memory and they are generated on the main memory. It should be noted that some of the functions of the display terminal 10A may be realized by dedicated hardware such as a dedicated circuit, and some may be realized by software or firmware.

A part or all of the memory device 12, the device monitor unit 13, the caution event determination unit 14, the object control unit 15, the drawing unit 16, and the display control unit 17 are processing circuits such as a system LSI (not shown). It may be realized by the above, or it may be realized by the cooperation of a plurality of processing circuits.

The communication IF device 24 communicates with an external device such as the device 30. The communication IF device 24 executes data input / output with an external device such as the device 30. The communication IF device 24 executes the processing of the communication unit 11. That is, the communication IF device 24 communicates using, for example, Ethernet, a serial port, or USB. The memory device 12 can acquire information on equipment such as the device 30 by using the communication IF device 24 by the processor 21.

The HDD 25 is composed of a magnetic memory or the like, and stores, for example, software which is a group of programs required for various processes by the processor 21. The programs constituting the various processing software by the processor 21 may be preliminarily incorporated in the computer with dedicated hardware, or may be preliminarily incorporated in the ROM 22 or the HDD 25. This program may be recorded on a computer-readable recording medium and provided as, for example, a computer program product, or may be downloaded by the display terminal 10A via a network or the like.

The input device 26 executes the processing of the input unit 19. The input device 26 is, for example, a touch panel, a software keyboard, a numeric keypad, a keyboard, etc. of the display device 27, and is a device for inputting various operations from the user. When the processor 21 uses the input device 26, the user can manually operate the virtual screen.

The display device 27 executes the processing of the display unit 18. The display device 27 is a device that displays various types of information, and is composed of, for example, a two-dimensional display device such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), or a CRT (Cathode-Ray Tube) display. .. When the processor 21 uses the display device 27, the user can visually recognize a part of the virtual screen drawn by the drawing unit 16.

FIG. 3 is a flowchart showing a processing procedure until the start of monitoring of the device in the display system according to the first embodiment. The drawing device draws a virtual screen to be displayed on the display terminal 10A in advance by using drawing software (step S10). The drawing software is software provided by the manufacturer of the programmable display for editing the drawing data of the virtual screen to be displayed on the programmable display. This software is installed on a drawing device that is a computer.

The drawing device uses pre-installed objects, separately inserted objects, and the like, and creates a screen layout of a virtual screen according to instructions from the user. Examples of pre-installed objects are text, shapes, and images. Examples of objects that are inserted separately are image files and document files. Further, the drawing device registers the memory device 12 corresponding to the device 30 connected to the display terminal 10A in association with each object on the virtual screen.

The display terminal 10A downloads the drawing data of the virtual screen created by the drawing software (step S20). At this time, the display terminal 10A connects the drawing device on which the drawing software is installed and the display terminal 10A via the communication IF device 24, and downloads the drawing data of the virtual screen from the drawing device. For example, the display terminal 10A downloads a package in which the drawing data of the virtual screen to which the object and the memory device 12 are associated and the software group for displaying the drawing data on the display terminal 10A are integrated into one package. ..

Next, the device 30 and the display terminal 10A are connected by the communication IF device 24 (step S30). Next, the power of the device 30 and the display terminal 10A is turned on (step S40), and the display terminal 10A starts device monitoring for the device 30 (step S50).

FIG. 4 is a flowchart showing a processing procedure of display control processing in the display terminal according to the first embodiment. When the display terminal 10A starts device monitoring for the device 30 (step S110), each time the memory device 12 receives the information sent from the device 30, the counter of the memory device 12 corresponding to the device 30 is counted. Up.

The device monitor unit 13 determines whether or not the state of the memory device 12 has changed at a specific cycle (step S120). When there is no state change in the memory device 12 (step S120, No), the device monitor unit 13 continues to determine whether or not the memory device 12 has a state change (step S120). When there is a state change in the memory device 12 (step S120, Yes), the object control unit 15 updates the state of the object (step S130).

The attention-requiring event determination unit 14 determines whether or not the state of the object corresponds to the caution-requiring event (step S140). When the state of the object is registered in the state of the event requiring attention, the attention-requiring event determination unit 14 determines that the state of the object corresponds to the event requiring attention. The state of the object does not have to be registered as the state of the event requiring attention. In this case, the attention-requiring event determination unit 14 may only determine the state change of the object.

If it does not correspond to the event requiring attention (step S140, No), the display terminal 10A returns to the process of step S120.

When the event requires attention (step S140, Yes), the display control unit 17 refers to the object control unit 15 to identify an object requiring attention indicating that the event requiring attention has occurred, and the specified object is required. Attention Determine the display area so that the object is included. That is, the display control unit 17 determines a display area including the attention-requiring object indicating the attention-requiring event (step S150). Specifically, the display control unit 17 executes any of movement, enlargement, and reduction of the display area in the virtual screen so that the specified object requiring attention is included. As a result, the display control unit 17 determines which area in the virtual screen is to be the display area. At this time, when a plurality of cautionary events have occurred, the display control unit 17 determines the display area so as to include all the plurality of cautionary objects.

The drawing unit 16 generates display data for the determined display area (step S160). Specifically, the drawing unit 16 extracts and generates display data corresponding to the display area determined by the display control unit 17 from the display data of the virtual screen composed of the combination of objects.

After that, the display unit 18 updates the screen by displaying the display area based on the display data generated by the drawing unit 16 (step S170). The display terminal 10A updates the screen in real time when an event requiring attention occurs. Therefore, when a new attention-requiring event occurs, the display terminal 10A displays a display area including the new attention-requiring object on the screen.

The display terminal 10A determines whether or not to terminate the device monitor (step S180). If the display terminal 10A does not end the device monitor (step S180, No), the display terminal 10A returns to the process of step S120. On the other hand, when the display terminal 10A ends the device monitor (step S180, Yes), the display terminal 10A ends the display control process.

FIG. 5 is a diagram for explaining a screen displayed by the display terminal according to the first embodiment when one event requiring attention has occurred. A plurality of objects 50 are arranged in the virtual screen data 41, which is the display data of the virtual screen. In FIG. 5, the attention-requiring object 51A, which is an object when a caution-requiring event occurs, is shown.

The display terminal 10A sets a display area 45 in the virtual screen data 41, and displays the set display area 45 on the screen 31 of the display terminal 10A. In this case, the display terminal 10A sets the display area 45 so that the caution object 51A when a caution event occurs is included in the display area 45, and displays the display area 45 on the screen 31. That is, when one event requiring attention occurs, the display control unit 17 moves the display area 45 in the virtual screen so as to include the object requiring attention 51A indicating that the event requiring attention has occurred, and the drawing unit. 16 takes out the display data in the range of the display area 45 from the virtual screen data 41. Then, the drawing unit 16 causes the screen 31 to display the display area 45 corresponding to the extracted display data.

FIG. 6 is a diagram for explaining a screen displayed by the display terminal according to the first embodiment when a plurality of events requiring attention have occurred. In FIG. 6, with respect to the virtual screen data 42, the objects requiring attention when an event requiring attention occurs are shown by the objects requiring attention 51A and 51B.

The display terminal 10A sets a display area 46 in the virtual screen data 42, and displays the set display area 46 on the screen 31 of the display terminal 10A. In this case, the display terminal 10A sets the display area 46 so that both the objects requiring attention 51A and 51B when the event requiring attention occurs are included in the display area 46, and displays the display area 46 on the screen 31. That is, when a plurality of cautionary events occur, the display control unit 17 sets the display area so that the cautionary objects 51A and 51B indicating that the cautionary events have occurred are included. Specifically, the display control unit 17 sets the display area 46 including the objects requiring attention 51A and 51B by moving and enlarging the display area in the virtual screen.

The drawing unit 16 extracts the display data in the range of the display area 46 from the virtual screen data 42, adjusts the display data so that the display area 46 corresponding to the extracted display data fits in the screen 31, and shifts the display area 46 to the screen 31. Display it. The drawing unit 16 changes the display data of the display area 46 so that the screen resolution of the display area 46 including the objects requiring attention 51A and 51B becomes the screen resolution of the display unit 18, and uses the changed display data to display the display area. 46 is displayed on the screen 31.

As described with reference to FIG. 5, the display terminal 10A may enlarge the display area to display when one event requiring attention has occurred. That is, the display terminal 10A may enlarge the display area and display it when all the objects to be displayed fit in the display area smaller than the screen resolution that can be displayed on the screen.

FIG. 7 is a diagram for explaining a screen displayed by the display terminal according to the first embodiment when the display area is enlarged. In FIG. 7, with respect to the virtual screen data 43, a caution object 51A shows a caution object when a caution event occurs.

The display terminal 10A sets a display area 47 in the virtual screen data 43, and displays the set display area 47 on the screen 31 of the display terminal 10A. In this case, the display terminal 10A sets the display area 47 so that the display area 47 includes the object requiring attention 51A when an event requiring attention occurs and the display area is minimized. When the display area 47 is narrower than the display area of the screen 31, the display terminal 10A enlarges the display area 47 and displays it on the screen 31 so that the entire display area 47 is displayed on the entire screen 31. Specifically, the display control unit 17 sets the display area 47 including the caution object 51A by moving and reducing the display area in the virtual screen.

The drawing unit 16 extracts the display data in the range of the display area 47 from the virtual screen data 43, adjusts the display data so that the display area 47 corresponding to the extracted display data is displayed on the screen 31, and displays the display area 47 on the screen. Display on 31. The drawing unit 16 changes the display data of the display area 47 so that the screen resolution of the display area 47 including the object requiring attention 51A becomes the screen resolution of the display unit 18, and uses the changed display data to display the display area 47. It is displayed on the screen 31.

In this way, when a plurality of caution-requiring events occur at the same time, the display terminal 10A adjusts the position and size of the display area according to the occurrence location, the number of occurrences, and the occurrence contents of the caution-requiring events. Multiple objects requiring attention corresponding to an event can be displayed on one screen at the same time.

In the first embodiment, the display control unit 17 determines the display area with reference to the object requiring attention, but the display control unit 17 considers an object satisfying a specific condition when determining the display area. You may not do it. The display control unit 17 is a specific object that satisfies conditions such as an area in which the object is arranged in the virtual screen, the type of the object, and the time when the state of the device 30 is changed (the time when the event requiring attention occurs). Does not have to be taken into consideration when determining the display area. That is, the display control unit 17 determines an object to be excluded from the display based on at least one of the area where the object is arranged in the virtual screen, the type of the object, and the time when the event requiring attention occurs. The display area may be determined for the object requiring attention among the objects other than the objects excluded from the display target. As a result, the display terminal 10A can display the display area by excluding the objects satisfying the predetermined specific conditions.

Further, in the first embodiment, the case where the display terminal 10A updates all the display data in the display area to the display data after switching has been described, but the display terminal 10A updates a part of the display data. It does not have to be. The display control unit 17 of the display terminal 10A sets, for example, a part of the user interface such as a window or a button to be excluded from the movement target of the virtual screen in advance. In this case, the display control unit 17 does not change the position or size of a part of the user interface even when updating the display area. As a result, the display terminal 10A divides the screen into a part for displaying the user interface and a part for displaying a part of the virtual screen, and switches only a part (display area) for displaying a part of the virtual screen. Can be done.

Further, in the first embodiment, the display terminal 10A displays the area including the object requiring attention as the display area, but the display area to be displayed may be set in advance by the user. In this case, the display area to be displayed by the user when a caution event occurs is registered in the display control unit 17 in advance, and the display control unit 17 displays the registered display area when the caution event occurs. To do. The user sets the display area for each event requiring attention or for each combination of events requiring attention. As a result, the display terminal 10A can display the freely set display area regardless of the state of the object.

Further, the display terminal 10A may have a function of supporting the operation of the virtual screen. In this case, the drawing unit 16 displays on the screen, for example, a navigation window having a relatively small area indicating which area of the virtual screen is displayed on the screen. The drawing unit 16 shows the positional relationship as a graphic on the navigation window so that the positional relationship between the virtual screen and the display area displayed on the screen can be understood, and the size of the graphic is the size of the display area to be displayed on the screen. Adjust according to the size.

Further, the drawing unit 16 may highlight the object requiring attention included in the display area by using at least one of a figure, a blink display, and the like. This makes it easier for the user to check the number and position of the objects requiring attention even when the entire virtual screen is displayed or when the area containing the plurality of objects requiring attention becomes relatively large.

Further, in the first embodiment, the case where the display terminal 10A displays a plurality of objects requiring attention in one display area when a plurality of events requiring attention occur has been described, but the display terminal 10A has a plurality of objects requiring attention. A plurality of objects requiring attention may be displayed using the display area. In this case, the display control unit 17 is based on at least one such as the position of the object requiring attention in the virtual screen, the relationship between the objects requiring attention, the time when the event requiring attention occurs, and the priority of the event requiring attention. A plurality of display areas are determined, and the drawing unit 16 switches and displays each display area. In this case, the display area may include only one object requiring attention, or may include a plurality of objects requiring attention. As a result, when a plurality of attention-requiring events occur, the display terminal 10A can show the user the attention-requiring object in a plurality of times. At this time, the display control unit 17 may switch the display area according to the user operation, or may automatically switch the display area at specific time intervals.

Further, the drawing unit 16 may notify the user by displaying a warning message, a thumbnail image, or the like indicating that an event requiring attention has occurred in accordance with the instruction from the display control unit 17. In this case, the display terminal 10A may display the display area including the object of the event requiring attention that has occurred, triggered by the user selecting the displayed notification.

As described above, in the first embodiment, the display terminal 10A determines the display area to be displayed on the two-dimensional display screen of the virtual screen so that the object requiring attention is displayed on the two-dimensional display screen. Further, when there are a plurality of objects requiring attention, the display terminal 10A adjusts the range of the display area so that the plurality of objects requiring attention are included in the display area. Therefore, the display terminal 10A can display each object corresponding to the plurality of caution events at once even when the caution events occur at a plurality of locations at the same time. This eliminates the need for the user to move the display area in the virtual screen multiple times in order to confirm the event requiring attention that has occurred at a plurality of locations. Therefore, the display terminal 10A can reduce the operation load by the user and allow the user to easily confirm the status determination of the event requiring attention.

Embodiment 2.
Next, the second embodiment will be described with reference to FIGS. 8 and 9. In the second embodiment, the display data of the screen to be displayed on the display unit 18 is transferred to the mobile terminal, and the screen corresponding to the display data is displayed on the mobile terminal.

FIG. 8 is a diagram showing a configuration of a display terminal provided with the display control device according to the second embodiment. FIG. 8 shows a display system 1B including a display terminal 10B, a device 30, and a mobile terminal 35. Of the components of FIG. 8, components that achieve the same functions as the display terminal 10A of the first embodiment shown in FIG. 1 are designated by the same reference numerals, and redundant description will be omitted.

The display terminal 10B includes a mobile terminal communication unit 20 which is a data transfer unit in addition to the components included in the display terminal 10A. The mobile terminal communication unit 20 transfers the display area determined by the display control unit 17 to the mobile terminal 35.

The mobile terminal 35 is an example of an external terminal seen from the display terminal 10B. The mobile terminal 35 is a communication terminal (information processing device) that can be brought to the work site. The mobile terminal 35 is, for example, a smartphone, a tablet PC (Personal Computer), a notebook PC, a head-mounted display, or the like. When the user who operates the mobile terminal 35 executes the work by remote control, the mobile terminal 35 may be used in a place different from the actual work site.

The mobile terminal communication unit 20 communicates between the display terminal 10B and the mobile terminal 35 via Wi-Fi (registered trademark) or Ethernet. The mobile terminal communication unit 20 is connected to the drawing unit 16. When the drawing unit 16 of the present embodiment generates display data indicating the display area determined by the display control unit 17, the display area is displayed on the display unit 18 using the generated display data, and the generated display data is displayed. Send to the mobile terminal communication unit 20. As a result, the mobile terminal communication unit 20 transmits the display data generated by the drawing unit 16 to the mobile terminal 35, and the mobile terminal 35 displays the screen corresponding to the display data. The screen displayed by the mobile terminal 35 is the same as the screen displayed by the display unit 18.

When the screen resolution of the display unit 18 and the screen resolution of the mobile terminal 35 are different, the drawing unit 16 may generate display data corresponding to the screen resolution of the mobile terminal 35 and send it to the mobile terminal communication unit 20. .. In this case, the display terminal 10B may register the screen resolution of the mobile terminal 35 in advance, or may receive the screen resolution from the mobile terminal 35.

FIG. 9 is a flowchart showing a processing procedure of display control processing in the display terminal according to the second embodiment. Of the processes of FIG. 9, the same processes as those executed by the display terminal 10A of the first embodiment shown in FIG. 4 will not be duplicated.

The display terminal 10B generates display data in the display area by the same process as the process described in the first embodiment. That is, the processing of steps S110 to S160 executed by the display terminal 10B is the same processing as the processing of steps S110 to S160 executed by the display terminal 10A. In the second embodiment, the process of the display terminal 10B is different from the processing of the display terminal 10A in that the display terminal 10B transfers the generated display data to the mobile terminal 35 and updates the screen of the mobile terminal 35. Hereinafter, processing different from the processing of the display terminal 10A will be described.

When the drawing unit 16 generates the display data of the determined display area (step S160), the drawing unit 16 sends the generated display data to the mobile terminal communication unit 20. The mobile terminal communication unit 20 transfers the display data generated by the drawing unit 16 to the mobile terminal 35 (step S210). As a result, the display terminal 10B updates the screen displayed by the mobile terminal 35 to the screen corresponding to the transferred display data (step S220). That is, the mobile terminal 35 displays the screen corresponding to the display data.

The mobile terminal communication unit 20 can use VNC (Virtual Network Computing) as a method of transferring display data to the mobile terminal 35. In this case, the VNC server is installed on the display terminal 10B, and the VNC client is installed on the mobile terminal 35. The display terminal 10B and the mobile terminal 35 transmit and receive data using a communication protocol called RFB (Remote Frame Buffer). As a result, the display terminal 10B can display the screen of the display unit 18 on the screen of the mobile terminal 35 in real time, and can accept the screen operation performed on the mobile terminal 35 in real time. Further, the display system 1B may display the display data on the mobile terminal 35 by using a function other than VNC. For example, when the display terminal 10B has a Web server function, the display data can be displayed on the browser of the mobile terminal 35.

As described above, according to the second embodiment, the display terminal 10B can transfer the created display data to the mobile terminal 35. As a result, the user can check the occurrence status of the event requiring attention on the mobile terminal 35 even if he / she is not in front of the display terminal 10B. Further, the display terminal 10B uses the created display data as HDMI (registered trademark) (High-Definition Multimedia Interface), DVI-D (Digital Visual Interface-D), or the like. It can also be displayed on a separate screen, projector, etc. via the video output interface. Further, the display terminal 10B may always display the entire virtual screen on the display unit 18, and may display the display area including the event requiring attention on the mobile terminal 35. As a result, the user can use the display unit 18 to check the virtual screen, and when a cautionary event occurs, the mobile terminal 35 can check the location where the cautionary event has occurred.

The display terminal 10B may execute screen display control by using another condition as a trigger other than the case where a cautionary event occurs.

The configuration shown in the above embodiments is an example, and can be combined with another known technique, can be combined with each other, and does not deviate from the gist. It is also possible to omit or change a part of the configuration.

1A, 1B display system, 2 display control device, 10A, 10B display terminal, 11 communication unit, 12 memory device, 13 device monitor unit, 14 caution event determination unit, 15 object control unit, 16 drawing unit, 17 display control unit , 18 display unit, 19 input unit, 20 mobile terminal communication unit, 21 processor, 22 ROM, 23 RAM, 24 communication IF device, 25 HDD, 26 input device, 27 display device, 30 equipment, 31 screen, 35 mobile terminal, 41-43 virtual screen data, 45-47 display area, 50 objects, 51A, 51B objects requiring attention.

Claims (9)

Based on the information acquired from the monitored device, the caution-required event determination unit that determines whether or not a caution-required event has occurred, and the caution-required event determination unit.
An object control unit that controls the state of an object that indicates whether or not the event requiring attention has occurred in a virtual screen that exceeds the range of screen resolution that can be displayed on a two-dimensional display screen, based on the result of the determination.
A display control unit that determines a display area of the virtual screen to be displayed on the two-dimensional display screen so that the caution object, which is an object indicating that the caution event has occurred, is displayed on the two-dimensional display screen. ,
A drawing unit that extracts the display data of the display area from the display data of the virtual screen and displays the display area on the two-dimensional display screen.
With
When there are a plurality of the objects requiring attention, the display control unit expands the range of the display area so that the plurality of the objects requiring attention are included in the display area.
The drawing unit, when the screen resolution of the magnified the display regions is larger than the screen resolution that can be displayed on the two-dimensional display screen is enlarged so that enlarged the display regions can be displayed on the two-dimensional display screen wherein together by reducing the display data of the display area displaying the display area on the two-dimensional display screen, the two-dimensional navigation window indicating which region has become the display area of the virtual screens The virtual screen is displayed on the display screen, and on the navigation window , the virtual screen and the figure indicating the position of the display area in the figure indicating the virtual screen are shown . The positional relationship is displayed as a graphic so that the positional relationship with the display area displayed on the two-dimensional display screen can be understood, and the size of the graphic is controlled in accordance with the size of the display area.
A display control device characterized by the fact that. A transfer unit for transferring the display data taken out by the drawing unit to an external terminal is further provided.
The display control device according to claim 1. The display control unit determines an object to be excluded from display based on at least one of the area in which the object is arranged, the type of the object, and the time when the event requiring attention occurs in the virtual screen. Then, the display area is determined for the object requiring attention among the objects other than the objects excluded from the display target.
The display control device according to claim 1 or 2. The display control unit determines the display area so that the user interface indicated by the window or button is not included in the display area.
The drawing unit draws the two-dimensional display screen without changing the position and size before Kiyu over The interface,
The display control device according to any one of claims 1 to 3, wherein the display control device is characterized by the above. An area corresponding to the event requiring attention is registered in advance in the display control unit.
The display control unit determines a pre-registered area as the display area when the event requiring attention occurs.
The display control device according to any one of claims 1 to 4, wherein the display control device is characterized by the above. The drawing unit highlights the object of interest using at least one of a graphic and a blink display.
The display control device according to any one of claims 1 to 5, wherein the display control device is characterized. The display control unit sets the position of the attention-requiring object in the virtual screen, the relationship between the attention-requiring objects, the time when the attention-requiring event occurs, and the priority of the attention-requiring event. Based on this, a plurality of the display areas are determined for the plurality of objects requiring attention, and a plurality of the display areas are determined.
The drawing unit switches and displays a plurality of the display areas.
The display control device according to any one of claims 1 to 6, wherein the display control device is characterized by the above. The drawing unit displays a warning message or a thumbnail image indicating that the event requiring attention has occurred on the two-dimensional display screen.
When the warning message or thumbnail image is selected, the display control unit displays the display area.
The display control device according to any one of claims 1 to 7, wherein the display control device is characterized. A display unit that displays the status of the device to be monitored,
A display control device that controls the display unit and
Have,
The display control device is
Based on the information acquired from the monitored device, the caution-required event determination unit that determines whether or not a caution-required event has occurred, and the caution-required event determination unit.
An object control unit that controls the state of an object that indicates whether or not the event requiring attention has occurred in a virtual screen that exceeds the range of screen resolution that can be displayed on a two-dimensional display screen, based on the result of the determination.
A display control unit that determines a display area of the virtual screen to be displayed on the two-dimensional display screen so that the caution object, which is an object indicating that the caution event has occurred, is displayed on the two-dimensional display screen. ,
A drawing unit that extracts the display data of the display area from the display data of the virtual screen and displays the display area on the two-dimensional display screen.
With
When there are a plurality of the objects requiring attention, the display control unit expands the range of the display area so that the plurality of the objects requiring attention are included in the display area.
The drawing unit, when the screen resolution of the magnified the display regions is larger than the screen resolution that can be displayed on the two-dimensional display screen is enlarged so that enlarged the display regions can be displayed on the two-dimensional display screen wherein together by reducing the display data of the display area displaying the display area on the two-dimensional display screen, the two-dimensional navigation window indicating which region has become the display area of the virtual screens The virtual screen is displayed on the display screen, and on the navigation window , the virtual screen and the figure indicating the position of the display area in the figure indicating the virtual screen are shown . The positional relationship is displayed as a graphic so that the positional relationship with the display area displayed on the two-dimensional display screen can be understood, and the size of the graphic is controlled in accordance with the size of the display area.
A display terminal characterized by that.

Images