JP2005056098A - Display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To more easily retrieve a necessary moving image and to more properly express a situation when trouble occurs, in a display device 14 connected to an external device 1, taking in state data corresponding to a control state by the external device 1, and performing unit screen display corresponding to a change of the state data on a display screen 26. <P>SOLUTION: The state data are recorded in synchronism with moving image data 50 taken in from an image pickup means 42 to allow reproduction, and the state data are used as a keyword to indirectly retrieve the moving image data. Display of the state data displayed in the same time as the moving image is expressed as a change of a figure such as a graph or a unit screen. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a display device that enables display corresponding to control contents in a control device such as a PLC, and particularly relates to a display device that enables recording and reproduction of images.

As this type of display device, the present applicant has previously programmed a display device that captures a moving image as a still image every time a predetermined event occurs, and displays the corresponding still image in conjunction with the history data. (For example, refer to Patent Document 1).
JP 2000-148331 A

  By the way, it is desirable to record and reproduce a moving image as it is without converting it into a still image. However, it is difficult to easily and accurately search a recording position of a moving image necessary when an alarm occurs. For example, although it is possible to associate moving image data for a predetermined time with one history data, in order to extract and display one scene within that time, it is necessary to reproduce and display the moving image from the beginning to the end. There is.

  As a result of consideration by the inventor for such inconvenience, the state data is recorded in synchronization with the recording of the moving image data. On the other hand, by using the state data as a search key, a moving image that needs to be displayed can be simplified. It was found that they can be selected.

  The present invention has been made on the basis of such knowledge, and by recording and reproducing the state data corresponding to the moving image data, it is possible to display the moving image corresponding to the details of the control state. In particular, it is an object of the present invention to provide a display device that can accurately determine a change in control contents by displaying a display of status data as a change in a figure or a unit screen.

  It is another object of the present invention to provide a display device that can easily search for a recording position of a necessary moving image by making it possible to search using status data as a keyword.

  It is another object of the present invention to provide a display device that can accurately determine an abnormal state of control through human senses by making it possible to record and reproduce sound in addition to moving images.

  The display device 14 according to the present invention is connected to an external device 1 such as a PLC as schematically shown in FIG. 1 as an overall configuration, and communicates state data corresponding to the control state of the external device 1. 2, the unit screen display corresponding to the change in the state data, for example, the processing instruction word stored in the processing instruction word storage means 5 and the graphic stored in the graphic data storage means 6. This is performed on the display screen 26 under the control of the display control means 4 using data.

  In the present invention, a moving image imaging means 42 is further provided, and the additional data 54 including the state data corresponding to the capturing timing of the moving image data 50 output from the imaging means 42 is obtained by the predetermined data processing means 7. The history data storage means 8 can be saved, and the saved additional data 54 can be displayed on the display screen 26 in correspondence with the reproduction time of the saved moving image data 50 on the display screen 26. Features.

  The stored state data is configured to be searchable using a keyword, and it is preferable that the corresponding moving image data 50 can be specified by the search using the operation means 9.

  The stored state data can be displayed as it is, but can also be displayed as a movement of a predetermined figure such as a graph as illustrated in FIG. Furthermore, the display may be displayed as a change of the unit screen in addition to designating and displaying individual data.

  In that case, the unit screen can be made up of multiple units and the unit screens selected when saving the image data can be played back and displayed sequentially, or the unit screens that could be selected when saving the image data are played back and displayed in parallel. Can also be done. Further, the apparatus further includes sound collecting means, and can save the sound data 52 output from the sound collecting means 44 in correspondence with the timing of capturing the moving image data 50 from the image pickup means 42, while storing the stored moving image. The stored sound data 52 may be reproducible in correspondence with the reproduction time of the image data 50 on the display screen 26.

  As described above, the present invention can display a moving image corresponding to the details of the control state by recording and reproducing the state data corresponding to the moving image data. In particular, by displaying the status data display as a graphic or unit screen change, it is possible to accurately determine the change in the control content.

  Further, by making it possible to search using status data as a keyword, it is possible to easily search for a necessary moving image recording position. Further, by enabling recording and reproduction of sound in addition to moving images, it is possible to accurately determine an abnormal state of control through the human senses.

  Hereinafter, as shown in FIG. 2, the present invention is a program used as a control panel for each PLC in a control system in which a plurality of PLCs 10 and 10 provided as external devices are linked to each other to enable sequence control of the target system 12. However, the present invention is not limited to this, and the display device 14 can be used in a similar manner to various personal computer application devices having a display function. Of course.

  There are a plurality of display devices 14, and each display device 14 is LAN-connected to the host computer 18 via the network line 16, and various data can be exchanged with the host computer 18 using a common communication protocol. .

  Further, while the memory capacity provided for each display device 14 is suppressed to the minimum necessary, the data fetched through the display device 14 is automatically sent to the host computer 18 via the network line 16 at regular time intervals or at predetermined intervals. By setting so that the data can be sent manually using the command, the host computer 18 can create a database of data sent from all the display devices 14 so that centralized data management can be performed on the operation screen of the host computer 18. Constitute. At the same time, each display device 14 is configured such that necessary data can be taken out from the host computer 18 using the search function at an appropriate time and displayed on the display screen 26 in each display device 14.

  Each display device 14 has substantially the same configuration, and is directly connected to one or a plurality of PLCs 10 via a dedicated communication line 20 so that data can be communicated using a dedicated communication protocol depending on the model of each PLC 10. On the other hand, by enabling the sequence control of the target system 12 with the connected PLC 10, it is used as a control panel in the PLC 10.

  The PLC 10 is achieved as a whole PLC by unitizing a circuit for each required individual function such as a CPU unit, a memory unit, or a computer link unit, and adding each unit as needed via a bus line. It is the thing of the structure substantially the same as the past that enables increase / decrease in the function to be performed.

  The storage location of the state data that is directly input / output via the sensor 21 or the switch of the target system 12 or used for the control is a level meter or limit switch provided on the target system 12 to be controlled or displayed. Passive parts such as relays, active parts such as relays and motors, or data setting parts such as counters and printers are secured on the memory unit. For word data such as on / off information, the word device sets the storage location in the memory unit so that the storage location can be specified by specifying the device name or address such as “X001” specific to the model. Has been.

  Therefore, only by specifying and accessing an arbitrary word device or bit device in the memory unit from the inside or outside of the PLC 10, the corresponding position of the target system 12 can be controlled or information regarding the operation state can be individually taken out. In view of this, the display device 14 is provided with an area in which all of the state data of the memory unit or a portion necessary for display and control can be stored, and a data transfer operation for matching the two is automatically performed. By simply referring to or changing the state data, display and control corresponding to the control state of the PLC 10 can be performed.

  As illustrated in FIGS. 3 and 4, the display device 14 has a display screen 26 using, for example, a liquid crystal display device as the display 24 on the front side of the main body case 22 formed in a substantially rectangular shape. The touch panel 28 is disposed in close contact with the liquid crystal panel 26. On the other hand, by accommodating the display control circuit 30 illustrated in FIG. 4 inside the main body case 22, a display corresponding to the control state in the PLC 10 is performed on the display screen 26, and at the same time, the display screen 26 via the touch panel 28 is displayed. The pointing operation by the fingertip is analyzed by the touch panel controller 32 for the pointing coordinates and the timing, and is used for various data processing to be described later.

  The configuration of the display control circuit 30 is basically the same as that of the personal computer device, and various memories including the CPU 34, ROM 36 and RAM 37 or the graphic controller 38 are connected via the bus line, and the data processing result by the CPU 34 is the graphic controller. 38, the corresponding contents are displayed on the display screen 26 of the display 24.

  In the present invention, the moving image capturing means 42 such as a video camera and the sound collecting means 44 such as a microphone are required to be constantly monitored, such as a control point in the target system 12. For example, it is possible to collect information related to an unusual state such as an on-site situation at the time of an alarm occurrence or abnormal noise of a motor. Then, the video signal output from the image pickup means 42 is digitized through the video processing circuit 46 to obtain the moving image data 50, while the acoustic signal output from the sound collecting means 44 is digitized through the acoustic processing circuit 48 to generate the sound. Each data is taken in as data 52, and data for a predetermined time can be temporarily stored in a memory such as the RAM 37 or a hard disk. As a method for storing various data, it is possible to store all the data when there is a margin in the memory, and when there is a limit, set the storable time in advance, and sequentially from the data stored first. Of course, it is possible to use various conventional methods such as selectively storing only necessary portions while erasing them.

  Moreover, the control state in PLC10 is always monitored using the process instruction word mentioned later, for example, the state data corresponding to the detection state of the sensor 21 provided in the target system 12 is such that the tank level and temperature exceed the upper limit value. If a predetermined condition such as a predetermined time interval is satisfied even during a normal operation, for example, several minutes or 10 minutes after the condition is satisfied or before and after the condition is satisfied. The additional data 54 including the change history of the state data is sequentially stored in the memory for a predetermined time.

  At that time, the moving image data 53 and the acoustic data 50 are captured in correspondence with the state data change history capturing period, and the acoustic data 52 and the additional data 54 are associated with the frame change of the moving image data 52 as shown in FIG. One file 56 is configured by being compressed and stored. Thus, the change history of the sound data 52 and the state data can be reproduced in synchronization with the reproduction of the moving image data 52. The additional data 54 to be stored at the same time is limited in terms of the date and time, information for specifying the event content generated such as an alarm, the type of the selected unit screen or touch information on the touch panel 28, and the like. It is not a thing.

  Of course, the data format for storing the data in the form of a file can be appropriately changed according to the data to be stored. For example, the moving image data 52 is generally in the MPEG format, and the audio data 50 is generally in the G726 or MP3 format. Further, the audio data 50 and other data are stored in a reproducible manner in synchronization with the moving image data 52. Can use various existing or new data formats such as the ASF format.

  Further, the state data or the additional data 54 is indexed to form a database, and the moving image data 52 or the sound data stored together with the information using a specific keyword or the magnitude of the value of the specific state data as a search key. 50 memory positions can be indirectly searched.

  Here, the display of the various data stored as described above on the display screen 26 can be designed using any general-purpose application such as a general-purpose database program or an Internet browser. However, in the display device 14 described above, a processing instruction word, which is a dedicated display control simple program, is used for the display control operation. For example, the touch panel 28 is to process data on the display screen 26. By specifying a tag name for each data processing function that is a basic unit such as a switch-on operation or screen display of numerical values and characters, one or more processing instructions are set on the display screen 26. Necessary functional operations can be easily realized on the display screen 26.

  Further, a single programmable display device 14 is provided with a plurality of unit screens configured as described above for data processing, and by specifying a different file number for each unit screen, the unit screen A screen displaying the necessary operation contents can be obtained by simply switching.

  On the other hand, the display control circuit 30 reads the processing instruction words set on the opened unit screen every predetermined short time, and repeatedly performs the corresponding data processing so that the necessary data processing operation is performed. I have to.

  The basic configuration of the processing instruction word is substantially the same. The file number of the base screen on which the display control operation is to be executed, the tag name that specifies the operation content to be executed on the base screen, and each execution event And a set of reference information made up of one or more pieces of data.

  In addition, since more advanced functions can be configured by combining a plurality of basic processing instructions as described above, the frequency of use such as reproduction display of stored additional data 54 and display of moving image data 52 is increased. For large functions, the corresponding processing instruction words are grouped into one processing instruction word, or a dedicated processing instruction word is defined.

  The present invention is characterized in that the information stored as described above is reproduced and displayed on the display screen 26. For example, FIG. 3 shows an example of a unit screen that is automatically displayed when the system is stopped due to an alarm occurrence. A moving image display section 58 is provided at the upper left of the screen, and a moving image is reproduced below. An operation unit 60 having stop and fast-forward keys and a keyword input window 62 are provided.

  The keyword that can be used for the search is not limited to the date and time, the period when the specific state data exceeds the set value, the period below it, the period within a predetermined range, or the alarm occurrence content. Further, it is possible to input a plurality of conditions and take a logical sum or logical product as in the conventional case. By inputting a search condition into the input window 62 and pressing a key on the operation unit 60, data in the corresponding range is extracted and displayed on the screen.

  Further, in the right half of the display screen 26, there is formed a display section 64 for additional data in which a change in state data synchronized with the display of the moving image is displayed in addition to the date and time when the moving image is recorded. The acoustic data 50 is displayed on the speaker that does not. The status information can be displayed directly from raw or unprocessed data that has been extracted from the PLC 10 such as numerical values and symbols, and can be graphed as illustrated in FIG. It can also be transformed into a figure and displayed.

  Further, instead of or in addition to displaying a part of the saved state data, the unit screen that is actually displayed on the display screen 26 when the moving image data 52 is saved, or selected at that time. The change status of the unit screen that was not selected but could be displayed is reproduced in synchronization with the reproduction of the moving image data 52 using the state data and the screen data stored as described above. Is also possible. At that time, it is needless to say that various display methods can be employed, such as stopping and displaying the content displayed on the screen, or advancing the display step by step every predetermined time.

  Furthermore, the display position of the additional data 54 is also assumed to be a case where the display screen 26 is relatively large, and one screen is divided into a plurality of parts and displayed simultaneously. Display methods such as enabling switching display while displaying on a window and superimposing them on each other, or overlaying additional data 54 or a graphic representation on a moving image. The position can be changed as appropriate.

  It is also possible to hold all the saved data, but the moving image data 52 and the additional data 54 are compressed by taking a difference at the time of saving, so that it is determined that the difference data is large, and the difference data It is also possible to delete from the file 56 including the moving image data 52 or the additional data 54 having a small size. Further, the file 56 that needs to be preferentially displayed can be selected using the difference data as a search key. Furthermore, instead of or in addition to centrally managing the data by the host computer 18 provided outside, it is also possible to distribute and manage necessary data by providing an external storage means such as a hard disk for each display device.

It is the schematic which shows the basic composition of this invention. It is a general block diagram which shows an example which implemented this invention in the control system. It is a front view which shows an example of a program-type display apparatus. It is a block diagram which shows an example of an electrical structure concretely. It is explanatory drawing which shows an example of the data preserve | saved.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 External device 2 Communication means 3 Status data storage means 4 Display control means 5 Processing instruction word storage means 6 Graphic data storage means 7 Data processing means 8 History data storage means 9 Operation means 10 PLC
DESCRIPTION OF SYMBOLS 12 Target system 14 Display apparatus 16 Network line 18 Host computer 20 Dedicated communication line 21 Sensor 22 Main body case 24 Display 26 Display screen 28 Touch panel 30 Display control circuit 32 Touch panel controller 34 CPU
36 ROM
37 RAM
38 Graphic controller 40 Video RAM
42 Imaging means 44 Sound collection means 46 Video processing circuit 48 Acoustic processing circuit 50 Moving image data 52 Acoustic data 54 Additional data 56 File 58 Moving image data display section 60 Operation section 62 Keyword input window 64 Additional data display section

Claims (7)

A display device connected to an external device, fetching status data corresponding to a control state by the external device, and performing unit screen display corresponding to the change of the status data on the display screen,
While further comprising a moving image imaging means, it is possible to save additional data including the state data corresponding to the timing of capturing the moving image data from the imaging means,
A display device characterized in that the stored additional data can be displayed in correspondence with the reproduction time of the stored moving image data on the display screen. The stored state data is reconstructed to be searchable using keywords,
The display device according to claim 1, wherein the corresponding moving image data can be specified by the search.   The display device according to claim 1, wherein the stored state data is displayed as a movement of a predetermined graphic.   The display device according to claim 3, wherein the stored state data is displayed as a change of a unit screen.   5. The display device according to claim 4, wherein there are a plurality of unit screens to be displayed, and the unit screens selected at the time of storing the image data are sequentially reproduced and displayed.   5. The display device according to claim 4, wherein there are a plurality of unit screens to be displayed, and the unit screens that can be selected when the image data is stored are reproduced and displayed in parallel. Further comprising acoustic sound collecting means, which can store the acoustic data output from the sound collecting means in correspondence with the timing of capturing moving image data from the imaging means,
The display device according to claim 1, wherein the stored sound data can be reproduced in accordance with a reproduction time on the display screen of the stored moving image data.

Images