WO2010110000A1 - Programmable display - Google Patents

Programmable display Download PDF

Info

Publication number
WO2010110000A1
WO2010110000A1 PCT/JP2010/052707 JP2010052707W WO2010110000A1 WO 2010110000 A1 WO2010110000 A1 WO 2010110000A1 JP 2010052707 W JP2010052707 W JP 2010052707W WO 2010110000 A1 WO2010110000 A1 WO 2010110000A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
moving image
display
input
video
Prior art date
Application number
PCT/JP2010/052707
Other languages
French (fr)
Japanese (ja)
Inventor
孝一 折戸
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to TW099107946A priority Critical patent/TW201100987A/en
Publication of WO2010110000A1 publication Critical patent/WO2010110000A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0442—Handling or displaying different aspect ratios, or changing the aspect ratio
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user

Definitions

  • the present invention relates to a programmable display, and more particularly to a programmable display that enables display corresponding to the content of control by a control device.
  • Patent Document 1 proposes a technique for generating and storing moving image data associated with time data for the purpose of confirming a state when an abnormality occurs in a control target device. According to the technique according to Patent Document 1, the programmable display device searches for a time associated with the selected symbol by selecting a symbol corresponding to each instruction in the control program, and a time zone close to that time. Display the video.
  • HMI Human Machine Interface
  • Patent Document 2 proposes a technique for storing moving image data synchronized with state data and making it possible to search for moving image data using the state data as a keyword.
  • the programmable display device searches for moving image data using the state data corresponding to the control state as a keyword.
  • the present invention has been made in view of the above, and an object of the present invention is to obtain a programmable display capable of grasping an operation state of a control target and facilitating verification when an abnormality occurs.
  • the purpose is to detect the movement of a specific area from the video based on the video data, and to search it as log data.
  • the present invention provides a moving image data storage unit that stores moving image data acquired by imaging a control object, and a log containing the operation state of the control object
  • Log data storage means for holding data, video by the video data held in the video data storage means, and display means for displaying the contents of the log data held in the log data storage means
  • Time data given to the moving image data and the log data for centrally managing the moving image data held in the moving image data storage means and the log data held in the log data storage means on a common time axis
  • Time data generating means for generating a search time point on the time axis is specified based on the video displayed on the display means
  • the log data to which the time data corresponding to the search target time point is searched or the search target time point on the time axis is determined based on the content of the log data displayed on the display means.
  • data search means for searching for the moving image data to which the time data corresponding to the search target time point is specified.
  • moving image data and log data are mutually searched, and the display based on the searched data is enabled, thereby facilitating the understanding of the operation state of the controlled object and the verification when an abnormality occurs. There is an effect that can be.
  • FIG. 1 is a block diagram illustrating a schematic configuration of the programmable display device according to the first embodiment.
  • FIG. 2 is a diagram illustrating an example of display on the display screen of the display unit.
  • FIG. 3 is a block diagram illustrating a schematic configuration of a characteristic part of the programmable display device according to the second embodiment.
  • FIG. 4 is a diagram illustrating an example of an input instruction to the input unit and a corresponding function.
  • FIG. 5 is a diagram showing a moving image display window of the programmable display according to the third embodiment.
  • FIG. 1 is a block diagram showing a schematic configuration of a programmable display 100 according to Embodiment 1 of the present invention.
  • the programmable display device 100 displays an operation state of a control target device controlled by an external control device 6 such as a PLC (Programmable Logic Controller).
  • the programmable display 100 includes a moving image data processing unit 3, a moving image data storage unit 4, a time data management unit 5, an external device connection interface (I / F) 7, a log data storage unit 8, a general processing unit 9, an input unit 10,
  • the display generation unit 11, the display unit 12, and the sound generation unit 13 are included.
  • the programmable display 100 is connected to the imaging means 1, the sound collection means 2, the external control device 6 and the sound generation means 14.
  • the external control device 6 is connected to a control target device (not shown).
  • the imaging unit 1 is a camera that captures an operation state of the control target device.
  • the imaging unit 1 is installed at a position where the control target device can be imaged.
  • the sound collecting means 2 is a microphone that acquires sound.
  • the sound collecting means 2 is installed at a position where the sound generated by the control target device can be acquired.
  • the moving image data processing unit 3 generates moving image data through a process of synchronizing the imaging data acquired by the imaging unit 1 and the audio data acquired by the sound collecting unit 2.
  • the external device connection I / F 7 generates log data containing the operation state of the control target device.
  • the log data is, for example, an alarm when an abnormality occurs in the control target device or an operation log history of the control target device by the external control device 6.
  • the time data management unit 5 includes time data generation means 21 and data search means 22.
  • the time data generation means 21 generates time data.
  • the moving image data storage unit 4 holds the moving image data output from the moving image data processing unit 3 with the time data output from the time data generation unit 21.
  • the log data storage unit 8 retains the log data output from the external device connection I / F 7 with the time data output from the time data generation unit 21.
  • the time data is given to the moving image data and the log data in order to centrally manage the moving image data held in the moving image data storage unit 4 and the log data held in the log data storage unit 8 on a common time axis.
  • the data search unit 22 searches the moving image data held in the moving image data storage unit 4 and the log data held in the log data storage unit 8.
  • the general processing unit 9 performs processing for display generation in the display generation unit 11 and sound generation by the sound generation unit 13 based on the input instruction data generated by the input operation to the input unit 10. Further, the general processing unit 9 causes the data search unit 22 to search for the moving image data and the log data according to an instruction from the input unit 10, and the moving image data extracted from the moving image data storage unit 4 and the log data storage unit 8 extract it. Log data is processed.
  • the display generation unit 11 generates display data according to the output from the overall processing unit 9.
  • the sound generation unit 13 generates sound data according to the output from the general processing unit 9.
  • the display unit 12 displays the display data generated in the display generation unit 11 in a graphic form.
  • the display unit 12 includes, for example, a liquid crystal display device.
  • the sound generation unit 14 includes a speaker that converts the sound data generated by the sound generation unit 13 into sound and generates the sound.
  • the sound generated from the sound generation means 14 is, for example, an alarm sound. Further, in the reproduction of the moving image data, the reproduction of the video by the display unit 12 and the reproduction of the sound by the sound generation unit 14 may be performed simultaneously.
  • the input means 10 accepts an input operation by an operator.
  • the input unit 10 includes, for example, a touch panel disposed on the display screen of the display unit 12.
  • the input unit 10 may operate a mouse or other pointing device instead of the touch panel.
  • the programmable display device 100 may receive an operation on the external control device 6 by the input unit 10 and transmit the input instruction data generated by the input operation to the input unit 10 to the external control device 6.
  • FIG. 2 is a diagram for explaining an example of display on the display screen 200 of the display means 12.
  • the moving image display window 300 is a window for displaying an image based on moving image data.
  • the portion where the moving image operation button 301 is displayed accepts an input operation related to reproduction of a moving image in the moving image display window 300.
  • the moving image operation button 301 includes keys for moving image playback, stop, fast forward, cueing, and the like.
  • the time bar 302 represents the time axis of the moving image data held in the moving image data storage means 4.
  • the indicator 303 shown on the time bar 302 indicates at which time point on the time axis of the video data stored in the video data storage means 4 the video displayed in the video display window 300 is.
  • the playback point on the time axis is shown.
  • the indicator 303 is also a key for adjusting the playback point of the moving image by moving on the time bar 302.
  • the indicator 303 functions as a playback point adjusting means for adjusting the playback point on the time axis of the video displayed in the moving image display window 300.
  • the time display window 400 displays the playback point of the moving image as a time point on which time point the video displayed in the moving image display window 300 is on the time axis of the moving image data.
  • the lamp / switch display 401 displays ON / OFF of the device to be controlled by turning on / off, changing the color, etc., and the presence / absence of a warning for notifying that an abnormality has occurred in the device to be controlled.
  • the numerical value input display window 402 displays numerical values input regarding the control of the external control device 6.
  • the alarm log display window 403 displays an alarm when an abnormality occurs in the control target device and an operation log history of the control target device by the external control device 6.
  • the graph display window 404 is a window for displaying the contents of the log data held in the log data storage unit 8 as a trend graph using a time axis.
  • the trend graph is a graph showing changes in various numerical values depending on the level of the broken line, and is represented with a predetermined direction, for example, the horizontal direction on the display screen 200 as a time axis.
  • the trend graph is scrolled in the alarm log display window 403 by moving the touch position in the time axis direction, for example, the left-right direction in the graph display window 404.
  • the portion where the graph display window 404 is displayed functions as a display range specifying means for specifying a range in which the trend graph is displayed on the time axis.
  • the trend graph may be a graph other than a line graph, and may be appropriately modified such that the direction of the time axis is, for example, the vertical direction.
  • the operator moves the indicator 303 on the time bar 302 while watching the video displayed on the video display window 300, and designates a desired search target time point from the video displayed on the video display window 300.
  • the data search means 22 refers to time data given to the moving image data displayed in the moving image display window 300.
  • the data search means 22 searches the log data storage means 8 for log data to which the same time data as the referenced time data is assigned.
  • the overall processing unit 9 causes the graph display window 404 to update and display a trend graph in which the log data extracted from the log data storage unit 8 is the reference position of the graph display window 404.
  • the reference position of the graph display window 404 is, for example, the center position of the graph display window 404 in the left-right direction. In the figure, the reference position of the graph display window 404 is the position of a solid line indicated by a triangle attached to the outer edge portion of the window. In this way, by specifying the search target time point on the time axis based on the video displayed on the display unit 12, the data search unit 22 searches the log data at the search target time point.
  • the operator designates a desired search target time point by scrolling the trend graph while viewing the trend graph in the graph display window 404.
  • the data search means 22 refers to the time data given to the log data that is the reference position of the graph display window 404.
  • the data search means 22 searches the moving picture data storage means 4 for moving picture data to which the same time data as the referenced time data is given.
  • the overall processing unit 9 causes the moving image display window 300 to update and display the video based on the moving image data extracted from the moving image data storage unit 4. In this way, by specifying the search target time point on the time axis based on the content of the log data displayed on the display unit 12, the data search unit 22 searches for moving image data at the search target time point.
  • Programmable display device 100 provides video data and log data with time data for centrally managing moving image data and log data on a common time axis, thereby searching log data based on video, It is possible to search for moving image data based on the data contents.
  • the programmable display device 100 enables a mutual search between moving image data and log data, and enables display based on the searched data. Rather than uniquely cueing moving image data by selecting an alarm or operation log in the alarm log display window 403 or operating the moving image operation button 301, video and log data at an arbitrary position on the time axis are displayed. Therefore, the situation before and after the occurrence of the abnormality can be easily grasped, and the situation can be grasped easily. As a result, it is possible to facilitate the understanding of the operation state of the controlled object and the verification when an abnormality occurs.
  • FIG. FIG. 3 is a block diagram showing a schematic configuration of the characteristic part of the programmable display according to Embodiment 2 of the present invention.
  • the programmable display according to the present embodiment is characterized in that when the input instruction data matches the specific input instruction data, the function corresponding to the specific input instruction data is executed for the display of the video by the display unit 12.
  • Configurations other than the configuration described in the present embodiment among the programmable displays are the same as those of the programmable display 100 (see FIG. 1) according to the first embodiment.
  • the same parts as those in the first embodiment are denoted by the same reference numerals, and redundant description is omitted.
  • the input determination means 15 is provided in the overall processing means 9.
  • the input determining unit 15 determines whether or not the input instruction data generated based on the input operation received by the input unit 10 matches the specific input instruction data set in advance in correspondence with the function for video playback. Judging.
  • the input determination unit 15 determines that the input instruction data matches the specific input instruction data
  • the input determination unit 15 causes the display generation unit 11 to generate a display corresponding to the function corresponding to the specific input instruction data, and corresponds to the specific input instruction data. Execute the function.
  • FIG. 4 is a diagram showing an example of an input instruction to the input means 10 and its corresponding function.
  • the movement locus of the touch position on the surface of the display screen 200 (see FIG. 2) on which the touch panel is disposed and the corresponding function are set in advance.
  • video is displayed for specific input instruction data for moving the touch position along the same locus as the letter “Z”.
  • an “enlarged display” function for displaying a part of the image is enlarged is set.
  • a range to be enlarged and displayed in the video is determined by the coordinates of the start point 1000 and the end point 1001 of the touch position.
  • the input unit 10 outputs input instruction data including the locus of moving the touch position, the coordinates of the start point 1000 and the coordinates of the end point 1001 in the moving image display window 300.
  • the input determination means 15 determines that the input instruction data from the input means 10 is the specific input instruction data. It is judged that it matches.
  • the input determining unit 15 determines a range to be enlarged and a magnification in the video according to the coordinates of the start point 1000 and the coordinates of the end point 1001 in the specific input instruction data, and outputs them to the overall processing unit 9.
  • the display unit 12 enlarges and displays the video according to the control by the overall processing unit 9.
  • the left-right direction of the moving image display window 300 is the X direction
  • the up-down direction is the Y direction.
  • the range in which the video is enlarged and displayed is, for example, a rectangular region having a length in the X direction between the start point 1000 and the end point 1001 or a length in the Y direction as one side.
  • the enlargement magnification is, for example, the magnification of the X direction length of the moving image display window 300 with respect to the X direction length between the start point 1000 and the end point 1001, or the moving image display window 300 with respect to the Y direction length between the start point 1000 and the end point 1001.
  • the magnification of the length in the Y direction is displayed an enlarged image of the range instructed by the input operation by the operator at the instructed enlargement magnification.
  • an “enlarged display cancel” function for canceling the enlarged display of the video is set in response to an input instruction when the touch position is moved along the locus similar to the character “W”.
  • the input unit 10 uses the shape of the touch position moved, the coordinates of the start point 1000 of the touch position in the moving image display window 300, Input instruction data including the coordinates of the end point 1001 is output.
  • the input determination unit 15 determines that the input instruction data from the input unit 10 matches the specific input instruction data.
  • the moving image display window 300 cancels the enlarged display and returns the image to the magnification before enlargement in response to an input instruction from the operator.
  • the movement locus of the touch position set as the specific input instruction data is not limited to that described in the present embodiment, as long as the input operation instructing the execution of which function can be identified. You may deform
  • a specific operation unit that executes a predetermined operation is used for a reproduction operation of an image displayed on a display screen.
  • the partial enlarged display of the video is performed at a magnification specified in advance by operation of the operation unit.
  • the programmable display according to the present embodiment can close up an arbitrary portion of an image at an arbitrary magnification by moving the touch position on the display screen 200. Since the detailed part of the video can be immediately confirmed, it is possible to grasp the operation state of the control target and facilitate the verification when an abnormality occurs. In addition, it is possible to eliminate the need for a specific operation unit for the function for which the specific input instruction data is set.
  • the function for which the specific input instruction data is set is not limited to the enlarged display function and the enlarged display release function.
  • specific input instruction data may be set for the enlarged display function, and the enlarged display release function may be executed by another input operation in the input unit.
  • the specific input instruction data may be set for other functions related to video playback, such as playback, playback stop, playback pause, fast forward, and rewind. By associating these functions with each trajectory for moving the touch position on the touch panel, it is possible to further reduce the specific operation unit for video reproduction.
  • the above-described operation of the programmable display can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. These programs are recorded on a computer-readable recording medium and executed by being read from the recording medium by the computer. These programs may be distributed via a network (communication line) such as the Internet.
  • a network such as the Internet.
  • FIG. 5 is a diagram showing a moving image display window 300 of the programmable display according to Embodiment 3 of the present invention.
  • the programmable display according to the present embodiment is characterized in that a search for motion detection in the motion detection region 500 is possible.
  • the motion detection area 500 is designated in advance in video based on moving image data.
  • the moving image display window 300 displays an image of the belt conveyor in operation.
  • the entry prohibition area around the belt conveyor is designated as the motion detection area 500.
  • a threshold value indicating a change in video is appropriately set in the programmable display, and a change equal to or greater than the set threshold value is recognized as motion detection.
  • the log data storage means holds the motion detection in the motion detection area 500 by including it in the log data. For example, when there is an approaching object to the motion detection area 500, the time when the approach occurred is stored as log data by recognizing the movement of the approaching object as motion detection. Log data including motion detection and moving image data are centrally managed on a common time axis.
  • the motion detection according to the present embodiment is not limited to the case where it is used for detection of an entry object to the entry prohibition area, and can be widely applied to grasping some situation such as occurrence of an abnormality.
  • the motion detection may be applied, for example, when it is grasped that a manufactured product or a box transported by a belt conveyor is in a state of protruding from the motion detection area 500.
  • the programmable display device is useful for verifying the relationship between various log data related to control of the external control device and moving image data.
  • moving image data storage means 8 log data storage means 10 input means 12 display means 15 input determination means 21 time data generation means 22 data search means 100 programmable display

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Testing And Monitoring For Control Systems (AREA)

Abstract

A programmable display comprises a moving image data storage means (4), a log data storage means (8), a display means (12) for displaying an image and the content of log data by means of moving image data, a time data generating means (21) for generating time data which is added to the moving image data and the log data in order to unify the management of the moving image data and the log data by means of the common time axis, and a data retrieval means (22) for retrieving the log data to which the time data corresponding to a time point to be retrieved is added by the specification of the time point to be retrieved in the time axis on the basis of the image displayed on the display means (12), or retrieving the moving image data to which the time data corresponding to the time point to be retrieved is added by the specification of the time point to be retrieved in the time axis on the basis of the content of the log data displayed on the display means (12).

Description

プログラマブル表示器Programmable display
　本発明は、プログラマブル表示器、特に、制御装置による制御内容に対応した表示を可能とするプログラマブル表示器に関する。 The present invention relates to a programmable display, and more particularly to a programmable display that enables display corresponding to the content of control by a control device.
　従来、プログラマブル表示器は、ＦＡ関連等でのシーケンサのＨＭＩ（Human　Machine　Interface）デバイスのインターフェース機器として使用されている。プログラマブル表示器に対しては、制御対象機器の状態変化を報知し、状態変化の原因を分析する等の対策に関する支援を可能とすることについて要請がなされている。制御対象機器に異常が生じた際の状態を確認することを目的として、例えば、特許文献１には、時刻データが関連付けられた動画データを生成し、格納する技術が提案されている。特許文献１に係る技術によると、プログラマブル表示器は、制御プログラムにおける各命令に対応するシンボルが選択されることにより、選択されたシンボルに関連付けされている時刻を検索し、その時刻に近い時間帯の映像を表示する。 Conventionally, the programmable display has been used as an interface device for an HMI (Human Machine Interface) device of a sequencer for FA-related and the like. There has been a demand for a programmable display device that can provide support for measures such as notifying the state change of the control target device and analyzing the cause of the state change. For example, Patent Document 1 proposes a technique for generating and storing moving image data associated with time data for the purpose of confirming a state when an abnormality occurs in a control target device. According to the technique according to Patent Document 1, the programmable display device searches for a time associated with the selected symbol by selecting a symbol corresponding to each instruction in the control program, and a time zone close to that time. Display the video.
　また、例えば、特許文献２には、状態データに同期させた動画データを格納し、状態データをキーワードとして動画データを検索可能とする技術が提案されている。特許文献２に係る技術によると、プログラマブル表示器は、制御状態に対応する状態データをキーワードとして動画データを検索する。 Also, for example, Patent Document 2 proposes a technique for storing moving image data synchronized with state data and making it possible to search for moving image data using the state data as a keyword. According to the technique according to Patent Document 2, the programmable display device searches for moving image data using the state data corresponding to the control state as a keyword.
国際公開第０５／９１０９８号（第２６頁、第１図）International Publication No. 05/91098 (page 26, Fig. 1) 特開２００５－５６０９８号公報（第９頁、第３図）Japanese Patent Laying-Open No. 2005-56098 (page 9, FIG. 3)
　上記の従来技術のいずれも、制御対象機器の制御状態から動画データを検索するものであるから、制御対象機器の動作状態の確認のためにログデータの確認が必要となる。このため、制御対象機器に生じた何らかの異常に対して、制御対象機器の動作状態を即座に把握することが困難な場合が生じ得る。本発明は、上記に鑑みてなされたものであって、制御対象の動作状態の把握、異常発生の際の検証の容易化を可能とするプログラマブル表示器を得ることを目的とする。 Since any of the above prior arts searches for moving image data from the control state of the control target device, it is necessary to check log data in order to check the operation state of the control target device. For this reason, it may be difficult to immediately grasp the operation state of the control target device with respect to any abnormality that has occurred in the control target device. The present invention has been made in view of the above, and an object of the present invention is to obtain a programmable display capable of grasping an operation state of a control target and facilitating verification when an abnormality occurs.
　また、動画データによる映像から特定領域の動きを検出し、ログデータとして検索可能とすることを目的とする。 Also, the purpose is to detect the movement of a specific area from the video based on the video data, and to search it as log data.
　上述した課題を解決し、目的を達成するために、本発明は、制御対象を撮像することにより取得された動画データを保持する動画データ記憶手段と、前記制御対象の動作状態を内容とするログデータを保持するログデータ記憶手段と、前記動画データ記憶手段に保持された前記動画データによる映像と、前記ログデータ記憶手段に保持された前記ログデータの内容と、を表示する表示手段と、前記動画データ記憶手段に保持された前記動画データと前記ログデータ記憶手段に保持された前記ログデータとを共通の時間軸により一元管理するために前記動画データと前記ログデータとに付与される時刻データを生成する時刻データ生成手段と、前記表示手段に表示されている前記映像に基づいて前記時間軸における検索対象時点が指定されることにより、当該検索対象時点に対応する前記時刻データが付与された前記ログデータを検索し、または、前記表示手段に表示されている前記ログデータの内容に基づいて前記時間軸における検索対象時点が指定されることにより、当該検索対象時点に対応する前記時刻データが付与された前記動画データを検索するデータ検索手段と、を有する。 In order to solve the above-described problems and achieve the object, the present invention provides a moving image data storage unit that stores moving image data acquired by imaging a control object, and a log containing the operation state of the control object Log data storage means for holding data, video by the video data held in the video data storage means, and display means for displaying the contents of the log data held in the log data storage means, Time data given to the moving image data and the log data for centrally managing the moving image data held in the moving image data storage means and the log data held in the log data storage means on a common time axis Time data generating means for generating a search time point on the time axis is specified based on the video displayed on the display means The log data to which the time data corresponding to the search target time point is searched or the search target time point on the time axis is determined based on the content of the log data displayed on the display means. And data search means for searching for the moving image data to which the time data corresponding to the search target time point is specified.
　また、動画データによる映像から特定領域の動きを検出し、ログデータに含めて保持することにより、動き検出を検索可能とする。 Also, it is possible to search for motion detection by detecting the motion of a specific area from video data and including it in log data.
　本発明によれば、動画データとログデータとを相互に検索し、検索されたデータに基づく表示を可能とすることにより、制御対象の動作状態の把握、異常発生の際の検証を容易化させることができるという効果を奏する。 According to the present invention, moving image data and log data are mutually searched, and the display based on the searched data is enabled, thereby facilitating the understanding of the operation state of the controlled object and the verification when an abnormality occurs. There is an effect that can be.
　またこの発明によれば、外部センサ装置等を用いること無く、動き検出領域として指定した箇所の状況把握等を容易にできるという効果を奏する。 Further, according to the present invention, there is an effect that it is possible to easily grasp the situation of the place designated as the motion detection area without using an external sensor device or the like.
図１は、実施の形態１に係るプログラマブル表示器の概略構成を示すブロック図である。FIG. 1 is a block diagram illustrating a schematic configuration of the programmable display device according to the first embodiment. 図２は、表示手段の表示画面における表示の一例を説明する図である。FIG. 2 is a diagram illustrating an example of display on the display screen of the display unit. 図３は、実施の形態２に係るプログラマブル表示器の特徴部分の概略構成を示すブロック図である。FIG. 3 is a block diagram illustrating a schematic configuration of a characteristic part of the programmable display device according to the second embodiment. 図４は、入力手段への入力指示と、その対応機能との一例を示す図である。FIG. 4 is a diagram illustrating an example of an input instruction to the input unit and a corresponding function. 図５は、実施の形態３に係るプログラマブル表示器の動画表示ウィンドウを示す図である。FIG. 5 is a diagram showing a moving image display window of the programmable display according to the third embodiment.
　以下に、本発明に係るプログラマブル表示器の実施の形態を図面に基づいて詳細に説明する。 Hereinafter, an embodiment of a programmable display device according to the present invention will be described in detail with reference to the drawings.
実施の形態１．
　図１は、本発明の実施の形態１に係るプログラマブル表示器１００の概略構成を示すブロック図である。プログラマブル表示器１００は、ＰＬＣ（Programmable　Logic　Controller）等の外部制御装置６が制御する制御対象機器の動作状態を表示する。プログラマブル表示器１００は、動画データ処理手段３、動画データ記憶手段４、時刻データ管理部５、外部装置接続インターフェース（Ｉ／Ｆ）７、ログデータ記憶手段８、総括処理手段９、入力手段１０、表示生成部１１、表示手段１２および音響生成部１３を有する。プログラマブル表示器１００は、撮像手段１、集音手段２、外部制御装置６および発音手段１４に接続されている。 Embodiment 1 FIG.
FIG. 1 is a block diagram showing a schematic configuration of a programmable display 100 according to Embodiment 1 of the present invention. The programmable display device 100 displays an operation state of a control target device controlled by an external control device 6 such as a PLC (Programmable Logic Controller). The programmable display 100 includes a moving image data processing unit 3, a moving image data storage unit 4, a time data management unit 5, an external device connection interface (I / F) 7, a log data storage unit 8, a general processing unit 9, an input unit 10, The display generation unit 11, the display unit 12, and the sound generation unit 13 are included. The programmable display 100 is connected to the imaging means 1, the sound collection means 2, the external control device 6 and the sound generation means 14.
　外部制御装置６は、制御対象機器（図示省略）に接続されている。撮像手段１は、制御対象機器の動作の様子を撮像するカメラである。撮像手段１は、制御対象機器を撮像可能な位置に設置される。集音手段２は、音声を取得するマイクである。集音手段２は、制御対象機器で発生した音声を取得可能な位置に設置される。 The external control device 6 is connected to a control target device (not shown). The imaging unit 1 is a camera that captures an operation state of the control target device. The imaging unit 1 is installed at a position where the control target device can be imaged. The sound collecting means 2 is a microphone that acquires sound. The sound collecting means 2 is installed at a position where the sound generated by the control target device can be acquired.
　動画データ処理手段３は、撮像手段１において取得された撮像データと、集音手段２において取得された音声データとを同期させる処理により、動画データを生成する。外部装置接続Ｉ／Ｆ７は、制御対象機器の動作状態を内容とするログデータを生成する。ログデータは、例えば、制御対象機器で異常が生じた際のアラームや、外部制御装置６による制御対象機器の操作ログ履歴である。 The moving image data processing unit 3 generates moving image data through a process of synchronizing the imaging data acquired by the imaging unit 1 and the audio data acquired by the sound collecting unit 2. The external device connection I / F 7 generates log data containing the operation state of the control target device. The log data is, for example, an alarm when an abnormality occurs in the control target device or an operation log history of the control target device by the external control device 6.
　時刻データ管理部５は、時刻データ生成手段２１およびデータ検索手段２２を備える。時刻データ生成手段２１は、時刻データを生成する。動画データ記憶手段４は、動画データ処理手段３から出力された動画データを、時刻データ生成手段２１から出力される時刻データを付与して保持する。ログデータ記憶手段８は、外部装置接続Ｉ／Ｆ７から出力されたログデータを、時刻データ生成手段２１から出力される時刻データを付与して保持する。時刻データは、動画データ記憶手段４に保持された動画データとログデータ記憶手段８に保持されたログデータとを共通の時間軸により一元管理するために、動画データとログデータとに付与される。データ検索手段２２は、動画データ記憶手段４に保持されている動画データと、ログデータ記憶手段８に保持されているログデータとを検索する。 The time data management unit 5 includes time data generation means 21 and data search means 22. The time data generation means 21 generates time data. The moving image data storage unit 4 holds the moving image data output from the moving image data processing unit 3 with the time data output from the time data generation unit 21. The log data storage unit 8 retains the log data output from the external device connection I / F 7 with the time data output from the time data generation unit 21. The time data is given to the moving image data and the log data in order to centrally manage the moving image data held in the moving image data storage unit 4 and the log data held in the log data storage unit 8 on a common time axis. . The data search unit 22 searches the moving image data held in the moving image data storage unit 4 and the log data held in the log data storage unit 8.
　総括処理手段９は、入力手段１０への入力操作により生成された入力指示データに基づいて、表示生成部１１における表示の生成、音響生成部１３による音声の生成のための処理を行う。また、総括処理手段９は、入力手段１０からの指示により、データ検索手段２２に動画データおよびログデータを検索させ、動画データ記憶手段４から取り出された動画データ、ログデータ記憶手段８から取り出されたログデータを処理する。表示生成部１１は、総括処理手段９からの出力に応じて、表示データを生成する。音響生成部１３は、総括処理手段９からの出力に応じて、音声データを生成する。 The general processing unit 9 performs processing for display generation in the display generation unit 11 and sound generation by the sound generation unit 13 based on the input instruction data generated by the input operation to the input unit 10. Further, the general processing unit 9 causes the data search unit 22 to search for the moving image data and the log data according to an instruction from the input unit 10, and the moving image data extracted from the moving image data storage unit 4 and the log data storage unit 8 extract it. Log data is processed. The display generation unit 11 generates display data according to the output from the overall processing unit 9. The sound generation unit 13 generates sound data according to the output from the general processing unit 9.
　表示手段１２は、表示生成部１１において生成された表示データをグラフィック表示する。表示手段１２は、例えば、液晶表示装置を備える。発音手段１４は、音響生成部１３で生成された音声データを音声に変換して発生させるスピーカを備える。発音手段１４から発生させる音声は、例えばアラーム音である。また、動画データの再生において、表示手段１２による映像の再生と、発音手段１４による音声の再生とを同時に行うこととしても良い。 The display unit 12 displays the display data generated in the display generation unit 11 in a graphic form. The display unit 12 includes, for example, a liquid crystal display device. The sound generation unit 14 includes a speaker that converts the sound data generated by the sound generation unit 13 into sound and generates the sound. The sound generated from the sound generation means 14 is, for example, an alarm sound. Further, in the reproduction of the moving image data, the reproduction of the video by the display unit 12 and the reproduction of the sound by the sound generation unit 14 may be performed simultaneously.
　入力手段１０は、オペレータによる入力操作を受け付ける。入力手段１０は、例えば、表示手段１２の表示画面上に配設されているタッチパネルを備える。入力手段１０は、タッチパネルに代えて、マウスその他のポインティングデバイスを操作させるものとしても良い。プログラマブル表示器１００は、外部制御装置６に対する操作を入力手段１０で受け付け、入力手段１０への入力操作により生成された入力指示データを外部制御装置６に伝送することとしても良い。 The input means 10 accepts an input operation by an operator. The input unit 10 includes, for example, a touch panel disposed on the display screen of the display unit 12. The input unit 10 may operate a mouse or other pointing device instead of the touch panel. The programmable display device 100 may receive an operation on the external control device 6 by the input unit 10 and transmit the input instruction data generated by the input operation to the input unit 10 to the external control device 6.
　図２は、表示手段１２の表示画面２００における表示の一例を説明する図である。動画表示ウィンドウ３００は、動画データによる映像を表示するウィンドウである。タッチパネルが配設された表示画面２００表面のうち、動画操作ボタン３０１が表示されている部分は、動画表示ウィンドウ３００における動画の再生に関する入力操作を受け付ける。動画操作ボタン３０１は、動画の再生、停止、早送り、頭出しなどの各キーを備える。 FIG. 2 is a diagram for explaining an example of display on the display screen 200 of the display means 12. The moving image display window 300 is a window for displaying an image based on moving image data. Of the surface of the display screen 200 on which the touch panel is provided, the portion where the moving image operation button 301 is displayed accepts an input operation related to reproduction of a moving image in the moving image display window 300. The moving image operation button 301 includes keys for moving image playback, stop, fast forward, cueing, and the like.
　タイムバー３０２は、動画データ記憶手段４に保持されている動画データの時間軸を表している。タイムバー３０２上に示されているインジケータ３０３は、動画表示ウィンドウ３００に表示されている映像が、動画データ記憶手段４に保持されている動画データの時間軸のうちのどの時点のものであるか、時間軸における再生ポイントを示す。また、インジケータ３０３は、タイムバー３０２上で移動させることにより、動画の再生ポイントを調整するためのキーでもある。インジケータ３０３は、動画表示ウィンドウ３００で表示させる映像の、時間軸における再生ポイントを調整するための再生ポイント調整手段として機能する。 The time bar 302 represents the time axis of the moving image data held in the moving image data storage means 4. The indicator 303 shown on the time bar 302 indicates at which time point on the time axis of the video data stored in the video data storage means 4 the video displayed in the video display window 300 is. The playback point on the time axis is shown. The indicator 303 is also a key for adjusting the playback point of the moving image by moving on the time bar 302. The indicator 303 functions as a playback point adjusting means for adjusting the playback point on the time axis of the video displayed in the moving image display window 300.
　オペレータがタイムバー３０２上でインジケータ３０３を移動させると、インジケータ３０３が示す再生ポイントにおける映像が動画表示ウィンドウ３００に表示される。時刻表示ウィンドウ４００は、動画表示ウィンドウ３００に表示されている映像が、動画データの時間軸におけるどの時点のものであるか、動画の再生ポイントを時刻で表示する。ランプ・スイッチ表示４０１は、点灯、消灯、色の変更等によって、制御対象機器のＯＮ／ＯＦＦや、制御対象機器で異常が生じたことを報知する警告の有無などを表示する。 When the operator moves the indicator 303 on the time bar 302, the video at the playback point indicated by the indicator 303 is displayed on the moving image display window 300. The time display window 400 displays the playback point of the moving image as a time point on which time point the video displayed in the moving image display window 300 is on the time axis of the moving image data. The lamp / switch display 401 displays ON / OFF of the device to be controlled by turning on / off, changing the color, etc., and the presence / absence of a warning for notifying that an abnormality has occurred in the device to be controlled.
　数値入力表示ウィンドウ４０２は、外部制御装置６の制御に関して入力された数値を表示する。アラームログ表示ウィンドウ４０３は、制御対象機器で異常が生じた際のアラームや、外部制御装置６による制御対象装置の操作ログ履歴を表示する。グラフ表示ウィンドウ４０４は、ログデータ記憶手段８に保持されたログデータの内容を、時間軸を用いたトレンドグラフとして表示するウィンドウである。トレンドグラフは、折れ線の高低によって各種数値の変化を示したグラフであって、所定の方向、例えば表示画面２００上の左右方向を時間軸として表されている。 The numerical value input display window 402 displays numerical values input regarding the control of the external control device 6. The alarm log display window 403 displays an alarm when an abnormality occurs in the control target device and an operation log history of the control target device by the external control device 6. The graph display window 404 is a window for displaying the contents of the log data held in the log data storage unit 8 as a trend graph using a time axis. The trend graph is a graph showing changes in various numerical values depending on the level of the broken line, and is represented with a predetermined direction, for example, the horizontal direction on the display screen 200 as a time axis.
　トレンドグラフは、グラフ表示ウィンドウ４０４において時間軸の方向、例えば左右方向へタッチ位置を移動させることにより、アラームログ表示ウィンドウ４０３内でスクロールされる。タッチパネルが配設された表示画面２００表面のうち、グラフ表示ウィンドウ４０４が表示されている部分は、時間軸のうちトレンドグラフを表示させる範囲を指定するための表示範囲指定手段として機能する。なお、トレンドグラフは、折れ線グラフ以外のグラフであっても良く、時間軸の向きを例えば上下方向とするなど適宜変形しても良い。 The trend graph is scrolled in the alarm log display window 403 by moving the touch position in the time axis direction, for example, the left-right direction in the graph display window 404. Of the surface of the display screen 200 on which the touch panel is provided, the portion where the graph display window 404 is displayed functions as a display range specifying means for specifying a range in which the trend graph is displayed on the time axis. Note that the trend graph may be a graph other than a line graph, and may be appropriately modified such that the direction of the time axis is, for example, the vertical direction.
　ここで、動画表示ウィンドウ３００に表示されている映像からログデータを検索する手法を説明する。オペレータは、動画表示ウィンドウ３００に表示される映像を見ながらタイムバー３０２上でインジケータ３０３を移動させ、動画表示ウィンドウ３００に表示させている映像から、所望とする検索対象時点を指定する。データ検索手段２２は、動画表示ウィンドウ３００に表示されている動画データに付与されている時刻データを参照する。 Here, a method for searching log data from the video displayed in the video display window 300 will be described. The operator moves the indicator 303 on the time bar 302 while watching the video displayed on the video display window 300, and designates a desired search target time point from the video displayed on the video display window 300. The data search means 22 refers to time data given to the moving image data displayed in the moving image display window 300.
　データ検索手段２２は、参照された時刻データと同じ時刻データが付与されているログデータをログデータ記憶手段８から検索する。総括処理手段９は、ログデータ記憶手段８から取り出されたログデータがグラフ表示ウィンドウ４０４の基準位置となるようなトレンドグラフを、グラフ表示ウィンドウ４０４に更新表示させる。グラフ表示ウィンドウ４０４の基準位置とは、例えば、グラフ表示ウィンドウ４０４の左右方向における中央位置とする。図中、グラフ表示ウィンドウ４０４の基準位置は、ウィンドウの外縁部分に三角形を付して示した実線の位置とする。このように、表示手段１２に表示された映像に基づいて、時間軸における検索対象時点が指定されることにより、データ検索手段２２は、当該検索対象時点におけるログデータを検索する。 The data search means 22 searches the log data storage means 8 for log data to which the same time data as the referenced time data is assigned. The overall processing unit 9 causes the graph display window 404 to update and display a trend graph in which the log data extracted from the log data storage unit 8 is the reference position of the graph display window 404. The reference position of the graph display window 404 is, for example, the center position of the graph display window 404 in the left-right direction. In the figure, the reference position of the graph display window 404 is the position of a solid line indicated by a triangle attached to the outer edge portion of the window. In this way, by specifying the search target time point on the time axis based on the video displayed on the display unit 12, the data search unit 22 searches the log data at the search target time point.
　次に、グラフ表示ウィンドウ４０４に表示されているグラフから動画データを検索する手法を説明する。オペレータは、グラフ表示ウィンドウ４０４のトレンドグラフを見ながらトレンドグラフをスクロールすることにより、所望とする検索対象時点を指定する。データ検索手段２２は、グラフ表示ウィンドウ４０４の基準位置となるログデータに付与されている時刻データを参照する。 Next, a method for searching for moving image data from the graph displayed in the graph display window 404 will be described. The operator designates a desired search target time point by scrolling the trend graph while viewing the trend graph in the graph display window 404. The data search means 22 refers to the time data given to the log data that is the reference position of the graph display window 404.
　データ検索手段２２は、参照された時刻データと同じ時刻データが付与されている動画データを動画データ記憶手段４から検索する。総括処理手段９は、動画データ記憶手段４から取り出された動画データによる映像を、動画表示ウィンドウ３００に更新表示させる。このように、表示手段１２に表示されたログデータの内容に基づいて、時間軸における検索対象時点が指定されることにより、データ検索手段２２は、当該検索対象時点における動画データを検索する。 The data search means 22 searches the moving picture data storage means 4 for moving picture data to which the same time data as the referenced time data is given. The overall processing unit 9 causes the moving image display window 300 to update and display the video based on the moving image data extracted from the moving image data storage unit 4. In this way, by specifying the search target time point on the time axis based on the content of the log data displayed on the display unit 12, the data search unit 22 searches for moving image data at the search target time point.
　プログラマブル表示器１００は、動画データとログデータとを共通の時間軸により一元管理するための時刻データを動画データとログデータとに付与することにより、映像を元にするログデータの検索と、ログデータの内容を元にする動画データの検索とが可能となる。プログラマブル表示器１００は、動画データとログデータとの相互における検索を可能とし、検索されたデータに基づく表示が可能となる。アラームログ表示ウィンドウ４０３におけるアラーム、操作ログの選択や、動画操作ボタン３０１の操作により一意的に動画データの頭出し処理をするのではなく、時間軸における任意の箇所の映像、ログデータを表示させることが可能であるので、異常発生時の前後の状況を把握し易くし、状況把握が容易となる。これにより、制御対象の動作状態の把握、異常発生の際の検証を容易化させることができるという効果を奏する。 Programmable display device 100 provides video data and log data with time data for centrally managing moving image data and log data on a common time axis, thereby searching log data based on video, It is possible to search for moving image data based on the data contents. The programmable display device 100 enables a mutual search between moving image data and log data, and enables display based on the searched data. Rather than uniquely cueing moving image data by selecting an alarm or operation log in the alarm log display window 403 or operating the moving image operation button 301, video and log data at an arbitrary position on the time axis are displayed. Therefore, the situation before and after the occurrence of the abnormality can be easily grasped, and the situation can be grasped easily. As a result, it is possible to facilitate the understanding of the operation state of the controlled object and the verification when an abnormality occurs.
実施の形態２．
　図３は、本発明の実施の形態２に係るプログラマブル表示器の特徴部分の概略構成を示すブロック図である。本実施の形態に係るプログラマブル表示器は、入力指示データが特定入力指示データに合致する場合に、表示手段１２による映像の表示に対して、特定入力指示データに対応する機能を実行させることを特徴とする。プログラマブル表示器のうち本実施の形態で説明する構成以外の構成は、実施の形態１に係るプログラマブル表示器１００（図１参照）と同様である。本実施の形態において、実施の形態１と同一の部分には同一の符号を付し、重複する説明を省略する。 Embodiment 2. FIG.
FIG. 3 is a block diagram showing a schematic configuration of the characteristic part of the programmable display according to Embodiment 2 of the present invention. The programmable display according to the present embodiment is characterized in that when the input instruction data matches the specific input instruction data, the function corresponding to the specific input instruction data is executed for the display of the video by the display unit 12. And Configurations other than the configuration described in the present embodiment among the programmable displays are the same as those of the programmable display 100 (see FIG. 1) according to the first embodiment. In the present embodiment, the same parts as those in the first embodiment are denoted by the same reference numerals, and redundant description is omitted.
　入力判断手段１５は、総括処理手段９に設けられている。入力判断手段１５は、入力手段１０で受け付けた入力操作に基づいて生成された入力指示データが、映像の再生についての機能に対応させて予め設定されている特定入力指示データに合致するか否かを判断する。入力判断手段１５は、入力指示データが特定入力指示データに合致すると判断した場合に、特定入力指示データに対応する機能に応じた表示を表示生成部１１に生成させ、特定入力指示データに対応する機能を実行させる。 The input determination means 15 is provided in the overall processing means 9. The input determining unit 15 determines whether or not the input instruction data generated based on the input operation received by the input unit 10 matches the specific input instruction data set in advance in correspondence with the function for video playback. Judging. When the input determination unit 15 determines that the input instruction data matches the specific input instruction data, the input determination unit 15 causes the display generation unit 11 to generate a display corresponding to the function corresponding to the specific input instruction data, and corresponds to the specific input instruction data. Execute the function.
　図４は、入力手段１０への入力指示と、その対応機能との一例を示す図である。プログラマブル表示器には、タッチパネルが配設された表示画面２００（図２参照）表面におけるタッチ位置の移動軌跡と、それに対応する機能とが予め設定されている。例えば、動画表示ウィンドウ３００が表示されている部分において、図中「Ｎｏ．１」に示すように、「Ｚ」の文字と同様の軌跡でタッチ位置を移動させる特定入力指示データに対して、映像の一部を拡大して表示する「拡大表示」機能が設定されているとする。また、映像のうち拡大表示する範囲は、タッチ位置の始点１０００の座標と終点１００１の座標とで決定されるものとする。 FIG. 4 is a diagram showing an example of an input instruction to the input means 10 and its corresponding function. In the programmable display, the movement locus of the touch position on the surface of the display screen 200 (see FIG. 2) on which the touch panel is disposed and the corresponding function are set in advance. For example, in the portion where the moving image display window 300 is displayed, as indicated by “No. 1” in the figure, video is displayed for specific input instruction data for moving the touch position along the same locus as the letter “Z”. It is assumed that an “enlarged display” function for displaying a part of the image is enlarged is set. Further, it is assumed that a range to be enlarged and displayed in the video is determined by the coordinates of the start point 1000 and the end point 1001 of the touch position.
　動画表示ウィンドウ３００に映像が表示されている状態において、オペレータが「Ｚ」の文字と同様の軌跡でタッチ位置を移動させたとする。入力手段１０は、タッチ位置を移動させた軌跡、動画表示ウィンドウ３００内におけるタッチ位置の始点１０００の座標、終点１００１の座標を含む入力指示データを出力する。この場合、タッチ位置を移動させた軌跡は、上記の「Ｎｏ．１」で示す特定入力指示データと一致することから、入力判断手段１５は、入力手段１０からの入力指示データが特定入力指示データに合致すると判断する。入力判断手段１５は、特定入力指示データのうち始点１０００の座標と終点１００１の座標とに応じて、映像のうち拡大表示させる範囲と、拡大倍率とを決定し、総括処理手段９へ出力する。表示手段１２は、総括処理手段９による制御に応じて、映像を拡大表示させる。 Suppose that the operator moves the touch position along a locus similar to the letter “Z” in a state where the video is displayed in the moving image display window 300. The input unit 10 outputs input instruction data including the locus of moving the touch position, the coordinates of the start point 1000 and the coordinates of the end point 1001 in the moving image display window 300. In this case, since the locus of moving the touch position coincides with the specific input instruction data indicated by “No. 1”, the input determination means 15 determines that the input instruction data from the input means 10 is the specific input instruction data. It is judged that it matches. The input determining unit 15 determines a range to be enlarged and a magnification in the video according to the coordinates of the start point 1000 and the coordinates of the end point 1001 in the specific input instruction data, and outputs them to the overall processing unit 9. The display unit 12 enlarges and displays the video according to the control by the overall processing unit 9.
　例えば、動画表示ウィンドウ３００の左右方向をＸ方向、上下方向をＹ方向とする。映像を拡大表示させる範囲は、例えば、始点１０００および終点１００１の間のＸ方向の長さ、またはＹ方向の長さを一辺とする矩形領域とする。拡大倍率は、例えば、始点１０００および終点１００１の間のＸ方向長さに対する動画表示ウィンドウ３００のＸ方向長さの倍率、または、始点１０００および終点１００１の間のＹ方向長さに対する動画表示ウィンドウ３００のＹ方向長さの倍率とする。動画表示ウィンドウ３００は、オペレータによる入力操作によって指示された範囲について、指示された拡大倍率で、映像を拡大表示する。 For example, the left-right direction of the moving image display window 300 is the X direction, and the up-down direction is the Y direction. The range in which the video is enlarged and displayed is, for example, a rectangular region having a length in the X direction between the start point 1000 and the end point 1001 or a length in the Y direction as one side. The enlargement magnification is, for example, the magnification of the X direction length of the moving image display window 300 with respect to the X direction length between the start point 1000 and the end point 1001, or the moving image display window 300 with respect to the Y direction length between the start point 1000 and the end point 1001. The magnification of the length in the Y direction. The moving image display window 300 displays an enlarged image of the range instructed by the input operation by the operator at the instructed enlargement magnification.
　また、図中Ｎｏ．２に示すように、「Ｗ」の文字と同様の軌跡でタッチ位置を移動させる場合の入力指示に対して、映像の拡大表示を解除させる「拡大表示解除」機能が設定されているとする。「Ｗ」の文字と同様の軌跡でタッチ位置を移動させる特定入力指示データに対して、入力手段１０は、タッチ位置を移動させた形状、動画表示ウィンドウ３００内におけるタッチ位置の始点１０００の座標、終点１００１の座標を含む入力指示データを出力する。 Also, No. in the figure. As shown in FIG. 2, it is assumed that an “enlarged display cancel” function for canceling the enlarged display of the video is set in response to an input instruction when the touch position is moved along the locus similar to the character “W”. In response to the specific input instruction data for moving the touch position along the locus similar to the character “W”, the input unit 10 uses the shape of the touch position moved, the coordinates of the start point 1000 of the touch position in the moving image display window 300, Input instruction data including the coordinates of the end point 1001 is output.
　オペレータが「Ｗ」の文字と同様の軌跡でタッチ位置を移動させた場合、入力判断手段１５は、入力手段１０からの入力指示データが特定入力指示データに合致すると判断する。動画表示ウィンドウ３００は、オペレータによる入力指示に応じて、拡大表示を解除し、映像を拡大前の倍率に戻す。なお、特定入力指示データとして設定されるタッチ位置の移動軌跡は、本実施の形態で説明するものに限られず、いずれの機能の実行を指示する入力操作であるかを識別可能であれば良く、適宜変形しても良い。 When the operator moves the touch position along the locus similar to the letter “W”, the input determination unit 15 determines that the input instruction data from the input unit 10 matches the specific input instruction data. The moving image display window 300 cancels the enlarged display and returns the image to the magnification before enlargement in response to an input instruction from the operator. Note that the movement locus of the touch position set as the specific input instruction data is not limited to that described in the present embodiment, as long as the input operation instructing the execution of which function can be identified. You may deform | transform suitably.
　一般に、従来のプログラマブル表示器は、表示画面上に表示される映像の再生操作には、所定の動作を実行する固有の操作部が使用される。固有の操作部を使用する場合、映像の部分拡大表示は、操作部の操作により予め指定された倍率でなされることとなる。本実施の形態に係るプログラマブル表示器は、表示画面２００上でタッチ位置を移動させることにより、映像のうち任意の箇所について、任意の倍率でクローズアップすることが可能となる。映像の詳細部分が即座に確認可能となることにより、制御対象の動作状態の把握、異常発生の際の検証の容易化が可能となるという効果を奏する。また、特定入力指示データが設定されている機能について、固有の操作部を不要とすることができる。 Generally, in a conventional programmable display, a specific operation unit that executes a predetermined operation is used for a reproduction operation of an image displayed on a display screen. When a unique operation unit is used, the partial enlarged display of the video is performed at a magnification specified in advance by operation of the operation unit. The programmable display according to the present embodiment can close up an arbitrary portion of an image at an arbitrary magnification by moving the touch position on the display screen 200. Since the detailed part of the video can be immediately confirmed, it is possible to grasp the operation state of the control target and facilitate the verification when an abnormality occurs. In addition, it is possible to eliminate the need for a specific operation unit for the function for which the specific input instruction data is set.
　なお、特定入力指示データが設定される機能は、拡大表示機能および拡大表示解除機能である場合に限られない。例えば、拡大表示機能については特定入力指示データを設定することとし、拡大表示解除機能は、入力手段における他の入力操作により実行することとしても良い。また、特定入力指示データは、映像の再生についての他の機能、例えば、再生、再生停止、再生一時停止、早送り、巻き戻しなどの機能に対して設定しても良い。タッチパネル上でタッチ位置を移動させる軌跡ごとにこれらの機能を対応させることにより、映像の再生についての固有の操作部をさらに少なくすることができる。 Note that the function for which the specific input instruction data is set is not limited to the enlarged display function and the enlarged display release function. For example, specific input instruction data may be set for the enlarged display function, and the enlarged display release function may be executed by another input operation in the input unit. The specific input instruction data may be set for other functions related to video playback, such as playback, playback stop, playback pause, fast forward, and rewind. By associating these functions with each trajectory for moving the touch position on the touch panel, it is possible to further reduce the specific operation unit for video reproduction.
　なお、上述したプログラマブル表示器の動作は、予め用意されたプログラムをパーソナルコンピュータやワークステーションなどのコンピュータで実行することにより実現することができる。これらのプログラムは、コンピュータで読取可能な記録媒体に記録され、コンピュータによって記録媒体から読み出されることによって実行される。また、これらのプログラムは、インタネットなどのネットワーク（通信回線）を介して配布することとしても良い。 Note that the above-described operation of the programmable display can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. These programs are recorded on a computer-readable recording medium and executed by being read from the recording medium by the computer. These programs may be distributed via a network (communication line) such as the Internet.
実施の形態３．
　図５は、本発明の実施の形態３に係るプログラマブル表示器の動画表示ウィンドウ３００を示す図である。本実施の形態に係るプログラマブル表示器は、動き検出領域５００における動き検出の検索が可能であることを特徴とする。動き検出領域５００は、動画データによる映像において予め指定される。 Embodiment 3 FIG.
FIG. 5 is a diagram showing a moving image display window 300 of the programmable display according to Embodiment 3 of the present invention. The programmable display according to the present embodiment is characterized in that a search for motion detection in the motion detection region 500 is possible. The motion detection area 500 is designated in advance in video based on moving image data.
　例えば、動画表示ウィンドウ３００には、稼働中のベルトコンベアの映像が表示されている。本実施の形態では、ベルトコンベアの周囲の進入禁止領域を、動き検出領域５００として指定している。例えば、プログラマブル表示器には、映像の変化を表す閾値が適宜設定され、設定された閾値以上の変化を、動き検出として認識する。 For example, the moving image display window 300 displays an image of the belt conveyor in operation. In this embodiment, the entry prohibition area around the belt conveyor is designated as the motion detection area 500. For example, a threshold value indicating a change in video is appropriately set in the programmable display, and a change equal to or greater than the set threshold value is recognized as motion detection.
　ログデータ記憶手段は、動き検出領域５００における動き検出を、ログデータに含めて保持する。例えば、動き検出領域５００への進入物があった場合に、進入物の移動が動き検出として認識されることにより、進入発生があった時間がログデータとして記憶される。動き検出を含むログデータと、動画データとは、共通の時間軸により一元管理される。 The log data storage means holds the motion detection in the motion detection area 500 by including it in the log data. For example, when there is an approaching object to the motion detection area 500, the time when the approach occurred is stored as log data by recognizing the movement of the approaching object as motion detection. Log data including motion detection and moving image data are centrally managed on a common time axis.
　動き検出があった時点を検索対象時点として指定することにより、進入物があった際の動画データを検索し、映像の再生によって確認することができる。これにより、外部センサ装置等を用いること無く、動き検出領域として指定した箇所の状況把握等を容易にできるという効果を奏する。なお、本実施の形態による動き検出は、進入禁止領域への進入物の検出に用いる場合に限られず、異常発生等の何らかの状況把握に対して広く適用可能である。動き検出は、例えば、ベルトコンベアによって運搬されている製造品や箱が動き検出領域５００へはみ出ている状態であることを把握する場合等に適用しても良い。 By designating the point in time when the motion is detected as the search target point, it is possible to search the moving image data when there is an entering object and confirm it by playing the video. Thereby, there is an effect that it is possible to easily grasp the situation of the location designated as the motion detection region without using an external sensor device or the like. Note that the motion detection according to the present embodiment is not limited to the case where it is used for detection of an entry object to the entry prohibition area, and can be widely applied to grasping some situation such as occurrence of an abnormality. The motion detection may be applied, for example, when it is grasped that a manufactured product or a box transported by a belt conveyor is in a state of protruding from the motion detection area 500.
　以上のように、本発明に係るプログラマブル表示器は、外部制御装置の制御に関するさまざまなログデータと動画データとの関連を検証する場合に有用である。 As described above, the programmable display device according to the present invention is useful for verifying the relationship between various log data related to control of the external control device and moving image data.
　４　動画データ記憶手段
　８　ログデータ記憶手段
　１０　入力手段
　１２　表示手段
　１５　入力判断手段
　２１　時刻データ生成手段
　２２　データ検索手段
　１００　プログラマブル表示器 4 moving image data storage means 8 log data storage means 10 input means 12 display means 15 input determination means 21 time data generation means 22 data search means 100 programmable display

Claims (6)

  1. 　制御対象を撮像することにより取得された動画データを保持する動画データ記憶手段と、
    　前記制御対象の動作状態を内容とするログデータを保持するログデータ記憶手段と、
    　前記動画データ記憶手段に保持された前記動画データによる映像と、前記ログデータ記憶手段に保持された前記ログデータの内容と、を表示する表示手段と、
    　前記動画データ記憶手段に保持された前記動画データと前記ログデータ記憶手段に保持された前記ログデータとを共通の時間軸により一元管理するために前記動画データと前記ログデータとに付与される時刻データを生成する時刻データ生成手段と、
    　前記表示手段に表示されている前記映像に基づいて前記時間軸における検索対象時点が指定されることにより、当該検索対象時点に対応する前記時刻データが付与された前記ログデータを検索し、または、前記表示手段に表示されている前記ログデータの内容に基づいて前記時間軸における検索対象時点が指定されることにより、当該検索対象時点に対応する前記時刻データが付与された前記動画データを検索するデータ検索手段と、
    　を有することを特徴とするプログラマブル表示器。     Moving image data storage means for holding moving image data acquired by imaging a control target;
    Log data storage means for holding log data containing the operation state of the control target;
    Display means for displaying the video based on the moving picture data held in the moving picture data storage means and the contents of the log data held in the log data storage means;
    Time given to the moving image data and the log data in order to centrally manage the moving image data held in the moving image data storage unit and the log data held in the log data storage unit on a common time axis Time data generating means for generating data;
    Searching the log data to which the time data corresponding to the search target time is given by specifying the search target time on the time axis based on the video displayed on the display means, or The video data to which the time data corresponding to the search target time is added is searched by specifying the search target time on the time axis based on the contents of the log data displayed on the display means. Data retrieval means;
    A programmable display device comprising:
  2. 　前記検索対象時点を指定するための入力操作を受け付ける入力手段を有し、
    　前記入力手段は、前記表示手段で表示させる前記映像の、前記時間軸における再生ポイントを調整するための再生ポイント調整手段を備えることを特徴とする請求項１に記載のプログラマブル表示器。     Input means for receiving an input operation for designating the search target time point;
    The programmable display according to claim 1, wherein the input unit includes a reproduction point adjustment unit for adjusting a reproduction point on the time axis of the video displayed by the display unit.
  3. 　前記検索対象時点を指定するための入力操作を受け付ける入力手段を有し、
    　前記表示手段は、前記ログデータの内容をグラフとして表示し、
    　前記入力手段は、前記時間軸のうち前記グラフを表示させる範囲を指定するための表示範囲指定手段を備えることを特徴とする請求項１または２に記載のプログラマブル表示器。     Input means for receiving an input operation for designating the search target time point;
    The display means displays the contents of the log data as a graph,
    The programmable display according to claim 1, wherein the input unit includes a display range designating unit for designating a range for displaying the graph on the time axis.
  4. 　制御対象を撮像することにより取得された動画データを保持する動画データ記憶手段と、
    　前記動画データ記憶手段に保持された前記動画データによる映像を表示する表示手段と、
    　前記表示手段に表示される動画の再生についての入力操作を受け付ける入力手段と、
    　前記入力手段で受け付けた前記入力操作に基づいて生成された入力指示データが、前記映像の再生についての機能に対応させて予め設定されている特定入力指示データに合致するか否かを判断する入力判断手段と、を有し、
    　前記入力判断手段は、前記入力指示データが前記特定入力指示データに合致すると判断した場合に、前記表示手段による前記映像の表示に対して、前記特定入力指示データに対応する機能を実行させることを特徴とするプログラマブル表示器。     Moving image data storage means for holding moving image data acquired by imaging a control target;
    Display means for displaying video based on the moving picture data stored in the moving picture data storage means;
    Input means for receiving an input operation for reproduction of a moving image displayed on the display means;
    An input for determining whether or not the input instruction data generated based on the input operation received by the input means matches the specific input instruction data set in advance in correspondence with the function for reproducing the video. Determination means, and
    When the input determining unit determines that the input instruction data matches the specific input instruction data, the input determining unit causes the display unit to execute a function corresponding to the specific input instruction data for display of the video. Features programmable display.
  5. 　前記特定入力指示データに対応する機能として、前記映像の一部を拡大表示させる拡大表示機能を含むことを特徴とする請求項４に記載のプログラマブル表示器。 The programmable display according to claim 4, wherein the function corresponding to the specific input instruction data includes an enlarged display function for enlarging and displaying a part of the video.
  6. 　前記動画データによる前記映像において、前記映像の動きを検出するための動き検出領域が指定され、
    　前記ログデータ記憶手段は、前記動き検出領域における動き検出を、前記ログデータに含めて保持することを特徴とする請求項１から３のいずれか一つに記載のプログラマブル表示器。     In the video by the moving image data, a motion detection area for detecting the motion of the video is designated,
    4. The programmable display device according to claim 1, wherein the log data storage unit holds the motion detection in the motion detection area in the log data. 5.
PCT/JP2010/052707 2009-03-27 2010-02-23 Programmable display WO2010110000A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW099107946A TW201100987A (en) 2009-03-27 2010-03-18 Programmable displayer

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2009-079693 2009-03-27
JP2009079693A JP2012118567A (en) 2009-03-27 2009-03-27 Programmable display

Publications (1)

Publication Number Publication Date
WO2010110000A1 true WO2010110000A1 (en) 2010-09-30

Family

ID=42780695

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2010/052707 WO2010110000A1 (en) 2009-03-27 2010-02-23 Programmable display

Country Status (3)

Country Link
JP (1) JP2012118567A (en)
TW (1) TW201100987A (en)
WO (1) WO2010110000A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105843941A (en) * 2016-04-01 2016-08-10 北京小米移动软件有限公司 Log checking method and device

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015099415A (en) * 2013-11-18 2015-05-28 三菱電機株式会社 Monitoring control system
JP6476594B2 (en) 2014-05-26 2019-03-06 オムロン株式会社 Simulation system
JP7088742B2 (en) * 2018-05-18 2022-06-21 キヤノン電子株式会社 Processing system, processing machine, processing machine control method and program
JP7412076B2 (en) * 2018-10-23 2024-01-12 株式会社キーエンス Engineering tools for programmable logic controllers
JP2020095379A (en) * 2018-12-11 2020-06-18 株式会社ディスコ Log data creation device
JP2020134986A (en) * 2019-02-12 2020-08-31 株式会社キーエンス Program creation support device for programmable logic controller
JP7466319B2 (en) * 2019-03-29 2024-04-12 株式会社キーエンス Programmable display and programmable logic controller system equipped with the same
JP7430473B1 (en) 2023-07-10 2024-02-13 旭精機工業株式会社 Monitoring data processing equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000276222A (en) * 1999-03-29 2000-10-06 Omron Corp Logging device
JP2001162491A (en) * 1999-12-09 2001-06-19 Yokogawa Electric Corp Machining monitor
JP2003090742A (en) * 2001-07-05 2003-03-28 Yokogawa Electric Corp Measurement data display system
JP2004021300A (en) * 2002-06-12 2004-01-22 Toshiba Corp Screen control device
JP2004030599A (en) * 1998-01-19 2004-01-29 Asahi Glass Co Ltd Saving method for time-series data, time-series database system, method and system for processing time-series data, time-series data display system, and recording medium
JP2004171282A (en) * 2002-11-20 2004-06-17 Digital Electronics Corp Client device, control system equipped with this client device and its program
JP2004280745A (en) * 2003-03-19 2004-10-07 Clarion Co Ltd Display device and method, and program
WO2005091098A1 (en) * 2004-03-22 2005-09-29 Digital Electronics Corporation Indicator, program product for functioning computer as indicator, and recording medium with the program product stored therein
JP2008217767A (en) * 2008-01-29 2008-09-18 Fujitsu Ten Ltd Display device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004030599A (en) * 1998-01-19 2004-01-29 Asahi Glass Co Ltd Saving method for time-series data, time-series database system, method and system for processing time-series data, time-series data display system, and recording medium
JP2000276222A (en) * 1999-03-29 2000-10-06 Omron Corp Logging device
JP2001162491A (en) * 1999-12-09 2001-06-19 Yokogawa Electric Corp Machining monitor
JP2003090742A (en) * 2001-07-05 2003-03-28 Yokogawa Electric Corp Measurement data display system
JP2004021300A (en) * 2002-06-12 2004-01-22 Toshiba Corp Screen control device
JP2004171282A (en) * 2002-11-20 2004-06-17 Digital Electronics Corp Client device, control system equipped with this client device and its program
JP2004280745A (en) * 2003-03-19 2004-10-07 Clarion Co Ltd Display device and method, and program
WO2005091098A1 (en) * 2004-03-22 2005-09-29 Digital Electronics Corporation Indicator, program product for functioning computer as indicator, and recording medium with the program product stored therein
JP2008217767A (en) * 2008-01-29 2008-09-18 Fujitsu Ten Ltd Display device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105843941A (en) * 2016-04-01 2016-08-10 北京小米移动软件有限公司 Log checking method and device
CN105843941B (en) * 2016-04-01 2019-07-09 北京小米移动软件有限公司 Log method of calibration and device

Also Published As

Publication number Publication date
JP2012118567A (en) 2012-06-21
TW201100987A (en) 2011-01-01

Similar Documents

Publication Publication Date Title
WO2010110000A1 (en) Programmable display
US10860145B2 (en) Projection device, projection method and projection program
US10120536B2 (en) Monitoring method
US8739067B2 (en) Information display device, information display method, and program
US20100271478A1 (en) Apparatus for playing back recorded video images related to event,and method thereof
EP3188034A1 (en) Display terminal-based data processing method
TW201119368A (en) Image processing device, image processing method, and computer program
US9984335B2 (en) Data processing device
US10577736B2 (en) Embroidery data generating apparatus, embroidery data generating method, and program for embroidery data generating apparatus
JP2020202449A (en) Control apparatus
JP6270488B2 (en) Operator monitoring control device and operator monitoring control method
JP2004005639A (en) Monitoring device
JP6109103B2 (en) Plant monitoring screen display device
JP2010277551A (en) Data selection device, method for controlling the same, and program
JP6494358B2 (en) Playback control device and playback control method
US20140358306A1 (en) Apparatus and method for processing data in energy management system
JP2004080156A5 (en)
US11009991B2 (en) Display control apparatus and control method for the display control apparatus
JP6474610B2 (en) Programmable display
JP2011175530A (en) Plant operation support device
JP2000148331A (en) Display device
JP2010259028A (en) Image display device
JPH11327732A (en) Display device
WO2022249277A1 (en) Image processing device, image processing method, and program
JP2011138402A (en) Operation input device, display device, imaging device, and moving image playback device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10755801

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10755801

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP