WO2013145448A1 - Operation terminal, operation method, and program - Google Patents

Operation terminal, operation method, and program Download PDF

Info

Publication number
WO2013145448A1
WO2013145448A1 PCT/JP2012/081142 JP2012081142W WO2013145448A1 WO 2013145448 A1 WO2013145448 A1 WO 2013145448A1 JP 2012081142 W JP2012081142 W JP 2012081142W WO 2013145448 A1 WO2013145448 A1 WO 2013145448A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
displayed
display area
screen
camera
Prior art date
Application number
PCT/JP2012/081142
Other languages
French (fr)
Japanese (ja)
Inventor
舟橋　孝博
Original Assignee
株式会社日立国際電気
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社日立国際電気 filed Critical 株式会社日立国際電気
Publication of WO2013145448A1 publication Critical patent/WO2013145448A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet

Definitions

  • the present invention relates to a monitoring operation at an operation terminal in an image monitoring system using a monitoring camera.
  • Image surveillance systems have been introduced in various public facilities and private facilities such as hotels, buildings, convenience stores, financial institutions, dams, roads, etc. for the purpose of crime and accident prevention, post-mortem analysis of incidents and accidents, etc. .
  • a general image monitoring system an area to be monitored is imaged by a camera, and the captured image is transmitted to a monitoring center or a recording device such as a management office or a security room via a network.
  • the monitoring target is monitored to give warnings and warnings according to the purpose and necessity, and the transmitted image is recorded in a recording device.
  • a monitor uses a computer such as a personal computer equipped with a monitor and a pointing device such as a mouse to operate pan / tilt / zoom of the camera from a GUI (Graphical User Interface) screen,
  • the monitoring target area is monitored by browsing the monitoring image.
  • Patent Document 1 an image monitoring system that controls a camera from a GUI screen displayed on a monitoring terminal in a Web browser format or displays a captured image is disclosed (see Patent Document 1).
  • the present invention has been made in view of such a demand, and an object thereof is to provide an image monitoring interface that can be operated more intuitively using a touch panel type operation terminal.
  • the operation terminal of the present invention includes a display unit that displays an operation screen on a display surface, a touch panel that is disposed on the display unit and detects an operation involving a touch, a control unit that determines and controls the detected operation, A thumbnail image display area for displaying a plurality of images, and an image enlargement display area for enlarging and displaying an image selected from the images displayed in the thumbnail image display area.
  • the image displayed on the display surface and displayed in the thumbnail image display area is dragged to the image enlargement display area, and the image is enlarged and displayed in the image enlargement display area.
  • the operation method of the present invention includes a display unit that displays an operation screen on a display surface, a touch panel that is disposed on the display unit and detects an operation involving a touch, and a control unit that determines and controls the detected operation. And a thumbnail image display area for displaying a plurality of images, and an image enlargement display area for enlarging and displaying an image selected from the images displayed in the thumbnail image display area. The image displayed on the display surface and displayed in the thumbnail image display area is dragged to the image enlargement display area, and the image is enlarged and displayed in the image enlargement display area. .
  • the program of the present invention is a thumbnail for displaying a plurality of images on a computer including a display unit that displays an operation screen on a display surface, and a touch panel that is disposed on the display unit and detects an operation involving a touch.
  • An image display area, an image enlargement display area for enlarging and displaying an image selected from images displayed in the thumbnail image display area, a display process for displaying on the display surface, and the thumbnail image display area And a selection process for enlarging and displaying the image in the image enlargement display area by dragging the image displayed on the image enlargement display area.
  • a signal for controlling pan, tilt, or zoom is transmitted to a camera that captures the image by performing an operation with a touch on the image.
  • a signal for controlling pan, tilt, or zoom is transmitted to a camera that captures the image by performing an operation with a touch on the image.
  • the plurality of images to be displayed in the thumbnail image display area are images of different cameras, and when the images are displayed larger than the thumbnail images, the images are displayed on the images.
  • a process of transmitting a signal for controlling pan, tilt, or zoom to a camera that captures the image is executed.
  • an image monitoring interface that can be operated more intuitively by performing operations such as mode switching and image selection by a gesture operation with touch using a touch panel type operation terminal.
  • FIG. 1 is a block diagram showing the overall configuration of the image monitoring system of the present invention and the internal configuration of the operation terminal.
  • the image monitoring system shown in FIG. 1 is a camera 1-1 to 1-n equipped with a pan / tilt / zoom function for picking up an image of a monitoring area (referred to as camera 1 unless otherwise specified), HDD (Hard Disk Drive), SSD or the like. It is composed of a recording device 2 having a large-capacity recording medium such as (Solid State Drive), and a touch panel type operation terminal 3, which are connected by a network such as the Internet.
  • the camera 1 is equipped with a pan / tilt / zoom function.
  • the camera 1 may be a fixed camera, and may not be plural. Further, the number of recording apparatuses 2 is one for the sake of simplicity, but a plurality of recording apparatuses 2 may be provided.
  • the camera 1 captures the monitoring area, acquires an image, and outputs the image to the recording device 2 via the network.
  • the recording device 2 records the input image on a recording medium.
  • the operation terminal 3 outputs a control signal to the camera 1 and the recording device 2 according to the operation and setting of the operator.
  • the camera 1 When a real-time image is requested from the operation terminal 3 to the designated camera 1, the camera 1 outputs the acquired image to the operation terminal 3, and the operation terminal 3 displays the received image.
  • the operation terminal 3 requests the designated camera 1 to control pan / tilt / zoom, the camera 1 controls pan / tilt / zoom according to the contents of the request.
  • the recording device 2 outputs the designated recording image to the operation terminal 3, and the operation terminal 3 displays the received recorded image. indicate.
  • the operation terminal 3 of the image monitoring system shown in FIG. 1 controls the communication unit 301 that converts data into a communicable format and transmits / receives data, controls each unit of the operation terminal 3, and executes a gesture information determination process and the like Unit 302, storage unit 303 for storing gesture information 303A and program 303B in ROM (Read Only Memory), RAM (Random Access Memory), etc., touch sensor 304A for recognizing the gesture of the operator, and display for displaying characters, images, etc.
  • the touch panel 304 includes a unit 304B, and an input unit 305 such as a return button or a power button.
  • the touch sensor 304A is provided over the entire surface of the display unit 304B.
  • the touch sensor 304A recognizes a gesture accompanied by an operator's touch using a surface acoustic wave method or a capacitance method, and the display unit 304B The characters and images drawn by the control unit 302 are displayed.
  • the gesture information 303A is information related to operation commands stored corresponding to the characteristics of the gesture of the operator recognized by the touch sensor 304A.
  • the program 303B is a determination processing program using, for example, an OS (Operating System) and the gesture information 304A. And various application programs.
  • the gesture means an operation that involves an operator touching the touch panel 304, and tap (touch and release immediately), drag (slide while touching), pinch-in (two touches and two touches). Such as pinching out (touching two points and sliding to release two points), swipe (touching and sliding to release), hold (long press), etc. is there.
  • the specific operation of the terminal by gesture operation is as follows.
  • the operator performs a gesture operation on the touch panel 304
  • the operator's gesture is recognized by the touch sensor 304A
  • the control unit 302 generates an operation command by referring to the gesture information 304, and executes the program 303B based on the operation command. To do.
  • the program execution result is drawn and displayed on the display unit 304B.
  • an operation by operating the input unit 305 is also realized by generating an operation command with reference to information stored in the storage unit 303 and executing the program 303B.
  • the communication unit 301 can communicate data such as a control signal from the control unit 302 via a network using a system such as a 3G line or Wi-Fi.
  • the data is converted into a format and output to the network toward the camera 1 and the recording device 2.
  • the recording device 2 when the camera 1 includes a large-capacity recording medium such as a memory card and records the captured image on itself, the recording device 2 is not necessary, and the camera 1 includes the function of the recording device 2. It communicates with the operation terminal 3. In this case, all the communication contents between the recording device 2 and the operation terminal 3 described above can be replaced with communication between the camera 1 and the operation terminal 3, and the camera 1 records whether the request from the operation terminal 3 relates to the camera control function. It works by determining whether it is related to the function or not. Therefore, this image monitoring system is realized only by the camera 1 and the operation terminal 3, and the physical system configuration can be simplified.
  • FIG. 2 is a diagram showing a screen in an initial state on the operation screen of the image monitoring system of the present invention.
  • 3A and 3B are diagrams showing an operation screen of the image monitoring system of the present invention, a screen in the middle of selecting the wide area monitoring mode
  • FIG. 3C is an image display main screen in the wide area monitoring mode
  • FIG. 3D is a wide area monitoring mode.
  • It is a figure which shows a map main body screen.
  • 4A and 4B are diagrams showing an operation screen of the image monitoring system of the present invention and a screen in the middle of selecting the in-building monitoring mode
  • FIG. 4C is an image display main screen in the in-building monitoring mode
  • FIGS. 5A and 5B are diagrams showing an operation screen of the image monitoring system of the present invention and a screen in the middle of selecting the camera designation mode
  • FIG. 5C is an image display main screen in the camera designation mode
  • FIG. 5D is a camera designation mode. It is a figure which shows a map main body screen.
  • an image acquired by the camera 1 is displayed in the display area 101. If a camera is designated in advance, the image of the camera is displayed. To switch the image to be displayed. When the screen is tapped once in this state, a mode selection icon group including the wide area monitoring mode icon 102, the in-building monitoring icon 103, and the camera designation icon 104 is displayed on the upper right side of the screen.
  • the image display main screen is displayed semi-transparently in 105 as shown in FIG. 3A.
  • the image display main screen is selected and displayed as shown in FIG. 3C.
  • the map main screen is displayed in a translucent manner 106 as shown in FIG. 3B.
  • the map main screen is selected and displayed as shown in FIG. 3D. The reason why each screen is displayed in a translucent manner is to guide the user to select a screen.
  • the upper part of the screen 107 displays, for example, the appearance of the building, and the images of the monitoring cameras are displayed side by side in the form of thumbnails in order of the camera name.
  • the image 111 of the camera selected from the thumbnail is displayed large.
  • an image to be displayed on the screen 111 can be selected by tapping the desired image 108 of the thumbnail on the upper part 107 of the screen or by holding and dragging and sliding it to the screen 111.
  • the currently selected camera image 108 is visually identified and displayed with a thick frame or the like.
  • an arrow-like screen feed button 109 is displayed on the left and right ends of the thumbnail display portion 107, and by tapping this, one thumbnail image slides in the direction of the arrow, and more images than the display amount are displayed. If there is, the next image that is not displayed slides in and is displayed.
  • the screen advance button 109 the thumbnail image automatically slides in the direction of the arrow, and when the screen is tapped again, the thumbnail image is released and the screen advancement is stopped. Note that the screen can be moved in that direction by swiping left and right, and the amount of screen shift varies depending on the swipe strength.
  • a menu box is displayed, and by tapping there, the screen may be changed to the image main screen in the in-building monitoring mode.
  • a building to be monitored is displayed together with the map 112 as a building icon 113 as shown in FIG. 3D.
  • the building icon 113 to be monitored is tapped, detailed building information and an image are associated with a line or the like and displayed in the window 114, and when the close button or outside the window is tapped, the window 114 is closed.
  • the window 114 can be closed by tapping the close button or the building icon 113, and a plurality of monitoring target windows can be displayed simultaneously. It is also possible to display an enlarged image by double-tapping the image display part of the window 114.
  • the map can be enlarged around the center of gravity between two points, and reduced by pinching out. You can also slide the map by swiping. Further, when the building icon 113 is double-tapped, a transition to a map main screen in the in-building monitoring mode described later can be made. In addition, even if it is not a double tap, it is good also as a menu box being displayed if it holds and changing to the map main body screen of the monitoring mode in a building by tapping there.
  • the in-building monitoring mode icon 103 when the in-building monitoring mode icon 103 is touched and dragged downward in the screen, the image display main screen is displayed in a translucent manner in 115 as shown in FIG. 4A.
  • the image display main screen is selected and displayed as shown in FIG. 4C.
  • the map main screen is displayed in a semi-transparent manner at 116 as shown in FIG. 4B.
  • the map main screen is selected and displayed as shown in FIG. 4D.
  • a map image 118 showing each floor of the building is displayed side by side in a thumbnail form in the order of the floor, etc.
  • the camera images 121 on the floor selected from the above are displayed side by side in the form of thumbnails in the order of the camera names, etc., and the camera image 124 selected from the thumbnails is displayed large in the lower part 123 of the screen.
  • the thumbnail image to be displayed on the middle screen portion 120 is determined by tapping the desired map image 118 on the upper portion 117 of the screen, and the desired image 121 to be displayed on the middle portion 120 of the screen is tapped on the desired thumbnail image 121. Or hold and drag to 124 to select.
  • the currently selected map image 118 and camera image 121 are visually identified and displayed with a thick frame or the like, and the camera of the currently selected image is visually indicated by an icon indicating the camera in the map image 118. Identified and displayed. Note that the screen feed is omitted because it is as described above.
  • a floor configuration image 126 showing the floor configuration of the selected building is displayed on the left portion 125 of the screen, and a map image of each floor is displayed on the upper right portion 127 of the screen. 128 are displayed side by side in the form of thumbnails in the order of the floor, and the detailed map image 131 of the selected floor and the camera icon 132 displayed corresponding to the actual camera installation position are selected in the lower right portion 130 of the screen.
  • a camera image 133 is displayed.
  • the map to be displayed on the lower right portion 130 of the screen is obtained by tapping or holding the desired floor of the floor configuration image 126 on the left portion 125 of the screen or the desired floor image 128 on the upper right portion 127 of the screen and dragging it to the lower right portion 130 of the screen. You can choose.
  • a desired camera icon 132 in the lower right portion 130 of the screen is tapped, the camera image is displayed in a window 133 in association with a line or the like, and when the close button or outside the image is tapped, the window 133 is closed.
  • the window 133 can be closed only by tapping the close button or the camera icon 132, and a plurality of camera image windows can be displayed simultaneously.
  • the map image 131 of the map main screen it is also possible to display an enlarged image by double-tapping the image display portion of the window 133. Also, the currently selected floor and camera images and icons are visually identified and displayed with thick frames or the like. Further, by pinching in a desired place on the map image 131 of the map main screen, the map can be enlarged around the center of gravity between two points, and reduced by pinching out. You can also slide the map by swiping. Note that the screen feed is omitted because it is as described above.
  • FIG. 2 when the camera designation mode icon 104 is touched and dragged downward in the screen, the image display main screen is displayed in a translucent manner at 133 as shown in FIG. 5A.
  • the image display main screen is selected and displayed as shown in FIG. 5C.
  • the map main screen is displayed in a translucent manner in 134 as shown in FIG. 5B.
  • the touch is released at a position where the map main screen is displayed in a semi-transparent state, the map main screen is selected and displayed as shown in FIG. 5D.
  • the images of the cameras are displayed side by side in a thumbnail shape in the upper part 135 of the screen in the order of the camera names, and the camera selected from the thumbnails is displayed in the lower part 139 of the screen.
  • the image 140 is displayed large.
  • an image to be displayed on 140 can be selected by tapping or holding a desired thumbnail image 136 on the upper part 135 of the screen or dragging it to 140.
  • Each camera image 136 displayed as a thumbnail on the upper part 135 of the screen has an identification icon 137 indicating the type and installation location of the camera in the upper left. By tapping or holding this icon, it is displayed directly or through display / selection of the menu icon.
  • Only the same type of camera or the camera image at the installation position can be displayed as a thumbnail on the upper part 135 of the screen. Further, the currently selected camera image 136 is visually identified and displayed with a thick frame or the like. Note that the screen feed is omitted because it is as described above.
  • a character string indicating the selected area division and the floor structure of the building is displayed on the left side portion 141 of the screen, and the left side portion of the screen is displayed on the right side portion 142 of the screen.
  • the camera images are displayed side by side in the form of thumbnails in the order of the camera names or the like corresponding to the sections and floors displayed in 141.
  • the desired camera image 143 is tapped, the camera image is enlarged and displayed in the window, and the window is closed by tapping the close button or the outside of the image.
  • the desired camera image 143 can be displayed in full screen by double tap or selecting a hold menu.
  • left and right screen feeds are as described above, but the up and down screen feeds using the screen feed button 145 need only be read as the left and right in the left and right screen feeds described above, and the area divisions and floors can be slid. Can be made.
  • the displayed image may be a still image or a moving image. Initially, a still image may be displayed, and a tap may be displayed as a moving image.
  • the detected camera image is automatically displayed, and the building icon, camera icon, and floor image are visually identified and displayed. Is done. Alternatively, it is possible to notify that an alarm has been issued and to select whether to switch to the detected camera image and icon.
  • the camera providing the displayed image has a pan / tilt / zoom function in a full-screen display or in an area where the image such as 111, 124, 140 is enlarged and displayed, May be used to control the turning and zooming in / out of the camera. For example, by tapping the top, bottom, left, or right edge of the displayed image, you can pan and tilt the camera in the up, down, left, or right direction, or by dragging or swiping, you can pan or tilt the camera in the direction opposite to the slide direction, You can zoom in / out by pinching in / out.
  • the present invention is not limited to the above embodiments.
  • the case of a portable terminal using a touch panel has been described.
  • the present invention is not limited to this, and a fixed touch panel type operation terminal may be used.
  • the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage.
  • various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in each embodiment. Furthermore, you may combine suitably the component covering different embodiment.
  • the present invention is particularly effective when image monitoring is performed using an operation terminal using a touch panel, but is also applicable when image monitoring is performed using a terminal other than a touch panel. If so, it is applicable.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)
  • Alarm Systems (AREA)

Abstract

In an image monitoring system that monitors a plurality of locations of different sizes by means of cameras, provided is an image monitoring interface that uses a touch panel operation terminal and is more intuitively easy to operate. Using the touch panel operation terminal in the operation terminal of the image monitoring system, it is possible to achieve a more intuitively easy to operate image monitoring interface by means of executing user operations such as image selection, enlargement, viewing, or the like, or switching modes between architectural, wide area, and the like by means of a gesture operation accompanying a touch.

Description

操作端末、操作方法およびプログラムOperation terminal, operation method and program
　本発明は、監視カメラを用いた画像監視システムにおける、操作端末での監視操作に関する。 The present invention relates to a monitoring operation at an operation terminal in an image monitoring system using a monitoring camera.
　画像監視システムは、ホテルやビル、コンビニエンスストア、金融機関、ダム、道路等といった様々な公共施設や民間施設等において、犯罪や事故の防止、事件や事故の事後解析等の目的で導入されている。一般的な画像監視システムでは、カメラで監視対象エリアを撮像し、撮像した画像をネットワークを介して管理事務所や警備室等の監視センタや記録装置に伝送し、伝送された画像により監視者が監視対象を監視して目的や必要に応じて注意や警告をしたり、伝送された画像を記録装置に記録したりしている。 Image surveillance systems have been introduced in various public facilities and private facilities such as hotels, buildings, convenience stores, financial institutions, dams, roads, etc. for the purpose of crime and accident prevention, post-mortem analysis of incidents and accidents, etc. . In a general image monitoring system, an area to be monitored is imaged by a camera, and the captured image is transmitted to a monitoring center or a recording device such as a management office or a security room via a network. The monitoring target is monitored to give warnings and warnings according to the purpose and necessity, and the transmitted image is recorded in a recording device.
　この様な従来の監視システムの場合、監視者がモニタとマウス等のポインティングデバイスを備えるパソコンなどのコンピュータを用いて、ＧＵＩ（Graphical User Interface）画面からカメラのパン・チルト・ズームを操作したり、監視画像を閲覧したりすることで、監視対象領域を監視している。 In the case of such a conventional monitoring system, a monitor uses a computer such as a personal computer equipped with a monitor and a pointing device such as a mouse to operate pan / tilt / zoom of the camera from a GUI (Graphical User Interface) screen, The monitoring target area is monitored by browsing the monitoring image.
　なお、従来技術として、監視端末にＷｅｂブラウザ形式で表示したＧＵＩ画面からカメラを制御したり、撮像した画像を表示したりする画像監視システムが開示されている（特許文献１を参照）。 As a conventional technique, an image monitoring system that controls a camera from a GUI screen displayed on a monitoring terminal in a Web browser format or displays a captured image is disclosed (see Patent Document 1).
　一方、近年、スマートフォンやタブレットと呼ばれるタッチパネルを用いた可搬型の通信端末が普及しており、これらを用いて画像監視することが望まれている。 On the other hand, in recent years, portable communication terminals using touch panels called smartphones and tablets have become widespread, and it is desired to monitor images using these.
特開２０１１－０５５４２３号公報JP 2011-055423 A
　本発明は、この様な要望を鑑みて為されたものであり、タッチパネル式の操作端末を用いて、より感覚的に操作し易い画像監視インターフェースを提供することを目的とする。 The present invention has been made in view of such a demand, and an object thereof is to provide an image monitoring interface that can be operated more intuitively using a touch panel type operation terminal.
　本発明の操作端末は、表示面に操作画面を表示する表示手段と、前記表示手段の上に配置されタッチを伴う操作を検出するタッチパネルと、検出した操作を判定して制御する制御手段と、を備える操作端末であって、複数の画像を表示するサムネイル画像表示領域と、前記サムネイル画像表示領域に表示された画像の中から選択された画像を拡大して表示する画像拡大表示領域と、を前記表示面に表示し、前記サムネイル画像表示領域に表示された画像を前記画像拡大表示領域までドラッグ操作されることで、該画像を前記画像拡大表示領域に拡大して表示することを特徴とする。 The operation terminal of the present invention includes a display unit that displays an operation screen on a display surface, a touch panel that is disposed on the display unit and detects an operation involving a touch, a control unit that determines and controls the detected operation, A thumbnail image display area for displaying a plurality of images, and an image enlargement display area for enlarging and displaying an image selected from the images displayed in the thumbnail image display area. The image displayed on the display surface and displayed in the thumbnail image display area is dragged to the image enlargement display area, and the image is enlarged and displayed in the image enlargement display area. .
　また、本発明の操作方法は、表示面に操作画面を表示する表示手段と、前記表示手段の上に配置されタッチを伴う操作を検出するタッチパネルと、検出した操作を判定して制御する制御手段と、を備える操作端末において、複数の画像を表示するサムネイル画像表示領域と、前記サムネイル画像表示領域に表示された画像の中から選択された画像を拡大して表示する画像拡大表示領域と、を前記表示面に表示し、前記サムネイル画像表示領域に表示された画像を前記画像拡大表示領域までドラッグ操作されることで、該画像を前記画像拡大表示領域に拡大して表示することを特徴とする。 The operation method of the present invention includes a display unit that displays an operation screen on a display surface, a touch panel that is disposed on the display unit and detects an operation involving a touch, and a control unit that determines and controls the detected operation. And a thumbnail image display area for displaying a plurality of images, and an image enlargement display area for enlarging and displaying an image selected from the images displayed in the thumbnail image display area. The image displayed on the display surface and displayed in the thumbnail image display area is dragged to the image enlargement display area, and the image is enlarged and displayed in the image enlargement display area. .
　また、本発明のプログラムは、表示面に操作画面を表示する表示手段と、前記表示手段の上に配置されタッチを伴う操作を検出するタッチパネルと、を備えるコンピュータに、複数の画像を表示するサムネイル画像表示領域と、前記サムネイル画像表示領域に表示された画像の中から選択された画像を拡大して表示する画像拡大表示領域と、を前記表示面に表示する表示処理と、前記サムネイル画像表示領域に表示された画像を前記画像拡大表示領域までドラッグ操作されることで、該画像を前記画像拡大表示領域に拡大して表示する選択処理と、を実行させることを特徴とする。 In addition, the program of the present invention is a thumbnail for displaying a plurality of images on a computer including a display unit that displays an operation screen on a display surface, and a touch panel that is disposed on the display unit and detects an operation involving a touch. An image display area, an image enlargement display area for enlarging and displaying an image selected from images displayed in the thumbnail image display area, a display process for displaying on the display surface, and the thumbnail image display area And a selection process for enlarging and displaying the image in the image enlargement display area by dragging the image displayed on the image enlargement display area.
　また、本発明の操作端末は、さらに、前記サムネイル画像表示領域に表示される複数の画像は、それぞれ異なるカメラの画像であって、画像が、前記サムネイル画像より大きく表示されている場合には、該画像に対してタッチを伴う操作がされることで該画像を撮像しているカメラに対してパン、チルト、またはズームを制御する信号を送信することを特徴とする。 Further, in the operation terminal of the present invention, when the plurality of images displayed in the thumbnail image display area are images from different cameras, and the images are displayed larger than the thumbnail images, A signal for controlling pan, tilt, or zoom is transmitted to a camera that captures the image by performing an operation with a touch on the image.
　また、本発明の操作方法は、さらに、前記サムネイル画像表示領域に表示される複数の画像は、それぞれ異なるカメラの画像であって、画像が、前記サムネイル画像より大きく表示されている場合には、該画像に対してタッチを伴う操作がされることで該画像を撮像しているカメラに対してパン、チルト、またはズームを制御する信号を送信することを特徴とする。 Further, in the operation method of the present invention, when the plurality of images displayed in the thumbnail image display area are images of different cameras, and the images are displayed larger than the thumbnail images, A signal for controlling pan, tilt, or zoom is transmitted to a camera that captures the image by performing an operation with a touch on the image.
　また、本発明のプログラムは、さらに、前記サムネイル画像表示領域に表示させる複数の画像は、それぞれ異なるカメラの画像であって、画像が前記サムネイル画像より大きく表示されている場合には、該画像に対してタッチを伴う操作がされることで該画像を撮像しているカメラに対してパン、チルト、またはズームを制御する信号を送信する処理を実行させることを特徴とする。 In the program of the present invention, the plurality of images to be displayed in the thumbnail image display area are images of different cameras, and when the images are displayed larger than the thumbnail images, the images are displayed on the images. On the other hand, when an operation involving touch is performed, a process of transmitting a signal for controlling pan, tilt, or zoom to a camera that captures the image is executed.
　本発明によれば、タッチパネル式の操作端末を用いて、タッチを伴うジェスチャ操作によってモード切替えや画像選択などの操作を実行することで、より感覚的に操作し易い画像監視インターフェースを実現できる。 According to the present invention, it is possible to realize an image monitoring interface that can be operated more intuitively by performing operations such as mode switching and image selection by a gesture operation with touch using a touch panel type operation terminal.
本発明の画像監視システムの全体構成と操作端末の内部構成を示すブロック図である。It is a block diagram which shows the whole structure of the image monitoring system of this invention, and the internal structure of an operating terminal. 本発明の画像監視システムの操作画面で、初期状態の画面を示す図である。It is a figure which shows the screen of an initial state on the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、広域監視モードの選択画面を示す図である。It is a figure which shows the selection screen of wide area monitoring mode on the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、広域監視モードの選択画面を示す図である。It is a figure which shows the selection screen of wide area monitoring mode on the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、広域監視モードの操作画面を示す図である。It is a figure which shows the operation screen of wide area monitoring mode on the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、広域監視モードの操作画面を示す図である。It is a figure which shows the operation screen of wide area monitoring mode on the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、建物内監視モードの選択画面を示す図である。It is a figure which shows the selection screen of the monitoring mode in a building in the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、建物内監視モードの選択画面を示す図である。It is a figure which shows the selection screen of the monitoring mode in a building in the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、建物内監視モードの操作画面を示す図である。It is a figure which shows the operation screen of the monitoring mode in a building in the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、建物内監視モードの操作画面を示す図である。It is a figure which shows the operation screen of the monitoring mode in a building in the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、カメラ指定モードの選択画面を示す図である。It is a figure which shows the selection screen of a camera designation | designated mode on the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、カメラ指定モードの選択画面を示す図である。It is a figure which shows the selection screen of a camera designation | designated mode on the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、カメラ指定モードの操作画面を示す図である。It is a figure which shows the operation screen of camera designation | designated mode on the operation screen of the image monitoring system of this invention. 本発明の画像監視システムの操作画面で、カメラ指定モードの操作画面を示す図である。It is a figure which shows the operation screen of camera designation | designated mode on the operation screen of the image monitoring system of this invention.
　以下、図面を参照して本発明の実施形態について詳細に説明する。
　図１は、本発明の画像監視システムの全体構成と操作端末の内部構成を示すブロック図である。 Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram showing the overall configuration of the image monitoring system of the present invention and the internal configuration of the operation terminal.
　図１に示す画像監視システムは、監視領域を撮像するパン・チルト・ズーム機能搭載のカメラ１－１～１－ｎ（特に区別しない場合はカメラ１と呼ぶ）、ＨＤＤ（Hard Disk Drive）やＳＳＤ（Solid State Drive）などの大容量の記録媒体を備える記録装置２、タッチパネル式の操作端末３から構成され、それぞれインターネット等のネットワークによって接続される。
　なお、カメラ１はパン・チルト・ズーム機能搭載としたが固定型のカメラでもよく、複数でなくてもよい。また、記録装置２も説明を簡単にするために１つとしたが、複数あってもよい。 The image monitoring system shown in FIG. 1 is a camera 1-1 to 1-n equipped with a pan / tilt / zoom function for picking up an image of a monitoring area (referred to as camera 1 unless otherwise specified), HDD (Hard Disk Drive), SSD or the like. It is composed of a recording device 2 having a large-capacity recording medium such as (Solid State Drive), and a touch panel type operation terminal 3, which are connected by a network such as the Internet.
The camera 1 is equipped with a pan / tilt / zoom function. However, the camera 1 may be a fixed camera, and may not be plural. Further, the number of recording apparatuses 2 is one for the sake of simplicity, but a plurality of recording apparatuses 2 may be provided.
　カメラ１は監視領域を撮像して画像を取得し、ネットワークを介して記録装置２へ出力し、記録装置２は入力された画像を記録媒体に記録する。操作端末３は操作者の操作や設定に従ってカメラ１や記録装置２へ制御信号を出力する。操作端末３から指定されたカメラ１へリアルタイムの画像を要求すると、カメラ１は操作端末３へ取得した画像を出力し、操作端末３は受信した画像を表示する。また、操作端末３から指定されたカメラ１へパン・チルト・ズームを制御するよう要求すると、カメラ１は要求の内容に従ってパン・チルト・ズームを制御する。また、操作端末３から日時やカメラ名等で指定した記録画像を記録装置２へ要求すると、記録装置２は指定された記録画像を操作端末３へ出力し、操作端末３は受信した記録画像を表示する。 The camera 1 captures the monitoring area, acquires an image, and outputs the image to the recording device 2 via the network. The recording device 2 records the input image on a recording medium. The operation terminal 3 outputs a control signal to the camera 1 and the recording device 2 according to the operation and setting of the operator. When a real-time image is requested from the operation terminal 3 to the designated camera 1, the camera 1 outputs the acquired image to the operation terminal 3, and the operation terminal 3 displays the received image. When the operation terminal 3 requests the designated camera 1 to control pan / tilt / zoom, the camera 1 controls pan / tilt / zoom according to the contents of the request. Further, when a recording image designated by the date and time, camera name, etc. is requested from the operation terminal 3 to the recording device 2, the recording device 2 outputs the designated recording image to the operation terminal 3, and the operation terminal 3 displays the received recorded image. indicate.
　また、図１に示す画像監視システムの操作端末３は、データを通信可能な形式に変換して送受信する通信部３０１、操作端末３の各部を制御するとともにジェスチャ情報の判定処理等を実行する制御部３０２、ＲＯＭ（Read Only Memory）やＲＡＭ（Random Access Memory）等でジェスチャ情報３０３Ａやプログラム３０３Ｂを記憶する記憶部３０３、操作者のジェスチャを認識するタッチセンサ３０４Ａと文字や画像等を表示する表示部３０４Ｂを備えるタッチパネル３０４、戻るボタンや電源ボタン等の入力部３０５から構成される。 In addition, the operation terminal 3 of the image monitoring system shown in FIG. 1 controls the communication unit 301 that converts data into a communicable format and transmits / receives data, controls each unit of the operation terminal 3, and executes a gesture information determination process and the like Unit 302, storage unit 303 for storing gesture information 303A and program 303B in ROM (Read Only Memory), RAM (Random Access Memory), etc., touch sensor 304A for recognizing the gesture of the operator, and display for displaying characters, images, etc. The touch panel 304 includes a unit 304B, and an input unit 305 such as a return button or a power button.
　タッチセンサ３０４Ａは表示部３０４Ｂの上に全面に渡って設けられ、タッチセンサ３０４Ａは、表面弾性波方式や静電容量方式などを用いて操作者のタッチを伴うジェスチャを認識し、表示部３０４Ｂは、制御部３０２によって描画される文字や画像等を表示する。 The touch sensor 304A is provided over the entire surface of the display unit 304B. The touch sensor 304A recognizes a gesture accompanied by an operator's touch using a surface acoustic wave method or a capacitance method, and the display unit 304B The characters and images drawn by the control unit 302 are displayed.
　ジェスチャ情報３０３Ａはタッチセンサ３０４Ａによって認識された操作者のジェスチャの特徴に対応して記憶された操作コマンドに関する情報であり、プログラム３０３Ｂは例えばＯＳ（Operating System）、ジェスチャ情報３０４Ａを用いた判定処理プログラム、各種アプリケーションプログラム等である。 The gesture information 303A is information related to operation commands stored corresponding to the characteristics of the gesture of the operator recognized by the touch sensor 304A. The program 303B is a determination processing program using, for example, an OS (Operating System) and the gesture information 304A. And various application programs.
　なお、ここでジェスチャとは、操作者のタッチパネル３０４へのタッチを伴う操作を意味し、タップ（タッチしてすぐに離す）、ドラッグ（タッチしたままスライドさせる）、ピンチイン（２点タッチし２点間を狭める様にスライドさせる）、ピンチアウト（２点タッチし２点間を離す様にスライドさせる）、スワイプ（掃く様にタッチしてスライドして離す）、ホールド（長押し）等といったものがある。 Here, the gesture means an operation that involves an operator touching the touch panel 304, and tap (touch and release immediately), drag (slide while touching), pinch-in (two touches and two touches). Such as pinching out (touching two points and sliding to release two points), swipe (touching and sliding to release), hold (long press), etc. is there.
　ジェスチャ操作による端末の具体的な動作は次の通り。
操作者がタッチパネル３０４に対してジェスチャ操作すると、タッチセンサ３０４Ａによって操作者のジェスチャが認識され、制御部３０２はジェスチャ情報３０４を参照して操作コマンドを生成し、操作コマンドに基づいてプログラム３０３Ｂを実行する。そして、プログラム実行結果を描画し表示部３０４Ｂに表示する。 The specific operation of the terminal by gesture operation is as follows.
When the operator performs a gesture operation on the touch panel 304, the operator's gesture is recognized by the touch sensor 304A, the control unit 302 generates an operation command by referring to the gesture information 304, and executes the program 303B based on the operation command. To do. Then, the program execution result is drawn and displayed on the display unit 304B.
　また、入力部３０５が操作されることによる動作も、記憶部３０３に記憶された情報を参照して操作コマンドを生成し、プログラム３０３Ｂを実行することで実現される。 Further, an operation by operating the input unit 305 is also realized by generating an operation command with reference to information stored in the storage unit 303 and executing the program 303B.
　上述した操作や自動実行プログラムにより通信が必要となった場合、通信部３０１は、制御部３０２からの制御信号等のデータを、３Ｇ回線やＷｉ－Ｆｉ等の方式を用いたネットワークで通信可能な形式に変換して、カメラ１や記録装置２へ向けてネットワークに出力する。 When communication is required by the above-described operation or automatic execution program, the communication unit 301 can communicate data such as a control signal from the control unit 302 via a network using a system such as a 3G line or Wi-Fi. The data is converted into a format and output to the network toward the camera 1 and the recording device 2.
　これにより、タッチパネル式の操作端末３を用いて画像監視することができる。 Thereby, image monitoring can be performed using the touch panel type operation terminal 3.
　なお、ここで、カメラ１がメモリーカード等の大容量の記録媒体を備え、撮像した画像を自らに記録する場合には、記録装置２は必要なく、カメラ１は記録装置２の機能も含めて操作端末３と通信する。この場合、上述した記録装置２と操作端末３との通信内容は全てカメラ１と操作端末３との通信に置き換えることができ、カメラ１は操作端末３からの要求がカメラ制御機能に関するものか記録機能に関するものかを判別して動作する。従って、この画像監視システムはカメラ１と操作端末３のみ成立し、物理的なシステム構成を簡素化することができる。 Here, when the camera 1 includes a large-capacity recording medium such as a memory card and records the captured image on itself, the recording device 2 is not necessary, and the camera 1 includes the function of the recording device 2. It communicates with the operation terminal 3. In this case, all the communication contents between the recording device 2 and the operation terminal 3 described above can be replaced with communication between the camera 1 and the operation terminal 3, and the camera 1 records whether the request from the operation terminal 3 relates to the camera control function. It works by determining whether it is related to the function or not. Therefore, this image monitoring system is realized only by the camera 1 and the operation terminal 3, and the physical system configuration can be simplified.
　次に、図２～図５を用いて、操作端末３に表示される画像監視インターフェースの操作について説明する。 Next, the operation of the image monitoring interface displayed on the operation terminal 3 will be described with reference to FIGS.
　図２は、本発明の画像監視システムの操作画面で、初期状態の画面を示す図である。
　図３Ａ，Ｂは、本発明の画像監視システムの操作画面で、広域監視モードの選択途中の画面を示す図、図３Ｃは、広域監視モードの画像表示主体画面、図３Ｄは、広域監視モードのマップ主体画面を示す図である。
　図４Ａ，Ｂは、本発明の画像監視システムの操作画面で、建物内監視モードの選択途中の画面を示す図、図４Ｃは、建物内監視モードの画像表示主体画面、図４Ｄは、建物内監視モードのマップ主体画面を示す図である。
　図５Ａ，Ｂは、本発明の画像監視システムの操作画面で、カメラ指定モードの選択途中の画面を示す図、図５Ｃは、カメラ指定モードの画像表示主体画面、図５Ｄは、カメラ指定モードのマップ主体画面を示す図である。 FIG. 2 is a diagram showing a screen in an initial state on the operation screen of the image monitoring system of the present invention.
3A and 3B are diagrams showing an operation screen of the image monitoring system of the present invention, a screen in the middle of selecting the wide area monitoring mode, FIG. 3C is an image display main screen in the wide area monitoring mode, and FIG. 3D is a wide area monitoring mode. It is a figure which shows a map main body screen.
4A and 4B are diagrams showing an operation screen of the image monitoring system of the present invention and a screen in the middle of selecting the in-building monitoring mode, FIG. 4C is an image display main screen in the in-building monitoring mode, and FIG. It is a figure which shows the map main body screen of monitoring mode.
5A and 5B are diagrams showing an operation screen of the image monitoring system of the present invention and a screen in the middle of selecting the camera designation mode, FIG. 5C is an image display main screen in the camera designation mode, and FIG. 5D is a camera designation mode. It is a figure which shows a map main body screen.
　図２において、１０１の表示領域にはカメラ１で取得した画像が表示されており、予めカメラを指定している場合にはそのカメラの画像が表示され、特に指定がなければ一定の間隔でカメラを切り替えて画像が表示される。この状態で画面を１度タップすると、広域監視モードアイコン１０２、建物内監視アイコン１０３、およびカメラ指定アイコン１０４から構成されるモード選択アイコン群が画面右上に表示される。 In FIG. 2, an image acquired by the camera 1 is displayed in the display area 101. If a camera is designated in advance, the image of the camera is displayed. To switch the image to be displayed. When the screen is tapped once in this state, a mode selection icon group including the wide area monitoring mode icon 102, the in-building monitoring icon 103, and the camera designation icon 104 is displayed on the upper right side of the screen.
　まず、広域監視モードを選択する場合について説明する。
　図２において、広域監視モードアイコン１０２にタッチし画面下方向にドラッグすると、図３Ａの様に、１０５に画像表示主体画面が半透明で表示される。この画像表示主体画面が半透明で表示されている位置でタッチを離すと、図３Ｃの様に、画像表示主体画面が選択されて表示される。また、広域監視モードアイコン１０２をさらに画面下方向にドラッグして所定の位置を越えると、図３Ｂの様に、１０６にマップ主体画面が半透明で表示される。このマップ主体画面が半透明で表示されている位置でタッチを離すと、図３Ｄの様にマップ主体画面が選択されて表示される。なお、各画面が半透明で表示されるのは、ユーザーに対して画面選択をガイドするためである。 First, the case where the wide area monitoring mode is selected will be described.
In FIG. 2, when the wide area monitoring mode icon 102 is touched and dragged downward in the screen, the image display main screen is displayed semi-transparently in 105 as shown in FIG. 3A. When the touch is released at a position where the image display main screen is displayed in a translucent state, the image display main screen is selected and displayed as shown in FIG. 3C. Further, when the wide area monitoring mode icon 102 is further dragged downward on the screen to exceed a predetermined position, the map main screen is displayed in a translucent manner 106 as shown in FIG. 3B. When the touch is released at a position where the map main screen is displayed in a semi-transparent state, the map main screen is selected and displayed as shown in FIG. 3D. The reason why each screen is displayed in a translucent manner is to guide the user to select a screen.
　画像表示主体画面が選択されると、図３Ｃの様に、画面上部１０７には例えば建物の外観等を監視カメラの画像がカメラ名順等でサムネイル状に横並びで表示され、画面下部１１０にはサムネイルから選択されたカメラの画像１１１が大きく表示される。このとき、１１１に表示する画像は、画面上部１０７のサムネイルの所望の画像１０８をタップするかホールド＆ドラッグして１１１までスライドさせることで選択することができる。また、現在選択されているカメラ画像１０８は太枠等で視覚的に識別して表示される。また、１０７のサムネイル表示部分の左右の端には矢印状の画面送りボタン１０９が表示され、これをタップすることで、矢印の方向にサムネイル画像が１枚分スライドして、表示分より多く画像がある場合には表示されていない次の画像がスライドインして表示される。また、画面送りボタン１０９をホールドすることで、自動でサムネイル画像が矢印方向にスライドし、画面を再度タップすることで解除され画面送りが停止する。なお、画面送りは左右にスワイプすることでもその方向に画面送りすることが可能であり、スワイプする強さに応じて画面送りされる量が変化する。また、所望の建物の画像１０８をホールドするとメニューボックスが表示され、そこをタップすることで建物内監視モードの画像主体画面に遷移することとしてもよい。 When the image display main screen is selected, as shown in FIG. 3C, the upper part of the screen 107 displays, for example, the appearance of the building, and the images of the monitoring cameras are displayed side by side in the form of thumbnails in order of the camera name. The image 111 of the camera selected from the thumbnail is displayed large. At this time, an image to be displayed on the screen 111 can be selected by tapping the desired image 108 of the thumbnail on the upper part 107 of the screen or by holding and dragging and sliding it to the screen 111. Further, the currently selected camera image 108 is visually identified and displayed with a thick frame or the like. Further, an arrow-like screen feed button 109 is displayed on the left and right ends of the thumbnail display portion 107, and by tapping this, one thumbnail image slides in the direction of the arrow, and more images than the display amount are displayed. If there is, the next image that is not displayed slides in and is displayed. In addition, by holding the screen advance button 109, the thumbnail image automatically slides in the direction of the arrow, and when the screen is tapped again, the thumbnail image is released and the screen advancement is stopped. Note that the screen can be moved in that direction by swiping left and right, and the amount of screen shift varies depending on the swipe strength. Further, when the desired building image 108 is held, a menu box is displayed, and by tapping there, the screen may be changed to the image main screen in the in-building monitoring mode.
　マップ主体画面が選択されると、図３Ｄの様に、監視対象の例えば建物が建物アイコン１１３としてマップ１１２と共に表示される。監視対象である建物アイコン１１３をタップすると、建物の詳細情報と画像が線等で対応付けられてウインドウ１１４で表示され、閉じるボタンまたはウインドウ外をタップするとウインドウ１１４が閉じる。ウインドウ１１４は閉じるボタンまたは建物アイコン１１３をタップすることで閉じることとし、複数の監視対象のウインドウを同時に表示することも可能である。また、ウインドウ１１４の画像表示部分をダブルタップすることで、画像を拡大表示することも可能である。また、このマップ主体画面で、所望の場所をピンチインすることで、２点間の重心位置を中心にマップを拡大し、ピンチアウトすることで縮小することができる。また、スワイプすることで、マップをスライドさせることもできる。また、建物アイコン１１３をダブルタップすると、後述する建物内監視モードのマップ主体画面に遷移することができる。なお、ダブルタップでなくても、ホールドするとメニューボックスが表示されて、そこをタップすることで建物内監視モードのマップ主体画面に遷移することとしてもよい。 When the map main screen is selected, for example, a building to be monitored is displayed together with the map 112 as a building icon 113 as shown in FIG. 3D. When the building icon 113 to be monitored is tapped, detailed building information and an image are associated with a line or the like and displayed in the window 114, and when the close button or outside the window is tapped, the window 114 is closed. The window 114 can be closed by tapping the close button or the building icon 113, and a plurality of monitoring target windows can be displayed simultaneously. It is also possible to display an enlarged image by double-tapping the image display part of the window 114. Further, by pinching in a desired place on this map main screen, the map can be enlarged around the center of gravity between two points, and reduced by pinching out. You can also slide the map by swiping. Further, when the building icon 113 is double-tapped, a transition to a map main screen in the in-building monitoring mode described later can be made. In addition, even if it is not a double tap, it is good also as a menu box being displayed if it holds and changing to the map main body screen of the monitoring mode in a building by tapping there.
　次に、建物内監視モードを選択する場合について説明する。
　図２において、建物内監視モードアイコン１０３にタッチし画面下方向にドラッグすると、図４Ａの様に、１１５に画像表示主体画面が半透明で表示される。この画像表示主体画面が半透明で表示されている位置でタッチを離すと、図４Ｃの様に、画像表示主体画面が選択されて表示される。また、建物内監視モードアイコン１０３をさらに画面下方向にドラッグして所定の位置を越えると、図４Ｂの様に、１１６にマップ主体画面が半透明で表示される。このマップ主体画面が半透明で表示されている位置でタッチを離すと、図４Ｄの様にマップ主体画面が選択されて表示される。 Next, the case where the in-building monitoring mode is selected will be described.
In FIG. 2, when the in-building monitoring mode icon 103 is touched and dragged downward in the screen, the image display main screen is displayed in a translucent manner in 115 as shown in FIG. 4A. When the touch is released at a position where the image display main screen is displayed in a translucent state, the image display main screen is selected and displayed as shown in FIG. 4C. If the in-building monitoring mode icon 103 is further dragged downward on the screen and exceeds a predetermined position, the map main screen is displayed in a semi-transparent manner at 116 as shown in FIG. 4B. When the touch is released at a position where the map main screen is displayed in a semi-transparent state, the map main screen is selected and displayed as shown in FIG. 4D.
　画像表示主体画面が選択されると、図４Ｃの様に、画面上部１１７には例えば建物の各フロアを示すマップ画像１１８がフロア順等でサムネイル状に横並びで表示され、画面中部１２０にはサムネイルから選択されたフロアにあるカメラの画像１２１がカメラ名順等でサムネイル状に横並びで表示され、画面下部１２３にはサムネイルから選択されたカメラ画像１２４が大きく表示される。このとき、画面中部１２０に表示するサムネイル画像は、画面上部１１７の所望のマップ画像１１８をタップすることで決定され、１２４に表示する画像は、画面中部１２０のサムネイルの所望の画像１２１をタップするかホールドして１２４までドラッグすることで選択することができる。また、現在選択されているマップ画像１１８およびカメラ画像１２１は太枠等で視覚的に識別して表示され、現在選択されている画像のカメラはマップ画像１１８内のカメラを示すアイコンが視覚的に識別されて表示される。なお、画面送りについては、上述した通りなので省略する。 When the image display main screen is selected, as shown in FIG. 4C, for example, a map image 118 showing each floor of the building is displayed side by side in a thumbnail form in the order of the floor, etc. The camera images 121 on the floor selected from the above are displayed side by side in the form of thumbnails in the order of the camera names, etc., and the camera image 124 selected from the thumbnails is displayed large in the lower part 123 of the screen. At this time, the thumbnail image to be displayed on the middle screen portion 120 is determined by tapping the desired map image 118 on the upper portion 117 of the screen, and the desired image 121 to be displayed on the middle portion 120 of the screen is tapped on the desired thumbnail image 121. Or hold and drag to 124 to select. The currently selected map image 118 and camera image 121 are visually identified and displayed with a thick frame or the like, and the camera of the currently selected image is visually indicated by an icon indicating the camera in the map image 118. Identified and displayed. Note that the screen feed is omitted because it is as described above.
　マップ主体画面が選択されると、図４Ｄの様に、画面左部１２５には選択されている建物のフロア構成を示すフロア構成画像１２６が表示され、画面右上部１２７には各フロアのマップ画像１２８がフロア順等でサムネイル状に横並びで表示され、画面右下部１３０には選択されているフロアの詳細なマップ画像１３１と実際のカメラ設置位置に対応して表示されるカメラアイコン１３２と選択されているカメラの画像１３３が表示される。画面右下部１３０に表示するマップは、画面左部１２５のフロア構成画像１２６の所望のフロアまたは画面右上部１２７の所望のフロア画像１２８をタップするかホールドして画面右下部１３０へドラッグすることで選択することができる。画面右下部１３０の所望のカメラアイコン１３２をタップすると、カメラ画像が線等で対応付けられてウインドウ１３３で表示され、閉じるボタンまたは画像外をタップするとウインドウ１３３が閉じる。ウインドウ１３３は閉じるボタンまたはカメラアイコン１３２をタップすることのみで閉じることとし、複数のカメラ画像ウインドウを同時に表示することも可能である。また、ウインドウ１３３の画像表示部分をダブルタップすることで、画像を拡大表示することも可能である。また、現在選択されているフロアおよびカメラの画像およびアイコンは、太枠等で視覚的に識別して表示される。また、このマップ主体画面のマップ画像１３１で、所望の場所をピンチインすることで、２点間の重心位置を中心にマップを拡大し、ピンチアウトすることで縮小することができる。また、スワイプすることで、マップをスライドさせることもできる。なお、画面送りについては、上述した通りなので省略する。 When the map main screen is selected, as shown in FIG. 4D, a floor configuration image 126 showing the floor configuration of the selected building is displayed on the left portion 125 of the screen, and a map image of each floor is displayed on the upper right portion 127 of the screen. 128 are displayed side by side in the form of thumbnails in the order of the floor, and the detailed map image 131 of the selected floor and the camera icon 132 displayed corresponding to the actual camera installation position are selected in the lower right portion 130 of the screen. A camera image 133 is displayed. The map to be displayed on the lower right portion 130 of the screen is obtained by tapping or holding the desired floor of the floor configuration image 126 on the left portion 125 of the screen or the desired floor image 128 on the upper right portion 127 of the screen and dragging it to the lower right portion 130 of the screen. You can choose. When a desired camera icon 132 in the lower right portion 130 of the screen is tapped, the camera image is displayed in a window 133 in association with a line or the like, and when the close button or outside the image is tapped, the window 133 is closed. The window 133 can be closed only by tapping the close button or the camera icon 132, and a plurality of camera image windows can be displayed simultaneously. It is also possible to display an enlarged image by double-tapping the image display portion of the window 133. Also, the currently selected floor and camera images and icons are visually identified and displayed with thick frames or the like. Further, by pinching in a desired place on the map image 131 of the map main screen, the map can be enlarged around the center of gravity between two points, and reduced by pinching out. You can also slide the map by swiping. Note that the screen feed is omitted because it is as described above.
　次に、カメラ指定モードを選択する場合について説明する。
　図２において、カメラ指定モードアイコン１０４にタッチし画面下方向にドラッグすると、図５Ａの様に、１３３に画像表示主体画面が半透明で表示される。この画像表示主体画面が半透明で表示されている位置でタッチを離すと、図５Ｃの様に、画像表示主体画面が選択されて表示される。また、カメラ指定監視モードアイコン１０４をさらに画面下方向にドラッグして所定の位置を越えると、図５Ｂの様に、１３４にマップ主体画面が半透明で表示される。このマップ主体画面が半透明で表示されている位置でタッチを離すと、図５Ｄの様にマップ主体画面が選択されて表示される。 Next, a case where the camera designation mode is selected will be described.
In FIG. 2, when the camera designation mode icon 104 is touched and dragged downward in the screen, the image display main screen is displayed in a translucent manner at 133 as shown in FIG. 5A. When the touch is released at a position where the image display main screen is displayed in a translucent state, the image display main screen is selected and displayed as shown in FIG. 5C. Further, when the camera designation monitoring mode icon 104 is further dragged downward in the screen and exceeds a predetermined position, the map main screen is displayed in a translucent manner in 134 as shown in FIG. 5B. When the touch is released at a position where the map main screen is displayed in a semi-transparent state, the map main screen is selected and displayed as shown in FIG. 5D.
　画像表示主体画面が選択されると、図５Ｃの様に、画面上部１３５にはカメラの画像がカメラ名順等でサムネイル状に横並びで表示され、画面下部１３９にはサムネイルから選択されたカメラの画像１４０が大きく表示される。このとき、１４０に表示する画像は、画面上部１３５のサムネイルの所望の画像１３６をタップするかホールドして１４０までドラッグすることで選択することができる。画面上部１３５にサムネイル表示される各カメラ画像１３６には左上にカメラの種類や設置場所を示す識別アイコン１３７が表示され、ここをタップまたはホールドすることで直接またはメニューアイコンの表示・選択を介して同種のカメラや設置位置のカメラ画像のみを画面上部１３５にサムネイル表示することができる。また、現在選択されているカメラ画像１３６は太枠等で視覚的に識別して表示される。なお、画面送りについては、上述した通りなので省略する。 When the image display main screen is selected, as shown in FIG. 5C, the images of the cameras are displayed side by side in a thumbnail shape in the upper part 135 of the screen in the order of the camera names, and the camera selected from the thumbnails is displayed in the lower part 139 of the screen. The image 140 is displayed large. At this time, an image to be displayed on 140 can be selected by tapping or holding a desired thumbnail image 136 on the upper part 135 of the screen or dragging it to 140. Each camera image 136 displayed as a thumbnail on the upper part 135 of the screen has an identification icon 137 indicating the type and installation location of the camera in the upper left. By tapping or holding this icon, it is displayed directly or through display / selection of the menu icon. Only the same type of camera or the camera image at the installation position can be displayed as a thumbnail on the upper part 135 of the screen. Further, the currently selected camera image 136 is visually identified and displayed with a thick frame or the like. Note that the screen feed is omitted because it is as described above.
　マップ主体画面が選択されると、図５Ｄの様に、画面左部１４１には選択されている地域の区分や建物のフロア構成を示す文字列が表示され、画面右部１４２には画面左部１４１に表示されている区分やフロアごとに対応してカメラ画像がカメラ名順等でサムネイル状に横並びで表示される。所望のカメラ画像１４３をタップすると、カメラ画像がウインドウで拡大表示され、閉じるボタンまたは画像外をタップすることでウインドウが閉じる。また、所望のカメラ画像１４３をダブルタップまたはホールドメニュー選択することにより全画面表示することができる。なお、左右の画面送りについては上述した通りだが、画面送りボタン１４５を用いた上下への画面送りは、上述した左右の画面送りでの左右を上下に読み替えればよく、地域区分やフロアをスライドさせることができる。 When the map main screen is selected, as shown in FIG. 5D, a character string indicating the selected area division and the floor structure of the building is displayed on the left side portion 141 of the screen, and the left side portion of the screen is displayed on the right side portion 142 of the screen. The camera images are displayed side by side in the form of thumbnails in the order of the camera names or the like corresponding to the sections and floors displayed in 141. When the desired camera image 143 is tapped, the camera image is enlarged and displayed in the window, and the window is closed by tapping the close button or the outside of the image. The desired camera image 143 can be displayed in full screen by double tap or selecting a hold menu. Note that the left and right screen feeds are as described above, but the up and down screen feeds using the screen feed button 145 need only be read as the left and right in the left and right screen feeds described above, and the area divisions and floors can be slid. Can be made.
　以上のことから、タッチパネル式の操作端末を用いてジェスチャ操作で各種操作を実行することで、より感覚的に操作し易い画像監視インターフェースを提供することができる。 From the above, it is possible to provide an image monitoring interface that can be operated more intuitively by performing various operations through gesture operations using a touch panel type operation terminal.
　なお、上述した各モードにおいて、表示される画像は静止画でもよいし動画でもよい。最初は静止画で表示して、タップすることで動画として表示する様にしてもよい。 In each mode described above, the displayed image may be a still image or a moving image. Initially, a still image may be displayed, and a tap may be displayed as a moving image.
　また、上述した各モードにおいて、侵入者等によりアラームが発報された場合には、検知したカメラの画像が自動的に表示され、建物アイコンやカメラアイコン、フロア画像が視覚的に識別されて表示される。または、アラームが発報されたことを通知し、検知したカメラの画像とアイコンに切り替えるか選択できる様にしてもよい。 In each mode described above, when an alarm is issued by an intruder or the like, the detected camera image is automatically displayed, and the building icon, camera icon, and floor image are visually identified and displayed. Is done. Alternatively, it is possible to notify that an alarm has been issued and to select whether to switch to the detected camera image and icon.
　また、全画面表示時や１１１，１２４，１４０等の画像が拡大されて表示される領域において、表示されている画像を提供しているカメラがパン・チルト・ズーム機能を備えている場合、ジェスチャによりカメラの旋回やズームアップ/アウトを制御できる様にしてもよい。例えば、表示された画像の上下左右端をタップすることで対応して上下左右方向にカメラをパン・チルトさせたり、ドラッグまたはスワイプ操作によりスライド方向とは逆方向にカメラをパン・チルトさせたり、ピンチイン/アウトによりズームアップ/アウトさせたりすることができる。 In addition, when the camera providing the displayed image has a pan / tilt / zoom function in a full-screen display or in an area where the image such as 111, 124, 140 is enlarged and displayed, May be used to control the turning and zooming in / out of the camera. For example, by tapping the top, bottom, left, or right edge of the displayed image, you can pan and tilt the camera in the up, down, left, or right direction, or by dragging or swiping, you can pan or tilt the camera in the direction opposite to the slide direction, You can zoom in / out by pinching in / out.
　また、本発明は上記各実施形態に限定されるものではない。例えば、上記実施形態では、タッチパネルを用いた携帯端末の場合で説明したが、これに限定されるものではなく、この他にも固定されたタッチパネル式の操作端末であってもよい。 Further, the present invention is not limited to the above embodiments. For example, in the above-described embodiment, the case of a portable terminal using a touch panel has been described. However, the present invention is not limited to this, and a fixed touch panel type operation terminal may be used.
　要するに本発明は、上記各実施形態そのままに限定されるものではなく、実施段階ではその要旨を逸脱しない範囲で構成要素を変形して具体化できる。また、上記各実施形態に開示されている複数の構成要素の適宜な組み合せにより種々の発明を形成できる。例えば、各実施形態に示される全構成要素から幾つかの構成要素を削除してもよい。さらに、異なる実施形態に亘る構成要素を適宜組み合せてもよい。 In short, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in each embodiment. Furthermore, you may combine suitably the component covering different embodiment.
　本発明は、特にタッチパネルを用いた操作端末を使って画像監視する場合に有効だが、タッチパネル以外の端末を使って画像監視する場合にも適用可能であり、また、画像監視以外でも画像を扱う用途であれば適用可能である。 The present invention is particularly effective when image monitoring is performed using an operation terminal using a touch panel, but is also applicable when image monitoring is performed using a terminal other than a touch panel. If so, it is applicable.
　１：カメラ、２：記録装置、３：操作端末、３０１：通信部、３０２：制御部、３０３：記憶部、３０３Ａ：ジェスチャ情報、３０３Ｂ：プログラム、３０４：タッチパネル、３０４Ａ：タッチセンサ、３０４Ｂ：表示部、３０５：入力部。 1: Camera, 2: Recording device, 3: Operation terminal, 301: Communication unit, 302: Control unit, 303: Storage unit, 303A: Gesture information, 303B: Program, 304: Touch panel, 304A: Touch sensor, 304B: Display Part, 305: input part.

Claims (6)

  1. 表示面に操作画面を表示する表示手段と、前記表示手段の上に配置されタッチを伴う操作を検出するタッチパネルと、検出した操作を判定して制御する制御手段と、を備える操作端末であって、
    複数の画像を表示するサムネイル画像表示領域と、前記サムネイル画像表示領域に表示された画像の中から選択された画像を拡大して表示する画像拡大表示領域と、を前記表示面に表示し、
    前記サムネイル画像表示領域に表示された画像を前記画像拡大表示領域までドラッグ操作されることで、該画像を前記画像拡大表示領域に拡大して表示することを特徴とする操作端末。     An operation terminal comprising: a display unit that displays an operation screen on a display surface; a touch panel that is disposed on the display unit and detects an operation with a touch; and a control unit that determines and controls the detected operation. ,
    A thumbnail image display area for displaying a plurality of images and an image enlargement display area for enlarging and displaying an image selected from the images displayed in the thumbnail image display area;
    An operation terminal, wherein an image displayed in the thumbnail image display area is dragged to the image enlargement display area, and the image is enlarged and displayed in the image enlargement display area.
  2. 表示面に操作画面を表示する表示手段と、前記表示手段の上に配置されタッチを伴う操作を検出するタッチパネルと、検出した操作を判定して制御する制御手段と、を備える操作端末において、
    複数の画像を表示するサムネイル画像表示領域と、前記サムネイル画像表示領域に表示された画像の中から選択された画像を拡大して表示する画像拡大表示領域と、を前記表示面に表示し、
    前記サムネイル画像表示領域に表示された画像を前記画像拡大表示領域までドラッグ操作されることで、該画像を前記画像拡大表示領域に拡大して表示することを特徴とする操作方法。     In an operation terminal comprising: a display unit that displays an operation screen on a display surface; a touch panel that is disposed on the display unit and detects an operation with a touch; and a control unit that determines and controls the detected operation.
    A thumbnail image display area for displaying a plurality of images and an image enlargement display area for enlarging and displaying an image selected from the images displayed in the thumbnail image display area;
    An operation method, comprising: dragging an image displayed in the thumbnail image display area to the image enlargement display area to enlarge and display the image in the image enlargement display area.
  3. 表示面に操作画面を表示する表示手段と、前記表示手段の上に配置されタッチを伴う操作を検出するタッチパネルと、を備えるコンピュータに、
    複数の画像を表示するサムネイル画像表示領域と、前記サムネイル画像表示領域に表示された画像の中から選択された画像を拡大して表示する画像拡大表示領域と、を前記表示面に表示する表示処理と、
    前記サムネイル画像表示領域に表示された画像を前記画像拡大表示領域までドラッグ操作されることで、該画像を前記画像拡大表示領域に拡大して表示する選択処理と、
    を実行させることを特徴とするプログラム。     A computer comprising: a display unit that displays an operation screen on a display surface; and a touch panel that is disposed on the display unit and detects an operation involving a touch.
    Display processing for displaying on the display surface a thumbnail image display area for displaying a plurality of images and an image enlargement display area for enlarging and displaying an image selected from images displayed in the thumbnail image display area When,
    A selection process for enlarging and displaying the image displayed in the image enlargement display area by dragging the image displayed in the thumbnail image display area to the image enlargement display area;
    A program characterized by having executed.
  4. 前記サムネイル画像表示領域に表示される複数の画像は、それぞれ異なるカメラの画像であって、
    画像が、前記サムネイル画像より大きく表示されている場合には、該画像に対してタッチを伴う操作がされることで該画像を撮像しているカメラに対してパン、チルト、またはズームを制御する信号を送信することを特徴とする請求項１に記載の操作端末。     The plurality of images displayed in the thumbnail image display area are images of different cameras, respectively.
    When an image is displayed larger than the thumbnail image, panning, tilting, or zooming is controlled with respect to the camera that captures the image by performing an operation with touch on the image. The operation terminal according to claim 1, wherein the operation terminal transmits a signal.
  5. 前記サムネイル画像表示領域に表示される複数の画像は、それぞれ異なるカメラの画像であって、
    画像が、前記サムネイル画像より大きく表示されている場合には、該画像に対してタッチを伴う操作がされることで該画像を撮像しているカメラに対してパン、チルト、またはズームを制御する信号を送信することを特徴とする請求項２に記載の操作方法。     The plurality of images displayed in the thumbnail image display area are images of different cameras, respectively.
    When an image is displayed larger than the thumbnail image, panning, tilting, or zooming is controlled with respect to the camera that captures the image by performing an operation with touch on the image. The operation method according to claim 2, wherein a signal is transmitted.
  6. 前記表示処理で前記サムネイル画像表示領域に表示させる複数の画像は、それぞれ異なるカメラの画像であって、
    画像が前記サムネイル画像より大きく表示されている場合には、該画像に対してタッチを伴う操作がされることで該画像を撮像しているカメラに対してパン、チルト、またはズームを制御する信号を送信する処理を実行させることを特徴とする請求項３に記載のプログラム。     The plurality of images displayed in the thumbnail image display area in the display process are images from different cameras,
    When the image is displayed larger than the thumbnail image, a signal that controls pan, tilt, or zoom for the camera that captures the image by performing an operation with touch on the image. The program according to claim 3, wherein a process for transmitting a message is executed.
PCT/JP2012/081142 2012-03-28 2012-11-30 Operation terminal, operation method, and program WO2013145448A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012073755A JP2013207517A (en) 2012-03-28 2012-03-28 Operation terminal, operation method, and program
JP2012-073755 2012-03-28

Publications (1)

Publication Number Publication Date
WO2013145448A1 true WO2013145448A1 (en) 2013-10-03

Family

ID=49258781

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/081142 WO2013145448A1 (en) 2012-03-28 2012-11-30 Operation terminal, operation method, and program

Country Status (2)

Country Link
JP (1) JP2013207517A (en)
WO (1) WO2013145448A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6815555B1 (en) * 2020-09-02 2021-01-20 Kddi株式会社 Image display device and program

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007053568A (en) * 2005-08-18 2007-03-01 Toa Corp Monitor display device and monitoring system using the same
JP2010258878A (en) * 2009-04-27 2010-11-11 Mitsubishi Electric Corp Video monitoring system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007053568A (en) * 2005-08-18 2007-03-01 Toa Corp Monitor display device and monitoring system using the same
JP2010258878A (en) * 2009-04-27 2010-11-11 Mitsubishi Electric Corp Video monitoring system

Also Published As

Publication number Publication date
JP2013207517A (en) 2013-10-07

Similar Documents

Publication Publication Date Title
US10579187B2 (en) Display control apparatus, display control method and display control program
US11550420B2 (en) Quick review of captured image data
US10969953B2 (en) Frameworks, devices and methods configured for enabling touch/gesture controlled display for facility information and content with resolution dependent display and persistent content positioning
US9298987B2 (en) Information processing apparatus, information processing method, program, and information processing system
JP6254945B2 (en) Video display system, operation terminal, operation method and program
JP6362207B2 (en) Video display system, operation terminal, operation method and program
JP6229816B2 (en) Mobile monitoring device, program, and control method
WO2015027790A1 (en) Application association processing method and apparatus
WO2023207145A1 (en) Screenshot capturing method and apparatus, electronic device and computer readable medium
TWI578798B (en) Method of displaying surveillance video and computer program product therefor
JP4713270B2 (en) Web browsing apparatus and web information display method
CN111061381A (en) Screen global input control system and method
JPWO2015040732A1 (en) Video display system and video display method
CN114816047A (en) Method, device, system and storage medium for migrating tasks across equipment
US9548894B2 (en) Proximity based cross-screen experience App framework for use between an industrial automation console server and smart mobile devices
WO2013145448A1 (en) Operation terminal, operation method, and program
WO2016132864A1 (en) Video surveillance system and video surveillance method
JP6484405B2 (en) Application management system
CN110785732A (en) Control operation switching method and device and remote control equipment
WO2024012415A1 (en) Text excerpting method and related device
JP6996758B2 (en) Mobile monitoring devices, control methods, and programs
JP6515975B2 (en) MOBILE MONITORING DEVICE, MOBILE MONITORING SYSTEM, PROGRAM, AND CONTROL METHOD
CN115885245A (en) Application window control method and device, interactive panel and storage medium
WO2014199263A1 (en) Frameworks, devices and methods configured for enabling display of facility information and surveillance data via a map-based user interface
CN111061416A (en) Screen global input control system and method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12872907

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12872907

Country of ref document: EP

Kind code of ref document: A1