JP2022169536A - Camera terminal, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology for improving operability of a mobile device.

SOLUTION: An information processing apparatus (2000) includes a first processing unit (2020), a second processing unit (2040), and a control unit (2060). The first processing unit (2020) generates information indicating an event detection position in accordance with a position on a monitor image set by a first operation. The first operation is an operation on the monitor image displayed on a display screen. The second processing unit (2040) executes display change processing on the monitor image or a window including the monitor image, in response to the first operation. The control unit (2060) causes the first processing unit (2020) or the second processing unit (2040) to process the first operation, based on a second operation.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to a mobile monitoring device, control method, and program.

2. Description of the Related Art There are surveillance systems that perform surveillance using images captured by a surveillance camera or the like (hereinafter referred to as "surveillance images"). For example, surveillance images are viewed by surveillance personnel and analyzed by an analysis device. Such a monitoring system is used to prevent the occurrence of troubles and to solve the troubles at an early stage.

Mobile devices such as smartphones and tablets are beginning to be used in monitoring systems. For example, Japanese Laid-Open Patent Publication No. 2002-100000 discloses a system that opens the video of a surveillance camera to unspecified users. A user can browse the video of the surveillance camera by accessing the server using a mobile device, a personal computer, or the like.

Also, in a monitoring system, there is a technique that can set a part of a monitoring video as a monitoring area. For example, in the image processing apparatus disclosed in Patent Document 2, a monitor area can be set using an input device such as a mouse. Then, this image processing device detects an intruding object in the monitored area.

JP 2014-64241 A Patent No. 4976939 WO2014/030667

In mobile devices such as smartphones and tablets used in monitoring systems, setting of event detection positions (setting of video monitoring lines, setting of monitoring areas, etc.) and processing to change the display on the display screen (display change processing) However, both can be performed by the user's touch operation. The setting of the event detection position is performed by designating the position and range of the image monitoring line and the monitoring area by, for example, sliding a finger on the display screen, pinch-in/pinch-out operation, or the like. Similarly, the display change processing includes the operation of sliding a finger on the display screen, the control of the PTZ (Pan-Tilt-Zoom) function of the remote surveillance camera by pinch-in/pinch-out operations, and the digital zoom (enlargement/reduction) of the display screen. or by scrolling.

Since different processes are executed in response to similar operations in this manner, the mobile devices used in the monitoring system have low operability for users.

The present invention has been made in view of the above problems. An object of the present invention is to provide a technique for improving the operability of mobile devices.

The mobile monitoring device of the present invention comprises first processing means for generating and setting information representing an event detection position for the monitoring image displayed on the display screen in accordance with a first operation for the monitoring image; second processing means for performing display change processing other than setting of the event detection position on the monitoring image or a window including the monitoring image in accordance with a first operation; and a control means for causing either one of the second processing means to process.

A program of the present invention is a program that causes a computer to operate as the mobile monitoring device of the present invention.

The control method of the present invention is executed by a computer. The control method includes a first processing step of generating and setting information representing an event detection position for a monitoring image displayed on a display screen in response to a first operation performed on the monitoring image; a second processing step of performing display change processing other than setting of the event detection position on the monitoring image or a window including the monitoring image, and performing the first operation in the first processing step and the second processing according to and a control step that causes either one of the steps to process.

ADVANTAGE OF THE INVENTION According to this invention, the technique which improves the operability of a mobile device is provided.

The above objectives, as well as other objectives, features and advantages, will become further apparent from the preferred embodiments described below and the accompanying drawings below.

1 is a block diagram illustrating an information processing apparatus according to Embodiment 1; FIG. 4 is a flowchart illustrating the flow of processing executed by the information processing apparatus of Embodiment 1; 2 is a block diagram illustrating the hardware configuration of an information processing device; FIG. FIG. 4 is a diagram illustrating a monitoring image captured by a monitoring camera; FIG. It is a surveillance image showing a map of a surveillance area. FIG. 4 is a diagram illustrating a window containing a surveillance image; FIG. FIG. 4 illustrates a window containing multiple surveillance images; FIG. 10 is a diagram illustrating a first operation; FIG. FIG. 10 is a diagram illustrating how an event detection position is designated by a first operation; It is a figure showing a mode that the image|video monitoring line is superimposed, touching the lower left of the monitoring image. It is a figure which illustrates the attitude|position of an information processing apparatus. 1 is a block diagram illustrating a monitoring system and an information processing device; FIG. 1 is a block diagram illustrating a surveillance system with cloud video storage; FIG. 1 is a block diagram illustrating a surveillance system with intelligent cameras; FIG. FIG. 10 is a first diagram illustrating a monitoring image displayed on a display screen in the embodiment; FIG. 10 is a second diagram illustrating a monitoring image displayed on the display screen in the embodiment;

First, the background of the present invention will be described in order to facilitate understanding of the embodiments of the present invention.
In some cases, images or documents containing images (such as web pages) do not fit within the display screen or window (hereafter referred to as “display screen, etc.”). For example, in general, an image displayed on a display screen or the like in an application that handles a map is only a map of a part of the location. Also, if the resolution of the image is greater than the resolution of the display screen, the image will only partially fit on the display screen or the like unless the size is reduced. Web pages with a large amount of information often do not fit on the display screen. Particularly in mobile devices, since the display screen is small, there are many cases where only a part of the image can be displayed on the display screen or the like.

When the image or document does not fit on the display screen or the like, the user adjusts the range of the image or document displayed on the display screen or the like by performing a predetermined operation. For example, the predetermined operation is a scroll operation, an enlargement operation, a reduction operation, and the like. For example, in the case of a map image, the user scrolls the map image by sliding his/her finger on the touch panel displaying the map image, thereby changing the location displayed on the display screen and browsing the map of the desired location. Further, for example, the user scrolls the document and browses desired sentences. Further, for example, the user adjusts the scale of the map by performing operations such as pinch-in and pinch-out on the map image.

In this way, when surveillance using surveillance video is performed in a situation where images and documents cannot fit on the display screen of a mobile device, for example, a user such as a surveillance officer may not be able to view the surveillance video or document containing the surveillance video as described above. , etc. By doing so, the user adjusts the range of the monitoring image displayed on the display screen, etc., and monitors the desired location.

In addition, the PTZ function of the PTZ (Pan-Tilt-Zoom) camera that acquires the surveillance image can be controlled by sliding your finger on the touch panel of the mobile device that displays the surveillance image, or by pinching in and pinching out. is done. In addition, digital zoom and the like are performed.

On the other hand, when trying to set an event detection position, such as drawing a video monitoring line or setting a monitoring area, by touching a touch panel on a monitoring video, intuitively, the operation is to slide a finger. or pinch-in/pinch-out operation. However, these intuitive operations are similar to operations for adjusting the range of the surveillance image displayed on the display screen, etc., and operations for changing the display, such as operations for controlling the PTZ function, as described above. There is a problem that the meaning of the intuitive operation performed on the is duplicated. For example, if a finger is slid to draw a video monitoring line during a monitoring video, problems such as scrolling of the display screen without drawing the video monitoring line may occur.

As an example of a device that provides an operation for designating an area on a map, there is the invention of Patent Document 3. In this invention, the user designates a range on the map, and the image of the sticker is drawn in this designated range. However, the present invention does not assume a situation in which the map scrolls when the finger is slid on the map, and does not assume the above-described problem of overlapping meanings of operations.

According to the embodiments of the present invention described below, the above problem of overlapping meanings of operations is resolved, and the operability of mobile devices is improved. Monitoring devices that use mobile devices such as smartphones and tablets are called "mobile monitoring devices."

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, in all the drawings, the same constituent elements are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

[Embodiment 1]
FIG. 1 is a block diagram illustrating an information processing device 2000 according to the first embodiment. Also, in FIG. 1, each block does not represent the configuration in units of hardware, but the configuration in units of functions.

The information processing device 2000 has a first processing section 2020 , a second processing section 2040 and a control section 2060 . The first processing unit 2020 generates information representing an event detection position (hereinafter referred to as “event detection position information”) according to the position on the monitoring image designated by the first operation. The first operation is an operation performed by the user on the touch panel 10 of the mobile device that displays monitoring images and the like. This event detection position is used by a monitoring system using the information processing apparatus 2000 to detect an event. Details of events and event detection positions will be described later.

The second processing unit 2040 performs display change processing on the display screen in accordance with the first operation. For example, the display change process is a process of changing the range of the monitoring image displayed on the touch panel 10, the size of the monitoring image, and the like. Specifically, the display change process is, for example, a process of scrolling the monitoring image. Other examples of display change processing will be described later.

The control unit 2060 causes either the first processing unit 2020 or the second processing unit 2040 to process the first operation.

<Process flow>
FIG. 2 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the first embodiment. The control unit 2060 determines whether or not a predetermined condition is satisfied (S104). If the predetermined condition is satisfied, the process of control unit 2060 proceeds to step S106. In step S106, the control unit 2060 causes the first processing unit 2020 to process the first operation.
On the other hand, if the predetermined condition is not satisfied, the processing of control unit 2060 proceeds to step S108. In step S108, the control unit 2060 causes the second processing unit 2040 to process the first operation.

<Action/effect>
For example, as will be described later, an operation of sliding a finger on a monitoring image may be an operation for drawing a line (such as a video monitoring line) representing an event detection position, or may be an operation for scrolling a monitoring image ( In some cases, it is an operation for controlling the pan/tilt function of the PTZ camera that acquires the monitoring image. In addition, the pinch-in/pinch-out operation on the surveillance image may be an operation to set the surveillance area, or an operation for enlarging/reducing the surveillance image (the zoom function of the PTZ camera that acquires the surveillance image). (operation for changing tele/wide), etc.). In this way, the intuitive operation for designating the event detection position and the intuitive operation for changing the display of the monitoring image or the like are often the same.

According to this embodiment, the first operation on the monitoring image or the like is processed by either the first processing unit 2020 or the second processing unit 2040 . When processed by the first processing unit 2020, the first operation means specifying the event detection position. When processed by the second processing unit 2040, the first operation means changing the display of the monitoring image or the like. As described above, according to the present embodiment, the first operation on the monitoring image or the like is processed as an operation for either designating the event detection position or changing the display of the monitoring image or the like according to a predetermined condition. be. Therefore, the user of the information processing apparatus 2000 can specify the event detection position with an intuitive operation similar to the operation for changing the display of the monitoring image or the like. Therefore, the user of the information processing apparatus 2000 can specify the event detection position with an intuitive operation.

The present embodiment will be described in further detail below.

<Hardware configuration example>
Each functional configuration unit of the information processing apparatus 2000 may be implemented by hardware (eg, hardwired electronic circuit, etc.) that implements each functional configuration unit, or may be implemented by a combination of hardware and software (eg, A combination of an electronic circuit and a program for controlling it, etc.).

FIG. 3 is a block diagram illustrating the hardware configuration of the information processing device 2000. As shown in FIG. The information processing device 2000 has a bus 1020 , a processor 1040 , a memory 1060 , a storage 1080 , an input/output interface 1100 and a network interface 1120 . Bus 1020 is a data transmission path for processor 1040, memory 1060, storage 1080, input/output interface 1100, and network interface 1120 to mutually transmit and receive data. However, the method of connecting the processors 1040 and the like to each other is not limited to bus connection. The processor 1040 is an arithmetic processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The memory 1060 is, for example, RAM (Random Access Memory) or ROM (Read Only Memory). The storage 1080 is, for example, a storage device such as a hard disk, SSD (Solid State Drive), or memory card. Also, the storage 1080 may be a memory such as RAM or ROM.

The input/output interface 1100 is an interface for connecting the information processing apparatus 2000 and input/output devices. The input/output device is, for example, the touch panel 10 that displays a monitoring image and receives an operation input for the monitoring image.

The network interface 1120 is an interface for communicably connecting the information processing device 2000 to an external device. The network interface 1120 may be a network interface for connecting with a wired line or a network interface for connecting with a wireless line.

The storage 1080 stores programs for realizing functions of the information processing apparatus 2000 . Specifically, program modules that realize the functions of the first processing unit 2020, the second processing unit 2040, and the control unit 2060 are stored. The processor 1040 implements the functions of the first processing unit 2020, the second processing unit 2040, and the control unit 2060 by executing these program modules. Here, when executing each module, the processor 1040 may execute these modules after reading them onto the memory 1060 , or may execute them without reading them onto the memory 1060 .

The hardware configuration of the information processing device 2000 is not limited to the configuration shown in FIG. For example, each program module may be stored in memory 1060 . In this case, the information processing device 2000 does not have to include the storage 1080 .

The information processing device 2000 is implemented as a computer such as a mobile device (smartphone, tablet, etc.). The touch panel 10 is, for example, a standard touch panel provided in a mobile device on which the information processing device 2000 is mounted.

<About surveillance images>
Surveillance images can be captured at various locations (ports, airports, terminal stations, platforms, power plants, plants, important facilities such as dams, warehouse districts, leisure facilities, sports facilities, stadiums, commercial facilities, buildings, cities, streets, etc.). is an image used for monitoring the Specifically, the monitoring image is an image captured by a monitoring camera provided at a location to be monitored. FIG. 4 is a diagram exemplifying a monitoring image displayed on the touch panel of the mobile device. In FIG. 4, the surveillance camera is imaging the hallway in the building.

It should be noted that the setting of the event detection position does not necessarily have to be performed on the monitoring image. It may be done on the image. FIG. 5 is an image representing a map of a monitored location displayed on the touch panel of the mobile device.

In addition, the map image may not only display a map, but may also have the meaning of a monitoring image that displays in real time tracking information of a person or the like for whom an event has been detected.

When the first operation is performed on a monitoring image, the monitoring image may be one or more frames forming a moving image, or may be an image (photograph) captured as a still image.

The monitoring image may be an image captured in real time or an image captured in the past.

For example, the monitoring image is stored in a storage device inside the information processing device 2000 (storage 1080 in FIG. 3). Further, for example, the monitoring image may be stored in a storage device provided outside the information processing device 2000 . In this case, the information processing device 2000 acquires the monitoring image from this external storage device. Further, for example, the information processing apparatus 2000 may directly acquire a monitoring image captured by a monitoring camera from the monitoring camera.

The touch panel 10 may display a monitoring image alone, or may display a window including a monitoring image. FIG. 6 is a diagram illustrating a window 60 containing the surveillance image 30. As shown in FIG. Also, the window 60 may include the main monitoring image 30 and a plurality of sub-monitoring images 31 at the same time. FIG. 7 is a diagram illustrating a window 60 including multiple surveillance images 30. As shown in FIG.

<About the first operation>
A first operation is, for example, an operation of sliding a finger on the touch panel 10 . This slide operation may be performed with one finger or may be performed with a plurality of fingers.

FIG. 8 is a diagram illustrating the first operation. FIG. 8A shows an operation of sliding one finger on the touch panel 10. FIG. FIG. 8(b) represents a rotation operation. For example, this rotation operation is an operation for rotating an image. FIG. 8(c) represents a pinch-in/pinch-out operation. However, the first operation is not limited to these operations.

<Process Performed by Second Processing Unit 2040>
There are various types of display change processing performed by the second processing unit 2040 . For example, the display change process is a process of changing the display of an image or window in accordance with an operation performed on the image or window in a general mobile device or the like.

For example, the display change process scrolls these monitoring images, etc., in response to an operation of sliding a finger on the touch panel 10 that displays a monitoring image, a map image, or a window containing them (referred to as a "monitoring image, etc."). processing. Further, for example, the display change process is a process of rotating a monitoring image or the like according to an operation of rotating a finger pinching the monitoring image or the like. Further, for example, the display change process is a process of reducing or enlarging the monitoring image or the like in accordance with an operation of pinching in or pinching out the monitoring image or the like. The display change processing is not limited to these examples.

The display change process includes a process of "controlling the PTZ function of the PTZ camera that generates the monitoring image by the user's operation on the monitoring image, and as a result, changing the display of the monitoring image". For example, the display change process is a process in which the surveillance image is scrolled as a result of controlling the pan/tilt function of the PTZ camera that generates the surveillance image according to the operation of sliding a finger on the surveillance image. be. In addition, for example, the display change processing is performed by controlling the zoom function (tele/wide) of the PTZ camera that acquires the monitoring image according to the pinch-in/pinch-out operation of the monitoring image. is reduced or enlarged. In addition, the display change processing includes processing for changing the display of the monitoring image as a result of digital processing such as digital zoom.

<Process Performed by First Processing Unit 2020>
The first processing unit 2020 generates event detection position information. Event detection position information is used, for example, in a monitoring system using the information processing apparatus 2000 . Events are various phenomena targeted for detection in this surveillance system. For example, events include vehicles such as people, animals, cars, and other objects (hereinafter simply referred to as "objects") passing through video monitoring lines, and predetermined events (intrusion, leaving, appearance, disappearance, intrusion, etc.) of objects in the monitoring area. leaving, appearing, disappearing, fighting, staying, loitering, falling, standing up, sitting down, changing direction of movement, running backwards, shoplifting, detouring, damage, taking away, being left behind, graffiti, forming a crowd, etc.), defined by lines For example, movement of an object along a specific route. The event detection position is used, for example, as a position indicating the video monitoring line or monitoring area in the monitoring system.

Note that the video monitoring line is a line superimposed on a monitoring image or the like by a user, and is a line for detecting an object crossing (passing through) the line. Video surveillance lines may have direction attributes (right to left, left to right, both directions, etc.) and are designed to alert only when an object passes in the direction specified by the user. may be A monitoring area is a part of a monitoring image or the like set by a user, and is an area for detecting a predetermined event.

<<Example of operation to specify the event detection position>>
FIG. 9 is a diagram illustrating how an event detection position is designated by the first operation. FIG. 9A shows how the first operation of drawing a line with the finger 40 designates the event detection position 50 represented by the line. FIG. 9(b) shows how an event detection position 50 represented by a rectangular area is designated by the same operation as in FIG. 9(a). When the operations in FIGS. 9A and 9B are processed by the second processing unit 2040, for example, the second processing unit 2040 scrolls the monitoring image and the window containing the monitoring image.

FIG. 9(c) shows how the event detection position 50 represented by a line is designated by a pinch-out operation. FIG. 9(d) shows how an event detection position 50 represented by a rectangular area is designated by the same operation as in FIG. 9(c). When the operations in FIGS. 9C and 9D are processed by the second processing unit 2040, for example, the second processing unit 2040 enlarges the monitoring image and the window containing the monitoring image. A pinch-in operation is the reverse of the pinch-out operation, and the monitoring image and the window containing the monitoring image are reduced.

FIG. 9(e) shows how an event detection position 50 represented by a rectangular area is designated by a rotation operation. When the operation in FIG. 9E is processed by the second processing unit 2040, for example, the second processing unit 2040 rotates the monitoring image and the window including the monitoring image.

FIG. 9F shows how an event detection position 50 represented by a rectangular area is designated by a touch operation. When the operation of FIG. 9F is processed by the second processing unit 2040, for example, the second processing unit 2040 performs a selection operation on a monitoring image or a window containing the monitoring image.

However, the first operation is not limited to each operation shown in FIG. Also, the event detection position 50 designated by each first operation is not limited to the example in FIG. For example, the event detection position 50 designated by the operation of drawing a line as shown in FIG. 9A may be a rectangular area or the like in which the line is given a predetermined width. Also, the event detection position 50 designated by the operation of drawing an area in FIG. 9B or the like is not limited to a rectangle. For example, in FIG. 9B, the event detection position 50 may be a circle whose diameter is the trajectory of the finger. Also, the event detection position 50 specified by the touch operation in FIG. 9F may be a point or an area of a shape other than a rectangle (such as a circle).

How the event detection position is set for each operation may be defined in advance in the information processing device 2000 implemented in the mobile device. For example, the first operation of drawing a line with the finger 40 will result in either setting shown in FIG. 9(a) or FIG. 9(b), or the pinch-out operation will cause the It may be defined in advance which setting is to be shown.

<<Details of event detection position information>>
The event detection position information of the event detection position represented by a line or area indicates a combination of coordinates representing the event detection position. There are various known methods for expressing lines or regions by combining coordinates. The first processing unit 2020 uses these known methods to represent an event detection position represented by a line or area by a combination of coordinates. A description of these known methods is omitted.

The coordinates representing the event detection position are coordinates (camera coordinates) on the monitoring image, for example. Further, for example, the coordinates may be coordinates on the real space corresponding to the coordinates on the monitoring image. For example, the real space coordinates are GPS (Global Positioning System) coordinates. Further, for example, the coordinates on the real space may be coordinates defined on a floor map within the facility. The coordinates on the real space corresponding to the coordinates on the surveillance image and the coordinates on the surveillance image are the various parameters related to the camera that captured the surveillance image (the position of the camera in the real space, the attitude of the camera, the angle of view, etc.). In addition, it includes internal parameters, etc., hereinafter referred to as "camera parameters").

When the event detection position is set on the monitoring image, and when the event detection position is represented by the coordinates in the real space, the first processing unit 2020 stores the camera parameters in a storage device or the like inside or outside the information processing device 2000 . Get from After that, the first processing unit 2020 calculates the coordinates on the real space corresponding to the coordinates on the monitoring image. Various known methods can be used to convert coordinates on the image into coordinates on the real space using the camera parameters. A description of these known methods is omitted. When event detection positions are set on a map or floor map as shown in FIG. 5, the first processing unit 2020 may directly acquire GPS coordinates or floor map coordinates.

Note that when a plurality of surveillance cameras acquire surveillance images, the GPS coordinates and floor map coordinates can be common coordinates of the camera coordinates of the plurality of surveillance cameras.

For example, the first processing unit 2020 stores the event detection position information in a storage device inside or outside the information processing device 2000 . Further, for example, the first processing unit 2020 may transmit event detection location information to a monitoring system or the like that uses event detection location information.

<Details of Control Unit 2060>
As described above, the control unit 2060 causes either the first processing unit 2020 or the second processing unit 2040 to process the first operation. Hereinafter, the state of the information processing apparatus 2000 when the control unit 2060 causes the first processing unit 2020 to process the first operation is also referred to as "event position setting mode". The state of the information processing apparatus 2000 when the control unit 2060 causes the second processing unit 2040 to process the first operation is also referred to as "display change mode". In addition, the state of the information processing apparatus 2000 when performing the display change process involving the control of the PTZ camera described above is described not only as the "display change mode" but also as the "PTZ camera control mode."

There are various methods for the control unit 2060 to determine which of the first processing unit 2020 and the second processing unit 2040 to process the first operation, that is, the method for switching between the display change mode and the event detection position setting mode. For example, the control unit 2060 determines which of the first processing unit 2020 and the second processing unit 2040 should process the first operation based on the second operation performed by the user. Specific contents of the second operation will be described later. Further, for example, the control unit 2060 determines which of the first processing unit 2020 and the second processing unit 2040 is to process the first operation based on the posture of the information processing device 2000 .

<<Example 1 of mode switching based on the second operation>>
Based on the second operation performed by the user, the control unit 2060 temporarily causes either one of the first processing unit 2020 and the second processing unit 2040 to process the first operation, which is different from the normal time. good too. That is, the control unit 2060 temporarily switches from the display change mode to the event detection position setting mode based on the second operation performed by the user. Alternatively, the control unit 2060 temporarily switches from the event detection position setting mode to the display change mode based on the second operation performed by the user.

In this case, for example, the second operation may be an operation of pressing the start position of the first operation for a predetermined time or longer. For example, assume that the first operation is an operation of sliding a finger on the monitoring image. In this case, for example, the user keeps pressing (long-pressing) a location on the monitoring image for a predetermined time or longer, and then starts sliding the finger while pressing the location. At this time, the display change mode is temporarily switched to the event detection position setting mode based on the second operation, which is "an operation of pressing and holding (long-pressing) a portion of the monitoring image for a predetermined time or longer". Therefore, the control unit 2060 causes the first processing unit 2020 to process subsequent finger sliding operations. As a result, for example, a video monitoring line is superimposed on the monitoring image along the trajectory of sliding the finger.

Alternatively, for example, when a pinch-out operation is started after a portion of the monitoring image is long-pressed with two fingers, the control unit 2060 causes the first processing unit 2020 to process the pinch-out operation. As a result, a monitoring area is set on the monitoring image according to the range in which the pinch-out operation is performed, for example.

The control unit 2060 allows the first processing unit 2020 to perform the first operation while a second operation, which is started before the first operation and continues during the operation of the first operation, is accepted. , and causes the second processing unit 2040 to process the first operation performed while the second operation is not accepted. For example, when an operation of sliding a finger is performed while the bottom left of the touch panel 10 (or the bottom left of the monitoring image displayed on the touch panel 10) is being touched, the control unit 2060 temporarily shifts the operation to the first position. Let the processing unit 2020 process. That is, the lower left corner of the touch panel 10 is touched, and while the touch is continued, the event detection position setting mode is entered, and the operation of sliding the finger becomes the operation of specifying the event detection position. On the other hand, when a finger slide operation is performed while the lower left corner of the touch panel 10 is not touched (normal state), the control unit 2060 causes the second processing unit 2040 to process the operation. In other words, the normal mode is the display change mode, and the operation of sliding the finger is an operation for performing display change processing such as scrolling of the monitoring image. If the lower left corner of the screen is touched in the normal state (display change mode) and a finger slide operation is performed while the touch continues, the event detection position setting mode is temporarily activated, and the trajectory of the finger slide. A video monitoring line is superimposed on the monitoring image along the . FIG. 10 is a diagram showing how the image monitoring line (event detection position 50) is superimposed while touching the lower left corner of the monitoring image.

Alternatively, for example, when a pinch-out operation is performed on the monitoring image while the lower left corner of the touch panel 10 is being touched, the control unit 2060 causes the first processing unit 2020 to process the pinch-out operation. As a result, a monitoring area is set on the monitoring image according to the range in which the pinch-out operation is performed, for example.

<<Example 2 of mode switching based on the second operation>>
The control unit 2060 may switch between the display change mode and the event detection position setting mode based on the second operation performed by the user using various patterns other than those described above. For example, the "switching by long press" described above may not be a temporary switch, but may switch between the display change mode and the event detection position setting mode each time the long press is made.

As another switching pattern, for example, the control unit 2060 causes the second processing unit 2040 to process the first operation (display change mode) before accepting the second operation, and switches to the first operation after accepting the second operation. The operation may be processed by the first processing unit 2020 (event detection position setting mode). From the user's point of view, the event detection position is designated after performing the second operation so as not to change the display of the monitoring image or the like. For example, after performing the second operation so that the monitoring image is not scrolled (after stopping the scrolling of the monitoring image), the user performs an operation of drawing a line designating the event detection position.

For example, the second operation may be an operation of touching a monitoring image, a map image, or a window containing them for a predetermined time or longer. This second operation may be accepted at an arbitrary location on an image such as a monitoring image, or may be accepted only at a predetermined location such as a monitoring image. The predetermined locations are, for example, the four corners of the monitoring image or the like.

Further, for example, the second operation may be an operation of touching the touch panel 10 for a predetermined time or longer. This second operation may be accepted at an arbitrary location on touch panel 10 or may be accepted only at a predetermined location on touch panel 10 . The predetermined locations are, for example, the four corners of the touch panel 10 . It should be noted that the "operation of touching the touch panel 10" differs from the "operation of touching a monitoring image, a map image, or a window containing them", and is a touch operation on a location where the monitoring image, map image, or a window containing them is not displayed. Also includes

Further, for example, the second operation may be an operation of touching the monitoring image or the like or a plurality of locations on the touch panel 10 simultaneously or in a predetermined order. For example, the second operation is a touch operation or the like on the four corners of the display screen in the order of upper left, upper right, lower right, and lower left. Note that the plurality of locations may be arbitrary locations or predetermined locations.

Further, for example, the second operation may be input of a predetermined voice. In this case, the information processing apparatus 2000 acquires a sound input from a microphone or the like, and determines whether or not the sound is a predetermined sound. After the predetermined voice is input (after the second operation is performed), the control unit 2060 causes the first processing unit 2020 to process the first operation. Various known voice analysis techniques can be used as a method for determining whether or not the voice input by the user is the predetermined voice. A description of these known techniques is omitted.

Further, for example, the second operation may be an operation on a hardware button (volume change button or power button) of the mobile device. For example, this operation is a long press of a hardware button, an operation of pressing a plurality of hardware buttons in a predetermined order, or the like. Note that this hardware button may be not only a general hardware button such as a volume change button, but also a dedicated hardware button provided for the second operation.

It should be noted that the control unit 2060, when a predetermined condition is satisfied after entering the “state in which the first processing unit 2020 processes the first operation” due to the performance of the second operation, the control unit 2060 performs “the first operation. The second processing unit 2040 may be made to process." For example, this predetermined condition is a condition that "the second operation is performed again". Here, a second operation for shifting the control unit 2060 to "a state in which the first processing unit 2020 processes the first operation" and a state in which the control unit 2060 is changed to "a state for causing the second processing unit 2040 to process the first operation" The second operation to be transferred may be the same operation or may be a different operation. Further, for example, when a predetermined period of time has elapsed after entering the state of causing the first processing unit 2020 to process the first operation, the control unit 2060 causes the second processing unit 2040 to process the first operation. state”. Further, for example, if a state in which the first operation is not detected continues for a predetermined time or longer after entering "a state in which the first operation is processed by the first processing unit 2020", the control unit 2060 determines that "the first operation is not performed." state to be processed by the second processing unit 2040”.

Contrary to the above description, the control unit 2060 may be configured such that "before accepting the second operation, the first operation is processed by the first processing unit 2020, and after accepting the second operation, the first operation is processed." The second processing unit 2040 may perform the control.

<<Example of Mode Switching Based on Posture of Information Processing Device 2000>>
For example, when the orientation of the information processing device 2000 is the predetermined first orientation, the control unit 2060 causes the first processing unit 2020 to process the first operation as the event detection position setting mode. When the information processing apparatus 2000 is in a second orientation different from the first orientation (for example, all orientations other than the first orientation), the second processing unit 2040 may be caused to process the first operation as the display change mode.

Since it is easy to change the posture of the mobile device, the user can easily switch between the operation of setting the event detection position and the processing of changing the display of the monitoring image or the like.

In general, a mobile device has a shape (substantially rectangular, etc.) with different lengths and widths in plan view. Therefore, for example, the information processing apparatus 2000 treats an orientation in which the long sides of the information processing apparatus 2000 are oriented horizontally (an orientation in which the information processing apparatus 2000 is horizontally long) as the first orientation, and the long sides of the information processing apparatus 2000 are oriented vertically. The posture (the posture in which the information processing apparatus 2000 becomes vertically long) is treated as the second posture. In other words, in this case, when the user wants to scroll the monitoring image, the user performs the operation while holding the information processing device 2000 so that the information processing device 2000 is vertically long. On the other hand, when the user wants to set the event detection position, the user performs an operation while holding the information processing device 2000 so that the information processing device 2000 is horizontally long. 11A and 11B are diagrams illustrating postures of the information processing apparatus 2000. FIG. FIG. 11A illustrates an orientation in which the long sides of the information processing device 2000 are oriented vertically, and FIG. 11B exemplifies an orientation in which the short sides of the information processing device 2000 are oriented vertically.

<Regarding various predetermined values>
Various predetermined values (predetermined operation, predetermined width, predetermined time, etc.) in each of the above descriptions are set in advance in, for example, the functional configuration unit that uses the values. Also, for example, these predetermined values are stored in a storage device provided inside or outside the information processing apparatus 2000 . In this case, each functional component acquires a predetermined value to be used from this storage device.

<Example of Usage of Information Processing Device 2000>
For example, monitoring by a mobile device in which the information processing apparatus 2000 is installed is used for monitoring work in places where monitoring is not normally required, but where monitoring is temporarily required. For example, even in a place that is usually peaceful and does not require surveillance, there are cases where surveillance is required only during the period when some kind of event (such as a fireworks display) is held. In such a case, the position to be monitored may differ depending on the type of event being held, and the position to be monitored may change in real time. Therefore, rather than constantly operating a large-scale monitoring system with fixed event detection positions, a simple and temporary monitoring system that can set and change event detection positions using a simple method using the touch panel of a mobile device. is sometimes preferable. According to the information processing apparatus 2000, the event detection position can be easily set by a touch operation or the like. Therefore, the information processing apparatus 2000 is suitable for such cases.

The method of using monitoring by a mobile device in which the information processing apparatus 2000 is installed is not limited to the method of using it for temporary monitoring work as described above. For example, a mobile monitoring system in which the information processing device 2000 is implemented may be used for setting an event detection position or the like as a monitoring system that is always operated. For example, an observer may temporarily leave his post for some reason. In that case, the observer uses the information processing device 2000 to set his station as the event detection position. By doing so, it is possible to prevent an event that occurred when leaving one's place from being overlooked. In addition, monitoring by a mobile device is highly convenient when a manager who runs a store wants to monitor the state of the store at night.

[Example]
A monitoring system 3000 using the information processing device 2000 will be exemplified below. FIG. 12 is a block diagram illustrating the monitoring system 3000 and the information processing device 2000. As shown in FIG. Note that the monitoring system using the information processing device 2000 is not limited to the monitoring system described below.

Surveillance system 3000 includes surveillance camera 3020 , storage device 3040 , event detection device 3060 , surveillance monitor 3080 and alarm device 3100 . Storage device 3040 stores monitoring images captured by monitoring camera 3020 . The storage device 3040 also stores event detection position information generated by the first processing unit 2020 . Note that the monitoring camera 3020 is a camera that captures images. Therefore, storage device 3040 stores the frames that form the video imaged by surveillance camera 3020 .

Storage device 3040 and event detection device 3060 may be implemented, for example, as a cloud-type video storage device. FIG. 13 is a block diagram illustrating a surveillance system 3000 having a cloud video store 4000. As shown in FIG. The cloud-type video storage device 4000 receives information indicating the event detection position from the information processing device 2000 via the network, and stores the information in the storage device 3040 . The cloud-type video storage device 4000 also stores monitoring images captured by the monitoring camera 3020 in the storage device 3040 . Then, the event detection device 3060 of the cloud type video storage device 4000 uses the event detection positions stored in the storage device 3040 to detect events in the monitoring images stored in the storage device 3040 . Then, the cloud-type video storage device 4000 notifies the monitoring monitor 3080 and the alarm device 3100 of the result of event detection via the network.

Each network that connects the cloud type video storage device 4000 to the information processing device 2000, the monitoring monitor 3080, and the alarm device 3100 may be a WAN (Wide Area Network) such as the Internet, or a LAN (Local Area Network). There may be.

Cloud type video storage device 4000 and monitoring camera 3020 may be connected via a network, or may be directly connected via a bus or the like. This network can also be either a WAN or a LAN.

Surveillance camera 3020 may also be implemented as an intelligent camera that includes storage device 3040 and event detection device 3060 therein. FIG. 14 is a block diagram illustrating a surveillance system 3000 having an intelligent camera 5000. As shown in FIG. The imaging unit 5020 is a functional configuration unit that implements the functions of the monitoring camera 3020 described above. The intelligent camera 5000 is connected to the information processing device 2000, the monitoring monitor 3080, and the alarm device 3100 via a network in the same manner as the cloud type video storage device 4000. FIG. Any of these networks can be a WAN or a LAN.

In this embodiment, the information processing device 2000 is a tablet terminal. The information processing device 2000 displays the monitoring image acquired from the storage device 3040 on the touch panel 10 . A user operates the touch panel 10 of the information processing apparatus 2000 using a finger, a touch pen, or the like. Note that in this embodiment, the control unit 2060 causes the first processing unit 2020 to process the first operation when the first operation is performed after the start position of the first operation is held down for one second. That is, in this case, the first operation is an operation of designating the event detection position. Note that the long press time is not limited to 1 second, and may be 1.5 seconds, 2 seconds, or any number of seconds.

15 and 16 are diagrams illustrating monitoring images 30 displayed on the touch panel 10 in the example. In the monitoring image 30 of FIG. 15(a), one door 70-1 is shown on the left side. It is assumed that the user intends to designate the door 70-2, which is not shown in the monitoring image 30 of FIG. 15(a) and which is one before the door 70-1, as the event detection position.

First, as shown in FIG. 15A , the user performs an operation of sliding the finger 40 on the monitoring image 30 to scroll the monitoring image 30 . As a result, the door 70-2 is displayed on the monitoring image 30 as shown in FIG. 15(b).

Next, the user performs an operation of drawing a video monitoring line on the monitoring image 30, as shown in FIG. 16(a). At this time, the user slides the finger 40 after continuing to press the start point 80 for one second or more. Then, as shown in FIG. 16B, the event detection position 50 is set with respect to the door 70-2. Event detection position information indicating this event detection position 50 is stored in the storage device 3040 .

The event detection device 3060 acquires event detection position information stored in the storage device 3040 . Then, the event detection device 3060 detects that a predetermined event (passage of the video monitoring line) has occurred at the event detection position. In the case of this embodiment, for example, the event detection device 3060 detects the entry and exit of people through the doors 70-1 and 70-2.

For example, the event detection device 3060 is a computer that performs image analysis. In this case, the event detection device 3060 acquires the monitoring image from the storage device 3040 and analyzes this monitoring image. For example, the event detection device 3060 acquires a plurality of surveillance images captured by the same surveillance camera 3020, and analyzes the positions corresponding to the event detection positions in the surveillance images. Then, event detection device 3060 detects that a predetermined event has occurred when a change representing a predetermined event is detected at that position. In the case of this embodiment, the event detection device 3060 detects the entry and exit of a person through the door 70-2 by analyzing the vicinity of the door 70-2. Here, an existing technique can be used as a technique for analyzing the inside of an image and detecting that a predetermined event has occurred.

Also, for example, the event detection device 3060 is a sensor such as an infrared sensor. For example, this sensor detects an event such as the passage of an object. For example, this sensor is installed at each location to be monitored. When the information processing apparatus 2000 generates the event detection position information, the sensors at or near the event detection position indicated by the event detection position information start monitoring. For example, in the case of this embodiment, an infrared sensor is provided near each door 70 or the like. Then, when the event detection position 50 shown in FIG. 16(b) is specified, the sensor near the door 70-2 starts monitoring.

When the event detection device 3060 detects an event, the information processing device 2000 (tablet terminal), the monitoring monitor 3080 and the alarm device 3100 are notified of the event. The surveillance monitor 3080 is, for example, a monitor provided in a guard room or the like. For example, the surveillance monitor 3080 notifies the surveillance staff of the occurrence of the event by highlighting the surveillance image showing the position where the event was detected. Therefore, the observer can easily grasp the place where the event occurred.

The alarm device 3100 notifies the observer of the occurrence of an event by, for example, sounding an alarm. This alarm allows the observer to know that an event has occurred.

Also, the surveillance monitor 3080 may acquire the event detection position information from the storage device 3040 and display the event detection position on the surveillance video. As a result, for example, a monitoring staff can perform monitoring work so as to focus on the event detection position. In addition, the observer can entrust the detection of the event occurrence at the event detection position to the event detection device 3060, and perform the monitoring work so as to pay attention to a place other than the event detection position.

Although the embodiments of the present invention have been described above with reference to the drawings, these are examples of the present invention, and various configurations other than those described above can also be adopted.

Examples of reference forms are added below.
1. a first processing means for setting an event detection position on a monitoring image displayed on a display screen in response to a first operation on the monitoring image;
second processing means for performing display change processing other than setting of the event detection position for the monitoring image or a window including the monitoring image in accordance with the first operation;
a control means for causing either one of the first processing means and the second processing means to process the first operation based on the second operation;
mobile surveillance device.
2. The control means causes the second processing means to process according to the first operation before the second operation is performed, and causes the second processing means to process according to the first operation after the second operation is performed. 1. Let the processing means process. A mobile surveillance device as described in .
3. 2. The second operation is a touch operation for a predetermined time or longer on any part of the display screen or the monitoring image. A mobile surveillance device as described in .
4. 2. The second operation is an operation of touching the start position of the first operation for a predetermined time or longer. A mobile surveillance device as described in .
5. the second operation is a touch operation on an arbitrary location on the display screen, which is started before the first operation and continues during the operation of the first operation;
The control means causes the first processing means to process according to the first operation while the second operation is being performed, and causes the second processing means to process according to the first operation when the second operation is no longer performed. Let the processing means process1. A mobile surveillance device as described in .
6. a first processing means for setting an event detection position on a monitoring image displayed on a display screen in response to a first operation on the monitoring image;
second processing means for performing display change processing other than setting of the event detection position for the monitoring image or a window including the monitoring image in accordance with the first operation;
a control means for causing either one of the first processing means and the second processing means to process the first operation;
The control means causes the first processing means to process the first operation when the posture of the mobile monitoring device is the first posture, and the posture of the mobile monitoring device is different from the first posture. A mobile monitoring device that causes the second processing means to process the first operation when in the second posture.
7. The event detection position represents the position of a video monitoring line for detecting a passing object or the position of a monitoring area for detecting a predetermined event of an object.1. to 6. A mobile surveillance device according to any one of the preceding claims.
8. a computer; to 7. A program for operating as the mobile monitoring device according to any one of the above.
9. A computer-implemented control method comprising:
a first processing step of setting an event detection position on the monitoring image in response to a first operation on the monitoring image displayed on the display screen;
a second processing step of performing display change processing other than setting of the event detection position for the monitoring image or a window including the monitoring image in accordance with the first operation;
a control step of causing either one of the first processing step and the second processing step to process the first operation based on the second operation;
A control method with
10. The control step causes the second processing step to perform processing according to the first operation before the second operation is performed, and causes the second processing step to perform processing according to the first operation after the second operation is performed. 9. Process in one processing step. The control method described in .
11. 10. The second operation is a touch operation on an arbitrary part of the display screen or the monitoring image for a predetermined time or longer. The control method described in .
12. 10. The second operation is an operation of touching the start position of the first operation for a predetermined time or longer. The control method described in .
13. the second operation is a touch operation on an arbitrary location on the display screen, which is started before the first operation and continues during the operation of the first operation;
The control step causes the first processing step to process according to the first operation while the second operation is being performed, and causes the second processing step to be processed according to the first operation when the second operation is no longer performed. 9. Let the processing step process. The control method described in .
14. A control method implemented by a computer, comprising:
a first processing step of setting an event detection position on the monitoring image in response to a first operation on the monitoring image displayed on the display screen;
a second processing step of performing display change processing other than setting of the event detection position for the monitoring image or a window including the monitoring image in accordance with the first operation;
a control step causing either one of the first processing step and the second processing step to process the first operation;
The control step causes the first processing step to process the first operation when the posture of the computer is the first posture, and the posture of the computer is the second posture different from the first posture. , the control method causes the first operation to be processed in the second processing step.
15. 9. The event detection position represents the position of a video surveillance line for detecting a passing object or the position of a surveillance area for detecting a given event of an object. to 14. A control method according to any one of the preceding claims.

The present invention relates to a camera terminal, an information processing method , and a program.

In the camera terminal of the present invention, when a predetermined touch operation is performed on a touch panel display that displays at least part of a surveillance image, an event to be detected in the surveillance image in response to a slide operation on the touch panel display. is detected, and when the predetermined touch operation is not performed on the touch panel display, the area displayed on the touch panel display is changed among the areas showing the surveillance image in accordance with the slide operation. It can communicate with an information processing device.
The camera terminal is
an imaging unit that captures the surveillance video;
a transmission unit configured to transmit the surveillance video to the information processing device;
a receiving unit for receiving information on the area;
a detection unit that detects an event to be detected in the surveillance image based on the received information of the area.

According to the program of the present invention, when a predetermined touch operation is performed on a touch panel display that displays at least part of a surveillance image, an event to be detected in the surveillance image is detected in response to a slide operation on the touch panel display. Information for setting an area to be detected and for changing an area to be displayed on the touch panel display among the areas showing the surveillance video according to a slide operation when the predetermined touch operation is not performed on the touch panel display. on a computer communicable with the processing unit ;
a process of capturing the surveillance video;
a process of transmitting the surveillance video to the information processing device;
a process of receiving information of said area;
A program for executing a process of detecting an event to be detected in the surveillance image based on the received information of the area .

In the control method of the present invention, when a predetermined touch operation is performed on a touch panel display that displays at least part of a surveillance image, an event to be detected in the surveillance image in response to a slide operation on the touch panel display. is detected, and when the predetermined touch operation is not performed on the touch panel display, the area displayed on the touch panel display is changed among the areas showing the surveillance image in accordance with the slide operation. A computer that can communicate with the information processing device executes .
In the control method , the computer
capturing the surveillance video;
transmitting the surveillance video to the information processing device;
receiving information of said area;
Based on the received information of the area, an event to be detected is detected in the surveillance image.

Claims (12)

displaying at least a portion of the surveillance video on a touch panel display;
setting an area for detecting an event to be detected in the surveillance image in response to a slide operation on the touch panel display when a predetermined touch operation is performed on the touch panel display;
A control method, wherein, when the predetermined touch operation is not performed on the touch panel display, an area to be displayed on the touch panel display out of areas showing the surveillance image is changed in accordance with a slide operation. In the control method according to claim 1,
The control method, wherein both the areas displayed before and after the changing process are included in the surveillance image. In the control method according to claim 2,
A control method, wherein the event is detected by analyzing the surveillance video. In the control method according to claim 3,
the event is an object event,
the object is a person, an animal, or a vehicle;
The control method, wherein the event is passage of the object through a video surveillance line, a predetermined event of the object in a surveillance area targeted by the surveillance video, or movement of the object along a specific route defined by a line. In the control method according to claim 3 or 4,
A control method, wherein when the event is detected, notification processing is performed to an information processing device. to the computer,
a function of displaying at least part of the surveillance video on a touch panel display;
A function of setting an area for detecting an event to be detected in the surveillance image in response to a slide operation on the touch panel display when a predetermined touch operation is performed on the touch panel display;
A program for providing a function of changing an area to be displayed on the touch panel display out of areas showing the surveillance image in accordance with a slide operation when the predetermined touch operation is not performed on the touch panel display. In the program according to claim 6,
The program, wherein both the areas displayed before and after the changing process are included in the surveillance image. In the program according to claim 7,
A program for detecting the event by analyzing the surveillance video. In the program according to claim 8,
the event is an object event,
the object is a person, an animal, or a vehicle;
The program according to claim 1, wherein the event is passage of the object through a video surveillance line, a predetermined event of the object in a surveillance area targeted by the surveillance video, or movement of the object along a specific route defined by a line. In the program according to claim 8 or 9,
A program that causes the computer to perform notification processing to an information processing device when the event is detected. displaying at least a portion of the surveillance video on a touch panel display;
setting an area for detecting an event to be detected in the surveillance image in response to a slide operation on the touch panel display when a predetermined touch operation is performed on the touch panel display;
A system for changing an area to be displayed on the touch panel display out of areas showing the surveillance video according to a slide operation when the predetermined touch operation is not performed on the touch panel display. 12. The system of claim 11, wherein
The system, wherein both the areas displayed before and after the changing process are included in the surveillance image.

Images