JP2019068389A - Information processing unit, control method and program of information processing unit - Google Patents

Abstract

To provide a technique for easily understanding how the imaging range in an imaging apparatus changes.SOLUTION: An information processing unit includes an acquisition part for acquiring multiple setting data from an imaging apparatus capable of changing the imaging range on the basis of the multiple setting data specifying multiple imaging ranges, and a display control section for controlling a display section to display, based on the multiple setting data, the information about the multiple imaging ranges, including a reference imaging range and an imaging range determined based on the reference imaging range, and related to some imaging range in the multiple imaging ranges corresponding to the multiple setting data, on an image indicating the region indicating the imaging range that can be imaged by the imaging apparatus.SELECTED DRAWING: Figure 11

Description

  The present invention relates to an information processing apparatus, a control method and program for the information processing apparatus, and more particularly to a monitoring technique using a network camera.

  In recent years, network cameras have come to be used for a wide variety of applications such as web casting and video conferencing as well as surveillance applications. As these network cameras, cameras which can freely adjust pan / tilt / zoom (hereinafter referred to as “PTZ” as needed) are widely used in addition to fixed cameras.

  Furthermore, in order to make it possible to form a surveillance camera system more easily, a preset patrol function that holds a plurality of preset PTZs of the camera, or a preset patrol or auto patrol, which operates to display a plurality of presets in order A feature called a guard tour has also been realized.

  Patent Document 1 discloses, as an example of a camera having a preset function, a camera having a function of drawing a PT position preset in a visible range of a surveillance camera.

Japanese Patent Application Laid-Open No. 08-279951

  A person in charge of surveillance of a surveillance camera system carries out surveillance work by viewing a captured image with a camera using a viewer. However, when the surveillance camera system travels according to the positions of a plurality of imaging ranges preset by the camera, the captured image displayed on the viewer changes every moment. Therefore, the monitoring staff moves the plurality of preset imaging ranges (changes) simply by visually observing the displayed captured image or drawing the PT position preset as in Patent Document 1 There is a problem that it is difficult to grasp what is going on (moving situation).

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a technique for easily grasping how an imaging range in an imaging device changes.

An information processing apparatus according to the present invention which achieves the above object is:
Acquisition means for acquiring the plurality of setting data from an imaging device capable of changing the imaging range based on a plurality of setting data for specifying a plurality of imaging ranges;
Information regarding a plurality of imaging ranges including a reference imaging range serving as a reference based on the plurality of setting data and an imaging range determined based on the reference imaging range, corresponding to the plurality of setting data A display control unit configured to display, on an image indicating an area indicating an imaging range that can be imaged by the imaging device, information relating to a part of the imaging ranges of the plurality of imaging ranges;
And the like.

  According to the present invention, it is possible to easily grasp how the imaging range in the imaging device changes.

BRIEF DESCRIPTION OF THE DRAWINGS The figure which shows an example of schematic structure of the information processing system which concerns on one Embodiment of this invention. FIG. 1 is a block diagram showing an example of an internal configuration of an imaging device according to an embodiment of the present invention. FIG. 2 is a block diagram showing an example of an internal configuration of an information processing apparatus according to an embodiment of the present invention. FIG. 6 is a view showing an example of various processing units of the imaging apparatus, various data, and the like according to the embodiment of the present invention. FIG. 6 is a view showing an example of various processing units of the information processing apparatus, various data, and the like according to the embodiment of the present invention. The flowchart which showed the flow of the processing which used the setting part concerning one embodiment of the present invention. The figure showing an example of setting data 480 created for a preset circulation part concerning one embodiment of the present invention. The flowchart which showed the flow of the processing which used the preset circulation part concerning one embodiment of the present invention. The figure which shows an example of the preset circulation data which the preset circulation part which concerns on one Embodiment of this invention produces. The figure showing the installation environment of the camera which constitutes the information processing system concerning one embodiment of the present invention. The figure which showed an example of the viewer dialog which the viewer part which concerns on one Embodiment of this invention displays. The flowchart which showed the flow of processing of the viewer part concerning one embodiment of the present invention.

  Hereinafter, embodiments will be described with reference to the drawings. In addition, the structure shown in the following embodiment is only an example, and this invention is not limited to the illustrated structure.

(Embodiment 1)
<Overview>
In the present embodiment, a plurality of setting data are acquired from an imaging apparatus capable of changing (traveling) the imaging range based on a plurality of setting data for specifying a plurality of imaging ranges (preset positions), and the plurality of settings Information related to a plurality of imaging ranges including a reference imaging range serving as a reference and an imaging range determined based on the reference imaging based on the data, and among the plurality of imaging ranges corresponding to the plurality of setting data Information related to a part of the imaging range (for example, a plurality of imaging positions (preset positions) including the current imaging position, a movement order between the plurality of imaging positions (preset circulation order), movement trajectories based on the movement order) An example in which at least any one of the above is displayed on the display unit on an image (for example, a panoramic image) indicating an area indicating an imaging range that can be imaged by the imaging device will be described.

  Here, the preset circulation is a function of sequentially imaging a plurality of imaging positions (preset positions) preset by the user, for example, while automatically changing the imaging positions with the passage of time. In the following description, “imaging position” refers to an imaging range imaged by a camera.

<System configuration>
FIG. 1 is a diagram showing an example of a schematic configuration of an information processing system according to an embodiment of the present invention. As shown in FIG. 1, the information processing system 100 includes an imaging device 110, an information processing device 120, and a network 130.

  The imaging device 110 functions as a camera server that distributes captured image data via the network 130. The information processing device 120 accesses the imaging device 110 to change the setting of the camera, and processes image data obtained as a result of imaging with the camera. Alternatively, it functions as a viewer client that processes stored image data and the like and displays an image based on the processed image data.

  Although one information processing apparatus 120 is shown as a client in the information processing system 100 shown in FIG. 1, in addition to the information processing apparatus 120, the imaging apparatus 110 is accessed to receive and store image data. It may further comprise other clients.

  The network 130 communicably connects the imaging device 110 and the information processing device 120, and includes, for example, a plurality of routers, switches, cables, and the like that satisfy a communication standard such as Ethernet (registered trademark). . In the present embodiment, as long as communication between the imaging device 110 and the information processing device 120 can be performed without any problem, the network 130 may have any communication standard, scale, or configuration. Therefore, the network 130 can be widely applied from the Internet to a LAN (Local Area Network).

<Hardware configuration>
FIG. 2 is a block diagram showing an example of the internal configuration of the imaging device 110 shown in FIG. The imaging device 110 has an internal bus 201 configured therein. The imaging device 110 is configured to include a CPU 200, a primary storage device 210, a secondary storage device 220, and various interfaces 230 to 260, which are connected to the internal bus 201. Specifically, in the imaging apparatus 110, an image capture I / F 230, a panhead control I / F 240, an input / output I / F 250, and a network I / F 260 are configured as various I / Fs. Furthermore, the imaging device 110 includes a camera 231 connected to the image capture I / F 230, a camera platform 241 connected to the camera platform control I / F 240, and an input / output device (I / F) connected to the input / output I / F 250. O device) 251 is configured.

  The CPU 200 centrally controls the operation of the imaging device. The primary storage device 210 is, for example, a writable high-speed storage device represented by a RAM. For example, an operating system (OS), various programs, various data, and the like are loaded into the primary storage device 210. The primary storage device 210 is also used as a work area when the CPU 200 executes the OS, various programs, and the like.

  The secondary storage device 220 is a non-volatile storage device represented by, for example, an FDD, an HDD, a flash memory, a CD-ROM drive, and the like. The secondary storage device 220 is used not only as a permanent storage area for an OS, various programs, various data, etc., but also as a storage area for short-term various data etc.

  The image capture I / F 230 converts and compresses image data of an image captured by the connected camera 231 into a predetermined format, and may be, for example, the secondary storage device 220 (may be the primary storage device 210 Transfer to). The camera 231 is an imaging unit in which an imaging angle of view and a zoom position are variable.

  The camera platform control I / F 240 is connected to a movable camera platform 241 on which the camera 231 is mounted. The pan head control I / F 240 controls the pan head 241 in response to an instruction from the CPU 200 to change a pan angle, a tilt angle, and the like of the camera 231. The input / output I / F 250 receives an external signal / interrupt or outputs an external signal via the connected I / O device 251. The network I / F 260 is an interface for connecting to the network 130 illustrated in FIG. 1, and communicates with the information processing apparatus 120 or the like via the network 130.

  Next, FIG. 3 is a block diagram showing an example of the internal configuration of the information processing apparatus 120 shown in FIG. The information processing apparatus 120 has an internal bus 301 configured therein. The information processing apparatus 120 has a CPU 300, a primary storage device 310, a secondary storage device 320, a user input / output I / F 330, a network I / F 340, and a display device 350 connected to the internal bus 301. Is configured. The information processing apparatus 120 further includes an input / output device (I / O device) 331 connected to the user input / output I / F 330.

  The CPU 300 centrally controls the operation of the information processing apparatus. The primary storage device 310 is, for example, a writable high-speed storage device represented by a RAM. For example, an OS, various programs, various data, and the like are loaded into the primary storage device 310. The primary storage device 310 is also used as a work area when the CPU 300 executes the OS, various programs, and the like.

  The secondary storage device 320 is a non-volatile storage device represented by, for example, an FDD, an HDD, a flash memory, a CD-ROM drive, and the like. The secondary storage device 320 is used not only as a permanent storage area for the OS, various programs, various data, etc., but also as a storage area for short-term various data etc.

  The user input / output I / F 330 is responsible for input / output to the user via the connected I / O device 331. The I / O device 331 is an input / output device configured of, for example, a keyboard and a mouse. A network I / F 340 is an interface for connecting to the network 130 illustrated in FIG. 1, and communicates with the imaging device 110 and the like via the network 130. The display device 350 is an image display device such as a display that displays an image or the like based on captured image data captured by the imaging device 110.

<Software configuration>
FIG. 4 is a view showing an example of processing units that execute various programs stored in the primary storage unit 210 and the secondary storage unit 220 of the imaging device 110 shown in FIG. 2 and various types of data. Specifically, FIG. 4A shows various programs and the like stored in the primary storage device 210 of the imaging device 110 shown in FIG. 2, and FIG. 4B shows the imaging device 110 shown in FIG. 7 shows various data etc. stored in the secondary storage device 220 of FIG.

  As shown in FIG. 4A, in the primary storage device 210, each processing unit of the OS 400, the image pickup unit 410, the image processing unit 420, the setting unit 430, the preset circulation unit 440, and the display control unit 450. The corresponding program is loaded. However, the image processing unit 420, the setting unit 430, the preset circulation unit 440, and the display control unit 450 do not necessarily have to be present in the primary storage device 210 of the imaging device 110. For example, as described later, it may be present in the primary storage device 310 of the information processing apparatus 120.

  An OS 400 illustrated in FIG. 4A is a control unit for controlling the entire imaging device 110. Here, the OS 400 manages the position (address) and size in the primary storage device 210 of programs corresponding to various processing units (the image pickup unit 410 to the display control unit 450).

  An image capturing unit 410 illustrated in FIG. 4A performs processing of capturing an image in the camera 231 and performs processing of an image captured by the camera 231 based on the received event. For example, when receiving an image capture end event from the camera 231, the image capturing unit 410 performs processing for obtaining image data of an image captured by the camera 231 via the image capture I / F 230. Then, the image capturing unit 410 converts and compresses the acquired image data into a predetermined format, and stores the converted image data as captured image data 460 in the secondary storage device 220 for storage (accumulation).

  In addition, when the image pickup unit 410 receives a delivery request event from the information processing apparatus 120 which is an external apparatus via the network 130, the image pickup unit 410 delivers the pickup image data 460 stored in the secondary storage unit 220 to the information processing apparatus 120. Do the process. As described above, the image capturing unit 410 receives an event for managing the captured image data 460 and the like, thereby capturing an image (image data) by the camera 231 of the imaging device 110, and of image data via the network 130. Process up to delivery etc.

  The image processing unit 420 illustrated in FIG. 4A performs processing for creating a panoramic image using the captured image data 460 stored in the secondary storage device 220. At this time, for example, the image processing unit 420 may select panoramic image data centered on the origin (0 degree), panoramic image data centered on the angle at which the camera 231 is currently facing, or the centroids of a plurality of preset points. Create panoramic image data etc. to be the center. Although a panoramic image is described as an example in the present embodiment, other types of wide area images such as omnidirectional images may be used. Then, the image processing unit 420 stores the image data created by the image processing as the image-processed image data 470 in the secondary storage device 220 and stores (stores) the image data.

  The setting unit 430 shown in FIG. 4A performs a process of generating setting data for the preset circulation unit 440 based on the preset position information and the attribute information of the circulation route. Then, the setting unit 430 stores the generated setting data as setting data 480 in the secondary storage device 220 and stores (stores) the data.

  The preset traveling unit 440 shown in FIG. 4A reads the setting data 480 stored in the secondary storage device 220, and based on the setting data 480, the camera platform 241 via the camera platform control I / F 240. Control to execute an automatic preset patrol. However, in the case of the configuration without the pan head control I / F 240 and the pan head 241, the image processing unit cuts out a part of the captured image data 460 based on the setting data 480 as an automatic preset patrol. Perform processing to be performed.

  Further, the preset traveling unit 440 performs processing of storing the progress status of the preset traveling in the preset traveling data 490. For example, processing is performed to save preset traveling status information indicating the time required for moving between at least two points of the preset circulation, and whether the preset circulation was successful, failed, or skipped. Also, processing is performed to save the number of times of movement to each preset position and the like since the start of the preset patrol. The display control unit 450 shown in FIG. 4A controls information display based on the setting data 480 and the preset circulation data 490.

  Further, as shown in FIG. 4B, in the secondary storage device 220 of the imaging device 110, captured image data 460, image processed image data 470, setting data 480, and preset circulation data 490 are stored. . However, the image-processed image data 470, the setting data 480, and the preset circulation data 490 need not necessarily be present in the secondary storage device 220 of the imaging device 110. For example, as described later, it may exist in the secondary storage device 320 of the information processing apparatus 120.

  The captured image data 460 illustrated in FIG. 4B is image data captured by the camera 231 and processed by the image capturing unit 410. The image-processed image data 470 illustrated in FIG. 4B is image data generated by the process performed by the image processing unit 420.

  The setting data 480 shown in FIG. 4B is setting data for preset circulation, which is a setting value for controlling the operation of the imaging device 110, and in particular, a movement route (circulation route) related to the preset circulation. Attribute information of. Specifically, in addition to setting the value of PTZ at the preset position, the setting data 480 holds the stopping time at the preset position and the movement order of the preset patrol.

  The preset circulation data 490 shown in FIG. 4B is data for holding the progress of the preset circulation, and is for holding the traveling time between at least two points of the preset circulation and the preset circulation status. is there.

  Next, FIG. 5 is a diagram showing an example of processing units for executing various programs stored in the primary storage unit 310 and the secondary storage unit 320 of the information processing apparatus 120 shown in FIG. 3 and various data. is there. Specifically, FIG. 5 (a) shows various processing units etc. stored in the primary storage device 310 of the information processing apparatus 120 shown in FIG. 3, and FIG. 5 (b) shows the information shown in FIG. It shows various data and the like stored in the secondary storage device 320 of the processing device 120.

  As shown in FIG. 5A, programs corresponding to the OS 500 and the viewer unit 510 are loaded into the primary storage device 310. In the primary storage unit 310, instead of the image processing unit 420 to the display control unit 450 of the primary storage unit 210 of the imaging device 110, the image processing unit 520, the setting unit 530, the preset circulation unit 540, and the display A program corresponding to each processing unit of the control unit 550 is loaded.

  An OS 500 illustrated in FIG. 5A is a control unit for controlling the entire information processing apparatus 120. Here, the OS 500 manages the position (address) and size in the primary storage device 310 of programs corresponding to various processing units (viewer unit 510 to display control unit 550).

  A viewer unit 510 illustrated in FIG. 5A performs processing for displaying on the display device 350 an image based on captured image data captured by the imaging device 110, preset tour setting information, a preset tour progress status, and the like.

  The viewer unit 510 has a user interface function for displaying a user interface on the display device 350. The display of the user interface by the user interface function allows display of a moving image acquired from the imaging device 110 and display of a still image. Alternatively, the display of moving images or still images, the display of accumulated images, the display of panoramic images, the display of preset circulation setting information, and the display of preset circulation progress status information are performed by a user operation. As the user interface, for example, a CUI, a GUI, a web application, or the like can be applied. Also, the interface of the CUI, GUI, or Web application mentioned here is provided by, for example, the setting unit 430 (or setting unit 530) of the imaging apparatus 110.

  The image processing unit 520, the setting unit 530, the preset circulation unit 540, and the display control unit 550 shown in FIG. 5A respectively have the image processing unit 420, the setting unit 430, the preset circulation unit 440, and the display shown in FIG. It has the same function as that of the control unit 450.

  As shown in FIG. 5B, in the secondary storage device 320, instead of the image-processed image data 470 and the setting data 480 of the secondary storage device 310 of the imaging device 110, as needed, Processed image data 560 and setting data 570 may be stored.

  The image-processed image data 560 and setting data 570 shown in FIG. 5B are the same as the image-processed image data 470 and setting data 480 shown in FIG. 4B, respectively. For example, the image-processed image data 560 is generated by the process of the image processing unit 520, and the setting data 570 is generated by the process of the setting unit 530.

  The preset traveling data 580 shown in FIG. 5 (b) is similar to the preset traveling data 490 shown in FIG. 4 (b). The preset traveling data 580 is generated by the processing of the preset traveling unit 540.

<Processing>
FIG. 6 is a flowchart illustrating an example of a processing procedure using the setting unit 430 according to the first embodiment. The flowchart illustrated in FIG. 6 is performed, for example, by the CPU 200 of the imaging device 110 executing a program corresponding to the setting unit 430 stored in the primary storage device 210 illustrated in FIG. 4.

  As described above, in the case where the setting unit 530 is stored in the information processing apparatus 120, the CPU 300 of the information processing apparatus 120 sets the primary storage device 310 in FIG. This is performed by executing a program corresponding to the part 530. The present invention can also be applied to a mode in which, in the information processing apparatus 120, the setting data 480 of the imaging apparatus 110 is read via the network 130 and processing is performed on the information processing apparatus 120 side.

  In the following description, a program corresponding to the setting unit is stored in the imaging apparatus 110, and the CPU 200 on the imaging apparatus 110 side performs processing using the setting unit, but the CPU 300 on the information processing apparatus 120 side. The processing may be performed by

  First, when the process of FIG. 6 is started, the CPU 200 of the imaging device 110 starts a process using a program corresponding to the setting unit 430 stored in the primary storage device 210. Then, in step S601, the CPU 200 of the imaging device 110 performs a process of reading the setting data 480.

  When the information processing apparatus 120 performs the process of FIG. 6, the CPU 300 reads the setting data 480 of the imaging apparatus 110 via the setting unit 530 stored in the apparatus or the network 130. Is done.

  Subsequently, in step S602, the CPU 200 of the imaging device 110 performs processing for displaying the setting data 480 as a dialog or the like on the display device of the host (for example, the information processing device 120). When the process of FIG. 6 is performed on the information processing apparatus 120 side, the display process is performed in the CPU 300. Since a GUI or the like can be applied to a specific user interface displayed on the display device 350 of the information processing apparatus 120, the description thereof is omitted.

  Subsequently, in step S603, the CPU 200 of the imaging device 110 performs processing such as input or correction (change) of the setting data 480 based on, for example, information input from the user via the I / O device 331. . This is realized, for example, by editing each value of the setting data or the like on the GUI in tabular form as shown in the example of the setting data 480 in FIG. 7 (described later with reference to FIG. 7). When the process of FIG. 6 is performed by the information processing apparatus 120, the CPU 300 performs the input / change process.

  Subsequently, in step S604, the CPU 200 of the imaging device 110 determines whether or not there is an end event relating to the setting of the setting data 480 from the user via the I / O device 331, for example. As a result of this determination, if there is no end event related to the setting of the setting data 480, the process returns to step S602.

  On the other hand, as a result of the determination in step S604, if there is an end event related to the setting of the setting data 480, the process proceeds to step S605. In step S605, the CPU 200 of the imaging device 110 stores and saves the setting data 480 processed in step S603 in the secondary storage device 220 of the own device, and sets the setting data 480. Thereafter, the process ends.

  When the process of FIG. 6 is performed on the side of the information processing apparatus 120, the CPU 300 determines whether there is an end event in step S604. Then, when there is an end event, the CPU 300 performs processing of storing and storing the setting data 570 in the secondary storage device 320 of the own device.

  Here, FIG. 7 is a diagram showing an example of setting data 480 created for the preset circulating unit 440 of the present invention. By setting Pan / Tilt / Zoom values as preset position information Preset 1 to Preset 9 for the camera 231 in the setting data 480 and determining the angle of view, arbitrary preset positions of 360 degrees all around (multiple imaging Position is set.

  More specifically, Pan is set to have a center at 0 degrees, a right direction as plus, a left direction as minus, and 360 degrees of ± 180 degrees, and a tilt from 0 degrees upward Set as plus 90 degrees. In ZOOM, the focal length of the lens is set.

  By setting this preset position, a plurality of imaging positions in the camera 231 are set. Furthermore, by setting the resting time information Pause, the stopping time at the preset position is set.

  Further, in the setting data 480, attribute information of a movement route (circulation route) related to the preset circulation of the camera 231 is set as Preset_Tour_Attribute. Specifically, as the attribute information of the circulation route of the camera 231, circulation order information (Tour) indicating the order of the circulation (movement order) in the preset position information Preset1 to Preset9 is set.

  As described above, FIG. 7 shows that, as the preset cyclic information list 700, position data of four presets, stop times at each preset position, and preset cyclic order are stored in the setting data 480.

  FIG. 8 is a flowchart illustrating an example of the process flow of the preset traveling unit 440 according to the first embodiment. Details of the process will be described later.

  FIG. 9 is a diagram showing an example of preset traveling data 490 created by the preset traveling unit 440. As shown in FIG. As shown in the figure, in the preset circulation data 490, a preset number, a moving time, and a status are stored for each preset circulation order. Specifically, a preset number 1 is stored as the tour number 1, 10 seconds for the movement time from the preset 4 to the preset 1, and a string F indicating the preset tour completion is stored in the status of the preset tour order 1.

  Similarly, a preset number 3 is stored as the patrol number 2, 10 seconds for the movement time from the preset 1 to the preset 3, and a string N indicating that the preset patrol execution is in progress is stored in the status of the preset patrol order 2. Also, similarly, preset 2 is stored as tour number 3, 5 seconds is the moving time from preset 3 to preset 2, and NULL indicating preset patrol non-execution is stored in the status of preset tour order 3. Similarly, the preset 4 is stored as the tour number 4, 15 seconds for the movement time from the preset 2 to the preset 4, and NULL indicating the non-execution of the preset tour is stored in the status of the preset tour order 4.

  The flow of processing of the preset circulation unit will be described below with reference to FIGS. 7, 8 and 9. According to the setting data shown in FIG. 7, the preset cyclic unit is configured as follows: Preset 1 → Preset 3 → Preset 2 → Preset 4 → Preset 1 →. . . Execute preset patrol in the order of.

  In the following description, a case where the preset traveling unit 440 is stored in the imaging device 110 and the CPU 200 on the imaging device 110 side performs processing using the preset traveling unit 440 will be described. However, in the present embodiment, as described above, the processing may be performed by the CPU 300 on the information processing apparatus 120 side using the preset circulation unit 540.

  First, when the process of FIG. 8 is started, the CPU 200 of the imaging device 110 starts a process using a program corresponding to the preset circulation unit 440 stored in the primary storage device 210. Then, in step S801, the preset circulating unit reads the setting data 480 shown in FIG.

  Subsequently, in step S802, the preset circulating unit 440 sets a timer to measure the time required to move between presets. Next, in step S803, the preset traveling unit 440 controls the camera platform 241 and the camera 231 to move to the preset position of the preset traveling order 1 based on the setting data 480 read in step S801. Specifically, it moves to (0, 45, 30) which is (P, T, Z) of Preset 1 and performs imaging for 3 seconds at an angle of view of 30 degrees at that position.

  Next, when the movement to the preset position is completed, in step S804, the preset traveling unit 440 reads the elapsed time of the timer and measures the preset movement time. In this embodiment, the elapsed time of the timer is set as the preset movement time, but in another embodiment, the average of the preset movement time measured in the past and the elapsed time of the timer may be set as the preset movement time.

  In step S 805, preset traveling unit 440 associates the traveling time measured in step S 804 and preset traveling status “character string F” indicating completion of preset traveling with preset traveling number 1 of preset traveling data 490. Store in

  Next, the process proceeds to step S806, where the preset traveling unit 440 determines whether or not the preset traveling has ended. Specifically, it is determined whether the movement to the last preset of the preset circulation order has ended. If it is determined that the preset patrol has ended as a result of this determination, the process proceeds to step S807. On the other hand, if it is determined that the preset patrol has not ended as a result of the determination in step S806, the process proceeds to step S808. Since the preset patrol has not ended this time, the process proceeds to step S808.

  In step S 807, the preset circulation unit 440 changes all preset circulation status information stored in the preset circulation data 490 to NULL. In step S808, the preset circulation unit 440 stores the preset circulation status “character string N” indicating that the movement to the next preset position is in the area linked to the preset circulation number 2.

  Next, in step S809, the preset circulation unit 440 determines whether or not there is an end event of the control related to the preset circulation from the user via the I / O device 331, for example. As a result of the determination, if there is no end event of control relating to the preset patrol, the process returns to step S802. On the other hand, as a result of the determination in step S809, when there is an end event of control relating to the preset patrol, the process ends.

  Here, the description of the process is continued assuming that there is no end event. When the process returns to step S802, the CPU 200 of the imaging device 110 sets the timer again. Then, in step S 803, the preset traveling unit 440 controls the camera platform 241 and the camera 231 to move to the preset position of the preset traveling order 2 based on the preset traveling order information of the setting data 480. Specifically, the camera platform 241 is controlled to move 170 degrees to the right and 35 degrees to the right toward (170, 80, 20), which is (P, T, Z) of Preset 3, and the angle of view is 20 degrees. Control the camera 231.

  After imaging for 10 seconds at this position, the process proceeds to step S804, and the preset traveling unit 440 reads the elapsed time of the timer and measures the preset movement time. Then, in step S805, the preset patrol unit 440 presets the preset patrol data 490 for the preset traveling status "character string F" representing the completion of the preset movement and the actual movement time between the imaging positions measured in step S804. Store in the area linked to number 2. Further, in step S808, the preset circulation unit 440 stores the preset circulation status "character string N" indicating that the next preset circulation is being moved in the area linked to the preset circulation number 3.

  Thereafter, similarly, the processing is repeated and the preset traveling unit 440 executes the preset traveling based on the preset traveling order. Specifically, the pan head 241 controls movement by 70 degrees leftward and 70 degrees downward toward (100, 10, 30), which is (P, T, Z) of Preset 2, to a field angle of 30 degrees. The camera 231 controls. After performing imaging for 5 seconds in this state, the pan head 241 moves and controls 270 ° left and 10 ° upward toward Preset 4 to control the camera 231 to a field angle of 15 °, and imaging in this state is performed. Do for 2 seconds.

  In the present embodiment, when the movement to Preset 4 is completed, the preset circulation is ended, so at this point, all preset circulation status information stored in the preset circulation data 490 is changed to NULL. After that, the preset tour returns to preset tour order 1, and the preset tour unit moves the camera platform 241 by 170 degrees to the right and up to 25 degrees toward Preset1 of preset tour number 1, and the angle of view to 30 degrees The camera 231 controls. And imaging is performed for 3 seconds in this state. Thereafter, the process is repeatedly executed until there is an end event of control related to the preset circulation. In this way, it is possible to acquire the actual movement time between preset positions and the traveling status of each preset position.

  FIG. 10 is a diagram showing an example of the installation environment of the camera constituting the information processing system of the present invention. FIG. 10 shows that a road is laid on a meadow surrounded by mountains, and a camera is installed at a place where one tree is planted along the road.

  11 shows the viewer displayed by the viewer unit 510 when the setting data 480 of FIG. 7 is stored for the preset circulation unit 440 and the preset circulation data 490 of FIG. 9 is stored by the preset circulation unit 440. It is an example of a dialog.

  A camera imaging display area 1101 displays an image based on captured image data captured by the imaging device 110. In the present embodiment, a live image based on captured image data captured by a camera at a location indicated by the camera current position icon 1106 is displayed.

  Reference numeral 1102 denotes an image display area of the image-processed image data 470. In the present embodiment, in the camera installation environment shown in FIG. 10, a rectangle indicating the visible range of the camera (an area indicating the range in which imaging is possible) is displayed. In another embodiment, image data, such as a panoramic image of a camera, created by the image processing unit and stored in the image-processed image data 470 may be displayed. Alternatively, an image (live image, recorded image) or a still image acquired by an omnidirectional (wide range) camera or a fixed camera may be displayed.

  Reference numeral 1103 denotes a preset rectangle displayed at a preset position on the panoramic image. The preset rectangle 1103 reflects information on the preset position of the setting data 480 and 570 and information based on the preset traveling data 490 and 580. In the present embodiment, the preset circulation order and the stop time at the preset position are displayed near the preset rectangle 1103 (here, in the frame). The size of the preset rectangle is determined based on the ZOOM value (zoom value), and indicates the imaging angle of view at each preset position.

  A preset position icon 1104 is displayed at a preset position on the panoramic image. In the present embodiment, a circle is displayed, but other forms such as a rectangle and a star can be used. The preset position icon 1104 indicates the pan and tilt positions of the preset. The display form of the preset position icon 1104 is different from the display form of the preset rectangle 1103.

  Reference numeral 1105 denotes a preset movement line connecting preset positions (imaging ranges). In the present embodiment, the preset movement line 1105 is a preset movement line (movement locus) representing a preset movement direction, and is an arrow line connecting the preset positions. In addition, a character string indicating the movement time between each preset position may be written together and displayed.

  Reference numeral 1106 denotes a camera current position icon. The camera current position icon 1106 is displayed at the position of the camera when the viewer unit 510 acquires the captured image data 460 and the preset traveling data 490 from the imaging device 110.

  The display control unit 450 (or the display control unit 550) controls display of the preset rectangle 1103, the preset position icon 1104, the preset movement line 1105, and the camera current position icon 1106. Specifically, the display control unit 450 (or the display control unit 550) selects any one of the preset rectangle 1103, the preset position icon 1104, the preset movement line 1105, and the camera current position icon 1106 based on the information preset by the user. Control to display one or more in combination.

  The display control unit 450 (or the display control unit 550) arbitrarily sets the preset rectangle 1103, the preset position icon 1104 and the preset movement line 1105 based on the number before and after the preset position designated by the user or the time before and after the preset position designated by the user. Control to display only the number of.

  For example, it is assumed that the user designates a certain preset as a reference, and sets the number of displayed preset rectangles 1103 to one before and after the preset circulation order. In this case, a total of three preset rectangles 1103 are superimposed and displayed on the image-processed image display area 1102 with the designated preset and one preset before and after the preset.

  As another embodiment, it is assumed that the user designates a certain preset as a reference and sets the preset movement time to 30 seconds before and after. In this case, the preset rectangle 1103 of the designated preset and the preset that moves 30 seconds before and after the preset is displayed superimposed on the image-processed image display area 1102. Here, as a method of setting the preset movement time, it is possible to set one or two of the stop time of the preset tour information and the movement time between the presets in combination.

  In the present embodiment, a preset is specified as a reference, but in another embodiment, it is also possible to specify the current imaging position of the camera. For example, when the number of displayed preset rectangles 1103 is specified as one before and after, a total of two preset rectangles 1103 are superimposed and displayed on the image-processed image display area 1102, one after and one after the current imaging position. .

  In the present embodiment, the preset rectangles 1103 to be displayed have the same settings before and after the preset designated by the user. However, in other embodiments, different settings can be made. Further, the method of setting based on the number and the method of setting based on time may be combined and set.

  In the present embodiment, the preset used as the reference and the preset rectangle 1103 to be displayed are set by the user, but in other embodiments, they may be automatically determined on the program. The preset position icon 1104 and the preset movement line 1105 can be similarly set.

  In the present embodiment, in FIG. 11, a reference imaging range (for example, a current imaging range, a preset rectangle 1103 having a preset circulation order No. 1) is included as information related to an imaging range of a part of a plurality of imaging ranges. Information indicating the imaging range of the part (preset rectangle 1103), information on the movement order between some of the imaging ranges (No. 1, No. 2, No. 4 in FIG. 11), and movement based on the movement order Although locus information (preset movement line 1105) and the camera current position icon 1106 indicating the reference imaging range are displayed, at least a part of these may be displayed.

  In addition, all the four arrows in FIG. 11 may not be displayed for the preset movement line 1105. For example, No. No. 1 preset rectangle 1103 and no. A moving line connecting the two preset rectangles 1103 and No. No. 1 preset rectangle 1103 and no. Two movement lines of movement lines connecting between the four preset rectangles 1103 may be displayed.

  Next, FIG. 12 is a flowchart illustrating an example of the processing procedure of the viewer unit according to the first embodiment. The flowchart illustrated in FIG. 12 is performed, for example, by the CPU 300 of the information processing apparatus 120 executing the viewer unit 510 of the primary storage device 310 of FIG. 5.

  Hereinafter, the process of displaying the preset tour setting information of the viewer unit and the flow of the process of displaying the preset tour progress status information will be described with reference to FIGS. 11 and 12. In the present embodiment, it is assumed that the setting data shown in FIG. 7 is created for the preset circulating units 440 and 540 of the present invention.

  First, when the process of FIG. 12 is started, the CPU 300 of the information processing apparatus 120 starts a process using a program corresponding to the viewer unit 510 stored in the primary storage device 310. In step S 1201, the viewer unit 510 acquires the image-processed image data 470 and the setting data 480 from the imaging device 110.

  In step S1202, the viewer unit 510 displays a viewer dialog as shown in FIG. At this time, nothing is displayed in the camera imaging display area 1101 of the viewer dialog and the image processing completed image display area 1102. In step S 1203, the viewer unit 510 acquires current camera position information from the imaging device 110. In the present embodiment, (P, T, Z) information of the current camera position is acquired.

  In step S 1204, the viewer unit 510 acquires captured image data 460 from the imaging device 110. In step S1205, the viewer unit 510 acquires the preset traveling data 490 from the imaging device 110. In step S1206, the viewer unit 510 overwrites and displays the captured image data 460 acquired in step S1204 on the camera imaging display area 1101 of the viewer dialog.

  In step S1207, the display control unit 550 determines the preset rectangle 1103, the preset position icon 1104, the preset movement line 1105, and the camera current position icon 1106 to be superimposed and displayed on the image display area 1102.

  As shown in FIG. 11, in the present embodiment, the preset serving as the reference is the preset No. 1 that is the current imaging position. 1, and the display number of the preset rectangle 1103 is the preset No. No. 1 imaging position and preset No. The imaging positions are set to one before and one after, respectively. The preset position icon 1104 is set to be displayed at all the remaining preset positions where the preset rectangle 1103 is not displayed among the four presets registered in the preset tour. In addition, all preset movement lines 1105 are set to be displayed, and the camera current position icon 1106 is also set to be displayed.

  In step S1208, the viewer unit 510 displays the preset rectangle 1103 at a predetermined preset position on the image display area 1102. Here, as shown in FIG. No. 1 imaging position and preset No. The preset rectangles 1103 are superimposed and displayed at three imaging positions of one imaging position before and after 1, respectively. At this time, the viewer unit 510 displays the preset circulation order (movement order) and the stop time at each preset position in the preset rectangular frame. The predetermined preset position may be user-specifiable.

  In step S1209, the viewer unit 510 displays the preset position icon 1104 at the remaining preset positions on the image display area 1002. As shown in FIG. 11, in the present embodiment, the viewer unit 510 superimposes and displays the preset position icon 1104 on one preset position on the panoramic image.

  In step S 1210, the viewer unit 510 superimposes and displays the preset movement line 1105 (movement locus) on the image display area 1102. At this time, the viewer unit 510 may display the moving time between the preset positions included in the preset traveling data acquired in step S1205. As shown in FIG. 11, in the present embodiment, the viewer unit 510 superimposes and displays four preset movement lines on the panoramic image.

  In step S1211, the viewer unit 510 superimposes and displays the camera current position icon 1106 on the image display area 1102 at the current camera position acquired in step S1203. In the present embodiment, the display location of the camera current position icon 1106 is specified from the current camera position information acquired from the imaging device 110. However, in another embodiment, the current camera position information may be specified by calculation using the movement time included in the preset circulation data and the elapsed time from the completion of the previous preset circulation.

  In step S 1212, the viewer unit 510 determines, for example, whether or not there is a processing end event from the user via the I / O device 331. As a result of this determination, when there is no event of end of processing, the processing returns to step S1203, and thereafter, a series of processing is repeated. On the other hand, if it is determined in step S1210 that there is an end event, the process ends.

  As described above, the information processing apparatus (for example, the information processing apparatus 120) according to an embodiment of the present invention changes the imaging range based on the plurality of setting data specifying the plurality of imaging ranges (preset positions) Acquisition unit that acquires the plurality of setting data from an imaging device (for example, the imaging device 110) that can be made to be), a reference imaging range as a reference based on the plurality of setting data, and the reference imaging range Information regarding a plurality of imaging ranges including an imaging range determined based on the information, the information regarding a part of the imaging ranges among the plurality of imaging ranges corresponding to the plurality of setting data (for example, the current imaging position Movement based on multiple imaging positions (preset position, preset rectangle), stop time at that position, movement order between imaging positions (preset circulation order), movement order A display control unit that causes a display unit (for example, the display device 350) to display at least one of traces (preset movement lines) on an image (for example, a panoramic image) indicating an area indicating an imaging range that can be imaged by the imaging device (For example, a display control unit 550).

  According to the present invention, the preset tour setting information of the camera and the preset tour progress status can be visually checked, and it can be easily grasped how the imaging range in the imaging apparatus changes (movement status). Therefore, the usability of the person in charge of monitoring can be improved.

  Also, by configuring the display control unit to control information displayed on the image display area and displaying a part of the information, the viewer can view the image even when the number of presets registered in the preset tour increases. You can keep the sex.

Second Embodiment
In the second embodiment, a display mode of the preset rectangle 1103 according to the current preset circulation status in the information processing system of the first embodiment will be described.

  The display form of the outer frame of the preset rectangle 1103 is configured to change in accordance with the contents of the preset circulation status. Specifically, when the preset circulation status is "preset circulation completion", the outer frame line is displayed as a red solid line. In addition, the outer frame line is displayed as a blue dotted line when the preset circulation status is "in progress of preset circulation". Also, when the preset circulation status is "NULL", the outer frame line is displayed as a yellow dotted line. Note that the display mode is an example, and the present invention is not limited to this, as long as it is a display mode in which the order of circulation and each preset circulation status can be identified. For example, the thickness of the outer frame line to be a colored outer frame may be changed, or the line width and line type (one-dot chain line, two-dot chain line ridge) may be changed. Also, the outer frame may be changed from a rectangle to another shape (eg, an ellipse, a polygon). Also, in the first embodiment, the preset position icon 1104 displayed by simplifying the preset information may be changed in color or shape as well.

  This makes it possible to more easily grasp how the imaging range in the imaging device changes.

(Embodiment 3)
In this embodiment, the preset traveling information list 700, which is a list of setting items including the information of the imaging position, the information of the stop time at the imaging position, and the information of the moving order of the imaging position described in the first embodiment. Further, the display mode will be described.

  The display form of the preset traveling information list 700 is configured to change according to the contents of the preset traveling status. Specifically, a preset for which the preset tour status is "preset tour completed" is displayed in red. Also, a preset for which the preset patrol status is "preset patrol in progress" is displayed in blue. Also, presets for which the preset cyclic status is "NULL" are displayed in yellow. Note that the display mode is an example, and the present invention is not limited to this, as long as it is a display mode in which the order of circulation and each preset circulation status can be identified. For example, the border of the table may be colored, the text color may be changed, or the text may be underlined. The preset traveling information list 700 may be displayed together with the display form of FIG. 11 shown in the first embodiment, or may be configured to be displayed alone.

  As a result, by visually recognizing the preset traveling information list, it is possible to more easily grasp how the imaging range in the imaging device changes.

(Embodiment 4)
Although the present embodiment has been described as the method of displaying the preset traveling progress status, in another embodiment, the present invention may be applied to the display of the progress status regarding the movement of the camera position other than the preset traveling.

  For example, the present invention may be applied to a surveillance camera system having a function of specifying a moving destination of a camera by clicking on an arbitrary position of a panoramic image display area displayed by a viewer unit with a mouse.

  In this embodiment, the current camera position is displayed as a red frame rectangle on the panoramic image display area of the viewer unit, and the movement destination designated by mouse click is displayed as a blue dotted frame rectangle. In addition, the camera current position icon 1106 is superimposed on the panoramic image, and the progress of movement from the current position to the designated movement destination position by clicking the mouse is displayed.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

  100: information processing system, 110: imaging device, 120: information processing device, 130: network, 350: display device, 410: image capturing unit, 420: image processing unit, 430: setting unit, 440: preset traveling unit, 450 : Display control unit 510: Viewer unit 520: Image processing unit 530: Setting unit 540: Preset circulation unit 550: Display control unit

Claims (21)

Acquisition means for acquiring the plurality of setting data from an imaging device capable of changing the imaging range based on a plurality of setting data for specifying a plurality of imaging ranges;
Information regarding a plurality of imaging ranges including a reference imaging range serving as a reference based on the plurality of setting data and an imaging range determined based on the reference imaging range, corresponding to the plurality of setting data A display control unit configured to display, on an image indicating an area indicating an imaging range that can be imaged by the imaging device, information relating to a part of the imaging ranges of the plurality of imaging ranges;
An information processing apparatus comprising:   The information on the partial imaging range includes information indicating a partial imaging range including the reference imaging range, information on a movement order between the partial imaging ranges, and information on a movement trajectory based on the movement order The information processing apparatus according to claim 1, comprising at least one of: The display control means
A first display form indicating the imaging range is displayed in each of the reference imaging range and a predetermined imaging range of movement order including before and after the reference imaging range,
The information processing apparatus according to claim 2, wherein a second display form indicating the imaging range is displayed in an imaging range excluding the predetermined imaging range among the plurality of imaging ranges.   The information processing apparatus according to claim 3, wherein the display control means further displays a stop time in an imaging range in the vicinity of the first display form.   The first display mode is a rectangle indicating an imaging range of a size corresponding to a zoom value, and the second display mode is an icon having a shape different from the rectangle. The information processing apparatus according to 4.   The information processing apparatus according to any one of claims 3 to 5, wherein the first display form is displayed in a different color according to a cyclic status indicating a movement situation between a plurality of imaging ranges. .   The display control means further displays a list of setting items including information of an imaging range, information of a stop time in the imaging range, and information of a movement order of the imaging range. The information processing apparatus according to any one of the above.   8. The information processing apparatus according to claim 7, wherein the setting item is displayed in a different display form in accordance with a circulation status indicating a movement situation between a plurality of imaging ranges.   The information processing apparatus according to any one of claims 2 to 8, wherein the information of the movement trajectory is a movement line connecting imaging ranges.   The information processing apparatus according to claim 9, wherein the movement line is an arrow indicating a movement direction.   The information processing apparatus according to any one of claims 1 to 8, wherein the display control means further displays an icon indicating the reference imaging range.   The display control means determines the number of the plurality of imaging ranges before and after the reference imaging range based on the information of the stop time in each imaging range included in each setting data, and the reference imaging range and the determination are performed. The information processing apparatus according to any one of claims 1 to 11, wherein information display is performed for an imaging range corresponding to the number.   The display control means receives specification of the number of imaging ranges before and after the reference imaging range from the user, and performs information display on the reference imaging range and an imaging range corresponding to the designated number. The information processing apparatus according to any one of claims 1 to 11.   The information processing apparatus according to any one of claims 1 to 13, wherein the reference imaging range is a current imaging range of the imaging device.   The information processing apparatus according to any one of claims 1 to 13, wherein the reference imaging range is an imaging range specified by a user. It further comprises measuring means for measuring an actual moving time between the plurality of imaging ranges based on the plurality of setting data,
The information processing apparatus according to any one of claims 1 to 15, wherein the display control means further displays information of the movement time. The system further comprises management means for managing a patrol status indicating a movement status between the plurality of imaging ranges,
The information processing apparatus according to any one of claims 1 to 16, wherein the display control means further displays the traveling status.   The information processing apparatus according to any one of claims 1 to 17, wherein the area indicating the imaging range which can be imaged is an area of a panoramic image.   The information processing apparatus according to any one of claims 1 to 17, wherein the area indicating the imaging range capable of imaging is an area of an omnidirectional image. A control method of the information processing apparatus,
An acquisition step of acquiring the plurality of setting data from an imaging device capable of changing the imaging range based on a plurality of setting data for specifying a plurality of imaging ranges;
Information regarding a plurality of imaging ranges including a reference imaging range serving as a reference based on the plurality of setting data and an imaging range determined based on the reference imaging range, corresponding to the plurality of setting data A display control step of causing display means to display information on a part of a plurality of imaging ranges on an image showing an area indicating an imaging range that can be imaged by the imaging device;
And controlling the information processing apparatus.   A program for causing a computer to function as the information processing apparatus according to any one of claims 1 to 19.