JP2023073130A - Control unit, control method, and program - Google Patents

Abstract

To prevent an increase in time required for processing related to trial of a shot function.SOLUTION: An information processing apparatus executes, for a predetermined image, a shot function in first control processing of sequentially changing the position or the size of a sub region to be cut out, based on first parameter information used in the shot function in the first control processing, sets second parameter information in a shot function in second control processing of driving at least one of panning, tilting, and zooming of imaging means, and executes the shot function in the second control processing according to the set second parameter information.SELECTED DRAWING: Figure 4

Description

The present invention relates to a control method for an imaging device.

Conventionally, there are optical PTZ and electronic PTZ as techniques for controlling the imaging range of an imaging device that captures an image. In the optical PTZ, there is a technique of changing the imaging range of the imaging device by driving at least one of the pan, tilt, and zoom mechanical mechanisms of the imaging device. The electronic PTZ is a technology for extracting and outputting a partial area from an image captured by an imaging device. It is a technology that controls the range.

Also, there is a shot function as a function for controlling the imaging device. The shot function controls the imaging range of the imaging device from the start imaging range corresponding to the start position to the specified end imaging range, in which the time to move to the end imaging range, which is the imaging range to be reached, is specified. This is a function to reach the end imaging range within the moving time.

Patent Document 1 discloses a method of controlling panning and tilting of an imaging device so as to reach a target position from a current position at a specified time specified by a user.

JP 2007-282069 A

In general, in the operation stage of the shot function, it may be desired to use the optical PTZ with higher resolution than the electronic PTZ to execute the shot function. Also, prior to the execution of the shot function in the operation stage, the user tries the shot function with various patterns while appropriately adjusting the parameters such as the end imaging range and the movement time, and then selects the optimal parameters that can capture the image desired by the user. I have a use case where I want to determine

Here, it is assumed that the execution of the shot function by the optical PTZ is tried with various parameter patterns. At this time, after the optical PTZ shot function has been executed from a certain starting imaging range with a certain parameter pattern, it is necessary to control the pan, tilt, and zoom again to return the imaging range to the certain starting imaging range. . That is, every time the optical PTZ attempts a certain pattern of shot functions from a certain starting imaging range, it is necessary to control the pan, tilt, and zoom to return to the certain starting imaging range. As a result, it may take time to try the shot function with various parameter patterns.

SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to suppress an increase in the time required for processing related to the trial of the shot function.

In order to solve the above problems, the control device of the present invention has the following configuration. That is, first control means for executing a shot function in a first control process for sequentially changing the position or size of a partial area to be cut out from a predetermined image; setting means for setting second parameter information in the shot function by a second control process for driving at least one of panning, tilting, and zooming of the imaging means based on the parameter information; and second control means for executing the shot function by the second control process according to the two-parameter information.

According to the present invention, it is possible to suppress an increase in the time required for processing related to the trial of the shot function.

It is a figure which shows an example of a system configuration. It is a figure which shows an example of the external appearance of an imaging device. It is a figure which shows an example of the functional block of an imaging device and an information processing apparatus. 4 is a diagram for explaining a GUI displayed on a display 210; FIG. 4 is a diagram for explaining a GUI displayed on a display 210; FIG. 4 is a diagram for explaining a GUI displayed on a display 210; FIG. FIG. 4 is a diagram for explaining processing for generating a simulated video; FIG. FIG. 10 is a diagram for explaining a process of setting second parameter information; FIG. 4 is a flow chart showing the flow of information processing related to a shot function; 4 is a diagram for explaining a GUI displayed on a display 210; FIG. 4 is a flow chart showing the flow of information processing related to a shot function; It is a figure which shows an example of the hardware constitutions of each apparatus.

Hereinafter, embodiments according to the present invention will be described with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples, and are not limited to the illustrated configurations.

(Embodiment 1)
FIG. 1 is a diagram showing the system configuration in this embodiment. The system in this embodiment has an imaging device 100 , an information processing device 200 , a display 210 and a network 300 .

The imaging device 100 and the information processing device 200 are interconnected via a network 300 . The network 300 is implemented by a plurality of routers, switches, cables, etc., conforming to communication standards such as ETHERNET (registered trademark).

Note that the network 300 may be implemented by the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network), or the like.

The imaging device 100 is a device that captures an image, and functions as imaging means capable of changing the imaging range by driving at least one of pan, tilt, and zoom. The imaging device 100 transmits image data of a captured image, information on the date and time when the image was captured, identification information for identifying the imaging device 100, and information on the imaging range of the imaging device 100 via the network 300. It transmits to an external device such as the processing device 200 . The information processing apparatus 200 is, for example, a client apparatus such as a personal computer in which a program for realizing functions of processes described later is installed. In the system according to the present embodiment, one imaging device 100 is provided, but a plurality of imaging devices may be provided. In other words, multiple imaging devices 100 may be connected to the information processing device 200 via the network 300 . In this case, the information processing apparatus 200 uses, for example, identification information associated with the transmitted image to determine which imaging apparatus 100 among the plurality of imaging apparatuses 100 captured the transmitted image. .

The display 210 is configured by an LCD (Liquid Crystal Display) or the like, and displays an image or the like captured by the imaging device 100 . The display 210 is connected to the information processing apparatus 200 via a display cable conforming to a communication standard such as HDMI (registered trademark) (High Definition Multimedia Interface). Note that the display 210 and the information processing device 200 may be provided in a single housing.

Next, the imaging device 100 according to this embodiment will be described with reference to FIGS. 2 and 3. FIG. FIG. 2 is an example of an external view of the imaging device 100 according to this embodiment. FIG. 3 is an example of functional blocks of the imaging device 100 and the information processing device 200 according to this embodiment. Among the functional blocks of the imaging apparatus 100 shown in FIG. 3, functions such as the image processing unit 112, the system control unit 113, the pan/tilt/zoom control unit 114, the storage unit 115, and the communication unit 116 are realized as follows. shall be That is, it is realized by the CPU (Central Processing Unit) 1200 of the imaging device 100 executing a computer program stored in a ROM (Read Only Memory) 1220 of the imaging device 100, which will be described later with reference to FIG.

The direction in which the optical axis of the lens 101 faces is the imaging direction of the imaging device 100 , and the luminous flux passing through the lens 101 forms an image on the imaging element of the imaging unit 111 of the imaging device 100 . A lens drive unit 102 is configured by a drive system that drives the lens 101 and changes the focal length of the lens 101 . The lens drive unit 102 is controlled by a pan/tilt/zoom control unit 114 .

The pan drive unit 103 is configured by a mechanical drive system that performs a pan operation and a motor as a drive source, and drives to perform rotational drive control for rotationally driving the imaging direction of the imaging apparatus 100 in the pan direction 105 . Also, the pan drive unit 103 is controlled by a pan/tilt/zoom control unit 114 .

The tilt drive unit 104 is configured by a mechanical drive that performs a tilt operation and a motor as a drive source, and drives so as to perform rotational drive for rotationally driving the imaging direction of the imaging apparatus 100 in the tilt direction 106 . The tilt drive unit 104 is controlled by a pan/tilt/zoom control unit 114 .

The imaging unit 111 is configured by an imaging device (not shown) such as a CCD (charge coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor. The imaging unit 111 photoelectrically converts the subject image formed through the lens 101 to generate an electric signal. The image processing unit 112 converts the electrical signal photoelectrically converted by the imaging unit 111 into a digital signal, performs image processing such as compression encoding processing, and generates image data, which is data of a captured image.

The pan/tilt/zoom control unit 114 controls the pan driving unit 103, the tilt driving unit 104, and the lens driving unit 102 by the optical PTZ based on the instructions transmitted from the system control unit 113, thereby panning and Control tilt and zoom. The storage unit 115 stores (holds) information indicating the imaging range, for example.

The communication unit 116 communicates with the information processing apparatus 200 via an I/F 1240 which will be described later with reference to FIG. For example, the communication unit 116 transmits image data of an image captured by the imaging device 100 to the information processing device 200 via the network 300 . The communication unit 116 also transmits information indicating the current imaging range of the imaging device 100 . The communication unit 116 also receives a control command, which is a command for controlling the imaging device 100 transmitted from the information processing device 200 , and transmits the control command to the system control unit 113 .

The system control unit 113 controls the entire imaging apparatus 100 according to the processing executed by the CPU 1200, which will be described later with reference to FIG. 12, and performs the following processing, for example. That is, the system control unit 113 analyzes a control command for controlling the imaging device 100 transmitted from the information processing device 200, and performs processing according to the control command. The system control unit 113 also instructs the pan/tilt/zoom control unit 114 to perform pan/tilt/zoom operations. Further, when the image data generated by the image processing unit 112 is transmitted to the information processing apparatus 200, the system control unit 113 also adds information on the image capturing time and information on the image capturing range to the image data. .

Note that the imaging range based on the optical PTZ in this embodiment is determined by the PTZ values (P value, T value, Z value) of the imaging device 100 . Note that the P value (Pan value) of the PTZ value is the angle of the imaging direction (optical axis) in the pan direction 105 of the imaging apparatus 100 when one driving end of the pan driving unit 103 is set to 0°, for example. Also, the T value (Tilt value) is the angle of the imaging direction (optical axis) in the tilt direction 106 of the imaging apparatus 100 when one of the drive ends of the tilt drive unit 104 is set to 0°, for example. Note that the Z value (Zoom value) of the imaging device 100 when an image is captured by the imaging device 100 is calculated from the focal length of the lens 101 .

Next, information processing of the information processing apparatus 200 according to the present embodiment will be described with reference to functional blocks of the information processing apparatus 200 shown in FIG. Each function of information processing apparatus 200 is implemented as follows using ROM 1220 and CPU 1200, which will be described later with reference to FIG. That is, each function shown in FIG. 3 is realized by CPU 1200 of information processing apparatus 200 executing a computer program stored in ROM 1220 of information processing apparatus 900 .

The communication unit 201 communicates with the imaging device 100 and, for example, receives image data of an image captured by the imaging device 100 from the imaging device 100 . The communication unit 201 also transmits a control command for controlling the imaging range of the imaging device 100 to the imaging device 100 .

The operation accepting unit 202 accepts a user's operation via an input device (not shown) such as a mouse or keyboard communicably connected to the information processing apparatus 200 .

The display control unit 203 causes the display 210 to display, for example, an image captured by the imaging device 100 that is based on the image data transmitted from the imaging device 100 . Note that an image based on image data here means, for example, when image data is generated by compressing and encoding an image captured by the imaging device 100, the image data is decoded by the information processing device 200. This is an image obtained by

The display control unit 203 also causes the display 210 to display a GUI (Graphical User Interface) for setting shot functions in electronic PTZ and optical PTZ.

The setting unit 204 sets parameters related to the electronic PTZ and the optical PTZ based on the user's operation on the GUI (setting screen) displayed on the display 210 .

The first control unit 205 executes the shot function using the first control process (electronic PTZ) that sequentially changes the position or size of the cutout partial area. That is, the first control unit 205 controls execution of the shot function in the electronic PTZ.

The second control unit 206 executes a shot function by second control processing (optical PTZ) that drives at least one of the pan driving unit 103, the tilt driving unit 104, and the lens driving unit 102 of the imaging apparatus 100. FIG. In other words, the second control unit 206 controls execution of the shot function in optical PTZ.

Here, the GUI for setting the shot function displayed on the display 210 by the display control unit 201 in this embodiment will be described with reference to FIGS. A GUI 400 shown in FIG. 4A is a GUI that presents information on a movable range, which is a range that can be reached by the imaging range in a specified movement time, and allows settings related to the shot function.

The GUI 400 includes an image display area 401 (first display area). In the example shown in FIG. 4A, the image display area 401 displays a panorama image based on an image captured by the imaging device 100 as a predetermined image. is displayed. Note that the panoramic image is an image generated in advance by the imaging device 100, and is an image obtained by synthesizing a plurality of images captured by the imaging device 100 while sequentially changing the imaging range using the optical PTZ. It is generated using known techniques for generating panoramic images. In the example shown in FIG. 4A, a panorama image is displayed as the predetermined image in the image display area 401, but the present invention is not limited to this. You may make it It is desirable that the captured image displayed as the predetermined image at this time be an image obtained by capturing a wide-angle range when the zoom is set to the WIDE end.

For the panorama image displayed in the image display area 401, the user selects a start partial area corresponding to the start position of the route in the shot function of the first control process and an end partial area corresponding to the end position of the route, It can be specified by a mouse drag operation or the like. Here, in the example shown in FIG. 4A, a start partial area 402 and an end partial area 403 are specified on the panorama image of the image display area 401, and the frames of the respective areas are superimposed and displayed. there is

Also, at this time, the aspect ratio of the partial areas cut out from the panorama image in the first control process, such as the start partial area 402, the end partial area 403, and the partial areas on the path therebetween, is the aspect ratio of the image captured by the imaging device 100. Limited. In addition, the size range of the partial area cut out from the panorama image is limited to the range from the angle of view at the telephoto end to the angle of view at the wide end in the optical PTZ of the imaging device 100 .

Further, as shown in FIG. 4A, the GUI 400 includes a movement parameter designation area 404 (second display area), and the user can specify time or Speed specification can be selected. When the time specification is selected, the partial area cut out from the start partial area to the end partial area in the shot function of the electronic PTZ is sequentially changed in the specified movement time. In the optical PTZ shot function, the imaging range is controlled from the start imaging range corresponding to the start partial area to the end imaging range corresponding to the end partial area in the specified movement time. Further, when the speed specification is selected, the partial area to be cut out is sequentially changed according to the specified moving speed from the start partial area to the end partial area in the shot function of the electronic PTZ. Also, when the speed designation is selected, the optical PTZ shot function controls the imaging range from the start imaging range corresponding to the start partial area to the end imaging range corresponding to the end partial area at the specified moving speed. . Note that the example shown in FIG. 4A shows a case where the time specification is selected, and the buttons are displayed in a different manner from the speed specification that is not selected. Further, as shown in FIG. 4A, when the time designation is selected, the movement parameter designation area 404 includes a slider bar 406 and an increase/decrease button 407 for changing the movement time, and displays the currently designated movement. It contains the information of the current value 408 indicating the time. The user can appropriately adjust the movement time by operating the slider bar 406 or pressing the increase/decrease button 407 . Note that FIG. 4(b) shows a case where speed designation is selected as a point different from the GUI 400 shown in FIG. 4(a). In this case, the user can appropriately adjust the movement speed by operating the slider bar 406 or pressing the increase/decrease button 407 in the movement parameter designation area 404. is displayed.

Returning to the description of FIG. 4A, the GUI 400 further includes a simulation start button 410 for instructing the start of the shot function of the first control process. When the simulation start button 410 is pressed by the user, the first control unit 205 executes the shot function of the first control process based on the currently selected parameters. Here, changes in the display of the GUI 400 when the simulation start button 410 is selected will be described with reference to FIGS. 5(a) to 5(c). FIG. 5A shows the state of the GUI 400 when the user operates the mouse 501 and presses the simulation start button 410 . At this time, the display control unit 203 changes the display mode of the frame of the starting partial area 402, which is the starting position of the partial area cut out on the panorama image, so that the frame is highlighted. FIG. 5(b) shows the GUI 400 when the shot function of the first control process is being executed, and the display control unit 203 generates a simulated image that is an image obtained by the shot function of the first control process. A message 502 indicating that it is in progress is displayed. Also, at this time, while the shot function of the first control process is being executed, the frame 503 of the currently cut out partial area is superimposed on the panorama image and displayed. By doing so, the user can grasp which part is currently set as the region to be cut out. FIG. 5(c) shows the GUI 400 when the shot function of the first control process has ended, and the display control unit 203 generates a message 504 indicating that the shot function of the first control process has ended A button 505 for displaying a simulated image is displayed. Also, at this time, the display mode is different such that the frame of the end partial area 403, which is the end position of the cut out partial area, is displayed in an emphasized manner.

Further, as described above, when the user presses the simulation start button 410, the first control unit 205 executes the shot function of the first control process based on the currently selected first parameter information. Specifically, at this time, the first control unit 205 controls the position information of the start partial area and the end partial area currently selected in the image display area 401 and the information of the movement parameter designated in the movement parameter designation area 404. The shot function of the first control process is executed. That is, the first parameter information includes position information of the start partial area and end partial area, and information of movement parameters. By executing the shot function of the first control process, a simulated image can be generated. In the example shown in FIG. 4A, the first control unit 205 sequentially changes the cut-out partial area from the start partial area 402 to the end partial area 403 in the designated movement time of 7 seconds. . Then, the first control unit 205 acquires the clipped image of the partial region at each position that is sequentially changed, and generates a group of the acquired clipped images as a simulation video.

Here, the process of generating a simulation image will be described with reference to FIG. The first control unit 205 controls the position information of the start partial area 702, the position information of the end partial area, the information of the movement time (or the movement speed) specified in the movement parameter specification area 404, and the frame rate. Get information and The position information of a partial area cut out from a predetermined image (panoramic image, etc.) is obtained by using the XY coordinates of the upper left vertex and the XY coordinates of the lower right vertex of the predetermined image, with the upper left vertex of the predetermined image as the origin. shall be determined. Note that the first control unit 205 makes the aspect ratio of the clipped partial area the same as the aspect ratio of the image captured by the imaging device 100, and follows the designated movement time (or movement speed) from the start partial area to the end. The partial area cut out to the partial area is changed sequentially. At this time, for example, if the specified movement time is t [seconds] and the frame rate is 30 [f/s], the partial regions are sequentially changed on the path 704, and 30 t [times] ] is extracted, and a group of extracted images is acquired. Also, if the specified speed is v [pixel/s], the length of the path 704 is L [pixel], and the frame rate is 30 [f/s], the partial area is sequentially changed on the path 704. In the process, 30*(L/v) [times] partial areas are cut out to obtain a group of cut out images. The first control unit 205 acquires a group of clipped images acquired at each position in this manner as a simulation video 705 . The frame rate information used to generate the simulation video may be set in advance, or may be changed as appropriate by the user.

Here, when the button 505 shown in FIG. 5C is pressed, the display control unit 203 causes the display 210 to display the simulation image generated by the first control unit 205 . After confirming the simulation video, the user can, if necessary, transmit the first parameter information (the position information of the start partial area and the end partial area, the movement parameter information) related to the shot function of the first control process to the GUI 400. can be adjusted above. After the adjustment, the simulation start button 410 can be pressed again to generate a simulation image by the shot function of the first control process based on the new parameters. If the user determines that the shot function of the first control process in the current first parameter is desirable, the operation start button 411 is pressed. When the operation start button 411 is pressed, the second control unit 206 performs second control processing (optical PTZ) according to the second parameter information set in the setting unit 204 based on the currently specified first parameter information. Execute the shot function by The processing of setting the second parameter information based on the first parameter information by the setting unit 204 will be described later.

Here, changes in the display of the GUI 400 when the operation start button 411 is pressed will be described with reference to FIGS. 6(a) to 6(c). FIG. 6A shows the GUI 400 when the operation start button 411 is pressed by the mouse 601 and the imaging apparatus 100 is controlled to face the start imaging range of the shot function by the second control processing according to the second parameter information. there is At this time, an image obtained by imaging the start imaging range is transmitted from the imaging device 100 to the information processing device 200 and displayed in the image display area 401 . Subsequently, FIG. 6B shows the GUI 400 when the shot function is being executed by the second control process, and a message 602 is displayed indicating that the shot function is being executed by the second control process. Also, at this time, an image captured at the moment when the shot function is being executed by the second control process is transmitted from the imaging device 100 to the information processing device 200 and displayed in the image display area 401 . FIG. 6C shows the GUI 400 when the shot function by the second control process has ended, and a message 603 indicating that the shot function by the second control process has ended is displayed. Also, at this time, an image obtained by imaging the end imaging range of the shot function by the second control process is transmitted from the imaging device 100 to the information processing device 200 and displayed in the image display area 401 .

Next, a setting process for setting second parameter information used in the shot function by the second control process (optical PTZ) based on the first parameter information used in the shot function by the first control process (electronic PTZ) Description will be made with reference to FIG.

An image 801 shown in FIG. 8 is a predetermined image from which a partial area is cut out, and is an image captured by the imaging device 100 . In the following description, the XY coordinates of the upper left vertex 803 and the lower right vertex 804 of the end partial area 802 with the upper left vertex of the image 803 as the origin are calculated using the PTZ values of the imaging apparatus 100 when the image 801 was captured. Processing for converting XY coordinates into PTZ coordinates will be described. Let (P0, T0, Z0) be the PTZ values of the imaging device 100 when the image 801 was captured, and let (x0, y0) be the XY coordinates of the image center 805 with the upper left vertex of the image as the origin. The PT coordinates corresponding to (x0, y0) are (P0, T0). The XY coordinates of the upper left vertex 803 of the end partial area are (x1, y1), and the XY coordinates of the upper right vertex 804 of the end partial area are (x2, y2). In addition, the setting unit 204 determines the Pan operation amount necessary to move the center of the field angle 805 by the image width 806 and the Tilt operation amount necessary to move the image height 807 for a certain Z value of the imaging apparatus. It is assumed that a correspondence table that associates is held. Here, the setting unit 204 refers to the correspondence table and performs proportional calculation to determine the Pan operation amount Δp1 required to move the image by the horizontal distance 808 and the Tilt operation amount Δt1 to move the image by the vertical distance 809. calculate. Then, the setting unit 204 derives P1 by adding Δp1 to P0 of the PT coordinates (P0, T0) at the center of the angle of view, and derives T1 by adding ΔT1 to T0. By doing so, the setting unit 204 derives the PT coordinates (P1, T1) corresponding to the XY coordinates (x1, y1) of the upper left vertex 803 of the end partial area. A similar process is performed to derive the PT coordinates (P2, T2) corresponding to the XY coordinates (x2, y2) of the lower right vertex 804 of the end partial area. The setting unit 204 further calculates the PT coordinates of the center position of the end partial area as (P1+P2/2, T1+T2/2), and the Z value of the end partial area is the Pan operation amount |P1-P2| from the correspondence table. Derive the corresponding Z(|P1−P2|). As described above, the setting unit 204 derives the PTZ value of the end imaging range included in the second parameter information from the position information (XY coordinates on the image) of the end partial area included in the first parameter information. Similarly, the setting unit 204 derives the PTZ value of the starting imaging range included in the second parameter information from the position information of the starting partial area included in the first parameter information. It is also assumed that the travel time included in the first parameter information is t. At this time, the second control unit 206 performs control to reach from the PTZ value of the start imaging range included in the second parameter information to the PTZ value of the end imaging range included in the second parameter information in the designated movement time t. Generate control commands. Then, the second control unit 206 transmits the generated control command to the imaging device 100, thereby implementing the shot function of the second control process according to the second parameter information.

Here, information processing of the information processing apparatus 200 according to the present embodiment will be described with reference to the processing of the flow shown in FIG. 9 . The processing of the flow shown in FIG. 9 is executed by the functional blocks of the information processing apparatus 200 shown in FIG. be done.

First, in S901, the display control unit 203 acquires a predetermined image from which a partial area is cut out. At this time, the predetermined image may be an image captured by the imaging device 100 or may be a panoramic image. Next, in S<b>902 , the display control unit 203 causes the display 210 to display a GUI for setting the first control process and the second control process. At this time, the display control unit 203 causes the display 210 to display, for example, a GUI 400 shown in FIG. Next, in S<b>903 , the first control unit 205 acquires position information of the start partial area and the end partial area currently specified by the user on the image display area 401 of the GUI 400 . Next, in S904, information on movement parameters currently designated by the user in the movement parameter designation area 404 of the GUI 400 is obtained. Next, in S905, it is determined whether the simulation start button 410 has been pressed on the GUI 400. If it is determined that the button has been pressed (Yes in S905), the process proceeds to S906, and it is determined that the button has not been pressed. If so (No in S905), the process proceeds to S907. In S906, the first control unit 205 executes the shot function of the first control process according to the current first parameter information (the position information of the start partial area and the end partial area, the movement parameter information), and displays the simulated video. Generate. Next, in S907, the display control unit 203 determines whether or not the operation start button 411 has been pressed. If so (No in S907), the process returns to S903. In S908, the setting unit 203 sets second parameter information used in the shot function of the second control process based on the first parameter information. Next, in S909, the second control unit 206 executes the shot function of the second control process according to the set second parameter information.

As described above, the information processing apparatus 200 in this embodiment executes the following processes. That is, the shot function of the first control process (electronic PTZ) is executed using the first parameter information, and the shot function used in the shot function of the second control process (optical PTZ) is executed based on the first parameter information. 2 Set parameter information. Then, the information processing apparatus 200 executes the shot function of the second control process (optical PTZ) according to the second parameter information. Thus, in the trial stage, by executing the first control process (electronic PTZ), even immediately after executing the shot function according to certain parameters from a certain start position, the A shot function can be executed according to the parameters. Then, in the operation stage, the shot function of the second control process (optical PTZ) is executed according to the second parameter information set based on the first parameter information used in the trial stage. By doing so, the shot function of the second control process (optical PTZ) reflecting the desired parameters set by the user in the trial stage can be performed. As described above, according to the information processing apparatus 200 of the present embodiment, it is possible to suppress an increase in the time required for processing related to the trial of the shot function.

(Embodiment 2)
In the second embodiment, a plurality of pieces of first parameter information are held, and the shot function of the first control process according to the first parameter information selected according to the user's operation, and the shot function set based on the first parameter information. The shot function of the second control process can be executed using 2-parameter information. Note that portions different from the above-described embodiments will be mainly described, and the same or equivalent components and processes as those of the above-described embodiments will be given the same reference numerals, and redundant description will be omitted.

Here, the GUI displayed by the information processing apparatus 200 in this embodiment will be described with reference to FIGS. A GUI 1000 shown in FIG. 10A is a setting screen displayed on the display 210 by the display control unit 203, and has a tab 1001 for managing setting pages in addition to the functions of the GUI 400 shown in FIG. 4A. In the GUI 1000 of FIG. 10A, the tab "1" of the tabs 1001 is displayed in white, indicating that the GUI 1000 currently displays the setting page "1". Further, the setting page "1" holds the first parameter information (the position information of the start partial area and the end partial area, movement parameters, etc.) currently set in FIG. 10A in association with it. Here, when the operation reception unit 202 receives a user operation of pressing the "+" tab of the tab 1001, the display of the GUI 1000 transitions to FIG. 10B. At this time, a setting page "2" is newly added to the GUI 1000 shown in FIG. 10(a), and the setting screen of the setting page "2" is displayed on the GUI 1000 shown in FIG. 10(b). Here, the GUI 1000 shown in FIG. 10(c) displays setting page "2" after movement parameters have been adjusted in the movement parameter designation area 404 in the GUI 1000 of FIG. 10(b). Further, the first parameter information currently set in the GUI 1000 of FIG. 10(c) is stored in association with the setting page "2" shown in the GUI 1000 of FIG. 10(c). At this time, by pressing various tabs of the tab 1001, the displayed setting page can be switched. Assume that the simulation start button 410 is pressed while a certain setting page (for example, setting page “2”) is currently displayed on the GUI 1000 . At this time, according to the first parameter information associated with the certain setting page, the first control unit 205 executes the shot function of the first control process to generate the simulated video. Assume that the operation start button 411 is pressed while the certain setting page is displayed on the GUI 1000 . At this time, the second control unit 205 executes the shot function of the second control process according to the second parameter information set in the setting unit 204 based on the first parameter information associated with the certain setting page.

In this way, the information processing apparatus 200 according to the present embodiment can separately associate and hold the first parameter information for each of the plurality of setting pages. Then, the information processing apparatus 200 in the present embodiment selects the first parameter information used in the shot function of the first control process or the shot function of the second control process from a plurality of pieces of first parameter information according to the user's operation. can do.

Here, information processing of the information processing apparatus 200 according to the present embodiment will be described with reference to the processing of the flow shown in FIG. 11 . 11 is executed by the functional blocks of the information processing device 200 shown in FIG. be done.

First, in S1101, the display control unit 203 acquires a predetermined image from which a partial area is cut out. At this time, the predetermined image may be an image captured by the imaging device 100 or may be a panoramic image. Next, in S1102, the display control unit 203 causes the display 210 to display a GUI for setting the first control process and the second control process. At this time, the display control unit 203 causes the display 210 to display, for example, a GUI 1000 shown in FIG. Next, in S1103, the display control unit 203 acquires information on the tab of the currently designated setting page. When the GUI 1000 of FIG. 10A is displayed, the display control unit 203 acquires "1" as the information of the tab of the currently designated setting page. Next, in S1104, the display control unit 203 determines whether the displayed setting page has been changed by operating the tab. If it is determined that the setting has been changed (Yes in S1104), the process proceeds to S1105, and if it is determined that the setting has not been changed (No in S1104), the process proceeds to S1106. In S1105, the display control unit 203 displays a GUI reflecting the first parameter information held in association with the currently displayed setting page. Next, in S<b>1106 , the first control unit 205 acquires position information of the start partial area and the end partial area currently specified by the user on the image display area 401 of the GUI 400 . Next, in S1107, information on movement parameters currently designated by the user in the movement parameter designation area 404 of the GUI 1000 is obtained. Next, in S1108, the display control unit 203 determines whether or not the simulation start button 410 on the GUI 1000 has been pressed. If it is determined that it is not (No in S1108), the process proceeds to S1110. In S1109, the first control unit 205 performs the first control process according to the first parameter information (the position information of the start partial area and the end partial area, the movement parameter information) recorded in association with the currently displayed setting page. Run the shot function and generate a simulated video. Next, in S1110, the display control unit 203 determines whether or not the operation start button 411 has been pressed. If so (No in S1110), the process returns to S1103. In S1111, the setting unit 203 sets the second parameter information used in the shot function of the second control process based on the first parameter information associated with the currently displayed setting page. Next, in S1112, the second control unit 206 executes the shot function of the second control process according to the set second parameter information.

As described above, the information processing apparatus 200 according to the present embodiment can individually associate and hold the first parameter information for each of the plurality of setting pages. The information processing apparatus 200 according to the present embodiment can select the first parameter information used in the shot function of the first control process or the shot function of the second control process according to the user's operation. By doing so, it is possible to improve the convenience of the setting screen while suppressing an increase in the time required to try the shot function.

(Other embodiments)
Next, with reference to FIG. 12, the hardware configuration of the information processing apparatus 200 for realizing each function of the above embodiment will be described. Note that although the hardware configuration of the information processing apparatus 200 will be described in the following description, the imaging apparatus 100 is also assumed to be realized by the same hardware configuration.

The information processing apparatus 200 in this embodiment has a CPU 1200 , a RAM 1210 , a ROM 1220 , an HDD 1230 and an I/F 1240 .

A CPU 1200 is a central processing unit that controls the information processing apparatus 200 . RAM 1210 temporarily stores computer programs executed by CPU 1200 . Also, the RAM 1210 provides a work area used when the CPU 1200 executes processing. Also, the RAM 1210 functions, for example, as a frame memory or as a buffer memory.

ROM 1220 stores programs and the like for CPU 1200 to control information processing apparatus 200 . The HDD 1230 is a storage device that records image data and the like.

The I/F 1210 communicates with external devices via the network 300 according to TCP/IP, HTTP, or the like.

In the description of each embodiment described above, an example in which the CPU 1200 executes the processing will be described, but at least part of the processing of the CPU 1200 may be performed by dedicated hardware. For example, processing for displaying GUI (GRAPHICAL USER INTERFACE) and image data on the display 210 may be executed by a GPU (GRAPHICS PROCESSING UNIT). Further, the process of reading the program code from the ROM 1220 and developing it in the RAM 1210 may be executed by a DMA (DIRECT MEMORY ACCESS) functioning as a transfer device.

Note that the present invention can also be implemented by processing in which one or more processors read and execute a program that implements one or more functions of the above-described embodiments. The program may be supplied to a system or device having a processor via a network or storage medium. The invention can also be implemented in a circuit (eg, an ASIC) that implements one or more of the functions of the embodiments described above. Also, each part of the information processing apparatus 200 may be realized by hardware shown in FIG. 12, or may be realized by software. Note that another device may have one or more functions of the information processing device 200 according to the above-described embodiment.

As described above, the present invention has been described together with the embodiments, but the above-described embodiments merely show specific examples for carrying out the present invention, and the technical scope of the present invention is interpreted to be limited by these. not a thing That is, the present invention can be embodied in various forms without departing from its technical idea or main features. For example, a combination of each embodiment is also included in the disclosure of this specification.

REFERENCE SIGNS LIST 100 imaging device 200 information processing device 210 display 201 communication unit 202 operation reception unit 203 display control unit 204 setting unit 205 first control unit 206 second control unit

Claims (13)

a first control means for executing a shot function in a first control process for sequentially changing the position or size of a partial area to be cut out from a predetermined image;
Settings for setting second parameter information in the shot function by the second control process for driving at least one of pan, tilt, and zoom of the imaging means based on the first parameter information used in the shot function in the first control process means and
second control means for executing the shot function by the second control process according to the second parameter information set by the setting means;
An information processing device comprising: 2. The information processing apparatus according to claim 1, further comprising display control means for causing a display means to display a setting screen for setting the first parameter information. 3. The information processing apparatus according to claim 2, wherein the setting screen includes a first display area for displaying the predetermined image. In the first display area, a start partial area corresponding to the start position of the shot function of the first control process and an end partial area corresponding to the end position of the shot function of the first control process can be set. 4. The information processing apparatus according to claim 3, characterized by: 5. The information processing apparatus according to claim 4, wherein a frame of said start partial area and a frame of said end partial area are displayed so as to be superimposed on said predetermined image. 6. The setting screen includes a second display area for designating a movement parameter that determines movement time or movement speed in the shot function of the first control process. The information processing device according to the item. 3. When the shot function of the second control process is being executed, information indicating that the shot function of the second control process is being executed is displayed on the setting screen. 7. The information processing device according to any one of 6. The first control means executes the shot function of the first control process according to first parameter information selected according to a user operation from among a plurality of first parameter information including the held first parameter information. 8. The information processing apparatus according to any one of claims 1 to 7, wherein: The first parameter information includes position information of a start partial area corresponding to a start position in the shot function of the first control process and position information of an end partial area corresponding to an end position in the shot function of the first control process. 9. The information processing apparatus according to claim 1, further comprising movement parameter information for determining movement time or movement speed in the shot function of said first control process. The setting means derives a PTZ value corresponding to the start partial area according to position information of the start partial area included in the first parameter information, and derives a PTZ value corresponding to the start partial area according to position information of the end partial area included in the first parameter information. deriving a PTZ value corresponding to the end subregion;
10. The information processing apparatus according to claim 9, wherein said second parameter information includes at least a PTZ value corresponding to said start partial area and a PTZ value corresponding to said end partial area. 11. The information processing according to any one of claims 1 to 10, wherein said predetermined image is an image taken by an imaging means or a panorama image based on an image taken by said imaging means. Device. a first control step of executing a shot function in a first control process of sequentially changing the position or size of a partial region to be cut out from a predetermined image;
Settings for setting second parameter information in the shot function by the second control process for driving at least one of pan, tilt, and zoom of the imaging means based on the first parameter information used in the shot function in the first control process process and
a second control step of executing the shot function by the second control process according to the second parameter information set in the setting step;
An information processing method characterized by having A computer program for causing a computer to function as each means of the information processing apparatus according to any one of claims 1 to 11.

Images