JP7257783B2 - Image processing device, image processing method - Google Patents

Description

The present invention relates to a technique for distributing images of imaging areas that are sequentially switched.

2. Description of the Related Art Conventionally, there has been known a network camera system in which a camera is controlled by remote control via a network or a dedicated line, and images captured by the camera are monitored. In addition to being able to control image quality parameters such as camera focus, zoom, exposure, resolution, and white balance, the network has a function to distribute multiple different cropped images during shooting and a function to control the frame rate. I have a camera system.

As for cut-out image distribution settings, there is also known one that has a preset function of pre-storing the cut-out position of the image. Also known is a function of distributing images while switching the cut-out positions of images in order at regular time intervals, and this function is called a preset circulation function. In the preset tour function, a static time, which is an image distribution time at each clipping position, is set, and the clipping position is switched based on the static time. Image distribution during preset tour is performed based on the set value of the frame rate.

For example, in Patent Document 1, based on the feature amount of the data, a continuous display time is specified when an image corresponding to the data whose feature amount is detected is displayed on the display device, and each image is displayed for each continuous display time. is displayed on the display device. For example, in Patent Document 2, a frame rate is set for each of two areas, an OSD portion and a non-OSD portion, of an image synthesized with an OSD.

Japanese Unexamined Patent Application Publication No. 2007-228019 JP-A-2009-265521

However, in the prior art disclosed in Patent Document 1, the light receiving area is divided into a plurality of imaging areas, and the frame rate is set for each imaging area. This technique controls the timing of reading out signals from the light receiving areas for each imaging area based on the set frame rate, and does not switch the frame rate for each specified area registered in the preset tour function.

In addition, in the conventional technology disclosed in the above-mentioned Patent Document 2, frame rate conversion without any adverse effects is realized for video synthesized with OSD. In the prior art disclosed in Patent Document 2, the frame rate conversion process is performed by dividing the area into two areas, the OSD part and the non-OSD part, but the frame rate is not switched for each specified area registered in the preset tour function. .

Furthermore, conventionally, when the preset tour function is executed, even if the degree of attention, purpose, amount of image change, and pause time differ for each area of a wide-area image, only the same frame rate can be set for all cutout positions.

In addition, with the preset tour function, if you want to deliver high-profile areas such as roadways where many fast-moving subjects appear or areas with large changes between frames at a high delivery frame rate, other areas can also be delivered at a high rate. delivered at the frame rate. As a result, there is a problem that the amount of data increases and the network load increases. The present invention provides a technique capable of setting a distribution frame rate individually for each imaging area.

According to one aspect of the present invention, holding means for holding a time for distributing an image corresponding to each of a plurality of distribution target areas set as distribution target image areas in a captured image;
selecting means for sequentially selecting each of the plurality of distribution target areas ;
setting means for setting a distribution frame rate of video corresponding to the distribution target area selected by the selection means based on the time held in the holding means for the distribution target area ;
The image corresponding to the distribution target area selected by the selection means is distributed at the distribution frame rate set by the setting means for the distribution target area for the time held in the holding means for the distribution target area. and
characterized by comprising

According to the present invention, a distribution frame rate can be set individually for each imaging region.

1 is a diagram showing an example of the appearance of a network camera system; FIG. FIG. 2 is a block diagram showing functional configuration examples of a monitoring camera 1000 and a client device 2000; FIG. 4 is a diagram showing an example of each image area (distribution target area); The figure which shows the structural example of GUI. 10 is a flowchart of distribution frame rate setting processing. 4 is a flowchart of processing for setting a distribution frame rate for each image area; FIG. 4 is a diagram showing an example of a distribution frame rate; 4 is a flowchart of processing for setting a delivery frame rate while moving; 4 is a flowchart of processing for setting a distribution frame rate;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that the embodiment described below is an example of a specific implementation of the present invention, and is one of the specific embodiments of the configuration described in the claims.

[First embodiment]
First, the network camera system according to this embodiment will be described with reference to FIG. 1 showing an example of its appearance. As shown in FIG. 1, the network camera system according to this embodiment has a surveillance camera 1000 and a client device 2000 . The monitoring camera 1000 and the client device 2000 are connected to a wired and/or wireless network 1500 and configured to be able to communicate data with each other via the network 1500 .

The surveillance camera 1000 has a pan drive mechanism 1011 , a tilt drive mechanism 1012 and a zoom drive mechanism 1013 , and these drive mechanisms operate according to instructions from the client device 2000 . The pan drive mechanism 1011 is a drive mechanism for changing the imaging direction of the surveillance camera 1000 to the pan direction. The tilt drive mechanism 1012 is a drive mechanism for changing the imaging direction of the surveillance camera 1000 to the tilt direction. A zoom drive mechanism 1013 is a drive mechanism for changing the angle of view of the surveillance camera 1000 .

The client device 2000 is a computer device such as a PC (personal computer), a tablet terminal device, or a smartphone, and performs various settings and instructions for the imaging device 101 and receives captured images output from the imaging device 101 . .

Functional configuration examples of the monitoring camera 1000 and the client device 2000 will be described with reference to the block diagram of FIG. First, a functional configuration example of the monitoring camera 1000 will be described.

The imaging unit 1001 has a lens group (optical system) including a focus lens and a zoom lens, and an imaging element. Light from the outside world is received by an imaging device via an optical system, and an image signal corresponding to the received light is output from the imaging device.

An image processing unit 1002 performs various types of image processing on the image signal from the imaging unit 1001 to generate and output an image signal (captured image) after image processing. Note that the image processing unit 1002 may compress and encode the generated captured image before outputting it.

A lens driving unit 1004 includes a lens group driving system included in the imaging unit 1001 and a motor that serves as a driving source for the driving system. Control distance and zoom. The operation of the lens driving section 1004 is controlled by the lens control section 1005 . A lens control unit 1005 controls the operation of the lens driving unit 1004 according to instructions from the system control unit 1003 .

A pan drive unit 1006 has a mechanical drive system that performs a pan operation of the imaging unit 1001 and a motor that serves as a drive source for the mechanical drive system. Controls the pan angle of 1001. The operation of the pan drive section 1006 is controlled by the pan/tilt control section 1008 .

A tilt drive unit 1007 has a mechanical drive system that performs a tilt operation of the imaging unit 1001 and a motor that serves as a drive source for the mechanical drive system. Controls the tilt angle of 1001. The operation of the tilt drive section 1007 is controlled by the pan/tilt control section 1008 . A pan/tilt control unit 1008 controls operations of the pan drive unit 1006 and the tilt drive unit 1007 according to instructions from the system control unit 1003 .

A recording unit 1009 stores a group of information necessary for the operation of the surveillance camera 1000, such as various information transmitted from the client device 2000 and other information calculated from the information. Details of information recorded in the recording unit 1009 will be described later.

The system control unit 1003 has one or more processors and memory. The processor executes processing using the computer programs and data stored in the memory, thereby controlling the overall operation of the monitoring camera 1000 and executing or controlling each processing described later as performed by the monitoring camera 1000. do.

When receiving a camera control command from the client apparatus 2000, the system control unit 1003 performs processing according to the camera control command. For example, when the system control unit 1003 receives a zoom or focal length change instruction as a camera control command, it instructs the lens control unit 1005 to change the zoom or focal length according to the change instruction. Further, for example, when the system control unit 1003 receives an instruction to change the pan angle as a camera control command, it instructs the pan/tilt control unit 1008 to change the pan angle according to the change instruction. Further, for example, when the system control unit 1003 receives an instruction to change the tilt angle as a camera control command, the system control unit 1003 instructs the pan/tilt control unit 1008 to change the tilt angle according to the change instruction.

The system control unit 1003 also reads and writes information to and from the recording unit 1009 and distributes captured images obtained by the image processing unit 1002 to the client device 2000 . The communication unit 1010 is an interface for performing data communication with the client device 2000 via the network 1500 .

Next, the client device 2000 will be explained. A display unit 2001 is composed of a liquid crystal screen, a touch panel screen, or the like, and can display the processing result of the system control unit 2003 in the form of images, characters, or the like. The display unit 2001 displays, for example, captured images received from the surveillance camera 1000, a GUI (graphical user interface) described below, and the like.

An input unit 2002 is a user interface such as a keyboard, a mouse, and a touch panel screen, and can input various instructions and information to the client device 2000 by user's operation.

The system control unit 2003 has one or more processors and memory. By executing processing using the computer programs and data stored in the memory, the processor controls the overall operation of the client device 2000, and executes or controls each processing described later as performed by the client device 2000. do. A communication unit 2004 is an interface for performing data communication with the surveillance camera 1000 via the network 1500 .

Next, FIG. 3 shows an example of each image area (distribution target area) set as a distribution target image area in an image captured by the monitoring camera 1000. In FIG. A captured image 3001 is a captured image obtained by capturing a wide range with the monitoring camera 1000. On the captured image 3001, an image area 3002 (image area name: A) and an image area 3003 (image area name: B) are displayed. , an image area 3004 (image area name: C) is set. For example, the monitoring camera 1000 distributes a video (captured image of a plurality of frames) corresponding to the image area 3002 to the client device 2000 for a predetermined time at a predetermined distribution frame rate, and then shifts the image area to be distributed from the image area 3002 to the image area 3002 . Switch to 3003. Then, the monitoring camera 1000 distributes the video (captured images of a plurality of frames) corresponding to the image area 3003 to the client device 2000 for a predetermined period of time at a predetermined distribution frame rate. Then, the monitoring camera 1000 distributes the video (captured images of multiple frames) corresponding to the image area 3003 to the client device 2000 for a prescribed time, and then switches the image area to be distributed from the image area 3003 to the image area 3004 . Then, the monitoring camera 1000 distributes the video (captured images of a plurality of frames) corresponding to the image area 3004 to the client device 2000 for a predetermined period of time at a predetermined distribution frame rate. In this way, the image area 3002, the image area 3003, and the image area 3004 are repeated in this order, and the video (captured image of multiple frames) corresponding to the image area is distributed.

Note that there are various methods for distributing the video corresponding to the image areas of interest (image areas 3002, 3003, and 3004), and the method is not limited to a specific method. For example, the surveillance camera 1000 controls the pan, tilt, and zoom of the surveillance camera 1000 to take an image of an image area of interest as an imaging area, and distributes the video obtained by the imaging as "video corresponding to the image area of interest." You can do it. Further, for example, the monitoring camera 1000 picks up the entire image area including the image area of interest (captured image 3001 in the case of FIG. 3), cuts out the image area of interest from the entire image area, and converts the image in the image area of interest into the image area of interest. It may be distributed as "corresponding video".

FIG. 4 shows a configuration example of a GUI for setting the video distribution frame rate corresponding to each of the image areas 3002, 3003, and 3004. In FIG. A GUI 4001 in FIG. 4 is an example of a setting page GUI for setting a distribution frame rate for each image area when setting the preset tour function of the setting page of the monitoring camera 1000, for example. Display control of the GUI 4001 and processing executed in response to user operations on the GUI 4001 are all performed by the system control unit 2003 .

In the GUI 4001 of FIG. 4, "number" is a unique number for each of the image areas 3002, 3003, and 3004, for example, a number representing the distribution order. “Image area name” is the image area name of each of the image areas 3002 , 3003 , and 3004 .

“Still time (seconds)” is the time during which the video corresponding to each of the image areas 3002, 3003, and 3004 is distributed. A “still time (seconds)” corresponding to each of the image areas 3002 , 3003 and 3004 is registered in the recording unit 1009 . When displaying the GUI 4001 , the system control unit 2003 acquires from the recording unit 1009 via the communication unit 2004 the “still time (seconds)” corresponding to each of the image areas 3002 , 3003 , and 3004 , and displays the GUI 4001 . display in place. In the example of FIG. 4, the "still time (seconds)" for the image area 3002 is "10 (seconds)", the "still time (seconds)" for the image area 3003 is "5 (seconds)", and the "still time (seconds)" for the image area 3004 is "10 (seconds)". Time (seconds)” is “10 (seconds)”. In the case of such settings, the monitoring camera 1000 performs the following operations: "distribute 10 seconds of video corresponding to image area 3002→distribute 5 seconds of video corresponding to image area 3003→distribute 10 seconds of video corresponding to image area 3004". The cycle will repeat.

“Frame rate (fps)” is the video distribution frame rate corresponding to each of the image areas 3002 , 3003 , 3004 . A “frame rate (fps)” corresponding to each of the image areas 3002 , 3003 and 3004 is registered in the recording unit 1009 . When displaying the GUI 4001 , the system control unit 2003 acquires the “frame rate (fps)” corresponding to each of the image areas 3002 , 3003 and 3004 from the recording unit 1009 via the communication unit 2004 , display in place. An initial value is set for the “frame rate (fps)” of each of the image areas 3002, 3003, and 3004 initially registered in the recording unit 1009, and updated as appropriate by the processing described later. In the example of FIG. 4, the "frame rate (fps)" for the image area 3002 is "15 (fps)", and the "frame rate (fps)" for the image area 3003 is "10 (fps)". Also, the “frame rate (fps)” for the image area 3004 is “30 (fps)”. In the case of such settings, the monitoring camera 1000 "distributes the video corresponding to the image area 3002 at 15 (fps) → distributes the video corresponding to the image area 3003 at 10 (fps) → distributes the video corresponding to the image area 3004. The cycle of "delivery at 30 (fps)" is repeated.

In the present embodiment, as shown in FIG. 3, for a pedestrian crossing area such as the image area 3002 where there is a high possibility that the movement of people will be relatively large, the "frame rate (fps)" is set to, for example, "15 fps." ” is set. Also, as shown in FIG. 3, for a forest area, such as the image area 3003, which moves relatively less than the image area 3002, a frame rate lower than that of the image area 3002 is set as the "frame rate (fps)". A rate, for example, "10 fps" is set. Also, as shown in FIG. 3, for a road area such as an image area 3004 where fast cars pass, a higher delivery frame rate than the image area 3002, for example, "30 fps", is set as "frame rate (fps)". ” is set.

"Amount of motion" is the amount of video motion measured in advance within each of the image regions 3002, 3003, and 3004 (within the distribution target region). there is The “movement amount” corresponding to each of the image areas 3002 , 3003 and 3004 is registered in the recording unit 1009 . When displaying the GUI 4001, the system control unit 2003 acquires from the recording unit 1009 via the communication unit 2004 "amount of movement" corresponding to each of the image areas 3002, 3003, and 3004, and displays the amount of movement as an indicator. is displayed at the corresponding portion of the GUI 4001 with . The indicator 4005 represents the amount of motion obtained in advance for the video within the image area 3002 (the longer the indicator, the greater the amount of motion). An indicator 4006 represents the amount of motion obtained in advance for the video within the image area 3003 (the longer the indicator, the greater the amount of motion). An indicator 4007 represents the amount of motion obtained in advance for the video within the image area 3004 (the longer the indicator, the greater the amount of motion).

The user can operate the input unit 2002 to designate a line corresponding to an image area for which the distribution frame rate is to be set, among the lines corresponding to the "numbers" of "1" to "3". In FIG. 4, the line with the "number" of "2" is indicated as the line corresponding to the image area for which the distribution frame rate is to be set, and the indicated line is highlighted.

An area 4008 is an area for inputting the "frame rate (fps)" corresponding to the indicated line, and any one of the lines corresponding to the "numbers" of "1" to "3" is When instructed, it becomes valid (a frame rate can be input).

As shown in FIG. 4, the user operates the input unit 2002 to input a desired distribution frame rate in the area 4008 and then presses the button 4009 while the line with the "number" of "2" is indicated. do. At this time, the system control unit 2003 sets the distribution frame rate input in the area 4008 to the image area (the image area 3003 whose image area name is B) corresponding to the instructed line (the line whose “number” is “2”). Set as the corresponding delivery frame rate. With this setting, the system control unit 2003 transmits the distribution frame rate input to the area 4008 to the surveillance camera 1000 via the communication unit 2004 as the distribution frame rate corresponding to the image area 3003 . The system control unit 1003 receives the distribution frame rate transmitted from the client device 2000 via the communication unit 1010 and registers the received distribution frame rate in the recording unit 1009 as the distribution frame rate of the image area 3003 . That is, in the recording unit 1009, the still time, the latest distribution frame rate, and the motion amount are registered for each of the image areas 3002, 3003, and 3004. FIG. Also, the system control unit 2003 displays the distribution frame rate input to the area 4008 at the corresponding location on the GUI 4001 .

In this way, the user designates the line corresponding to the image area for which the distribution frame rate is to be set in the GUI 4001, inputs the distribution frame rate in the area 4008, and then designates the button 4009, whereby the distribution corresponding to the image area is displayed. Frame rate is set.

On the other hand, when the user operates the input unit 2002 to indicate a button 4010, the distribution frame rate corresponding to each image area is changed to the one before change. By instructing the button 4010, the distribution frame rate corresponding to each image area may be returned to the initial value.

By setting the distribution frame rate for each image area using such a GUI 4001, the following effects can be obtained. In other words, when multiple image areas are registered as distribution targets using mechanical PTZ or digital PTZ with a wide range of images, image areas with large movements such as roads with heavy traffic or intersections with many people passing by, or image areas with a high level of attention A high image area can result in a high delivery frame rate. On the other hand, a low distribution frame rate can be set for an image region with little movement or low attention. By setting the distribution frame rate for each image area to be distributed in this way, the amount of data and the network load can be reduced.

Processing for setting the distribution frame rate corresponding to the image area using the GUI 4001 in FIG. 4 will be described with reference to the flowchart in FIG. It is assumed that the GUI 4001 is already displayed on the display unit 2001 at the start of the processing according to the flowchart of FIG.

In step S501, the system control unit 2003 determines whether or not any of the rows corresponding to "1" to "3" in the "number" in the GUI 4001 has been instructed by the user's operation of the input unit 2002 or not. As a result of this determination, if any one of the lines corresponding to the "numbers" of "1" to "3" is indicated by the user's operation of the input unit 2002, the process proceeds to step S502. On the other hand, if none of the lines corresponding to "1" to "3" for "number" is indicated, the process returns to step S501.

In step S502, the system control unit 2003 enables the area 4008 so that the distribution frame rate can be input in the area 4008, and accepts the input of the distribution frame rate.

In step S503, the system control unit 2003 determines whether or not the button 4009 has been designated. As a result of this determination, if the button 4009 has been designated, the process proceeds to step S504, and if the button 4009 has not been designated, the process returns to step S502.

In step S<b>504 , the system control unit 2003 updates the display of the GUI 4001 by displaying the distribution frame rate input in the area 4008 in the “frame rate (fps)” column of the line indicated in the GUI 4001 . Also, the system control unit 2003 transmits the distribution frame rate input in the area 4008 to the monitoring camera 1000 and registers the distribution frame rate in the recording unit 1009 .

In step S505, the system control unit 2003 determines whether or not the user has operated the input unit 2002 to input an instruction to end the distribution frame rate setting process. As a result of this determination, if an instruction to end the distribution frame rate setting process has been input, the process according to the flowchart of FIG. , the process returns to step S501.

As described above, according to the present embodiment, each distribution target area set as a distribution target image area in the captured image is individually selected, and the distribution frame rate of the video corresponding to the selected distribution target area is set to set. This solves the conventional problem that only the same distribution frame rate can be set for all image areas, and makes it possible to reduce the amount of data and the network load.

<Modification of First Embodiment>
The setting of the distribution frame rate for each image area using the GUI 4001 is not limited to being performed when setting the preset tour function, but may be performed when setting related to distribution for each image area.

Also, the system control unit 2003 inputs to the area 4008 according to the length of the indicator corresponding to the indicated line (the length of the indicator 4006 if the "number" of the indicated line is "2"). A range of possible delivery frame rates may be determined and notified to the user. For example, the system control unit 2003 displays the determined range near the area 4008, thereby notifying the user of the range of inputtable distribution frame rates. By limiting the range of the distribution frame rate according to the amount of motion, it is possible to adjust the amount of data according to the motion of the video.

[Second embodiment]
In each of the following embodiments and modifications, including the present embodiment, differences from the first embodiment will be explained, and unless otherwise specified, they are the same as the first embodiment. In the first embodiment, the setting of the distribution frame rate for each image area was performed according to the user's operation. In this embodiment, the monitoring camera 1000 sets the distribution frame rate for each image area. Processing performed by the monitoring camera 1000 to set the distribution frame rate for each image area will be described with reference to the flowchart of FIG.

In step S<b>6001 , the system control unit 1003 acquires “set value a of the maximum frame rate determined by the stream” registered in advance in the recording unit 1009 . In step S6002, the system control unit 1003 obtains the set value (a/2) and stores it in the recording unit 1009. FIG. Hereinafter, the delivery frame rate with the setting value a is referred to as "high delivery frame rate", and the delivery frame rate with the setting value (a/2) is referred to as "low delivery frame rate".

The processing of steps S6003 to S6007 is repeated while image distribution is being performed for each of the image areas 3002, 3003, and 3004. FIG. That is, the processing of steps S6003 to S6007 is performed for the still time corresponding to the image area 3002, and then the processing of steps S6003 to S6007 is performed for the still time corresponding to the image area 3003. FIG. Then, the processing of steps S6003 to S6007 is performed for the static time corresponding to the image area 3004 next. and repeat this.

In step S6004, the system control unit 1003 determines whether or not the static time corresponding to the image area of interest (one of the image areas 3002, 3003, and 3004) is equal to or less than the threshold value t. The threshold value t is obtained in advance and stored in the recording unit 1009. For example, it is the time obtained by dividing the total time of the still times of the image areas 3002, 3003, and 3004 by 3 and dividing the average still time by 2. .

As a result of this determination, if the static time corresponding to the image region of interest is equal to or less than the threshold t, the process advances to step S6005. The process advances to step S6006.

In step S6005, the system control unit 1003 sets the distribution frame rate corresponding to the image area of interest to (a/2). On the other hand, in step S6006, the system control unit 1003 regards the image area of interest as an image area with a high degree of attention, and sets the distribution frame rate corresponding to the image area of interest to a. A distribution frame rate corresponding to each image area is stored in the recording unit 1009 by the system control unit 1003 .

FIG. 7 shows an example of the distribution frame rate set by the process according to the flowchart of FIG. Table 7001 in FIG. 7 shows the static time (static time (seconds)) and the distribution frame rate (frame rate (fps)) for the image areas with "number" of "1" to "5" (image areas A to E, respectively). ) and . Here, the threshold value t=5 and the set value a (maximum frame rate that can be delivered in the stream)=30.

The distribution frame rate corresponding to the image regions B and D whose still time is equal to or less than the threshold value t=5 is a/2=15. On the other hand, the distribution frame rate corresponding to the image regions A, C, and E whose still time is longer than the threshold t=5 is a=30.

As described above, according to the present embodiment, it is possible to distribute a video image of an area with a low degree of attention or an area with a small amount of change between frames (that is, an area where a relatively short static time is set) at a low distribution frame rate. . On the other hand, video in areas with a high degree of attention or areas with a large change amount between frames (that is, areas where a relatively long static time is set) can be distributed at a high distribution frame rate. This makes it possible to reduce the amount of data and the network load.

<Modification of Second Embodiment>
In the second embodiment, the distribution frame rate is set based on the stationary time of the image area. However, the method of setting the delivery frame rate is not limited to this method, and for example, the delivery frame rate may be set according to the amount of movement due to moving object detection, auto slow shutter, and auto scene settings.

For example, if the amount of motion from the video within the image area due to motion detection is less than the threshold, the delivery frame rate for the image area is set to a low delivery frame rate, and if the amount is equal to or greater than the threshold, the delivery frame rate for the image area is set to Have a high delivery frame rate.

Also, in the case of auto slow shutter, if the distribution frame rate is higher than the shutter speed, the distribution frame rate is lowered to match the shutter speed. Next, in the auto scene, for example, if motion is prioritized, the distribution frame rate is increased. Also, when the shutter speed is lowered in the auto scene in a low-light environment, if the delivery frame rate is higher than the shutter speed, the delivery frame rate is lowered to match the shutter speed.

[Third embodiment]
It takes time to switch the image area for distributing video. In particular, it takes time to change the pan, tilt, and zoom of the monitoring camera 1000 so as to set the image area as the imaging area. When video distribution is performed while panning, tilting, and zooming of the surveillance camera 1000 are being changed (during movement), the lower the distribution frame rate during movement, the more discontinuous the distribution video becomes. Therefore, in this embodiment, the setting value a is set for the delivery frame rate during movement.

Processing performed by the monitoring camera 1000 to set the delivery frame rate while moving will be described with reference to the flowchart of FIG. In step S8002, the system control unit 1003 determines whether the pan, tilt, and zoom of the surveillance camera 1000 are being changed (moving). As a result of this determination, if it is moving, the process proceeds to step S8003, and if it is not moving, the process proceeds to step S8004.

In step S8003, the system control unit 1003 sets the current distribution frame rate to the setting value a, thereby distributing the video distributed while moving at the maximum distribution frame rate that can be distributed in the stream.

In step S8004, the system control unit 1003 sets the distribution frame rate corresponding to the destination image area, thereby distributing the video distributed during movement at the distribution frame rate corresponding to the destination image area. .

As described above, according to the present embodiment, as in the first and second embodiments, even when video is distributed at a distribution frame rate lower than the maximum distribution frame rate that can be distributed in a stream, the It becomes possible to distribute video more continuously.

[Fourth embodiment]
When the user has acquired the control authority to change the pan, tilt, and zoom of the surveillance camera 1000, the user operates an operation unit (not shown) provided in the surveillance camera 1000 to pan, tilt, and zoom the surveillance camera 1000. You can change the zoom. In this case as well, as in the third embodiment, when video is distributed while the pan, tilt, and zoom of the surveillance camera 1000 are being changed (during movement), the lower the distribution frame rate during movement, the more discontinuously the distribution video becomes. There is a problem of becoming Therefore, in this embodiment, while the user has the control authority to change the pan, tilt, and zoom of the surveillance camera 1000, the distribution frame rate is set to the above set value a. This is the same in the case where the switching of the image area for distributing the video is implemented by switching the area to be cut out from the captured image.

Processing performed by the monitoring camera 1000 to set the distribution frame rate will be described with reference to the flowchart of FIG. In step S<b>9002 , the system control unit 1003 determines whether or not the user has acquired the control authority to change the pan, tilt, and zoom of the surveillance camera 1000 . As a result of this determination, if the user has acquired the control right, the process proceeds to step S9003, and if the user has not acquired the control right, the process proceeds to step S9004.

For example, the user operates an operation unit (not shown) provided in the monitoring camera 1000 to input an instruction to shift to the mode "the user changes the pan, tilt, and zoom of the monitoring camera 1000". rights can be acquired. On the other hand, the control right is returned to the system control unit 1003 by operating the operation unit to input an instruction to cancel this mode.

In step S9003, the system control unit 1003 sets the current distribution frame rate to the setting value a, thereby distributing the video at the maximum distribution frame rate that can be distributed in the stream.

In step S9004, the system control unit 1003 sets the distribution frame rate corresponding to the recently moved image area, thereby distributing the video at the distribution frame rate corresponding to the recently moved image area.

As described above, according to the present embodiment, even when video distribution is performed at a frame rate lower than the maximum frame rate that can be distributed in a stream as in the first and second embodiments, moving video can be displayed. It is possible to deliver more continuously.

[Fifth embodiment]
In the above embodiment, when processing such as preset tour for distributing video by sequentially switching image areas is stopped, video is distributed at the maximum frame rate that can be distributed in the stream (the above set value a for the distribution frame rate). ).

Also, in the above embodiment, the case of setting and controlling the distribution frame rate has been described. You can do it.

Also, in the above-described embodiment, the setting and control of distribution regarding the still time have been described, but the present invention is not limited to this. Any one of the static time, the continuous display time on the GUI, and the time from starting with the timer function to finishing after a certain period of time may be targeted.

Also, the video distribution destination is not limited to the client device 2000, and the monitoring camera 1000 may distribute video to other devices instead of or in addition to the client device 2000. FIG.

Alternatively, the monitoring camera 1000 and the client device 2000 may be integrated to form a single device, in which case the integrated device executes the operations of the monitoring camera 1000 and the client device 2000 respectively do.

Further, part of the operation of one of the monitoring camera 1000 and the client device 2000 may be performed by the other device, and the processing performed in each of the monitoring camera 1000 and the client device 2000 is not limited to the above example. .

Also, a part or all of the embodiments and modifications described above may be used in combination as appropriate. Further, each embodiment and each modified example described above may be selectively used.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in the computer of the system or apparatus reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

1001: Imaging unit 1002: Image processing unit 1003: System control unit 1004: Lens driving unit 1005: Lens control unit 1006: Pan driving unit 1007: Tilt driving unit 1008: Pan/tilt control unit 1009: Recording unit 1010: Communication unit 2001: Display Unit 2002: Input unit 2003: System control unit 2004: Communication unit

Claims (10)

holding means for holding a time for distributing an image corresponding to each of a plurality of distribution target areas set as distribution target image areas in a captured image;
selecting means for sequentially selecting each of the plurality of distribution target areas ;
setting means for setting a distribution frame rate of video corresponding to the distribution target area selected by the selection means based on the time held in the holding means for the distribution target area ;
The image corresponding to the distribution target area selected by the selection means is distributed at the distribution frame rate set by the setting means for the distribution target area for the time held in the holding means for the distribution target area. and
An image processing device comprising: The setting means preliminarily sets a distribution frame rate of the video corresponding to the distribution target area selected by the selection means if the time held in the holding means is equal to or less than a threshold. A frame rate that is half the maximum distribution frame rate is set, and if the time held in the holding means for the distribution target area selected by the selection means is greater than a threshold, the image corresponding to the distribution target area is reproduced. 2. The image processing apparatus according to claim 1 , wherein a preset maximum distribution frame rate is set as the distribution frame rate . 3. The image processing apparatus according to claim 2 , wherein said threshold value is half of an average time held by said holding means . 4. The setting device according to any one of claims 1 to 3, wherein said setting means sets a preset maximum distribution frame rate while switching a distribution target area for distributing video. Image processing device. 3. The setting means sets a predetermined maximum distribution frame rate while the user has obtained the control authority to change the pan, tilt, and zoom of the image processing apparatus. 5. The image processing apparatus according to any one of 1 to 4 . 6. The image processing apparatus according to any one of claims 1 to 5 , wherein each of the plurality of distribution target areas is an image area cut out from a captured image. 6. The image processing apparatus according to any one of claims 1 to 5 , wherein each of the plurality of distribution target areas is an image area of a captured image obtained by capturing an area within the captured image. . The selecting means selects a second distribution target area different from the first distribution target area when the image corresponding to the first distribution target area is distributed for the time held in the holding means for the first distribution target area. 8. The image processing apparatus according to any one of claims 1 to 7, wherein: 9. The image processing device according to claim 1, wherein said image processing device is a surveillance camera. An image processing method performed by an image processing apparatus having holding means for holding a time for distributing an image corresponding to each of a plurality of distribution target areas set as distribution target image areas in a captured image,
a selection step in which the selection means of the image processing device sequentially selects each of the plurality of distribution target areas ;
a setting step in which setting means of the image processing apparatus sets a distribution frame rate of video corresponding to the distribution target area selected in the selection step, based on the time held in the holding means for the distribution target area; ,
The distribution means of the image processing apparatus distributes the image corresponding to the distribution target area selected in the selection step to the distribution target area at the distribution frame rate set in the setting step for the distribution target area, and the holding means for the distribution target area. The delivery process to deliver for the time held in
An image processing method comprising:

Images