JP2008244586A - Video image processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically zoom a desired zoom range of an image by eliminating the time and effort of an operation. <P>SOLUTION: An image signal 100 obtained with a camera section 2 is converted into a digital motion image signal 101 in an A/D conversion section 3, selected in a graphic generating section 10 and supplied to a monitor 11, and encoded in an encoding section 4 and recorded in a recording device 7. The digital motion image signal 101 is supplied to a subject detecting section 5, and a candidate of the subject (candidate subject) is detected by using edge detection. A parameter calculating section 6 calculates the zoom parameter of a zoom range, including the candidate subject and its zoom magnification rate from the image signal 104 of the candidate subject, and the camera section 2 executes zoom imaging of the zoom range at this zoom magnification rate, on the basis of the zoom parameter 106. Thus, a zoom image is displayed on the monitor 11. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a video processing apparatus capable of discriminating candidate subjects by detecting edge information, motion vector information, or face recognition information, and automatically zooming in on the subject.

  Conventionally, a device that detects the shape of a subject and always performs optimum automatic zoom has been proposed (see, for example, Patent Document 1).

  In the conventional technique described in Patent Document 1, two identical imaging screens are obtained using a secondary coupling lens including a pair of lenses, and the interval between these imaging screens depends on the defocus state of the imaging lens. The distance to the subject is obtained from the distance and the focal length of the imaging lens to obtain a distance image representing the distribution of the distance in the screen, and the size and position of the main subject on the screen are obtained from the distance image. An automatic zoom operation is performed by obtaining the focal length of the imaging lens to be displayed at the size and position of the image, and changing the imaging lens so that this focal length becomes the focal length of the photographing lens. It is.

  As another example, an apparatus that controls the zoom operation of a camera while confirming an image that is actually desired to be zoomed has been proposed (for example, see Patent Document 2).

The prior art described in Patent Document 2 is to perform zooming of a camera by remotely specifying a zoom range from a personal computer or workstation, and zooming the image display device at a size specified by a size specifying means. An image display frame indicating the range is displayed, and the focal length (zoom magnification) is determined according to the size of the image display frame. Here, a photographed image obtained by photographing with the camera B is displayed on the image display device, but the camera is photographed with a smaller focal length as the image display frame is larger, and the image display frame is smaller. The image is taken with a larger focal length, and the image taken from the camera is reduced so as to be displayed within the image display frame as a whole. The user can change the size of the image display frame by operating the size specifying means, thereby enabling the zoom magnification of the camera to be appropriately selected.
JP-A-7-318787 JP-A-9-37132

  By the way, in the prior art described in the above-mentioned patent document 1, there is a problem that the apparatus becomes complicated due to the use of a secondary coupling lens, and it is difficult to reduce the size, and it is disadvantageous in terms of cost. There is also a problem.

  In the prior art described in Patent Document 2, since the range to be zoomed is manually determined, it is good for remote operation such as monitoring. There is a problem that it takes time and effort to set.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a small and inexpensive video processing apparatus capable of solving such a problem and automatically zooming in a desired zoom range of an image without the need for operation.

  In order to achieve the above object, the present invention detects edge information from an image signal of a moving image from a camera unit having an optical zoom function, and detects a subject in a shooting scene of the camera unit as a candidate subject based on the edge information. A detection unit, and a parameter calculation unit that determines a zoom range in a shooting scene including a candidate subject detected by the subject detection unit and a zoom magnification of the zoom range as a zoom parameter, and supplies the zoom parameter to the camera unit Thus, the camera unit zooms the zoom range in the imaging scene with the zoom magnification.

  The present invention also includes a subject detection unit that detects edge information from a moving image signal from a camera unit having an optical zoom function, and detects a subject in a shooting scene of the camera unit as a candidate subject based on the edge information, and a subject detection unit. A parameter calculation unit that determines a zoom range and a zoom magnification of the zoom range in a shooting scene including the detected candidate subject as a zoom parameter, and a zoom image obtained by performing digital zoom processing on a portion of the zoom range in the moving image signal from the camera unit A zoom image generation unit that generates a signal, and a graphic generation unit that supplies one of the moving image signal and the zoom image signal from the camera unit to the monitor, and the parameter calculation unit zooms the determined zoom parameter For the range, the camera unit or the camera unit and zoom image generator The graphic generation unit performs a zoom operation with a zoom magnification of the parameter, and the graphic generation unit receives a moving image signal from the camera unit and a zoom image signal from the zoom image generation unit according to the zoom magnification determined by the parameter calculation unit. Any one of these is selected and supplied to the monitor.

  The present invention further includes an encoding unit that encodes a moving image signal from the camera unit, and a recording unit that records an encoded stream obtained by encoding by the encoding unit on a recording medium, and generates a zoom image. When the digital zoom processing is performed in the unit, the zoom parameter of the zoom range and the zoom magnification set in the zoom image generation unit from the parameter calculation unit is recorded on a recording medium.

  The present invention also provides a subject detection unit that detects edge information from a moving image signal, detects a subject in a shooting scene of the camera unit as a candidate subject based on the edge information, and a shooting scene including the candidate subject detected by the subject detection unit A parameter calculation unit that determines a zoom range and a zoom magnification of the zoom range as zoom parameters, and a zoom image generation unit that generates a zoom image signal by performing digital zoom processing on a portion of the zoom range in the moving image signal from the camera unit, A graphic generation unit that selects one of the moving image signal and the zoom image signal from the camera unit and supplies the selected one to the monitor, and the parameter calculation unit zooms in on the zoom range of the determined zoom parameter. The image generation unit is allowed to perform zoom operation with the zoom magnification of the determined zoom parameter. It is an.

  The graphic generation unit includes a encoding unit that encodes a moving image signal from the camera unit, and a recording unit that records an encoded stream obtained by encoding by the encoding unit on a recording medium. When selecting a zoom image signal from the unit, the zoom parameter of the zoom range and zoom magnification set in the zoom image generation unit from the parameter calculation unit is recorded on a recording medium.

  Further, the present invention provides a sub-image generation unit that sets a zoom range of the zoom parameter determined by the parameter calculation unit, extracts a portion of the zoom range of the moving image signal from the camera unit, and outputs it as a sub-image signal. The graphic generation unit selects the sub image signal and supplies it to the monitor, and the monitor can selectively display a screen in which the sub screen based on the sub image signal is combined with the imaging screen based on the image signal from the camera unit. It is characterized by that.

  The present invention also provides a decoding unit that decodes an encoded stream reproduced from a recording medium by a recording apparatus into a moving image signal, detects edge information from the moving image signal from the decoding unit, and uses the edge information to detect a moving image. A subject detection unit that detects a subject in the signal as a candidate subject, and a parameter calculation unit that determines a zoom range of the scene based on a moving image signal including the candidate subject detected by the subject detection unit and a zoom magnification of the zoom range as zoom parameters; A zoom image generation unit that generates a zoom image signal by performing digital zoom processing on a portion of the zoom range in the moving image signal from the decoding unit at a zoom magnification, and one of the moving image signal and the zoom image signal from the decoding unit A graphic generation unit that supplies one of them to the monitor, and the parameter calculation unit zooms the determined zoom parameter. Relative circumference, is characterized in that to perform the zooming operation of the zoom magnification of the zoom parameters determined to the zoom image generation unit.

  Then, a zoom range of the zoom parameter determined by the parameter calculation unit is set, a sub image generation unit that extracts a zoom range portion of the moving image signal from the decoding unit and outputs it as a sub image signal is provided. The generation unit selects the sub image signal, combines the sub image signal with the moving image signal from the decoding unit, supplies the sub image signal to the monitor, and selectively selects the playback screen of the recording apparatus on which the sub screen is combined on the monitor. It is characterized in that it can be displayed.

  Further, the subject detection unit detects a plurality of candidate subjects to determine the type of the candidate subject, and the parameter calculation unit determines a zoom parameter for each detected candidate subject and generates a zoom moving image according to the type. It is characterized by setting the order of

  According to the present invention, the zoom range of the subject is automatically set for a scene in which the subject is desired to be zoomed during shooting or playback from the recording medium, so that switching to the zoom screen can be realized instantaneously.

  In addition, according to the present invention, a zoom screen can be easily obtained simply by adding to a conventional photographing system or recording system, which is excellent in terms of cost.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a first embodiment of a video processing apparatus according to the present invention, wherein 1 is a video processing apparatus according to this embodiment, 2 is a camera unit, and 3 is A / D (analog / digital) conversion. 4 is an encoding unit, 5 is a subject detection unit, 6 is a zoom parameter calculation unit, 7 is a recording device, 8 is an external command unit, 9 is a sub-image generation unit, 10 is a graphic generation unit, and 11 is a monitor. .

  As shown in FIG. 1, the video processing apparatus 1 includes a camera unit 2 having an optical zoom function, an A / D conversion unit 3, an encoding unit 4, a subject detection unit 5, and a zoom parameter calculation unit 6. And a recording device 7, an external command unit 8, a sub image generation unit 9, and a graphic generation unit 10.

  The analog moving image signal 100 from the camera unit 2 is converted into a digital image signal 101 by the A / D conversion unit 3 and supplied to the encoding unit 4, the subject detection unit 5, the sub image generation unit 9, and the graphic generation unit 10. The When an external command (output image switching command) 203 indicating a normal mode in which the zoom operation is not performed is sent from the external command unit 8, the graphic generation unit 10 receives the digital moving image signal 101 from the A / D conversion unit 3. This is selected and supplied to the monitor 11 as the output moving image signal 108 of the video processing apparatus 1. As a result, the photographing screen 300 of the camera unit 2 as shown in FIG.

  The external command unit 8 outputs a command according to an operation by a user of an operation unit (not shown) as an external command.

  The digital moving image signal 101 output from the A / D conversion unit 3 is also encoded and compressed by the encoding unit 4, and the encoded stream 102 is recorded in the recording device 7. For encoding by the encoding unit 4, MPEG2 and H.264 are used. H.264 or the like is used. The encoding unit 4 detects a motion vector at the time of encoding the digital moving image signal 101 and performs encoding processing of the digital moving image signal 101 using the detected motion vector. While being supplied to the recording device 7 and recorded, it is supplied to the subject detection unit 5.

  The subject detection unit 5 detects edge information representing the contour of the subject in the digital moving image signal 101 supplied from the A / D conversion unit 3 using an edge detection filter, and performs encoding based on the edge information. A candidate for a subject to be zoomed (that is, a candidate subject) is detected using the motion vector 103 from the unit 4, and image information 104 representing the candidate subject is output and supplied to the parameter calculation unit 6.

  In the parameter calculation unit 6, a zoom range including the candidate subject is determined from the image information 104, and a zoom magnification for magnifying and displaying an image of the zoom range including the entire candidate subject on the entire screen of the monitor 11 is determined. The Then, the zoom parameter 105 representing the zoom range is supplied to the sub-image generation unit 9, and the zoom range and the zoom magnification (a zoom magnification equal to the zoom magnification in the zoom parameter 105 supplied to the sub-image generation unit 9) are obtained. The camera zoom parameter 106 shown is supplied to the camera unit 2. Even if the zoom parameter 105 representing the zoom range is supplied in this manner, the camera unit 2 does not perform the zoom operation unless there is an external command (camera zoom control command) 202 for the zoom operation from the external command unit 8.

  The sub image generation unit 9 extracts a portion within the zoom range represented by the zoom parameter 105 from the parameter calculation unit 6 from the digital moving image signal 101 supplied from the A / D conversion unit 3. The moving image signal is supplied to the graphic generation unit 10 as the sub image signal 107.

  The graphic generation unit 10 is controlled in response to the output image switching command 203 from the external command unit 8. When the output image switching command 203 commands the normal mode, A / The digital moving image signal 101 from the D conversion unit 3 is supplied to the monitor 11 as an output moving image signal 108, and a shooting screen 300 when the camera unit 2 shown in FIG. 2A is shooting in the normal mode is displayed. The

  When the output image switching command 203 instructs the zoom range display mode by the operation of the user operation unit, the graphic generation unit 10 adds the sub image to the digital moving image signal 101 from the A / D conversion unit 3. The sub image signal 107 from the generation unit 9 is fitted and synthesized (superimposed), and the synthesized image signal is supplied to the monitor 11 as an output image signal 108. On the monitor 11, as shown in FIG. 2B, a zoom range display screen 302 with a sub surface 301 superimposed on the sub image signal 107 is displayed on a part of the imaging screen 300 in the normal imaging mode.

  Further, when a camera zoom control command 202 for instructing a zoom operation is supplied from the external command unit 8 by a zoom operation on the operation unit, the normal shooting screen 300 shown in FIG. Even if the camera unit 2 is in the normal shooting mode state or in the zoom range display mode state in which the zoom range display screen 302 shown in FIG. Zoom shooting is performed in which the shooting range specified by the zoom range in the camera zoom parameter 106 from the unit 6 is zoomed at the zoom magnification in the camera zoom parameter 106. At the same time, the graphic generating unit 10 supplies the digital moving image signal 101 zoomed from the A / D conversion unit 3 to the monitor 11 as an output image signal 108. As a result, on the monitor 11, as shown in FIG. 2C, zoom shooting is performed so that the sub screen 301 (FIG. 2C) generated by the sub image generation unit 9 is enlarged and displayed on the entire display screen. The mode is executed.

  In the zoom shooting mode in which the zoom shooting screen 300 shown in FIG. 2C is displayed, when the user performs a zoom magnification change operation on the operation unit, the external command unit 8 performs an external operation for changing the zoom magnification. A command (zoom parameter adjustment command) 201 is supplied to the parameter calculation unit 6, and the zoom magnification changed thereby is supplied to the camera unit 2 as the camera zoom parameter 106. Thereby, the camera unit 2 performs zoom shooting at the changed zoom magnification, and the zoom magnification of the zoom shooting screen 303 (FIG. 2C) is changed.

  In the zoom shooting mode, the encoded stream 102 encoded by the encoding unit 4 of the digital moving image signal 101 obtained by zoom shooting is also recorded in the recording device 7 together with the motion vector.

  Incidentally, there may be a plurality of candidate subjects in the scene captured by the camera unit 2. Even in such a case, the subject detection unit 5 recognizes each candidate subject.

  FIG. 3 is a diagram schematically showing a candidate subject detection operation of the subject detection unit 5 in this case. 400 and 401 are subjects, and 500 to 503 are zoom ranges.

  Now, as shown in FIG. 3A, when a subject 400 that is a person and a subject 401 that is a moving object are present in the shooting scene of the camera unit 2, the subject detection unit 5 uses an edge detection filter or the like to detect these subjects. These edges are detected by detecting edges 400 and 401, and each is determined as a candidate subject. Here, the subject 400 is recognized as a human candidate subject 400 by performing face recognition by pattern matching on the contours of the subjects 400 and 401, and the subject 401 is moved by the motion vector 103 from the encoding unit 4. It is recognized as a body candidate subject 401. Although not shown in the figure, a subject other than a person or a moving body (hereinafter referred to as a stationary subject, including a stationary moving body) is also a stationary body by performing recognition processing using face recognition and a motion vector. As a candidate subject.

  In addition, with respect to a person's subject, not only the entire subject but also only the face portion and the upper body portion can be set as candidate subjects.

  When the subject detection unit 5 detects the candidate subjects in this manner, the subject detection unit 5 generates the image signal 104 representing each candidate subject and supplies the image signal 104 to the parameter calculation unit 6. The candidate subject image signal 104 is a moving image signal representing the contour of the candidate subject, and edge information representing each contour differs depending on, for example, the type of candidate subject (person, moving body, or stationary body). Represented by the digital value of the value. Thus, the position and type of each candidate subject on the screen can be determined.

  When the candidate subject image signal 104 is supplied, the parameter calculation unit 6 once holds the image signal in the memory, and then sets a zoom range for each candidate subject. FIG. 3B shows the zoom range set for the candidate subject 400 that is a person and the candidate subject 401 that is a moving object. As the subject 401, a rectangular zoom range 304 including the entire candidate subject 401 is set as shown by a broken line frame. For the human subject 400, the face candidate candidate, the upper body candidate subject, and the entire candidate subject are recognized, and the entire face candidate candidate is included, as indicated by the dashed frame. A rectangular zoom range 500, a rectangular zoom range 501 including the entire upper-body candidate subject, and a rectangular zoom range 502 including the entire human subject are set. Here, the aspect ratio of the set zoom range 500 to 503 is set to be substantially equal to the aspect ratio of the display screen of the monitor 11, and the size thereof corresponds to the size of the candidate subject included therein.

  Further, the parameter calculation unit 6 sets the zoom magnification for each candidate subject from the ratio between the set zoom range size and the display screen size. This zoom magnification represents the magnification at which an image in the zoom range is displayed on the entire display screen.

  Further, when a plurality of candidate subjects are targeted as described above, the parameter calculation unit 6 selects one of the candidate subjects, and supplies the zoom range corresponding thereto to the sub image generation unit 9 as the zoom parameter 105. Accordingly, in the zoom range display mode, the sub screen 301 for the selected candidate subject is displayed as shown in FIG. The selection of the candidate subjects is determined in order, and is performed by the selection operation of the operation unit of the user in FIG. 1. In accordance with this operation, the candidate subject selection command 200 is changed from the external command 8 to the parameter selection. The candidate object is sent to the calculation unit 6 and the candidate object next to the candidate object selected so far is selected. The selection order of the candidate subjects is set in advance by the user. For example, this is repeated in the order of a human candidate subject, a moving subject candidate subject, and a stationary candidate subject. For a human candidate subject, the face candidate subject, upper body candidate subject, and overall candidate subject Order.

  Further, depending on the detection result of the edge information in the subject detection unit 5, the candidate subject 400 may be positioned out of the center of the zoom range 500 as shown in FIG. When zoom shooting is performed within the zoom range 500, the candidate subject 400 is displayed at a position offset toward the corner on the zoom shooting screen 303 shown in FIG. In such a case, the candidate object 400 is positioned at the center of the enlarged zoom range 500a as shown in FIG. 4B by expanding the zoom range 500 as indicated by an arrow 400 by manual operation. Can be.

  For this reason, the operation unit is provided with operation buttons for designating the upper and lower sides and the left and right sides of the zoom range, respectively, and the zoom range can be adjusted by operating any one of these operation buttons. . For example, as shown in FIG. 4A, when the candidate subject 400 is in a position offset to the right side in the zoom range 500, the right side of the zoom range moves to the right by operating the right side operation button. At the same time, the upper side is moved upward and the lower side is moved downward, so that the zoom range 500 is moved to the right while maintaining the aspect ratio (that is, the aspect ratio of the display screen of the monitor 11). Expanding. As a result, as shown in FIG. 4B, the zoom range 500a can be adjusted so that the candidate subject 400 is positioned substantially at the center while keeping the aspect ratio constant.

  As described above, in the first embodiment, since the zoom range is automatically set during shooting, the operation for setting the zoom range is saved, and there are a plurality of candidate subjects. In this case, zoom imaging of any one of the candidate subjects can be selected by the monitor, and the desired candidate subject can be easily zoomed.

  FIG. 5 is a block diagram showing a second embodiment of the video processing apparatus according to the present invention. Reference numeral 12 denotes a zoom image generation unit. The same reference numerals are assigned to portions corresponding to those in FIG. Omitted.

  In this figure, in the second embodiment, a zoom image generating unit 12 is provided, and the camera unit 2 performs optical zooming, and the zoom image generating unit 12 also performs digital zooming to increase the zoom magnification. It can be set.

  The digital moving image signal 101 from the A / D conversion unit 3 is also supplied to the zoom image generation unit 12. Further, the zoom image generation unit 12 is supplied from the parameter calculation unit 6 with an external command (zoom parameter) 109 for the zoom range and zoom magnification for the candidate subject selected as described above. As a result, the zoom image generation unit 12 extracts the zoom range parameter of the zoom parameter 107 from the supplied digital moving image signal 101, and expands the zoom range parameter according to the zoom magnification of the zoom parameter 107. The zoom moving image signal 110 is generated by performing digital zoom processing (at this time, pixel interpolation processing between pixels is performed). The zoom moving image signal 110 is supplied to the graphic generation unit 10.

  Here, in the zoom imaging mode, the camera unit 2 performs optical zoom of the zoom range at a zoom magnification within a certain set zoom magnification range, and parameters according to the size of the zoom range set for the candidate subject. When the zoom magnification obtained by the calculation unit 6 exceeds the range of the zoom magnification set by the camera unit 2, the zoom image generation unit 12 further performs digital zoom.

That is, if the upper limit value of the zoom magnification range of the optical zoom is α _1MAX , the zoom magnification of the optical zoom of the camera unit 2 is α ₁ , and the zoom magnification of the digital zoom of the zoom image generation unit 12 is α ₂ , the parameter calculation unit 6 If the zoom magnification obtained in step is α,
α = α ₁ × α ₂
Because
When α ≦ α _1MAX , α = α ₁ , where α ₂ = 1
In this case, the zoom operation by the optical zoom is performed in the camera unit 2, and the digital moving image signal 101 by the optical zoom passes through the zoom image generation unit 12 and the graphic generation unit 10 as they are to the monitor 11. Supplied. Also,
When α> α _1MAX , α = α _MAX × α ₂ , where α ₂ = α / α _1MAX
In this case, the zoom operation by the optical zoom is performed in the camera unit 2, and the digital moving image signal 101 by the optical zoom is further subjected to the zoom process by the digital zoom in the zoom image generation unit 12. And supplied to the monitor 11.

In the zoom imaging mode, the digital moving image signal 101 optically zoomed by the camera unit 2 is encoded by the encoding unit 4 and is recorded in the recording unit 7 as an encoded stream 102, but α> α _1MAX . When the zoom parameter 111 represents the zoom range of the selected candidate subject calculated by the parameter calculation unit 6 and the zoom magnification α ₂ in the zoom range of the candidate subject in the zoom image generation unit 12 (therefore, the zoom parameter 111 is equal to the zoom parameter 109 supplied to the zoom image generation unit 12) and is supplied to the recording device 7 and recorded together with the encoded stream 102, the motion vector, and the like from the encoding unit 4.

  In this way, in the second embodiment, the same effects as those of the first embodiment can be obtained, and further, zoom photography can be performed with a larger zoom magnification than in the first embodiment. By recording images up to the maximum of optical zoom, there is almost no increase in the amount of information (because it is only the information of the zoom range, so it is very small compared to the image information), and later within the range of optical zoom If you can, you can edit it.

  Note that as a modification of the second embodiment, zooming (digital zoom) may be performed only by the zoom image generation unit 12. In this case, the camera unit 2 does not have a zoom function, and only normal shooting is performed, and the digital moving image signal 101 resulting from the shooting is encoded by the encoding unit 4, and the encoded stream 102 generated thereby moves. It is recorded in the recording device 7 together with the vector and the like. In this case, in the zoom mode by the zoom image generation unit 12, the zoom parameter 111 including the zoom range and the zoom magnification from the parameter calculation unit 6 is recorded in the recording device 7.

  Also in this modified example, the same effects as those of the previous embodiments can be obtained, and the zoom optical system is not necessary for the camera unit 2, and the operation can be further simplified.

  FIG. 6 is a block diagram showing a third embodiment of a video processing apparatus according to the present invention, in which 20 is a video processing apparatus of this embodiment, 21 is a recording apparatus, 22 is a decoding unit, and 23 is a subject detection unit. , 24 is a parameter calculation unit, 25 is an external command unit, 26 is a zoom image generation unit, 27 is a sub-image generation unit, 28 is a graphic generation unit, and 29 is a monitor.

  The third embodiment is applied to a playback device of a recording device. In FIG. 6, a video processing device 20 includes a recording device 21, a decoding unit 22, a subject detection unit 23, and a parameter calculation unit. 24, an external command unit 25, a zoom image generation unit 26, a sub image generation unit 27, and a graphic generation unit 28. An output image signal 128 from the graphic generation unit 28 is supplied to the monitor 29. Is displayed.

The recording device 21 can reproduce the encoded stream from the recording medium by the digital image signal (encoded stream) encoded by the recording device 7 shown in FIG. 1 or FIG. The encoded stream can be reproduced from the recording medium on which the encoded stream is recorded by the other recording apparatus. here,
(1) Although the encoded stream of the image signal zoomed by the optical zoom is recorded on the recording medium recorded by the recording device 7 in FIG. 1, the zoom parameter is not recorded.
(2) On the recording medium recorded by the recording device 7 in FIG. 5, the encoded stream of the image signal zoomed by the optical zoom of the camera unit 2 is also recorded. In this case, the zoom parameter is not recorded. However, a zoom parameter for the digital zoom is recorded for an encoded stream on which the digital zoom is performed.
(3) On the recording medium recorded by the recording device 21 in FIG. 6, an encoded stream of an image that is not zoomed (that is, normal imaging) is recorded, but the zoom parameter is not recorded.

  In the playback operation of the recording device 21, when a zoom parameter is recorded on the recording medium at that time, the zoom parameter is played back along with the playback of the encoded stream for the zoom parameter and supplied to the parameter calculation unit 24 as the zoom parameter 130. Is done.

  In the recording device 21, the encoded stream 120 is reproduced from the recording medium together with the motion vector, and is decoded into the original digital moving image signal 121 supplied to the decoding unit 22. The digital moving image signal 121 is supplied to the graphic generation unit 28, the subject detection unit 23, the sub image generation unit 27, and the zoom image generation unit 26.

  The subject detection unit 23 is the same as the subject detection unit 5 in FIGS. 1 and 5, and the edge information of the digital moving image signal 121 is detected using an edge detection filter to detect the contour of the subject. Detection of a candidate subject and its type (a candidate subject such as a person, a moving object, and a stationary object) are discriminated by using the motion vector 122 used in face recognition by the pattern matching or the decoding unit 22, and an image signal of the candidate subject 123 is generated and supplied to the parameter calculation unit 24.

  Here, the parameter calculation unit 24 takes in the image signal 123 of the candidate subject from the subject detection unit 23 and, like the parameter calculation unit 6 shown in FIGS. 1 and 5, the candidate subject selection command 200 from the external command unit 25. A zoom range and a zoom magnification for the candidate subject selected by the above are obtained. Then, as in the first and second embodiments and the modified example of the second embodiment, the zoom parameter 124 of the zoom range for the selected candidate subject is supplied to the sub-image generation unit 27 and supplied to the sub-image 126. The zoom parameter 125 of the zoom range and zoom magnification is supplied to the zoom image generation unit 26 to generate the zoom moving image signal 127, and the output image from the external command unit 25 by the operation of the user operation unit In response to the switching command 203, any one of the screens of FIGS. 2A, 2B, and 2C is displayed on the monitor 29. FIG.

  When the zoom moving image signal 127 from the zoom image generating unit 26 is selected by the graphic generating unit 28 and a zoom screen as shown in FIG. 2C is displayed on the monitor 29, the zoom range and zoom at that time are displayed. The magnification is supplied as a zoom parameter 129 to the recording device 21, and is recorded in association with the encoded stream reproduced at that time on the recording medium. This indicates that this portion of the encoded stream is zoomed according to the zoom parameter 129.

  Therefore, when reproducing the recording media (1) to (4) above, when reproducing a portion of the encoded stream where the zoom parameter 130 is not reproduced, such processing can be performed. The zoom parameter 129 is newly recorded in the portion where the zoom display is performed.

  When the recording device 21 reproduces the zoom parameter 130 from the recording medium and supplies the zoom parameter 130 to the parameter calculation unit 24, the parameter calculation unit 24 takes in the zoom parameter 130 and generates the zoom image by using the zoom parameter 130 as the zoom parameter 125. Send to part 26. The zoom image generation unit 26 creates a zoom moving image signal 127 using the zoom parameter 125 and supplies it to the graphic generation unit 28. When the parameter calculation unit 24 takes in the zoom parameter 130, the parameter calculation unit 24 sends a zoom image selection command 204 to the external command unit 8. In response to the zoom image selection command 204, the external command unit 8 sends an output image switching command 203 that instructs to select the zoom moving image signal 127 to the graphic generation unit 28. The graphic generation unit 28 selects the zoom moving image signal 127 from the zoom image generation unit 26 by the output image switching command 203 and supplies it to the monitor 29. As a result, a zoom screen enlarged at the zoom magnification of the zoom parameter 125 is displayed on the monitor 29 as shown in FIG.

  In this way, as in the recording media of (2) and (3) above, or even in the recording media of (1) and (4), they are reproduced by the recording device 21 as described above. When the zoom parameter 130 is reproduced by the recording device 21 like the recording medium in which the zoom image generating unit 127 enlarges the image and displays the zoom image on the monitor 29 to record the zoom parameter 129 at that time, this is performed. A portion of the zoom range of the moving image signal reproduced by the recording device 21 according to the zoom parameter 130 is automatically enlarged to be fully displayed on the monitor 29 and zoomed.

  Accordingly, by recording the zoom parameter in association with the encoded stream on the recording medium once zoomed, the zoom screen of the encoded stream can be automatically displayed on the monitor 29 again.

  In this manner, a moving image that has been zoomed once can be reproduced and displayed again in the same zoom state, and the same reproduced image as the previous time can be enjoyed.

  In the above embodiment, only one sub screen for the selected candidate subject is combined with the moving image and displayed on the monitor. However, the sub screens of all candidate subjects are simultaneously displayed on the monitor. Then, the user may select one of them. In this case, the zoom screen of the candidate subject for the selected sub-screen may be automatically selected by the graphic generation unit and displayed on the monitor.

1 is a block configuration diagram showing a first embodiment of a video processing apparatus according to the present invention. FIG. It is a figure which shows typically a specific example of the screen in each mode displayed on the monitor in FIG. It is a figure which shows typically the process with respect to several candidate object in 1st Embodiment shown in FIG. It is a figure which shows typically the correction process of the zoom range in 1st Embodiment shown in FIG. It is a block block diagram which shows 2nd Embodiment of the video processing apparatus by this invention. It is a block block diagram which shows 3rd Embodiment of the video processing apparatus by this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 2 Camera part 3 A / D conversion part 4 Coding part 5 Subject detection part 6 Parameter calculation part 7 Recording apparatus 8 External command part 9 Sub image generation part 10 Graphic generation part 11 Monitor 12 Zoom image generation part 100 Shooting Image signal 101 Digital image signal 102 Encoded stream 103 Motion vector 104 Image after subject detection 105 Zoom parameter 106 Camera zoom parameter 107 Sub image 108 Output image 200 Candidate subject selection command 201 Zoom parameter adjustment command 202 Camera zoom control command 203 Output image Switching command 300 Normal shooting screen 301 Sub screen 302 Zoom range display screen 303 Zoom shooting screen 400, 401 Candidate subjects 500, 500a, 501 to 503 Zoom range

Claims (9)

A subject detection unit that detects edge information from an image signal of a moving image from a camera unit having an optical zoom function, and detects a subject in a shooting scene of the camera unit as a candidate subject based on the edge information;
A parameter calculation unit that determines a zoom range in the shooting scene including the candidate subject detected by the subject detection unit and a zoom magnification of the zoom range as a zoom parameter, and supplies the zoom parameter to the camera unit By doing so, the camera unit causes the zoom range in the imaging scene to be zoomed at the zoom magnification. A subject detection unit that detects edge information from a moving image signal from a camera unit having an optical zoom function, and detects a subject in a shooting scene of the camera unit as a candidate subject based on the edge information;
A parameter calculation unit that determines a zoom range in the shooting scene including the candidate subject detected by the subject detection unit and a zoom magnification of the zoom range as zoom parameters;
A zoom image generation unit for generating a zoom image signal by digitally zooming a portion of the zoom range in the moving image signal from the camera unit;
A graphic generation unit that supplies either a moving image signal from the camera unit or the zoom image signal to a monitor;
The parameter calculation unit causes the camera unit or the camera unit and the zoom image generation unit to perform a zoom operation with the zoom magnification of the zoom parameter determined for the zoom range of the determined zoom parameter,
The graphic generation unit selects either the moving image signal from the camera unit or the zoom image signal from the zoom image generation unit according to the size of the zoom magnification determined by the parameter calculation unit. A video processing apparatus characterized by being supplied to a monitor. In claim 2,
An encoding unit for encoding a moving image signal from the camera unit;
A recording unit that records an encoded stream obtained by encoding by the encoding unit on a recording medium,
When digital zoom processing is performed in the zoom image generation unit, a zoom parameter of a zoom range and a zoom magnification set in the zoom image generation unit from the parameter calculation unit is recorded on the recording medium. apparatus. A subject detection unit that detects edge information from a moving image signal and detects a subject in a shooting scene of the camera unit as a candidate subject based on the edge information;
A parameter calculation unit that determines a zoom range in the shooting scene including the candidate subject detected by the subject detection unit and a zoom magnification of the zoom range as zoom parameters;
A zoom image generation unit for generating a zoom image signal by digitally zooming a portion of the zoom range in the moving image signal from the camera unit;
A graphic generation unit that selects one of the moving image signal from the camera unit and the zoom image signal and supplies the selected signal to a monitor;
The video processing apparatus, wherein the parameter calculation unit causes the zoom image generation unit to perform a zoom operation with the zoom magnification of the determined zoom parameter for the determined zoom range of the zoom parameter. In claim 4,
An encoding unit for encoding a moving image signal from the camera unit;
A recording unit that records an encoded stream obtained by encoding by the encoding unit on a recording medium,
When the graphic generation unit selects a zoom image signal from the zoom image generation unit, the zoom parameter of the zoom range and zoom magnification set in the zoom image generation unit from the parameter calculation unit is recorded on the recording medium. A video processing apparatus characterized by that. In any one of Claims 1-5,
A sub-image generation unit configured to set the zoom range of the zoom parameter determined by the parameter calculation unit, extract a portion of the zoom range of the moving image signal from the camera unit, and output as a sub-image signal Provided,
The graphic generation unit selects the sub image signal and supplies the selected sub image signal to the monitor. The monitor selectively selects a screen in which the sub screen based on the sub image signal is combined with the imaging screen based on the image signal from the camera unit. A video processing apparatus characterized in that it can be displayed on the screen. A decoding unit for decoding an encoded stream reproduced from a recording medium by a recording device into a moving image signal;
A subject detection unit that detects edge information from a moving image signal from the decoding unit, and detects a subject in the moving image signal as a candidate subject based on the edge information;
A parameter calculation unit that determines a zoom range of the scene based on the moving image signal including the candidate subject detected by the subject detection unit and a zoom magnification of the zoom range as zoom parameters;
A zoom image generation unit that generates a zoom image signal by digitally zooming a portion of the zoom range in the moving image signal from the decoding unit at the zoom magnification;
A graphic generation unit that supplies either the moving image signal from the decoding unit or the zoom image signal to a monitor;
The video processing apparatus, wherein the parameter calculation unit causes the zoom image generation unit to perform a zoom operation with the zoom magnification of the determined zoom parameter for the determined zoom range of the zoom parameter. In claim 7,
A sub-image generation unit that sets the zoom range of the zoom parameter determined by the parameter calculation unit, extracts a portion of the zoom range of the moving image signal from the decoding unit, and outputs the extracted portion as a sub-image signal Provided,
The recording apparatus in which the graphic generation unit selects the sub image signal, combines the sub image signal with the moving image signal from the decoding unit, supplies the sub image signal to the monitor, and combines the sub screen A video processing apparatus characterized in that the playback screen can be selectively displayed on the monitor. In any one of Claims 1-8,
The subject detection unit detects a plurality of candidate subjects to determine a type of the candidate subjects;
The image processing apparatus, wherein the parameter calculation unit determines the zoom parameter for each detected candidate subject and sets the order of zoom moving image generation according to the type.

Images