JP2022097021A - Imaging device and imaging processing method - Google Patents

Abstract

To provide an imaging device and an imaging processing method capable of generating display image information for appropriately displaying horizontally long imaging information on a vertically long display device.SOLUTION: An imaging device includes an imaging unit configured to change the shooting magnification, and a distribution information generation unit. In a case in which partial imaging information cut out from each frame shot and acquired at the first shooting magnification by the imaging unit in a preset first cutout range is enlarged at the first magnification to generate the distribution image information, when the shooting magnification changes to the second shooting magnification which is lower than the first shooting magnification, the distribution information generation unit generates partial imaging information of a second cutout range which is smaller than the size of the first cutout range from each acquired frame, and enlarges the partial imaging information in the second cutout range at the second magnification higher than the first magnification, and switches to generate the distribution image information.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image pickup apparatus and an image pickup processing method.

Conventionally, the mainstream of high-definition image pickup devices that are widely used are those having an aspect ratio (horizontal size: vertical size) of 16: 9 on the screen of the image pickup information to be processed. This image pickup device has a high affinity with a device having a horizontally long screen with an aspect ratio of 16: 9, such as a personal computer or a home TV device, and the image pickup information captured by the image pickup device is displayed on the screen of these devices. It can be displayed efficiently.

On the other hand, even in smartphones that have rapidly become widespread in recent years, there are increasing opportunities to visually recognize image information streamed using SNS (social networking service) or the like. Smartphones are often used when the display screen is vertically long, that is, the horizontal size: vertical size is 9:16. Therefore, when trying to visually recognize the image pickup information taken by the image pickup device as described above with a smartphone, the horizontally long image pickup information is displayed in a part of the vertically long display screen, for example, the central part, and the margins and blacks are displayed in the upper and lower parts of the screen. A band part is generated. When a margin or a black band portion is generated in the screen, the display size of the image pickup information becomes smaller by that amount, and there is a problem that it becomes difficult for the smartphone user to visually recognize the image.

In response to such technical problems, Patent Document 1 describes an important region extracted from an image pickup information frame to the minimum size of the distribution aspect ratio in a video distribution device for streaming distribution of a zoomed image of captured image information. A technique is disclosed in which a zoom condition is determined so as to be expanded and a zoom image cut out based on the determined zoom condition is distributed.

Japanese Patent No. 5594842

However, if the optical zoom of the imaging device is changed to the WIDE side while the moving image information captured by the image pickup device is being distributed, the angle of view of the distributed image information for distribution is widened. The size of the subject becomes relatively small. That is, there is an inconvenience that the image of the subject is delivered at a video position not intended by the photographer.

The present invention has been made in view of such a situation, and an object thereof is to continue distribution with the set original angle of view for distribution even if the angle of view for photography is changed by the optical zoom. It is an object of the present invention to provide an image pickup apparatus and an image pickup processing method capable of generating display image information for the purpose.

The image pickup apparatus of the present invention for achieving the above object is
The shooting magnification can be changed, and the image pickup unit that outputs an image signal by performing moving image shooting processing at the set shooting magnification, and frames are sequentially acquired from the image signal, and a predetermined cutout is made from each of the acquired frames. The distribution information generation unit includes a distribution information generation unit that generates partial imaging information in a range and enlarges the generated partial imaging information at a predetermined magnification to generate distribution image information. The distribution information generation unit is the imaging unit. When the partial image pickup information cut out in the preset first cut-out range from each of the frames taken and acquired at the first shooting magnification is enlarged by the first enlargement ratio to generate the image information for distribution. When the shooting magnification changes to a second shooting magnification lower than the first shooting magnification, the partial image pickup information of the second cutting range having a size smaller than the size of the first cutting range is obtained from each acquired frame. It is characterized in that it is generated and the partial image pickup information of the second cutout range is enlarged at a second enlargement ratio higher than the first enlargement ratio to be switched so as to generate the distribution image information.

Further, in the image pickup processing method of the present invention, the shooting magnification can be changed, and an image pickup device provided with an image pickup unit that performs moving image shooting processing at a set shooting magnification is captured and generated by the image pickup unit at the first shooting magnification. When the frames are sequentially acquired, the partial image pickup information of the first cut-out range set in advance is cut out from each of the frames, and the image information for distribution is generated by enlarging at the first enlargement ratio. When the shooting magnification changes to a second shooting magnification lower than the first shooting magnification, the range cut out from each of the acquired frames is changed to a second cutting range having a size smaller than the size of the first cutting range. It is characterized in that the partial image pickup information of the second cutout range is enlarged at a second enlargement ratio higher than the first enlargement ratio to be switched to generate the distribution image information.

According to the image pickup apparatus and the image pickup processing method of the present invention, even if the angle of view for photography is changed by the optical zoom, the image information for display for continuing the distribution with the original angle of view for distribution set. Can be generated.

It is a block diagram which shows the structure of the whole image pickup apparatus by 1st Embodiment of this invention. It is a block diagram which shows the structure of the information generation part for distribution in the image pickup apparatus by 1st Embodiment of this invention. It is a flowchart which shows the operation of the image pickup apparatus according to 1st Embodiment of this invention. (A) is a diagram showing an example of a state in which GUI information for designating a cutout position is superimposed and displayed on the image pickup information captured by the image pickup apparatus according to the first embodiment of the present invention. ) Is a diagram showing an example of image information for distribution generated by cutting out a range specified by GUI information. (A) is a figure which shows an example of the image pickup information which was taken by the image pickup apparatus in the 1st Embodiment of this invention after changing a high image-taking magnification, and (b) is a figure from the image-taking information after changing the image-taking magnification. This is an example of image information for distribution that has been cut out and generated. (A) is a diagram showing an example of image pickup information taken after changing the image pickup magnification to a low level in the image pickup apparatus according to the first embodiment of the present invention, and (b) is a diagram showing an example of image pickup information after the image pickup magnification is changed. This is an example of image information for distribution that has been cut out and generated. (A) is a diagram showing an example of image pickup information taken after changing the image pickup magnification to a low level in the image pickup apparatus according to the first embodiment of the present invention, and (b) is a diagram showing an example of image pickup information after the image pickup magnification is changed. This is an example of image information for distribution that has been cut out and generated. It is a block diagram which shows the structure of the information generation part for distribution in the image pickup apparatus according to 2nd Embodiment of this invention.

Hereinafter, as an embodiment of the present invention, when the captured horizontally long (aspect ratio 16: 9) image pickup information is distributed by SNS, it is suitably displayed on the vertically long (aspect ratio 9:16) display screen of the smartphone. An image pickup device that generates image information capable of generating an image information will be described.

<< First Embodiment >>
<Structure of the image pickup apparatus according to the first embodiment>
The configuration of the image pickup apparatus 1A according to the first embodiment of the present invention will be described with reference to FIG. The image pickup device 1A according to the present embodiment is a device for taking a moving image, and includes a zoom lens 2 as an image pickup unit, a CMOS (Complementary MOS) sensor 3, an input unit 4, a video storage unit 5, and a network IF unit 6. It includes an external monitor IF unit 7, a display unit 8, a storage unit 9, an image processing unit 10, a codec unit 20, and a CPU (Central Processing Unit) 30.

The zoom lens 2 is a lens configured so that the shooting magnification can be changed, and the subject light is incident at a magnification set by the user using a zoom lever (not shown) or the like. The CMOS sensor 3 is an image pickup device that converts subject light incident from the zoom lens 2 into an electric signal. The CMOS sensor 3 outputs the converted electric signal as an image signal such as MIPI (Mobile Industry Processor Interface), sLVDS (sub Low Voltage Differential Signaling), HiSPi (High-Speed Pixel Interface) and the like.

The input unit 4 is composed of key buttons or a touch panel, and inputs user operation information, for example, information for designating a shooting magnification, information for instructing video generation for SNS distribution, or information for specifying an image cropping range, which will be described later. do. In the present embodiment, the touch panel is provided on the display unit 8. The video storage unit 5 is a storage medium for storing information generated by the image processing unit 10 and information generated by the codec unit 20, which will be described later, and is composed of, for example, an SD memory or an SSD (Solid State Drive). .. The network IF unit 6 is an interface for connecting to a predetermined LAN (Local Area Network).

The external monitor IF unit 7 is an interface for connecting to an external television device or display device (not shown), and for example, HDMI (High-Definition Multimedia Interface) or SDI (Serial Digital Interface) standard is used. .. The display unit 8 is a small monitor for confirming captured moving image information, and is, for example, an LCD (liquid crystal display) with a touch panel, an EL display, or the like. The storage unit 9 is a storage medium used when processing is executed by the image processing unit 10 and the codec unit 20, and is composed of, for example, a DDR4 (Double-Data-Rate4) memory or a hard disk.

The image processing unit 10 includes a sensor IF unit 11, a scratch correction / NR (Noise reduction) processing unit 12, a divider processing unit 13, a color reproduction unit 14, a motion detection unit 15, and a shooting magnification information acquisition unit 16. It also has a display information generation unit 17.

The sensor IF unit 11 receives the image signal output from the CMOS sensor 3, converts the serial data into parallel data, and sequentially generates it as a frame. Further, the sensor IF unit 11 extracts the horizontal synchronization signal and the vertical synchronization signal from the received signal and replaces them with the synchronization signal inside the image pickup apparatus 1A. When executing this process, the storage unit 9 may be used.

The scratch correction / NR processing unit 12 acquires the data converted by the sensor IF unit 11 as information to be processed for each frame, and executes so-called scratch data interpolation processing and noise reduction processing included in the corresponding frame. do. As the noise reduction processing, either 2DNR (2-dimensional noise reduction), which processes and executes the processing for each frame, or 3DNR (3-dimensional noise reduction), which analyzes and executes the processing for consecutive frames, may be adopted. When executing this process, the storage unit 9 may be used.

When the CMOS sensor 3 corresponds to the Bayer structure of R, Gr, Gb, B, the divider processing unit 13 converts the frame acquired from the CMOS sensor 3 into the R, G, B structure by the Bayer processing. When the CMOS sensor 3 supports monochrome or a 3CMOS structure, the acquired frame is not subjected to debayer processing. The color reproduction unit 14 performs gamma correction processing and color management processing according to a preset white balance on the acquired frame.

The motion detection unit 15 detects the motion information of the subject from the distribution moving image information generated by the distribution information generation unit 19A of the display information generation unit 17, which will be described later. The shooting magnification information acquisition unit 16 acquires information on the shooting magnification set in the zoom lens 2 via the CPU 30.

The display information generation unit 17 has a main information generation unit 18 and a distribution information generation unit 19A. The main information generation unit 18 generates display image information having an aspect ratio of 16: 9 corresponding to high-definition television or the like from the acquired frame. The generated display image information is sequentially sent from the storage unit 9 to the video storage unit 5 by the CPU 30, and is recorded as the main moving image information.

The distribution information generation unit 19A displays distribution image information from the acquired frame as display information having an aspect ratio of 9:16 to be displayed on a vertical display screen such as a smartphone (not shown) by distribution such as SNS. To generate. The generated image information for distribution is sequentially transmitted from the storage unit 9 to the video storage unit 5 by the CPU 30, and is recorded as moving image information for distribution.

The detailed configuration of the distribution information generation unit 19A will be described with reference to FIG. The distribution information generation unit 19A includes a GUI (Graphical User Interface) display control unit 191, a cutting range setting unit 192, a cutting unit 193, a resizing processing unit 194, and a setting changing unit 195.

When the GUI information generation instruction for SNS distribution is input from the input unit 4, the GUI display control unit 191 is for designating a cutout range of a rectangle having a predetermined size with an aspect ratio of 9:16 from the captured video information. The GUI information is displayed on the display unit 8.

The cutout range setting unit 192 sets the cutout range within the frame specified by the user using the GUI information displayed under the control of the GUI display control unit 191 as the first cutout range. Further, the cutting range setting unit 192 changes the cutting range based on an instruction from the setting changing unit 195, which will be described later.

The cutout unit 193 cuts out the image pickup information of the first cutout range set by the cutout range setting unit 192 as partial image pickup information from the frame shot at a predetermined first shooting magnification. The resizing processing unit 194 resizes the partial image pickup information cut out by the cutting unit 193 for SNS distribution, and generates image information for distribution.

The setting change unit 195 was changed to a second shooting magnification lower than the first shooting magnification during shooting based on the shooting magnification information of the zoom lens 2 acquired by the shooting magnification information acquisition unit 16. When is detected, the cutout range in the frame is changed to the second cutout range having a size smaller than the size of the first cutout range for the cutout range setting unit 192.

Further, when the setting changing unit 195 detects that the shooting magnification of the zoom lens 2 has been returned to the first shooting magnification after changing the cutting range to the second cutting range, the setting changing unit 195 sets the cutting range to the cutting range setting unit 192. Set to return to the first cutout range. Further, when the movement of the subject exceeding a predetermined value is detected in the distribution image information generated after the cutout range is changed to the second cutout range, the setting change unit 195 sets a frame for the cutout range setting unit 192. The inside cutout range is changed to a third cutout range that is larger than the second cutout range and smaller than the first cutout range.

Returning to FIG. 1, the codec unit 20 has a main codec unit 21 and a distribution codec unit 22. The main codec unit 21 encodes the main moving image information generated and stored in the main information generation unit 18 for storage in the video storage unit 5, and temporarily stores the main moving image information in the storage unit 9. After that, the CPU 30 stores the data temporarily stored in the storage unit 9 in the video storage unit 5 in a file format format. It is also encoded when it is transmitted to an external server device or the like via the network IF unit 6. Further, the main codec unit 21 decodes the encoded main moving image information when it is reproduced by the display device or the like from the external monitor IF unit 7 or when it is reproduced by the display unit 8.

The distribution codec unit 22 encodes the distribution moving image information generated by the distribution information generation unit 19B for transmission to an external display device, and stores it in the storage unit 9. Further, the distribution codec unit 22 decodes the encoded distribution moving image information when it is reproduced.

The CPU 30 includes the zoom lens 2, the CMOS sensor 3, the input unit 4, the video storage unit 5, the network IF unit 6, the external monitor IF unit 7, the display unit 8, the storage unit 9, the image processing unit 10, and the codec unit 20. Controls the behavior of.

<Operation of the image pickup apparatus according to the first embodiment>
Next, the operation of the image pickup apparatus 1A according to the present embodiment will be described with reference to the flowchart of FIG. First, when the user performs an operation instructing the start of moving image shooting from the input unit 4, the moving image shooting process is started by the zoom lens 2, the CMOS sensor 3, and the image processing unit 10 set to the first shooting magnification Z1. .. The captured moving image information is displayed on the display unit 8 by the CPU 30.

Next, when the user performs an operation instructing the input unit 4 to create a video for SNS distribution (“YES” in S1), the frame of the video information captured by the GUI display control unit 191 in the image processing unit 10 Therefore, the GUI information for designating the cutout range (first cutout range) of the first size rectangle with an aspect ratio of 9:16 is superimposed on the moving image information and displayed on the display unit 8 (S2).

FIG. 4A shows an example of GUI information superimposed and displayed on the moving image information displayed on the display unit 8. In FIG. 4A, GUI information is displayed on the moving image information of the monkey parent and child. The GUI information includes the frame information G1 having an aspect ratio of 9:16, the horizontal screen center line G2 of the display unit 8, the vertical screen center line G3, and the left for horizontally moving the frame information G1 to the left. Slide the arrow button G4, the right arrow button G5 to move the frame information G1 horizontally to the right, the position determination button G7 to determine the horizontal position of the frame information G1, and the frame information G1 to perform the position determination operation. It has message information G8 that prompts you to do it.

The user operates the left arrow button G4 or the right arrow button G5 from the input unit 4, moves the frame information G1 to a desired position, that is, the position of the subject to be delivered, and operates the position determination button G7. When the position determination button G7 is operated to determine the horizontal position of the frame information G1 (“YES” in S3), the cutout range setting unit 192 sets the first cutout range A1 indicated by the frame information G1 as the cutout range in the frame. Set (S4).

When setting the first cutout range A1 for the captured moving image information, the cutout range setting unit 192 first specifies a predetermined position (for example, the left end position) of the frame information G1 as the cutout start position H1 in the horizontal direction. Also, as the cutout start position V1 in the vertical direction of the cutout range, if the video information to be processed is HD image quality, the position is 1080 pixels vertically from the top or bottom of the frame, and if it is 4K image quality, it is 2160 pixels vertically. Identify the position, that is, the bottom or top of the frame.

Next, the cutout unit 193 cuts out the partial image pickup information of the first cutout range A1 set by the cutout range setting unit 192 from the frame F1 of the moving image information to be processed. Then, the resizing processing unit 194 enlarges (resizes) the partial image pickup information cut out by the cutting unit 193 at a predetermined first enlargement ratio for SNS distribution, and distributes the predetermined size as shown in FIG. 4 (b). Generate image information D1 for. After that, based on the first cutout range A1 set in step S4, image information for distribution is generated for each frame sequentially acquired by shooting (S5).

During shooting, when the user performs an operation to change the shooting magnification of the zoom lens 2 from the first shooting magnification Z1 to the second shooting magnification Z2 from the input unit 4 (“YES” in S6, “YES” in S7), shooting is performed. The magnification information acquisition unit 16 acquires the information of the first shooting magnification Z1 before the change and the information of the shooting magnification Z2 after the change. FIG. 5A shows the frame F2 acquired after the shooting magnification is changed on the display unit 8.

The setting change unit 195 calculates the zoom magnification ratio Z1 / Z2> 1 from the information acquired by the shooting magnification information acquisition unit 16, and recognizes that the change in the shooting magnification is a change in the Wide direction. As shown in FIG. 5A, the setting change unit 195 sets the cutout range set by the cutout range setting unit 192 to be smaller than the size of the first cutout range A1 and has a size calculated by Z2 / Z1. 2 Change to the cutout range A2.

Here, the second cutout range A2 is changed in conjunction with the first cutout range A1 and the zoom magnification ratio.

Assuming that the number of horizontal pixels of the moving image information to be processed is Hpixel and the cutting start position in the first cutting range A1 is counted from the upper left of the screen and is H1, the cutting start position H2 in the horizontal direction of the second cutting range A2 is as follows. It is represented by the equation (1).

H2 = Hpixel / 2 × (1 － Z2 / Z1) + H1 × Z2 / Z1 (1)
The Hpixel is, for example, 1,920 in the case of HD image quality and 3,840 in the case of 4K image quality.

Assuming that the number of vertical pixels of the moving image information to be processed is Vpixel, the cutting start position V2 in the vertical direction of the second cutting range A2 is represented by the following equation (2).

V2 = Vpixel / 2 × (1-Z2 / Z1) (2)
The Vpixel is, for example, 1,080 in the case of HD image quality and 2,160 in the case of 4K image quality.

Of course, Hpixel and Vpixel are not limited to screen sizes such as HD image quality and 4K image quality, but are calculated using equations (1) and (2) by referring to the number of horizontal pixels and the number of vertical pixels of the video information to be processed. can. When the shooting magnification is changed, the first shooting magnification Z1 at the time when the user sets the first cutting range A1 is fixed, and the second shooting magnification Z2, which is the changed shooting magnification, is changed and recalculated. do.

Then, the cutting unit 193 switches the range to be cut out from the frame F2 to be acquired thereafter to the second cutting range A2. The resizing processing unit 194 enlarges the partial image pickup information cut out in the second cutout range A2 by the second enlargement ratio calculated by Z1 / Z2, which is higher than the first enlargement ratio. Then, as shown in FIG. 5B, the resizing unit 194 generates distribution image information having the same size as the distribution image information generated in step S5. After that, based on the changed second cutout range A2, the image information D2 for distribution is generated for each frame sequentially acquired by shooting (S8).

After that, when the user returns the shooting magnification of the zoom lens 2 to the first shooting magnification Z1 from the input unit 4, that is, changes the shooting direction to the Tele direction (“YES” in S9, “YES” in S10), the shooting magnification information The acquisition unit 16 acquires the information of the change. Then, based on the information of the change, the setting change unit 195 returns the setting of the cutting range to the first cutting range A1 (S11).

Then, the cutting unit 193 switches the range to be cut out from the frame F3 to be acquired thereafter to the first cutting range A1. The resizing processing unit 194 enlarges the partial image pickup information cut out in the first cutting range A1 at the first enlargement ratio, and generates the distribution image information D3 in the same range as the processing in step S5. After that, in the changed first cutout range A1, distribution image information is generated for each frame sequentially acquired by shooting (S11).

Further, when the shooting magnification of the zoom lens 2 is not returned to the first shooting magnification Z1 after the cutting range is changed to the second cutting range A2 (“NO” in S9), the motion detection unit 15 generates the image. Detects the movement of the subject in the delivered image information for distribution. For detecting the movement of the subject, existing techniques such as the amount of change in brightness between the front and rear frames and the motion vector information of the subject are used.

Here, when the motion detection unit 15 detects a motion of a predetermined value or more from the image information for distribution (“YES” in S12), the setting change unit 195 shows the set cutout range as shown in FIG. 6A. , Change to the third cutting range A3, which is larger than the second cutting range A2 and smaller than the first cutting range A1.

Then, the cutting unit 193 switches the range to be cut out from the frame F4 to be acquired thereafter to the third cutting range A3. The resizing processing unit 194 enlarges the partial image pickup information cut out in the third cutout range A3 at a third enlargement ratio lower than the second enlargement ratio, and distributes the same size as the distribution image information generated in step S5. Generate image information D4 for. After that, the image information for distribution is generated for each frame sequentially acquired by shooting within the changed cutout range (S13).

After that, the process returns to step S9, and when the shooting magnification of the zoom lens 2 is not returned to the first shooting magnification Z1 (“NO” in S9), a movement of a predetermined value or more is detected from the changed image information for distribution. When (“YES” in S12), the setting change unit 195 changes the set cutout range to the fourth cutout range A4 which is larger than the third cutout range A3 and smaller than the first cutout range A1. After that, the process of step S13 is executed in the same manner as the process described above.

In step S7 of the above-mentioned process, when the user changes the shooting magnification of the zoom lens 2 in the Tele direction during shooting to change the shooting angle of view as shown in FIG. 7A (“NO” in S7). , The range to be cut out from the frame F5 to be acquired after that remains the same as the first cutout range A1. As a result, as shown in FIG. 6B, the distribution image information D5 in which the subject is magnified more than the distribution image information D1 is generated from the cut out partial image pickup information.

Further, when the shooting magnification is further changed in the wide direction in step S10 (“NO” in S10), the process returns to step S8, and the setting changing unit 195 changes the cutting range to a smaller size.

According to the first embodiment described above, horizontally long image information with an aspect ratio of 16: 9 taken by a general image pickup device is distributed as a moving image for a vertically long display device having an aspect ratio of 9:16 on a smartphone. Even if the image angle for shooting is changed by the optical zoom, distribution can be continued with the original image angle for distribution that was set, and even if the subject moves, the subject can be moved from the image for distribution. You can continue delivery and shooting without missing out.

<< Second Embodiment >>
<Structure of the image pickup apparatus according to the second embodiment>
The configuration of the image pickup apparatus 1B according to the second embodiment of the present invention is the first, except that the display information generation unit 17 of the image processing unit 10 has the distribution information generation unit 19B instead of the distribution information generation unit 19A. Since the configuration is the same as that of the image pickup apparatus 1A described in the embodiment, detailed description of the portion having the same function will be omitted.

In the present embodiment, as shown in FIG. 8, the distribution information generation unit 19B includes an MTF information storage unit 196 and an image correction unit 197 in addition to the configuration of the distribution information generation unit 19A described in the first embodiment. is doing.

The MTF information storage unit 196 stores in advance MTF (Modulation Transfer Function) information for each shooting magnification set in the zoom lens 2. When the image correction unit 197 detects that the shooting magnification set in the zoom lens 2 has been changed, it is generated based on the difference between the MTF information of the shooting magnification before the change and the MTF information of the shooting magnification after the change. It is corrected so as to emphasize the edge part of the subject in the image information for distribution.

<Operation of the image pickup apparatus according to the second embodiment>
In the image pickup apparatus 1B according to the present embodiment, distribution image information regarding the captured moving image information is generated by the same processing as that of the image pickup apparatus 1A described in the first embodiment. At that time, when the shooting magnification set in the zoom lens 2 is changed from the first shooting magnification Z1 to the second shooting magnification Z2, the image correction unit 197 detects this.

When the image correction unit 197 detects that the shooting magnification has been changed, the step is based on the difference between the MTF information of the first shooting magnification Z1 and the MTF information of the second shooting magnification Z2 stored in the MTF information storage unit. Correction is made so as to emphasize the edge portion of the subject in the distribution image information generated in S8. Specifically, when the difference between the MTF information of the second shooting magnification Z2 and the MTF information of the first shooting magnification Z1 is large, good image quality can be obtained, so that the degree of emphasizing the edge portion is weakened. On the contrary, when the difference is small or in the negative direction, the image quality is deteriorated, so the correction is made so as to increase the degree of emphasizing the edge portion. In addition, in conjunction with the ratio of the second shooting magnification Z2 and the first shooting magnification Z1, as the second magnification factor Z1 / Z2 becomes larger, the emphasis of the edge portion may be further strengthened.

Further, in order to suppress the cost, the memory capacity of the MTF information storage unit 196 may be reduced or omitted as much as possible. In this case, since the MTF performance of the lens generally deteriorates toward the peripheral portion of the screen, the degree of edge enhancement may be controlled according to the position of the cutting start position H2 in the horizontal direction of the second cutting range A2. For example, if H2 is near the center of the screen, the edge enhancement may be weakened, and as H2 is closer to the left and right edges of the screen, the edge enhancement may be increased. In conjunction with the ratio of the second shooting magnification Z2 and the first shooting magnification Z1, the edge enhancement may be strengthened as the magnification factor Z2 / Z1 becomes larger.

According to the above second embodiment, even when the cut out image information is enlarged, the distribution image information can be clearly generated.

1A, 1B Image pickup device 2 Zoom lens 3 CMOS sensor 4 Input section 5 Video storage section 6 Network IF section 9 Storage section 10 Image processing section 11 Sensor IF section 12 Scratch correction / NR processing section 13 Divider processing section 14 Color reproduction section 15 Movement Detection unit 16 Shooting magnification information acquisition unit 17 Display information generation unit 18 Main information generation unit 19A, 19B Distribution information generation unit 20 Codec unit 21 Main codec unit 22 Distribution codec unit 191 GUI display control unit 192 Cutout range setting unit 193 Cutout unit 194 Resize processing unit 195 Setting change unit 196 MTF information storage unit 197 Image correction unit

Claims (5)

The shooting magnification can be changed, and the image pickup unit that outputs an image signal by performing movie shooting processing at the set shooting magnification,
Frames are sequentially acquired from the image signal, partial imaging information in a predetermined cutting range is generated from each acquired frame, and the generated partial imaging information is enlarged at a predetermined magnification to generate image information for distribution. Information generation unit for distribution and
Equipped with
The distribution information generation unit magnifies the partial image pickup information cut out from each of the frames taken and acquired by the image pickup unit at the first image pickup magnification in a preset first cut-out range at the first enlargement ratio. When the shooting magnification changes to a second shooting magnification lower than the first shooting magnification while generating image information for distribution, the size is smaller than the size of the first cutting range from each acquired frame. The partial image pickup information of the second cutout range of the size is generated, and the partial image pickup information of the second cutout range is enlarged at a second magnifying factor higher than the first magnifying factor to generate the image information for distribution. An image pickup device characterized by switching. The image pickup apparatus according to claim 1, wherein the second cutting range is set based on the ratio of the first photographing magnification and the second photographing magnification. The distribution information generation unit detects movement of a subject of a predetermined value or more in the distribution image information generated after changing the range to be cut out from the acquired frame from the first cutout range to the second cutout range. The claim is characterized in that the range cut out from the acquired frame is changed to a third cutout range larger than the second cutout range and smaller than the first cutout range to generate display image information. Item 2. The image pickup apparatus according to Item 1. An MTF information storage unit that stores modulation transfer function information for each shooting magnification set in the image pickup unit, and
When the imaging magnification changes from the first imaging magnification to the second imaging magnification, the modulation transmission function information of the first imaging magnification and the modulation transmission function information of the second imaging magnification stored in the MTF information storage unit are used. Based on the difference in The image pickup apparatus according to claim 1 or 2, further comprising a unit. An image pickup device equipped with an image pickup unit that can change the shooting magnification and performs movie shooting processing at the set shooting magnification
Frames taken and generated at the first shooting magnification by the image pickup unit are sequentially acquired, partial image pickup information in the first cutout range set in advance is cut out from each of the frames, and the partial image pickup information is enlarged and distributed at the first enlargement ratio. When the shooting magnification changes to a second shooting magnification lower than the first shooting magnification while generating image information for use, the range to be cut out from each of the acquired frames is larger than the size of the first cutting range. Is changed to a second cutout range having a smaller size, and the partial image pickup information of the second cutout range is enlarged at a second magnifying factor higher than the first magnifying factor to generate the image information for distribution. An image pickup processing method characterized by.

Images