JP2019033437A - Image processing apparatus, control method thereof, storage medium, and program - Google Patents

Abstract

To reduce the user's workload by automating the task of placing markers.SOLUTION: An image processing apparatus includes acquisition means for acquiring an input image and generating means for generating a display image by superimposing a marker indicating a cut-out region obtained by cutting out the input image at a predetermined aspect ratio onto the input image, and when the input image includes an image area and an image outside area arranged around the image area, the generation means combines the marker indicating the cut-out region obtained by cutting out the input image at the predetermined aspect ratio with the input image.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image processing apparatus capable of superimposing and displaying an aspect marker on a display image, a control method thereof, a storage medium, and a program.

  When shooting a movie, an anamorphic lens may be used to shoot a video. The anamorphic lens is a lens that can optically convert the aspect ratio of the shooting angle of view and input it to a camera sensor. Accordingly, for example, a sensor capable of capturing an image having an aspect ratio (4096: 2160) of DCI 4K has a wider angle of view than that obtained by using a conventional lens, for example, an aspect ratio of 2.39 used in a movie. : 1 (horizontal: vertical) images can be recorded. In this case, an image in which the shooting angle of view with an aspect ratio of 2.39: 1 is optically reduced in the horizontal direction by the anamorphic lens is acquired. Therefore, the image acquired by the sensor is in a state in which the subject is vertically distorted.

  Before an image captured using an anamorphic lens is displayed on a display device such as an external display or an electronic viewfinder, the image is subjected to a process for restoring the aspect ratio (desk easing process) to obtain an image from the imaging apparatus. Output to the display device. The aspect ratio of the image obtained by the desk easing process is equivalent to the shooting angle of view. When the aspect ratio of the image output from the imaging device is different from the aspect ratio of the image obtained by the desqueezing process, the imaging apparatus combines the image obtained by the desqueezing process with a black band (letter box) and outputs it. Generate an image. For example, it is assumed that the aspect ratio of the image obtained by the desqueezing process is 2.39: 1, and the aspect ratio of the image output from the imaging device is the DCI 4K aspect ratio (4096: 2160). In this case, the imaging apparatus generates an output image having an aspect ratio of DCI 4K by combining black bands on the upper and lower sides of the image obtained by the deskize process. For example, in Patent Document 1, when a video with an aspect ratio of 4: 3 is transmitted to a display device having a wide screen with an aspect ratio of 16: 9, black bands are added to the left and right of the video to match the size of the wide screen. It is described that video is transmitted.

  In some cases, an image is produced by adjusting the aspect ratio of the image acquired from the imaging apparatus. The display device has a function of displaying a marker (aspect marker) indicating a region (cutout region) after being cut out on the screen of the display device so that a user who adjusts the image after adjusting the aspect ratio can easily recognize the display device. There is a case. The position of such a marker is determined so as to cut out a part of the input image.

Japanese Patent Application Laid-Open No. 07-203404

When an aspect marker is generated based on an input image, an area including a black belt synthesized for outputting an image from the imaging apparatus may be indicated as an image area after being cut out. For example, as described above, when an image obtained by synthesizing a black band on a 2.39: 1 image captured using an anamorphic lens is input, a black band image (outside image area) outside the upper and lower synthesized image is input. A region including may be indicated by an aspect marker. Since the user wants to confirm the area corresponding to the specified aspect ratio in the shooting angle of view, it has been necessary to manually adjust the position and size of the aspect marker.
In view of the above problems, an object of the present invention is to provide an image processing apparatus capable of arranging a marker at an appropriate position even in an image including a region outside the image, and a control method thereof.

  The first aspect of the present invention is an acquisition unit that acquires an input image, and a generation unit that generates a display image by superimposing a marker indicating a target area of a predetermined aspect ratio on the input image. When the input image is an image including an image area and an outside image area arranged around the image area, the generation unit is configured such that the target area indicated by the marker is the outside image area. The image processing apparatus is characterized in that the marker is combined with the input image so as not to include the image.

  The second aspect of the present invention is an acquisition unit that acquires an input image, a generation unit that generates a display image by superimposing a marker indicating a cutout region obtained by cutting out the input image with a predetermined aspect ratio on the input image, And the generation unit cuts out the image area with the predetermined aspect ratio when the input image is an image including an image area and an outside image area arranged around the image area. Provided is an image processing apparatus characterized in that a marker indicating a cutout region is combined with the input image.

  The third aspect of the present invention is an acquisition step of acquiring an input image, a generation step of generating a display image by superimposing a marker indicating a target area of a predetermined aspect ratio on the input image, of the input image, And when the input image is an image including an image region and a non-image region arranged around the image region, in the generation step, the target region indicated by the marker is outside the image. There is provided a control method of an image processing apparatus, wherein the marker is combined with the input image so as not to include a region.

  The fourth aspect of the present invention is an acquisition step of acquiring an input image, a generation step of generating a display image by superimposing a marker indicating a cutout region obtained by cutting out the input image with a predetermined aspect ratio on the input image, In the generation step, when the input image is an image including an image region and a non-image region arranged around the image region, the image region is cut out with the predetermined aspect ratio. A control method for an image processing apparatus is provided, wherein a marker indicating a cutout region is combined with the input image.

According to a fifth aspect of the present invention, there is provided a computer-readable recording medium storing a program for causing a computer to execute each step of the control method of the image processing apparatus according to the present invention.
According to a sixth aspect of the present invention, there is provided a program for causing a computer to execute each step of a control method for an image processing apparatus according to the present invention.

  According to the present invention, it is possible to place a marker at an appropriate position even in an image including a region outside the image.

1 is a block diagram illustrating a configuration example of a photographing system according to Embodiment 1. FIG. FIG. 3 is a diagram illustrating a configuration example of each unit of the display device and the imaging device according to the first embodiment. FIG. 6 is a diagram illustrating an example of a flow of processing in the imaging apparatus according to the first embodiment. It is a figure which shows the example of a desk easing process. It is a figure which illustrates a letterbox image | video. FIG. 6 is a diagram illustrating an example of a process flow in the display device according to the first embodiment. It is a figure which illustrates aspect marker display control information. It is a figure which shows the 1st example of the setting of aspect marker display control information. It is a figure which shows the example of a display of an aspect marker. It is a figure which shows the 2nd example of the setting of aspect marker display control information. It is a figure which shows the example of a structure of each part of the display apparatus of Example 2, and an imaging device. FIG. 10 is a diagram illustrating an example of a process flow in the display device according to the second embodiment. It is a figure which shows the example of the cut-out in a prior art example. It is a figure which illustrates the aspect marker of a prior art example and the Example of this invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In each drawing, the same components are denoted by the same reference numerals in principle, and redundant description is omitted. Further, numerical values and the like exemplified for embodying the description are not limited to these unless otherwise specified.
Further, the present invention is not limited to the following examples, and can be appropriately changed without departing from the gist thereof. For example, each configuration of the following embodiments may be appropriately modified or changed depending on the configuration of the apparatus to which the present invention is applied and various conditions.

<Example 1>
(Overall configuration of the shooting system)
FIG. 1 is a block diagram illustrating a configuration example of an imaging system 1 according to the first embodiment. The imaging system 1 includes a display device 100 and an imaging device 101, and the display device 100 and the imaging device 101 communicate via a transmission path 103.
The imaging device 101 is another device outside the display device 100. The imaging apparatus 101 includes an anamorphic lens 102 in which a lens rear lens is vertically longer than a normal lens, and an image that is reduced by a factor of 1.1.33 in the horizontal direction is captured by the anamorphic lens 102. Hereinafter, the reduced image reduced in the horizontal direction (or vertical direction) is referred to as an anamo video. Further, the horizontal reduction magnification of the anamorphic video is called squeeze magnification. Note that the squeeze magnification is not limited to 1 / 1.33 times, and may be other magnifications such as ½ times.
The photographing apparatus 101 generates a cinesco image (expanded image) by desqueezing the anamorphic image, and generates a letterbox image (input image) by adding a black belt (outside image area) around the cinesco image. . Then, the photographing apparatus 101 transmits a letterbox image to the display apparatus 100 via the transmission path 103.
It is assumed that transmission conforming to the SDI (Serial Digital Interface) transmission specification is performed on the transmission path 103. SDI is standardized by SMPTE (Society of Motion Picture and Television Engineers).

  The display device 100 determines whether or not the video received from the photographing device 101 has been desqueezed, and if the video has been desqueezed, the aspect marker is displayed superimposed on the letterbox video. This aspect marker indicates the range of the video after being cut out when the Sinesco video is cut out to have an aspect ratio of 16: 9. That is, the aspect marker indicates the boundary between the cutout area and the other area when the letterbox video is cut out. In this embodiment, it is assumed that the aspect ratio of the aspect marker is 16: 9, which matches the aspect ratio of the wide screen. A display example of the aspect marker will be described later.

(Configuration of Each Part of Display Device and Imaging Device of Example 1)
FIG. 2 is a diagram illustrating a configuration example of each unit of the display device 100 and the imaging device 101 according to the first embodiment.
The photographing apparatus 101 includes a photographing unit 110, a deskize processing unit 111, and a transmission unit 112. The imaging unit 110 generates an anamorphic image captured by the anamorphic lens 102.
The desk ease processing unit 111 performs desk ease processing on the anamorphic video (reduced image) to obtain a horizontally long cinesco video (expanded image). Here, in this embodiment, it is assumed that the aspect ratio of the Sinesco video is 2.39: 1 (predetermined aspect ratio).
Subsequently, the deskize processing unit 111 reduces the Sinesco video according to the resolution of EVF (Electric Viewfinder) or the resolution of the video signal transmitted through the transmission path 103. Further, the deskize processing unit 111 generates a letterbox video (input image) to which black bands (outside image areas) adjacent to the upper and lower sides of the Sinesco video are added. The black belt indicates a black belt-like image having an RGB value (0, 0, 0). The black belt is a belt-like region provided around the image region, and may be a color other than black.
The transmission unit 112 transmits the letterbox video to the display device 100.

The display device 100 includes an IF unit 200, a display control unit 203, a display unit 204, an operation instruction unit 205, and an image processing device 210. In addition, the image processing apparatus 210 includes an additional information acquisition unit 201, an image processing unit 202, a deskew processing determination unit 206, and an aspect marker display control unit 207. The image processing apparatus 210 has a function of generating an aspect marker and synthesizing it with a video signal.
The IF unit 200 is an input IF (Interface) for a video signal. The IF unit 200 inputs and decodes a data stream composed of the SDI transmission specifications, and outputs ancillary data and a video signal (image data) to the additional information acquisition unit 201.

  Here, the ancillary data is information indicating the transmission specification of the video signal defined by the SDI transmission specification and various characteristics of the video to be transmitted. For example, the ancillary data includes information such as a sampling structure of a video to be transmitted, a pixel depth, a frame rate, a time code, a signal type, a mapping format, audio information, a link type, and resolution information. Furthermore, the ancillary data includes an area where the user can store arbitrary information. In this embodiment, additional information used in the display device is stored. In the present embodiment, it is assumed that deskew processing information indicating whether or not the deskize processing function is performed, information indicating whether or not a black belt image is added, and the like are included in the video signal as additional information.

The additional information acquisition unit 201 acquires information on the input image from the ancillary data of the video signal acquired from the IF unit 200. The additional information acquisition unit 201 acquires deskew processing information and video signal resolution information from the ancillary data. The additional information acquisition unit 201 outputs the acquired deskease processing information and the resolution information of the video signal to the deskease processing determination unit 206. The resolution information is size information indicating the resolution (number of pixels) in the vertical direction (vertical direction) and the horizontal direction (horizontal direction) of the video signal. Further, the additional information acquisition unit 201 outputs a video signal to the image processing unit 202.
The desk ize processing determination unit 206 determines whether the video signal is a sine sco video that has been subjected to the desk easing process based on the desk easing processing information input from the additional information acquisition unit 201. If the video has been subjected to the deskize process, the deskize process determination unit 206 outputs the resolution information input from the additional information acquisition unit 201 to the aspect marker display control unit 207. On the other hand, when the video is not desqueezed, the descrambling determination unit 206 may not output resolution information to the aspect marker display control unit 207.

The aspect marker display control unit 207 generates aspect marker display control information using the resolution information of the video signal and outputs it to the image processing unit 202. Here, the aspect marker display control information determines the size and position of the aspect marker indicating the range of the video (displayed image) when the aspect ratio of the Sinesco video in the image area is changed to an aspect ratio of 16: 9. It is information for. It is assumed that the aspect marker is an image that indicates a cut-out position when a Sinesco video is cut into an image with a specified aspect ratio. Based on this aspect marker display control information, the size of the aspect marker is set so that either the vertical or horizontal size of the range indicated by the aspect marker matches the size of the image area. Further, the position where the aspect marker is displayed is set by the aspect marker display control information so that the range indicated by the aspect marker is inscribed in the image area.

The operation instruction unit 205 is an interface that accepts designation of whether or not to display an aspect marker, designation of the position of an aspect marker, and the like. The operation instruction unit 205 outputs an operation instruction from the user to the aspect marker display control unit 207.
The image processing unit 202 synthesizes the aspect marker with the letterbox image based on the aspect marker display control information, and inputs the letterbox image with the aspect marker superimposed thereon to the display control unit 203. The aspect marker is synthesized so as not to overlap the black belt portion. Note that the image processing unit 202 may perform various types of image processing on the video signal in addition to displaying the aspect marker.
The display control unit 203 displays a video on the display unit 204 based on the letterbox video input from the image processing unit 202.
The display unit 204 displays the letterbox video in the display area according to the control from the display control unit 203.

(Processing flow in the imaging device)
First, processing in the photographing apparatus will be described.
FIG. 3 is a diagram illustrating an example of a processing flow in the imaging apparatus 101 according to the first embodiment.
In step S300, the imaging unit 110 acquires an anamorphic image captured by the anamorphic lens 102. For example, the anamorphic image has a squeeze magnification of 1 / 1.33 times, and the subject is distorted vertically. Note that the above-described squeeze magnification is an example, and an anamorphic lens having another squeeze magnification may be used.

In step S <b> 301, the desk easing processing unit 111 performs a desk easing process on the anamorphic video and expands it in the horizontal direction to obtain a horizontal video. This desk easing process eliminates the distortion of the subject. For example, the desk squeeze processing unit 111 generates a horizontally long image having a size obtained by extending the horizontal length of an anamorphic image to a reciprocal (1.33 / 1) times the squeeze magnification (1 / 1.33). .
Since the horizontally long video after desk easing is slightly longer in the horizontal direction than the Sinesco video (the aspect ratio is large), the desk easing processing unit 111 cuts out and removes the vicinity of the left edge and the right edge of the horizontal video. As a result, a Sinesco image having an aspect ratio of 2.39: 1 is generated.
FIG. 4 is a diagram illustrating an example of the desk easing process. FIG. 4 shows a horizontally long image 400 after desk easing and a sinesco image 401 in a shaded area. The left and right portions that do not overlap the shaded portion of the horizontally long image 400 after desk easing are cut out and removed. For example, when the resolution of the video signal after desqueezing is 5448 × 2160, the desqueezing processing unit 111 cuts out the left and right dotted lines so that the resolution of the video signal is 5162 × 2160, and the left end of the horizontally long video And remove the right edge.

In step S302, the deskize processing unit 111 adds a black band having a width corresponding to the resolution of the video signal to the top and bottom of the cinesco video to generate a letterbox video.
5A and 5B are diagrams illustrating letterbox images. FIG. 5A is a letterbox image 500a in which a Sinesco image 501a is contained in an image signal having a resolution of 3840 × 2160.
The numerical values listed in the left column of FIG. 5A are the number of valid lines, and the numerical values listed in the upper row are the number of valid samples. The Sinesco video is shaded and displayed in an image area with an aspect ratio of 2.39: 1, and black bands 502a (outside image areas) are added above and below the Sinesco video. The same applies to FIG. 5B.

  Specifically, the deskize processing unit 111, when storing a cinesco image 501a having an aspect ratio of 2.39: 1 in an image having the same size as the image signal having a resolution of 3840 × 2160, the left side and the right side of the cinesco image 501a Is inscribed in a size. Further, the desk easing processing unit 111 arranges the Sinesco video 501a in the middle of the letterbox video 500a. Further, the desk easing processing unit 111 adds a black band 502a having 276 effective lines to the upper range of 1 to 276 effective lines and the lower range of 1885 to 2160 of the cinesco image 501a. In this case, the number of effective lines of the Sinesco video 501a is 1608 lines. As a result, a letterbox image 500a having a resolution of 3840 × 2160 is generated.

  FIG. 5B shows a letterbox image 500b in which a video signal with a resolution of 4096 × 2160 contains a Sinesco image 501b with an aspect ratio of 2.39: 1. The deskize processing unit 111 has a size in which the left side and the right side of the cinesco image 501b are inscribed when the cinesco image 501b having an aspect ratio of 2.39: 1 is stored in an image having the same size as the image signal having a resolution of 4096 × 2160. To do. Further, the desk easing processing unit 111 arranges the Sinesco video 501b in the middle of the letterbox video 500b. Further, the deskize processing unit 111 adds a black belt 502b having 224 effective lines to the upper range of 1 to 224 effective lines and the lower range of 1937 to 2160 of the Sineco video 501b. In this case, the number of effective lines of the Sinesco video 501b is 1712 lines. As a result, a letterbox image 500b having a resolution of 4096 × 2160 is generated. As described above, the size of the Sinesco video and the width of the black belt are determined by the resolution of the video signal.

  Returning to FIG. In step S303, the transmission unit 112 transmits the letterbox video generated in step S302 to the display device 100.

(Processing flow in the display device)
Next, processing in the display device 100 will be described.
FIG. 6 is a diagram illustrating an example of a process flow in the display device 100 according to the first embodiment.
In step S600, the IF unit 200 receives a video signal (including ancillary data) transmitted from the imaging apparatus 101.
In step S <b> 601, the additional information acquisition unit 201 acquires the deskew processing information of the additional information and the resolution information of the video signal from the ancillary data, and outputs the deskease processing information to the deskease processing determination unit 206. Then, the additional information acquisition unit 201 outputs the video signal to the image processing unit 202.

In step S602, the deskize processing determination unit 206 determines whether the video signal transmitted from the display device 100 is a video obtained by deskyzing the anamorphic video based on the deskize processing information. If it is a video that has been desqueezed, that is, a letterbox video, the process proceeds to step S603. On the other hand, if the video is a normal video instead of the deskize-processed video, the process proceeds to step S607. Note that a normal video is a video with an aspect ratio of 16: 9 that does not include a black belt. The deskize processing determination unit 206 determines that the input video is a letterbox video when information indicating that the input video has a black band added thereto is added to the ancillary data. Also good.
In step S <b> 603, the additional information acquisition unit 201 outputs the resolution information of the video signal to the aspect marker display control unit 207.
In step S604, the aspect marker display control unit 207 receives the operation instruction unit 2 from the user.
It is determined whether or not there is an instruction to display the aspect marker via 05. If there is an instruction from the user, the process proceeds to step S605. If there is no instruction, the process in FIG. 6 is terminated.

In step S <b> 605, the aspect marker display control unit 207 generates aspect marker display control information based on the resolution information of the video signal and outputs it to the image processing unit 202. Hereinafter, the aspect marker display control information will be described with a specific example.
FIG. 7 is a diagram illustrating the aspect marker display control information.
The left side of the table of FIG. 7 shows the resolution information (letterbox video resolution) of the video signal, and the right side shows the aspect marker display control information.
The resolution information of the left video signal is divided into a vertical resolution indicating the vertical resolution and a horizontal resolution indicating the horizontal resolution. On the left side of FIG. 7, the vertical resolution and horizontal resolution of the letterbox image 500a shown in FIG. 5A are shown on the top, and the vertical resolution and horizontal resolution of the letterbox video 500b shown in FIG. 5B are shown on the bottom. .
Further, the right side of FIG. 7 illustrates the start point and aspect marker size of the aspect marker corresponding to the letterbox image 500a, and the start point and aspect marker size of the aspect marker corresponding to the letterbox image 500b. Here, the start point of the aspect marker control information indicates the coordinates (horizontal coordinate, vertical coordinate) of the upper left pixel of the aspect marker, and the aspect marker size indicates the number of pixels in the horizontal direction and vertical direction of the aspect marker (horizontal coordinate). The number of pixels in the direction x the number of pixels in the vertical direction). In this embodiment, it is assumed that the coordinate system has the origin (0, 0) as the upper left pixel of the letterbox image 500a or 500b.

  Note that the aspect marker display control unit 207 may change the aspect marker display control information in accordance with an operation instruction from the operation instruction unit 205. For example, the aspect marker display control unit 207 may change the presence / absence of display of the aspect marker, the display position, the shape (aspect ratio, size), and the like according to the operation instruction.

Next, a procedure for generating aspect marker display control information in the case of the letterbox image 500a of FIG. 5A will be described.
FIG. 8 is a diagram illustrating a first example of setting aspect marker display control information.
The display screen area 800 indicates the display area of the screen of the display unit 204, and the effective display resolution of the display screen area 800 is 3849 × 2160. In this display screen area 800, a letterbox image 500a with black bands 502a added up and down is displayed.
The resolution of the display screen area 800 is 3849 × 2160, whereas the resolution of the letterbox video 500a is 3840 × 2160, and the display screen area 800 is slightly longer in the horizontal direction than the letterbox video 500a. Therefore, the aspect marker display control unit 207 inserts black bands 802 on the left and right of the letterbox image 500a so that the letterbox image 500a is displayed in the center of the display screen area 800.

The aspect marker area 801 is an area where the aspect marker is arranged, and is inscribed in the cinesco image 501a.
The aspect marker display control unit 207 obtains the resolution 3840 × 1602 of the Sinesco video 501a based on the aspect ratio of 2.39: 1 of the Sinesco video 501a and the resolution of the letterbox video 500a. Subsequently, the aspect marker display control unit 207 sets the aspect marker size to 2848 × 1602 so that the length in the vertical direction of the aspect marker region 801 matches the length in the vertical direction in the Sinesco video 501a. In this embodiment, the minimum unit of the aspect marker is 32 × 18 (the number of pixels in the horizontal direction × the number of pixels in the vertical direction), and the aspect marker size is adjusted by enlarging this. That is, in the example of FIG. 8, the aspect marker display control unit 207 enlarges the 32 × 18 aspect marker by 89 times. The minimum unit of the aspect marker is not limited to 32 × 18, and may be 16 × 9, for example.

Subsequently, the aspect marker display control unit 207 specifies the upper left coordinates (497, 280) of the aspect marker when the aspect marker 801 is arranged at the center of the letterbox image 500a as the starting point.
As described above, the aspect marker size and the start point of the display control information are specified.
Note that the upper left vertical coordinate of the aspect marker region 801 may be specified based on the width of the black band 502a.

Returning to FIG. In step S606, the aspect marker display control unit 207 displays a frame-shaped aspect marker having an aspect ratio of 16: 9 based on the aspect marker display control information.
Next, a display example when the aspect marker is displayed based on the aspect marker display control information will be described.
FIG. 9 is a diagram illustrating a display example of the aspect marker.
First, the aspect marker display control unit 207 sets the position of the top left vertex 901 of the aspect marker to (497, 280) based on the start point (497, 280) of the aspect marker display control information. Subsequently, the aspect marker display control unit 207 sets the position of the upper right vertex 902 to (3344, 280) based on the position of the vertex 901 and the aspect marker size 2840 × 1602. Similarly, the aspect marker display control unit 207 sets the position of the lower left vertex 903 as (497, 1881) and the position of the lower right vertex 904 as (3344, 1881). Then, the aspect marker display control unit 207 generates an aspect marker 900 that connects the vertex 901, the vertex 902, the vertex 903, and the vertex 904.
By combining and displaying the aspect marker 900 on the letterbox image 500a, the range (cutout region) of the image after cutting out the letterbox image becomes clear, and the composition of the image after cutting out can be confirmed. it can.

Returning to FIG. If it is not the video that has been desqueezed in step S602 (in the case of normal video), the process proceeds to step S607.
In step S <b> 607, the aspect marker display control unit 207 determines whether there is an instruction to display the aspect marker from the user via the operation instruction unit 205. If there is an instruction from the user, the process proceeds to step S608. If there is no instruction, the process in FIG. 6 is terminated.
In step S <b> 608, the aspect marker display control unit 207 generates aspect marker display control information based on the resolution information of the video signal and outputs the generated aspect marker display control information to the image processing unit 202.

In step S609, the aspect marker display control unit 207 displays the aspect marker based on the aspect marker display control information.
FIG. 10 is a diagram illustrating a second example of setting of aspect marker display control information. In the example of FIG. 10, unlike the letterbox image 500a, no black band is displayed in the display screen area 1000. It is assumed that the effective display resolution of the display screen area 1000 is 2160 × 4096. The aspect marker display control unit 207 displays an aspect marker 1001 having an aspect ratio of 16: 9 on the display screen area 1000 based on the start point 1002 and the aspect marker size. In the case of FIG. 10, the aspect marker 1001 slightly protrudes from the left and right. The aspect ratio of the video can be adjusted by using the aspect marker 1001 to cut out portions that slightly protrude from the left and right sides of the aspect marker 1001.

As described above, since the composition of the video after clipping can be confirmed by the automatically generated aspect marker, the operation of arranging the aspect marker at the correct position becomes unnecessary, and the burden on the user can be reduced.

The aspect marker display control unit 207 may change the coordinates of the start point of the display control information and the aspect marker size in accordance with a user instruction from the operation instruction unit 205. For example, when the left and right keys of the keyboard are pressed, the aspect marker display control unit 207 may shift the aspect marker to the left and right by changing the coordinates of the start point.
In the flowchart of FIG. 6, the aspect marker is displayed when there is an instruction to display the aspect marker from the user in step S604 and step S607. May be.

Although the aspect ratio of the aspect marker is 16: 9, the present invention is not limited to this, and the aspect ratio of the aspect marker may be changed according to the aspect ratio of the monitor that displays the image.
Further, although an example of generating a letterbox image based on a Sinesco image having an aspect ratio of 2.39: 1 has been described, a letterbox image may be generated based on an image having another aspect ratio.

Moreover, although the example which superimposes and displays an aspect marker on an image | video was demonstrated, it is not limited to this, You may superimpose and display an aspect marker on a still image.
In the above embodiment, it has been described that the anamorphic image is an image reduced in the horizontal direction, but it may be an image reduced in the vertical direction. In this case, in the desk easing process, the aspect marker is generated by the same process as in the above-described embodiment, based on the video obtained by stretching the anamorphic video in the vertical direction.

In the above-described example, the aspect marker is arranged at the center of the Sinesco video in the letterbox video. However, the present invention is not limited to this. For example, the aspect marker may be arranged at a position shifted in the left direction or the right direction of the Sinesco video. Further, the size of the aspect marker may be changed in accordance with a user instruction in the operation instruction unit 205.
In the above-described example, the example in which the frame-shaped aspect marker is arranged in the letterbox image has been described. However, the shape of the aspect marker is not limited to this. For example, a straight line indicating the upper and lower sides or the left and right sides of the range of the image after cutting may be used as the aspect marker.

In the above example, the position and size of the aspect marker are determined based on the resolution information of the letterbox image. However, the image area is identified by image analysis, and the position and size of the aspect marker are determined according to the image area. You may decide. For example, on the basis of the threshold value of the luminance value, an area of pixels equal to or higher than the threshold is specified as an image area, and an area of pixels lower than the threshold is specified as a black belt. Then, the aspect marker having an aspect ratio of 16: 9 may be enlarged or reduced according to the specified image area, and the aspect marker may be superimposed at a position inscribed in the image area. Further, an image region may be specified by providing a threshold value for any of the R value, the G value, and the B value.
Further, in the above-described example, the example in which the Sinesco image is generated by performing the desqueezing process on the anamorphic image captured using the anamorphic lens is described, but the present invention is not limited thereto. For example, an image with an aspect ratio of 16: 9 may be converted into an image with an aspect ratio of 2.39: 1 by image processing, and noise processing may be performed to generate a cinesco image. Even in this case, black bands are added to the top and bottom of the generated Sinesco video in the same manner as in the above example, and a letterbox video is generated.
Further, the image processing unit 202 may move the display position of the aspect marker in accordance with an instruction from the user.

<Example 2>
(Configuration of Each Part of Display Device and Imaging Device of Example 2)
The second embodiment is different from the first embodiment in that the display device 1100 has a deskize function.
FIG. 11 is a diagram illustrating a configuration example of each unit of the display device 1100 and the imaging device 1110 according to the second embodiment. The image processing unit 1105 is different from the image processing apparatus 210 according to the first embodiment in that the image processing unit 1105 includes a deskize processing unit 1102. In addition, the same code | symbol is attached | subjected to the same structure as Example 1, and description is abbreviate | omitted suitably.
The imaging device 1110 includes an imaging unit 1111 and a transmission unit 1112. The imaging unit 1111 generates an anamorphic image captured by the anamorphic lens 102.
The transmission unit 1112 transmits the anamorphic video image to the display device 1100.

The IF unit 200 receives an anamorphic video from the imaging device 1110. Further, the IF unit 200 may receive a letterbox image obtained by desqueezing an anamorphic image and an image imaged by a normal lens in addition to the anamorphic image from other image capturing apparatuses.
The additional information acquisition unit 1101 acquires deskew processing information, squeeze magnification information, and video signal resolution information from the ancillary data transmitted together with the anamorphic video. The desk squeeze processing information and the squeeze magnification information are additional information.
Subsequently, the additional information acquisition unit 1101 transmits the desqueezing processing information, the squeeze magnification information, and the resolution information to the desqueezing processing determination unit 1103, and transmits the video signal to the desqueezing processing unit 1102. Here, the squeeze magnification information is a reduction magnification (for example, 1 / 1.33 times) of the anamorphic image, and is information set according to the anamorphic lens. In addition, when image | photographing with the normal lens, squeeze magnification information is not included in additional information. Further, the desk easing process information is information indicating the presence or absence of the desk easing process as in the first embodiment.

The desk squeeze processing determination unit 1103 determines whether the video signal has been desqueezed based on the desk squeezing processing information, and further determines whether the video signal is an anamorphic video based on the presence / absence of squeeze magnification information. . If there is deskease processing information, it is a letterbox video. If there is no desk squeeze processing information and there is squeeze magnification information, it is an anamorphic video. Further, when there is no desk squeeze processing information and no squeeze magnification information, it is a normal video.
If it is a letterbox video, the deskize processing determination unit 1103 outputs the resolution information input by the additional information acquisition unit 1101 to the aspect marker display control unit 207. If the video is an anamorphic video, the deskease processing determination unit 206 outputs squeeze magnification information to the deskeze processing unit 1102 and outputs resolution information to the aspect marker display control unit 207.

When the squeeze magnification information is input from the desk squeeze processing determination unit 1103, the desk squeeze processing unit 1102 (creating unit) performs a desk squeeze process based on the squeeze magnification information. That is, the desk easing processing unit 1102 creates a cinesco video (expanded image) by expanding the anamorphic video (reduced image) to the original length. Further, the desk easing processing unit 1102 creates a letterbox video by adding black bands (outside image areas) to the top and bottom of the Sinesco video. Then, the deskize processing unit 1102 transmits the video signal to the image processing unit 202.
On the other hand, when no squeeze magnification information is input from the deskize processing determination unit 1103, the deskize processing unit 1102 transmits the video signal as it is to the image processing unit 202 without performing any particular processing on the video signal. .

FIG. 12 is a diagram illustrating an example of a process flow in the display device 1100 according to the second embodiment. Note that description of the same processing as in FIG. 6 is omitted as appropriate.
In step S1200, IF unit 200 receives a video signal.
In step S1201, the additional information acquisition unit 1101 acquires deskew processing information and squeeze magnification information of the additional information and resolution information of the video signal from the ancillary data transmitted together with the anamorphic video. Subsequently, the additional information acquisition unit 1101 transmits the squeeze magnification information and the resolution information to the desqueezing processing determination unit 1103 and transmits the video signal to the desqueezing processing unit 1102.

In step S <b> 1202, the deskize process determination unit 1103 determines whether the input video signal is a video that has been desqueezed based on the deskew process information.
If it is a video that has been desqueezed, the process proceeds to step S1203. Here, in the case of a video that has been desqueezed, the input video signal is a letterbox video. On the other hand, if the video has not been desqueezed, the process proceeds to step S1207.
In step S1203, the additional information acquisition unit 1101 outputs the resolution information of the video signal to the aspect marker display control unit 207. The subsequent processes from step S1204 to S1206 are the same as steps S604 to S606 in FIG.

If it is not the video that has been desqueezed in step S1202, the process proceeds to step S1207, and the desqueezing process determination unit 1103 determines whether there is squeeze magnification information. When there is squeeze magnification information, the input video signal is an anamorphic video. In this case, the process proceeds to step S1208. On the other hand, when there is no squeeze magnification information, the input video signal is a normal video. In this case, the process proceeds to step S1209.
Note that the processing from step S1209 to S1211 is the same as the processing from step S607 to S609 in FIG.

In step S <b> 1208, the deskize processing unit 1102 performs desqueezing processing on the video signal based on the squeeze magnification information, and transmits the video signal to the image processing unit 202.
Next, the desk easing process will be described with a specific example.
For example, it is assumed that the resolution of the video after the deskize process is 5448 × 2160. The desk easing processing unit 1102 cuts out the left and right portions in accordance with the aspect ratio of the cinesco video, and sets the video resolution to 5162 × 2160. Subsequently, the deskize processing unit 1102 reduces the video in accordance with the resolution of the video signal, and further adds a black band having a width corresponding to the resolution of the video signal to the top and bottom of the Sinesco video to create a letterbox video. .

  Returning to FIG. The subsequent processes from step S1204 to S1206 are the same as steps S604 to S606 in FIG.

(effect)
Below, the effect in a prior art example and the Example of this invention is compared.
FIG. 13 is a diagram illustrating an example of clipping in the conventional example. The Sinesco video 1300 is a video with an aspect ratio of 2.39: 1 created by desk-equiping an anamorphic video. When displaying this video on a wide screen, the aspect ratio needs to be 16: 9 as in the work video 1301, so the dotted line portion is cut out. In FIG. 13, black bands added to the top and bottom of the Sinesco video are omitted.

14A and 14B are diagrams illustrating an aspect marker in the conventional example and the embodiment of the present invention. FIG. 14A is a diagram illustrating a display example of a conventional aspect marker 1401. As shown in FIG. 14A, since the aspect marker 1401 is expanded to fill the screen in the initial state, the user needs to adjust the size and position of the aspect marker 1401 according to the actual cutout range. This was a cumbersome operation for the user.

  On the other hand, FIG. 14B is a diagram showing a display example of aspect markers according to the embodiment of the present invention. The size of the aspect marker is determined according to the resolution of the letterbox image 1400, and an aspect marker 1410 is provided at the center of the cinesco image 1402. Thereby, the work of arranging the aspect marker can be omitted, which is convenient for the user.

  The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

  100: Display device 201: Additional information acquisition unit 202: Image processing unit 206: Deskize processing determination unit 207: Aspect marker display control unit

Claims (16)

Acquisition means for acquiring an input image;
Generation means for generating a display image by superimposing a marker indicating a target area of a predetermined aspect ratio on the input image among the input images;
With
When the input image is an image including an image area and an outside image area arranged around the image area, the generation unit does not include the outside area in the target area indicated by the marker. As described above, the image processing apparatus synthesizes the marker with the input image.   The image processing apparatus according to claim 1, wherein the generation unit determines a size and a position of the marker based on size information in a vertical direction and a horizontal direction of the input image.   The image processing apparatus according to claim 2, wherein the acquisition unit acquires the size information from additional information added to the input image. A determination means for determining whether or not the image in the image region is an expanded image obtained by expanding a reduced image in which a length in a vertical direction or a horizontal direction is reduced to an original length;
The image processing apparatus according to claim 1, wherein the generation unit synthesizes the marker with the input image when an image in the image region is an expanded image.   The determination unit determines whether an image in the image area is an expanded image based on whether information indicating that the image is a reduced image is added to the input image. The image processing apparatus according to claim 4.   Input a reduced image in which the length in the vertical direction or the horizontal direction is reduced, generate an expanded image by expanding the reduced image to the original length, and add a region outside the image around the expanded image The image processing apparatus according to claim 1, further comprising a creating unit that creates image data by using the method.   The image processing apparatus according to claim 1, wherein the generation unit moves the position of the marker in accordance with a user instruction.   The image processing apparatus according to claim 1, wherein the marker is a frame-shaped marker having the predetermined aspect ratio that indicates the target region.   The image processing apparatus according to claim 1, wherein the marker is a marker that indicates two sides on the top and bottom or left and right of the target region.   The image processing apparatus according to claim 1, wherein the acquisition unit acquires the input image from another external apparatus. Acquisition means for acquiring an input image;
Generating means for generating a display image by superimposing a marker indicating a cutout region obtained by cutting out the input image with a predetermined aspect ratio on the input image;
With
When the input image is an image including an image area and a non-image area arranged around the image area, the generation unit generates a cut-out area obtained by cutting the image area with the predetermined aspect ratio. An image processing apparatus, wherein a marker to be displayed is synthesized with the input image. The image processing apparatus according to any one of claims 1 to 11,
Display means for displaying the display image;
A display device comprising: An acquisition step of acquiring an input image;
A generation step of generating a display image by superimposing a marker indicating a target area of a predetermined aspect ratio on the input image among the input image;
Have
When the input image is an image including an image area and an outside image area arranged around the image area, in the generation step, the target area indicated by the marker does not include the outside image area. Thus, the control method of the image processing apparatus, wherein the marker is combined with the input image. An acquisition step of acquiring an input image;
A generation step of generating a display image by superimposing a marker indicating a cutout region obtained by cutting out the input image with a predetermined aspect ratio on the input image;
Have
In the generating step, when the input image is an image including an image area and an outside image area arranged around the image area, a cutout area obtained by cutting out the image area with the predetermined aspect ratio is obtained. A control method for an image processing apparatus, wherein a marker to be displayed is synthesized with the input image.   15. A computer-readable recording medium storing a program for causing a computer to execute each step of the control method for an image processing apparatus according to claim 13 or 14.   15. A program for causing a computer to execute each step of the control method for an image processing apparatus according to claim 13 or 14.

Images