JP2017162371A - Image processing device, image processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide appropriate support when an area to be processed is specified by a user's operation.SOLUTION: When a position on an image obtained from an imaging part is continuously specified, for example, when swiping operation is performed on a touch screen, an area including the specified position is determined as a target area for image processing by following the specified position (touch position), and the processing target area is notified by following the specified position. In this case, a guide frame demonstrating the processing target area is superimposed and displayed on the image displayed on the touch screen by following the swiping operation.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program for performing predetermined processing on an image in an area designated by a user operation.

  In general, when a part of an image is cut out from a shot image and pasted on another shot image or subjected to predetermined image processing, the cut-out area is arbitrarily designated by a user operation. For example, if the shape of the cutout region is a rectangular region, each position on the screen corresponding to the four corners of the rectangle is designated by a user operation as shown in Patent Document 1.

JP 2000-106623 A

  However, when the clip region is specified by specifying four points as described above, the user considers the relationship between the position that has already been specified and the position that is newly specified this time, and what kind of clip region (position or size) If the area actually cut out is slightly different from the expected range, some of the desired subject will be cut out. It will have a big effect on the image.

  An object of the present invention is to appropriately support the designation of a region where a process is executed by a user operation.

In order to solve the above-described problems, the present invention
Image acquisition means for acquiring images;
Position specifying means for continuously specifying different positions on the image acquired by the image acquiring means;
Area specifying means for following the position continuously specified by the position specifying means and specifying an area including the specified position as a processing target area for image processing;
Informing means for informing the processing target area specified by the area specifying means in accordance with the designated position;
An image processing apparatus comprising:

  According to the present invention, when a region for executing processing is designated by a user operation, the designation can be appropriately supported.

The block diagram which showed the basic component of the digital camera applied as an image processing apparatus. (1), (2) is a diagram showing a state in which a region for executing predetermined image processing is designated by a user operation. The flowchart for demonstrating the operation | movement (characteristic operation | movement of this embodiment) started execution when it switches to imaging | photography mode. The flowchart following the operation | movement of FIG. (1) and (2) are diagrams showing a display state when a single tap operation is performed on the fisheye image displayed on the live view screen, and (3) is cut out from the fisheye image. The figure which showed the image by which distortion correction was carried out. (1) is a diagram showing a display state when a swipe operation is performed on a fisheye image displayed on the live view screen, and (2) is cut out from the fisheye image and corrected for distortion. The figure which showed the image. (1) is a diagram showing a display state when a swipe operation is performed on a fisheye image displayed on the live view screen, and (2) is cut out from the fisheye image and corrected for distortion. The figure which showed the image. The figure for demonstrating the modification of embodiment, and the figure which showed the display state when swipe operation is performed on the fisheye image currently displayed on the live view screen.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a digital camera as an image processing apparatus, and FIG. 1 is a block diagram showing basic components of the digital camera.
An image processing apparatus (digital camera) has, as a basic function, an imaging function capable of imaging using a fisheye lens or other normal imaging lens, and a playback function for reproducing an image captured using a fisheye lens. Etc.

  The control unit 1 operates by supplying power from the power source unit (secondary battery) 2 and controls the overall operation of the digital camera in accordance with various programs in the storage unit 3. A CPU (Central Processing Unit) and a memory (not shown) are provided. The storage unit 3 includes, for example, a ROM, a flash memory, and the like, and stores a program and various applications for realizing the present embodiment in accordance with an operation procedure illustrated in FIGS. 3 and 4 to be described later. A program memory 3A, and a work memory 3B for temporarily storing various information (for example, a flag) necessary for the operation of the camera.

  Note that the storage unit 3 may be configured to include a removable portable memory (recording medium) such as an SD card or a USB memory card that records and saves fisheye images or the like. In a state where it is connected to the network via a network, it may include a storage area on a predetermined server device side. The operation unit 4 includes various push button type keys such as a power key for turning on / off the power, a release key for instructing photographing, and a setting key for setting photographing conditions such as exposure and shutter speed. The unit 1 performs processing according to the input operation signal from the operation unit 4.

  The imaging unit 5 constitutes a camera unit capable of photographing a subject with high definition. The lens unit 5A of the imaging unit 5 is provided with a fisheye lens 5B, an imaging element 5C, and the like. Note that the camera according to the present embodiment can exchange a normal imaging lens (not shown) and the fisheye lens 5B, and the illustrated example shows a state in which the fisheye lens 5B is mounted instead of the normal imaging lens. . The fish-eye lens 5B is a circumferential fish-eye lens (all-around fish-eye lens) that has a three-lens lens system and can capture a wide range of angles of view of approximately 180 °. The entire image captured by the fish-eye lens 5B Becomes a circular image. In this case, since the projection method is adopted, the image (fisheye image) picked up by the fisheye lens 5B has a feature that the image is distorted as it is farther from the center (toward the end).

  When a subject image (optical image) from the fisheye lens 5B is formed on an image sensor (for example, CMOS or CCD) 5C, an image signal (analog signal) photoelectrically converted by the image sensor 5C is not shown. After being converted into a digital signal (image signal) by the A / D conversion unit and subjected to predetermined image display processing, it is displayed on the touch display unit 6 in real time as a live view image. The control unit 1 performs development processing on the captured image in accordance with the operation of a release button that instructs photographing, converts the image into a standard file format, and then records and saves it on a recording medium in the storage unit 3.

  The touch display unit 6 constitutes a touch screen in which a touch panel 6B is laminated on a display 6A such as a high-definition liquid crystal, and various software keys (touch keys) are allocated and displayed to display the function names. A touch operation with a finger or the like is detected, and an operation signal corresponding to the touch position is input. The display screen of the touch display unit 6 becomes a monitor screen (live view screen) that displays an image (fisheye image) or the like captured by the fisheye lens 5B in real time, or reproduces a captured image (fisheye image) or the like. The playback screen may appear.

FIG. 2 is a diagram illustrating a state where a region for executing predetermined image processing is designated by a user operation among images (fisheye images) captured by the imaging unit 5.
That is, in a state where an image (fisheye image) photographed by the imaging unit 5 is displayed on the touch display unit 6 as a live view image, processing is performed by a touch operation on the touch screen (for example, a live view screen). This shows the case of specifying the target area. In the present embodiment, the predetermined image processing indicates processing for cutting out a part of an image from a fisheye image, and the processing target area indicates the cutting area, but is not limited thereto.

FIG. 2A illustrates a case where a predetermined touch operation, for example, a single touch operation (single tap operation) is performed on the touch screen in a state where a fisheye image is displayed on the touch display unit 6. FIG.
When the user instructs to cut out an image of a part (desired subject portion) from the fisheye image, the user designates the cutout region (processing target region) by a touch operation. At this time, for example, when a standard size image with an aspect ratio of 4: 4 is desired, a predetermined touch operation (for example, a single tap operation) is performed on the desired subject portion. When an arbitrary point on the touch screen is designated by the predetermined touch operation (single tap operation), the control unit 1 superimposes (notifies) the touch position on the fisheye image, and displays the touch position. A region to be included is specified as a processing target region, and a guide frame for clearly indicating the processing target region is superimposed and displayed (notified) on the fisheye image.

  That is, the control unit 1 first generates a predetermined area centered on the touch position. For example, as a rectangular area having the touch position as the center point, a horizontally long rectangular area having an aspect ratio of 4: 3 and a standard size is generated. Then, when this rectangular region (region for standard size development) is subjected to a distortion correction process according to the distortion rate of the fisheye image, the corrected region is transformed into an arcuate region by this distortion correction. . After specifying this corrected region (arc-shaped region) as a processing target region, a guide frame (thick dashed frame in the figure) for clearly indicating the processing target region (arc-shaped region) is displayed at the touch position. In addition to a mark (indicated by a black dot in the figure), a fisheye image is superimposed and displayed.

FIG. 2B shows a state in which a fisheye image is displayed on the touch display unit 6, and a predetermined touch operation, for example, a slide operation (swipe operation) for drawing an arcuate locus is performed on the touch screen. It is the figure which illustrated the case.
When the user instructs to cut out a part of the fisheye image (desired subject part), for example, when the user desires a panoramic image having an aspect ratio of 8: 3, he / she As a predetermined touch operation with respect to the subject portion to be performed, a slide operation (swipe operation) for moving a wide range so as to include the subject portion is performed. In this case, the swipe operation is performed so that the start position of the swipe operation is the start point of panorama development, and the end position of the swipe operation is the end point of panorama development. Therefore, if the desired subject part extends from the central part to the peripheral part of the fisheye image, swipe operation to move on the subject part is a linear trajectory. Instead, the trajectory is curved in an arc.

  When the touch position continuously changing by the arc-shaped swipe operation is designated, the control unit 1 follows the swipe operation and marks the mark indicating the touch locus (broken line with an arrow in the figure) as a fisheye. The arc-shaped area including the touch position (arc-shaped area centered on the touch locus) is generated and superimposed on the image, and the arc-shaped process is performed after the generated area is specified as the processing target area. A guide frame (indicated by a thick broken line in the figure) for clearly indicating the target area is superimposed on the fisheye image following the swipe operation. This arc-shaped processing target area is an area for panorama development in which the start position of the swipe operation is the start point of panorama development and the end position of the swipe operation is the end point of panorama development. Note that an arc-shaped area is generated based on the touch trajectory following the swipe operation, and the curvature of the arc-shaped area is generated in consideration of distortion of the image captured by the fisheye lens 5B. become.

  Next, an operation concept of the image processing apparatus (digital camera) in the present embodiment will be described with reference to flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. In other words, in addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium. 3 and 4 are flowcharts showing an outline of the operation of the characterizing portion of the present embodiment in the overall operation of the image processing apparatus (digital camera). When the flow of FIG. 3 and FIG. The process returns to the main flow (not shown) of the overall operation.

3 and 4 are flowcharts for explaining an operation (characteristic operation of the present embodiment) that is started when the mode is switched to the shooting mode.
First, in the shooting mode, the control unit 1 acquires an image (fisheye image) from the imaging unit 5 and starts an operation of displaying the image on the touch display unit 6 as a live view image (step S1). Then, the presence / absence of touch operation on the live view screen (touch screen) (presence / absence of touch start) is checked (step S2), and the presence / absence of operation of the release key on the operation unit 4 is checked (step S10).

  If a touch operation is detected (YES in step S2), the touch position is detected and temporarily stored in the work memory 3B (step S3). Then, it is checked whether the touch position has changed (whether the touch operation has moved) (step S4). If the touch position has not changed (NO in step S4), it is checked whether the touch operation has ended (whether the touch has been released). (Step S5). Here, if the state remains touched (NO in step S5), the process returns to step S4 described above, but if the touch position remains unchanged (NO in step S4), the touch is released (step S5). YES), that is, when a touch operation that is performed after touching (one touch operation: single tap operation) is performed, the process proceeds to the next step S6, and the touch position temporarily stored in the work memory 3B Is generated, and a rectangular region having a standard size centered on the touch position, for example, a horizontally long rectangular region having an aspect ratio of horizontal 4: vertical 3 is generated.

  Next, the control unit 1 acquires the distortion rate of the fisheye lens 5B according to the generation area (horizontal rectangular area), and performs a process of correcting the distortion for the generation area (step S7). That is, since the distortion rate of the fisheye image increases as the distance from the center of the fisheye lens 5B increases, the preset parameters of the fisheye lens 5B (a series of distortion rates from the center of the lens to the edge) are read out. The distortion rate at each position corresponding to the generation region (horizontal rectangular region) is acquired from the above, and distortion correction is performed on the generation region using the plurality of distortion rates. As a result, the horizontally long rectangular region is transformed into an arcuate region. Next, the control unit 1 specifies the corrected arc-shaped area as a target area for image processing, and temporarily stores it in the work memory 3B (step S8). Then, a guide frame that clearly indicates the processing target area is displayed on the fisheye image together with a mark indicating the touch position (step S9).

  FIG. 5 shows a case where a single tap operation is performed as in the case shown in FIG. 2 (1). FIG. 5 (1) shows a fisheye image obtained by photographing the parent and child on the live view screen. In this state, a single tap operation is performed around the area where the parent and child are reflected on the fisheye image. FIG. 5 (2) shows a guide frame that clearly indicates a processing target region (an arc-shaped region corrected according to distortion of a fisheye image) on the live view screen by the single tap operation, and a mark indicating the touch position. Indicates a state of being superimposed and displayed on the fisheye image.

  On the other hand, if a change in the touch position is detected (YES in step S4), the changed touch position is detected and temporarily stored in the work memory 3B (step S11), and then a region corresponding to the touch locus is formed. Is generated (step S12). That is, an arc-shaped region having a predetermined width with the touch locus as a center line, for example, is generated. Then, after specifying this generation region as a target region for image processing and temporarily storing it in the work memory 3B (step S13), a fisheye image with a guide frame indicating the processing target region and a mark indicating the touch trajectory is displayed. The image is superimposed and displayed on top (step S14). In this state, it is checked whether the touch operation has been completed (whether the touch has been released) (step S15). Thereafter, the process returns to step S4 until the touch is released, and thereafter, every time the touch position changes (YES in step S4). The above operations (steps S11 to S15) are repeated. As a result, the processing target area superimposed and displayed on the fisheye image sequentially changes following the touch operation (swipe operation).

  FIG. 6 shows a case where a swipe operation for drawing an arcuate locus is performed, as in the case shown in FIG. 2 (2). FIG. 6 (1) shows a fisheye image obtained by photographing a parent and child in a live view screen. In the state displayed on the screen, the area where the parent and child are reflected on the fisheye image (the center of the fisheye image) is swiped. On the live view screen according to the swipe operation touch track A guide frame that clearly indicates the arc-shaped processing target area is superimposed on the fisheye image, and a mark indicating the touch locus is superimposed on the fisheye image. The guide frame that clearly indicates the processing target area and the mark indicating the touch trajectory change sequentially following the swipe operation, and are displayed with their line type and thickness changed so that they can be identified. Like to do.

  FIG. 7 shows a case where a swipe operation for drawing an arcuate locus is performed as in the case shown in FIG. 2 (2). In the case of FIG. 6 (1), the center portion of the fisheye image is swiped. In the case of FIG. 7 (1), the peripheral portion of the fisheye image is swiped. That is, the fish-eye image shown in FIG. 7 (1) is an example of the case where the surrounding building group is photographed with the fish-eye lens 5B facing the sky, and the surrounding building group (the peripheral part of the fish-eye image) is illustrated. The figure shows the case where the lower half of the figure is swiped, and a guide frame that clearly indicates the arc-shaped processing target area on the live view screen is displayed on the fisheye image according to the touch trajectory of the swipe operation. In addition to being superimposed, a mark indicating the touch locus is superimposed on the fisheye image. The guide frame that clearly indicates the processing target area and the mark indicating the touch trajectory change sequentially following the swipe operation, and are displayed with their line type and thickness changed so that they can be identified. Like to do.

  When the process of specifying and notifying the processing target region by such a touch operation (single tap operation or swipe operation) is finished, it is checked whether the release key is operated (step S10), and if the release key is not operated (step S10). NO at S10), the process returns to step S2. If the release key is operated (YES in step S10), the process proceeds to step S16 in FIG. 4, and whether the processing target area is temporarily stored in the work memory 3B, that is, the processing target area has been specified as a preparation for photographing. Find out if there is. Here, if the processing target area is not specified (NO in step S16), a fisheye image is acquired from the imaging unit 5 and development processing is performed, and after conversion into a standard file format, Recording and storage are performed on the recording medium (step S24).

  If the processing target area has been specified (YES in step S16), a fisheye image is acquired from the imaging unit 5, and an image in the processing target area is cut out from the fisheye image (step S17). Then, in the same manner as described above, the preset parameters of the fisheye lens 5B (a series of distortion rates from the center of the lens to the edge) are read (step S18), and the position of each position corresponding to the processing target region is read from the parameters. A distortion rate is acquired, and a process of correcting distortion of the image in the processing target region using the plurality of distortion rates is performed (step S19). As a result, the image in the arc-shaped processing target region is transformed into a rectangular image. Then, the corrected image is developed and converted into a standard file format, and then recorded and stored in the recording medium of the storage unit 3 (step S20). That is, as described so far, the above-described release key operation determines that the specified processing target area is a target for image processing.

  As shown in FIG. 5 (3), as shown in FIG. 5 (1), the distortion is corrected for the image in the arc-shaped processing target area specified by the single tap operation to the center part of the fisheye image. The corrected image is shown, and this corrected image is recorded and saved as a standard size developed image. In this case, the arc-shaped image is transformed into a rectangular image by distortion correction, and becomes, for example, a rectangular image (standard size developed image) having an aspect ratio of 4: 4.

  FIG. 6 (2) shows the distortion of the image in the arc-shaped processing target area specified by the swipe operation from the central part to the peripheral part of the fish-eye image as shown in FIG. 6 (1). The corrected image after correcting is shown, and this corrected image is recorded and saved as a panorama size developed image. In this case, the arc-shaped image is transformed into a rectangular image by distortion correction, and becomes, for example, a rectangular image (panorama size developed image) having an aspect ratio of 8: 3.

  In FIG. 7 (2), as shown in FIG. 7 (1), the distortion is corrected for the image in the arc-shaped processing target area specified by the swipe operation to the peripheral part of the fisheye image. The corrected image is shown later, and this corrected image is recorded and saved as a panorama size developed image. In this case, the arc-shaped image is transformed into a rectangular image by distortion correction, and becomes, for example, a rectangular image (panorama size developed image) having an aspect ratio of 8: 3.

  When the corrected image is recorded and saved in this way, the fisheye image that is the basis of the corrected image is recorded and saved (step S21). Even in this case, the fish-eye image is subjected to development processing, converted into a standard file format, and then recorded and stored in the recording medium of the storage unit 3. At this time, the correction image and the fish-eye image are associated with each other. The record is saved. Thereafter, after performing the process of erasing the contents of the work memory 3B (step S22), it is checked whether or not the shooting mode has been canceled (step S23). If the shooting mode is canceled (YES in step S23), the flow of FIGS. 3 and 4 is exited, but if the shooting mode remains (NO in step S23), the process returns to step S2 of FIG. Repeat the operation.

  As described above, in the present embodiment, when the position on the image acquired from the imaging unit 5 is continuously specified, the control unit 1 performs image processing on the region including the specified position following the specified position. Since the target region is specified and the processing target region is notified in accordance with the specified position, the specification can be appropriately supported when the region to be processed is specified by the user operation. For example, the guide frames that clearly indicate the processing target area on the live view screen by the swipe operation shown in FIGS. 6 (1) and 7 (1) are sequentially displayed following the swipe operation. Thus, it is possible to easily visually check an appropriate processing target area simply by performing a swipe operation. In addition, with the distortion of the fisheye image corrected and the corrected image displayed, it is possible to accept the designation of the cutout area and the designation of the area on which other image processing is to be performed on the corrected image. Instead, it is possible to specify an area in which image processing is executed on an image having distortion.

  Since the control unit 1 continuously follows the designated position and specifies a region having a shape corresponding to the designated locus as a target region for image processing, the user considers the distortion of the fisheye lens 5B. However, continuous position designation is possible.

  When the position on the image acquired from the imaging unit 5 is specified, the control unit 1 sets the region including the specified position as a target region for image processing based on the specified position and the distortion rate corresponding to the position. Since the process target area is specified and specified, when the user designates an area for executing the process, the designation can be appropriately supported. For example, a guide frame that clearly indicates the processing target area is displayed on the live view screen by the single tap operation shown in FIGS. 5 (1) and 5 (2), so that the user only needs to perform the single tap operation. It is possible to easily visually check a target processing area.

  Since the control unit 1 calculates the distortion rate of the fisheye image based on the parameters of the fisheye lens 5B, the distortion rate can be accurately obtained.

  Since the control unit 1 performs predetermined image processing on the image in the specified processing target area among the images acquired from the imaging unit 5, the control unit 1 performs processing on the processing target area specified by appropriate support. Accurate image processing is possible.

  Since the control unit 1 performs the process of cutting out the image in the processing target area specified from the images acquired from the imaging unit 5, for example, because the specification of the processing target area is inaccurate, It is possible to prevent such a situation that a part is cut off.

  Since the control unit 1 performs the process of cutting out the image within the processing target area specified from the wide-angle image acquired from the imaging unit 5, the control unit 1 performs the process of correcting the distortion on the cut-out image. Even if the image in the processing target area is cut out from the fisheye image, an image without distortion can be obtained.

  The control unit 1 identifies and displays the processing target area specified according to the designated position together with the position designated by the user operation on the screen that displays the image acquired from the imaging unit 5. On the other hand, it is possible to provide easy-to-see notification.

  In a state where the image acquired from the imaging unit 5 is displayed on the touch display unit 6, the control unit 1 superimposes and displays the processing target region specified based on the position specified by the touch operation on the image. Therefore, it is possible to accurately specify the processing target area by a touch operation on the image.

<Modification 1>
In the above-described embodiment, when a fish-eye image is displayed on the touch display unit 6, an arc-shaped swipe operation is performed on the touch screen in consideration of the properties of the fish-eye image. However, the present invention is not limited to the arc-shaped swipe operation, and a swipe operation for drawing a linear trajectory may be performed.
FIG. 8 is a diagram for explaining a case where a swipe operation for drawing a linear locus is performed in a state where a fisheye image is displayed on the touch display unit 6.

  Here, as shown in FIG. 8, the control unit 1 superimposes and displays a mark indicating a touch locus (a broken line with an arrow in the figure) on the fisheye image following a linear swipe operation. A rectangular area including the touch position, that is, a rectangular area centered on the touch locus is generated, and distortion correction is performed on the generated area. That is, the distortion rate at each position corresponding to the processing target region is acquired from the preset parameters of the fisheye lens 5B (a series of distortion rates from the center to the edge of the lens), and the plurality of distortion rates are used. Distortion correction is performed on the processing target area. As a result, the rectangular area is transformed into an arc-shaped area, and this arc-shaped area is specified as a processing target area and is superimposed and displayed on the fisheye image.

  In this way, when the processing target area is identified and notified following the swipe operation, a rectangular area including the touch position is generated and the rectangular area is subjected to distortion correction to be transformed into an arc-shaped area. If this arc-shaped region is specified and notified as a processing target region, the region that is actually processed can be notified even if a linear swipe operation is performed.

<Modification 2>
In the above-described embodiment, the distortion rate is obtained using the preset parameters of the fisheye lens 5B (a series of distortion rates from the center of the lens to the edge), but by analyzing the fisheye image, You may make it obtain | require the distortion factor with respect to each point. That is, a feature line included in a fisheye image (for example, a horizontal line or a vertical line in the real world such as a horizon line, a straight line at the edge of a TV or a desk) is detected, and the feature line is used as a reference. Thus, the distortion rate may be calculated by obtaining the degree of distortion at each point. Thus, if the distortion rate is obtained by image analysis, the distortion rate can be obtained even when no lens parameter is prepared.

<Modification 3>
In the above-described embodiment, the processing target area is notified on the live view screen at the time of shooting. However, the processing target area is notified on the playback screen when the captured image (saved image) is played back. Also good. That is, when a single tap operation or a swipe operation is performed on the playback screen on which a captured image (stored image) is displayed, a processing target area is specified according to the single tap operation or swipe operation, and this processing is performed. A guide frame that clearly indicates the target area may be superimposed on the playback screen. In this case, an image in the processing target area may be cut out and distortion correction may be performed, and the corrected image may be switched and displayed on the playback screen or recorded and saved. In this case, after a single tap operation or swipe operation is performed and a processing target area is specified accordingly, for example, when a predetermined operation such as a double click on the screen or a predetermined button operation is detected, or a processing target If it is detected that there is no operation for several seconds after the area is specified, the processing target area may be determined as an area for image processing.

  In the above-described embodiment, the case where the present invention is applied to an image photographed with the fisheye lens 5B has been described. The same can be applied to the area designation above. In the case of an image with distortion as in the above-described embodiment, the processing target region is generated after taking image distortion into consideration. However, in the case of an image without distortion, image distortion should be taken into consideration. Instead, the processing target area is generated.

  In the above-described embodiment, the position specified by the user operation is displayed on the screen that displays the image acquired from the imaging unit 5 in addition to the guide frame that clearly indicates the processing target area. It is not necessary to display the designated position only by displaying a guide frame that clearly indicates the area, and is not limited to the case where the guide frame that clearly indicates the processing target area is superimposed on the fisheye image. As long as the processing target area can be identified, such as displaying the entire processing target area in a colored manner or blinking, the notification method is not limited.

  In the above-described embodiment, the processing for cutting out the image in the processing target area is performed as the predetermined processing. However, the present invention is not limited to this, and the image is subjected to processing for displaying special effects such as contrast, blurring, and sharpness. It may be processing.

  In the above-described embodiment, the image processing apparatus is not limited to a digital camera and a notebook PC, but may be, for example, a PDA (personal portable information communication device), a tablet terminal device, a mobile phone such as a smartphone, an electronic game, It may be a music player.

  Further, the “apparatus” and “unit” shown in the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
Image acquisition means for acquiring images;
Position specifying means for continuously specifying different positions on the image acquired by the image acquiring means;
Area specifying means for following the position continuously specified by the position specifying means and specifying an area including the specified position as a processing target area for image processing;
Informing means for informing the processing target area specified by the area specifying means in accordance with the designated position;
An image processing apparatus comprising:
(Claim 2)
The invention according to claim 2 is the image processing apparatus according to claim 1,
The region specifying unit specifies a region having a shape according to the specified locus following the position continuously specified by the position specifying unit as a target region for image processing;
It is characterized by that.
(Claim 3)
The invention described in the claims
Image acquisition means for acquiring an image having distortion;
Position designation means for designating a position on the image acquired by the image acquisition means;
On the image acquired by the image acquisition unit, a distortion rate acquisition unit that acquires a distortion rate corresponding to the position specified by the position specification unit;
Area specifying means for specifying an area including the specified position as a target area for image processing based on the position specified by the position specifying means and the distortion rate acquired by the distortion rate acquiring means;
Informing means for informing the processing target area specified by the area specifying means;
An image processing apparatus comprising:
(Claim 4)
The invention according to claim 4 is the image processing apparatus according to claim 3,
The position specifying means continuously specifies different positions on the image acquired by the image acquisition means;
The region specifying unit specifies a region including the specified position following the position continuously specified by the position specifying unit as a target region for image processing,
The notification means notifies the processing target area specified by the area specifying means following the specified position,
It is characterized by that.
(Claim 5)
The invention according to claim 5 is the image processing apparatus according to claim 3 or 4,
The distortion rate acquisition means calculates a distortion rate of the image based on a parameter of a lens that captures the image acquired by the image acquisition means;
It is characterized by that.
(Claim 6)
The invention according to claim 6 is the image processing apparatus according to claim 3 or 4,
The distortion rate acquisition means calculates the distortion rate of the image by analyzing the image acquired by the image acquisition means;
It is characterized by that.
(Claim 7)
The invention according to claim 7 is the image processing apparatus according to any one of claims 1 to 6,
A processing area determining means for determining that the processing target area specified by the area specifying means is an area for image processing;
Image processing means for performing predetermined image processing on an image in the processing target area determined by the processing area determination means;
Is further provided.
(Claim 8)
The invention according to claim 8 is the image processing apparatus according to claim 7,
The image processing means performs a process of cutting out an image in a processing target area determined by the processing area determination means from the images acquired by the image acquisition means.
It is characterized by that.
(Claim 9)
The invention according to claim 9 is the image processing apparatus according to claim 7,
The image processing means performs a process of correcting the distortion of the image in the processing target area determined by the processing area determination means from the wide-angle image acquired by the image acquisition means.
It is characterized by that.
(Claim 10)
The invention according to claim 10 is the image processing apparatus according to any one of claims 1 to 9,
And further comprising display means for displaying the image acquired by the image acquisition means,
The informing means identifies and displays the processing target area specified by the area specifying means together with the position specified by the position specifying means on the display means on which the image is displayed.
It is characterized by that.
(Claim 11)
According to an eleventh aspect of the present invention, in the image processing apparatus according to any one of the first to tenth aspects,
And further comprising display means for displaying the image acquired by the image acquisition means,
The position specifying means is a touch operation means on the display means,
The notifying means superimposes and displays the processing target area specified by the area specifying means on the display means on which the image is displayed;
It is characterized by that.
(Claim 12)
The invention according to claim 12
An image processing method in an image processing apparatus,
Processing to acquire images,
A process of continuously designating different positions on the acquired image;
A process of following the continuously specified position and specifying an area including the specified position as a processing target area of image processing;
A process of notifying the specified processing target area following the specified position;
It is characterized by including.
(Claim 13)
The invention according to claim 13
For the computer of the image processing device,
The ability to retrieve images,
A process of continuously designating different positions on the acquired image;
A function of following the continuously designated position and specifying an area including the designated position as a processing target area for image processing;
A function of notifying the specified processing target area following the specified position;
It is a program for realizing.
(Claim 14)
The invention according to claim 14
An image processing method in an image processing apparatus,
Processing to acquire an image having distortion;
A process for designating a position on the acquired image;
On the acquired image, a process for acquiring a distortion rate corresponding to the designated position;
Based on the designated position and the acquired distortion rate, a process for specifying an area including the designated position as a target area for image processing;
A process of notifying the specified processing target area following the specified position;
It is characterized by including.
(Claim 15)
The invention according to claim 15 is:
For the computer of the image processing device,
A function of acquiring an image having distortion;
A function for designating a position on the acquired image;
A function for acquiring a distortion rate corresponding to the designated position on the acquired image;
Based on the specified position and the acquired distortion rate, a function for specifying an area including the specified position as a target area for image processing;
A function of notifying the specified processing target area following the specified position;
It is a program for realizing.

DESCRIPTION OF SYMBOLS 1 Control part 3 Memory | storage part 3A Program memory 5 Imaging part 5B Fisheye lens 5C Image pick-up element 6 Touch display part 6A Display 6B Touch panel

Claims (15)

Image acquisition means for acquiring images;
Position specifying means for continuously specifying different positions on the image acquired by the image acquiring means;
Area specifying means for following the position continuously specified by the position specifying means and specifying an area including the specified position as a processing target area for image processing;
Informing means for informing the processing target area specified by the area specifying means in accordance with the designated position;
An image processing apparatus comprising: The region specifying unit specifies a region having a shape according to the specified locus following the position continuously specified by the position specifying unit as a target region for image processing;
The image processing apparatus according to claim 1. Image acquisition means for acquiring an image having distortion;
Position designation means for designating a position on the image acquired by the image acquisition means;
On the image acquired by the image acquisition unit, a distortion rate acquisition unit that acquires a distortion rate corresponding to the position specified by the position specification unit;
Area specifying means for specifying an area including the specified position as a target area for image processing based on the position specified by the position specifying means and the distortion rate acquired by the distortion rate acquiring means;
Informing means for informing the processing target area specified by the area specifying means;
An image processing apparatus comprising: The position specifying means continuously specifies different positions on the image acquired by the image acquisition means;
The region specifying unit specifies a region including the specified position following the position continuously specified by the position specifying unit as a target region for image processing,
The notification means notifies the processing target area specified by the area specifying means following the specified position,
The image processing apparatus according to claim 3. The distortion rate acquisition means calculates a distortion rate of the image based on a parameter of a lens that captures the image acquired by the image acquisition means;
The image processing apparatus according to claim 3 or 4, The distortion rate acquisition means calculates the distortion rate of the image by analyzing the image acquired by the image acquisition means;
The image processing apparatus according to claim 3, wherein the image processing apparatus is an image processing apparatus. A processing area determining means for determining that the processing target area specified by the area specifying means is an area for image processing;
Image processing means for performing predetermined image processing on an image in the processing target area determined by the processing area determination means;
The image processing apparatus according to claim 1, further comprising: The image processing means performs a process of cutting out an image in a processing target area determined by the processing area determination means from the images acquired by the image acquisition means.
The image processing apparatus according to claim 7. The image processing means performs a process of correcting the distortion of the image in the processing target area determined by the processing area determination means from the wide-angle image acquired by the image acquisition means.
The image processing apparatus according to claim 7. And further comprising display means for displaying the image acquired by the image acquisition means,
The informing means identifies and displays the processing target area specified by the area specifying means together with the position specified by the position specifying means on the display means on which the image is displayed.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. And further comprising display means for displaying the image acquired by the image acquisition means,
The position specifying means is a touch operation means on the display means,
The notifying means superimposes and displays the processing target area specified by the area specifying means on the display means on which the image is displayed;
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. An image processing method in an image processing apparatus,
Processing to acquire images,
A process of continuously designating different positions on the acquired image;
A process of following the continuously specified position and specifying an area including the specified position as a processing target area of image processing;
A process of notifying the specified processing target area following the specified position;
An image processing method comprising: For the computer of the image processing device,
The ability to retrieve images,
A process of continuously designating different positions on the acquired image;
A function of following the continuously designated position and specifying an area including the designated position as a processing target area for image processing;
A function of notifying the specified processing target area following the specified position;
A program to realize An image processing method in an image processing apparatus,
Processing to acquire an image having distortion;
A process for designating a position on the acquired image;
On the acquired image, a process for acquiring a distortion rate corresponding to the designated position;
Based on the designated position and the acquired distortion rate, a process for specifying an area including the designated position as a target area for image processing;
A process of notifying the specified processing target area following the specified position;
An image processing method comprising: For the computer of the image processing device,
A function of acquiring an image having distortion;
A function for designating a position on the acquired image;
A function for acquiring a distortion rate corresponding to the designated position on the acquired image;
Based on the specified position and the acquired distortion rate, a function for specifying an area including the specified position as a target area for image processing;
A function of notifying the specified processing target area following the specified position;
A program to realize

Images