JP2013008326A - Image processing device and control method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability in selection of a type of image processing and adjustment of a processing amount by a multi-touch operation.SOLUTION: Two touches on a display screen are recognized, a type of image processing is selected on the basis of a distance between the two recognized touches, a rotation angle obtained through movement of one touch of the two touches with the other touch as the center of rotation is acquired, a processing amount is calculated from the rotation angle, and image processing is performed on an image displayed on the display screen on the basis of the type of image processing and the processing amount.

Description

  The present invention relates to image processing for performing an input operation by a multi-touch operation.

2. Description of the Related Art In recent years, information processing apparatuses that use a touch panel configured integrally with a display screen as an operation input unit and perform a touch operation on a graphical user interface (GUI) member displayed on the screen have become widespread. In particular, since a small information processing apparatus such as a digital camera or a mobile phone has a limited area for placing hardware operation members, a touch panel that can handle many operation items by switching display of GUI members is often used.
In recent years, devices capable of multi-touch operation have increased, and there is an operation of rotating a map by a rotation operation in a state where a touch panel as proposed in Patent Document 1 is touched with a plurality of fingers. Specifically, this is realized by rotating the map at the detected rotation angle of the rotation operation by the user.

JP 2008-158842 A

On the other hand, in order to obtain a desired image by image processing, it is easy to select the type of image processing and adjust the processing amount with a series of operations on the desired area while checking the contents of the image processing on the screen. Need to be done.
However, the conventional technique has a problem in that selection of the type of image processing and adjustment of the processing amount cannot be performed by a series of operations.
The present invention has been made in view of the above problems, and an object of the present invention is to improve the operability of selecting the type of image processing and adjusting the processing amount by a multi-touch operation.

  An image processing apparatus according to the present invention that achieves the above object selects a type of image processing based on a recognition means for recognizing two touches on a display screen and a distance between the two touches recognized. Selecting means; and calculating means for obtaining a rotation angle obtained by moving one touch of the two touches and moving the other touch, and calculating a processing amount from the rotation angle; And image processing means for performing image processing on the image displayed on the display screen based on the type of image processing and the processing amount.

  According to the present invention, the multi-touch operation improves the operability of selecting the type of image processing and adjusting the processing amount.

1 is a block diagram of an image processing apparatus 100. FIG. The detailed flowchart of S403 in a modification. The figure which shows the example of an auxiliary | assistant display. A correspondence table between the distance between two points and the type of image processing. 5 is a flowchart in the image processing apparatus 100. Explanatory drawing of rotation operation. Explanatory drawing of the example which divides | segments an area | region by a tracing operation.

<Embodiment 1>
Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram of an image processing apparatus 100 in the present embodiment. The image processing apparatus 100 includes a display unit 11, a touch panel unit 12, a display control unit 13, a holding unit 14, a calculation unit 15, an operation recognition unit 16, and an image processing unit 17.

  The display control unit 13 controls the display unit 11 to display the image that has been subjected to image processing by the image processing unit 17 and the image that is held by the holding unit 14. The operation recognition unit 16 recognizes touches and rotation operations operated on the touch panel unit 12. The calculation unit 15 calculates the distance between the first touch and the second touch recognized by the operation recognition unit 16. Here, a point at which the operation recognition unit 16 first detects a touch is a first touch point, and a point at which a second touch is detected is a second touch point. Further, the calculation unit 15 calculates the rotation angle of the rotation operation recognized by the operation recognition unit 16. The image processing unit 17 divides the image displayed on the display unit 11 for each region, specifies the type of image processing based on the distance, and performs image processing based on the angle of the rotation operation. The holding unit 14 holds an image, a correspondence table described later, and the like.

  In the present embodiment, the display unit 11 and the touch panel unit 12 are integrally configured as a touch panel display. In addition, it is assumed that the touch panel unit 12 is a panel capable of multi-touch.

  FIG. 5 is a flowchart in the image processing apparatus 100.

  In step S <b> 502, the display control unit 13 reads the image data from the holding unit 14 and displays it on the display unit 11. In step S503, the operation recognition unit 16 recognizes the first touch by the user. In step S504, the image processing unit 17 divides the image data displayed on the display screen into two or more areas. In step S505, the image processing unit 17 sets a region including the first touch point among the regions divided in step S504 as a region for performing image processing. In step S <b> 506, the display control unit 13 performs display control so that the user can identify an area that includes the first touch by the user and an area that does not include the first touch. In step S507, the operation recognition unit 16 recognizes the second touch by the user. At this time, it is assumed that the second touch is recognized when the second touch is made while the first touch is made by the user.

  In step S508, the calculation unit 15 calculates the distance between the first touch point and the second touch point. In step S509, the image processing unit 17 selects the type of image processing based on the distance between two points and a correspondence table described later.

  FIG. 4 is a correspondence table between the distance between two points and the type of image processing to be selected. In the present embodiment, a color component handled in color tone adjustment will be described as an example of the type of image processing. The distance between two points is the distance between the point A of the first touch and the point B of the second touch. According to the correspondence table of FIG. 4, the image processing unit 17 determines that the blue component (B) when the distance AB between two points is 0 <AB ≦ 3 cm, the green component (G) when 3 <AB ≦ 6 cm, and 6 cm <AB. In this case, the red component (R) is selected as the type of image processing. The blue component (B), the green component (G), and the red component (R) are assigned from the smaller distance between the two points, and the blue component (B) and the green component ( G) and the order of red component (R). For this reason, when the user adjusts the color tone of the red component (R), it is easy to analogize that the distance between the two points should be increased, and the functions can be used in an intuitive manner.

  In step S510, the operation recognition unit 16 recognizes a rotation operation by the user. When the rotation operation is recognized, in step S511, the calculation unit 15 calculates and acquires the rotation angle of the rotation operation. The rotation angle is an angle obtained by moving the other touch with the one touch out of the two touches.

  In step S512, the image processing unit 17 obtains the processing amount of the image processing from the rotation angle, and executes the image processing selected in step S509. At this time, the obtained processing amount and image processing are performed on the region set in step S505. Here, the processing amount when executing the image processing is obtained by “the processing amount per rotation angle × 1 degree”. Further, in the case of the clockwise rotation, the image processing is applied to the plus, and in the case of the rotation to the counterclockwise, the image processing is applied to the minus. Note that the processing amount per degree is held in the holding unit 14.

  In step S513, the display control unit 13 displays the image after the image processing on the display unit 11. In step S <b> 514, the image processing unit 17 determines whether a predetermined end condition is satisfied such that a predetermined time elapses after the first touch and the second touch by the user are canceled substantially simultaneously. If it is determined that the end condition is satisfied, in step S515, the image processing unit 17 stores the image after the image processing is performed in the holding unit 14, and ends the flow.

  FIG. 6 is an explanatory diagram of the rotation operation. Here, an example will be described in which the first touch point is a point touched with a thumb and the second touch point is a point touched with an index finger.

  FIG. 6A shows a state in which an image 6001 is displayed on the screen of the display unit 11. FIG. 6B shows a state where the user touches the object 6002 of the image 6001 with the thumb 6012. A contact point between the thumb 6012 and the touch panel unit 12 is a point A. In FIG. 6B, when the operation recognition unit 16 recognizes the first touch on the touch panel 12 by the user's thumb 6012, the image processing unit 17 displays an image 6001 displayed on the screen as regions 6021 and 6022. Divide into

  In the present embodiment, the image processing unit 17 detects a boundary by analyzing a change in pixel value, and divides the image into two or more regions. In the case of a photographic image taken by an imaging device, the main subject is in focus, so the details are more detailed than the other areas, and high frequency components of the luminance frequency are distributed. On the other hand, since portions other than the main subject are blurred and photographed due to lens characteristics, there is no high frequency component. In addition, the boundary line that separates the main subject from the background or the like is generally configured so that the luminance, saturation, or color tone between adjacent pixels changes beyond a predetermined value. Therefore, if the distribution of the luminance frequency is measured for each part divided by the boundary line, and the part where the high-frequency components are gathered is divided from the other parts, the part can be divided as the main subject area.

  FIG. 6C shows an example in which a region 6022 not including the first touch point is hatched. This not only allows the user to identify that the image is divided into regions, but also indicates which region is selected.

  FIG. 6D shows a state where the user touches the index finger 6013 while touching the thumb 6012. A contact point between the index finger 6013 and the touch panel unit 12 is a point B. When the operation recognition unit 16 recognizes the second touch by the index finger 6013 while the first touch by the thumb 6012 is continued, the calculation unit 15 calculates the distance of the line segment AB connecting the point A and the point B. The image processing unit 17 selects the type of image processing to be performed on the selected region 6021 according to the distance of the line segment AB.

  In FIG. 6D, when the distance of the line segment AB, which is the distance between two points, is 4.5 cm, based on the correspondence table, the color component (type of image processing) handled by the image processing unit 17 in color tone adjustment. Is selected as the green component (G).

  FIG. 6E is a diagram in which the user performs a rotation operation around the point A. FIG. After the rotation operation, the color tone is adjusted according to the rotation angle of the rotation operation with two fingers. Here, the rotation operation will be described by taking as an example a case where an operation is performed so as to draw an arc with the index finger 6013 (second touch) around the thumb 6012 (first touch).

  FIG. 6F is a diagram for explaining the rotation angle. When the operation recognition unit 16 recognizes the rotation operation with two fingers by the user, the calculation unit 15 calculates the rotation angle. When the touch position of the index finger 6013 at the end point of the rotation operation is a point B ′, the rotation angle of the rotation operation is calculated as ∠BAB ′. In the present embodiment, the operation recognizing unit 16 recognizes the right rotation as an input operation corresponding to an increase in the target parameter and the left rotation as an input operation corresponding to a decrease in the target parameter.

  Since the image 6001 has color component data represented by RGB values of 256 gradations, it is possible to adjust the color tone by increasing / decreasing the value of each color component.

  In this embodiment, the color component for color tone adjustment has been described as an example of the type of image processing to be selected. However, the present invention is not limited to this. The types of image processing can be applied to adjustments such as brightness, contrast, saturation, gradation, dynamic range, and blurring amount. The type of image processing is not limited to the one that faithfully adjusts the numerical value of the image data, and can also be applied to adjustments such as a filter effect. The filter effect is a function for adding a special effect to an image. For example, an image such as a toy camera style or a diorama style can be obtained without requiring complicated work with a special lens or image processing software.

As described above, the area for image processing is designated by the first touch, the interval between the second touch and the first touch is changed, the type of image processing is selected, and the rotation operation is rotated. The amount of processing can be controlled by the angle.
The image processing apparatus 100 can perform auxiliary display when selecting an image processing type based on a distance between two points and performing a parameter adjustment operation based on a rotation angle of a rotation operation. FIG. 3 is a diagram illustrating an auxiliary display example displayed by the image processing apparatus 100.

  FIG. 3A is an auxiliary display displayed when selecting an image processing type based on a distance between two points. In FIG. 3, when the operation recognition unit 16 recognizes two touches of the thumb 9012 and the index finger 9013, the display control unit 13 assists along the line segment AB based on the distance information of the line segment AB calculated by the calculation unit 15. The display 9031 is controlled to be displayed. In FIG. 3, the line segment AB is 7 cm, and according to the correspondence table of FIG. 4, the content of the selected image processing is the red component (R), so that the corresponding portion of the auxiliary display 9031 is highlighted. ing. By viewing the auxiliary display, the user can see not only what image processing type is currently selected, but also how much the finger spacing can be changed to change the selection to another image processing type. .

  FIG. 3B is an auxiliary display that is displayed in the parameter adjustment operation based on the rotation angle of the rotation operation. When the operation recognition unit 16 recognizes the rotation operation at two points from the state of FIG. 3A, the display control unit 13 sets the line segment AB as the diameter based on the distance information of the line segment AB calculated by the calculation unit 15. Control to display a circular auxiliary display 9032. The display of the auxiliary display 9032 is changed according to the type of image processing adjusted by the rotation operation. In this embodiment, color tone adjustment is described as an example of the type of image processing, and the increase / decrease in the numerical value of the color component is adjusted by a rotation operation. In the auxiliary display 9032, the current numerical value 9101 is displayed in the vicinity of the point B that is the starting point of the rotation operation. Further, a numerical value 9102 indicating that the operation is to decrease the numerical value when the left rotation operation is performed, and a numerical value 9103 that is an operation to increase the numerical value are displayed when the right rotation operation is performed. With these auxiliary displays, the user can easily understand the operation method intuitively. Depending on the type of image processing to be handled, the current setting can be displayed in the vicinity of the starting point of the rotation operation, and the value adjusted by the operation can be displayed on the left and right.

  In this way, by performing the auxiliary display that makes it easy to infer the operation method that the user must perform, the operation method of the image processing apparatus can be performed more intuitively.

<Modification>
In the first embodiment, the region division in the image is performed by the boundary detection. However, it is possible to designate the region by an arbitrary operation by the user. For example, the operation recognition unit 16 recognizes a trajectory that the user performs a tracing operation on the touch panel 12 so as to surround the edge of the subject, and the image processing unit 17 performs control so as to divide the image into regions inside and outside the trajectory. Can do. Here, the tracing operation is an operation of moving the touched point while touching.

  FIG. 7 is an explanatory diagram of an example of dividing an area by a tracing operation. In the case where an area of the image 7001 is divided from the outer periphery of the object 7002, the user designates the area by tracing the outer periphery of the object 7002 with the index finger 7013 as shown in FIG. As shown in FIG. 7B, when the trajectory is recognized as a closed figure, the image processing unit 17 divides the trajectory 7031 into a region inside and outside the trajectory. Various conditions can be set for recognizing a closed figure, for example, the start point and end point of the tracing operation coincide with each other, and the touch point intersects the locus. Further, a frame of the display screen may be used for recognizing a closed figure.

  FIG. 7C is a diagram when the first touch point A is selected for the region divided by the tracing operation. In FIG. 7C, as in FIG. 6C, the hatching process is performed on the unselected region.

  FIG. 2 is a detailed flowchart of S504 when determining a region to be divided by the tracing operation.

  In step S <b> 801, when the operation recognition unit 16 detects a user's tracing operation while displaying the image 7001, the operation recognition unit 16 stores a trajectory. In step S802, the operation recognition unit 16 determines whether the locus is a closed figure. If it is determined that the locus is a closed figure, in step S803, the image processing unit 17 divides the region with the locus as a boundary. If it is determined in step S803 that the figure is not a closed figure, in step S804, the operation recognition unit 16 recognizes a line composed of a line segment connecting the start point and end point of the tracing operation and the locus 7031 as a boundary of region division.

  FIG. 7D shows an example where the subject is not in the image and the user has drawn a locus 7032 starting from point C and ending with point D. When the frame of the display screen is also used for recognizing the closed figure, a line composed of the locus 7032 and the line segment CD can be recognized as the boundary of the area division.

  In this way, by specifying the area to be divided by the user's arbitrary operation, it is possible to deal with images that are difficult to divide by boundary detection or when you want to perform image processing only on specific areas Become.

  As described above, according to the present embodiment, the type of image processing and the adjustment of the processing amount can be easily performed by performing a series of operations on a desired region while confirming the contents of the image processing.

  Note that the processing of the above-described embodiment may provide a system or apparatus with a storage medium that records software program codes that embody each function. The functions of the above-described embodiments can be realized by the computer (or CPU or MPU) of the system or apparatus reading out and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. As a storage medium for supplying such a program code, for example, a hard disk, an optical disk, a magneto-optical disk, or the like can be used. Alternatively, a CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, or the like can be used.

  The functions of the above-described embodiments are not only realized by executing the program code read by the computer. Including the case where the OS (operating system) running on the computer performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. It is.

  Further, the program code read from the storage medium may be written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After that, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Is also included.

Claims (8)

Recognition means for recognizing two touch points on the display screen;
Selection means for selecting the type of image processing based on the recognized distance of the two touch points;
Calculating means for obtaining a rotation angle obtained by moving one touch of the two touches and moving the other touch, and calculating a processing amount from the rotation angle;
An image processing apparatus comprising image processing means for performing image processing on an image displayed on the display screen based on the type of image processing and the processing amount. Of the two touches, the first touch is the first touch,
The image processing means divides an image displayed on a display screen into a plurality of regions, and performs image processing on a region including the first touch among the plurality of regions. The image processing apparatus according to claim 1, wherein:   The image processing apparatus according to claim 1, further comprising display control means for displaying information on the type of image processing on a display screen.   The image processing apparatus according to claim 3, wherein the display control unit further displays information on the processing amount. A recognition step for recognizing a touch of two points on the display screen;
A selection step in which the selection means selects the type of image processing based on the recognized distance of the two touch points;
A calculating step in which the calculation means obtains a rotation angle obtained by moving one touch of the two touches and moves the other touch, and calculates a processing amount from the rotation angle; ,
An image processing unit comprising: an image processing step of performing image processing on an image displayed on the display screen based on the type of image processing and the processing amount. Control method. Of the two touches, the first touch is the first touch,
The image processing step divides an image displayed on a display screen into a plurality of regions, and performs image processing on a region including the first touch among the plurality of regions. The method of controlling an image processing apparatus according to claim 5, wherein:   A program that causes a computer to function as each unit of the image processing apparatus according to claim 5 by being read and executed by the computer.   A computer-readable storage medium storing the program according to claim 7.

Images