JPH11306374A - Picture display and picture processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to easily confirm a correction part at the time of correcting details in an area of a picture by the user. SOLUTION: In a picture display, an area as an object of picture processing like color correction is displayed as a curve roping picture indicating its outline and only a part which the user wants to enlarge is enlarged and displayed. That is, input picture data is displayed on the display, and a roping picture is displayed in the periphery of the selected area in accordance with user's operation. If the user selects an enlargement display mode, the input picture and the area picture only within a circular area having, for example, a mouse pointer as the center is enlarged and displayed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display apparatus and an image processing apparatus in which an image in a certain area around a pointer is enlarged so that an area to be processed can be easily designated. About the method.

[0002]

2. Description of the Related Art In recent years, the production of Internet homepages has become widespread, and retouching software for processing image data and creating homepage contents has become widespread. In image processing by retouching software, it is necessary to select an area to be processed. In order to indicate a processing target area in an image to a user, a method called lasso display, in which a contour of a processing target is displayed by a curve, may be adopted.
For example, Japanese Patent Laying-Open No. 7-303182 discloses a processing area display method similar to lasso display in retouching software, which displays an outline of an area to be subjected to chroma key processing in an image.

Further, in order to select a processing target area,
A method called Magic Wand, which automatically extracts the outline of the object included in the image and automatically selects the area within the outline for processing, is called Photo Shop (product name of Adobe Systems),
Paint Shop Pro (trade name of Jasc Software) and Photo
It is used in Impact (trade name of Ulead Systems). According to this magic wand, the processing target area in the image can be automatically selected. However, in order to accurately specify the processing target area desired by the user, the processing target area automatically selected is selected. Details need to be corrected manually.

In order to check and correct the details of the processing target area, it is preferable to enlarge the image and display it. However, if the entire image is simply enlarged, the entire image will not fit on the screen and scrolling of the screen will occur. It may be necessary, and on the contrary, the correction work may be difficult. A similar problem also occurs when the user designates, as a processing target area, the area of the trajectory where the mouse pointer is moved by freehand.

[0005]

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems of the prior art, and has been made in consideration of the problems described above.
When the user of the software moves the mouse pointer by freehand to specify the area to be image-processed or corrects the details of the automatically selected area, it is necessary to check the entire image. It is an object of the present invention to provide an image display device and an image processing method capable of performing work and easily performing fine work. Another object of the present invention is to provide an image display device and an image processing method that allow a user to easily confirm a finely corrected portion when the user corrects details of an area to be subjected to image processing. .

[0006]

Means for Achieving the Object [Image Display Apparatus] To achieve the above object, an image display apparatus according to the present invention comprises:
Image display means for displaying input image data (input image data), and pointing for pointing an arbitrary position of the input image data in response to a pointing operation for designating an arbitrary position of the displayed input image data Means, an area image display means for displaying an area image indicating an arbitrary area of the input image data, in response to a pointing operation on the displayed input image data, and a display selection operation for selecting a display method, Image display changing means for changing the size of the input image data and the area image display means within a predetermined area corresponding to the pointed position and displaying the input image data.

Preferably, in response to an area selection operation for selecting an area of the input image data, an area selection means for selecting an area of the input image data designated by a pointing operation on the displayed input image data; And image processing means for performing predetermined image processing on the input image data in the selected area.

Preferably, the area image display means changes and displays an area image indicating an arbitrary area of the input image data in accordance with the pointing operation, and the image display change means operates the pointing device. The input image data and the lasso image in a predetermined area corresponding to the position are displayed in an enlarged manner.

[Operation of Image Display Apparatus] An image display apparatus according to the present invention displays an area to be subjected to image processing as a curve (lasso) image showing its outline, and allows a user to operate a mouse button or the like. When the enlarged display mode is selected, only the input image and the lasso image in a predetermined area around the mouse pointer are enlarged and displayed.

[Image Display Means] The image display means displays input image data on a display device.

[Pointing Means] The pointing means points an arbitrary position of the displayed input image data in response to a user operation using a pointing device such as a mouse pointer.

[Area image display means] The area image display means is, for example, specified by the user moving the mouse pointer by freehand, or the retouching software automatically detects the contour of the object in the image, A curve (lasso) image (region image) indicating the outline of the processing target region corrected by the user's mouse operation is displayed in association with the input image data.

[Image display changing means] The image display changing means enlarges the input image and the area image in the circular area centered on the mouse pointer when, for example, the user selects the enlarged display mode by operating the mouse button. This changes the image display. The image display changing means may perform reduced display of these images in addition to enlarged display of these images in accordance with the setting of the user.

[Area Selection Means] The area selection means selects, for example, a processing target area specified or corrected by the user in accordance with the user's mouse button operation.

[Image processing means] The image processing means performs, for example, retouch processing such as color change, painting and clipping on image data in the processing target area selected by the area selecting means.

[Image Processing Method] The image processing method according to the present invention provides a pointing operation for displaying input image data (input image data) and designating an arbitrary position of the displayed input image data. Accordingly, an arbitrary position of the input image data is pointed, and a region image indicating an arbitrary region of the input image data is displayed according to a pointing operation on the displayed input image data, and a display method is selected. Depending on the display selection operation,
The size of the input image data and the area image display means in a predetermined area corresponding to the pointed position is changed and displayed, and displayed according to an area selection operation of selecting an area of the input image data. Then, an area of the input image data designated by a pointing operation on the input image data is selected, and predetermined image processing is performed on the input image data in the selected area.

[Recording medium] In an image processing apparatus for displaying input image data and performing predetermined image processing, an image display step of displaying input image data (input image data); A pointing step of pointing to an arbitrary position of the input image data in response to a pointing operation of designating an arbitrary position of the image data; and a pointing step of pointing to an arbitrary position of the input image data. An area image display step of displaying an area image indicating the area of the input image data, and the input image data and the area image display step in a predetermined area corresponding to a pointed position in response to a display selection operation of selecting a display method. Performing an image display change step of changing the size and displaying the image on the computer To record the program to.

Preferably, in response to an area selection operation for selecting an area of the input image data, an area selection step of selecting an area of the input image data designated by a pointing operation on the displayed input image data; And performing an image processing step of performing predetermined image processing on the input image data in the selected area.

Preferably, in the area image display step, the area image indicating an arbitrary area of the input image data is changed and displayed in accordance with the pointing operation; And causing the computer to execute processing for enlarging and displaying the input image data and the lasso image in a predetermined area corresponding to the pointed position.

[0020]

Embodiments of the present invention will be described below. [Image Processing Apparatus 1] FIG. 1 is a diagram showing a configuration of an image processing apparatus 1 according to the present invention. As shown in FIG. 1, the image processing apparatus 1 includes an input device 10, a CPU 14, a memory 16,
Image display interface (IF) 18, display device 20 using CRT or the like, and hard disk device (HDD)
Is a computer connected via a bus 24 and capable of image processing. The input device 10 includes, for example, a keyboard 100, a pointing device such as a mouse 102, a keyboard 100 and a mouse 102.
And an input interface 14 that accepts a user's operation on and outputs it to the CPU 14.

[Input device 10] In the input device 10,
The input interface 12 receives a user's press of a button on the keyboard 100 and a pointing operation on the mouse 102, and receives a command via the bus 24.
Output to PU14.

[CPU 14] The CPU 14 is composed of a microprocessor and its peripheral circuits.
2 is loaded into the memory 16 and executed to implement the image processing method according to the present invention.

[Image Display Interface 18] The image display interface 18 converts image data generated by the retouching software 3 executed by the CPU 14 into image signals and displays them on the display device 20.

[Storage Device 22] The storage device 22 stores software executed by the CPU 14, such as the retouching software 3, and data necessary for processing by the CPU 14. The storage device 22 stores image data to be processed by the retouch software 3 and stores the image data in the retouch software.
It supplies the image data to the software 3 and further stores the image data generated by the retouching software 3.

[Retouch Software 3] FIG. 2 is a diagram showing a configuration of the retouch software 3 executed in the image processing apparatus 1 shown in FIG. As shown in FIG. 2, the retouching software 3 includes an operation receiving unit 30,
It comprises a pointer display section 32, an area image display section 34, an enlarged image display section 36, an image display section 38, an image synthesis section 40, an area selection section 42, and an image processing section 44. The retouching software 3 uses these components to read and supply input image data from the storage device 22 or the like,
Alternatively, in the input image data captured and supplied by a digital camera or the like (not shown) connected to the image processing apparatus 1, a processing target area to be processed is selected and input according to a user operation. After correction, image processing (retouch processing) such as color change is performed on the input image data in the processing target area.

[Operation Receiving Unit 30] The operation receiving unit 30 receives an operation input indicating an operation performed on the input device 10 by the user from the input interface 12, and
0, calculate the coordinates of the mouse pointer on the screen 0, and in accordance with the operation on the buttons of the keyboard 100 and the mouse 102, a processing mode such as screen enlargement, and
A control command indicating the end of the area selection and the like is generated and output to each component of the retouching software 3.

[Pointer display section 32] Pointer display section 3
2 generates pointer image data that displays, for example, an arrow-shaped mouse pointer at a position on the screen of the display device 20 indicated by the mouse pointer coordinates input from the operation receiving unit 30, and generates the image combining unit 40 and the enlargement. Output to the image display unit 36.

[Region image display unit 34] FIG. 3 is a diagram illustrating a lasso image generated by the region image display unit 34 shown in FIG. The area image display unit 34 performs, for example, an operation on the input device 10 in which the user specifies an outline of an area (processing target area) in the input image data to be subjected to image processing, and then presses a mouse button. Curve (lasso) image (area image) showing the locus of the mouse pointer as shown in FIG. 3 when the mouse pointer is moved while being pressed
Is generated in association with the input image data to generate area image data, and the enlarged image display unit 36 and the image combining unit 40
Output to

For example, when the user performs an operation on the input device 10 to designate the automatic creation of a processing target region, the region image display unit 34 displays the outline of the object included in the input image data. Area image data for detecting and displaying the lasso indicating the contour of the object in association with the input image data is generated and output to the enlarged image display unit 36 and the image synthesis unit 40.

For example, when the user once performs an operation of correcting the designated lasso image, the region image display unit 34 displays the corrected lasso so as to pass the position clicked by the mouse. Region image data for displaying the image in association with the input image data is generated and output to the enlarged image display unit 36 and the image synthesis unit 40.

[Image Display Unit 38] The image display unit 38 (FIG. 2) generates image data to be displayed on the display device 20 without enlarging the input image data, and outputs it to the image synthesizing unit 40.

[Enlarged Image Display Section 36] Enlarged Image Display Section 3
6, when the enlargement mode is selected by the user, the coordinates within a certain range around the mouse pointer, for example, within a radius n (n is an integer) of pixels from the coordinates of the mouse pointer, or the coordinates of the mouse pointer. Enlarged image data for enlarging and displaying the input image data, the area image data, and the pointer image data in the center rectangular area is generated and output to the image synthesizing unit 40. When the enlargement mode is not selected, the enlarged image display unit 36 does not output the enlarged image data. In some applications, the enlarged image display unit 36 does not enlarge each of the data, but generates image data in which the data is reduced or the color is changed to black and white. May be output.

[Image Synthesizing Unit 40] FIGS. 4A and 4B
FIG. 3 is a diagram illustrating display image data output by the image combining unit 40 shown in FIG. 2. The image synthesizing unit 40 overlaps the area image data input from the area image display unit 34 with the enlarged image data input from the enlarged image display unit 36, and further overlaps the pointer image data input from the pointer display unit 32. Display image data for displaying the combined image is generated and displayed on the display device 20 via the image display interface 18.

When the enlargement mode is selected and the enlarged image display unit 36 is set to enlarge the image in the circular area around the pointer, the image output by the image combining unit 40 is, for example, as shown in FIG. As shown in FIG. Also,
Similarly, when the enlargement mode is selected and the enlarged image display unit 36 is set to enlarge the image in the rectangular area around the pointer, the image output by the image combining unit 40 is, for example, as shown in FIG. The result is as shown in FIG.

The image synthesizing section 40 is connected to the image display section 38.
After the start of the retouching process, the processed image data input from the image processing unit 44 is displayed instead of the non-enlarged image data input from the user. , The retouching work can be made easier.

[Area Selection Section 42] The area selection section 42, for example, when the user specifies the contour of the processing target area and then performs an operation to end the selection / correction of the specified processing target area, An area in the input image data surrounded by the lasso image generated by the area image display unit 34 is selected as a processing target area. In addition, the area selection unit 42, for example,
When the user performs an operation of selecting a process (painting process) for coloring the trace of the pointer, a range of a region inside the fixed width centered on the trace of the pointer is selected as the processing target region.

[Image Processing Unit 44] The image processing unit 44 performs a retouching process such as cutting, color correction, and painting on the processing target area in the input image data selected by the area selecting unit 42. The processed image data is generated and output to the display device 20 or the storage device 22.

[First Operation of Image Processing Apparatus 1] A first operation when the image processing apparatus 1 performs a color correction process or the like on a processing target area will be described below with reference to FIG. FIG. 5 shows a first operation (S1) of the image processing apparatus 1 shown in FIG.
It is a flowchart which shows 00). As shown in FIG. 5, in step 102 (S102), the image synthesizing unit 40 (FIG. 2) of the retouching software 3 of the image processing apparatus 1 (FIG. 1) transmits the non-enlarged image data input from the image display unit 38. (Or processed image data), the area image data input from the pointer display unit 32, and the enlarged image data input from the enlarged image display unit 36 are combined, and an image such as that shown in FIG. indicate.

In step 104 (S104), the enlarged image display unit 36 determines whether the user has selected the enlarged mode. If the user has selected the enlargement mode, the enlarged image display unit 36 proceeds to the process of S106, otherwise proceeds to the process of S108.

In step 106 (S106), the enlarged image display unit 36 generates enlarged image data for enlarging and displaying the periphery of the pointer, and the image synthesizing unit 40 compares the enlarged image data from the enlarged image display unit 36 with the enlarged image data. , Area image data, non-enlarged image data (processed image data), and pointer image data to generate display image data as shown in, for example, FIG. 20 is displayed.

In step 108 (S108), the enlarged image display unit 36 stops generating the enlarged image data.
0 synthesizes the area image data, the non-enlarged image data (processed image data) and the pointer image data, generates, for example, display image data as shown in FIG.

In step 110 (S110), the area image display unit 34 generates or corrects area selection image data according to the operation of the user. Also, the area selection unit 42
Generates or corrects a processing target area according to a user operation.

In step 112 (S112), the area selector 42 determines whether or not the user has performed an operation to end the creation or modification of the processing target area. When the user has finished creating / modifying the processing target area, the area selecting unit 42 proceeds to the processing of S114, otherwise proceeds to the processing of S104.

In step 114 (S114), the area selection section 42 selects an area surrounded by the area image generated by the area image display section 34 from the input image data as a processing target area.

In step 116 (S116), the image processing section 44 performs processing such as color correction designated by the user on the input image data included in the processing target area selected in the processing in S114, and Is output to the image synthesizing unit 40, the storage device 22, and the like.

In step 118 (S118), the pointer display section 32 and the enlarged image display section 36 determine whether or not the user has performed an operation of moving the pointer.
If the pointer has been moved, the process returns to S104,
Otherwise, the process proceeds to S120.

In step 120 (S120), operation accepting section 30 determines whether or not the user has performed an operation for selecting the end of the work. If the end of the work has been selected, the process proceeds to S122, and otherwise. In the case of, the process returns to S104.

In step 122 (S122), operation accepting section 30 determines whether or not the user has performed an operation for performing the next retouching process, and if there is the next retouching process, proceeds to the process of S102. Otherwise, the process ends.

[Second Operation of Image Processing Apparatus 1] A second operation when the image processing apparatus 1 performs a paint process or the like on the trajectory of a pointer will be described below with reference to FIG. FIG.
Is the second operation (S13) of the image processing apparatus 1 shown in FIG.
It is a flowchart which shows 0). Note that among the processes in FIG. 6, the processes denoted by the same reference numerals as those in FIG. 5 are the same as those in FIG.

As shown in FIG. 6, step 102 (S1
02) to Step 108 (S108), each component of the retouching software 3 displays an image obtained by combining the non-enlarged image data (processed image data) and the enlarged image data, and the user selects the enlargement mode. It is determined whether or not the image is composed of enlarged image data, non-enlarged image data (processed image data) and pointer image data, or is composed of non-enlarged image data (processed image data) and pointer image data. Display an image.

In step 132 (S132), the area selecting section 42 selects the area around the trajectory of the pointer moved in response to the operation of the user as an area to be processed.

In step 134 (S134), the image processing section 44 performs a retouching process such as a paint process for painting the processing target area selected by the area selecting section 42 with a color designated by the user.

Step 118 (S118) to Step 1
22 (S122), the retouching software 3
The constituent parts of whether or not the user has performed an operation of moving the pointer, whether or not the user has performed an operation of selecting the end of the work, and whether or not the user has performed an operation of performing the next retouching process Judge, and according to the judgment result, S1
20, S122, S102, and S104.

FIG. 7 is a diagram showing an image displayed on the display device 20 by enlarging the entire display image data shown in FIG. As shown in FIG. 7, when the entire display image data is enlarged and the processing target area is selected and corrected, only a part of the display image data is displayed on the display device 20, and the user works while checking the entire image. Can not do. On the other hand, according to the image processing apparatus 1 according to the present invention, FIG.
As can be understood by referring to (B), the user can select and correct details of the processing target area while checking the entire image, so that the work is easy and the efficiency is improved.

[0055]

As described above, according to the image display apparatus and the image processing method according to the present invention, the user who uses the retouching software moves the mouse pointer by freehand to set the area to be subjected to image processing. You can work on the entire image when you specify or modify the details of the automatically selected area,
In addition, fine work can be easily performed. Further, according to the image display device and the image processing method of the present invention, when the user corrects the details of the area to be subjected to the image processing, it is possible to easily confirm the finely corrected portion.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of an image processing apparatus according to the present invention.

FIG. 2 is a diagram illustrating a configuration of retouching software executed in the image processing apparatus illustrated in FIG. 1;

FIG. 3 is a diagram illustrating a lasso image generated by an area image display unit shown in FIG. 2;

FIGS. 4A and 4B are diagrams exemplifying display image data output by the image synthesis unit shown in FIG. 2;

FIG. 5 is a first operation (S1) of the image processing apparatus shown in FIG. 1;
It is a flowchart which shows 00).

FIG. 6 shows a second operation (S1) of the image processing apparatus shown in FIG.
It is a flowchart which shows 30).

FIG. 7 is a diagram showing an image displayed on a display device by enlarging the entire display image data shown in FIG. 3;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Image processing apparatus 10 ... Input device 12 ... Input interface 100 ... Keyboard 102 ... Mouse 14 ... CPU 16 ... Memory 18 ... Image display interface 20 ... Display device 22 ... Storage device 24 ... Bus 3 ... Retouching software 30 ... Operation receiving unit 32 ... Pointer display unit 34 ... Area image display unit 36 ... Enlarged image display unit 38 image display unit 40 image combination unit 42 area selection unit 44 image processing unit

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] May 19, 1999

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claims

[Correction method] Change

[Correction contents]

[Claims]

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Masayuki Ryuto 1623-14 Shimotsuruma, Yamato-shi, Yamato Kanagawa, Japan

Claims (7)

[Claims] 1. Input image data (input image data)
An image display means for displaying the input image data; a pointing means for pointing an arbitrary position of the input image data in response to a pointing operation for indicating an arbitrary position of the displayed input image data; and the input image data displayed Area image display means for displaying an area image indicating an arbitrary area of the input image data in response to a pointing operation with respect to a predetermined area corresponding to a pointed position in response to a display selection operation for selecting a display method An image display changing means for changing the size of the input image data and the area image displaying means in the image display. 2. An area selecting means for selecting an area of the input image data designated by a pointing operation on the displayed input image data in response to an area selecting operation of selecting an area of the input image data, 2. The image display device according to claim 1, further comprising: image processing means for performing predetermined image processing on the input image data in the selected area. 3. The area image display means changes and displays an area image indicating an arbitrary area of the input image data in response to the pointing operation, and the image display change means operates the pointing position. The image display device according to claim 1, wherein the input image data and the lasso image in a predetermined area corresponding to the image are enlarged and displayed. 4. Input image data (input image data)
In response to a pointing operation to indicate an arbitrary position of the displayed input image data, pointing to an arbitrary position of the input image data, and according to a pointing operation to the displayed input image data, Displaying an area image indicating an arbitrary area of the input image data, and displaying the input image data and the area image display means in a predetermined area corresponding to a pointed position in response to a display selection operation for selecting a display method The size of the input image data is displayed, and in response to an area selection operation for selecting an area of the input image data, an area of the input image data specified by a pointing operation on the displayed input image data is selected. An image processing method for performing predetermined image processing on the input image data in a selected area. 5. An image processing apparatus for displaying input image data and performing predetermined image processing, comprising: an image display step of displaying input image data (input image data); A pointing step of pointing an arbitrary position of the input image data in response to a pointing operation of designating an arbitrary position of the input image data; and an arbitrary area of the input image data in response to a pointing operation of the displayed input image data. Area image displaying step of displaying an area image indicating the size of the input image data and the area image displaying step in a predetermined area corresponding to a pointed position in response to a display selection operation of selecting a display method For causing a computer to execute the image display changing step of changing and displaying the image. Recording medium recording the ram. 6. An area selecting step of selecting an area of the input image data specified by a pointing operation on the displayed input image data in response to an area selecting operation of selecting an area of the input image data. The computer-readable recording medium according to claim 5, wherein the computer executes an image processing step of performing predetermined image processing on the input image data in the selected area. 7. In the area image display step,
A process of changing and displaying an area image indicating an arbitrary area of the input image data according to the pointing operation; and an input image in a predetermined area corresponding to the pointed position in the image display changing step. The recording medium according to claim 5, wherein the computer is configured to execute a process of enlarging and displaying data and the lasso image.