JP2004506995A - Enlarging and editing parts of an image in the context of the image - Google Patents

Abstract

In a method and computer program for enlarging and modifying a portion of an image, the enlarged portion of the image is positioned to preserve visual context within the image. In another embodiment, the visual context for the magnified portion of the image is displayed by a visual cue indicated in the image and allows for changing the portion of the magnified image.
[Selection diagram] Fig. 1

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to image enlargement and editing.
[0002]
[Prior art]
Tools that allow a computer user to enlarge portions of an image and make modifications to it (ie, edit them) are an important aspect of graphics applications. Magnification tools allow computer users to detect small features in portions of an image. Such features are often imperceptible when the original image is displayed entirely on a computer screen, but they are apparent when a portion of the image is magnified. And may be clear. Tools that allow a user to modify an enlarged version of a portion of an image and then apply these modifications to the original view of the image are also useful. This is because they allow the user to change small features that are not perceptible in the overall image view. Thus, the user can inspect a portion of the image closely, make corrections to the details revealed in the magnified view, and then apply these corrections to the image as a whole. is there.
[0003]
There are tools to enlarge parts of the image. The user may be able to select a portion of the image to magnify, for example, by positioning a cursor over the portion of the image that the user wants to inspect more closely. In some cases, the original view of the image is replaced with a magnified view of a portion of the image. In other cases, the original view of the image stops before the user and the second magnified view appears, possibly next to its first. Tools also exist that allow a user to modify a magnified view of a portion of an image and apply these modifications to an unmagnified image. They are included in document processing applications as well as graphics applications.
[0004]
However, such magnification and editing tools are problematic. This is because there is an inverse relationship between view clarity or resolution in the field of view. At higher levels of magnification, the user sees finer parts but will see smaller parts of the image. Thus, the user has little or no awareness of the relationship or correspondence between the magnified view and the original image. At a high magnification, or high degree of magnification, it may not be possible for the user to identify the part of the image present in the magnified view. Even if the user recognizes which part of the image is shown in the magnified view, it is difficult for the user to recognize the relationship between the magnified view and the overall image. There are cases.
[0005]
Thus, with existing magnification and editing tools, the user loses the visual context for the magnified portion of the image relative to the non-magnified portion of the image. It is unclear which part of the image is being magnified, or what magnification for that part fits the rest of the image, so that the user can view the image relative to the rest of the image. It may not be possible to make the appropriate modifications to that part. While the user may be able to make modifications in response to small features that appear in the magnified view, the user may not be able to make modifications in response to the visual context of the complete image. Impossible.
[0006]
The problem of identifying how a magnified portion of an image corresponds to the rest of the image allows the user to partially change the portion of the image shown in the magnified window And has been addressed. For example, the user may be able to adjust the portion of the image shown in the magnified view by manipulating scroll bars on the horizontal and vertical axes of the magnified window. If the magnified view does not show a portion of the image of interest, the user can change it. By examining nearby parts of the image with such tools, the user finds recognizable features of the image and estimates which part of the image is shown in the magnified view and how it is It may be possible to estimate what is related to the parts around the image.
[0007]
The problem of identifying how a magnified portion of an image corresponds to the rest of the image is also a problem in presenting a magnified view of a portion of the image next to the original image and between them. The problem is partially dealt with by providing a cue indicating the correspondence. For example, manipulation of one window can cause correlated changes in portions of the image shown in multiple windows. On the other hand, the correspondence between the two images can be estimated by comparing the markings on the horizontal and vertical rulers in each of those views. In this case, a point at a specific coordinate in the enlarged window corresponds to a point at the same coordinate in the original view.
[0008]
[Problems to be solved by the invention]
However, each of these tools allows the user to modify the details of a magnified view of a portion of an image while taking into account the relationship between the detailed features and the non-magnified portions of the image. It does not provide enough cues for the game. The user is not able to edit the enlarged portion of the image within the visual context of the overall image.
[0009]
[Means for Solving the Problems]
In general, in one aspect, the invention features a method and computer program product for enlarging and modifying (ie, editing) a portion of an image within the visual context of a larger image.
[0010]
Particular implementations may include one or more of the following features. An enlarged view of a portion of the image is superimposed and centered over that portion of the image in the original view. The user can change the portion of the image shown in the magnified view. The user defines the size of the magnified view of the portion of the image or the degree of magnification of the portion of the image. The user processes the enlarged view and makes corrections to the image. These modifications are applied to the corresponding parts of the image. In the enlarged view, the modification will be a change in at least one pixel value. Pixels in the image corresponding to changed pixels in the magnified view are also changed.
[0011]
In general, in another aspect of the invention, the present invention presents an enlarged portion of an image in an area smaller than the image but not necessarily in the visual context of the larger image and the user Features a method and a computer program product that allow it to be modified. In this implementation, the magnified portion is displayed with a visual cue shown with the image, and the user can change the portion of the magnified image. These tools allow the user to easily estimate the visual context.
[0012]
Particular implementations may include one or more of the following features. The part of the image presented in the enlarged view is displayed, for example, by separating it with a dotted line. The user indicates the size of the enlarged view of the portion of the image, the degree of magnification of the portion of the image, or the location of the enlarged version of the portion of the image relative to the image. The user corrects the image by operating the enlarged view. These modifications are applied to the corresponding parts of the image. In a magnified view, the modification changes at least one pixel value. Pixels in the image corresponding to changed pixels in the magnified view are also changed.
[0013]
Advantages that can be obtained in implementations of the invention include one or more of the following. The present invention provides a magnified view of a portion of an image and allows editing of the magnified portion within the visual context of the non-magnified portion of the image. The user may consider the relationship between the detailed features shown in the magnified view of a portion of the image and the non-magnified portion around the image when changing for the magnified portion of the image. It is possible.
[0014]
BEST MODE FOR CARRYING OUT THE INVENTION
In one implementation, the invention allows a computer user to create a magnified version of a portion of an image centered over a magnified portion of the image, and to perform the magnifying in the context of the non-magnified portion of the image It makes it possible to make modifications to the modified version and to apply these modifications to the non-magnified image.
[0015]
As shown in FIG. 1, the present invention is used to make corrections on an image 1 shown in an original window 2. The user selects a part of the image 1 as an enlarged part 3. The enlarged portion 3 is delimited by a dotted line in the drawing and surrounds one of the three mountain-like peaks and the canyon-like line or line 25 in the image 1. The portion of the image 1 that is not included in the enlarged portion 3, that is, the portion that is not surrounded by the dotted line is the unexpanded portion 4. There may be special features in the non-magnified portion 4 of the image 1, such as features 5 such as oval lakes and features 6 such as jagged clouds.
[0016]
The user can define the size of the enlarged window 7. On the other hand, the user can specify the degree of enlargement, that is, the magnification of the enlarged portion 3. Once the dimensions of the enlarged portion 3 and the degree of magnification are defined, the dimensions of the enlarged window 7 can be calculated. The magnified window 7 is larger than the non-magnified portion 3 of the image 1. The portion of the enlarged window 7 excluding the enlarged portion 3 of the image 1 is a hidden area 8. This hidden area 8 and some of the features in this hidden area 8, for example a cloud-like feature 6, are hidden by an enlarged window of selected dimensions 7.
[0017]
As shown in FIG. 2, the system provides an enlarged version 9 of the enlarged portion 3 of the image 1 according to the selected magnification 7 in the enlargement window 10. The magnified window 10 is superimposed on the original window 2 and centered on the magnified portion 3 of the image 1. The magnifying window 10 hides a magnified portion 3 of the image 1 and a hidden area 8 of the image 1 that includes a portion of the feature 6 such as a cloud. Furthermore, the enlarged version 9 of the magnified portion 3 of the image 1 is smoothly aligned with the visible portion 11 of the non-magnified portion 4 because the portion 8 of the unmagnified portion 4 of the image 1 is hidden. It does not do. In particular, the lines showing peaks like three peaks in the image 1 are cut off at the boundary between the enlarged window 10 and the visible portion 11 of the unenlarged portion 4.
[0018]
A magnified version 9 of the magnified portion 3 of image 1 shows features such as gorge-like lines 25 shown in image 1 and triangles 12 which were not apparent in image 1 It is possible to represent small features. Furthermore, only the part 11 of the non-magnified part 4 of the image 1 is visible in FIG. 2, but the relationship between the magnified version 9 of the magnified part 3 and the non-magnified part 4 of the image 1 is magnified. It is easily estimated from the position of the window 10. Thus, the user maintains the visual context for the magnified version 9 because the magnified window 8 is superimposed and centered on the magnified portion 3 of the image 1.
[0019]
As shown in FIG. 3, the user can apply a modification to the enlarged version 9 of the portion 3 of the image 1 shown in the enlarged window 10. The user can modify the enlarged version 9 by changing the pixels so that features such as lines 25, such as canyons, are no longer present. The user can also modify the enlarged version 9 by changing the pixels to add features. For example, the user can add a feature such as the word 13 "ADOBE". Such a modification 13 is responsive to small features such as triangular shapes 12 that have been revealed in a magnified version 9 of magnified portion 3 of image 1 by magnifying portion 3 of image 1. Is possible. In this case, the upper part of the letter “A” of “ADOBE” is aligned with the triangular shape 12. The modification may also be responsive to special features in the non-magnified and visible portion 11 of the image 1. In this case, the magnified version 9 is modified by adding a lake-like ellipse 14 similar to the lake-like ellipse 5 in the unmagnified and visible portion 11 of the image 1.
[0020]
As shown in FIG. 4, changes to pixels due to removal of features such as lines 25 such as canyons, and changes due to addition of features such as the word 13 of "ADOBE" and ellipses 14 such as lakes are included. The modification made by the user to the enlarged version 9 of image 1 in the enlarged window 11 is applied as a modification 15 to image 1. The modification 15 to image 1 is made by changing the pixels corresponding to the changed pixels in modified version 9 of image 1.
[0021]
In another implementation, the invention is directed to a computer user who enlarges an image by forming an enlarged version of a portion of the image centered over the enlarged portion of the image and changing the position of the enlarged version. It is possible to apply a correction to the non-enlarged part of the image shown when changing the part of the image and changing the enlarged version. In this implementation, the modifications made to each part of the image may remain the same, but the enlarged part changes. Thus, the user can apply corrections to the image by tracing features that appear in the magnified version and, for example, changing pixels consistently at the center of the magnified portion.
[0022]
In yet another implementation, the present invention allows a computer user to form an enlarged version of a portion of an image with the enlarged version smaller than the image but not superimposed on the image. I do. In this implementation, the context for the magnified version of the image allows the user to examine the visual cues applied to the image and to allow the user to change the portion of the image shown in the magnified version. Provided by:
[0023]
As shown in FIG. 5, the enlarged portion 3 of the image 1 is separated by a dotted line 16. Part 3 of this image contains one of the three mountain-like peaks and a gorge-like line 25. The system provides a magnified version 9 of magnified portion 3 of image 1 to magnified window 17. In this case, the enlarged window 17 is adjacent to the original window. The position of the magnified version 9 shown in the magnified window 17 is clearly and continuously indicated by the dotted line 16.
[0024]
As shown in FIG. 6, the user can change the portion of the image 1 shown in the enlarged window 17. In this case, the user has selected another portion 19 of image 1, which is above and overlaps portion 3 of the image previously shown in image window 17. A magnified version 20 of magnified portion 19 of image 1 appears in magnified window 17 and shows magnified portion 21 of cloud-like feature 6 previously present in non-magnified portion 4 of image 1. ing.
[0025]
The invention can be implemented in digital electronic circuits or in computer hardware, firmware, software or a combination thereof. The apparatus of the present invention may be embodied in a computer program product tangibly embodied in a machine-readable output device for execution by a programmable processor, and the method steps of the present invention may be implemented with respect to input data. It can be implemented by a programmable processor that executes a program of instructions that perform the functions of the present invention by performing operations and generating outputs.
[0026]
The present invention comprises at least one programmable processor coupled to receive and transmit data and instructions from a data storage system, at least one input device, and at least one output device. It can be effectively implemented in one or more computer programs executable on an inclusive programmable system. Each computer program may be implemented in a high-level procedural or object-oriented programming language, or, if desired, in an assembly or machine language, and in each case, the language is a compiled or interpreted language. It is possible to do. Suitable processors include, by way of example, both general and special purpose microprocessors. Generally, a processor will receive instructions and data from a read-only memory and / or a random access memory.
[0027]
Generally, computers include one or more mass storage devices for storing data files, such as magnetic disks, such as internal hard disks and removable disks, and magneto-optical disks. , And an optical disc. Suitable storage devices for tangibly implementing computer program instructions and data include all forms of non-volatile memory, including, for example, semiconductor memory devices such as EPROM, EEPROM, flash memory devices, It includes a magnetic disk such as an internal hard disk and a removable disk, a magnetic / optical disk, a CD-ROM disk, and the like. Any of the foregoing can be supplemented by, or incorporated in, ASICs (application-specific integrated circuits).
[0028]
To provide for interaction with a user, the present invention provides a display device, such as a monitor or LCD screen, and a keyboard for displaying information to the user and thereby allowing the user to provide input to the computer system. It can be implemented on a computer system with a pointing device such as a possible mouse or trackball. The computer system can be programmed to provide a graphical user interface through which a computer program interacts with a user.
[0029]
The invention has been described with reference to specific embodiments. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. Accordingly, other embodiments are within the scope of the following claims.
[Brief description of the drawings]
FIG. 1 is a schematic diagram of an image having a part to be enlarged.
FIG. 2 is a schematic diagram of an image on which an enlarged window is superimposed.
FIG. 3 is a schematic diagram of an image having an enlarged window in which editing has been performed.
FIG. 4 is a schematic diagram of an image with edits made in an enlarged window.
FIG. 5 is a schematic diagram of an image having an enlarged portion in an adjacent window.
FIG. 6 is a schematic diagram of an image as in FIG. 5 with different parts enlarged in adjacent windows.

Claims (36)

A method of displaying an image (1) on a computer display device for interacting with a user using a graphical user interface, the method comprising: displaying an image (1) at a first magnification in a first area (2) on the computer display device. ) And a second portion of the image (1) at a second greater magnification in the second area (10), wherein the second portion of the image (1) is A second area (10) operable in said graphical user interface to receive user input to modify the image (1); and a second area (10) of the second area (10). In a method wherein the modification in part is manifested in the corresponding visible part of the image (1) displayed in the first area (2),
Further receiving user input selecting a portion (3) of the first zone (2), the selected portion (3) defining what the second portion is in the second zone (10), The two parts are enlargements of said selected part (3) of the first area (2), wherein selecting different parts (19) of the first area (2) or changing the dimensions of the selected part (3) is the second. Updating said second part according to the currently selected part (3) of an area (2);
A method comprising: Method according to claim 1, characterized in that a selected part (3) of the first area (2) is covered by a second area (10). Method according to claim 2, characterized in that the center of the selected part (3) of the first zone (2) coincides with the center of the second zone (10). 2. The method according to claim 1, wherein the second area is located adjacent to the first area and the selected portion is displayed by a visual cue in the first area. Features method. In any one of claims 1 to 4,
Receiving user input defining dimensions of the second zone (10);
A method comprising: Method according to any one of the preceding claims, characterized in that the selected part (3) of the first zone (2) is smaller than the second zone (10). In any one of claims 1 to 6,
Receiving a user input defining a degree of magnification for the portion (3) selected to obtain the second portion shown in the second area (10);
A method comprising: A computer program product tangibly stored on a computer readable medium for displaying images and interacting with a user using a graphical user interface, the computer program product displaying on a display and on the display. A computer having a pointing device operatively coupled to a cursor to be moved and a first section (4) of the image (1) at a first magnification into a second section (2) on the computer display. Within (10), there is an instruction to display the second part of the image (1) at a second higher magnification, the second part of the image (1) being selectable by the user of the image (1) The second area (10) is the graphical user interface for receiving user input to modify the image (1). A computer program product operable in the interface, wherein modifications in a part of the second area (10) appear in the corresponding visible part of the image (1) displayed in the first area (2). So,
Furthermore, there is an instruction to receive a user input for selecting a part (3) of the first area (2), wherein the selected part (3) is displayed in the second area (10). Defining what the two parts are, said second part being an enlargement of a selected part (3) of the first area (2), selecting a different part (19) of the first area (2) or Resizing the selected part (3) updates the second part according to the current selected part (3) of the first area (2);
Computer program product, comprising instructions for: Computer program product according to claim 8, characterized in that a selected part (3) of the first area (2) is covered by a second area (10). Computer program product according to claim 9, characterized in that the center of the selected part (3) of the first zone (2) coincides with the center of the second zone (10). 9. The method according to claim 8, wherein the second area (10) is located adjacent to the first area (2) and the selected part (3) is displayed by a visual cue in the first area (2). Characterized computer program product. In any one of claims 8 to 11,
Receiving user input defining dimensions of the second zone (10);
Computer program product, comprising instructions for: Computer program product according to any one of claims 8 to 12, characterized in that the selected part (3) of the first area (2) is smaller than the second area (10). In any one of claims 8 to 13,
Receiving a user input defining a degree of magnification for the portion (3) selected to obtain the second portion shown in the second area (10);
Computer program product, comprising instructions for: In any one of claims 8 to 14,
Receiving a user input defining a corrective action in the second zone (10), wherein the corrective action includes changing at least one pixel value;
Computer program product, comprising instructions for: In claim 15, further,
Changing the value of each pixel in the first area (2) of the computer display corresponding to the pixel having the changed value in the second area (10) of the computer display;
Computer program product, comprising instructions for: A method for displaying and modifying an image being displayed on a display device for interaction with a user using a graphical user interface, comprising:
Display the first part of the image at the first magnification in the first area,
Receiving user input for positioning a second area to cover a portion of the first area, the covered part is a second of the image to be displayed at a second greater magnification in the second area. Identify the part,
Displaying the second enlarged portion of the image in the second area;
Receiving user input to modify the second enlarged portion of the image in the second area, wherein a modification in a portion of the second area affects a modification of the image and is displayed in the first area. Appearing in the corresponding visible portion of the image,
A method comprising the above steps. 18. The method of claim 17, wherein the second enlarged portion of the image corresponds to a portion of the image located below a center of the second area. In claim 17, further,
Moving or resizing the second area in response to user input to cause a different portion of the image in the first area to be displayed as an enlarged image in the second area;
The method that encompasses that. In claim 17, further,
Receiving user input defining dimensions of the second area;
The method that encompasses that. In claim 17, further,
Receiving user input defining a degree of magnification for a portion of the image shown in the second area;
The method that encompasses that. A method for displaying and modifying images on a computer display device for interaction with a user using a graphical user interface, comprising:
Displaying a first portion of the image at a first magnification in a first area;
Receiving a user input selecting a second portion of the image in the first area to be displayed at a second greater magnification in a second area;
Displaying the selected second portion of the image by a visual cue within the first area;
Displaying the selected second portion of the image at a second higher magnification within the second area smaller than the first area;
Receiving a user input to modify the second enlarged portion of the image in the second area, wherein the modification in a portion of the second area causes a modification of the image and is displayed in the first area; Appearing in the corresponding part of the image,
The method that encompasses that. In claim 22, further comprising:
Receiving user input defining dimensions of the second area;
The method that encompasses that. In claim 22, further comprising:
Receiving a user input defining a degree of magnification of a portion of the image in the first area shown in the second area;
The method that encompasses that. In claim 22, further comprising:
Receiving user input for positioning the second area on the computer display device;
The method that encompasses that. A computer program product tangibly stored on a computer readable medium for interacting with a user and displaying an image using a graphical user interface, the computer program product comprising a display and a display on the display. A computer having a pointing device operatively coupled to a cursor to be displayed,
Displaying a first portion of the image at a first magnification within a first area;
Receiving a user input selecting within the first area a second portion of the image to be displayed at a second greater magnification in a second area;
Causing the selected second portion of the image to be displayed by a visual cue within the first area;
Causing the selected second portion of the image to be displayed at a second higher magnification in the second area smaller than the first area;
Receiving a user input to modify the second enlarged portion of the image in the second area, wherein a modification in a portion of the second area causes a modification of the image and is displayed in the first area; Appearing in the corresponding part of the image,
Computer program product having instructions for: 26. The computer program product of claim 24, wherein the second enlarged portion of the image corresponds to a portion of the image located below a center of the second area. In claim 24, further,
Moving or resizing the second area in response to user input to display a different portion of the image in the first area as an enlarged image in the second area;
Computer program product having instructions for: In claim 24, further,
Receiving user input defining dimensions of the second area;
Computer program product having instructions for: In claim 24, further,
Receiving user input defining a degree of magnification for the portion of the image shown in the second area;
Computer program product having instructions for: 25. The instruction of claim 24, wherein the instructions for receiving a user input gesture to modify the second magnified portion of the image in the second area comprises:
Receiving user input to change at least one pixel value of the second enlarged portion of the image in the second area;
Changing a value of a pixel in the first area corresponding to a pixel having a changed value in the second area;
Computer program product having instructions for: A computer program product tangibly stored on a computer readable medium for displaying and modifying images and interacting with a user using a graphical user interface, comprising a display and a computer program product displayed on the display. A computer having a cursor and a pointing device operatively coupled to the
Displaying a first portion of the image at a first magnification within a first area;
Receiving a user input selecting a second portion of the image to be displayed in the second area at a second greater magnification in the first area, and selecting the image by a visual cue in the first area. To display the second part
Causing the selected second portion of the image to be displayed at a second higher magnification in the second area smaller than the first area;
Receiving a user input to modify the second enlarged portion of the image in the second area, wherein a modification in a portion of the second area causes a modification of the image and is displayed in the first area; Appearing in the corresponding part of the image,
Computer program product having instructions. In claim 22, further comprising:
Receiving user input defining dimensions of the second area;
Computer program product having instructions for: In claim 32, further,
Causing a user input to define a degree of magnification of a portion of the image in the first area shown in the second area;
Computer program product having instructions for: In claim 32, further,
Causing a user input to locate the second area on the computer display device;
Computer program product having instructions for: 33. The instruction of claim 32, wherein the instructions for receiving user input to modify the second enlarged portion of the image in the second area comprise:
Receiving user input to change at least one pixel value of the second enlarged portion of the image in the second area;
Changing a value of a pixel in the first area corresponding to a pixel having a changed value in the second area;
Computer program product having instructions for: