JPH10188019A - Method and device for processing image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To cut out an object or to move the object through simple operation by designating a desired area including a specified image, making the background color of specified image in this area transparent and cutting out only the specified image by copying or moving the entire area. SOLUTION: The unroutine image of figure, etc., is cut out and synthesized with the other image by combining rectangular range designation and paint-out processing. First of all, a rectangular area 144 including the human figure is designated from an image 142, and the background of designated rectangular area 144 is painted out in any specified designated color (red, for example) (b). Thus, the background except for the figure in the rectangular area 144 is painted out in one color. Next, the color in the background area of rectangular area 144 is changed from the designated color (red) to transparent color. Thus, the rectangular area 144 becomes an image plotting the figure in the transparent background (c). Next, the rectangular area 144 is stuck at any desired position on an image 140 of scenery (d).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an image processing method and apparatus for processing digital image information picked up by, for example, an electronic camera.

[0002]

2. Description of the Related Art In recent years, electronic cameras capable of photographing images as digital information have rapidly spread as cameras for photographing scenes such as people and landscapes, in place of conventional cameras using films. ing. The electronic camera has the advantage that the development processing of a captured image such as a film is unnecessary, and the image can be confirmed on the spot where the image is captured. In addition, since the information is digital information, the image information can be imported into a personal computer or a dedicated editing machine, and the user can freely modify the captured image to generate an image subjected to various processes. is there.

[0003]

However, when image information is edited by a personal computer or a dedicated editing machine, a full-scale image processing program has abundant functions, but executes the abundant functions. Therefore, the processing tends to be complicated. In addition, when processing an image captured by an electronic camera, processing on a subject such as a person is mainly performed. For this reason, it is desired that the subject be cut out or moved by a simple operation.

An object of the present invention is to provide an image processing method capable of processing a designated area by a simple operation. Another object of the present invention is to provide an image processing method capable of combining an irregular image of a person or the like with another image by a simple operation. Another object of the present invention is to provide an image processing method capable of drawing a shaded line by a simple operation.

[0005]

An object of the present invention is to perform, by one operation of designating a desired area, designation of an area for designating the desired area and designation of processing for processing the desired area at the same time. This is achieved by an image processing method. In the above-described image processing method, it is preferable that the process specified by the process specification is a copy process.

The above object is achieved by a first step of designating a desired area including a specific image, a second step of making the background color of the specific image in the desired area transparent, A third step of substantially cutting out only the specific image by copying or moving the entire area. In the above-described image processing method, the second step includes a step of painting a background color of the specific image in the desired area with a designated color, and a step of subsequently changing the designated color to a transparent color. It is desirable to have

In the above-described image processing method, it is preferable that the filling step includes a step of detecting an unpainted portion in the desired area and filling it. An object of the present invention is to provide an image processing method for drawing a linear image according to a movement trajectory by moving a pen tip image designated as a pen tip, wherein the pen tip image includes a plurality of partially overlapping unit images. A first step of drawing the plurality of unit images according to the movement locus by moving the pen tip image, and a second step of returning and redrawing each unit image in the reverse direction along the movement locus. And an image processing method.

In the above image processing method, the second
It is preferable that, in the step (b), the unit image located on the upper side of the plurality of unit images is returned in the reverse direction according to the movement locus and redrawn.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The configuration of an image processing apparatus according to one embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a perspective view showing a use state of the image processing apparatus, and FIG. 2 is a block diagram of the image processing apparatus. As shown in FIG. 1, the image processing apparatus 10 according to the embodiment converts image data captured by the digital camera 30 into a CRT monitor 40.
Or to perform image editing processing on the CRT monitor 40.

The image processing apparatus 10 has a pressure-sensitive tablet 14 at the center of the upper surface of a housing 12. Pen 16
By tracing the tablet 14, the user can draw a picture or indicate a position in the image. A horizontally long determination key 18 is provided on a front side surface of the housing 12. By pressing the enter key 18, the designated position in the image is determined, or the processing content is determined using the icon.

A memory card slot 20 is provided on the right side of the tablet 14 of the housing 12. A memory card 22 storing image data is attached to and detached from the memory card slot 20. For example, as shown in FIG. 1, image data captured by the digital camera 50 is supplied to the image processing device 10 via the memory card 22.

A ROM is provided above the tablet 14 in the housing 12.
A cartridge slot 24 is provided. ROM
A ROM cartridge 26 that stores an image processing program, image data, a game, and the like is mounted in the cartridge slot 24. The functions of the image processing apparatus 10 can be expanded by the ROM cartridge 26. The image processing apparatus 10 is provided with an AC adapter 28, and power is supplied through the AC adapter 28. Further, a CRT monitor 52 is connected to the image processing apparatus 10 for displaying image data and performing image processing such as editing.

Next, the configuration of the image processing apparatus according to the present embodiment will be described with reference to FIG. The MPU 60 controls the entire image processing device. The RAM 62 is a work memory of the MPU 60. The video / audio processor 64 controls a drawing process of a background, a character, and the like, and a sound process of music, processed sound, and the like. The video signal and the audio signal from the video / audio processor 64 are output from the video / audio terminal 66 to the CRT monitor 52.

The MPU 60 is provided with a connector 68. The ROM cartridge 26 is attached to the connector 68 as needed. The controller 70 monitors the states of the tablet 14 and the enter key 18, and outputs input information by a player's operation to the MPU 60. The controller 70 is provided with a connector 72. The memory card 22 storing image data is attached to the connector 72.

Next, processing operations of the image processing apparatus according to the present embodiment will be described with reference to FIGS. When the image processing apparatus is started, a basic menu screen 100 as shown in FIG. The basic menu screen 100 includes an image display area 10 for displaying image information.
2 and an icon area 104 for displaying icons for instructing various processes. The position indicated by the pen 16 on the tablet 14 is indicated by a pointer 106.

The menu structure of the image processing apparatus according to the present embodiment will be described with reference to FIGS. The icon area 104 of the basic menu screen 100 shown in FIG. 3 will be described. The icon area 104 includes, in order from the top, file icons 110 for calling, saving, and deleting screens,
Icon 1 for executing the contents of the separately sold ROM cartridge
11, an edit icon 112 for performing an editing operation, a TOOL icon 113 for selecting a tool at the time of editing, an effect icon 114 for selecting an effect at the time of drawing processing, a character input icon 115 for performing character input, a slide icon 116 for performing slide processing, UNDO to cancel the process just executed
Icon 117, area designation icon 1 for designating an area
18 are arranged.

In the icon area 104, a direction icon 120 for designating a direction, a color pallet 121 for designating a color to be used, and a dropper icon 122 for collecting a color displayed on the screen are arranged. Thus, as shown in FIG. 4, the basic menu of the image processing apparatus of this embodiment includes file processing, editing processing, TOOL selection processing, effect processing, character input processing, UNDO processing, and area processing. The file processing, the editing processing, the TOOL selection processing, the effect processing, and the character input processing are each constituted by a plurality of specific processings.

The file processing will be described with reference to FIG. When the file icon 110 is clicked, FIG.
A file mode screen 100 as shown in (b) is displayed. The file mode screen 100 displays the image display area 10
2 and an icon area 104. In the image display area 102, a large number of reduced image data stored in the memory card 22 are displayed.

As shown in FIG. 5A, file processing includes page turning processing, back calling processing, primitive calling processing, smart media storage processing, slide processing, deletion processing, and initialization processing. There is a lock process. The page turning process is a process of displaying screen data that is not displayed. The call processing to the back,
This is the process of calling the image to the back. The process of calling a primitive is a process of calling in the state of a primitive (floating as in an area specification). In the process of storing the processed image in the smart media, the processed image is
This is the process of saving to The slide process is a process of sequentially displaying images stored in the memory card 22. The deletion process is a process for deleting a stored image. The initialization process is a process of initializing image data, and is mainly used when creating a composite image. The lock process is a process for preventing specified image data from being deleted.

As shown in FIG. 6, the editing processing includes a rear image deletion processing, an area designation deletion processing, a left / right inversion processing, a vertical inversion processing, a stamp (continuous stamp) processing, a transparent stamp processing, and a mask processing. The back image deletion process is a process of deleting only the image on the back to make it white. The area-in-designation deletion process is a process for deleting only the area designated in the area. The area is transparent and only the frame remains. The left-right reversal process is a process of reversing the left and right in the area designated. The upside down process is a process of upside down within the area designated. The stamp (continuous stamp) process is a process of moving a picture within a designated area and copying it to a desired position. The transparent stamp process is a process of copying a picture within a designated area into a desired position in a semi-transparent state. The mask process is a process in which a picture is drawn in a rectangular area, and the sketch is peeled off with the outline of the picture.

As shown in FIG. 7, the effect processing includes mosaic processing, gradation processing, negative / positive processing, sepia processing, and monochrome processing. If an area is specified, the specified effect processing is performed on the specified area. If no area is specified, the specified effect processing is performed on the entire screen. The mosaic process is a process of applying a mosaic. The gradation process is vertical, horizontal,
This is a process of applying a gradation obliquely or radially. The negative / positive process is a process for inverting the negative / positive of a photograph. The sepia process is a process of performing color conversion to a light reddish-toned sepia color. The monochrome process is a process of performing color conversion to monochrome.

In the TOOL selection process, as shown in FIG. 8, a pen, a blur, a straight line, a circle, a paint, a spray, or a transparent color tool is set. The pens include a normal pen having a plurality of thicknesses, a translucent pen having a plurality of thicknesses, and a plurality of types of shaded pens. Blur is a tool for rubbing the color of the screen with a finger. The straight line is a process of drawing a straight line connecting two points. The circle is a process of drawing a circle having a specified radius from the center. Paint is a tool for filling a certain area. Spray is a tool that draws colors like a spray. The transparent color is a tool for making a predetermined area transparent.

In the character input process, as shown in FIG. 9A, a character input area 108 is provided in the image display area 102, and a character string that can be input is displayed in an area below the character input area 108. The pen 16 is moved on the tablet 14 to select characters, and the characters are sequentially written in the character input area 108. When the character input is completed, the character may be enlarged or moved while remaining in the horizontal position as shown in FIG. 9B, if necessary, or as shown in FIG. 9C. , May be in a vertical position.

For displaying characters in the vertical position, a character font in the vertical position is prepared in addition to the character font in the horizontal position. The change in the horizontal direction of the character at the vertical position is performed by the inversion processing. Next, regarding the copy processing of the present embodiment,
This will be described with reference to FIG. In processing such as copying in a conventional image processing method, first, a range to be processed is designated, and then processing (copying, moving, deleting, etc.) of the designated area is determined, or conversely, At least two steps were required to determine the processing contents (copy, move, delete, etc.) and then specify the range of the area to be processed.

In the present embodiment, in image processing for a captured image of a digital camera or the like, in consideration of the fact that the frequency of use of copy processing is extremely high, copy processing is specified as a processing area while simultaneously specifying a desired area. It is assumed. As shown in FIG. 10A, when the area 130 surrounding the person is designated as a range, copy processing is designated at the same time. When the pointer is moved, as shown in FIG.
The designated area 130 is copied to the area 130 '.

As described above, according to the present embodiment, a desired area can be copied to another position by a single range designation operation, and the operation is simple. Note that, in the present embodiment, the process of simultaneous designation is a copy process in consideration of the frequency of use in image processing of a captured image of a digital camera or the like. The process may be specified.

Next, the synthesizing process of this embodiment will be described with reference to FIG. In image processing of a captured image of a digital camera or the like, there is a demand for a synthesis process in which only a person of a certain image is cut out and pasted to another image having a different scenery. In this case, as shown in FIG.
Even if the image 142 including the person is simply superimposed on the landscape image 140 and synthesized, the desired result cannot be obtained because the background of the image 142 is in the way. It is sufficient to cut out only a person from the image 142 and paste it on the image 140, but this is impossible in the present embodiment because only a rectangular range can be specified. It is sufficient that the range for cutting out an arbitrary outline can be specified, but it is not practical because a very complicated operation is required.

In the present embodiment, an irregular image of a person or the like is cut out and combined with another image by combining the designation of the rectangular range and the filling process. First, FIG.
As shown in FIG. 1 (b), a rectangular area 144 including a person is specified from the image 142, and the background in the specified rectangular area 144 is filled with a specific specified color (for example, red). At the time of the filling processing, the area can be efficiently filled if the same color area is automatically set to the designated color by the painting processing. In this way, as shown in FIG. 11B, the background area other than the person in the rectangular area 144 is painted in one color.

Next, the color of the background area of the rectangular area 144 is converted from the designated color (red) to a transparent color. As a result, FIG.
As shown in (c), the rectangular area 144 is an image in which a person is drawn in a transparent background. Next, the rectangular area 144
At a desired position on the landscape image 140. As a result, as shown in FIG.
Only a person is drawn on 0, and a composite image in which the background is a landscape image can be obtained.

As described above, according to the present embodiment, an irregular-shaped image of a person or the like can be cut out by combining the designation of the rectangular range and the painting process, and can be combined with another image as necessary. Next, the filling process according to the present embodiment will be described with reference to FIGS.

In the above-described synthesizing process, when the background is painted, it is inevitable that unpainted will be left, whether it is painted using a thick pen tip or painted. In the present embodiment, the unpainted portion is efficiently painted out. FIG.
As shown in FIG.
When there is a background 154 and a paint process, the unpainted portion is left in the background as shown in FIG.

Therefore, the unpainted portion 1 is obtained by the painting process according to the procedure of the flowchart shown in FIG.
54 is automatically filled. First, the designated color (red) used for filling the background is set as the search color (step S2).
01). Next, the image scanning position is initialized using a predetermined position within the rectangular range 150, for example, the upper left position as the starting point of the image scanning position (step S202).

Next, the color information of the scanning point is obtained (step S203). Subsequently, it is determined whether or not the acquired scan color is the same as the search color (step S204). If they are the same, the process skips step S207 from step S205 and proceeds to step S208. If the scanning color is not the same as the search color, color information on the outer periphery of the scanning point is obtained (step S205).

Next, it is determined whether or not the outer peripheral color is the same as the inspection color (step S206). If the outer peripheral color is the same as the search color, it is determined that the scanning point is a color stamp whose entire outer periphery is the search color, and the scanning point is painted with the search color (step S207). If the outer peripheral color is not the same as the search color, the process of step S207 is skipped and step S208
Proceed to.

Next, the scanning point is moved to the next position (step S208). Subsequently, it is determined whether or not the scanning is completed (step S209), and the above-described processing is repeated until the scanning within the rectangular range 150 is completed. As described above, according to the present embodiment, it is only necessary to detect whether or not only the outer periphery of the scanning point matches the search color. Therefore, it is possible to reliably and efficiently detect the unpainted portion and fill it out.

FIGS. 14A to 14E show specific examples of the definition pattern of the outer peripheral color used in steps S205 and S206. In FIG. 14A, a scanning point is one dot, and eight dots surrounding the scanning point are peripheral points. Even fine dots can be reliably filled. In FIG. 14B, twelve dots surrounding the four dots including the scanning point are set as outer peripheral points. Painting can be performed efficiently (4 dots) in a short search time (12 dots).

FIG. 14C shows eight dots surrounding the four dots including the scanning point as the outer peripheral points. Painting (4 dots) can be performed more efficiently with less search time (8 dots). In FIG. 14D, four dots at the four corners of the four dots including the scanning point are set as outer peripheral points. Filling (4 dots) can be performed more efficiently with less search time (4 dots).

In FIG. 14E, four dots at the center of four sides of nine dots including a scanning point are set as outer peripheral points. Painting can be performed more efficiently (9 dots) in less search time (4 dots). Next, drawing processing using the shadow pen according to the present embodiment will be described with reference to FIGS.

A shaded pen is a tool that can draw a line that appears to be embossed with the same decoration as a shadow when light is applied from one side. The same drawing processing is performed by including those for drawing a tube-shaped line in a shaded pen. As shown in FIG. 15 (a), the pen tip image 160 of the shaded pen has a thinner central part 160a, a darker middle part 160b around it, and an outer peripheral part 16 around it.
The case where 0c is the darkest will be described.

When the pen tip image 160 moves, if it is drawn as it is, as shown in FIG.
The locus of 0c overwrites the locus of the central portion 160a and the intermediate portion 160b, and is no longer a locus with a shadow. Therefore, in the present embodiment, the pen tip image 160
Is stored, and a process of reversely following the trajectory at a predetermined distance or at predetermined time intervals is performed. As a result, the locus that has been overwritten and erased is redrawn.

First, the trajectory of the intermediate portion 160b overwritten by the outer peripheral portion 160c is reversely traced and redrawn (FIG. 1).
5 (c)). Next, the trajectory of the central portion 160a overwritten by the outer peripheral portion 160c and the intermediate portion 160b is reversely traced and redrawn (FIG. 15D). Thereby, a desired shaded line can be drawn. Then, pen tip image 1 of the pen with shadow
When 60 is moved rightward (FIG. 15 (e)), once
The central portion 160a and the intermediate portion 1
The locus of 60b is overwritten (FIG. 15F).

However, in the same manner as in FIGS. 15 (c) and 15 (d), when the intermediate portion 160b and the central portion 160a are redrawn by sequentially following the trajectory, a desired shaded line can be drawn (FIG. 15). (G), (h)). FIG. 16 and FIG. 17 are diagrams showing a drawing process using another type of shaded pen. This is basically the same as the drawing process in FIG.

The pen tip image 162 of the shaded pen shown in FIG.
Is a thin circular image 162a as shown in FIG.
Behind, a dark circular image 162b is arranged. When the pen tip image 162 is moved to the right, a shaded line is drawn, but as shown in FIG.
The locus of 2a is overwritten by the locus of the dark circular image 162b. Thereafter, when the locus of the thin circular image 162a is traced in the reverse direction and redrawn, a desired shaded line can be drawn as shown in FIG.

The pen point image 164 of the shaded pen shown in FIG.
Is a dark rectangular image 164a as shown in FIG.
Two thin small rectangular images 164b and 164c are arranged on the top. When the pen tip image 164 is moved to the right, a shadowed line is drawn. However, as shown in FIG. 17B, the locus of the thin small rectangular images 164b and 164c is overwritten by the locus of the dark rectangular image 164a. Thereafter, when the trace of the thin small rectangular images 164b and 164c is traced in the reverse direction and redrawn, a desired shaded line can be drawn as shown in FIG.

The present invention is not limited to the above embodiment, and various modifications are possible. For example, in the above embodiment, the present invention is applied to an image processing method of an image processing apparatus that edits a captured image of a digital camera or the like, but the present invention may be applied to an image processing method of another electronic device.

[0046]

As described above, according to the present invention, by one operation of designating a desired area, the area designation for designating the desired area and the processing designation for processing the desired area are performed simultaneously. Thus, the specified area can be processed by a simple operation. According to the present invention, a desired area including a specific image is designated, the background color of the specific image in the desired area is made transparent, and the entire desired area is copied or moved, Since substantially only the specific image is cut out, an irregular image of a person or the like can be combined with another image by a simple operation.

Further, according to the present invention, in an image processing method for drawing a linear image according to a movement trajectory by moving a pen point image specified as a pen point, the pen point image is partially A plurality of unit images overlapping each other, drawing the plurality of unit images according to the movement locus by moving the pen tip image, and returning each unit image in the opposite direction along the movement locus to redraw With this configuration, a shadowed line can be drawn by a simple operation.

[Brief description of the drawings]

FIG. 1 is a perspective view showing a use state of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a block diagram of the image processing apparatus shown in FIG.

FIG. 3 is a diagram showing an operation screen of the image processing apparatus shown in FIG.

FIG. 4 is a diagram showing a basic menu of the image processing apparatus shown in FIG. 1;

FIG. 5 is a diagram showing file processing of the image processing apparatus shown in FIG. 1;

FIG. 6 is a diagram showing an editing process of the image processing apparatus shown in FIG.

FIG. 7 is a diagram illustrating effect processing of the image processing apparatus illustrated in FIG. 1;

FIG. 8 is a diagram showing a TOOL process of the image processing apparatus shown in FIG. 1;

FIG. 9 is a diagram illustrating a character input process of the image processing apparatus illustrated in FIG. 1;

FIG. 10 is an explanatory diagram illustrating copy processing according to an embodiment of the present invention.

FIG. 11 is an explanatory diagram illustrating a synthesizing process according to an embodiment of the present invention.

FIG. 12 is an explanatory diagram illustrating a painting process according to an embodiment of the present invention.

FIG. 13 is a flowchart of a painting process according to an embodiment of the present invention.

FIG. 14 is an explanatory diagram illustrating a painting process according to an embodiment of the present invention.

FIG. 15 is an explanatory diagram illustrating a drawing process using a shaded pen according to an embodiment of the present invention.

FIG. 16 is an explanatory diagram illustrating another example of the drawing process using the shaded pen according to the embodiment of the present invention.

FIG. 17 is an explanatory diagram illustrating still another example of the drawing process using the shaded pen according to the embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 ... Image processing apparatus 12 ... Case 12a ... Top case 12b ... Bottom case 14 ... Tablet 16 ... Pen 18 ... Enter key 20 ... Memory card slot 22 ... Memory card 24 ... ROM cartridge slot 26 ... ROM cartridge 28 ... AC Adapter 52 CRT monitor 50 Digital camera 52 CRT monitor 60 MPU 62 RAM 64 Video / audio processor 66 Video / audio terminal 68 Connector 70 Controller 72 Connector

──────────────────────────────────────────────────の Continued on front page (51) Int.Cl. ⁶ Identification code FI H04N 5/91

Claims (9)

[Claims] 1. An operation for designating a desired area,
An image processing method, wherein an area designation for designating the desired area and a process designation for processing the desired area are performed simultaneously. 2. The image processing method according to claim 1, wherein the process specified by the process specification is a copy process. 3. A first step of designating a desired area including a specific image, a second step of making the background color of the specific image transparent in the desired area, and the entire desired area. A third step of substantially cutting out only the specific image by copying or moving the image. 4. The image processing method according to claim 3, wherein the second step is a step of filling a background color of the specific image in the desired area with a specified color, and thereafter, setting the specified color in the desired area. Changing the image to a transparent color. 5. The image processing method according to claim 4, wherein said painting step includes a step of detecting and painting out an unpainted portion in said desired area. 6. An image processing method for drawing a linear image in accordance with a movement trajectory by moving a pen tip image specified as a pen tip, wherein the pen tip images are partially overlapped with a plurality of unit images. A first step of drawing by the plurality of unit images according to the movement locus of the pen tip image by moving the pen tip image, and a step of returning and redrawing each unit image in the reverse direction along the movement locus. 2. An image processing method comprising: 7. The image processing method according to claim 6, wherein, in the second step, the unit image located on the upper side of the plurality of unit images is returned in a reverse direction according to the movement locus. An image processing method characterized in that the image is redrawn. 8. An image processing apparatus for executing the image processing method according to claim 1. Description: 9. A medium on which a program for executing the image processing method according to claim 1 is recorded.