JP2011008521A - Printer, apparatus and method for processing image and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve user convenience in image processing of performing image retrieval based on a drawn image.SOLUTION: An image processing apparatus performing the image retrieval includes: a drawing processing part generating a drawn image according to a drawing instruction; a history drawn image processing part detecting a history drawn image similar to the generated drawn image with respect to a prescribed characteristic from history drawn images that are other drawn images stored in a prescribed storage area; and an image retrieval part setting a query image as a reference of the image retrieval based on the detected history drawn image, and performing the image retrieval based on the query image.

Description

  The present invention relates to image processing for performing image search.

  Image processing for retrieving an image based on a drawn image drawn in accordance with a user input operation is known (see, for example, Patent Document 1).

JP 2003-316804 A

  Conventionally, image search based on a drawn image has room for improvement in terms of user convenience. For example, since it is difficult to accurately reproduce a drawing operation, it may be difficult to detect an image detected in a past image search again in an image search based on a drawn image.

  SUMMARY An advantage of some aspects of the invention is to improve user convenience in image processing that performs image search based on a drawn image.

  In order to solve at least a part of the above problems, the present invention can be realized as the following forms or application examples.

Application Example 1 An image processing apparatus that performs an image search,
A drawing processing unit that obtains a drawing instruction and generates a drawing image according to the drawing instruction;
A history drawing image processing unit that detects the history drawing image similar to the generated drawing image with respect to a predetermined feature from a history drawing image that is another drawing image stored in a predetermined storage area;
An image processing apparatus comprising: an image search unit that sets a query image as a reference for image search based on the detected history drawing image and performs image search based on the query image.

  In this image processing apparatus, a drawing image is generated according to a drawing instruction, a history drawing image similar to the drawing image generated with respect to a predetermined feature is detected, and an image search reference is based on the detected history drawing image. Since the query image is set and the image search is performed, for example, it is possible to easily detect the image detected in the past image search, and the user convenience is improved in the image processing for performing the image search based on the drawn image. Can be made.

Application Example 2 The image processing apparatus according to Application Example 1, further comprising:
A display unit that displays the generated drawing image and the detected history drawing image;
The history drawing image processing unit obtains a selection instruction for selecting one of the displayed history drawing images,
The image search unit is an image processing device that sets the query image based on the selected history drawing image.

  In this image processing apparatus, the generated drawing image and the detected history drawing image are displayed, and one of the displayed history drawing images is selected, and a query image is set based on the selected history drawing image. Thus, user convenience can be improved in image processing for performing image search based on a drawn image.

[Application Example 3] The image processing apparatus according to Application Example 2,
The image search unit is an image processing device that sets the selected history drawing image as the query image.

  In this image processing apparatus, the selected history drawing image can be set as a query image, and user convenience can be improved in image processing for performing an image search based on the drawing image.

Application Example 4 The image processing apparatus according to Application Example 2,
The drawing processing unit generates a new drawing image by drawing based on the selected history drawing image,
The image search unit, wherein the image search unit sets the generated new drawn image as the query image.

  In this image processing apparatus, a new drawing image is generated by performing drawing based on the selected history drawing image, and the generated new drawing image is set as a query image. An image obtained by modifying the used query image can be used as a new query image, and user convenience can be improved in image processing for performing an image search based on a drawn image.

Application Example 5 The image processing apparatus according to any one of Application Example 1 to Application Example 4,
The history drawing image processing unit stores the generated drawing image as the history drawing image in the storage area.

  In this image processing apparatus, since the generated drawing image is stored as a history drawing image in the storage area, a history drawing image similar to the generated drawing image is detected from the history drawing image stored in the storage area. Can do.

[Application Example 6] The image processing apparatus according to Application Example 5,
A user information acquisition unit that acquires user information that identifies users,
The history drawing image processing unit stores the history drawing image in the storage area in association with the user information, and detects the history drawing image similar to the generated drawing image at the time of drawing image generation. An image processing apparatus that executes the history drawing image associated with the user information indicating the same user as the user.

  In this image processing device, the history drawing image is stored in the storage area in association with the user information, and the history drawing image similar to the generated drawing image is detected by the same user as the drawing image generation user. Since this is executed for the history drawing image associated with the user information to be shown, the user can efficiently set a desired query image, and user convenience is achieved in image processing for performing image search based on the drawing image. Can be improved.

Application Example 7 The image processing apparatus according to Application Example 6,
The history drawing image processing unit is an image processing device that detects the history drawing image based on a degree of similarity of features in the drawing progress of the generated drawing image and the history drawing image.

  In this image processing apparatus, a history drawing image desired by a user can be detected more accurately and efficiently, and user convenience can be improved in image processing for performing an image search based on the drawing image.

[Application Example 8] The image processing apparatus according to Application Example 5, further comprising:
A user information acquisition unit that acquires user information that identifies users,
The history drawing image processing unit stores the history drawing image in the storage area in association with the user information, and generates a drawing image when detecting the history drawing image similar to the generated drawing image. The history drawing image associated with the user information indicating the same user as the user at the time is detected based on the degree of similarity of features in the drawing process, and the user indicating a user different from the user at the time of drawing image generation An image processing apparatus that detects the history drawing image associated with information without considering the degree of similarity of features in the drawing process.

  In this image processing apparatus, a history drawing image desired by a user can be detected more accurately and efficiently, and user convenience can be improved in image processing for performing an image search based on the drawing image.

[Application Example 9] The image processing apparatus according to Application Example 2, further comprising:
A progress image processing unit that detects a progress image that is an image at each stage of the drawing progress of the history drawing image selected from the displayed history drawing images from a predetermined storage area;
The display unit displays the detected progress image,
The progress image processing unit obtains a selection instruction for selecting one of the displayed progress images,
The image search unit is an image processing device that sets the query image based on the selected progress image.

  In this image processing apparatus, a progress image that is an image at each stage of the drawing progress of the selected history drawing image is detected, one of the progress images is selected, and a query image is set based on the selected progress image. Thus, a query image desired by the user can be set efficiently, and user convenience can be improved in image processing for performing image search based on a drawn image.

[Application Example 10] The image processing apparatus according to Application Example 9,
The drawing processing unit generates a new drawing image by drawing based on the selected progress image,
The image search unit is an image processing device that sets the generated new drawn image as the query image.

  In this image processing apparatus, for example, a query image can be set by drawing based on an image (elapsed image) in a drawing process of a query image used in past image search, and image search based on the drawn image The user convenience can be improved in the image processing for performing the above.

[Application Example 11] The image processing apparatus according to Application Example 9 or Application Example 10,
The progress image processing unit stores an image at each stage of drawing progress of the generated drawn image in the storage area as the progress image.

  In this image processing apparatus, the image at each stage of the drawing progress of the generated drawing image is stored in the storage area as a progress image, so that the query image can be set by drawing based on the progress image.

[Application Example 12] The image processing apparatus according to Application Example 2,
The display unit is an image processing apparatus that displays the detected history drawing image so as to overlap the generated drawing image.

  In this image processing apparatus, a history drawing image can be easily selected through comparison with a drawing image, and user convenience can be improved in image processing for performing an image search based on the drawing image.

[Application Example 13] The image processing apparatus according to any one of Application Examples 1 to 12,
The image search unit performs an image search at a preset timing,
The said display part is an image processing apparatus which displays the detected image detected by the image search simultaneously with the said produced | generated drawing image and the detected said history drawing image.

  In this image processing apparatus, a series of processing results from drawing to image search can be displayed at the same time, and user convenience can be improved in image processing that performs image search based on a drawn image.

[Application Example 14] The image processing apparatus according to any one of Application Examples 1 to 13, further comprising:
A print image setting unit for setting a detection image to be printed from detection images detected by image search;
An image processing apparatus comprising: a printing unit that prints a detection image to be printed.

  This image processing apparatus can improve user convenience in image processing for performing image search based on a drawn image and printing the detected image.

  It should be noted that the present invention can be realized in various modes. For example, an image processing method and apparatus, an image search method and apparatus, a printing method and apparatus, and a computer for realizing the functions of these methods or apparatuses The present invention can be realized in the form of a program, a recording medium recording the computer program, a data signal including the computer program and embodied in a carrier wave, and the like.

1 is an explanatory diagram schematically illustrating a configuration of a printer 100 as an image processing apparatus according to an embodiment of the present invention. 6 is a flowchart illustrating a flow of image search / print processing according to the embodiment. It is explanatory drawing which shows an example of the initial window W1. It is a flowchart which shows the flow of a query image setting process. It is explanatory drawing which shows an example of the initial window W1. It is explanatory drawing which shows an example of the initial window W1. It is explanatory drawing which shows an example of the initial window W1. It is explanatory drawing which shows an example of the initial window W1. It is explanatory drawing which shows an example of search result window W2. It is explanatory drawing which shows an example of the initial window W1a in a modification. It is explanatory drawing which shows the characteristic of drawing operation. It is explanatory drawing which shows an example of the initial window W1a in a modification. It is explanatory drawing which shows an example of the initial window W1a in a modification.

Next, embodiments of the present invention will be described in the following order based on examples.
A. Example:
A-1. Configuration of image processing device:
A-2. Image search / print processing:
B. Variation:

A. Example:
A-1. Configuration of image processing device:
FIG. 1 is an explanatory diagram schematically showing the configuration of a printer 100 as an image processing apparatus according to an embodiment of the present invention. The printer 100 of this embodiment is an ink jet color printer that supports so-called direct printing, in which an image is printed based on image data acquired from a memory card MC or the like. The printer 100 includes a CPU 110 that controls each unit of the printer 100, an internal memory 120 configured by a ROM and a RAM, an operation unit 140 configured by buttons and a touch panel, a display unit 150 configured by a liquid crystal display, and a printer. An engine 160 and a card interface (card I / F) 170 are provided. The printer 100 may further include an interface for communicating with another device (for example, a digital still camera or a personal computer). Each component of the printer 100 is connected to each other via a bus.

  The printer engine 160 is a printing mechanism that performs printing based on print data. The card interface 170 is an interface for exchanging data with the memory card MC inserted into the card slot 172. In this embodiment, an image file including image data is stored in the memory card MC.

  The internal memory 120 stores an image processing unit 200, a display processing unit 310, and a print processing unit 320. The image processing unit 200 is a computer program for executing image search / print processing under a predetermined operating system. The image search / printing process of the present embodiment is a process of performing an image search based on a drawing image and printing a detected image. The image search / print process will be described in detail later.

  The image processing unit 200 includes, as modules, a drawing processing unit 210, a history drawing image processing unit 220, a progress image processing unit 230, an image search unit 240, a print image setting unit 250, a user information acquisition unit 260, Is included. The functions of these units will be described in detail in the description of image search / print processing described later.

  The display processing unit 310 is a display driver that controls the display unit 150 to display a window screen including a processing menu and a message, an image, and the like on the display unit 150. The print processing unit 320 is a computer program for generating print data from image data, controlling the printer engine 160, and printing an image based on the print data. The CPU 110 reads out and executes these programs (the image processing unit 200, the display processing unit 310, and the print processing unit 320) from the internal memory 120, thereby realizing the functions of these units.

A-2. Image search / print processing:
FIG. 2 is a flowchart illustrating a flow of image search / print processing in the embodiment. The image search / printing process of the present embodiment is a process of performing an image search for detecting an image and printing the detected image. The image search is performed by detecting an image having a high similarity (similarity) with a query image as a reference in the image search for a predetermined feature of the image from target images to be searched. . More specifically, a feature amount distance representing the similarity between the query image related to a predetermined feature of the image and the target image is calculated, and a target image whose feature amount distance is equal to or less than the maximum feature amount distance is detected. In this embodiment, the query image is set based on a drawn image drawn in response to a user operation. Although the target image can be arbitrarily set, in this embodiment, an image (image data included in the image file) stored in a predetermined area of the memory card MC is set as the target image.

  In response to an instruction from the user via the operation unit 140 (FIG. 1), the image processing unit 200 starts an image search / print process (FIG. 2). At this time, the user information acquisition unit 260 acquires user information for identifying the user via the operation unit 140. Thereby, a user is specified.

  When the image search / print processing (FIG. 2) is started, the image processing unit 200 controls the display processing unit 310 to display the initial window W1 on the display unit 150 (step S110). FIG. 3 is an explanatory diagram showing an example of the initial window W1. The initial window W1 includes a user using a color palette button Bu11 including a plurality of color buttons with different colors, a brush diameter specifying button Bu12 including a plurality of brush buttons with different diameters, and a color palette button Bu11 and a brush diameter specifying button Bu12. The drawing image display area Ar10 for displaying the drawing image DI in accordance with the drawing operation, the clear button Bu13 for clearing the display of the drawing image display area Ar10, and the drawing image DI displayed in the drawing image display area Ar10 for one drawing operation The return button Bu14 for changing to the previous drawing image DI, the forward button Bu15 for changing the drawing image DI displayed in the drawing image display area Ar10 to the drawing image DI after one drawing operation, and the drawing image display area Ar10 are displayed. And an OK button 16 for setting the selected image as a query image. The user can draw a desired image in the drawing image display area Ar10 by selecting and operating each interface included in the initial window W1 via the operation unit 140. This drawing process is realized by the drawing processing unit 210 (FIG. 1).

  In this embodiment, the unit of the drawing operation (also referred to as “stroke”) is the color selected by the color palette button Bu11, and is one of the diameters (size / width) selected by the stroke diameter designation button Bu12. An operation of drawing a point or a line. Therefore, when the operation unit 140 includes a touch panel, one point on the screen is touched in the drawing image display area Ar10 in a state where a desired color in the color palette button Bu11 and a desired diameter in the brush diameter designation button Bu12 are selected. One drawing operation is an operation or an operation in which the screen is touched and then released after being traced linearly. The unit of the drawing operation may be another unit. For example, a drawing operation every predetermined time may be adopted as the unit of the drawing operation. For example, when the operation unit 140 includes a mouse, in the drawing image display area Ar10, an operation of single-clicking the mouse or an operation of releasing the click after dragging while clicking is one drawing operation.

  In step S120 (FIG. 2), a query image setting process is performed. FIG. 4 is a flowchart showing the flow of the query image setting process. In step S210, the drawing processing unit 210 (FIG. 1) acquires a drawing instruction input by the user selecting and operating each interface included in the initial window W1 (FIG. 3) via the operation unit 140. The drawing processing unit 210 that has acquired the drawing instruction generates a drawing image according to the drawing instruction, and controls the display processing unit 310 to display the drawing image DI in the drawing image display area Ar10 of the initial window W1 (step S220). ). The generated drawing image DI is temporarily stored in a predetermined area of the internal memory 120.

  When the drawing processing unit 210 further acquires a drawing instruction within a predetermined time from the acquisition of the previous drawing instruction (step S230: YES), the drawing processing unit 210 updates the drawing image DI and controls the display processing unit 310 to draw the drawing. The updated drawing image DI is displayed in the image display area Ar10 (step S220). Note that images (drawing images) at each stage of drawing progress of the drawing image DI are temporarily stored in a predetermined area of the internal memory 120 as a progress image PI (described later).

  When the drawing processing unit 210 does not acquire a further drawing instruction within a predetermined time from the acquisition of the previous drawing instruction (step S230: NO), the history drawing image processing unit 220 (FIG. 1) stores it in the memory card MC. A history drawing image RI similar to the drawing image DI displayed in the drawing image display area Ar10 is searched for the predetermined characteristics of the image from the history drawing images RI thus obtained (step S240). Here, the history drawing image RI is a drawing image generated in the past and stored in a predetermined area of the memory card MC. As will be described later, in this embodiment, after the search is executed (step S130 in FIG. 2), the query image is stored in the memory card MC as the history drawing image RI. At this time, the history drawing image RI is stored in association with the user information. The target of the history drawing image search in this embodiment is the history drawing image RI associated with the user information indicating the same user as the user specified by the user information acquired at the start of the image search / printing process. That is, in step S240, processing for detecting a drawing image similar to the current drawn image from drawing images (history drawing image RI) drawn in the past by the same user as the current user is executed. Note that a search for a history drawing image RI similar to the drawing image DI is performed using a known image search method. In addition, as a predetermined feature used for image search, for example, a color histogram or a Haar wavelet coefficient is used.

  The history drawing image processing unit 220 controls the display processing unit 310 to display the history drawing image RI detected by the search in the history drawing image display area Ar20 of the initial window W1 (step S240). FIG. 5 shows an example of the initial window W1 on which the history drawing image RI is displayed. As shown in FIG. 5, in the initial window W1, a history drawing image display area Ar20 for displaying a history drawing image RI detected as being similar to the drawing image DI displayed in the drawing image display area Ar10 is newly added. Is displayed. In the history drawing image display area Ar20, a list of history drawing images RI is displayed in descending order of similarity to the drawing image DI. When the number of history drawing images RI that cannot be displayed in the history drawing image display area Ar20 is detected, the display of the history drawing images RI can be switched by scrolling or the like. In the history drawing image display area Ar20, a progress image display button Bu21 is also displayed corresponding to each history drawing image RI. The progress image display button Bu21 will be described later.

  When a drawing instruction is acquired by the drawing processing unit 210 after displaying the history drawing image RI (step S250: YES), the drawing processing unit 210 updates the drawing image DI and controls the display processing unit 310. The updated drawing image DI is displayed in the drawing image display area Ar10 (step S220). Also in this case, when no further drawing instruction is acquired within a predetermined time from acquisition of the drawing instruction (step S230: NO), the history drawing image RI is searched based on the updated drawing image DI, and detected. The history drawing image RI thus displayed is displayed (step S240).

  The user can input a history drawing image selection instruction by selecting one of the history drawing images RI displayed in the history drawing image display area Ar20 via the operation unit 140. When the input history drawing image selection instruction is acquired by the history drawing image processing unit 220 (step S260: YES), the drawing processing unit 210 controls the display processing unit 310 to display the display image in the drawing image display area Ar10. Is updated to the selected history drawing image RI (step S220). FIG. 6 shows an example of the initial window W1 in which the selected history drawing image RI is displayed in the drawing image display area Ar10 as the drawing image DI.

  Even when the selected history drawing image RI is displayed in the drawing image display area Ar10, when no further drawing instruction is acquired within a predetermined time (step S230: NO), the updated drawing image DI ( That is, the history drawing image RI is searched based on the selected history drawing image RI), and the detected history drawing image RI is displayed (step S240). When a drawing instruction for further drawing is acquired based on the updated drawing image DI (selected history drawing image RI) (step S250: YES), the drawing processing unit 210 displays the drawing image DI. Further, the display processing unit 310 is controlled and the updated drawing image DI is displayed in the drawing image display area Ar10 (step S220).

  The user can input a progress image display instruction by selecting the progress image display button Bu21 displayed in the history drawing image display area Ar20 via the operation unit 140. When the input progress image display instruction is acquired by the progress image processing unit 230 (FIG. 1) (step S270: YES), the progress image processing unit 230 displays the progress of the history drawing image RI corresponding to the progress image display button Bu21. The image PI is detected and the display processing unit 310 is controlled to display the progress image PI in the progress image display area Ar30 of the initial window W1 (step S280). FIG. 7 shows an example of the initial window W1 in which the progress image PI for the history drawing image RI corresponding to the selected progress image display button Bu21 is displayed in the progress image display area Ar30. Here, the progress image PI is an image at each stage of drawing progress of the history drawing image RI, that is, an image in the middle of drawing. In the present embodiment, a drawn image at the end of each drawing operation (stroke) as each stage of drawing progress of the history drawing image RI is used as a progress image PI. As shown in FIG. 7, in the progress image display area Ar30, a plurality of progress images PI according to the drawing progress of the history drawing image RI are displayed.

  The user can input a progress image selection instruction by selecting one of the progress images PI displayed in the progress image display area Ar30 via the operation unit 140. When the input progress image selection instruction is acquired by the progress image processing unit 230 (step S290: YES), the drawing processing unit 210 controls the display processing unit 310 to display the display image in the drawing image display area Ar10. The selected progress image PI is updated (step S220). FIG. 8 shows an example of the initial window W1 in which the selected progress image PI is displayed as the drawing image DI in the drawing image display area Ar10.

  Even when the selected progress image PI is displayed in the drawing image display area Ar10, if no further drawing instruction is acquired within a predetermined time (step S230: NO), the updated drawing image DI (ie, The history drawing image RI is searched based on the selected progress image PI), and the detected history drawing image RI is displayed (step S240). When a drawing instruction for further drawing is acquired based on the updated drawing image DI (selected progress image PI) (step S250: YES), the drawing processing unit 210 further displays the drawing image DI. In addition to updating, the display processing unit 310 is controlled to display the updated drawing image DI in the drawing image display area Ar10 (step S220).

  The user can input a search start instruction by selecting the OK button Bu16 via the operation unit 140 while a desired drawing image is displayed in the drawing image display area Ar10. When the input search start instruction is acquired by the image search unit 240 (step S300), the image search unit 240 sets the drawing image displayed in the drawing image display area Ar10 as a query image serving as a reference for image search. (Step S310).

  When the query image setting process (FIG. 4) is completed, the image search unit 240 (FIG. 1) executes an image search based on the set query image (step S130 in FIG. 2). In the image search in the present embodiment, an image stored in a predetermined area of the memory card MC is used as a target image, and a similarity (similarity) with a query image is large with respect to a predetermined feature of the image from the target image. This is done by detecting the image. The image search is executed using a known image search method. In addition, as a predetermined feature used for image search, for example, a color histogram or a Haar wavelet coefficient is used.

  When the query image setting process (FIG. 4) is completed, the history drawing image processing unit 220 (FIG. 1) stores the set query image as a history drawing image RI in a predetermined area of the memory card MC ( Step S140). At this time, the query image (history drawing image RI) is stored in association with the user information. Further, when the progress image PI exists for the query image, the progress image PI is also stored in association with the query image.

  When the image search is completed, the image processing unit 200 (FIG. 1) controls the display processing unit 310 to display the search result window W2 on the display unit 150 (step S150). FIG. 9 is an explanatory diagram showing an example of the search result window W2. The search result window W2 is a window for displaying a list of target images (detected images DeI) detected in the image search. That is, as shown in FIG. 9, the search result window W2 includes a detection image display area Ar62 in addition to the query image display area Ar61. In the detected image display area Ar62, the detected images DeI are displayed side by side in a rank order (in ascending order of score) indicating the overall similarity to the query image.

  The search result window W2 (FIG. 9) includes a print designation area Ar63. In the search result window W2, for example, the user drags and drops the icon of the detection image DeI to the print designation area Ar63 to display the icon IC of the detection image DeI in the print designation area Ar63, thereby detecting the detection image DeI to be printed. Can be designated (step S160 in FIG. 2). In the example of FIG. 9, two detection images DeI are designated as images to be printed. The print designation area Ar63 includes a print execution button Bu64 and a print designation release button Bu65. The user selects the icon IC of the image displayed in the print designation area Ar63 and selects the print designation release button Bu65 (or drags and drops the image icon IC onto the print designation release button Bu65). The print designation of the image can be canceled. In addition, the user can instruct the print execution start of the detected image DeI corresponding to the icon IC displayed in the print designation area Ar63 by selecting the print execution button Bu64. When an instruction to start printing is given, the print processing unit 320 (FIG. 1) generates print data based on the image data of the designated detection image DeI, and controls the printer engine 160 to print the detection image DeI. This is executed (step S170 in FIG. 2).

  As described above, in the image search / print processing by the printer 100 of this embodiment, a history drawing image RI similar to the generated / updated drawing image DI is searched, and a query is made based on the detected history drawing image RI. Since image search can be performed by setting an image, user convenience can be improved in image processing that performs image search based on a drawn image. That is, for example, in the image search / print processing of this embodiment, the query image used in the past image search is stored as the history drawing image RI, so that the query image is detected and set as the query image again. By performing the image search, the image detected in the past image search can be detected again.

  In the present embodiment, the search and display of the history drawing image RI is executed when no further drawing instruction is acquired within a predetermined time from the acquisition of the previous drawing instruction, so that the user can search for the history drawing image RI. If desired, the drawing operation may be stopped for a predetermined time. In other words, in this embodiment, since it is possible to suppress the search execution of the history drawing image RI when the user does not want to search the history drawing image RI, the processing load is reduced and the processing efficiency is improved. Can do.

  Further, in the image search / print processing of the present embodiment, a new drawing image generated by further drawing based on the detected and selected history drawing image RI is set as a query image and image search is performed. Can do. Therefore, for example, an image obtained by changing a query image used in a past image search can be used as a new query image, and user convenience can be improved in image processing for performing an image search based on a drawn image. it can.

  In the image search / print processing of the present embodiment, a new drawing image generated by further drawing based on the detected and selected progress image PI is set as a query image and image search is performed. it can. Therefore, for example, a new query image can be set by performing drawing based on the image (progress image PI) in the middle of drawing the query image used in the past image search, and image search based on the drawn image can be performed. User convenience can be improved in the image processing to be performed.

  Further, in the image search / print processing of the present embodiment, the history drawing image RI is searched for the history drawing image RI drawn in the past by the same user as the current user, so that the desired query image can be efficiently used. The user convenience can be improved in the image processing for performing the image search based on the drawn image.

B. Variation:
The present invention is not limited to the above-described examples and embodiments, and can be implemented in various modes without departing from the gist thereof. For example, the following modifications are possible.

B1. Modification 1:
In the above embodiment, the history drawing images RI are displayed as a list in the history drawing image display area Ar20 of the initial window W1 (see FIG. 5), but the method of displaying the history drawing images RI can be variously changed. FIG. 10 is an explanatory diagram showing an example of the initial window W1a in the modification. In the initial window W1a shown in FIG. 10, the detected history drawing image RI is displayed so as to overlap the drawing image DI in the drawing image display area Ar10. The history drawing image RI is displayed lightly so that the overlapping drawing image DI and the history drawing image RI can be distinguished from each other. The initial window W1a includes a candidate selection button Bu17, a next candidate button Bu18, and a previous candidate button Bu19. When a plurality of history drawing images RI are detected, for example, the history drawing image RI having the highest degree of similarity to the drawing image DI is displayed first, and the history is determined by selecting the next candidate button Bu18 or the previous candidate button 19. Display switching of the drawn image RI is performed. Further, an instruction to select the history drawing image RI is given by the candidate selection button Bu17.

B2. Modification 2:
In the above embodiment, the history drawing image RI is searched for the history drawing image RI associated with the user information indicating the same user as the user specified by the user information acquired at the start of the image search / printing process. Although it is executed, the history drawing image RI may be searched for all the history drawing images RI stored in the memory card MC regardless of whether or not the users are the same. In this way, including the drawing image drawn by another user, the history drawing image RI used as the query image in the past image search can be set as the query image again, and the image search can be performed. The efficiency of the query image setting can be improved, and the user convenience can be improved in the image processing for performing the image search based on the drawn image. In this case, the user information does not need to be acquired at the start of the image search / print process, and the history drawing image RI does not need to be associated with the user information.

  In addition, when the history drawing image RI is searched for all the history drawing images RI stored in the memory card MC regardless of whether or not the users are the same, the detected history drawing image RI is displayed. The user who has drawn the history drawing image RI may be displayed in an identifiable manner. For example, when displaying the history drawing image RI in the history drawing image display area Ar20, the background color is set to a color according to the user, or the user information is displayed next to or above the history drawing image RI. Also good.

  The history drawing image RI stored in the memory card MC may be exchanged between users or devices via a storage medium such as the memory card MC or a network such as a LAN.

B3. Modification 3:
In the above embodiment, the history drawing image RI similar to the drawing image DI is searched for the predetermined feature of the image. However, the predetermined feature of the image referred to when searching for the history drawing image RI is completed. The feature is not limited to the feature of the image, and may be a feature in the drawing process. As a feature in the drawing process, for example, a feature of a drawing operation can be cited. FIG. 11 is an explanatory diagram showing features of the drawing operation. In FIG. 11A, for example, the direction of the drawing operation on a line drawn by one drawing operation using an input device such as a mouse is indicated by an arrow, and the input position of the input device after a certain time has been indicated by a black dot. Yes. FIG. 11B shows an input position for each elapsed time as an example of the feature of the drawing operation shown in FIG. As shown in FIG. 11B, by comparing the input positions for each elapsed time between the drawn image and the history drawn image RI, the similarity of the features of the drawing operation can be obtained. In drawing operations, it is considered that each person's habit (direction, speed, etc. of drawing a line) often appears. By searching the history drawing image RI using the similarity of the features of such drawing operations, the history drawing image RI desired by the user can be detected more accurately and efficiently. Such a retrieval method of the history drawing image RI can be realized by storing the input position at every elapse of a fixed time in the drawing operation. FIG. 11B shows a two-dimensional graph representing an input position along the vertical direction, for example, but in reality, a three-dimensional graph including an axis representing the input position along the horizontal direction. It is possible to compare the similarity of the features of the drawing operation using the graph. The history drawing image RI search method using the characteristics of such drawing progress indicates that the search of the history drawing image RI indicates the same user as the user specified by the user information acquired at the start of the image search / print processing. This is adopted only when executed on the history drawing image RI associated with the user information, and targets all history drawing images RI stored in the memory card MC regardless of whether or not the users are the same. It may not be adopted when the history drawing image RI is searched.

B4. Modification 4:
In the above embodiment, the image search is executed when the OK button 16 is selected after setting the query image in the initial window W1 (FIG. 3). However, the execution timing of the image search can be arbitrarily set. is there. For example, the image search may be executed with the drawing image displayed in the drawing image display area Ar10 as a query image every predetermined time. In this case, when the image search is executed, as shown in FIG. 12, the detected image display area Ar40 is displayed in the initial window W1b, and the detected images DeI are displayed in a list in the detected image display area Ar40. In this way, a series of processing results from drawing to image search can be displayed in one window, and user convenience can be improved in image processing that performs image search based on a drawn image.

  As shown in FIG. 13, an image search start instruction button Bu22 corresponding to each history drawing image RI is displayed in the history drawing image display area Ar20 of the initial window W1c, and the user selects the image search start instruction button Bu22. Then, an image search using the corresponding history drawing image RI as a query image is executed, and a list of detected images DeI may be displayed in the detected image display area Ar40.

B5. Modification 5:
In the above embodiment, the history drawing image RI is searched and displayed when no further drawing instruction is acquired within a predetermined time from the acquisition of the previous drawing instruction. However, the history is immediately after each drawing operation is completed. The drawing image RI may be searched and displayed.

  In the above embodiment, the progress image PI can be detected and displayed. However, the progress image PI need not necessarily be detected and displayed.

  In addition, although the operation unit 140 in the above embodiment is configured with buttons and a touch panel, the operation unit 140 may be configured with other input devices (such as a mouse and a pen tablet).

  In the above embodiment, the image search / print processing is executed using the image (image data (image file)) stored in the memory card MC as the target image. However, the target image in the image search / print processing is arbitrary. Can be set. For example, an image stored in a predetermined area of the internal memory 120 (FIG. 1) may be set as a target image, or in a storage area of another device connected to the printer 100 via a cable or a network. The stored image may be set as the target image.

  Similarly, in the above embodiment, the history drawing image RI and the progress image PI are stored in the memory card MC, and the history drawing image RI and the progress image PI are targeted for the history drawing image RI and the progress image PI stored in the memory card MC. However, the storage area of the history drawing image RI and the progress image PI may be a predetermined area of the internal memory 120, or other area connected to the printer 100 via a cable or a network. It may be a storage area of the device.

  Further, the contents and layout of the initial window W1 and the search result window W2 in the above embodiment are merely examples, and various modifications can be made.

  Further, the configuration of the printer 100 as the image processing apparatus in the above embodiment is merely an example, and the configuration of the printer 100 can be variously changed. In the above-described embodiments, the image search / print processing by the printer 100 as the image processing apparatus has been described. However, part or all of the processing may be another type of server, personal computer, digital still camera, digital video camera, or the like. It may be executed by the image processing apparatus. The printer 100 is not limited to an ink jet printer, and may be another type of printer such as a laser printer or a sublimation printer.

  In the above embodiment, a part of the configuration realized by hardware may be replaced with software, and conversely, a part of the configuration realized by software may be replaced by hardware.

  In addition, when part or all of the functions of the present invention are realized by software, the software (computer program) can be provided in a form stored in a computer-readable recording medium. In the present invention, the “computer-readable recording medium” is not limited to a portable recording medium such as a flexible disk or a CD-ROM, but an internal storage device in a computer such as various RAMs and ROMs, a hard disk, etc. It also includes an external storage device fixed to the computer.

100 ... Printer 110 ... CPU
DESCRIPTION OF SYMBOLS 120 ... Internal memory 140 ... Operation part 150 ... Display part 160 ... Printer engine 170 ... Card interface 172 ... Card slot 200 ... Image processing part 210 ... Drawing processing part 220 ... History drawing image processing part 230 ... Progression image processing part 240 ... Image Search unit 250 ... Print image setting unit 260 ... User information acquisition unit 310 ... Display processing unit 320 ... Print processing unit

Claims (17)

An image processing apparatus for performing image search,
A drawing processing unit that obtains a drawing instruction and generates a drawing image according to the drawing instruction;
A history drawing image processing unit that detects the history drawing image similar to the generated drawing image with respect to a predetermined feature from a history drawing image that is another drawing image stored in a predetermined storage area;
An image processing apparatus comprising: an image search unit that sets a query image as a reference for image search based on the detected history drawing image and performs image search based on the query image. The image processing apparatus according to claim 1, further comprising:
A display unit that displays the generated drawing image and the detected history drawing image;
The history drawing image processing unit obtains a selection instruction for selecting one of the displayed history drawing images,
The image search unit is an image processing device that sets the query image based on the selected history drawing image. The image processing apparatus according to claim 2,
The image search unit is an image processing device that sets the selected history drawing image as the query image. The image processing apparatus according to claim 2,
The drawing processing unit generates a new drawing image by drawing based on the selected history drawing image,
The image search unit, wherein the image search unit sets the generated new drawn image as the query image. An image processing apparatus according to any one of claims 1 to 4,
The history drawing image processing unit stores the generated drawing image as the history drawing image in the storage area. The image processing apparatus according to claim 5, further comprising:
A user information acquisition unit that acquires user information that identifies users,
The history drawing image processing unit stores the history drawing image in the storage area in association with the user information, and detects the history drawing image similar to the generated drawing image at the time of drawing image generation. An image processing apparatus that executes the history drawing image associated with the user information indicating the same user as the user. The image processing apparatus according to claim 6,
The history drawing image processing unit is an image processing device that detects the history drawing image based on a degree of similarity of features in the drawing progress of the generated drawing image and the history drawing image. The image processing apparatus according to claim 5, further comprising:
A user information acquisition unit that acquires user information that identifies users,
The history drawing image processing unit stores the history drawing image in the storage area in association with the user information, and generates a drawing image when detecting the history drawing image similar to the generated drawing image. The history drawing image associated with the user information indicating the same user as the user at the time is detected based on the degree of similarity of features in the drawing process, and the user indicating a user different from the user at the time of drawing image generation An image processing apparatus that detects the history drawing image associated with information without considering the degree of similarity of features in the drawing process. The image processing apparatus according to claim 2, further comprising:
A progress image processing unit that detects a progress image that is an image at each stage of the drawing progress of the history drawing image selected from the displayed history drawing images from a predetermined storage area;
The display unit displays the detected progress image,
The progress image processing unit obtains a selection instruction for selecting one of the displayed progress images,
The image search unit is an image processing device that sets the query image based on the selected progress image. The image processing apparatus according to claim 9,
The drawing processing unit generates a new drawing image by drawing based on the selected progress image,
The image search unit is an image processing device that sets the generated new drawn image as the query image. The image processing apparatus according to claim 9 or 10, wherein:
The progress image processing unit stores an image at each stage of drawing progress of the generated drawn image in the storage area as the progress image. The image processing apparatus according to claim 2,
The display unit is an image processing apparatus that displays the detected history drawing image so as to overlap the generated drawing image. An image processing apparatus according to any one of claims 1 to 12,
The image search unit performs an image search at a preset timing,
The said display part is an image processing apparatus which displays the detected image detected by the image search simultaneously with the said produced | generated drawing image and the detected said history drawing image. The image processing apparatus according to claim 1, further comprising:
A print image setting unit for setting a detection image to be printed from detection images detected by image search;
An image processing apparatus comprising: a printing unit that prints a detection image to be printed. An image processing method for performing image search,
(A) obtaining a drawing instruction and generating a drawing image in accordance with the drawing instruction;
(B) detecting the history drawing image similar to the generated drawing image with respect to a predetermined feature from a history drawing image which is another drawing image stored in a predetermined storage area;
(C) An image processing method comprising: setting a query image as a reference for image search based on the detected history drawing image, and performing an image search based on the query image. A computer program for image processing that performs image search,
A drawing processing function for obtaining a drawing instruction and generating a drawing image according to the drawing instruction;
A history drawing image processing function for detecting the history drawing image similar to the generated drawing image with respect to a predetermined feature from a history drawing image which is another drawing image stored in a predetermined storage area;
A computer program that causes a computer to realize an image search function that sets a query image as a reference for image search based on the detected history drawing image and performs image search based on the query image. A printing device,
A drawing processing unit that obtains a drawing instruction and generates a drawing image according to the drawing instruction;
A history drawing image processing unit that detects the history drawing image similar to the generated drawing image with respect to a predetermined feature from a history drawing image that is another drawing image stored in a predetermined storage area;
An image search unit that sets a query image as an image search reference based on the detected history drawing image, and performs an image search based on the query image;
A print image setting unit for setting a detection image to be printed from detection images detected by image search;
A printing unit that prints a detection image to be printed.

Images