JP5794476B2 - Image processing system, image processing apparatus, image processing method, image processing program, and printed matter - Google Patents

Description

  The present invention relates to an image processing system, an image processing method, an image processing program, and a printed matter that are suitable for printing and providing a photograph composed of digital image data.

Since the spread of digital cameras, various new businesses have been born, taking advantage of the fact that photos can be sent over the Internet and image processing is possible.
For example, taking advantage of the property of being able to be transmitted via the Internet, a print service is widely used in which a photo is ordered from a printer through the Internet and a photo printed on a print medium such as photographic paper is received by mail.

  Further, there is a picture conversion technique that takes advantage of the characteristic that image processing is possible and converts photographed photographs into picture-like image data composed of picture-like pictures (for example, see Patent Document 1).

There are also websites that convert pictures uploaded by users into picture-like image data using such picture conversion technology.
With painting conversion technology, you can convert a photo of a dim cloudy sky into a bright pastel image, or convert a portrait of a person into an illustration image, opening up new ways to enjoy photos be able to.

A business that sells works made of painting-like image data that has been converted in this way for a fee can be considered.
In that case, the goodness of the painting conversion technology cannot be promoted unless the sample of the work is shown to the user, but there is a problem that the work is copied (downloaded) without permission if all are displayed.

  In order to clarify the copyright of the downloaded work, a technique for adding a sample mark to the downloaded image data is known (see, for example, Patent Document 2).

  Further, a technique for masking a part of image data is known from the viewpoint of privacy protection (see, for example, Patent Document 3).

  With this technique, the sample mark is embedded in the work or part of it is masked, and after the fee is paid, the sample mark or mask is removed. There was a request to confirm the whole work.

JP 2011-166217 A JP 2006-180051 A JP 2006-320488 A

  The present invention has been made in view of the above circumstances, and an object of the present invention is to allow a user to easily check the entire image data from the masked image data using a viewer.

To achieve the above Symbol object, one aspect of the present invention, an image processing system composed of a server connected via a network to the end terminal and said end, the terminal part of the images reading means for reading the markers that are masked, based on the information indicated by the marker read by the reading means, and connecting means for connecting to the server, and discriminating means for discriminating the type of said marker, by said connection means An acquisition unit that acquires image data of a type corresponding to a determination result by the determination unit from a connected server and that represents a part of the image masked by the marker; and acquired by the acquisition unit based on the image data, the image processing cis, characterized in that it comprises display means for displaying an image without a mask by the marker It is to provide a beam.

  According to the present invention, the entire work can be shown to the user using a viewer while preventing the work from being copied.

It is a block diagram which shows the structure of the network system of one Embodiment which concerns on this invention. In the same embodiment, it is a figure which shows the state printed on the print medium so that the marker may mask the principal part of pictorial image data. In the embodiment, it is a figure for demonstrating the state which reads the marker printed on the print medium with a terminal. FIG. 3 is a block diagram showing a configuration of a server in the same embodiment. (A) is a flowchart for explaining the flow when a photo print is ordered in the embodiment, and (B) is a case where a marker printed on a print medium is read by a terminal in the embodiment. It is a flowchart for demonstrating a flow. 4 is a flowchart for explaining a picture conversion process in the embodiment. In the same embodiment, it is a figure which shows the state which is displaying the multiple types of painting style image data on the terminal. In the same embodiment, it is a figure which shows the state which is displaying the operation menu on the terminal. In the embodiment, it is a functional block diagram which shows the structure of a terminal. In the same embodiment, it is a sequence diagram of the communication part of a terminal and a server. It is a schematic diagram for demonstrating 2nd Embodiment which concerns on this invention. It is a schematic diagram for demonstrating the modification of 2nd Embodiment which concerns on this invention. The data flow figure in the same embodiment is shown. It is a figure which shows the internal flow of the terminal in the Example. It is a figure which shows the internal flow of the terminal in 3rd Embodiment which concerns on this invention.

[First Embodiment]

  FIG. 1 is a block diagram showing a configuration of a network system according to an embodiment of the present invention. 1-1, 1-2, 1-3,... Are so-called terminals such as a personal computer (PC), a smartphone, a mobile phone, and an information terminal, and can be connected to the image service site 10 via the Internet 500. It acts as a viewer.

  The image service site 10 is a service for converting original image data uploaded by a user into painting-like image data composed of a painting-like painting tone (painting conversion). It is a website that provides services for receiving and printing on print media, and services for publishing photos and painting-like image data posted by users. In addition, the submitted photograph (original image data), the painting-like image data converted into a painting, the photograph printed on the print medium, and the like are collectively referred to as a work.

  The image service site 10 includes a server 11, performs processing related to various services including a service for converting the image data into painting-like image data including painting-like painting tone, and includes a printing device 12. Prints picture-like image data ordered by the user. The printing device 12 does not need to be in the image service site 10 and includes a device that is outsourced to another printing site.

FIG. 2A explains printing of a photograph ordered by a user. A picture-like image 32 is printed on a print medium 20 such as paper or photographic paper, and a QR code is printed on a main part 24 of the picture-like image 32. A printed matter 25 is formed by printing a marker 22 made of (registered trademark) or the like.
Thereby, the main part 24 of the picture-like image 32 is hidden by the marker 22 in the printed matter 25 so that it cannot be seen.

  The part of the painting-like image 32 masked by the marker 22 may be a unique position regardless of the contents of the image data such as the vicinity of the center of the painting-like image 32. In addition, a region that a human will focus on is extracted using the region-of-interest extraction technique described in Japanese Patent Application Laid-Open No. 2011-54071, and the extracted region may be used as a main part. A region in which the main part of the painting-like image 32 is automatically recognized may be used as the main part. Furthermore, the part designated by the user who uploaded the original image data of the painting-like image 32 may be used as the main part. In this case, a function for the user to specify the position and size of the mask is provided on the website.

  As for the shape of the marker, when it is composed only of QR code (registered trademark), the shape of the marker is rectangular as shown in the figure. However, a template such as a star shape or an oval shape is prepared in the server 11 in advance, and the size and position of the template can be adjusted so that the marker on the printed matter 25 can have an appropriate shape. In this case as well, when QR code (registered trademark) is used, a marker in which a rectangular QR code (registered trademark) is put in a star is formed and printed.

Then, as shown in FIG. 2B, the marker 22 is read by a camera (not shown) on the back surface of the terminal 1-1. Since the marker 22 indicates the URL address of the server 11 of the image service site 10, the terminal 1-1 connects to the image service site 10 and downloads the painting-like image 32 from the server 11 to the terminal 1-1. Therefore, the painting-like image 32 can be displayed on the display unit 31.
Thereby, the marker 22 on the main part 24 disappears, and the whole painting-like image 32 can be seen on the display part 31 of the terminal 1-1.

FIG. 3 is a block diagram showing the configuration of the server 11, where 13 is an original image data storage unit for storing a photograph (original image data) uploaded by the user, and 14 is an original image data converted into a pictorial image. A picture-like image data storage unit 15 for storing picture-like image data, and a link control program storage unit 15 for storing a link control program for controlling the link between the server 11 and the terminal 1-1.
The link control program also has a function of converting a storage location of original image data or painting-like image data into a two-dimensional barcode as a marker.

  16 is a picture conversion program for executing a picture conversion process in accordance with a picture conversion algorithm, and a picture conversion program storage unit in which parameters for effect processing necessary for the picture conversion are stored. It is a print control program storage unit that stores a converted print-like image data and a print control program for printing together with a marker indicating a place where the original image data is stored.

  Reference numeral 18 denotes a marker control program storage unit that stores a marker control program for controlling in which size and shape the marker 22 is superimposed on which position on the painting-like image 32.

  Here, the types of painting styles that can be converted by the painting conversion program are oil painting style, watercolor painting style, pastel painting style, colored pencil painting style, gothic painting style, airbrush painting style, beast group painting style. There are 16 types of colors available: embroidery, illustration, pale watercolor, crayon, gouache, silkscreen, collage, drawing, and heavy oil.

  13A is a start address of the original image data storage unit 13, 15A is a start address of the link control program storage unit 15, and 14A is a start address of the painting-like image data storage unit 14. By specifying this start address, original image data, various link control programs, and various picture-like image data are specified.

FIG. 4A is a flowchart for explaining the flow when ordering a print of a photograph. Since it is described along the procedure, the processing performed by the terminal 1-1 and the processing performed by the server 11 are described in one flowchart.
The actual communication sequence between the server 11 and the terminal 1-1 will be described later with reference to FIG.

  First, the user uploads an original image from the terminal 1-1 to the server 11 when he / she wants to place an order for printing a photograph to the image service site 10 via the Internet (step S401). At that time, the number of prints and print size are also specified.

  On the server 11 side, the uploaded original image data is stored in the original image data storage unit 13 (step S402). In step S403, the original image data is subjected to a picture conversion process by a picture conversion program. There are 16 types of image tone as described above, but here, all 16 types are created and stored in the painting image data storage unit 14 (step S404). After receiving the designation of the type of painting tone, it is also possible to convert the painting tone image data of the designated painting tone.

  Subsequently, the start address 14A of the picture-like image data storage unit 14, that is, a marker indicating the location where various picture-like image data is stored is created by the link control program (step S405). As described above, the marker is, for example, a QR code (registered trademark).

Subsequently, in step S406, the created marker 22 is superimposed on the main part 24 of the painting-like image 32 and printed on the same print medium 20 (see FIGS. 2A and 2B). The printing itself may be performed within the image service site 10 or a print instruction may be given to another print server or a print dealer.
Then, the print medium 20 on which both the picture-like image 32 and the marker 22 are printed in an overlapping manner is mailed from the image service site 10 or from a consigned print dealer to the user (step S407).

  FIG. 4B is a flowchart showing an operation procedure on the terminal 1-1 side of the user. The marker 22 printed on the print medium 20 is photographed by a camera (not shown) (81 in FIG. 8 described later) provided in the terminal 1-1 (step S411). Then, the terminal 1-1 recognizes the marker 22 and automatically connects to the link destination of the server 11 designated by the marker 22, that is, the place where the picture-like image data is stored (step S412). At this time, whether or not to request a click by displaying the URL address of the link destination is a design matter, and in this embodiment, it is directly connected to the start address 14A where the picture-like image data is stored. Then, the painting-like image data stored in the place, for example, the painting-like image data of oil painting is downloaded to the terminal 1-1 (step S413), and the painting-like image 32 is displayed on the display unit 31 (step S414). .

  By doing so, the user can view the painting-like image 32 in which the marker 22 hiding the main part 24 disappears only by holding the terminal 1-1 on the print medium 20.

FIG. 5 is a flowchart showing a picture conversion process by the picture conversion program stored in the picture conversion program storage unit 16.
First, preprocessing is performed (step S502). This is a process that is executed in common regardless of the type of painting, and the image conversion process requires that the image data be in bitmap format, so image data expressed in JPEG format is converted to bitmap format. To do. Also, noise is removed by applying a filter.

Subsequently, an image tone selection process is performed (step S504).
When the image tone is selected, the process proceeds to the step of each image tone conversion algorithm. For example, if it is oil-tone conversion, the process proceeds to step S506, and if it is watercolor-tone conversion, the process proceeds to step S510. Otherwise, the process proceeds to another step of the tone conversion algorithm (step S520).

When executing each algorithm of the painting conversion process, various parameters for effect processing necessary for the conversion are acquired (steps S508 and S512). The parameters are stored in the picture conversion program storage unit 16. A parameter is an element for applying an effect process to a pixel. That is, a pixel is generally expressed by gradations of a plurality of bits for each of RGB, but is an element for performing an operation on the bit data.
The effect processing basically obtains the same effect as the effect processing adopted in photo retouching software.

  In addition, as a kind of effect processing, overexposure of overexposure or underexposure is achieved by inserting a photo with a wide dynamic range, which cannot be represented by a normal photo called HDR (High Dynamic Range), into a narrow dynamic range by tone mapping. There is also an effect process that increases the expressive power by correcting blackout. By applying this effect processing, it is possible to obtain an image that realizes a new photographic expression that takes artistic expression into consideration by bringing the photograph closer to the memory and impression received by the human brain. HDR conversion is also a kind of picture conversion.

Then, the 16 types of painting conversion processes described above are performed via steps S522 and S504.
Since 16 types of painting conversion processes are assumed to be viewed on the display unit 31 of the terminal 1-1, a very large image is not necessary. For example, the resized image data obtained by resizing the original image data to about 800 × 600 pixels. Is being processed. The original image data is generally very large such as about 4000 × 3000. Therefore, when a specific image tone such as a print order is determined (step S522), the process proceeds to step S524, and a picture conversion process is performed on the original image data (step S524). At this time, the necessary parameters are acquired (step S526). However, even when painting conversion is performed for the same image with the same painting tone, appropriate parameters also change when the size or print size of the original image changes. Therefore, the parameters acquired in step S508 and step S512 and the parameters acquired in step S526. The parameters to do will be different.

  Thereafter, post-processing for converting the picture-like image data after the picture conversion into the JPEG format again is performed (step S528). If it is not necessary to convert the original image data into a picture, steps S524 and S526 may be skipped.

FIG. 6 shows a state in which a plurality of types of picture-like image data are displayed on the display unit 31 of the terminal 1-1 in the present embodiment. That is, a list of 16 kinds of reduced-size images 41a, 42b,... Of painting-like image data is displayed on the display unit 31 of the terminal 1-1 (reference numeral 41). 41a is an oil painting tone, 41b is a watercolor painting tone, 41c is a pastel painting tone, 41d is a color pencil painting tone, 41e is a painting tone image data converted into a Gothic painting tone.
The display unit 31 of the terminal 1-1 has a touch panel. When any one of the reduced images 41a, 41b,... Is touched, the image is enlarged and an operation menu display as shown in FIG. come.

In FIG. 7, reference numeral 32 denotes painting-like image data of the selected painting tone, and 42 shows an operation menu.
The display browser of the terminal 1-1 is configured using, for example, HTML (HyperText Markup Language) 5 or CSS (Cascading Style Sheets) 3 and the like, and is compatible regardless of the model. Cooperation with the link control program stored in the program storage unit 15 can be established.
That is, when any one of the operation menus 42 is operated on the touch panel of the display unit 31 of the terminal 1-1, the operation signal is transmitted to the server 11 via the Internet 500, and the corresponding link control program storage unit 15 to the address 16A, and the link control program of the server 11 executes the corresponding process.

Next, link control between the server 11 and the terminal 1-1 will be described with reference to FIGS.
FIG. 8 is a functional block diagram for explaining the configuration of the terminal 1-1. With this configuration, the display shown in FIG. 7 is realized.
Reference numeral 81 denotes a camera installed on the back surface of the terminal 1-1 (not shown in FIG. 2B) for reading the marker 22.
A transmitting unit 82 functions to read the marker 22, access the link destination of the server 11, and upload original image data to the server 11.
A receiving unit 83 functions to receive control data, original image data, and painting-like image data transmitted from the server 11.
A display control unit 84 controls the display of the display unit 31. The operation menu 42 is displayed on the display unit 31 by the control of the menu display control unit 85, and the control of the painting-like image data display control unit 86 is performed. Thus, it functions to display picture-like image data of a predetermined image tone on the display unit 31 in accordance with the operation of the operation menu 42.
Reference numeral 87 denotes a terminal-side link control unit which functions to cooperate with the link control program stored in the link control program storage unit 15 of the server 11. In order to establish cooperation, the transmission unit 82 and the reception unit 83 transmit and receive various control signals between the terminal 1-1 and the server 11.
Reference numeral 88 denotes an operation control unit that functions to control the touch panel and output an operation signal in response to an operation of the operation menu 42.

  In FIG. 7, when the “next” key or the “back” key of the operation menu 42 is pressed while the painting-like image 32 is displayed, the painting-like image data of the types of paintings displayed in the list in FIG. The images are displayed one by one in order or backward. It is also possible to touch the part of the painting-like image 32 on the touch panel of the display unit 31 to page (swipe) the page.

  When the “list display” key is pressed, a list display state shown in FIG. 6 is obtained.

  When the “Enlarged Display” key is pressed, the currently displayed display is enlarged and the details of the image can be seen. As described above, the number of pixels of the display unit 31 of the terminal 1-1 is about 800 × 600 pixels, and the actual image data is about 4000 × 3000 pixels. be able to.

  If you want to place a print order for painting-like image data, select the print size with the “Specify size” key, select the presence / absence and type of the frame with the “Specify frame” key, Select mugs, T-shirts, etc. Finally, the user places an order by pressing the “print order” key.

  Of course, the submenu can be displayed by pressing one operation key.

  The above operations allow selection, display, print order, etc. of painting-like image data without being particularly conscious of the image service site 10, but the top page of the image service site 10 is displayed by operating the “top page” key. Displayed on the unit 31. You can view photos posted by other users and post your own photos as well as print orders.

  In this case, when the terminal 1-1 is a personal computer or a smartphone, the normal home page of the image service site 10 is displayed, but when the terminal 1-1 is a mobile phone, the mobile page dedicated to the mobile phone may be jumped to.

FIG. 9 is a sequence diagram of the communication part between the terminal and the server, and shows the signal flow of the operation of FIG.
The printed matter 25 mailed from the image service site 10 is printed with an image 32 in which the marker 22 is superimposed on the print medium 20 so as to mask the main portion 24 (marker image data (A)). When this marker 22 is read by the camera 81 of the terminal 1-1, the terminal 1-1 cooperates with the link control program stored in the link control program storage unit 15 included in the server 11 of the image service site 10. Then, it recognizes the URL address of the server 11 (marker information (C)) and jumps to the address 14A of the picture-like image data storage unit 14 in which the picture-like image 32 is stored.
Then, the painting-like image 32 (image data (B) corresponding to the marker) designated by the address 14A is read out and sent to the terminal 1-1.

  These are controlled by the link control program storage unit 15 of the server 11 and the link control unit 87 of the terminal 1-1.

  Thereby, the marker 22 on the main part 24 disappears, and the whole painting-like image 32 can be seen on the display part 31 of the terminal 1-1.

[Second Embodiment]
In the second embodiment of the present invention, information hiding the main part of the work is inserted in the marker. That is, in the first embodiment, the entire image is replaced by downloading the original image from the image whose main part is hidden by the marker. However, in this embodiment, the image of the part hidden by the marker is replaced. Is encoded and written to the marker.

FIG. 10 is a schematic diagram for explaining the embodiment. FIG. 10A illustrates printing of an image ordered by a user. An image 33 is printed on a print medium 20 such as paper or photographic paper, and a marker 23 is placed on a main portion 24 of the image 33. It is printed.
Therefore, the main part 24 of the image 33 in the printed matter 25 is hidden by the marker 23 so that it cannot be seen.

  The marker 23 is a portion that is hidden by the marker 23 in the image 33, that is, a deficient data 35 indicated by a solid line in FIG. The marker 23 in which the missing data 35 is encoded and written is restored by the painting-like image data display control unit 86 of the terminal 1-1 using an application downloaded from the server 11 of the image service site 10 for a fee or free of charge. Is something that can be done.

  Therefore, the user takes an image 33 including the marker 23 printed on the print medium 20 by the camera 81 included in the terminal 1-1. Then, the terminal 1-1 recognizes the marker 23, and the painting-like image data display control unit 86 operates based on the application to generate the encoded deficient data 35.

  Further, after the marker 23 is removed from the image 33 including the marker 23 displayed on the display unit 31 by photographing with the camera 81, the image 33 from which the marker 23 is removed and the insufficient data 35 are matched. The contours and the like are matched and displayed. Thereby, as shown in FIG. 10B, the original image 33 in which the deficient data 35 is interpolated is displayed on the display unit 31, the marker 23 on the main part 24 is deleted, and the entire image 33 is displayed on the terminal. It can be seen on the display unit 31 of 1-1.

  FIG. 11 is a schematic diagram for explaining a modification of the second embodiment of the present invention. FIG. 11A explains printing of an image ordered by a user. An image 33 is printed on a print medium 20 such as paper or photographic paper. The main part 24 of the image 33 is: It consists of a marker 34 made of a processed image. The marker 34 composed of the processed image is obtained by processing the pre-processed image data 331 that is the original image portion in the image 33 shown in FIG. 3C and displaying an image different from the original image portion. . Thereby, the main part 24 of the image 33 in the printed matter 25 is hidden by the marker 34 made of the processed image so that it cannot be seen.

  The marker 34 that processes the original image 331, which is the original image, and displays an image different from the original image portion, uses an application downloaded for free or free from the server 11 of the image service site 10. The painting-like image data display control unit 86 includes data that can be restored to the original image portion by executing processing.

  Therefore, the user takes an image 33 including the marker 34 printed on the print medium 20 by the camera 81 included in the terminal 1-1. Then, the terminal 1-1 recognizes the marker 23, and the painting-like image data display control unit 86 operates based on the application, thereby decoding and generating the encoded original image portion.

  Further, after removing the marker 34 made of the processed image from the image 33 including the marker 34 made of the processed image displayed on the display unit 31 by photographing with the camera 81, the image 33 from which the marker 34 is removed The pre-processing image data 331 is displayed by matching. As a result, as shown in FIG. 11B, the original image 33 in which the portion of the marker 34 made of the processed image is replaced with the pre-processed image data 331 is displayed on the display unit 31, and the processed image on the main unit 24. By removing the marker 34 made of an image, the entire image 33 can be viewed on the display unit 31 of the terminal 1-1.

  FIG. 12 shows a data flow diagram in the second embodiment. In the figure, the printed matter 25 is mailed to the user from the image service site 10 or a contracted print company. The user photographs the printed matter 25 with the camera 81 included in the terminal 1-1. The terminal 1-1 reads the marker 34 composed of the processed image data (step S601), and acquires information on the marker 34.

As described with reference to FIG. 11, the marker 34 includes a processed image obtained by processing the main part 24 of the image 33. Further, the marker 34 composed of the processed image is obtained by processing the pre-processed image data 331 that is the original image portion in the image 33 shown in FIG. 11C and displaying an image different from the original image portion. It is. Thereby, the main part 24 of the image 33 in the printed matter 25 is hidden by the marker 34 made of the processed image so that it cannot be seen.
And based on the acquired marker information, the presence of pre-processing data for displaying the pre-processing image, and the presence of the processed image data meant by the processed image (marker 34) obtained by photographing the printed matter, An inquiry is made by the painting-like image data display control unit 86 (step S602).

  Then, after removing the marker 34 made of the processed image from the image 33 including the marker 34 made of the processed image displayed on the display unit 31 by photographing with the camera 81, the image 33 from which the marker 34 is removed Then, the pre-processing image data 331 is matched and synthesized (step S603). Thereafter, the original image 33 in which the portion of the marker 34 made of the processed image is replaced with the pre-processed image data 331 is displayed on the display unit 31 of the terminal 1 (step S604). The entire image 33 from which the marker 34 made of the processed image on the unit 24 has been removed can be viewed on the display unit 31 of the terminal 1-1.

FIG. 13 is a diagram illustrating an internal flow of the terminal according to the second embodiment. In this embodiment, the painting-like image data display control unit 86 of the terminal 1-1 shown in FIG. 8 accesses the server 11 of the image service site 10 in advance and downloads the following application (1 ) (2) (3) are stored.
(1) Application corresponding to insufficient data (2) Application corresponding to unprocessed image data (3) Application corresponding to different processed image data

Further, the painting-like image data display control unit 86 includes
(A) Insufficient data corresponding to the marker (B) Pre-processing image data corresponding to the marker (C) Another pre-processing image data corresponding to the marker is downloaded in advance from the server 11 of the image service site 10 for a fee or free of charge. Stored.

In the above configuration, when the user performs an operation of photographing the printed matter 25 using the terminal 1-1, the terminal 1-1 reads a marker present in the image of the printed matter 25 by the camera 81 (step S701). Then, it is determined which of the following (a), (b), and (c) the read marker means (step S702).
(A) Marker corresponding to deficient data (b) Marker corresponding to pre-processed image data (c) Marker corresponding to another processed image data

  In the case of “(a) a marker corresponding to insufficient data”, that is, when the insufficient data 35 is encoded and written in the marker 23, the painting-like image data display control unit 86 sets (1) the insufficient data to Start the corresponding application. Then, by this application, (A) insufficient data corresponding to the marker is acquired (step S703).

  If it is “(b) Marker corresponding to pre-processed image data”, that is, if the processed image data is encoded and written in the marker 34, the painting-like image data display control unit 86 (2) The application corresponding to the pre-processing image data is activated. Then, by this application, (B) pre-processing image data corresponding to the marker is acquired (step S704).

  Further, in the case of “(c) a marker corresponding to another processed image data”, that is, in the case where (the processed image data different from b is encoded and written in the marker 34), the painting-like image The data display control unit 86 activates (3) an application corresponding to another processed image data, and (C) acquires another pre-processing image data corresponding to the marker (S705).

  Thereafter, after removing the marker from the image including the marker displayed on the display unit 31 by photographing with the camera 81, the image from which the marker is removed, and the image acquired in any of steps S703 to 705 Are matched (step S706). At this time, the image displayed on the display unit 31 by photographing with the camera 81 is not necessarily photographed from the front due to the influence of the photographing angle of the terminal 1-1 at the time of photographing. S707). Thereafter, it is synthesized with the video on the display unit 31 (step S708) and displayed on the display unit 31 of the terminal 1-1 (step S709). As a result, the user can view the entire image 33 from which the marker 34 made of the processed image on the main part 24 is removed on the display unit 31 of the terminal 1-1.

[Third Embodiment]
FIG. 14 is a diagram illustrating an internal flow of the terminal according to the third embodiment of the present invention. The third embodiment is different from the second embodiment described above, and the marker cannot be restored to deficient data, pre-processing image data, or other pre-processing image data on the terminal 1 side. It can be restored only on the image service site 10 side.

Therefore, the user takes an image 33 including the marker 23 printed on the print medium 20 by the camera 81 included in the terminal 1-1. Then, the terminal 1-1 reads a marker present in the image of the printed matter 25 by the camera 81 (step S801). Then, it is determined whether this marker means one of the following (a), (b), and (c) (step S802).
(A) Marker corresponding to deficient data (b) Marker corresponding to pre-processed image data (c) Marker corresponding to another processed image data

  In the case of “(a) marker corresponding to insufficient data”, the insufficient data is acquired from the link destination of the server 11 designated by the marker (step S803). If “(b) corresponds to pre-processing image data”, the pre-processing image data is acquired from the link destination of the server 11 designated by the marker (S704), and “(c) another processing is performed”. If “corresponds to processed image data”, another pre-processed image data is acquired from the link destination of the server 11 designated by the marker corresponding to the other processed image data (step S805).

  After that, after removing the marker from the image including the marker displayed on the display unit 31 by photographing with the camera 81, the image from which the marker is removed, and the image acquired in any of steps S803 to 705 Are matched (step S806). At this time, the image displayed on the display unit 31 by photographing with the camera 81 is not necessarily photographed from the front due to the influence of the photographing angle of the terminal 1-1 at the time of photographing. S807). Thereafter, the video is synthesized with the video on the display unit 31 (step S808) and displayed on the display unit 31 of the terminal 1-1 (step S809). As a result, the user can view the entire image 33 from which the marker 34 made of the processed image on the main part 24 is removed on the display unit 31 of the terminal 1-1.

  As described above, the user can see and confirm an image that has been pictorially converted into various painting styles with a simple operation while preventing the copy of the work with the marker. In addition, it is possible to confirm and order a print of painting-like image data having a favorite painting tone. Furthermore, it is possible to select a print medium such as a mug or a T-shirt, or to select a frame.

  It is simple because the image from which the marker has been removed can be viewed simply by reading the marker present in the painting-like image data for which the user has ordered the print. At that time, since cooperation with the image service site occurs, as a secondary effect, the opportunity to access the website increases, and guidance to the website and improvement of recognition can be expected.

  In the above embodiment, a QR code (registered trademark) is used as a marker. However, the present invention is not limited to this, and a two-dimensional barcode or a one-dimensional barcode may be used. In a template such as a round shape, a square shape, or a star shape. Markers may be inserted.

  The example of hard printing on paper, mugs, T-shirts, etc. has been explained, but even if a work whose main part is hidden with a marker is displayed on a display medium such as liquid crystal, EL, or electronic paper (soft print) ) The same effect can be obtained. For example, a work whose main part is hidden with a marker is displayed on the screen of a personal computer, and the entire image of the work with the marker disappeared can be displayed on the viewer by reading the marker with the camera of the viewer.

  Although FIG. 7 shows an example in which image data display and operation menu display are performed simultaneously, it is needless to say that full operation menu display may be used.

  In addition, the link between the terminal 1-1 and the server 11 is controlled by the server 11 so that the link control program of the server 11 operates, but the application program is downloaded and installed in the terminal 1-1, You may make it operate | move by a terminal main body.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to these, The invention described in the claim and its equal range are included.

  The invention described in the claims of the present application will be added below.

<Claim 1>
An image processing system including a terminal and a server connected to the terminal via a network,
The terminal
Reading means for reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
Connection means for connecting to the server based on information indicated by the marker read by the reading means;
Obtaining means for obtaining image data that displays the image without the mask by the marker from the server connected by the connection means;
Display means for displaying an image without the mask by the marker based on the image data acquired by the acquisition means;
The server
Storage means for storing image data for displaying an image without a mask by the marker;
Image data supply means for reading the image data from the storage means and supplying the image data to the acquisition means of the terminal;
An image processing system comprising:

<Claim 2>
The image data supply means of the server supplies image data for displaying an image without a mask by the marker in a size corresponding to the size of the display means of the terminal to the acquisition means of the terminal. The image processing system according to claim 1.

<Claim 3>
First display control means for displaying an image on the display unit and displaying a marker so as to mask a part of the image;
Reading means for reading the marker displayed on the display unit by the first display control means;
Based on information indicated by the marker read by the reading means, second display control means for causing the display unit to display an image that is an image without a mask by the marker;
An image processing apparatus comprising:

<Claim 4>
Reading means for reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
Based on information indicated by the marker read by the reading means, display control means for displaying on the display unit an image that is the image and has no mask by the marker;
An image processing apparatus comprising:

<Claim 5>
The reading unit includes an imaging unit that captures the image partially masked by the marker,
The display control unit displays an image picked up from the printed matter by the image pickup unit on the display unit, and then processes the displayed image to display an image without a mask by the marker on the display unit. The image processing apparatus according to claim 4, wherein:

<Claim 6>
5. The image processing according to claim 3, further comprising a download unit that downloads, from a server, image data for displaying an image without a mask by the marker displayed on the display unit by the second display control unit. apparatus.

<Claim 7>
Reading means for reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
Display control means for displaying on the display unit an image which is the image and has no mask by the marker based on information indicated by the marker read by the reading means;
The marker includes partial image data for displaying a part of the masked image,
The display control means includes
Restoring means for displaying an image captured from the printed matter on a display unit and restoring a part of the masked image based on the marker;
Interpolating means for interpolating a portion from which the marker of the image displayed on the display means is removed by a partial image based on the partial image data restored by the restoring means;
An image processing apparatus comprising:

<Claim 8>
An image processing method using a terminal and a server connected via a network,
The terminal includes
A reading step of reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
A connection step of connecting to the server based on the information indicated by the marker read by the reading step;
An acquisition step of acquiring image data for displaying the image and an image without a mask by the marker from the server connected by the connection;
Based on the image data acquired by the acquisition step, a display step of displaying an image without a mask by the marker is executed,
The server includes
An image data supply step of reading the image data from a storage unit storing image data for displaying an image without a mask by the marker, and supplying the image data to the acquisition step of the terminal;
An image processing method characterized in that

<Claim 9>
A first display control step of displaying an image on the display unit and displaying a marker so as to mask a part of the image;
A reading step of reading the marker displayed on the display unit by the first display control step;
A second display control step for displaying on the display unit an image that is the image and is not masked by the marker, based on information indicated by the marker read by the reading step;
An image processing method comprising:

<Claim 10>
A reading step of reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
Based on the information indicated by the marker read by the reading step, a display control step for causing the display unit to display an image without the mask by the marker,
An image processing method comprising:

<Claim 11>
A reading step of reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
A display control step of displaying on the display unit an image that is the image and has no mask by the marker based on information indicated by the marker read by the reading step,
The marker includes partial image data for displaying a part of the masked image,
The display control step includes:
A restoration step of displaying an image captured from the printed matter on a display unit and restoring a part of the masked image based on the marker;
A matching step of matching and interpolating a partial image based on the partial image data restored by the restoration step with a portion from which the marker of the image displayed in the display step is removed;
An image processing method comprising:

<Claim 12>
A computer-readable program executed by a computer included in an image processing apparatus,
The computer,
First display control means for displaying an image on the display unit and displaying a marker so as to mask a part of the image;
Reading means for reading the marker displayed on the display unit by the first display means control means;
Based on information indicated by the marker read by the reading means, second display control means for causing the display unit to display an image that is an image without a mask by the marker;
An image processing program characterized by being made to function.

<Claim 13>
A computer-readable program executed by a computer included in an image processing apparatus,
The computer,
Reading means for reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
Based on information indicated by the marker read by the reading means, display control means for displaying on the display unit an image that is the image and has no mask by the marker;
An image processing program comprising:

<Claim 14>
A computer-readable program executed by a computer included in an image processing apparatus,
The computer,
Reading means for reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
Display control means for displaying on the display unit an image which is the image and has no mask by the marker based on information indicated by the marker read by the reading means;
The marker includes partial image data for displaying a part of the masked image,
The display control means includes
Restoring means for displaying an image captured from the printed matter on a display unit and restoring a part of the masked image based on the marker;
A matching means for matching and interpolating a partial image based on the partial image data restored by the restoration means with a portion from which the marker of the image displayed on the display means is removed;
An image processing program characterized by being made to function.

<Claim 15>
The image is printed, and a marker is printed so as to mask a part of the image,
The printed matter, wherein the marker includes connection information for connecting the terminal to a server storing image data for displaying an image without a mask by the marker.

<Claim 16>
The image is printed, and a marker is printed so as to mask a part of the image,
The printed matter, wherein the marker includes information that causes the display unit to display an image that is the image and is not masked by the marker.

<Claim 17>
The image is printed, and a marker is printed so as to mask a part of the image,
When the image partially masked by the marker is captured, the marker displays the captured image on a display unit, and then processes the displayed image to mask the marker. Printed material characterized in that it contains information for displaying an image without any image on the display unit.

<Claim 18>
The printed matter according to claim 16, wherein the marker includes download information for downloading a work as an original image corresponding to an image without a mask by the marker from a predetermined server.

1 terminal 11 server 12 printing device 13 original image data storage unit 14 painting-like image data storage unit 15 link control program storage unit 16 painting conversion program storage unit 17 print control program storage unit 18 marker control program storage unit 20 print medium 22 marker 23 Marker 24 Main part 25 Shortage data 25 Printed matter 31 Display part 32 Painting-like image 33 Image 34 Marker 81 Camera 82 Transmission part 83 Reception part 85 Menu display control part 86 Painting-like image data display control part 87 Link control part 331 Image data before processing

Claims (13)

An image processing system including a terminal and a server connected to the terminal via a network,
The terminal
Reading means for reading the markers that are masked part of the images,
Connection means for connecting to the server based on information indicated by the marker read by the reading means;
Determining means for determining the type of the marker;
An acquisition means for acquiring image data representing a part of the image masked by the marker, which is a type of image data according to a determination result by the determination means , from a server connected by the connection means;
The image processing system characterized in that it comprises a display means based on said image data acquired by the acquisition means, for displaying the image without the mask by the marker. The marker type includes a marker corresponding to the deficient data and a marker corresponding to the pre-processing image data,
When the determination result by the determination unit is a marker corresponding to insufficient data, the acquisition unit acquires the insufficient data, and when the determination result by the determination unit is a marker corresponding to pre-processing image data Acquires image data before processing a part of the image,
The terminal further includes display control means for performing processing for matching the image data acquired by the acquisition means with a part of the image masked by the marker and displaying an image without the mask by the marker on the display means. the image processing system according to claim 1, characterized in that it comprises. The server further includes image data supply means , and the image data supply means displays image data for displaying an image without a mask by the marker in a size corresponding to the size of the display means of the terminal. The image processing system according to claim 1, wherein the image processing system is supplied to an acquisition unit. Together to display an image on the display unit, and table示制control means Ru display the marker to mask a portion of the image,
Reading means for reading the marker displayed on the display unit by the front Symbol Table示制control means,
Discriminating means for discriminating the type of marker read by the reading means ;
If the discrimination result by the discrimination means is a marker corresponding to the deficient data, the deficiency data is acquired as image data representing a part of the image masked by the marker, and the discrimination result by the discrimination means is processed. If the marker corresponds to the previous image data, acquisition means for acquiring image data before processing a part of the image as image data representing a part of the image masked by the marker;
With
The display control unit performs processing for matching the image data acquired by the acquisition unit with a part of the image masked by the marker, and displays the image without the marker mask by the display unit. An image processing apparatus characterized by being displayed on the screen. When the determination result by the determination unit is a marker corresponding to insufficient data, the display control unit further performs projective transformation for matching the image displayed on the display unit with the insufficient data. Item 5. The image processing apparatus according to Item 4. Reading means for reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
Discriminating means for discriminating the type of marker read by the reading means ;
If the discrimination result by the discrimination means is a marker corresponding to the deficient data, the deficiency data is acquired as image data representing a part of the image masked by the marker, and the discrimination result by the discrimination means is processed. In the case of a marker corresponding to the previous image data, acquisition means for acquiring image data before processing a part of the image as image data representing a part of the image masked by the marker;
Display control means for performing processing for matching the image data acquired by the acquisition means with a part of the image masked by the marker, and displaying the image without the mask by the marker on a display unit; An image processing apparatus comprising: The image processing apparatus according to claim 4, wherein the insufficient data is encoded and written to the marker. The image processing apparatus according to claim 4, wherein the acquisition unit acquires the deficient data from a link destination designated by the marker. An image processing method using a terminal and a server connected via a network,
The terminal includes
A step reading reading markers are masked portion of images,
A connection step of connecting to the server based on the information indicated by the marker read by the reading step;
A determination step of determining the type of the marker;
An acquisition step of acquiring image data representing a part of the image masked by the marker, which is the type of image data according to the determination result of the determination step , from the server connected by the connection;
Image processing method characterized in that said obtaining, based on image data obtained by the step, Ru is executed and a display step of displaying an image without a mask by the marker. A first display control step of displaying an image on the display unit and displaying a marker so as to mask a part of the image;
A reading step of reading the marker displayed on the display unit by the first display control step;
A determination step of determining the type of marker read by the reading step ;
If the determination result in the determination step is a marker corresponding to the deficient data, the deficient data is acquired as image data representing a part of the image masked by the marker, and the determination result in the determination step is processed. In the case of a marker corresponding to the previous image data, an acquisition step of acquiring image data before processing a part of the image as image data representing a part of the image masked by the marker;
A process of matching the image data acquired in the acquisition step with a part of the image masked by the marker, and displaying the image that is not masked by the marker on the display unit. And a display control step . A reading step of reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
A determination step of determining the type of marker read by the reading step ;
If the determination result in the determination step is a marker corresponding to the deficient data, the deficient data is acquired as image data representing a part of the image masked by the marker, and the determination result in the determination step is processed. In the case of a marker corresponding to the previous image data, an acquisition step of acquiring image data before processing a part of the image as image data representing a part of the image masked by the marker;
A display control step of performing processing for matching the image data acquired in the acquisition step with a part of the image masked by the marker, and displaying the image without the mask by the marker on a display unit ; An image processing method comprising: A computer-readable program executed by a computer included in an image processing apparatus,
To the computer,
Together to display an image on the display unit, a first display control step of displaying a marker to mask a portion of the image,
A reading step of reading the marker displayed on the display unit by the first display control step ;
A determination step of determining the type of marker read by the reading step ;
If the determination result in the determination step is a marker corresponding to the deficient data, the deficient data is acquired as image data representing a part of the image masked by the marker, and the determination result in the determination step is processed. In the case of a marker corresponding to the previous image data, an acquisition step of acquiring image data before processing a part of the image as image data representing a part of the image masked by the marker;
A process of matching the image data acquired in the acquisition step with a part of the image masked by the marker, and displaying the image that is not masked by the marker on the display unit. Display control step and
An image processing program for executing A computer-readable program executed by a computer included in an image processing apparatus,
To the computer,
A reading step of reading the marker from a printed material on which an image is printed and the marker is printed so as to mask a part of the image;
A determination step of determining the type of marker read by the reading step ;
If the determination result in the determination step is a marker corresponding to the deficient data, the deficient data is acquired as image data representing a part of the image masked by the marker, and the determination result in the determination step is processed. In the case of a marker corresponding to the previous image data, an acquisition step of acquiring image data before processing a part of the image as image data representing a part of the image masked by the marker;
A display control step of performing processing for matching the image data acquired in the acquisition step with a part of the image masked by the marker, and displaying the image without the mask by the marker on a display unit;
An image processing program for executing

Images