JP2018190338A - Examination processing apparatus and print matter manufacturing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically examine a user image.SOLUTION: An examination processing apparatus according to the present invention has a receiving unit 11 for receiving a user image from a user terminal 7, and an examination processing unit 14 for examining the user image. The examination processing unit 14 determines whether or not the user image includes a person image. If it is determined that the person image is included, the examination processing unit determines whether or not the person image included in the user image is similar to any of the plurality of images and, if it is determined that the person image is similar to any of the plurality of images, then determines that a secondary examination is necessary.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an examination processing apparatus and a printed material production system.

  Conventionally, an image taken with a digital camera, a smartphone, or the like is uploaded and stored on a network. In addition, a service for printing an uploaded image to create a photo book, a poster, or the like is known (see, for example, Patent Document 1).

  In producing a photo book, a service provider performs a so-called examination for determining whether or not an image uploaded from a customer is an image suitable for the photo book. For example, in the examination, it is determined whether the image does not infringe copyright or portrait rights, does not violate public order and morals, or has no purpose of illegal resale.

  Conventionally, the inspection has been performed manually. For this reason, there has been a possibility that problems such as an increase in human costs and a delay in delivery of photo books accompanying a delay in examination work may occur with an increase in the number of photo book orders.

JP 2005-339214 A

  It is an object of the present invention to provide an examination processing device that automatically examines a user image and a printed material production system that produces a printed material obtained by printing the user image.

  An examination processing apparatus according to the present invention includes a receiving unit that receives a user image from a user terminal, and an examination processing unit that examines the user image, and the examination processing unit includes a person image in the user image. If a person image is included, a similarity determination is made between the person image included in the user image and a plurality of images, and the person image is included in the plurality of images. If it is similar to any of the above, it is determined that a secondary examination is necessary.

  In one aspect of the present invention, the image processing apparatus further includes a storage unit that stores a plurality of celebrity face images, and the examination processing unit performs a face detection process on the user image, and the detected face images and the plurality of celebrities The similarity with the face image is determined.

  In one aspect of the present invention, the examination processing unit determines that a secondary examination is necessary when a mark indicating copyright is detected from the user image.

  In one aspect of the present invention, the examination processing unit detects a skin exposure degree of the person image, and determines that a secondary examination is necessary when the skin exposure degree is a predetermined value or more.

  In one aspect of the present invention, an editing processing unit that receives an editing operation by a user and generates a print image using the user image, and an order processing unit that receives an order of a printed material for printing the printing image. In addition, the examination processing unit determines that a printed material can be produced when a person image is not included in the user image and when the included person image is not similar to the plurality of images.

  A print production system according to the present invention includes the above-described examination processing device, a printer that produces an image by printing the image for printing including the user image determined to be capable of producing the print production by the examination processing unit, and Is provided.

  According to the present invention, it is possible to perform an automatic examination of a user image and determine whether the image may be used for producing a printed matter or whether a secondary examination by an examiner is necessary. The examiner only needs to check the user images that were not determined to be printable by the automatic examination, and can reduce the number of images to be examined manually (visually), and the human cost for the examination The printed matter can be produced at an early stage.

It is a schematic diagram of a printed matter production system concerning an embodiment of the present invention. It is a figure which shows the structure and functional block of a server apparatus which concern on the embodiment. It is a figure which shows the example of the order information preserve | saved at a memory | storage part. It is a figure which shows the example of the image determination result preserve | saved at a memory | storage part. It is a flowchart explaining the examination process which concerns on the same embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  As shown in FIG. 1, the print production system according to the embodiment of the present invention includes a server device 1 and an examiner terminal 3. The server device 1 can communicate with the examiner terminal 3 and the user terminal 7 via a communication network such as the Internet. The server device 1 stores the user image uploaded from the user terminal 7.

  The user terminal 7 is a PC, a smartphone, a tablet terminal, or the like. The user image is, for example, an image taken by a user with a digital camera, a smartphone, or the like.

  The user performs an editing operation for combining the user image uploaded by the user with an editing item such as a favorite frame or stamp. The user selects an article and the number for printing the composite image (print image) created by the editing operation, selects a payment method, and completes the print order.

  When the server device 1 receives a print order from the user (user terminal 7), the server device 1 performs an examination process, and determines whether or not the user image included in the print image is an image that can be used for producing a printed material. To do. For example, the server device 1 determines whether the user image is an image that infringes copyright or portrait right.

  When the server apparatus 1 determines that the user image is a printable image, the server apparatus 1 transmits print data including print order details to the factory 5.

  If the print order includes a user image that the server apparatus 1 has not determined to be able to produce a printed material, the server apparatus 1 notifies the examiner terminal 3 of the determination result. The examiner operates the examiner terminal 3 to visually confirm the user image that the server apparatus 1 has not determined to be able to produce the printed material, and performs the examination. When the examiner determines that the image is appropriate, the server apparatus 1 transmits print data including the order contents to the factory 5.

  A printer (not shown) installed in the factory 5 performs a printing process based on the received print data, and prints a print image on a designated article to produce a printed matter 6. The printed matter 6 to be produced is a photograph, a poster, a calendar, a photo book, a batch, a mug, or the like. The printed matter produced at the factory 5 is delivered to the user.

  As described above, according to the present embodiment, the server device 1 performs the examination (primary examination) of the user image uploaded by the user, and the examiner is the user who is not determined to be able to produce the printed matter by the primary examination. You only need to check the image. Therefore, the number of images to be examined manually (visually) can be reduced, and even when there are a large number of print orders, the increase in human cost for the examination is suppressed, and the printed matter 6 can be used at an early stage by the user. Can be delivered to.

  Next, the configuration of the server device 1 will be described. In the following embodiment, an example in which a photo book is produced as the printed product 6 will be described. The server device 1 receives a user image from the user terminal 7, generates an image editing screen and transmits it to the user terminal 7, accepts an image editing operation and a photobook print order, performs a user image examination process, and edits Print data including image data for printing generated by the operation is transmitted to the factory 5.

  As illustrated in FIG. 2, the server device 1 includes a control unit 10, a storage unit M, and a communication unit 21. The control unit 10 is a central processing unit (CPU) that controls the entire server device 1. The control unit 10 implements various functions by reading and executing an operating system (OS) and application programs stored in the storage unit M.

  The storage unit M is a storage area for storing programs and data necessary for the control unit 10 to execute various processes, and a hard disk, a semiconductor memory, or the like is used. The storage unit M includes a template DB (database) 15, a user image DB 16, a print data DB 17, an order information DB 18, a celebrity image DB 19, and an image determination result DB 20.

  The template DB 15 is a storage area for storing templates. The template is an image to be combined with the user image, and includes a box for designating the arrangement position of the user image, an edit item such as a stamp and a background image.

  The celebrity image DB 19 is a storage area for storing facial images of celebrities such as sports players, actors, and talents, and celebrity image search results on the Internet.

  The control unit 10 includes a receiving unit 11, an editing processing unit 12, an order processing unit 13, and an examination processing unit 14. The receiving unit 11 receives user image data from the user terminal 7 using the communication unit 21 and stores the user image data in the user image DB 16. The control unit 10 may determine whether the image is suitable for printing from the resolution and data size of the user image received by the reception unit 11 and notify the user terminal 7 of the determination result.

  The editing processing unit 12 generates an editing screen capable of image editing such as processing for selecting a template or a user image, processing for placing the selected user image in a frame, processing for placing the selected stamp, and the like. 21 to the user terminal 7. The editing processing unit 12 receives an editing operation performed on the editing screen by the user using the user terminal 7, and generates a composite image (print image) in which a template, a user image, and the like are combined. Print data for photobook production including the generated print image data is stored in the print data DB 17.

  The order processing unit 13 receives an order from the user terminal 7 such as selection of an article to be printed with a print image and the number of prints 6 to be produced. In this example, the order processing unit 13 receives the number of photo book prints as a print order. If necessary, a payment unit (not shown) performs a payment process, and the print order is completed.

  When the print order is completed, the editing processing unit 12 or the order processing unit 13 stores, in the order information DB 18, information obtained by combining the order number of the print order and the image identification number of each image included in the photo book for which the print order has been placed. Store. FIG. 3 shows an example of the data structure of the order information DB 18. User information including the contact information of the user who placed the print order may be stored in the order information DB 18.

  The examination processing unit 14 examines each image included in the photo book that has been ordered for printing, and determines whether the image can be used for producing the photo book. In particular, in this embodiment, the examination processing unit 14 prevents illegal resale of a photo book using an image of a celebrity, or prevents an act of infringing copyright or portrait right such as distribution of a copyrighted work of another person. We conduct examination to do.

  The examination process by the examination processing unit 14 will be described using the flowchart shown in FIG.

  The examination processing unit 14 refers to the order information DB 18 and selects an image that has not yet been examined among images linked with the order number of the print order to be examined, and corresponds to the image identification number of the selected image. Image data to be retrieved is extracted from the user image DB 16 (step S1).

  The examination processing unit 14 detects whether a C mark indicating copyright, a mark indicating copyright, or a character string is displayed on the image to be examined (step S2). When a C mark, a mark indicating copyright, or a character string is displayed (step S3_Yes), it is determined that the image needs to be subjected to a secondary examination by the examiner because there is a possibility of an image infringing the copyright. (Step S9).

  When the C mark, the mark indicating copyright, and the character string are not displayed (step S3_No), the examination processing unit 14 detects whether or not a face image is included in the examination target image, and a person (person It is determined whether or not the image includes (image) (step S4). For the face detection, for example, a well-known technique can be used in which a difference between brightness and darkness such as eyes and a mouth is roughly analyzed from an image to detect a face-like portion and then a face-like portion is analyzed in detail. A ratio (skin exposure degree) of an area estimated to be skin in the image may be detected to determine whether or not a person image is included.

  When a person image is not included (step S5_No), there is no risk of infringement of a portrait right or the like, or the possibility of infringement is extremely low, and thus an image (print OK image) that may be used for photobook production. Determination is made (step S8).

  When the person image is included (step S5_Yes), the examination processing unit 14 searches the celebrity face image in the celebrity image DB 19 for an image similar to the face image extracted from the examination target image (step S6). ). For example, the degree of similarity of the face image is calculated by a known method, and a celebrity image having a similarity greater than or equal to a predetermined value is searched.

  If there is no similar celebrity image (step S7_No), there is no risk of infringement of portrait rights or the like (the possibility is extremely low), so it is determined that the image can be used for photobook production (step S8). .

  When a similar celebrity image is detected (step S7_Yes), there is a possibility that the image infringes on the portrait right or the like, and therefore, it is determined that the image needs a secondary examination by the examiner (step S9).

  Steps S1 to S9 are repeated until all user images included in the print order to be examined are examined (step S10). The examination processing unit 14 registers the determination result for each image in the image determination result DB 20. FIG. 4 shows an example of the data structure of the image determination result DB 20.

  When the examination processing unit 14 determines that all the user images included in the print order to be examined are images that can be used for the production of the photobook (step S11_Yes), the examination process is ended. Using the communication unit 21, the control unit 10 transmits the print data of the print order that has been reviewed to the factory 5.

  If the print order to be examined includes an image that is determined to require a secondary examination by the examiner (step S11_No), the control unit 10 uses the communication unit 21 to perform an image that requires a secondary examination. Is notified to the examiner terminal 3 (step S12).

  The examiner uses the examination terminal 3 to perform a visual secondary examination. For example, the image that is the secondary examination “necessary” is identified from the image determination result DB 20, and this image is displayed on the display to check whether there is a problem. The examiner inquires the user about the image acquisition route and the use of the photo book as necessary. When it is confirmed by the secondary examination that there is no problem, the server device 1 transmits print data to the factory 5.

  The image data providing apparatus 1 transmits to the factory 5 print data including a print image and order contents generated by the user's editing operation. In the factory 5, the image for printing is printed on photographic paper, bound, and a photo book is produced.

  As described above, according to the present embodiment, the server device 1 having a function as an examination processing device examines a user image uploaded by a user (primary examination). The examiner need only confirm images that have been determined to require secondary examination. Therefore, the number of images to be examined manually (visually) can be reduced, an increase in human cost for the examination can be suppressed, and a photo book can be produced early and delivered to the user.

  In the above embodiment, after the print order is completed, the examination processing unit 14 examines the user image. However, the examination may be performed in parallel with the user image editing operation (or before the image editing operation). . For example, when the user selects an image to be used for the photo book using the image editing screen and arranges it in the frame, the examination processing unit 14 performs the examination and displays the examination result on the editing screen. For example, a determination result such as “OK” or “similarity to celebrity (possible inquiry later)” is displayed on the editing screen for each image arranged in the frame. A check box for the user to check that the image is not a celebrity image may be displayed simultaneously on the image determined to be similar to the celebrity.

  The user can further reduce the number of images subject to the secondary examination by the examiner by changing the image judged to be “similar to celebrity” and placing a print order with all the images judged to be “OK”. it can.

  In the above embodiment, the server device 1 includes the celebrity image DB 19. However, the celebrity image DB 19 may be provided in a server device different from the server device 1. The examination processing unit 14 may search for similar celebrity images from the entire web.

  In the above embodiment, the server device 1 includes the examination processing unit 14. However, the communication unit 21 transfers the user image included in the print order to another server device, and the other server device performs primary examination (mark detection or It is also possible to determine whether the image is an image that can be used for producing a photo book or whether a secondary examination by an examiner is necessary. The communication unit 21 of the server device 1 receives a determination result from another server device. The server device 1 may transmit all user images to other server devices, or after performing mark detection or person image detection, only the user images determined to contain human images are included in the other server devices. May be sent to.

  For each user, the server device 1 may manage the history such as the number of images determined to require the secondary examination, the number of times the print order is canceled by the secondary examination, and the like. From the history, it is possible to determine whether or not the user has a high possibility of performing illegal resale or infringing copyright or portrait right.

  In the above embodiment, the secondary examination is performed when celebrity-like images are included. However, if the number of print orders is a small number of a predetermined number or less, there is not much fear of unauthorized resale, The print data 6 may be produced by transmitting the print data to the factory 5 without performing the examination.

  In the above embodiment, even if there is no similar celebrity image for a human image included in the user image, if the skin exposure level is equal to or greater than a predetermined value, there is a risk that it is contrary to public order and morals. You may determine with a required image.

  The secondary examination of the user image that the server apparatus 1 has not determined to be able to produce the printed material may be performed by an examination processing apparatus that is equipped with, for example, artificial intelligence and can perform a highly accurate examination process. The examiner may conduct an examination (tertiary examination) only for the user image that is not determined to be able to produce the printed material by the secondary examination.

  In the above-described embodiment, an example in which a print product 6 such as a photo book is produced using a user image has been described. However, the edited image data may be sold without producing the print product 6. It is also possible to provide a service for examining a user image and notifying the examination result.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 Server apparatus 3 Examiner terminal 5 Factory 6 Printed matter 7 User terminal 10 Control part 11 Reception part 12 Editing process part 13 Order process part 14 Examination process part 21 Communication part

Claims (6)

A receiving unit for receiving a user image from the user terminal;
An examination processing unit for examining the user image;
With
The examination processing unit determines whether or not a person image is included in the user image. If the person image is included, the person image included in the user image is classified into a plurality of images. An examination processing apparatus, wherein a judgment is made to determine that a secondary examination is necessary if the person image is similar to any one of the plurality of images. A storage unit for storing a plurality of celebrity face images;
The examination process according to claim 1, wherein the examination processing unit performs a face detection process on the user image, and performs similarity determination between the detected face image and the plurality of celebrity face images. apparatus.   The examination processing apparatus according to claim 1, wherein the examination processing unit determines that a secondary examination is necessary when a mark indicating copyright is detected from the user image.   The said examination process part detects the skin exposure degree of the said person image, and when the said skin exposure degree is more than predetermined value, it determines with a secondary examination being required, Any one of Claim 1 thru | or 3 characterized by the above-mentioned. The examination processing device described in Crab. An editing processing unit that accepts an editing operation by a user and generates a print image using the user image;
An order processing unit for accepting an order for a printed matter for printing the print image;
Further comprising
The examination processing unit determines that a print can be produced when a person image is not included in the user image and when the person image is not similar to the plurality of images. The examination processing apparatus according to claim 1. An examination processing apparatus according to claim 5;
A printer that prints the image for printing including the user image that is determined to be printable by the examination processing unit to create a printed material;
A print production system comprising:

Images