JP2017028531A - Image processing system, image processing method, image processing program, image processing device and control method and control program therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To confirm the large size print result of a captured image when ordering.SOLUTION: An image processing device includes an imaging section, an image storage section for storing the images captured by the imaging section, a print instruction input section for inputting a print instruction including the print size of an image, an enlarged image quality predicting section for predicting the image quality of the captured image enlarged to a large size, when the print size exceeds a predetermined size, and a notice section for notifying of the fact that a print instruction cannot be accepted, when the image quality of the enlarged image is below a threshold.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for printing a captured image.

  In the above technical field, Patent Document 1 discloses a technique in which image data captured by a user with a camera-equipped mobile phone is processed and printed by a server via the Internet. Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for determining whether characters can be resolved when printing a photographed document and displaying a recommended document frame to be printed.

JP 2004-179827 A JP2015-102915A

  However, in the technique described in the above document, for example, when a user orders a large print, the large print result of the captured image cannot be confirmed at the time of ordering.

  The objective of this invention is providing the technique which solves the above-mentioned subject.

In order to achieve the above object, an image processing apparatus according to the present invention provides:
Imaging means;
Image storage means for storing an image captured by the imaging means;
A print instruction input means for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction means for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size,
Informing means for informing that the print instruction is not accepted when the image quality of the enlarged image is below a threshold value;
Is provided.

In order to achieve the above object, a method for controlling an image processing apparatus according to the present invention includes:
An image accumulating step for accumulating an image captured by the imaging means;
A print instruction input step for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction step for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size;
A notification step of notifying that the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
including.

In order to achieve the above object, a control program for an image processing apparatus according to the present invention provides:
An image accumulating step for accumulating an image captured by the imaging means;
A print instruction input step for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction step for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size;
A notification step of notifying that the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
Is executed on the computer.

In order to achieve the above object, an image processing system according to the present invention provides:
Imaging means;
Image storage means for storing an image captured by the imaging means;
A print instruction input means for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction means for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size,
An informing means for informing that the print instruction is canceled and the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
Printing means for printing the captured image in the print size according to the print instruction when the print instruction is not canceled;
Is provided.

In order to achieve the above object, an image processing method according to the present invention includes:
An image accumulating step for accumulating an image captured by the imaging means;
A print instruction input step for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction step for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size;
A notification step of notifying that the print instruction is not accepted and the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
A printing step of printing the captured image in the print size according to the print instruction when the print instruction is not canceled;
including.

In order to achieve the above object, an image processing program according to the present invention provides:
A print instruction input step for inputting a print instruction including the print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction step for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size;
A notification step of notifying that the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
A transmission step of transmitting the captured image printed in the large size and the print instruction when the image quality of the enlarged image does not fall below a threshold;
Is executed on the computer.

  According to the present invention, it is possible to confirm a large-format print result of a captured image at the time of ordering.

1 is a block diagram illustrating a configuration of an image processing apparatus according to a first embodiment of the present invention. It is a figure which shows the process outline | summary in the image processing system containing the image processing apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows the operation | movement outline | summary 230 of the WEB application in the image processing system containing the image processing apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows the operation outline | summary of the image processing apparatus in the image processing system containing the image processing apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows the example of a display of the print size of the image processing apparatus in the image processing system containing the image processing apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the structure of the image processing system containing the image processing apparatus which concerns on 2nd Embodiment of this invention. It is a sequence diagram which shows the operation | movement procedure in the image processing system containing the image processing apparatus which concerns on 2nd Embodiment of this invention. It is a sequence diagram which shows the operation | movement procedure including member registration in the image processing system containing the image processing apparatus which concerns on 2nd Embodiment of this invention. It is a sequence diagram which shows the operation | movement procedure including the image editing process and order processing in the image processing system containing the image processing apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the function structure of the portable terminal as an image processing apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the photograph database which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the function structure of the web submission server which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the member database which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the large format database which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the template database which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the stamp database which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the order database which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the portable terminal as an image processing apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the resolution determination table which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the process sequence of the portable terminal as an image processing apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure of the print order process which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the WEB manuscript server concerning 2nd Embodiment of this invention. It is a flowchart which shows the process sequence of the WEB manuscript server concerning 2nd Embodiment of this invention. It is a figure which shows the display of the print size and arrangement | positioning in the image processing apparatus which concerns on 3rd Embodiment of this invention. It is a block diagram which shows the function structure of the portable terminal as an image processing apparatus which concerns on 3rd Embodiment of this invention. It is a block diagram which shows the function structure of the order size adjustment part which concerns on 3rd Embodiment of this invention. It is a figure which shows the structure of the superimposition control table which concerns on 3rd Embodiment of this invention. It is a flowchart which shows the process sequence of the portable terminal as an image processing apparatus which concerns on 3rd Embodiment of this invention. It is a figure which shows the projection of the large format print in the image processing apparatus which concerns on 4th Embodiment of this invention. It is a block diagram which shows the function structure of the portable terminal as an image processing apparatus which concerns on 4th Embodiment of this invention. It is a block diagram which shows the function structure of the order size projection control part which concerns on 4th Embodiment of this invention. It is a figure which shows the structure of the parameter generation table which concerns on 4th Embodiment of this invention. It is a flowchart which shows the process sequence of the portable terminal as an image processing apparatus which concerns on 4th Embodiment of this invention. It is a block diagram which shows the structure of the image processing system containing the image processing apparatus which concerns on 5th Embodiment of this invention. It is a sequence diagram which shows the operation | movement procedure in the image processing system containing the image processing apparatus which concerns on 5th Embodiment of this invention. It is a figure which shows the process outline | summary in the image processing system containing the image processing apparatus which concerns on 6th Embodiment of this invention. It is a figure which shows the other process outline | summary in the image processing system containing the image processing apparatus which concerns on 6th Embodiment of this invention. It is a block diagram which shows the function structure of the portable terminal as an image processing apparatus which concerns on 7th Embodiment of this invention.

  Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. However, the constituent elements described in the following embodiments are merely examples, and are not intended to limit the technical scope of the present invention only to them. Note that “large format print” in the present specification indicates, for example, a print having a size of “A2” or more which is a standard.

[First Embodiment]
An image processing apparatus 100 as a first embodiment of the present invention will be described with reference to FIG. The image processing apparatus 100 is an apparatus for ordering printing of captured images.

  As illustrated in FIG. 1, the image processing apparatus 100 includes an imaging unit 101, an image storage unit 102, a print instruction input unit 103, an enlarged image quality prediction unit 104, and a notification unit 105. The image storage unit 102 stores the images captured by the imaging unit 101. The print instruction input unit 103 inputs a print instruction including the print size of the captured image. When the print size is a large size exceeding a predetermined size, the enlarged image quality prediction unit 104 predicts the image quality of the enlarged image obtained by enlarging the captured image to the large size. The notification unit 105 notifies that the print instruction is not accepted when the image quality of the enlarged image is lower than the threshold value.

  According to the present embodiment, when the image quality of the enlarged image is predicted to be below the threshold value, it is notified that the print instruction for the large print is not accepted, so that the large print result of the captured image can be confirmed at the time of ordering.

[Second Embodiment]
Next, an image processing system including an image processing apparatus according to the second embodiment of the present invention will be described. When the image processing system according to the present embodiment determines that the image quality of the enlarged image is below the threshold due to the resolution of the captured image when enlarging the image captured by the portable terminal as the image processing device and placing an order for a large format print, Notify that the user's print instruction is not accepted. Further, when the user designates the size of the large-format print, the user is notified of the image quality of the enlarged image being lower than the threshold value, or the upper limit of the size and the standard of resolution. Further, even when confirming the order, it is confirmed whether or not the image quality of the enlarged image falls below the threshold so as not to cause waste due to the failure of large format printing.

《Image processing system》
Hereinafter, an overview of an image processing system including an image processing apparatus according to the present embodiment will be described with reference to FIGS. 2A to 4C. In the following description, a smartphone, which is a mobile terminal, is described as a representative image processing apparatus. However, the image processing apparatus is not limited to a mobile terminal such as a mobile phone, a tablet, or a notebook computer (Personal Computer), and may be a stand-alone PC. Can be applied in the same manner, and has the same effect.

(Outline of processing)
FIG. 2A is a diagram illustrating an outline of processing in the image processing system including the image processing apparatus 210 according to the present embodiment.

  In the present embodiment, a user prints a large-format print (for example, a poster print in FIG. 2A) from the smartphone 210 via a network with respect to an image (photograph) captured by a camera mounted on the smartphone 210 serving as an image processing apparatus. Are ordered from a WEB submission server that provides a WEB application. Upon receiving this order, a poster print 220 is made from the WEB submission server by the print store, and is provided to the user by delivery or receipt (hand delivery) to the user.

  In the present embodiment, when the user orders a large-format print, whether the image quality of the large-format print is within the allowable range is determined based on the resolution of the captured image, and the user is notified of the waste due to the failure of the large-format print. Is not caused.

  FIG. 2B is a diagram illustrating an operation outline 230 of the WEB application in the image processing system including the image processing apparatus 210 according to the present embodiment. In FIG. 2B, it is assumed that large format printing has already been instructed or that a large format WEB application has been started.

  In operation 231, the user selects a category of a template that decorates an image provided by the WEB application. Next, in operation 232, the user selects a desired template from a plurality of templates in the selected category. In operation 233, the user selects an image captured in advance or captures it in real time. Further, in the operation 233 ', a range desired to be printed from the captured image, for example, an object such as a person may be trimmed (cut out). At this point, the selected and downloaded template is synthesized or superimposed on the selected image or the image being captured and displayed on the display screen.

  Next, in operation 234, the user inputs a desired character to be added to the image or selects a stamp. At this point, the input characters and the selected and downloaded stamp are added to the image on which the template is synthesized or superimposed. In operation 235, the user instructs a print order.

  The operation procedure in FIG. 2B is an example, and the present invention is not limited to this. For example, in the present embodiment, whether or not large printing is possible is determined by selecting a print order image in operation 233 or setting a large size (not shown). And / or preferably when ordering a print for operation 235.

(Overview of image processing device operation)
FIG. 2C is a diagram illustrating an operation outline of the image processing apparatus 210 in the image processing system including the image processing apparatus 210 according to the present embodiment. In FIG. 2C, it is assumed that the membership registration for the WEB application of the print service has already been completed and a necessary application has been downloaded to the image processing apparatus 210.

  A “photo print” 210 a is selected from the application icons displayed on the screen of the image processing apparatus 210, and the WEB application of the print service is activated. A menu for selecting the type of photographic print is displayed on the screen of the image processing apparatus 210. In this example, the large format print 210b is selected. Next, a photo ID “def” 210c to be printed in large format is selected. Although not shown, an image being captured in real time may be selected as a large print target.

  At this time, it is determined whether or not the resolution of the photo ID “def” 210c (or the image being captured) is below the threshold. If the resolution of the image to be printed in large format is below the threshold, it is necessary for the message 210f that the large-sized print of the captured image cannot be accepted, or the upper limit of the large size that can be accepted by the resolution of the captured image or the desired large format The resolution of the captured image is displayed and notified to the user.

  On the other hand, if the resolution of the photo ID “def” 210c (or the image being captured) is not lower than the threshold value, the detailed order content 210d is input, and when there is an order instruction, the order information 210e is displayed to notify the user. Is done. As described above, when the detailed order content 210d is input or when the order is instructed, it is wasteful to check the image quality of the designated large format print due to the failure of the large format print. It is desirable not to cause

  FIG. 2D is a diagram illustrating a display example of the print size of the image processing apparatus 210 in the image processing system including the image processing apparatus 210 according to the present embodiment.

  The display example 210h of the print size in FIG. 2D is referred to, for example, when a large size is specified in the order content 210d in FIG. 2C. By displaying the graphic representing the large size in comparison with the model with the same magnification, it is possible to give the user a sense of the large size to be designated. That is, display control is performed so that a large-size image and a comparative image of a known size (person image in FIG. 2D) can be displayed on the display unit so as to be comparable.

(System configuration)
FIG. 3 is a block diagram illustrating a configuration of an image processing system 300 including the image processing apparatuses 211 to 21n according to the present embodiment.

  The image processing system 300 includes image processing apparatuses 211 to 21n, a WEB submission server 320, and print stores 331 to 33m, which are connected via a network 340. The image processing apparatuses 211 to 21n are user terminals including a smartphone 211, a tablet 212, a notebook PC 21i, a stand-alone PC 21n, and the like, and are not particularly limited. The WEB submission server 320 is a server that provides a WEB application of the photo print service of the present embodiment, and may be a unique server or a virtual server in the cloud. In the print stores 331 to 33m, printing devices capable of various types of processing are arranged, and the captured images are processed according to the print data received by the print data receiving devices from the image processing devices 211 to 21n via the WEB submission server 320. Print. In this example, the print stores 331 to 33m deliver large finished prints to the user or deliver them at the store.

(Operation sequence)
FIG. 4A is a sequence diagram illustrating an operation procedure in the image processing system 300 including the image processing apparatus 210 according to the present embodiment.

  In step S400, the image processing apparatuses 211 to 21n perform imaging processing using the mounted imaging unit (camera). The captured image is held in a database with metadata such as the date and time of image capture, the camera used, and the resolution.

  When the image processing apparatuses 211 to 21n desire the print service of the captured image according to the present embodiment, in step S401, the image processing apparatuses 211 to 21n access the WEB submission server 320 and activate the WEB application of the print service. In step S403, the image processing apparatuses 211 to 21n perform member registration processing on the WEB submission server 320 based on information input by the user. At the time of this member registration, the image processing apparatuses 211 to 21n download a program necessary for the WEB application of the print service. Then, an icon of the photo print application is displayed on the screens of the image processing apparatuses 211 to 21n.

  When the icon of the photo print application on the screen of the image processing apparatuses 211 to 21n is instructed, the image processing apparatuses 211 to 21n start print order processing in step S405. In this example, the order is a large format print. At this time, from the WEB submission server 320, in step S407, information on large size checking and information for image processing such as templates and stamps are downloaded to the image processing apparatuses 211 to 21n. In FIG. 4A, although shown in one step S407, it may be downloaded in a distributed manner.

  In step S409, the image processing apparatuses 211 to 21n check the resolution or the number of pixels of the captured image to be printed in the large format according to this embodiment. In the resolution check, for example, if the resolution is below a predetermined resolution (150 dpi), it is determined that large format printing is not possible. In addition, when the user specifies a large size, even if the resolution is not desirable, it is determined that large format printing is not possible. When the image processing apparatuses 211 to 21n include a main camera and a sub camera (in-camera, self-portrait camera), an image captured by the sub camera has a low resolution, and thus it is determined that large format printing is not possible. Furthermore, in addition to the determination of whether or not large-format printing is possible depending on the resolution, other conditions such as brightness and contrast of brightness, contrast, and saturation may be used as the determination conditions for whether or not large-format printing is possible.

  In step S411, the image processing apparatuses 211 to 21n perform image editing processing based on trimming of a desired range from the captured image and image processing information such as a template and a stamp downloaded in step S407. If the performance of the image processing apparatuses 211 to 21n is high, other complicated processing such as resolution conversion may be performed.

  In step S413, the image processing apparatuses 211 to 21n set details (number of sheets, surface processing, etc.) of the large format print, generate large format print information, and perform large format print order processing. In step S415, the WEB submission server 320 receives large format print information for ordering large format prints and holds the enlarged and processed images. In step S417, the web submission server 320 stores print images 331 to 33m designated by the user. Then, a large format print instruction is performed based on the large format print information.

  The print stores 331 to 33m that have received the large format print instruction print the enlarged and processed image in step S419, and deliver the large format print to the ordering user or deliver it at the store in step S421.

  FIG. 4B is a sequence diagram illustrating an operation procedure including member registration (S403) in the image processing system 300 including the image processing apparatus 210 according to the present embodiment. In FIG. 4B, description will be made centering on the transition of the display screen of the image processing apparatus 210 based on the WEB application.

  In member registration (S403), first, the menu of the top screen D450 is displayed. When member registration is selected, a member information setting screen D451 is displayed. When member information is input from the member registration input screen D452, it is acquired by a temporary member registration API (Application Programming Interface) of the WEB submission server 320. The screen changes to a member registration completion screen D453.

  The WEB submission server 320 transmits a member registration mail to the temporary member image processing apparatus 210. The image processing apparatus 210 receives the member registration mail (D454). When proceeding with registration, when a member registration URL (Uniform Resource Locator) added to the member registration mail is tapped (D455), the image processing apparatus 210 notifies the URL of the member registration and displays a member registration completion screen. (D456). The WEB submission server 320 confirms the notification of member registration to the URL destination, and performs registration processing of the main member.

  Once the member registration is completed, it is possible to connect to a large format WEB application by logging in next time. In login, when login is selected from the menu of the top screen D450, a login screen D461 is displayed. When a user ID or password is input from the login screen D461, it is acquired by the login API of the WEB submission server 320, and authentication and login processing are performed.

  An optional coupon service is also provided. In the coupon, when a coupon is selected from the menu of the top screen D450, a coupon screen D471 is displayed. When the QR code (registered trademark) is read on the reading screen D472 by the imaging unit (camera), it is acquired by the coupon registration API of the WEB submission server 320. A coupon list screen D473 is acquired by the coupon list acquisition API of the WEB submission server 320.

  FIG. 4C is a sequence diagram illustrating an operation procedure including an image editing process (S405 to S411) and an order process (S413 to S417) in the image processing system 300 including the image processing apparatus 210 according to the present embodiment. In FIG. 4C, description will be focused on the transition of the display screen of the image processing apparatus 210 based on the WEB application.

  In the image editing process (S405 to S411), first, the menu of the top screen D450 is displayed. When image editing is selected, a template screen D481 is displayed, and then a template selection screen D482 including a template category is displayed. Is done. When a category is selected from the template selection screen D482, a template file is downloaded from the WEB submission server 320, and a template download screen D483 including a template included in the selected category is displayed.

  Next, a photo file to be printed in large format is designated. The designated time (A) of this photo file is the first determination timing of whether or not large format printing is possible. In addition to the date and time of image capture, the camera used and the resolution are added to the photo file as metadata. In this example, whether or not large-format printing is possible is determined based on the used camera and resolution metadata. For example, if the camera used is a sub-camera (self-portrait camera), it is determined that large format printing is not possible because the resolution is low. Further, even if it is the main camera, when the resolution is lower than 150 dpi, for example, it is determined that the large format printing is not possible. Even if the resolution is 150 dpi or more, the image is blurred depending on the large size. Therefore, when the large size is set, it is determined again that the large format cannot be printed.

  If the designated photo file can be printed in large format, the desired range is trimmed from the captured image on the image editing screen D484 if necessary. At this time, it may be determined whether or not large format printing is possible based on the trimmed image. Next, processing using the template selected from the template download screen D483 is performed. Next, when it is desired to add a character, the character is input from the character input screen D485 and image editing is performed. If it is desired to add a stamp, a stamp image is requested from the stamp screen D486, a stamp file is downloaded from the WEB submission server 320, and a stamp download screen D487 including a plurality of stamps is displayed. Then, image editing is performed using the stamp selected from the stamp download screen D487.

  In the image editing screen D484, when the image editing is completed, an image editing confirmation screen D488 indicating the print state after the processing editing is displayed. When confirmation is instructed, an image editing completion screen D489 is displayed, and the image editing processing is completed.

  Subsequently, order processing (S413 to S417) of the image for which image editing has been completed is started. First, the size of the large print is selected on the size selection screen D490. Reference is made to a screen that gives the user the feeling of the large size of FIG. 2D when this size is selected. The selection point (B) of this size is the determination timing for whether or not large-format printing is possible. That is, since the actual size of the large format print is determined at this point, it is determined whether or not the determined large format print is possible. At this point, it may be determined whether or not large printing is possible based on the trimmed image. At the same time, a large size allowed from the resolution of the captured image and a resolution necessary to allow a desired large size are also acquired. Next, on the quantity / option selection screen D491, an option such as a large size quantity that can be printed or surface processing is selected.

  On the delivery method selection screen D492, at least two delivery methods are selected. One is selection of a store that performs printing and serves as a delivery source. A store list from the store list acquisition API of the WEB submission server 320 is displayed on the store selection screen D493, and a store is selected. The second is selection of a delivery destination (= ordering source). A delivery destination is selected and input from the delivery destination selection screen D494 from the delivery destination acquisition API of the WEB submission server 320, and is registered from the delivery destination registration screen D495. The delivery destination registered from the delivery destination registration screen D495 is registered by the delivery destination registration API of the WEB submission server 320.

  Next, a payment method selection screen D496 is displayed, and a payment method such as a card is selected. Then, final confirmation before ordering is performed on the order confirmation screen D497. This final confirmation time (C) is also the determination timing of whether or not large format printing is possible. The determination of whether or not large format printing is possible based on the trimmed image may be performed at this time. When final confirmation is made on the order confirmation screen D497, an order including large-format print information is registered in the order registration API of the WEB submission server 320, and the large-format print order is completed on the order completion screen D499. In the coupon processing as an option, the input of the coupon list screen D498 on the order confirmation screen D497 is acquired by the coupon list acquisition API of the WEB submission server 320.

<Functional configuration of mobile terminal>
FIG. 5 is a block diagram illustrating a functional configuration of the mobile terminal 210 as the image processing apparatus according to the present embodiment. The portable terminal 210 represents the image processing apparatuses 211 to 21n illustrated in FIG.

  The portable terminal 210 includes a communication control unit 501, a WEB application activation unit 502, a WEB application execution unit 503, a display unit 504, an operation unit 505, an imaging unit 506, and a photo database 507.

  The communication control unit 501 controls communication with the WEB submission server 320 and other devices via the network 340. The WEB application activation unit 502 activates the WEB application of the photo print service according to the present embodiment by connecting to the WEB submission server 320. A WEB application execution unit 503 executes a WEB application of the photo print service of the present embodiment. The display unit 504 displays an instruction to the user or a processing result. The operation unit 505 includes a touch panel and inputs a user operation. The imaging unit 506 is a camera, and may include, for example, a main camera installed on the side opposite to the display panel and a self-shooting sub camera installed on the display panel side. The photo database 507 accumulates the photographic images captured by the imaging unit 506 with metadata such as imaging date / time, imaging location, and resolution.

  Here, the WEB application execution unit 503 includes an order selection unit 531, a file reception unit 532, an order setting unit 533, an order determination unit 534, an image editing unit 535, and an order transmission unit 536. In the photo print service of this embodiment, the order selection unit 531 selects a large format print or a template or stamp for processing a photo image in accordance with a user instruction from the operation unit 505. The file receiving unit 532 downloads from the WEB submission server 320 a file such as a resolution threshold value when a large format print is selected, or a template or a stamp. The order setting unit 533 sets the details of the photo print order according to the user input from the operation unit 505. The order determination unit 534 determines whether or not large format printing is possible based on the resolution of the photographic image selected for large format printing, based on the resolution threshold received by the file reception unit 532. When the resolution of the photographic image is below the resolution threshold, it is determined that large printing is not possible, the printing instruction is stopped, and the display unit 504 notifies the user that large printing is not possible. When the order determination unit 534 permits large format printing, the image editing unit 535 edits and processes the photographic image selected for large format printing with a template or stamp that has been downloaded and selected by the user using the operation unit 505. Note that when the image editing unit 535 performs trimming of a desired range from the captured image, the order determination unit 534 determines whether large printing is possible for the trimmed image. The order transmission unit 536 transmits the photographic image edited by the user by the image editing unit 535 and the order information such as the order detail information, the order source information, and the print store information to the WEB submission server 320, and the large format print is displayed. Order.

(Photo database)
FIG. 6 is a diagram showing a configuration of the photo database 507 according to the present embodiment. The configuration of the photo database 507 is not limited to FIG.

  The photograph database 507 stores an imaging condition 604 and a captured image 605 in association with the imaging date / time 601, the imaging location 602, and the used camera 603. Note that by storing information associated with map information as the imaging location 602, it is possible to search the captured image 605 using the map information as a key. In this example, the camera 603 used is the main camera and the sub camera (self-portrait camera), but is not limited to this.

  Further, as an option, a large size permission / inhibition flag 606 indicating whether the captured image 605 can be printed in large size is stored. By storing the large size flag 606 in advance, it is possible to easily perform selection and determination of a captured image during large size printing. As shown in FIG. 6, when the camera 603 to be used is a sub camera, the resolution is relatively low at present, and the large size flag 606 may be set to be impossible.

<Functional configuration of WEB submission server>
FIG. 7 is a block diagram showing a functional configuration of the WEB submission server 320 according to the present embodiment.

  The WEB submission server 320 includes a communication control unit 701, a WEB application providing unit 702, a member database 703, an editing database 704, a file transmission unit 705, an order receiving unit 706, an order database 707, and a print instruction unit. 708.

  The communication control unit 701 controls communication with the mobile terminal 210 and other devices via the network 340. The WEB application providing unit 702 provides the mobile terminal 210 with a photographic image print service including large format prints. The member database 703 registers members who receive the print service. The editing database 704 stores information for editing a photographic image in a photographic image print service including large format prints. The file transmission unit 705 functions as a processing information providing unit that transmits information for editing a photographic image stored in the editing database 704 to the member's mobile terminal 210, including a resolution threshold value for determining whether large format printing is possible. The order receiving unit 706 receives a print order of a photographic image including a large print from the member's mobile terminal 210. The order database 707 holds print orders accepted by the order acceptance unit 706. The print instruction unit 708 sends a print order held in the order database 707 to a print store according to the user's instruction and issues a print instruction.

  Here, the editing database 704 includes a database for determining whether or not to allow large format printing (hereinafter also referred to as DB) 741, a template database 742 that stores a template for editing, and a stamp database 743 that stores a stamp for editing. ,including. Note that the plurality of databases in FIG. 7 may be integrated into one database or may be further finely divided.

(Member database)
FIG. 8A is a diagram showing a configuration of the member database 703 according to the present embodiment. Note that the configuration of the member database 703 is not limited to FIG. 8A.

  The member database 703 registers user information 802 in association with the user ID 801. The user information 802 includes confidential information such as a user name and password, attributes such as age / gender, and contact information such as an address, a telephone number, and an e-mail address. Moreover, a card number etc. may be included.

(Large-format database)
FIG. 8B is a diagram showing a configuration of a large format database 741 according to the present embodiment. Note that the configuration of the large format database 741 is not limited to FIG. 8B.

  The large format database 741 includes a large size resolution (number of pixels) 810 that stores a resolution threshold that enables large size printing, and a possible resolution (number of pixels) table 820 that stores a lower limit resolution at which each large size can be printed. And a dot number table 830 for storing the number of dots corresponding to each large size and resolution.

  In this example, 150 dpi is stored as the lower limit resolution 811 capable of large format printing and 8 million pixels are stored as the lower limit pixel number 812 in the large resolution (number of pixels) 810. However, the present invention is not limited to this value. . The possible resolution (number of pixels) table 820 stores a possible resolution (number of pixels) 822 that is the lower limit resolution or the number of pixels that can be printed, corresponding to each large size 821. The dot number table 830 stores, for example, the number of dots 832 in the case of 300 dpi and the number of dots 833 in the case of 150 dpi corresponding to the size value 831 of each large size.

  In the present embodiment, 150 million dpi of the lower limit resolution 811 or 8 million pixels of the lower limit pixel number 812 is used to determine whether large-format printing is possible, particularly at the timing of the photo file designation (A) in FIG. 4C. . Further, each possible resolution 822 of the possible resolution table 820 determines whether or not large format printing is possible especially when a large size is selected at the timing of the size selection screen (B) in FIG. It is also used to propose large size and resolution to the user.

  In this example, large-format printing from A2 to B0 is possible if it is 150 dpi or more (8 million pixels or more), but 300 dpi (16 million pixels or more) is required if it is larger than B0. Note that there are various conditions other than the resolution and the number of pixels in the determination of the image quality of large format prints, and determination may be made in consideration of these conditions.

(Template database)
FIG. 8C is a diagram showing a configuration of the template database 742 according to the present embodiment. The configuration of the template database 742 is not limited to FIG. 8C. FIG. 8C shows a database configuration 840 and a template editing operation 850.

  The database configuration 840 stores a template image 842 in association with the template type (category) 841.

  In template editing operation 850, template category selection 851 is first performed, and template selections 852 to 854 from a plurality of templates downloaded in accordance with category selection 851 are performed, and a photographic image is edited with the selected template. Is done.

(Stamp database)
FIG. 8D is a diagram showing a configuration of the stamp database 743 according to the present embodiment. The configuration of the stamp database 743 is not limited to FIG. 8D. FIG. 8D shows a database configuration 860 and a series of template and stamp editing operations 870.

  The database configuration 860 stores a stamp image 862 in association with a stamp type (category) 861.

  In template and stamp editing operation 870, template download 871 and template selection and editing 872 are first performed, and then stamp download 873 and stamp selection and editing 874 are performed.

(Order database)
FIG. 8E is a diagram showing a configuration of the order database 707 according to the present embodiment. Note that the configuration of the order database 707 is not limited to FIG. 8E.

  The order database 707 is associated with the order date and time 881, the order image 882, the order type 883, the number of orders 884, the charge 885, the order source information 886, the print destination store information 887, the scheduled finish date and time 888, and delivery or receipt The flag 889 is stored.

<< Hardware configuration of mobile terminal >>
FIG. 9 is a block diagram illustrating a hardware configuration of the mobile terminal 210 as the image processing apparatus according to the present embodiment.

  In FIG. 9, a CPU (Central Processing Unit) 910 is a processor for arithmetic control, and implements the functional components shown in FIG. 5 by executing a program. A ROM (Read Only Memory) 920 stores fixed data and programs such as initial data and programs. The communication control unit 501 controls communication with the WEB submission server 320 and other devices via the network 340.

  A RAM (Random Access Memory) 940 is a random access memory used by the CPU 910 as a work area for temporary storage. In the RAM 940, an area for storing data necessary for realizing the present embodiment is secured. The active application 941 is an application currently active on the mobile terminal 210. The member registration information 942 is member information stored at the time of member registration or login. The print selection information 943 is information for selecting a print service including large format prints. Note that if the print service application is dedicated to large format printing, the print selection information 943 may be omitted. The image data 944 is data of an image that is selected from the photo database 507 and is printed in large format. The resolution determination table 945 is a table for determining whether large printing is possible in large printing. The image editing data 946 is data for image editing downloaded from the WEB submission server 320 such as a template or a stamp. The edited image data 947 is a photographic image edited by the image editing data 946. The input / output data 948 stores data input / output by the input / output device via the input / output interface 960. The transmission / reception data 949 stores data to be transmitted / received to / from the WEB submission server 320 via the communication control unit 701.

  The storage 950 stores a database, various parameters, or the following data or programs necessary for realizing the present embodiment. The photograph database 507 is a database for storing the photographed photograph image shown in FIG. The large format print threshold value 951 is a threshold value used for determining whether or not large format printing downloaded from the WEB submission server 320 is possible. The template data 952 is template data downloaded from the WEB submission server 320. The stamp data 953 is stamp data downloaded from the WEB submission server 320. The storage 950 stores the following programs. The portable terminal control program 954 is a program that controls the entire portable terminal 210. The print order application 955 is a program corresponding to the print order WEB application provided by the WEB submission server 320. The print order application 955 includes a member registration module, a large format order module, a resolution determination module, a user notification module, an image editing module, and the like.

  The input / output interface 960 performs an interface for controlling data input / output with the input / output device. In the present embodiment, a display unit 504, an operation unit 505, and an imaging unit 506 are connected to the input / output interface 960. The input / output interface 960 is further connected to a voice input / output unit 961, a GPS position calculation unit 962, and the like.

  Note that the RAM 940 and the storage 950 in FIG. 9 do not show programs and data related to general-purpose functions and other realizable functions of the mobile terminal 210.

(Resolution judgment table)
FIG. 10 is a diagram showing a configuration of the resolution determination table 945 according to the present embodiment. The resolution determination table 945 is used to determine whether or not the resolution of the photographic image selected as the large print target is large print.

  The resolution determination table 945 is associated with the designated image 1001 of the large format print, the resolution 1002, the trimming information 1003 indicating the trimming area, the large format print availability result 1004 compared with the resolution threshold, and the optional user notification data 1005. , Remember.

《Handling procedure of mobile device》
FIG. 11A is a flowchart illustrating a processing procedure of the mobile terminal 210 as the image processing apparatus according to the present embodiment. This flowchart is executed by the CPU 910 in FIG. 9 using the RAM 940, and implements the functional configuration unit in FIG.

  In step S <b> 1111, the mobile terminal 210 determines whether or not imaging by the camera has been performed. If the image is taken by the camera, in step S1113, metadata such as date / time, location, resolution, and device type is added to the taken image. In step S1115, the portable terminal 210 stores the captured image in the photograph database 507 so that the captured image can be searched.

  If the image is not captured by the camera, the portable terminal 210 determines in step S1121 whether or not it is registered as a member of the print service for the captured image. In the case of member registration, the portable terminal 210 inputs and transmits user information in step S1123. In step S <b> 1125, the portable terminal 210 waits for the download of the print service WEB application. When the downloading of the WEB application is completed, the portable terminal 210 stores the WEB application in the storage 950 and displays an icon on the display unit 504 in step S1127.

  If the image is not captured by the camera and is not a member registration, the portable terminal 210 determines whether or not the print application is activated (whether or not it is an icon instruction) in step S1131. If the print application is to be activated, the portable terminal 210 selects a print output method such as large format printing in step S1133. Next, the portable terminal 210 selects a photographic image to be printed from the photographic database 507 in step S1135. In step S <b> 1137, the portable terminal 210 executes a print order process including a large-format print availability determination.

(Print order processing)
FIG. 11B is a flowchart illustrating the procedure of the print order process (S1137) according to the present embodiment.

  In step S1141, the portable terminal 210 determines whether or not the user's instruction is large format printing. If the print is not large format, the portable terminal 210 performs another print process in step S1161.

  If the print is large format, the portable terminal 210 determines in step S1143 whether the resolution of the target image is below a resolution threshold (150 dpi in this example). If the resolution of the target image is equal to or higher than the resolution threshold, the portable terminal 210 performs trimming of a desired range from the target image and editing processing such as a template and a stamp on the target image in step S1144. Next, in step S1145, the portable terminal 210 sets details of the print order contents of the edited image. In step S1147, the portable terminal 210 determines whether or not the resolution of the target image is lower than the lower limit resolution corresponding to the set size of the large-format print. If the resolution is lower than the lower limit resolution, the portable terminal 210 notifies the user that printing is not possible and instructs the user to change the large size in step S1149.

  In step S1151, the portable terminal 210 transmits a print order based on the large format print information to the WEB submission server 320. In step S1153, the portable terminal 210 waits for a reply to receipt of the print order from the WEB submission server 320, and when receiving the print order receipt, notifies the user of completion of the print order in step S1155. On the other hand, when the resolution of the target image is lower than the resolution threshold value in step S1143, the portable terminal 210 notifies the user that the large-format print cannot be ordered in step S1157. Note that, as an option, the portable terminal 210 may propose to the user a resolution change or a large size change that enables large format printing in step S1159.

<< Hardware configuration of WEB submission server >>
FIG. 12 is a block diagram showing a hardware configuration of the WEB submission server 320 according to the present embodiment.

  In FIG. 12, a CPU 1210 is a processor for arithmetic control, and implements the functional component of FIG. 7 by executing a program. The ROM 1220 stores fixed data and programs such as initial data and programs. The communication control unit 701 controls communication with the mobile terminal 210 and other devices via the network 340.

  The RAM 1240 is a random access memory that the CPU 1210 uses as a work area for temporary storage. The RAM 1240 has an area for storing data necessary for realizing the present embodiment. The member information 1241 is information for member registration received from the mobile terminal 210. The template / stamp information 1242 is information on a template image and a stamp image provided to the mobile terminal 210 that orders the print service. The print order information 1243 is an image and information of a print order including a large format print received from the mobile terminal 210. The print instruction information 1244 is print instruction information including an image and order information for the print stores 331 to 33m designated by the user. The transmission / reception data 1245 stores data to be transmitted / received via the communication control unit 701.

  The storage 1250 stores a database, various parameters, or the following data or programs necessary for realizing the present embodiment. The editing database 704 is a database that stores resolution determination and editing data. The editing database 704 includes a large format database 741 (see FIG. 8B), a template database 742 (see FIG. 8C), and a stamp database 743 (see FIG. 8D). The member database 703 stores member registration as shown in FIG. 8A. The order database 707 stores print orders from the portable terminal 210 as shown in FIG. 8E. The storage 1250 stores the following programs. The WEB submission server control program 1251 is a program for controlling the entire WEB submission server 320. The member registration module 1252 is a module that executes member registration from the mobile terminal 210. The order receiving module 1253 is a module that receives a print order from the portable terminal 210 and holds it in the order database 707. The print instruction module 1254 is a module for instructing printing by transmitting a print order received from the portable terminal 210 to a print store designated by the user.

  Note that the RAM 1240 and storage 1250 in FIG. 12 do not show programs and data related to general-purpose functions and other realizable functions of each server.

<< Processing procedure of WEB submission server >>
FIG. 13 is a flowchart showing a processing procedure of the WEB submission server 320 according to the present embodiment. This flowchart is executed by the CPU 1210 of FIG. 12 using the RAM 1240, and implements the functional configuration unit of FIG.

  In step S1311, the WEB submission server 320 determines whether or not it is a registration request for the WEB application. If the request is a registration request, the WEB submission server 320 performs member registration processing in step S1313. When the member registration is completed, the WEB submission server 320 downloads a program executed by the communication terminal 210 in the WEB application in step S1315.

  If it is not a registration request, the WEB submission server 320 determines in step S1321 whether or not it is a print order. If it is a print order, the WEB submission server 320 transmits an image editing file including a resolution threshold value, a template image, and a stamp image to the portable terminal 210 in step S1323. In step S <b> 1325, the WEB submission server 320 receives print order information including an image that has been determined to have a large size and has been edited from the portable terminal 210. In step S1327, the WEB submission server 320 transmits print order information to the print destination store designated by the user and instructs printing.

  If the print order is not a registration request, the WEB submission server 320 performs other processing in step S1331.

  According to the present embodiment, when the resolution of the captured image is below the threshold value, it is notified that the printing instruction for the large format print is not accepted, so that the large format print result of the captured image can be confirmed at the time of ordering by a simple procedure. . In addition, if the user specifies the size of the large format print, the image quality of the enlarged image falls below the threshold value, or the user is notified of the upper limit of the size and the approximate resolution. Since it is confirmed whether the image quality does not fall below the threshold value, waste due to failure of large format printing is not caused.

[Third Embodiment]
Next, an image processing system including an image processing apparatus according to the third embodiment of the present invention will be described. The image processing system according to the present embodiment is different from the second embodiment in that the user can confirm whether the size and arrangement position of the large format print are appropriate at the time of ordering. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

<Display of print size and layout>
FIG. 14 is a diagram showing a display of print size and arrangement in the image processing apparatus 1410 according to the present embodiment.

  FIG. 14 shows an example of a display in which the image processing apparatus 1410 superimposes a large-format print image on the image being captured by the main camera in the present embodiment. In FIG. 14A, an image in which a desired large format image 1410a is superimposed on the target 1412 in the captured image by imaging in the A direction is displayed on the screen of the image processing device 1410. In FIG. 14B, an image in which a desired large-size image 1410b is superimposed around the target 1411 in the captured image by imaging in the B direction is displayed on the screen of the image processing device 1410. In (C) of FIG. 14, an image in which a desired large format image 1410b is superimposed around the target 1411 in the captured image by imaging in the C direction is displayed on the screen of the image processing apparatus 1410 whose orientation is changed to landscape. Has been.

  As the target 1411 or 1412, a business card or other known size is used. The goal is not limited to business cards. It is sufficient that the size is known and easy to handle. In FIG. 14, the target 1411 or 1412 is the center of the large format image, but the image may be aligned with other positions such as corners. Further, the large size image may be an image only showing the size or an image actually printed in large format.

<Functional configuration of mobile terminal>
FIG. 15A is a block diagram illustrating a functional configuration of a mobile terminal 1410 as an image processing apparatus according to the present embodiment. In FIG. 15A, the same functional components as those in FIG.

  The WEB application execution unit 1503 includes an order size adjustment unit 1537 in addition to the WEB application execution unit 503 in FIG. The order size adjustment unit 1537 superimposes the large size of the large print order on the image being picked up by the image pickup unit 506 and displays it on the display unit 504 so that the impression when the large size is actually arranged can be known in advance. Can do. If an image of a large size is used as a target image, an impression such as a color can be known in advance. The order size adjustment unit 1537 can select and adjust the large size by the operation unit 505 while viewing the display unit 504 that displays the large size in a superimposed manner.

(Order size adjustment section)
FIG. 15B is a block diagram illustrating a functional configuration of the order size adjustment unit 1537 according to the present embodiment.

  The order size adjustment unit 1537 includes a captured image acquisition unit 1571, a target extraction unit 1572, an order size image acquisition unit 1573, an image superimposition unit 1574, and a superimposed image output unit 1575.

  The captured image acquisition unit 1571 acquires the video imaged by the imaging unit 506. The target extraction unit 1572 extracts the targets 1411 and 1412 shown in FIG. 14 from the video acquired by the captured image acquisition unit 1571. The order size image acquisition unit 1573 acquires an image of the order size set by the order setting unit 533. The image superimposing unit 1574 has a superimposition control table 1574a, and superimposes an image of an order size that is aligned and aligned with the target of the captured image on the captured image. The superimposed image output unit 1575 outputs and displays the superimposed image on the display unit 504.

(Superimposition control table)
FIG. 16 is a diagram showing a configuration of the superposition control table 1574a according to the present embodiment. The superimposition control table 1574a is used to superimpose an image of an order size that is aligned and aligned with the target of the captured image on the captured image.

  The superimposition control table 1574a includes a captured image 1601, a target extraction result 1602 extracted from the captured image, an order size 1603, an order size image 1604 that matches the target size based on the order size 1603, a superimposed image 1605, Are stored in association with each other. Here, the target extraction result 1602 includes a target position and a target size.

《Handling procedure of mobile device》
FIG. 17 is a flowchart illustrating a processing procedure of the mobile terminal 1410 as the image processing apparatus according to the present embodiment. This flowchart is executed by the CPU 910 in FIG. 9 using the RAM 940, and implements the functional components shown in FIGS. 15A and 15B. Note that this flowchart may be incorporated in FIG. 11A or FIG. 11B.

  The portable terminal 1410 acquires a video from the imaging unit 506 in step S1701. In step S1703, the mobile terminal 1410 extracts a target from the captured video. In step S1705, the portable terminal 1410 calculates a target position and a target size from the extracted target. In step S1707, the portable terminal 1410 generates an image corresponding to the order size. Note that the image corresponding to the order size is adjusted to the size corresponding to the target size. In step S1709, the portable terminal 1410 superimposes an image of the order size whose size has been adjusted with the target position in the captured image as a mark. In step S <b> 1711, the mobile terminal 1410 displays a superimposed image obtained by superimposing an order-size image on the captured video on the display unit 504. In step S1713, the portable terminal 1410 determines whether or not it is an instruction to end the superimposed display. If not, the process returns to step S1701.

  According to the present embodiment, whether or not the size and arrangement of the large format print are appropriate can be confirmed on the screen at the time of ordering, and waste due to the failure of the large format print is not caused.

[Fourth Embodiment]
Next, an image processing system including an image processing apparatus according to the fourth embodiment of the present invention will be described. The image processing system according to the present embodiment is different from the third embodiment in that a large-size print is projected onto an arrangement position to check whether the size and arrangement of the large-size print are appropriate at the time of ordering. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

《Projection of large prints》
FIG. 18 is a diagram showing projection of a large format print in the image processing apparatus 1810 according to the present embodiment.

  In FIG. 18, an image 1820 adjusted in accordance with the instruction size for large format printing based on the size of the target 1821 is projected from the projection unit 1811 of the image processing apparatus 1810. The projected image 1820 may be an image showing only the size or an image printed in a large format.

<Functional configuration of mobile terminal>
FIG. 19A is a block diagram showing a functional configuration of a mobile terminal 1810 as an image processing apparatus according to this embodiment. In FIG. 19A, the same functional components as those in FIG. 5 are denoted by the same reference numerals, and description thereof is omitted.

  In addition to the WEB application execution unit 503 in FIG. 5, the WEB application execution unit 1903 includes an order size projection control unit 1938 that controls projection of an image of an order size from the projection unit 1811. The order size projection control unit 1938 projects an image of the order size from the projection unit 1811, so that the impression when the large size is actually arranged can be known in advance. If an image of a large size is used as a target image, an impression such as a color can be known in advance. The order size projection control unit 1938 can select and adjust the large size using the operation unit 505 while viewing the large size image projected from the projection unit 1811.

(Order size projection control unit)
FIG. 19B is a block diagram illustrating a functional configuration of the order size projection control unit 1938 according to the present embodiment.

  The order size projection control unit 1938 includes an order size acquisition unit 1981, a projection parameter generation unit 1982, and a projection control unit 1983.

  The order size acquisition unit 1981 acquires an image of the order size set by the order setting unit 533. The projection parameter generation unit 1982 has a parameter generation table 1982a, and generates a projection parameter for performing projection corresponding to the image of the order size. The projection control unit 1983 controls the projection unit 1811 according to the projection parameters generated by the projection parameter generation unit 1982 to project an image of the order size.

(Parameter generation table)
FIG. 20 is a diagram showing the configuration of the parameter generation table 1982a according to the present embodiment. The parameter generation table 1982a is used by the projection parameter generation unit 1982 to generate projection parameters for performing projection corresponding to the image of the order size.

  The parameter generation table 1982a stores an order size 2001, a projection unit type 2002, a target extraction result 2003, and a projection parameter in association with each other. Here, the target extraction result 2003 includes the distance to the target and the target size. Further, the projection parameter 2004 includes a projection size and a projection image.

《Handling procedure of mobile device》
FIG. 21 is a flowchart illustrating a processing procedure of the portable terminal 1810 as the image processing apparatus according to the present embodiment. This flowchart is executed by the CPU 910 in FIG. 9 using the RAM 940, and implements the functional components shown in FIGS. 19A and 19B. Note that this flowchart may be incorporated in FIG. 11A or FIG. 11B.

  The portable terminal 1810 acquires the order size in step S2101. Next, in step S2103, the mobile terminal 1810 refers to the target and generates a projection parameter based on the order size. In step S <b> 2105, the portable terminal 1810 projects an image of the order size using the projection parameter generated from the projection unit 1811. In step S2107, the portable terminal 1810 determines whether or not it is an instruction to end large-format image projection. If not, the mobile terminal 1810 returns to step S2101.

  According to the present embodiment, whether or not the size and arrangement of the large format print are appropriate can be confirmed directly at the time of ordering, and waste due to the failure of the large format print is not caused.

[Fifth Embodiment]
Next, an image processing system including an image processing apparatus according to the fifth embodiment of the present invention will be described. The image processing system according to the present embodiment is different from the second to fourth embodiments in that large-format print checking and processing are executed by a cloud server instead of a mobile terminal as an image processing apparatus. Since other configurations and operations are the same as those in the second to fourth embodiments, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

《Image processing system》
Hereinafter, the image processing system of this embodiment will be described with reference to FIGS. 22 and 23.

(System configuration)
FIG. 22 is a block diagram illustrating a configuration of an image processing system 2200 including image processing apparatuses 211 to 21n according to the present embodiment. In FIG. 22, the same components as those in FIG. 3 are denoted by the same reference numerals, and description thereof is omitted.

  A cloud server 2250 is connected to the network 340. The cloud server 2250 includes a virtual server 2251 and a virtual photo database 2252, and performs an alternative process to the print order process in the image processing apparatuses 211 to 21n or the print order process in the WEB submission server 320. As described above, the load on the image processing apparatuses 211 to 21n and the WEB submission server 320 can be reduced, and processing that cannot be performed on the image processing apparatuses 211 to 21n and the WEB submission server 320 can be executed.

(Operation procedure)
FIG. 23 is a sequence diagram illustrating an operation procedure in the image processing system 2200 including the image processing apparatus 210 according to the present embodiment. In FIG. 23, steps similar to those in FIG. 4A are denoted by the same step numbers, and description thereof is omitted.

  In step S2301, when the image processing apparatuses 211 to 21n request storage of photographs taken by the image processing apparatuses 211 to 21n, the cloud server 2250 stores the requested photographs in the virtual photograph database 2252 in a searchable format in step S2303.

  When the image processing apparatuses 211 to 21n make a print order in step S2311, the cloud server 2250 performs a print order check, particularly a large-format print image quality check, in step S2313. In step S2315, the cloud server 2250 transmits a print availability check result, and the image processing apparatuses 211 to 21n notify the print order availability in step S2317.

  If the print order is permitted, the image processing apparatuses 211 to 21n set an image editing instruction and print details in step S2319, and the cloud server 2250 executes the instructed image editing process in step S2321. .

  When the order processing by the image processing apparatuses 211 to 21n is received, the WEB submission server 320 acquires the edited print image from the cloud server 2250 in step S2323.

  According to the present embodiment, image processing that is not mounted on the mobile terminal can be performed without increasing the load on the mobile terminal as the image processing apparatus, and large format printing can be realized without causing waste due to failure.

[Sixth Embodiment]
Next, an image processing system including an image processing apparatus according to the sixth embodiment of the present invention will be described. Compared with the second to fifth embodiments, the image processing system according to the present embodiment is a large-format print on a campus (cloth), or a material whose shape is changed instead of a flat surface such as a T-shirt or a curtain. It differs in that it is a large format print. Since other configurations and operations are the same as those in the second to fifth embodiments, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

《Image processing system》
Hereinafter, with reference to FIG. 24A and FIG. 24B, an outline of processing in the image processing system of the present embodiment will be described.

  FIG. 24A is a diagram illustrating an outline of processing in the image processing system including the image processing apparatus according to the present embodiment. FIG. 24A shows campuses 2401 and 2402 corresponding to large format prints. As described above, according to the present embodiment, an impression of a large-format print on the campus can be obtained at the time of ordering.

  FIG. 24B is a diagram showing another process outline in the image processing system including the image processing apparatus according to the present embodiment. In the upper part of FIG. 24B, an example of a large format print 2404 of a captured image on the wallpaper 2403 is shown. In FIG. 24B, the pasting of large-format print wallpaper on a single flat wall is illustrated, but the present embodiment can also be applied to large-format prints on a plurality of surfaces that form curved surfaces or angles. It is also possible to adjust the large size print 2404 so as to be arranged at a desired position on the wallpaper 2403, and it is possible to adjust the large size and the arrangement that give an actual impression.

  In the lower part of FIG. 24B, for example, a large-format print 2706 for a print target whose surface is not flat, such as a curtain 2405, is effective, and an actual impression was obtained. Large size and arrangement can be adjusted.

  According to the present embodiment, the large-format print result can be confirmed at the time of ordering the large-sized print even in the large-sized print on the campus (cloth) or the large-sized print on the material whose shape is not flat such as wallpaper or curtain. Thus, large format printing can be realized without causing waste due to failure.

[Seventh Embodiment]
Next, an image processing system including an image processing apparatus according to the third embodiment of the present invention will be described. Compared with the second to sixth embodiments, the image processing system according to the present embodiment provides a unified large format print service regardless of the model of the image processing apparatus and the type of the imaging unit (camera). Different. Since other configurations and operations are the same as those in the second to sixth embodiments, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

<Functional configuration of mobile terminal>
FIG. 25 is a block diagram illustrating a functional configuration of a portable terminal 2510 as an image processing apparatus according to the present embodiment. In FIG. 25, the same functional components as those in FIG.

  In addition to the WEB application execution unit 503 in FIG. 5, the WEB application execution unit 2503 includes a device determination adjustment unit 2539 that adjusts a print order based on device information from the device information holding unit 2509. The device determination adjustment unit 2539 determines and adjusts the device so that the print order of the present embodiment is uniformly performed even when there are differences in the types of various image processing apparatuses and types of image pickup units (cameras). Do. With this process, the print order WEB application of this embodiment can be applied to any model.

  According to the present embodiment, it is possible to realize a unified large format print service regardless of the type of the image processing apparatus and the type of the imaging unit (camera) without causing waste due to failure.

[Other Embodiments]
The present invention has been described above with reference to the embodiments, but the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In addition, a system or an apparatus in which different features included in each embodiment are combined in any way is also included in the scope of the present invention.

  In addition, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention can also be applied to a case where an information processing program that implements the functions of the embodiments is supplied directly or remotely to a system or apparatus. Therefore, in order to realize the functions of the present invention on a computer, a program installed in the computer, a medium storing the program, and a WWW (World Wide Web) server that downloads the program are also included in the scope of the present invention. . In particular, at least a non-transitory computer readable medium storing a program for causing a computer to execute the processing steps included in the above-described embodiments is included in the scope of the present invention.

Claims (12)

Imaging means;
Image storage means for storing an image captured by the imaging means;
A print instruction input means for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction means for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size,
Informing means for informing that the print instruction is not accepted when the image quality of the enlarged image is below a threshold value;
An image processing apparatus comprising: The enlarged image quality prediction means predicts the image quality of the enlarged image enlarged to the large size based on the resolution or the number of pixels of the captured image,
The image processing apparatus according to claim 1, wherein the notification unit notifies that the print instruction is not accepted when the resolution of the captured image is lower than a predetermined resolution threshold. The print instruction input means cuts out a part of the captured image and gives a print instruction,
The image processing apparatus according to claim 1, wherein the enlarged image quality predicting unit predicts an image quality of an enlarged image obtained by enlarging a part of the captured image to the large size. Display means;
First display control means for causing the display means to display the large-sized image and the comparative image of the known size in a comparable manner;
The image processing apparatus according to claim 1, further comprising: Display means;
Second display control means for adjusting and superimposing the size of the enlarged image on the video imaged by the imaging means, and causing the display means to display the second display control means;
An image processing apparatus according to any one of claims 1 to 3. Projection means;
Projection control means for projecting the large format image or the enlarged image on the projection means;
An image processing apparatus according to any one of claims 1 to 3. An image accumulating step for accumulating an image captured by the imaging means;
A print instruction input step for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction step for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size;
A notification step of notifying that the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
A method for controlling an image processing apparatus. An image accumulating step for accumulating an image captured by the imaging means;
A print instruction input step for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction step for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size;
A notification step of notifying that the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
Control program for an image processing apparatus that causes a computer to execute A server that accepts a large-format print of the captured image from the image processing apparatus according to any one of claims 1 to 6,
WEB application providing means for providing the image processing apparatus with a WEB application for printing the captured image;
Member registration means for registering a user as a member who can order prints;
Processing information providing means for providing the member with information for processing the captured image;
Order accepting means for accepting an order for the large format print from the member;
Print instruction means for instructing a print store to order the large format print;
A server comprising Imaging means;
Image storage means for storing an image captured by the imaging means;
A print instruction input means for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction means for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size,
An informing means for informing that the print instruction is canceled and the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
Printing means for printing the captured image in the print size according to the print instruction when the print instruction is not canceled;
An image processing system comprising: An image accumulating step for accumulating an image captured by the imaging means;
A print instruction input step for inputting a print instruction including a print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction step for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size;
A notification step of notifying that the print instruction is not accepted and the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
A printing step of printing the captured image in the print size according to the print instruction when the print instruction is not canceled;
An image processing method including: A print instruction input step for inputting a print instruction including the print size of the captured image;
When the print size is a large size exceeding a predetermined size, an enlarged image quality prediction step for predicting an image quality of an enlarged image obtained by enlarging the captured image to the large size;
A notification step of notifying that the print instruction is not accepted when the image quality of the enlarged image is below a threshold;
A transmission step of transmitting the captured image printed in the large size and the print instruction when the image quality of the enlarged image does not fall below a threshold;
An image processing program for causing a computer to execute.

Images