WO2021182579A1

WO2021182579A1 - Submitted data re-editing apparatus and method, and storage medium

Info

Publication number: WO2021182579A1
Application number: PCT/JP2021/009847
Authority: WO
Inventors: 朋樹岡本
Original assignee: 株式会社バリューブリッジ
Priority date: 2020-03-13
Filing date: 2021-03-11
Publication date: 2021-09-16
Also published as: JP6893712B1; JP2021149977A; JP2021145293A; JP7072945B2

Abstract

The objective of the present invention is to enable a customer or the like to perform re-editing, such as enlarging a photograph, with respect to submitted data, and to reduce time and effort, and mistakes, in correction work. A submitted data re-editing apparatus 50 includes a storage unit 512 which stores: submitted data, as a single file in which a first photographic image, selected from a plurality of original photographic images, that has been subjected to image processing is fitted into an image frame of a template, and a first character string has been fitted into a text frame of the template; and data relating to the plurality of original photographic images. A separating means of a processor 501 separates the first photographic image from the submitted data, and identifies the image frame. An extracting means of the processor 501 extracts a specific original photographic image corresponding to the first photographic image from the plurality of original photographic images. An editing means of the processor 501 executes image processing with respect to the specific original photographic image, in accordance with a user instruction, to create a second photographic image. A fitting means of the processor 501 fits the second photographic image into the image frame of the submitted data, and recreates the submitted data.

Description

Submission data re-editing device, method and storage medium

The present invention relates to a submitted data re-editing device, a method, and a storage medium for re-editing submitted data of a photo book.

All or part of the data taken in the case where a photographer or other photographer takes an order from a customer at a wedding ceremony, 753, coming-of-age ceremony, other events, family photography, etc. We may receive requests from customers to create albums and photo books that contain data.

At that time, the business operator lays out the customer's photo on the cover, page, etc. of the album or photobook using photo editing or DTP software, and a general-purpose standard file format such as jpeg or pdf accepted by the bookbinding manufacturer that outsources printing. Output with. Normally, one page or one spread (two pages) becomes one file, and multiple files for one page serve as data to be passed to the printing process (submission data).

When the customer proofreads before printing, either provide a printed version of the submitted data or send the submitted data itself by e-mail etc. and ask them to confirm the layout. At that time, instructions for replacing the photo to be used and requests for corrections regarding the arrangement such as enlargement, reduction, rotation, trimming, etc. of the photo are often made by text such as comments, and explanations and communication from the customer to the business operator are made. It's difficult, complicated, and error-prone.

Since print data such as jpeg and pdf are fixed as one page (or one spread) and one image, the photo group included in the page cannot be re-edited normally.

The present invention reduces labor and mistakes in proofreading work by allowing customers and the like to re-edit the submitted data, such as replacing the photo to be used, enlarging, reducing, rotating, and trimming the photo. It is an object of the present invention to provide a device, a method and a storage medium for realizing the above.

In the submitted data re-editing device according to the present invention, the first photographic image selected from a plurality of original photographic images and subjected to image processing is fitted into the image frame of the template, and the first character string is placed in the text frame of the template. It has a storage unit that stores the submitted data as a single file that is fitted and the data related to a plurality of original photographic images. The first photographic image is separated from the submitted data and the image frame is identified. A specific original photographic image corresponding to the separated first photographic image is extracted from the plurality of original photographic images. Image processing is executed on a specific original photographic image according to a user instruction to generate a second photographic image. The second photographic image is fitted into the image frame of the submitted data, and the submitted data is regenerated.

According to the present invention, the submitted data can be re-edited, and the customer who proofreads the submitted data can replace the photo to be used, enlarge, reduce, rotate, trim, etc. the photo. By doing so, it is possible to reduce labor and mistakes in the calibration work.

It is a schematic diagram which shows the manuscript data re-editing system including the man-made data re-editing apparatus 50 which concerns on this invention, and a photobook creation system. FIG. 1 is a diagram showing a photo editing screen 540 for editing a photo displayed in the photo area 541 of the submitted data of the customer-side information processing terminal 40 of FIG. 1. It is a schematic diagram for demonstrating the process of generating the trafficking data executed by the trafficking data generation apparatus 30 of FIG. It is a block diagram which shows the structure of the submitted data re-editing apparatus 50 of FIG. It is a flowchart which shows the trafficking data re-editing process executed by the trafficking data re-editing apparatus 50 of FIG. It is a schematic diagram for demonstrating the process of re-editing the trafficking data executed by the trafficking data re-editing apparatus 50 of FIG.

Hereinafter, specific embodiments of the present invention will be described with reference to the accompanying drawings. The terms are defined as follows.

Photobook: A photobook typically made up of multiple mounts with photos and texts pasted on them, but includes a simple photo sheet with photos pasted on a single mount or a folded mount.
Photo image: Refers to image data taken with a digital camera.
Template: Framework data in which an image frame or text frame for laying out a photographic image is pre-assembled. Illustrations and texts may be pre-installed.
Mount: A photographic image or character string separated from the submitted data of a photo book is simply called a mount.
Uploaded data: An arbitrary photo image is fitted in the image frame of the template, an arbitrary character string is fitted in the text frame, and the whole is converted to a specific file format to make a single file.

As an outline of the present embodiment, the photographic image is identified from the submitted data, and the submitted data is separated into a photographic image part and a mount part. Next, the photographic image separated from the submitted data is individually collated with all the multiple original photographic images taken at a wedding, etc., and the original photographic image that is the source of the photographic image separated from the submitted data is used. Identify. According to the instruction of the customer who is the proofreader, the specified original photographic image is arbitrarily enlarged, reduced, rotated, trimmed, and refitted into the image frame of the mount. It is also possible to replace the specified original photographic image with another original photographic image and fit it in the image frame. After the proofreading confirmation is completed, the photographic image is recombined on the mount, converted into a single file in a specific file format such as jpeg, pdf, and the submitted data passed to the printing process is regenerated.
Embodiment 1.
The submitted data re-editing device 50 according to the present embodiment shown in FIG. 1 is a device that once determines and executes a re-editing process on the generated submitted data. The submitted data is generated by a system (hereinafter referred to as a photobook creation system) on the photobook creator side according to the instructions of the user (photobook requester (customer)). The photobook creation system stores data of various mounts (templates) prepared by the photobook creator. In the template, an image frame and a text frame are laid out on a appropriately decorated mount.

The user selects a template, selects a preferable original photographic image from a plurality of original photographic images, enlarges / reduces the original photographic image, trims it, corrects color, brightness, etc., and performs such various image processing. At the same time, it fits into the image frame while adjusting the position. Here, a photographic image obtained by subjecting an original photographic image to image processing such as enlargement / reduction processing or trimming processing is referred to as a "first photographic image". When re-editing the submitted data, which will be described later, a photographic image that has undergone image processing such as enlargement / reduction processing or trimming processing on the original photographic image is referred to as a "second photographic image" and is referred to as a "first photo". Distinguish from "image".

In addition, the user inputs an appropriate character string, selects a character font, adjusts the character size, sets the character modification, and fits the character string into the text frame while adjusting the position and orientation of the character string with respect to the text frame. go. This character string is referred to as a "first character string" here. When re-editing the submitted data, which will be described later, the newly input character string or the first character string in which the character font, character size, and character modification are reset is referred to as the "second character string" and is referred to as "the second character string". Distinguish from "1 character string".

At this stage, the first photographic image data and the first character string data are distributed and stored as a plurality of files together with the template data in which the link information is embedded.

At the time of submission, the entire template in which the first photographic image and the first character string are embedded is converted into a single file and generated as submission data to be passed to the printing process. In the submitted data, the state in which the first photographic image and the first character string are laid out so as to be printed on paper is stored integrally so that the state cannot be easily modified. The submitted data is typically in pdf (Portable Document Format) format, or is converted into an image file format such as JPEG, GIF, PNG, TIFF, BMP as a single image data as a whole.

The submitted data re-editing device 50 includes a server 10, an information processing terminal for original photographs 20, a submitted data generation device 30, a customer-side information processing terminal 40, via an Internet network (electronic public communication line network) 70. The information processing terminal 60 for print processing is connected. Data related to a plurality of original photographic images taken by the cameraman are taken in via the information processing terminal 20 for original photographs, and the photographic images are appropriately processed by the cameraman himself. Data related to a plurality of original photo images taken in via the original photo information processing terminal 20 are stored in the server 10. In addition to the data related to the original photo image, the server 10 also stores data related to a plurality of templates, data related to a plurality of character strings, and submitted data.

The user operates the customer-side information processing terminal 40 to select a template, individually select a preferable original photographic image from a plurality of original photographic images for each image frame, and set the position of the original photographic image with respect to the image frame. Enter the instructions necessary to make adjustments, zoom in / out the original photographic image, trim, and modify the color, brightness, etc.

FIG. 2 shows an example of an operation screen for image processing of a photographic image of the customer side information processing terminal 40. The original photographic image 701 is superimposed and displayed on the image frame 602 laid out on the entire frame 540 of the template. Preferably, the original photographic image 701 is controlled so that only the image portion that fits in the image frame 602 is displayed, and the portion that protrudes from the image frame 602 disappears from the screen. The user can operate the move button 544 using the pointer 543 to move the original photographic image 701 relative to the fixed image frame 602.

The reduction / enlargement button 545 is a slider button for enlarging / reducing the original photographic image. When the user operates the button 545 in the lower right direction or the upper left direction, the original photographic image 701 is enlarged / reduced according to the enlargement / reduction ratio specified according to the operation. When the pointer 543 is operated by a mouse or the like instead of the touch panel method, each

button

544 and 545 is operated by the pointer 543.

The user operates the customer-side information processing terminal 40 to input an appropriate character string, select a character font, adjust the character size, set the character modification, and position and orient the character string with respect to the text frame. Enter the instructions required to adjust. In addition, when re-editing the submitted data, the user operates the information processing terminal 40 on the customer side to adjust the position of the original photo image with respect to the image frame, enlarge / reduce the original photo image, trimming, correct the color, brightness, etc. Enter the required instructions as well. Similarly, when re-editing the submitted data, the user operates the customer-side information processing terminal 40 to input instructions necessary for re-entering the character string, resetting the character font, character size, and character modification.

FIG. 3 is a schematic diagram for explaining the submission data generation process executed by the submission data generation device 30 of FIG. In FIG. 3A, an appropriate template 601 is selected from a plurality of types of templates (mounting sheets) stored in the submitted data generation device 30, and a plurality of original photographic images stored in the server 10 are related. From the data, select a plurality of original photographic images 701 that you want to publish in the photo book. These original photographic images 701 are, for example, jpg. It is image data in the format. An image frame 602 and a text frame 802 for fitting a photographic image are set in the template 601.

In FIG. 3B, the original photographic image 701 to be fitted into each image frame 602 is selected, and the position of the original photographic image 701 with respect to the image frame is adjusted. In addition, the original photographic image is subjected to image processing such as reduction or enlargement processing, trimming, color, and brightness. Further, for example, "friend", "childhood friend", etc. are input as character strings (comments) for each of the text frames 802. The position of the character string with respect to the text frame, its layout, character font, character size, character modification, etc. are also processed according to the user's instruction. Such processing such as fitting is repeated for a plurality of papers constituting the photo book.

Finally, as shown in FIG. 3 (c), for example, pdf. It is converted into an electronic document format such as a format or an image file format such as TIFF, and the submitted data 610 as a single file is generated.

FIG. 4 is a block diagram showing the configuration of the submitted data re-editing device 50 that executes the re-editing process on the submitted data 610. The submitted data re-editing device 50 includes a processor 501 which is a control unit, a RAM (RandomAccessMemory) 502, a ROM (ReadOnlyMemory) 503, an input controller 504, a video controller 505, and an I / O controller 506. A communication controller 507, an input device 510, a display 511, and a storage device 512 which is an example of a storage unit are provided.

Processor 501 comprehensively controls each device and controller connected to the system bus. The processor 501 is composed of, for example, a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processor 501 executes a program stored in the RAM 502 to realize various functions. The processor 501 executes a re-editing process on the submitted data 610 by executing a re-editing program for the submitted data that executes the flowchart of FIG. 5 described later. The program is configured to realize the means described later in the processor 501 as a computer, and is stored in a storage medium such as a computer-readable RAM 502, ROM 503, CD, DVD, Blu-ray disc, or USB flash memory.

Specifically, the processor 501 that executes the program realizes the separation means, the extraction means, the editing means, and the fitting means. The separation means separates the first photographic image 710 and the other background 610a from the submitted data 610, and identifies the image frame 602 (see FIGS. 6A and 6B).

The extraction means is the original original photographic image 701 used to generate a specific original photographic image 701 corresponding to the separated first photographic image 710, that is, the first photographic image 710 from the plurality of original photographic images 701. (See FIG. 6 (b) and FIG. 6 (c)). For example, the first photographic image 710 is differentiated from each of the plurality of original photographic images 701, and the sum of squares of the differences is calculated. Actually, since the original photographic image 701 is subjected to image processing such as enlargement / reduction and trimming, the resolution and range are different. Therefore, while changing the resolution of the first photographic image 710 in various ways and moving the first photographic image 710 within the frame of the original photographic image 701, the difference is made at each position, and the sum of squares of the differences is calculated and they are used. The minimum value of is identified as the matching index value of each of the original photographic images 701 with respect to the first photographic image 710. The matching index values of the plurality of original photographic images 701 are compared, and the original photographic image 701 showing the lowest matching index value is specified.

It should be noted that the original photographic image corresponding to the photographic image in the submitted data is searched for from a plurality of original photographic images, that is, collated, and the processing of content matching (image matching) is actually artificial intelligence (AI: Artificial Intelligence). ) Technology is adopted.

The editing means moves the original photographic image 701 specified relative to the image frame 602 relative to the image frame 602, enlarges / reduces the original photographic image 701, trims the original photographic image 701, and its color and brightness. Etc. are modified to generate a second photographic image 711 (see FIG. 6 (c)). The fitting means fits the second photographic image 711 into the image frame 602 (see FIG. 6D). The second photographic image 711 may be superimposed or replaced on the first photographic image 710 on the image frame 602.

Similarly, for re-editing the character string, the separation means separates the character string (first character string) from the other background 610a from the paper surface of the submitted data 610, and a rectangle or the like including the first character string. Identify the text frame of. The editing means and the fitting means input a character string (second character string) to the consented text frame, select a character font, adjust the character size, set the character modification, and set the character modification to the text frame. While adjusting the position and orientation of the second character string, fit it into the text frame. Actually, the second character string is superimposed or replaced with the first character string together with the text frame. It is preferable that the separating means, the editing means, and the fitting means related to the character string are separately provided from the separating means, the editing means, and the fitting means related to the photographic image.

The RAM 502 functions as the main memory, work area, etc. of the processor 501. The processor 501 loads a program or the like necessary for executing the process from the ROM 503 or the storage device 512 into the RAM 502, and executes the loaded program to realize various operations.

The ROM 503 or the storage device 512 is necessary to realize various functions such as a BIOS (Basic Input Output System) executed by the processor 501, an operating system program (OS), and various application programs including a submitted data re-editing program. Various programs, various files processed by various programs, various data, etc. are stored. Naturally, the original photographic image 701 is also stored. The storage device 512 includes, for example, a hard disk (HDD: Hard Disk Drive), a solid state drive (SSD: Solid State Drive), a magnetic disk such as a floppy (registered trademark) disk, a CD (Compact Disc), or a DVD (Digital Versatile). Includes optical disks such as Disc) and BD (Blu-ray (registered trademark) Disc), optical magnetic disks such as MD (Mini Disc) (registered trademark), and removable media such as memory cards.

The input controller 504 controls the input from the input device 510 such as a keyboard (KB), a pointing device such as a mouse or a touch panel.

The video controller 505 controls the display of a display such as an LCD (Liquid Crystal Display) under the control of the processor 501.

The I / O controller 506 controls access to the storage device 512. The storage device 512 contains the original photographic image 701 stored in the server 10, the submitted data 610, the photographic image data 710 cut out from the submitted data 610, and the background 610a after the photographic image is cut out from the submitted data 610. Image data and the like are stored. The files and data stored in the storage device 512 are read out as necessary and stored in the RAM 502 as the submitted data re-editing program is executed.
The communication controller 507 controls communication with the customer-side information processing terminal 40 for the customer-side correction instruction for instructing the editing of the submitted data via the network 70.

The operation of the submitted data re-editing system including the submitted data re-editing device 50 configured as described above will be described below.

FIG. 5 is a flowchart showing a re-editing process of the submitted data executed by the submitted data re-editing device 50. FIG. 6 is a supplementary diagram of the submitted data re-editing process of FIG. In step S1, the user operates the customer-side information processing terminal 40 and inputs the submission data re-editing request to the submission data re-editing device 50 together with the user ID and the submission ID that identifies the submission data. .. In step S2, the submission data re-editing device 50 transmits the submission data 610 and the data transmission request of the plurality of original photo images 701 associated with the user together with the user ID and the submission ID to the server 10. In step S3, the submitted data re-editing device 50 receives the submitted data 610 and the data of the plurality of original photographic images 701 from the server 10 and stores them in the storage device 512.

In step S4, the submitted data re-editing device 50 separates the submitted data 610 into a first photographic image 710 and a background 610a (FIG. 6B). In other words, the first photographic image 710 is extracted and the image frame is specified. In step S5, the original original photographic image 701 used to generate the separated first photographic image 710 is specified from the plurality of original photographic images 701 (see FIGS. 6 (b) and 6 (c)). ). It is also possible to replace with another original photographic image that does not correspond to the first photographic image.

In step S6, the submitted data re-editing device 50 executes various image processing on the original photo image 701 according to the user instruction from the customer side information processing terminal 40. For example, processing such as reduction or enlargement processing, trimming processing of a desired range, position adjustment, and image filtering is executed.

In step S7, the re-edited submitted data 620 (FIG. 6 (d)) is generated and transmitted to the customer side information processing terminal 40. The re-edited submitted data 620 is, for example, image data in pdf format.

Similarly, when the user requests re-editing of the character string, the text frame such as a rectangle containing the character string (first character string) and the other background 610a are separated from the paper surface of the submitted data 610. Then, enter the character string (second character string) received from the user, select the character font, adjust the character size, set the character modification, and adjust the position and orientation of the second character string with respect to the text frame. While fitting it into the text frame.

The re-edited submitted data 620 is displayed on the display unit of the customer side information processing terminal 40 and confirmed by the user. When the completion instruction is received from the user in step S8 (step S8 “YES”), the process proceeds to step S9, and the re-edited submitted data 620 is transmitted to the information processing terminal 60 for printing processing (entering the printing process). Manuscript). In step S8, when the completion instruction is not received from the user (step S8 “NO”), the process returns to step S6.

Even after the submitted data 610 of the photo book is completed in this way, the re-editing process can be executed on the submitted data 610. Conventionally, once the submitted data 610 is completed, the trimming range of the photographic image, the position of the photographic with respect to the image frame, the image enlargement ratio (reduction ratio), the image filtering specifications, the character string, the character font, the character size, and the character modification are performed. When making changes, it is necessary to discard the completed submitted data and perform tasks such as template selection, photographic image selection, trimming, and character input again, which not only imposes a heavy burden on the user, but also imposes a heavy burden on the user. It was difficult to reproduce the same state except for the changed parts. According to this embodiment, since the re-editing process can be executed on the submitted data 610, the burden on the user can be reduced, the parts other than the changed parts can be reproduced in the same state, and the submitted data can be proofread. By enabling re-editing such as replacement of used photos, enlargement, reduction, rotation, trimming, etc. of photos, it is possible to reduce labor and mistakes in re-editing (proofreading work).

Although some embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, as well as in the scope of the invention described in the claims and the equivalent scope thereof.

10 ... server, 30 ... trafficking data generator, 40 ... customer side information processing terminal, 50 ... trafficking data re-editing device, 501 ... processor, 512 ... storage device, 601 ... template, 602 ... image frame, 610 ... Manuscript data, 620 ... Re-edited manuscript data, 701 ... Original photo image, 710 ... First photo image, 711 ... Second photo image, 802 ... Text frame.

Claims

The first photographic image selected from a plurality of original photographic images and subjected to image processing is fitted into the image frame of the template, the first character string is fitted into the text frame of the template, and converted into a single file. A storage unit that stores the submitted data and the data related to the plurality of original photographic images,
A means for separating the first photographic image from the submitted data and identifying the image frame,
An extraction means for extracting a specific original photographic image corresponding to the separated first photographic image from the plurality of original photographic images.
An image processing means that executes image processing on the specific original photographic image according to a user instruction to generate a second photographic image, and
A trafficking data re-editing device comprising a means for fitting the second photographic image into the image frame of the trafficking data and regenerating the trafficking data.
The submitted data re-editing device according to claim 1, wherein the image processing means executes enlargement / reduction processing or trimming processing on the specific original photographic image.
The extraction means makes a difference at each position while moving the first photographic image relative to each of the plurality of original photographic images, and specifies the specific original photographic image based on the sum of squares of the differences. Item 1. The submitted data re-editing device according to item 1.
A means for separating the first character string from the submitted data and identifying the text frame, and
A means for generating a second character string by selecting a character font according to a user instruction for the first character string, adjusting a character size, or setting a character modification.
The submitted data re-editing device according to claim 1, further comprising a means for fitting the second character string into the text frame of the submitted data.
A single file in which the first photographic image selected from a plurality of original photographic images from an external server and subjected to image processing is fitted into the image frame of the template, and the first character string is fitted into the text frame of the template. The step of receiving and storing the submitted data as a data and the data related to the plurality of original photographic images, and
A step of separating the first photographic image from the submitted data and identifying the image frame, and
A step of extracting a specific original photographic image corresponding to the separated first photographic image from the plurality of original photographic images, and
A step of executing image processing on the specific original photographic image according to a user instruction to generate a second photographic image, and
A method for re-editing submitted data, which includes a step of fitting the second photographic image into the image frame of the submitted data and regenerating the submitted data.
A single file in which the first photographic image selected from a plurality of original photographic images from an external server and subjected to image processing is fitted into the image frame of the template, and the first character string is fitted into the text frame of the template. A means for receiving and storing the submitted data and the data related to the plurality of original photographic images in the storage unit.
A means for separating the first photographic image from the submitted data and identifying the image frame,
A means for extracting a specific original photographic image corresponding to the separated first photographic image from the plurality of original photographic images, and
A means for generating a second photographic image by executing image processing on the specific original photographic image according to a user instruction.
A computer-readable storage medium in which a program for fitting a second photographic image into the image frame of the submitted data and realizing a means for regenerating the submitted data on a computer is recorded.
The first photographic image selected from a plurality of original photographic images and subjected to image processing is fitted into the image frame of the template, and the first character string is fitted into the text frame of the template. A storage unit that stores data and data related to the plurality of original photographic images, and
A means for separating the first photographic image from the submitted data and identifying the image frame,
A means for extracting a specific original photographic image corresponding to the first image from the plurality of original images, and
An image processing means for generating a second photographic image by performing image processing on the specific original photographic image or another original photographic image selected from the plurality of original photographic images according to a user instruction.
A trafficking data re-editing device comprising a means for fitting the second photographic image into the image frame of the trafficking data and regenerating the trafficking data.
A single file in which the first photographic image selected from a plurality of original photographic images from an external server and subjected to image processing is fitted into the image frame of the template, and the first character string is fitted into the text frame of the template. The step of receiving and storing the submitted data as a data and the data related to the plurality of original photographic images, and
A step of separating the first photographic image from the submitted data and identifying the image frame, and
A step of extracting a specific original photographic image corresponding to the first image from the plurality of original images, and
A step of performing image processing on the specific original photographic image or another original photographic image selected according to a user instruction from the plurality of original photographic images to generate a second photographic image.
A method for re-editing submitted data, which includes a step of fitting the second photographic image into the image frame of the submitted data and regenerating the submitted data.
The first photographic image selected from a plurality of original photographic images and subjected to image processing is fitted into the image frame of the template, and the first character string is fitted into the text frame of the template. A means for storing the data and the data related to the plurality of original photographic images in the storage unit, and
A means for separating the first photographic image from the submitted data and identifying the image frame,
A means for extracting a specific original photographic image corresponding to the first image from the plurality of original images, and
An image processing means for generating a second photographic image by performing image processing on the specific original photographic image or another original photographic image selected from the plurality of original photographic images according to a user instruction.
A computer-readable storage medium in which a program for fitting a second photographic image into the image frame of the submitted data and realizing a means for regenerating the submitted data on a computer is recorded.