KR20190123993A - Terminal for image auto-editing and system for image auto-editing comprising it - Google Patents

Abstract

The present invention relates to an automatic image editing terminal capable of suggesting a plurality of candidate edited images to a client and providing a final edited image selected by the client by inspecting the validity of image files uploaded by the client and automatically editing the images and an automatic image editing system including the same. According to an embodiment of the present invention, the automatic image editing terminal includes: a communication part transceiving information with a client terminal through a wired/wireless communication network; an input part providing an order option input field for inputting an order option to be selected by a client in regard to image editing and a file upload field for uploading a plurality of images to be edited; an image file inspection part inspecting the validity of the image files uploaded by the client; an image file selection part automatically selecting some of the completely inspected image files to be used for image editing; and an image editing part editing an image by using the image files automatically selected by the image file selection part.

Description

Terminal for automatic image editing and image automatic editing system including same {terminal for image auto-editing and system for image auto-editing comprising it}

The present invention relates to a video auto-editing terminal and a video auto-editing system including the same. More particularly, the present invention provides a plurality of candidate video edits to customers by checking the validity of image files uploaded by a customer and automatically editing the video. The present invention relates to a video automatic editing terminal capable of providing a final video edited product according to a customer's selection, and an automatic video editing system including the same.

Recently, with the development of information and communication technology, the wedding invitations, albums, and the like, which were conventionally produced on-line, are manufactured and widely used as electronic wedding invitations, electronic albums, etc. on the Internet. Hereinafter, the electronic video material used in various ceremonies, such as an electronic wedding invitation and an electronic album, is called a video editing.

When a customer accesses an image editing site that provides a video edit and uploads an image file to be edited, the web server edits the uploaded image file and sends the video edit to the customer.

The current video edit is produced entirely using an image file uploaded by a customer, which has the following inconvenience.

First, when uploading an image file to a video editing web site, the customer has to inconvenient to select and upload an image file in a format required by the web site.

Secondly, when uploading an image file to a video editing web site, the customer has to check and upload the image file one by one. In particular, as smartphones and digital cameras are widely used, the number of photographic images or videos taken by an individual is rapidly increasing. Therefore, a considerable amount of time and effort is required to select a necessary image from a large number of images (photos or videos). There is a problem.

Third, if the image file uploaded by the customer's choice does not meet the format required by the website, it cannot be automatically checked, so the quality of the edited video is very small or the face is blurred. There is a high possibility that a degraded video edit will come out. Of course, the manufacturer may require manual verification and upload a new image file, but the possibility of such an inappropriate image file being used by the manufacturer's mistake cannot be ruled out.

Korean Patent Publication No. 10-2015-0042678

The present invention provides a video automatic editing terminal capable of validating image files uploaded by a customer and automatically editing a video to present a plurality of candidate video edits to a customer, and providing a final video edit according to a customer's selection. It is an object of the present invention to provide a video automatic editing system that includes.

According to an embodiment of the present invention, the automatic video editing terminal,

Communication unit for transmitting and receiving information with the client terminal through a wired or wireless communication network; An input unit providing an order option input field for inputting an order option selectable by a customer in relation to image editing and a file upload field for uploading a plurality of image files to be edited; An image file inspector for validating a plurality of image files uploaded by a customer; An image file selection unit for automatically selecting an image file to be used for image editing among a plurality of image files whose validity checks have been completed; And an image editing unit editing an image using the image file automatically selected by the image file selecting unit.

In the automatic image editing terminal according to an embodiment of the present invention, further comprising a template providing unit for providing a template of a variety of formats prepared in advance to the client terminal, and more than the number of images defined in the template through the client terminal A number of image files are uploaded.

In the automatic image editing terminal according to an embodiment of the present invention, the image file inspection unit, File temporary storage module for storing the image file, Validation module for checking whether the image file conforms to the image editing standard and A file modification module for generating an error check page when an error is found in the image file, an image file after validation, an original backup folder for storing the original image file, and a reporting file including status information And a file storage module after inspection including a reporting folder, a success folder for storing valid files, and an error folder for storing invalid files.

In the automatic image editing terminal according to an embodiment of the present invention, the validity checking module, whether the metadata of the image file is present, whether the size of the image file is suitable for the image editing criteria, within the image file It is characterized by checking whether the face area of the person meets the video editing criteria and whether there is a duplicate image file.

In the automatic image editing terminal according to an embodiment of the present invention, the validity check module may include at least one of a size, a resolution, a producer, a date, and location information of the image file even when metadata of the image file exists. If is missing, characterized in that the image file is determined to be invalid.

In the automatic video editing terminal according to an embodiment of the present invention, if the size information of the image file included in the metadata of the image file is smaller than a standard standard, the validity check module is not valid. It is characterized by judging.

In the automatic image editing terminal according to an embodiment of the present invention, the validity check module executes a face recognition algorithm to check a face area of the subject in the image file, and then, the color of the outer line and the background of the face area. It is characterized by determining the validity of the image file through the contrast.

In the automatic image editing terminal according to an embodiment of the present invention, the validity checking module extracts a picture taken by continuous shooting from the image file, processes any one of the continuous shooting pictures as a valid image file, and the rest. Similar sequential shots are characterized in that they are determined to be invalid.

In the automatic video editing terminal according to an embodiment of the present invention, the image file selection unit, based on at least one selected from the date the image file was produced, the region where the image file was produced, the producer of the image file It is characterized by automatically selecting image files to be used for video editing.

In the automatic image editing terminal according to an embodiment of the present invention, the image file selection unit selects and classifies a plurality of image file sets according to the selection criteria, and the image editing unit uses a plurality of candidates using the plurality of image file sets. Characterized in editing the video editing.

The automatic video editing system according to an embodiment of the present invention includes a video automatic editing terminal, and a client terminal that is accessible to a web site provided by the video automatic editing terminal and transmits an order option and an image file.

Other specific details of embodiments according to various aspects of the present invention are included in the following detailed description.

According to an embodiment of the invention,

When a customer uploads an image file, the user can upload a plurality of image files and receive a video edit by the selected image file without uploading a plurality of image files. You can.

The validity of the image file uploaded by the customer can be automatically checked and corrected automatically, or the customer can be re-uploaded another valid image file to reduce the likelihood that an image file inappropriate for the video edit will be used.

By using the image files uploaded randomly by the customer, a plurality of candidate video edits can be presented to the customer, and the final video edit can be provided according to the customer's selection, thereby improving convenience of use.

1 is a block diagram showing an automatic image editing system according to an embodiment of the present invention.
2 is a block diagram illustrating an automatic video editing terminal according to an embodiment of the present invention.
3 is a block diagram illustrating an image file inspecting unit of a video automatic editing terminal according to an exemplary embodiment of the present invention.
4 and 5 are exemplary diagrams in which metadata representing an attribute of an image file is illustrated.
6 is an exemplary view of a task manager screen viewed from a client terminal in an automatic image editing system according to an embodiment of the present invention.
7 is an exemplary view of an error check page seen in a client terminal in an automatic image editing system according to an embodiment of the present invention.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all transformations, equivalents, and substitutes included in the spirit and scope of the present invention.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present invention, the terms 'comprise' or 'have' are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof. Hereinafter, an image automatic editing terminal and an image automatic editing system including the same according to an embodiment of the present invention will be described with reference to the accompanying drawings.

1 is a block diagram showing an automatic image editing system according to an embodiment of the present invention. As shown in FIG. 1, the automatic image editing system according to an exemplary embodiment of the present invention includes a client terminal 100 and an automatic image editing terminal 200.

The client terminal 100 refers to a terminal capable of receiving various web page data via wired or wireless communication network according to a key operation, a touch input, a voice input, etc. of a customer, and may be a personal computer (PC), a notebook computer, a personal portable device. It may be one of a personal digital assistant (PDA) and a mobile communication terminal (PDA), for storing a web browser and a program for accessing the automatic image editing terminal 200 via a wired or wireless communication network. Means a terminal having a memory, a microprocessor for executing and controlling a program.

The customer who wants to edit an image accesses a web site provided by the video automatic editing terminal 200 through wired or wireless communication to the client terminal 100, inputs order information, and uploads a plurality of image files to be edited. Here, the image file may include a photo file and a video file.

The automatic image editing terminal 200 provides a web site to which the client terminal 100 can be connected, receives an image file requesting order information and editing work from the client terminal 100, and receives an error of the received image file. After checking whether there is an error, correct it, select an image file to be used for image editing from the modified image file, and perform image editing using the selected image file.

To this end, the automatic video editing terminal 200 includes a control unit 210, a communication unit 220, an input unit 230, an output unit 240, a storage unit 250, a template providing unit 260, And an image file inspecting unit 270, an image file selecting unit 280, and an image editing unit 290.

The controller 210 performs overall control of the video automatic editing terminal 200, and includes at least one processor and at least one memory loading data including a central processing unit (CPU) and a micro processing unit (MPU) in hardware. May include an execution memory (eg, a register and / or random access memory (RAM)) loaded with a bus and a bus for inputting and outputting at least one or more data into and from the processor and the memory. It is loaded into the execution memory from a predetermined recording medium to perform a function defined in the automatic image editing terminal 200 (eg, providing data, validating image files, automatic image sorting, image editing, etc.) by software. It may include a predetermined program routine (Routine) or program data that is arithmetic processing by the processor. In other words, among the functions provided in the automatic image editing terminal 200 to perform the automatic image editing method according to an embodiment of the present invention, a component that can be processed by software may be determined as a function of the controller 210. have.

The controller 210 is functionally connected to at least one component provided to support the automatic image editing method. That is, the control unit 210, the communication unit 220, input unit 230, output unit 240, storage unit 250, template providing unit 260, image file inspection unit 270, image file selection unit 280 It is functionally connected to the image editing unit 290 and controls the flow of signals for supplying power and performing functions to the components.

The communication unit 220 performs a role of supporting transmission and reception of various information with the client terminal 100 through a wired or wireless communication network. In particular, the communication unit 220 according to an embodiment of the present invention receives an image file requesting an order option and an editing operation from the client terminal 100 under the control of the controller 210, and automatically edited the image file using the image file. To the client terminal 100.

The input unit 230 provides an order option input field for inputting an order option that the customer can select in relation to image editing when the customer accesses a web site through the client terminal 100. It also includes a file upload field for uploading an image file to be edited after entering an order option.

The output unit 240 calculates and outputs a quotation cost in which the order option input by the customer is reflected in real time, and also outputs a preview screen showing the edited image of the image file uploaded by the customer. The preview screen may be output by applying the order option input by the customer. When the preview screen is output, the estimate cost may be calculated in real time and output together. Estimated cost can be calculated in real time by calculating the basic cost according to the type of template selected by the customer and adding the additional cost according to the order option additionally ordered by the customer.

The storage unit 250 may store various programs and data necessary for driving the automatic image editing terminal 200. In addition, storage for the file temporary storage module 271, various folders and various files in the image file inspection unit 270 described later, the file storage module 281 of the image file selecting unit 280, various folders and various files Provide space. It also includes a database in which various kinds of information are stored.

The template provider 260 provides templates of various formats, which are prepared in advance, to the client terminal 100 connected to a web site through wired or wireless communication. The customer selects one or more of the various templates provided on the website and uploads a plurality of image files to be applied to the template. In this case, the customer may upload a larger number of image files than the number of images defined in the template through the client terminal 100. For example, if the number of images defined in the template is 30, the customer can upload 60 images.

The video auto-editing terminal of the present invention may check the validity of more image files than the number of images defined in the template, and automatically select images from the valid image files and present them to the customer. In this case, a plurality of sets of candidate video edits may be presented to the customer according to selection criteria. The customer may select any one candidate video edit from among a plurality of sets of candidate video edits.

The image file inspecting unit 270 determines the quality and size of the image file uploaded by the customer, corrects an error of the image file, and checks whether the image file is suitable for the image editing process.

To this end, the image file inspecting unit 270, as shown in Figure 3, the file temporary storage module 271, the validation module 272, the file modification module 273, and the post-check file storage module ( 274, an XML parsing module 275, and a DB update module 276.

The file temporary storage module 271 includes a validation check temporary folder, and the image file received by the communication unit 220 is copied and stored in the validation check temporary folder.

The validation module 272 reads an image file stored in the file temporary storage module 271 and validates the image file.

The validity checking module 272 checks whether the image file uploaded by the customer conforms to the standard required by the automatic image editing system. More specifically, it is checked whether the image file uploaded by the customer satisfies the following. The following matters are exemplary only, and the inspection item is not limited thereto.

1) whether the metadata of the image file exists,

2) whether the size of the image file meets the video editing standards,

3) Whether the face area of the person in the image file meets the video editing criteria (sharpness),

4) Duplicate image file exists

The image file uploaded by the customer is then checked for suitability for preprogrammed elements for various types of video editing. At this time, the standard standard for various types of image editing is stored in the storage unit 250 and is called by the validation module 272 at the time of validation, and the image file stored in the file temporary storage module 271. Is used as a test criterion during validation. The standard standard for image editing is provided to correspond to a template provided by the template provider 260. The validation module 272 checks whether the image file uploaded by the customer is suitable for the template selected by the customer.

Specific inspection methods performed by the validation module 272 are as follows.

1) Check for Metadata Existence

The image file contains metadata representing the attributes of the image file. The meter data includes information such as the size / resolution / producer / date of the corresponding image file, as shown in FIG. 4. In addition, when the GPS is turned on when taking a picture or video, the metadata of the corresponding image file may include location information. In addition, as shown in FIG. 5, the meter data includes camera information of photographing the corresponding image file.

The validity checking module 272 checks whether the metadata exists for each image file uploaded by the customer, and if the metadata does not exist, determines that the image file is not valid. In addition, even if the metadata exists, if at least one of the size / resolution / manufacturer / date / location information of the image file is missing, it is determined that the image file is not valid.

2) Check the size of the image file

If the size information of the image file included in the meta data of the image file is smaller than the standard specification, it is determined that the image file is not valid.

3) Examine the face area of the person in the image file

After executing the face recognition algorithm to check the face area of the subject in the image file, if the color contrast value of the color contrast between the outer line of the face area and the background is less than the preset reference value, the image file is invalid. To judge. At this time, instead of inspecting the face areas of all subjects in the image file, the feature points of the customer faces are extracted from the customer photos uploaded when the image file is uploaded by the customer, and the customer face areas in the image file are extracted based on the extracted feature points. After extraction, the face area is examined through color contrast.

4) Check for Existing Image Files

From the plurality of image files uploaded by the customer, the continuous shots are extracted, and any one of the continuous shots is treated as a valid image file, and the remaining similar continuous shots are regarded as duplicate image files. The file is considered invalid.

The inspection process of the validation module 272 is output through the task manager as illustrated in FIG. 6 so that the customer can directly monitor and confirm the validity of the image file.

As a result of the inspection by the validity checking module 272, if an error is found in the image file, the file modification module 273 generates an error check page as illustrated in FIG. 7. The error check page illustrated in FIG. 7 indicates that the size of the image file is small when the customer uploads the image file uploaded through the client terminal 100 so that the size of the image file is small. You are requesting to upload a file. In addition, when the uploaded image file is not clear and does not meet the video editing standard, the user is notified that the sharpness of the image file is not appropriate, and a solution for this is requested to upload another image file. The customer can clear the error by uploading another image file via the file reacceptance field provided on the error check page.

Meanwhile, in FIG. 7, the preview screen outputs the edited image using the image file uploaded by the customer. The preview screen outputs the edited video using the image file uploaded by the customer. If the customer uploads another image file in place of the image file in error, the preview screen may output the edited edited image by using the uploaded image file.

After this validation, the original image file is saved in the original backup folder, and the reporting file including status information is stored in the reporting folder. The reporting file is then subjected to data transformation processing by the XML parsing module 275, the contents of which are known to the customer via the web site. In this case, the reporting file may include information on whether the image file uploaded by the customer has passed or failed the validation check, and in case of failure, information related to the cause of the failure.

Meanwhile, as a result of the validation, if the file is valid, the file is stored in the success folder, and if the file is invalid, the file is stored in the error folder. Then, the DB update module 276 updates the status information or error information of the uploaded image file to the database. Save it.

The image file selector 280 sorts and sorts the image files that have passed the validity check by the image file inspector 270 according to a selection criterion. The selection criteria are criteria for selecting a plurality of image files according to the number of images defined in the template. For example, the selection criteria may be a date when the image file is produced, a region where the image file is produced, an image file creator, and the like. Or it may be the date and region the image file was produced, the creator of the image file and the date / region of the image file. Alternatively, the selection criteria may be determined according to the attributes of the template provided by the template provider 260.

The image file sorting unit 280 sorts the image files so as to match the number of images defined in the template (for example, 30) among the image files uploaded by the customer (for example, 60 image files) according to the sorting criteria. Classify. The image file selector 280 may select only one sorting criterion, but sort the image files according to the plurality of sorting criteria and classify the plurality of image file sets. In this case, any one image file may be selected by overlapping the plurality of image file sets. For example, if a customer uploaded 60 image files and 50 image files passed validation, the 50 image files could be categorized according to screening criteria to create three sets of image files consisting of 30 image files. Can be screened. This set of image files constitutes a candidate video compilation.

The image editor 290 edits the candidate image edit using the image file set automatically selected by the image file selector 280. The image editor 290 edits a plurality of candidate image edits by using a plurality of image file sets selected and classified by the image file selector 280.

The output unit 240 outputs each of the candidate video edits as a preview screen. The customer checks each of the plurality of candidate video edits and finally selects one of the most favorite candidate video edits to confirm the video edits.

At this time, even if the customer finally selects one candidate video edit and confirms the final video edit, if the specific image (or video) is not satisfied in the final video edit, select the slide into which the image is inserted. You can replace it with another image. If you want to replace it with another image, you can select and upload the image file you want to replace.

According to the video auto-editing terminal and the video auto-editing system including the same according to the present invention, when a customer uploads an image file, a plurality of image files are collectively collected without the need to select and upload the image file. While uploading, it is possible to receive a video edit by the selected image file, thereby improving the ease of use. In addition, the validity of the image file uploaded by the customer can be automatically checked and corrected automatically, or the customer can be re-uploaded another valid image file to reduce the likelihood that an image file inappropriate for the video edit will be used. In addition, since a plurality of candidate video edits can be presented to the customer by using the image files uploaded randomly by the customer, and the final video edit can be provided according to the customer's selection, convenience of use can be improved.

As mentioned above, although an embodiment of the present invention has been described, those of ordinary skill in the art may add, change, delete or add elements within the scope not departing from the spirit of the present invention described in the claims. The present invention may be modified and changed in various ways, etc., which will also be included within the scope of the present invention.

100: client terminal 200: automatic image editing terminal
210: control unit 220: communication unit
230: input unit 240: output unit
250: storage unit 260: template providing unit
270: image file checker 280: image file selector
290: video editing unit

Claims (5)

Communication unit for transmitting and receiving information with the client terminal through a wired or wireless communication network;
An input unit for providing an order option input field for inputting an order option selectable by a customer in relation to image editing and a file upload field for uploading a plurality of image files to be edited;
An image file inspector for validating a plurality of image files uploaded by a customer;
An image file selection unit for automatically selecting an image file to be used for image editing among a plurality of image files whose validity checks have been completed; And,
Image editing unit for editing the image using the image file automatically selected by the image file selection unit
Automatic image editing terminal comprising a.
The method according to claim 1,
The apparatus further includes a template providing unit that provides templates of various formats pre-produced to the client terminal, and image files are uploaded through the client terminal with a larger number of image files than the number of images defined in the template. terminal.
The method according to claim 1, wherein the image file inspection unit,
A file temporary storage module for storing the image file;
A validation module for checking whether the image file conforms to a video editing standard;
A file modification module for generating an error check page when an error is found in the image file;
Save the image file after validation, the original backup folder for storing the original of the image file, the reporting folder for storing the reporting file containing status information, the success folder for storing valid files, the error for storing invalid files Post-scan file storage module including folders
Automatic video editing terminal comprising a.
The method according to claim 1,
The image file selection unit,
Selecting and sorting a plurality of image file sets by automatically selecting an image file to be used for editing the image, based on at least one of the date the image file was produced, the region where the image file was produced, and the producer of the image file.
And the image editing unit edits a plurality of candidate image edits using the plurality of image file sets.
The automatic image editing terminal according to any one of claims 1 to 4;
And a client terminal capable of accessing a web site provided by the automatic image editing terminal and transmitting an order option and an image file.

Images