KR20190058847A - Photo­book production apparatus for recommending user customized photo­book services and the method thereof - Google Patents

Abstract

The present invention relates to a photo book production apparatus for recommending a customized photo book service according to user pattern information and user preference using information on a plurality of images included in a mobile device and a method thereof. The apparatus may classify and cluster information on selected images suitable for photo book production of a plurality of images included in a mobile device through a deep learning method and recommend customized photo book service according to the clustered information on the selected images.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a photobook production apparatus and a method thereof for recommending a customized photobook service,

The present invention relates to a photobook production apparatus and a method thereof for recommending a customized photobook service, and more particularly, to a photobook production apparatus and a method thereof for recommending a customized photobook service by using a plurality of image information included in a mobile device, The present invention relates to a photo book manufacturing apparatus that is recommended.

In recent years, there have been more and more people who print photographs taken with a digital camera or a mobile phone camera, such as photobooks, photo frames, cards, or gift items. Among them, photobook production includes, for example, a mobile device such as a personal computer (PC), a laptop computer, a smart phone, a tablet, and a wearable computer carried by a user Selecting a theme, a style, a template, a resource, and the like for creating a photobook using the selected image, and selecting and arranging any of a plurality of images included in the mobile device according to the selection.

That is, in order to make a photobook, an existing user selects photobook information such as a photobook size, a number of photobook pages, a photobook style and a photobook theme, selects a template and a resource according to each photobook information, A plurality of images were edited and arranged in accordance with the layout to produce a photobook.

Accordingly, in the present specification, a technique for recommending a customized photobook service suitable for a plurality of image information included in a mobile device is proposed.

&Quot; IDENTIFYING CONTENT ITEMS USING A DEEPLEARNING MODEL ", U.S. Published Patent Application No. US2017 / 0132510

It is an object of the present invention to provide a method and system for classifying and clustering SELM image information suitable for photobook production among a plurality of images included in a mobile device based on a Deep Learning technique and providing a customized photobook service according to the clustered SELM image information I would like to provide a recommendable technique.

It is also an object of the present invention to extract at least one photobook information of a customized photobook size, a number of photobook pages, a photobook style, and a photobook theme according to a result of clustering, Edit, and arrange a photo book service.

It is also an object of the present invention to provide a technique capable of editing and positioning and arranging a selec- tive image according to a facial recognition result for selct image information.

A personalized photobook producing apparatus installed in a photobook editing software of a mobile device according to an embodiment of the present invention to provide a photobook service, the apparatus comprising: And a photobook recommending unit for recommending a customized photobook service according to user pattern information and user preference. The photobook recommending unit includes: an image selector unit for sorting and categorizing the select image information suitable for fabrication;

In addition, a customized photobook production apparatus according to an embodiment of the present invention includes a pattern learning unit that learns the user pattern information for photobook production, and a pattern learning unit that generates a photobook service based on the plurality of image information generated in the mobile device. And a control unit for pushing the recommendation.

The pattern learning unit obtains the user preference based on a usage pattern and an order pattern of a user for making a photobook, and stores the user preference in accordance with the user preference in the photobook size, the number of photobook pages, the photobook style, The user pattern information can be learned.

The image selector may cluster the select image information received from the mobile device by item using a Deep Learning technique which is the machine learning algorithm.

The image selec- tory unit clusters the SEL image information according to items such as a theme, an object, a text, a creation date and a location, and clusters the SEL image information according to the facial recognition result.

The photobook recommending unit may include a template selected by at least one of photobook information of a customized photobook size, a number of photobook pages, a photobook style, and a photobook theme according to clustering classified by items, a resource, and a layout Accordingly, the clustered SEL image information can be arranged to recommend the customized photo book service.

The photobook recommending unit may display each of the clustered selec- tive image information on the layout by centering the face on the basis of the face recognition result extracted by the image selec- tion unit.

Wherein the controller is adapted to use the customized photobook service through the mobile device if the plurality of image information generated by the mobile device is suitable for the selected image information to be classified and clustered and exceeds a preset capacity or number Can be pushed.

Wherein the control unit transmits the plurality of pieces of image information included in the mobile device to an external server, receives analysis results of the plurality of pieces of image information from the external server, Can be provided to the recommendation department.

A customized photobook production system according to another embodiment of the present invention is a system for displaying and providing a customized photobook service according to a plurality of image information, comprising: a mobile device for receiving a selection input from a user; And an external server for recommending the customized photobook service according to the user's preference and the clustered selec- tive image information, the user pattern information, .

The external server may include a template selected by at least one of photobook size, photobook page number, photobook style, and photobook theme recommended according to the user pattern information and the user preference, And the clustered selct image information according to the layout.

The external server can recommend the customized photobook service to the mobile device by arranging each of the clustered selec- tive image information in the layout on the basis of the facial recognition result for the selct image information.

A method of operating a customized photo book production apparatus provided with photo book editing software of a mobile device according to an exemplary embodiment of the present invention to provide a photo book service, the method comprising: Classifying and sorting the SEL image information suitable for the photobook production into items, and recommending the customized PHOTOBOOK service according to the clustered SEL image information, the user pattern information, and the user preference.

The sorting and clustering of the SEL image information items may cluster the SEL image information received from the mobile device by using a Deep Learning technique as the machine learning algorithm.

The step of recommending the customized photobook service includes a template selected by at least one of photobook information of a customized photobook size according to clustering classified by items, a number of photobook pages, a photobook style, and a photobook theme, , The clustered selct image information may be arranged according to the resource and the layout to recommend the customized book service.

According to the embodiment of the present invention, it is possible to categorize and categorize the select image information suitable for the photobook production among the plurality of images included in the mobile device based on the Deep Learning technique, Book service can be recommended.

Further, according to the embodiment of the present invention, at least any one of the photobook information of the customized photobook size, the number of photobook pages, the photobook style, and the photobook theme is extracted according to the clustering result, Can be customized to edit and place the recommendation of the photobook service.

In addition, according to the embodiment of the present invention, the selec- tive image can be edited, positioned, and placed according to the face recognition result for the selec- tive image information.

FIG. 1 is a view for explaining a detailed configuration of a customized photobook production apparatus according to an embodiment of the present invention.
Figure 2 illustrates an example of clustering in accordance with an embodiment of the present invention.
3A and 3B show application examples of a mobile device according to an embodiment of the present invention.
4 illustrates an exemplary configuration of a photobook service according to an embodiment of the present invention.
5 is a view for explaining a configuration of a customized photobook production system according to another embodiment of the present invention.
Figure 6 shows a flow chart of a customized photo book production method according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. In addition, the same reference numerals shown in the drawings denote the same members.

Also, terminologies used herein are terms used to properly represent preferred embodiments of the present invention, which may vary depending on the viewer, the intention of the operator, or the custom in the field to which the present invention belongs. Therefore, the definitions of these terms should be based on the contents throughout this specification.

The present invention relates to a photobook production apparatus and method for recommending a customized photobook service, and a photobook production apparatus provided with photobook editing software for providing a photobook service. For example, a customized photobook production apparatus according to an embodiment of the present invention may be an application, and may be installed and performed by a user on a mobile device.

A customized photobook production apparatus according to an embodiment of the present invention may be stored in a mobile device or may be incorporated in a mobile network using a plurality of associated image information linked to an SNS (Social Networking Service) Service is recommended. At this time, the mobile device may be a terminal device possessed by the user and may be a personal computer, a laptop computer, a smart phone, a tablet, and a wearable computer ). ≪ / RTI >

Further, according to the embodiment of the present invention, a technique of recommending a customized photo book service installed in a mobile device owned by a user by using photo book editing software or a customized photo book service using an external server in a mobile device It may be recommended. For example, according to another embodiment of the present invention, the external server generates a customized photobook service according to user pattern information and user preference using a plurality of image information received from the mobile device, and recommends the photobook service to the mobile device It is possible.

That is, the present invention can create a customized photo book service according to a plurality of pieces of image information in a mobile device or an external server, and recommend it to a mobile device.

Hereinafter, the present invention will be described in detail with reference to FIGS. 1 to 6. FIG.

FIG. 1 is a view for explaining a detailed configuration of a customized photobook production apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a customized photo book production apparatus according to an exemplary embodiment of the present invention recommends customized photo book service based on user pattern information and user preference using a plurality of image information included in a mobile device.

To this end, the customized photobook production apparatus 100 according to the embodiment of the present invention includes an image selection unit 110 and a photobook recommending unit 120.

The image selector 110 classifies and clusters the SEL image information suitable for photobook production based on the machine learning algorithm among a plurality of pieces of image information received from the mobile device.

Hereinafter, an image selector according to an embodiment of the present invention will be described in detail with reference to FIG.

Figure 2 illustrates an example of clustering in accordance with an embodiment of the present invention.

2, an image selector 110 according to an embodiment of the present invention classifies a plurality of pieces of image information 10 received from a mobile device on the basis of a machine learning algorithm into items A, B, and C And clustering (210, 220, 230).

The image selector 110 according to the embodiment of the present invention may store a plurality of image information 10 stored in a mobile device held by a user or a plurality of image information 10 on a social networking service (SNS) It is possible to classify the cell image information 20 among the cell image information 10 as shown in FIG. At this time, the selct image information 20 may be image information suitable for photobook production.

Specifically, among the large amount of image information 10 stored or included in the mobile device or interworking on the SNS, the image quality of the close-up picture or the overlapping picture, the image with low resolution, the image which is not suitable for making a photobook, For example, a capture image, a business image, and an image for confirmation are included, so it is necessary to exclude it. Accordingly, the image selector 110 can extract the selec- tive image information 20 suitable for the photobook production among the plurality of image information 10 by using the Deep Learning technique, which is a machine learning algorithm, The selected cell image information 20 can be classified into clusters 210, 220, and 230 according to the items A, B, and C such as a theme, an object, a text,

For example, the image selection unit 110 may classify a theme such as a trip, a sea, a friend, a group, a family and a poisonous person, an object classification such as a building, a place, an object and a person, a text classification, And the like. Further, the image selector 110 may cluster the selctery information 20 according to the classification or item, or cluster the selektor image information 20 using the generation date and the area. The creation date and region (or location) can be a clear reference for objectively categorizing the unclear selct image information 20.

The customized photobook production apparatus 100 according to the embodiment of the present invention may further include a pattern learning unit 140 for learning user pattern information on the photobook production. The image selection unit 110 may include a deep learning technique The user pattern information and the user preference learned from the pattern learning unit 140 can be utilized in the process of extracting and classifying the SEL image information 20 and clustering it 210,

For example, the pattern learning unit 140 may calculate a usage pattern for each of a photobook size, a number of photobook pages, a photobook style, and a photobook theme based on a history of a user creating a photobook And an order pattern, thereby learning user pattern information according to user preference and user preference. Accordingly, the image selector 110 can extract, sort, and clustering (210, 220, 230) the selec- tive image information 20 customized to the user by using the user preference, the user pattern information, .

2, the image selector 110 according to the embodiment of the present invention extracts the selftest image information 20 suitable for the photobook production among the plurality of image information 10, The clustering 210 can be classified into the same location A by the same location A and classified by the object B of the same object, for example, the Eiffel tower of Paris, the Leaning Tower of Pisa of Italy, Clustering 220 according to the creation date may be formed, and clustering 230 according to creation days may be formed by classifying the same creation day (C). As another example, the image selector 110 according to the embodiment of the present invention may cluster the SEL image information by the person according to the facial recognition result of the SELF image information 20. [ However, items for sorting and clustering the selcture image information 20 are not limited thereto.

Referring again to FIG. 1, the photobook recommending unit 120 of the customized photobook producing apparatus 100 according to the embodiment of the present invention includes clustering selected image information, user pattern information, and customized photobook service Is recommended.

The photobook recommending unit 120 includes a template selected by at least one of photobook information of a customized photobook size according to clustering classified by items, a number of photobook pages, a photobook style, and a photobook theme, And arranging the selec- tive image according to the layout to recommend the customized photo book service. In addition, the photobook recommending unit 120 can determine the title of the photobook service using the clustered selct image information.

For example, the photobook recommending unit 120 sets the theme of the photobook book to be customized to the characteristics of the clustered selec- tive image information 20, for example, a travel theme, and specifies the cover type, cover type, And the number of pages of at least one of 6x6, 5x7, 8x8, 8x10, A4, 10x10, and 12x12 selected according to the photobook style and the photobook style. At this time, the photobook recommending unit 120 preferentially reflects the user preference and the user pattern information received from the pattern learning unit 140 to recommend the photobook size, the number of photobook pages, the photobook style, and the photobook theme , Templates, resources, and layout design, number, and layout.

Thereafter, the photobook recommending unit 120 can edit and arrange the SELECTION images clustered according to travel themes according to the templates, resources, stickers, and layouts included in each page of the photo book. At this time, the photobook recommending unit 120 can display each of the clustered selec- tive images in the layout on the basis of the face recognition result extracted by the image selec- tor 110, and display them. For example, the photobook recommending unit 120 may arrange the faces in each SEL image extracted through the face detection technique according to the number and position of the layout included in the photo book page. However, when a plurality of persons in the selec- tive image are included, it is possible to extract face regions for a plurality of persons and arrange them in the layout based on the extracted face regions.

The photobook recommending unit 120 can recommend a product type such as a photo frame, a card, a mug, a tumbler, a cell phone case, a garland, etc. using the selec- tive image information in addition to a recommendation of a customized photobook service using the selec- , Based on images such as texts, index based on statistical data, user base such as clicks, referrals, order history, search conditions, behavior patterns, and customized photo based on events such as 100 days, 1st anniversary, 10th anniversary, Book service, picture frame, card, mug, tumbler, cell phone case, garland etc. can be recommended.

1, a customized photobook production apparatus 100 according to an exemplary embodiment of the present invention may further include a controller 130. The controller 130 may control the image forming apparatus 100 based on a plurality of pieces of image information generated in the mobile device The recommendation of the photobook service can be pushed.

In one embodiment, based on the select image information classified and clustered in the image selector 110, the controller 130 may instruct the user to select a customized photo book service Can be pushed. In addition, the control unit 130 may guide the provisional photobook service according to the clustered selec- tive image information. The control unit 130 may provide the photobook service through the photobook recommending unit 120 according to the user's selection input received from the mobile device. You can also control referrals.

Alternatively, the controller 130 may transmit a plurality of pieces of image information stored in the mobile device held by the user or a plurality of pieces of image information on a Social Networking Service (SNS) linked to the mobile device to an external server, And provides analysis results to the image selec- tion unit 110 and the photobook recommending unit 120. The image selecting unit 110 and the photobook recommending unit 120 may be configured to receive the analysis result. In this case, the analysis performed by the external server may be classified according to items of image information, or classified according to theme such as travel, sea, friend, group, family, and poisonous person, object classification such as building, place, Text classification, number classification, facial classification through facial analysis, and emotional classification.

As another example, the control unit 130 may select and apply a photobook cover or inlay resource, image, layout, background, sticker, text and template corresponding to photobook information recommended by the photobook recommending unit 120 . Further, the control unit 130 may edit the photobook service according to the user's selection input for the customized photobook service provided to the mobile device.

3A and 3B show application examples of a mobile device according to an embodiment of the present invention.

3A, a customized photobook production apparatus according to an embodiment of the present invention includes at least any one of a customized photobook size, a number of photobook pages, a photobook style, and a photobook theme according to clustering classified by items A SELECTION IMAGE can be added and arranged according to a template, a resource, and a layout selected by information.

For example, a photobook includes a plurality of pages 310, and each of the photobook pages 310 may include templates, resources, and layouts of different shapes, designs, numbers, and the like. At this time, the resource may be an image, a background, a sticker, and text for providing a photobook service.

3B and 3C show an example of arranging the horizontal selec- tive image in the vertical layout. When the horizontal selec- tive image 320 is automatically arranged in the vertical layout 330, As shown, the entire selec- tive image 320 is located at the center of the vertical layout 330, so that the person located at the left edge of the selec- tive image 320 is not included in the layout.

Referring to FIG. 3C, a customized photobook production apparatus according to an embodiment of the present invention extracts a person from the selec- tive image 320 through face detection technology, 330).

According to an embodiment, a customized photo book production apparatus according to an embodiment of the present invention can crop the face included in the select image 320 and place it in the layout 330, and the select image 320 ), A plurality of face regions can be extracted and arranged in the layout 330. Fig. For example, the customized photobook production apparatus according to the embodiment of the present invention calculates the ratio of the layout 330 and the select image 320 as in the general page pool method, and calculates the face area in the selct image 320 according to the calculated value And can be positioned at the center of the layout 330. [ However, if the face area is arranged at the center of the layout 330, a blank space in the area of the layout 330 may be formed. Therefore, the customized photobook producing apparatus according to the embodiment of the present invention may be configured to include the selct image 320 ) Can be moved up / down or left / right, or a zoom in / out method or an image full method can be used.

4 illustrates an exemplary configuration of a photobook service according to an embodiment of the present invention.

The customized photobook production apparatus according to the embodiment of the present invention is a template for creating a template based on the classified image information classified and grouped by each item of school / education such as family such as marriage and baby, travel / honeymoon, , Resources and layouts, and customized photobook services.

Referring to FIG. 4, page templates in a multiform template include a layout that can include a plurality of images, and the number of configurable images is fixed. Accordingly, the customized photobook production apparatus according to the embodiment of the present invention manages the layout usable for each template, and can select and apply a layout according to the clustered selct image information. At this time, the resources such as the background, the sticker, and the text in each template are not changed, and a plurality of predetermined layout forms are used as they are according to various concepts and themes.

However, classification items, multi-form templates, templates, and types, forms, and styles of the layout constituting the photobook service are not limited thereto.

5 is a view for explaining a configuration of a customized photobook production system according to another embodiment of the present invention.

Referring to FIG. 5, a customized photo book production system 500 according to an embodiment of the present invention includes a mobile device 510 and an external server 520. Although FIG. 5 illustrates a single mobile device 510 for the sake of clarity, communication between a plurality of mobile devices 510 and an external server 520 may be performed.

The mobile device 510 displays and provides a customized photobook service according to a plurality of image information, and receives a selection input from the user.

For example, the mobile device 510 may store a plurality of image information or a plurality of image information on an associated SNS (Social Networking Service) through an Ethernet / 3G, 4G, or 5G wireless data communication to an external server 520). In addition, the mobile device 510 may receive information related to the analysis results from the external server 520 via wireless data communication, and may receive selection inputs from the user. However, the communication between the mobile device 510 and the external server 520 is based on a WiFi connection or a charging state.

The mobile device 510 may be at least one of a personal computer (PC), a laptop computer, a smart phone, a tablet, and a wearable computer, (Not shown), a memory unit (not shown), an input unit (not shown), an output unit (not shown), and a communication unit / controller (not shown). In this case, the communication unit / control unit may be referred to as the control unit 130 shown in FIG.

The display unit is based on a first screen including a plurality of items making up a customized photo book service and a touch sensitive surface, sensor or sensor set that receives input from a user based on haptic or tactile contact. And display a second screen including at least one item related to the function.

The memory unit may include a high speed random access memory, a magnetic disk, an SRAM, a DRAM, a ROM, a flash memory or a non-volatile memory.

The input unit may include a touch keyboard, a touch input, a touch pad, a dial, a slider switch, a button, etc. The output unit may output a warning sound using an audio module, a speaker module or a buzzer, The warning light can be blinked by using the vibration module, and the vibration can be outputted by using the vibration module.

The communication unit / control unit may convert an electric signal into an electromagnetic signal, convert an electric signal from the electromagnetic signal, communicate with the communication network, another communication apparatus, and an external apparatus through the electromagnetic signal, and may include a processor, a central processing unit, Or a communication processor.

The external server 520 classifies and categorizes the select image information suitable for photobook production into items based on the machine learning algorithm among the plurality of pieces of image information received from the mobile device 510, And customized photo book service based on user preference.

For example, the external server 520 may determine at least one of the photobook size, the number of photobook pages, the photobook style, and the photobook theme recommended according to the user pattern information and the user preference, Templates, resources and layouts. In addition, the external server 520 can recommend a personalized photo book service to the mobile device by locating each of the clustered selec- tive images in the layout on the basis of the facial recognition result for the selec- tive image information.

More specifically, the external server 520 can receive a plurality of pieces of image information from the mobile device 510 after authentication with the mobile device 510 using the user information, and can perform deep learning of the big data model, Technique, the theme, object, text, creation date and location of the image information are analyzed, and analysis of sharpness, affinity, presence of speaker, and uploading of SNS can be analyzed.

Then, the external server 520 extracts the SEL image information suitable for the photobook production among the plurality of pieces of image information based on the analysis result, and outputs the extracted SEL image information as a theme, an object, a text, Or an EXchangeable Image File format (Exif).

According to an embodiment, the external server 520 may push the use of the customized photobook service to the mobile device 510 if the capacity or number of the selectable images to be clustered exceeds a predetermined criterion. Further, the external server 520 may control the recommendation of the customized photobook service from the user ' s selection input via the mobile device 510. [

According to another embodiment, the external server 520 may provide a recommendation of a customized photobook service using select image information, a product type of a frame, card, mug, tumbler, mobile phone case, (510), and can be recommended as a user base such as an image based on places, texts, index based on statistical data, clicks, recommendation numbers, order details, search conditions and behavior patterns, and 100 days, A photo book service, a photo frame, a card, a mug, a tumbler, a cellular phone case, and a garland may be recommended according to an event basis such as a holiday,

Figure 6 shows a flow chart of a customized photo book production method according to an embodiment of the present invention.

The method shown in FIG. 6 can be performed by a customized photobook production apparatus that is installed in the photobook editing software of the mobile device shown in FIG. 1 and provides a photobook service.

In step 610, the SEL image information suitable for the photobook production is classified and clustered based on the machine learning algorithm among the plurality of pieces of image information received from the mobile device.

Step 610 may be a step of clustering the SEL image information received from the mobile device by item using a Deep Learning technique which is a machine learning algorithm. For example, in operation 610, a plurality of pieces of image information stored in a mobile device owned by a user or a plurality of pieces of image information on a Social Networking Service (SNS) A theme, an object, a text, a creation date and a location, and clustering according to a classification item.

In step 620, the clustered selec- tive image information, user pattern information, and customized photobook service according to user preferences are recommended.

Step 620 includes at least one of the photobook information of at least one of the customized photobook size, the number of photobook pages, the photobook style, and the photobook theme according to the clustering classified by items, the template selected by the photobook information, And recommending the customized photo book service by arranging the selec- tive image according to the layout. In addition, the step 620 may determine the title of the photobook service using the clustered selct image information.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical media such as CDROMs and DVDs, magnetic optical media such as floppy disks, magnetooptical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

10: Multiple image information
20: Select image information
100: Customized photobook production device
210, 220, 230: Clustering
310: Photo Book Page
320: Select image
330: Layout
500: Customized Photobook Production System

Claims (16)

A customized photobook production apparatus installed in a photobook editing software of a mobile device to provide a photobook service,
An image selector for classifying and sorting the SEL image information suitable for photobook production based on a machine learning algorithm among a plurality of pieces of image information received from the mobile device; And
A photobook recommending section for recommending the customized photobook service according to the user preference and the user pattern information and the clustered selct image information,
And a photographed photo book production device. The method according to claim 1,
A pattern learning unit for learning the user pattern information on the photobook production; And
A controller for pushing recommendation of the photobook service based on the plurality of pieces of image information generated in the mobile device
Further comprising: means for generating a customized photobook program. 3. The method of claim 2,
The pattern learning unit
Acquiring the user preference on the basis of a usage pattern and an order pattern of a user for a photobook production, calculating the user pattern information according to the user preference in each of a photobook size, a number of photo book pages, a photo book style, A customized photobook production system for learning. The method according to claim 1,
The image selector
Wherein the select image information received from the mobile device is clustered by item using a Deep Learning technique which is a machine learning algorithm. 5. The method of claim 4,
The image selector
Clustering the SEL image information by items such as a theme, an object, a text, a creation date and a location, and clustering the SEL image information by a person according to a facial recognition result. The method according to claim 1,
The photo book recommending unit
A template selected by at least one of photobook information of a customized photobook size according to clustering classified by items, a number of photobook pages, a photobook style, and a photobook theme, resources, and layout, And arranging image information to recommend the customized photobook service. The method according to claim 6,
The photo book recommending unit
And displays the clustered selec- tive image information on the layout by centering the face on the basis of the face recognition result extracted by the image selec- tion unit. 3. The method of claim 2,
The control unit
Wherein the mobile device is adapted to push the use of the customized photobook service through the mobile device if the plurality of image information generated by the mobile device is suitable for the select image information to be classified and clustered and exceeds a predetermined capacity or number, Photobook production device. 3. The method of claim 2,
The control unit
The image processing method according to claim 1, further comprising: transmitting the plurality of pieces of image information included in the mobile device to an external server, receiving analysis results of the plurality of pieces of image information from the external server, A customized photobook production device provided. A mobile device displaying and providing a customized photobook service according to a plurality of pieces of image information, and receiving a selection input from a user; And
And classifying and sorting the SEL image information suitable for photobook production based on the machine learning algorithm among the plurality of pieces of image information received from the mobile device and classifying the sorted image information into CLOBs according to the clustered SEL image information, External server recommending customized photo book service
The system comprising: 11. The method of claim 10,
The external server
Depending on the template selected by at least one of the photobook size, the number of photobook pages, the photobook style and the photobook theme, and the photobook information recommended according to the user pattern information and the user preference, And arranging the clustered selct image information. 12. The method of claim 11,
The external server
Arranging each of the clustered selec- tive image information in the layout on the basis of a face recognition result of the selec- tive image information to recommend the customized book service to the mobile device. A method of operating a customized photo book production apparatus installed in a photo book editing software of a mobile device to provide a photo book service,
Classifying and sorting the SEL image information suitable for photobook production based on a machine learning algorithm among a plurality of pieces of image information received from the mobile device by items; And
Recommending a customized photobook service according to the clustered selec- tive image information, user pattern information, and user preferences
The method comprising the steps of: 14. The method of claim 13,
The step of classifying and clustering the SEL image information by items
The method of claim 1, wherein the selection information received from the mobile device is clustered by item using a Deep Learning technique that is a machine learning algorithm. 14. The method of claim 13,
The step of recommending the customized photo book service
A template selected by at least one of photobook information of a customized photobook size according to clustering classified by items, a number of photobook pages, a photobook style, and a photobook theme, resources, and layout, And arranging image information to recommend the customized photobook service. 16. A computer program stored in a computer-readable medium for performing the method of any one of claims 13 to 15.

Images