KR102054300B1 - Photo­book production apparatus for recommending user customized photo­book services and the method thereof - Google Patents

Abstract

The present invention relates to a photobook production apparatus and method for recommending a photobook service for recommending a photobook service according to user pattern information and user preferences using a plurality of image information included in a mobile device, and deep learning. A deep learning technique may classify and cluster select image information suitable for photobook production among a plurality of images included in a mobile device, and recommend a customized photobook service according to the clustered select image information.

Description

Photobook production device recommending customized photobook service and its method {PHOTO­BOOK PRODUCTION APPARATUS FOR RECOMMENDING USER CUSTOMIZED PHOTO­BOOK SERVICES AND THE METHOD THEREOF}

The present invention relates to a photobook production apparatus and method for recommending a customized photobook service, and more particularly, to a customized photobook service based on user pattern information and user preferences using a plurality of image information included in a mobile device. It is related with the recommended photobook production apparatus.

Recently, more and more people print photos taken with a digital camera or a mobile phone camera to produce photo books, frames, cards, or gift items. Among them, the photobook production includes mobile devices such as a personal computer, a laptop computer, a smart phone, a tablet, a wearable computer, etc. possessed by a user. It is performed by selecting a theme, a style, a template, a resource, etc. for producing a photobook, and selecting and arranging an arbitrary image among a plurality of images included in the mobile device according to the selection.

That is, an existing user selects photobook information such as photobook size, number of photobook pages, photobook style, and photobook theme for photobook production, and selects templates and resources according to each photobook information. Photobooks were created by editing and arranging a plurality of images to suit the layout.

Accordingly, the present specification proposes a technique for recommending a customized photobook service suitable for a plurality of image information included in a mobile device.

United States Patent Application Publication No. 2017/0132510 published on May 11, 2017 "IDENTIFYING CONTENT ITEMS USING A DEEP® LEARNING MODEL"

Disclosure of Invention An object of the present invention is to classify and cluster select image information suitable for photobook production among a plurality of images included in a mobile device based on a deep learning technique, and to provide a customized photobook service according to the clustered select image information. We want to provide a recommendation.

In addition, an object of the present invention is to extract at least one or more photobook information of the customized photobook size, photobook page number, photobook style and photobook theme according to the clustering result, and to tailor the select image information to the photobook information It is intended to provide a technology that can recommend a photobook service by editing and arrangement.

Another object of the present invention is to provide a technique for editing, positioning, and placing a select image according to a face recognition result of the select image information.

A custom photobook production apparatus installed with photobook editing software of a mobile device according to an embodiment of the present invention and providing a photobook service, comprising: a photobook based on a machine learning algorithm among a plurality of image information received from the mobile device; And an image selector for classifying and classifying select image information suitable for production, and a clustered selector image information, and a photobook recommender for recommending a customized photobook service according to user pattern information and user preferences.

In addition, the device for producing a custom photobook according to an embodiment of the present invention is based on the pattern learning unit for learning the user pattern information for photobook production and the plurality of image information generated on the mobile device based on the It may further include a control unit for pushing the recommendation.

The pattern learning unit obtains the user preferences based on a user's usage pattern and order pattern for photobook production, and according to the user's preference in each photobook size, number of photobook pages, photobook style, and photobook theme. The user pattern information can be learned.

The image selector may cluster the select image information received from the mobile device for each item by using a deep learning technique, which is the machine learning algorithm.

The image selector may cluster the select image information by an item such as a theme, an object, text, a creation date, and a location, and may cluster the select image information by a person according to a facial recognition result.

The photobook recommendation unit may include a template, a resource, and a layout selected by at least one of photobook information selected from among customized photobook sizes, photobook pages, photobook styles, and photobook themes according to clustering classified by items. Accordingly, the clustered select image information may be arranged to recommend the customized photobook service.

The photobook recommender may arrange and display each of the clustered select image information in the layout based on a face recognition result extracted by the image selector.

The controller may be configured to use the customized photobook service through the mobile device when the plurality of image information generated by the mobile device is suitable for the selected image information that is classified and clustered and exceeds a preset capacity or number. Can push

The controller transmits the plurality of image information included in the mobile device to an external server, receives an analysis result of the plurality of image information from the external server, and transmits the analysis result to the image selector and the photobook. Can be provided to the recommendation section.

According to another embodiment of the present invention, a custom photobook production system displays and provides a custom photobook service according to a plurality of image information, and receives a selection input from a user, and the plurality of images received from the mobile device. An external server that classifies and clusters select image information suitable for photobook production based on a machine learning algorithm among information, and recommends the customized photobook service according to the clustered select image information, user pattern information, and user preference. Include.

The external server may include a template and a resource selected by at least one photobook information among photobook size, photobook page number, photobook style, and photobook theme recommended according to the user pattern information and the user preference. And the clustered select image information according to a layout.

The external server may recommend the customized photobook service to the mobile device by arranging each of the clustered select image information in the layout based on a face recognition result of the select image information.

A method of operating a customized photobook manufacturing apparatus installed with photobook editing software of a mobile device and providing a photobook service according to an embodiment of the present invention, the method comprising: based on a machine learning algorithm among a plurality of image information received from the mobile device; And classifying and clustering the select image information suitable for photobook production by item, and recommending the clustered select image information, a custom photobook service according to user pattern information, and user preference.

The classifying and clustering the select image information for each item may cluster the select image information received from the mobile device for each item using a deep learning technique, which is the machine learning algorithm.

The recommending of the customized photobook service may include selecting a template based on at least one photobook information of a customized photobook size, photobook page number, photobook style, and photobook theme according to clustering classified by items. The clustered select image information may be arranged according to resources and layouts to recommend the customized photobook service.

According to an embodiment of the present invention, based on a deep learning technique, classifying and clustering select image information suitable for producing a photobook among a plurality of images included in a mobile device, and custom photo according to the clustered select image information We can recommend book service.

In addition, according to an embodiment of the present invention, according to the clustering result, at least one or more photobook information of the customized photobook size, the number of photobook pages, the photobook style, and the photobook theme is extracted, and the selected image information is selected from the photobook information. Photobook service can be recommended by editing and arranging in a customized manner.

In addition, according to an embodiment of the present invention, the select image may be edited and positioned and arranged according to a result of facial recognition of the select image information.

1 is a view illustrating a detailed configuration of a custom photobook manufacturing apparatus according to an embodiment of the present invention.
2 illustrates an example of clustering according to an embodiment of the present invention.
3A to 3B illustrate an application example of a mobile device according to an embodiment of the present invention.
4 illustrates a configuration example of a photobook service according to an embodiment of the present invention.
5 is a view illustrating a configuration of a custom photobook manufacturing system according to another embodiment of the present invention.
6 is a flowchart illustrating a method of manufacturing a custom photobook according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited or limited by the embodiments. Also, like reference numerals in the drawings denote like elements.

In addition, terms used in the present specification (terminology) are terms used to properly express preferred embodiments of the present invention, which may vary depending on the intention of the viewer, the operator, or customs in the field to which the present invention belongs. Therefore, the definitions of the terms should be made based on the contents throughout the specification.

The present invention relates to a photobook production apparatus for recommending a custom photobook service and a method thereof, and more particularly, to a custom photobook production apparatus installed with photobook editing software and providing a photobook service. For example, the custom photobook production apparatus according to the embodiment of the present invention may be an application, and may be installed and performed on a mobile device by a user.

An apparatus for producing a customized photobook according to an embodiment of the present invention may be stored in a mobile device or included in a mobile device or may be linked to an SNS (Social Networking Service) using a plurality of image information associated with a customized photobook according to user pattern information and user preferences. Recommend service In this case, the mobile device may be a terminal device possessed by a user, for example, a personal computer, a laptop computer, a smart phone, a tablet, and a wearable computer. It may be at least one of).

Furthermore, according to an embodiment of the present invention, a technology for recommending a customized photobook service is installed in a mobile device possessed by a user as a photobook editing software, or in another embodiment, a customized photobook service is performed from an external server to a mobile device. It may be recommended. For example, according to another embodiment of the present invention, the external server generates a custom photobook service according to user pattern information and user preference using a plurality of image information received from the mobile device, and recommends it to the mobile device. It may be.

That is, the present invention may generate a customized photobook service according to a plurality of image information in a mobile device or an external server, and may recommend it as a mobile device.

Hereinafter, the present invention will be described in detail with reference to FIGS. 1 to 6.

1 is a view illustrating a detailed configuration of a custom photobook manufacturing apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a custom photobook manufacturing apparatus according to an embodiment of the present invention recommends a custom photobook service based on user pattern information and user preference using a plurality of image information included in a mobile device.

To this end, the custom photobook manufacturing apparatus 100 according to the embodiment of the present invention includes an image selector 110 and a photobook recommender 120.

The image selector 110 classifies and clusters select image information suitable for producing a photobook among items based on a machine learning algorithm among a plurality of image information received from a mobile device.

Hereinafter, an image selector according to an exemplary embodiment of the present invention will be described in detail with reference to FIG. 2.

2 illustrates an example of clustering according to an embodiment of the present invention.

Referring to FIG. 2, the image selector 110 according to an embodiment of the present invention classifies a plurality of image information 10 received from a mobile device into items (A, B, C) based on a machine learning algorithm. And clustering (210, 220, 230).

The image selector 110 according to an exemplary embodiment of the present invention stores a plurality of image information 10 stored in a mobile device possessed by a user or a plurality of image information on an SNS (Social Networking Service) linked to the mobile device. The select image information 20 may be classified in step 10. In this case, the select image information 20 may be image information suitable for producing a photo book.

Specifically, among a large amount of image information 10 stored and included in a mobile device or linked on an SNS, the image quality of a macro photograph or a duplicate photo is poor, the resolution of which is not suitable or important for making a photo book, For example, it includes a capture image, business image, confirmation image, etc., it is necessary to exclude it. Accordingly, the image selector 110 may extract select image information 20 suitable for producing a photobook among the plurality of image information 10 by using a deep learning technique, which is a machine learning algorithm. The selected select image information 20 may be classified into items (A, B, and C) such as a theme, an object, a text, a creation date, and a location, and clustered (210, 220, 230).

For example, the image selector 110 may classify themes such as travel, sea, friends, groups, family, and dog pictures, classify objects such as buildings, places, objects, and people, text classification, number classification, and facial analysis. Facial expression classification and emotion classification can be performed. In addition, the image selector 110 may cluster the select image information 20 according to a classification or an item, or may cluster the select image information 20 using a generation date and a region. The generation date and region (or location) may be a definite criterion for objectively classifying the unclear select image information 20.

Custom photobook production apparatus 100 according to an embodiment of the present invention may further include a pattern learning unit 140 for learning user pattern information for photobook production, the image selector 110 is a deep learning technique In the process of extracting and classifying the select image information 20 based on the clustering (210, 220, 230), the user pattern information learned from the pattern learner 140 may be utilized.

For example, the pattern learning unit 140 uses patterns for each photobook size, photobook page, photobook style, and photobook theme that the user selected or preferred based on the history of the photobook creation. And order patterns, thereby learning user preferences and user pattern information according to user preferences. Accordingly, the image selector 110 may extract and classify the selector image information 20 according to the user's preference and user pattern information and the deep learning technique to cluster the clusters 210, 220, and 230. .

For example, referring to FIG. 2, the image selector 110 according to an exemplary embodiment of the present invention extracts select image information 20 suitable for producing a photo book from among a plurality of image information 10, and selects image information ( Clustering 210 according to the position can be formed by classifying the same by location (A) of 20), and the object by classifying it into the same object (B), for example, the Eiffel Tower in Paris, the Leaning Tower of Pisa, Italy, etc. The clustering 220 according to the present invention may be formed, or may be classified into the same generation date C to form the clustering 230 according to the generation date. As another example, the image selector 110 according to an exemplary embodiment of the present invention may cluster select image information for each person according to a facial recognition result of the select image information 20. However, items for classifying and clustering the select image information 20 are not limited thereto.

Referring back to FIG. 1, the photobook recommendation unit 120 of the custom photobook manufacturing apparatus 100 according to an embodiment of the present invention may provide a customized photobook service according to clustered select image information, user pattern information, and user preference. Recommended.

The photobook recommendation unit 120 may include a template and a resource selected by at least one of photobook information among custom photobook sizes, photobook pages, photobook styles, and photobook themes according to clustering classified by items. And by selecting the layout image according to the layout can recommend a custom photobook service. In addition, the photobook recommendation unit 120 may determine a title of the photobook service using the clustered select image information.

For example, the photobook recommendation unit 120 sets the photobook theme in accordance with the characteristics of the clustered select image information 20, for example, a travel theme, and includes a cover type, a cover coating type, a to type, and a bookbinding type. The photobook size and the number of pages of at least one of 6x6, 5x7, 8x8, 8x10, A4, 10x10, and 12x12 selected according to the photobook style and the photobook style may be set. At this time, the photobook recommender 120 recommends the photobook size, the number of photobook pages, the photobook style, and the photobook theme by first reflecting the user preference and user pattern information received from the pattern learner 140. , Design, number, and layout of templates, resources, and layouts.

Thereafter, the photobook recommendation unit 120 may edit and arrange the clustered select image for each travel theme according to templates, resources, stickers, and layouts included in each page of the photobook. In this case, the photobook recommendation unit 120 may arrange and display each of the clustered select images in the layout based on the face recognition result extracted by the image selector 110. For example, the photobook recommendation unit 120 may arrange a face in each select image extracted through face detection according to the number and positions of layouts included in the photobook page. However, when a plurality of people are included in the select image, face areas of the plurality of persons may be extracted and arranged in the layout based on the extracted face areas.

The photobook recommendation unit 120 may recommend product types such as photo frames, cards, mugs, tumblers, cell phone cases, and garlands using the select image information in addition to recommending a customized photo book service using the select image information. , Photo-based images, statistical data indicators, user bases such as clicks, referrals, order history, search conditions, behavior patterns, and event-based events such as 100 days, 1st anniversary, 10th anniversary, and anniversary Book services, photo frames, cards, mugs, tumblers, cell phone cases, and garlands may be recommended.

Referring to FIG. 1, the custom photobook manufacturing apparatus 100 according to the embodiment of the present invention may further include a controller 130, and the controller 130 is based on a plurality of image information generated in the mobile device. It can push the recommendation of photobook service.

According to an embodiment, based on the select image information classified and clustered in the image selector 110, the controller 130 may customize a photobook service to the user when the capacity or number of the clustered select images exceeds a preset criterion. Can push the use of Furthermore, the controller 130 may guide the temporary photobook service according to the clustered select image information, and the customized photobook service through the photobook recommendation unit 120 according to a user's selection input received from the mobile device. You can also control recommendations.

As another example, the controller 130 transmits a plurality of image information stored in a mobile device possessed by the user or a plurality of image information on an SNS (Social Networking Service) linked to the mobile device to an external server, An analysis result of the plurality of image information may be received from the image information, and the analysis result may be provided to the image selector 110 and the photobook recommendation unit 120. At this time, the analysis performed on the external server may be classified by the item according to a plurality of image information, or the theme classification such as travel, sea, friends, groups, family and dog pictures, object classification such as buildings, places, objects and people, It may be a task such as text classification, number classification, facial expression analysis and emotional classification through facial analysis.

As another example, the controller 130 may select and apply a resource, an image, a layout, a background, a sticker, a text, a template, and the like of a photobook cover or inlay corresponding to the photobook information recommended by the photobook recommender 120. Can be. In addition, the controller 130 may edit the photobook service according to a user's selection input for the customized photobook service provided to the mobile device.

3A to 3B illustrate an application example of a mobile device according to an embodiment of the present invention.

Referring to FIG. 3A, at least one photobook of a custom photobook size, photobook page number, photobook style, and photobook theme according to clustering categorized by items may be used. The select image may be added and arranged according to a template, a resource, and a layout selected by the information.

For example, the photobook may include a plurality of pages 310, and each of the photobook pages 310 may include templates, resources, and layouts of different shapes, designs, and numbers. In this case, the resource may be an image, a background, a sticker, and a text for providing a photobook service.

3B and 3C illustrate an example of arranging a horizontal select image in a vertical layout. In the related art related to photobook production, when the horizontal select image 320 is automatically disposed in the vertical layout 330, FIG. As shown in the drawing, the entire select image 320 is positioned at the center of the vertical layout 330 so that the person positioned at the left edge of the select image 320 is not included in the layout.

On the contrary, referring to FIG. 3C, the device for producing a custom photobook according to an embodiment of the present invention extracts a person from the select image 320 through face detection technology and uses a vertical layout based on the extracted face. 330) can be placed in the center.

According to an embodiment, the custom photobook manufacturing apparatus according to an embodiment of the present invention may be disposed on the layout 330 by cropping around a face included in the select image 320 and selecting the image 320. When a plurality of persons are included in the), a plurality of face regions may be extracted and arranged in the layout 330. For example, the custom photobook production apparatus according to the embodiment of the present invention calculates the ratio of the layout 330 and the select image 320 as in the general page pull method, and adjusts the face area in the select image 320 according to the calculated value. It may be positioned in the center of the layout 330. However, when the face area is disposed at the center of the layout 330, an empty space may be formed in the area of the layout 330, so that the custom photobook manufacturing apparatus according to the embodiment of the present invention may select the image 320 so that there is no empty space. ) Can be moved up / down or left / right, zoom in / out, or image pull.

4 illustrates a configuration example of a photobook service according to an embodiment of the present invention.

Custom photobook production apparatus according to an embodiment of the present invention is a template (Template) based on the clustered select image information classified by each item of school / education, such as family, travel / honeymoon, group and graduation, such as marriage and baby You can choose resources, layouts, and configure custom photobook services.

Referring to FIG. 4, page templates in a multiform template include a layout that may include a plurality of images, and the number of configurable images is determined. Accordingly, the apparatus for producing a custom photobook according to an embodiment of the present invention manages a layout available for each template, and selects and applies a layout according to clustered select image information. At this time, resources such as background, sticker, and text in each template are not changed, and it is basically based on using a plurality of preset layout forms according to various concepts and themes.

However, the types, shapes, and styles of the classification items, multiform templates, templates, and layouts that constitute the photobook service are not limited thereto.

5 is a view illustrating a configuration of a custom photobook manufacturing system according to another embodiment of the present invention.

Referring to FIG. 5, the customized photobook production system 500 according to the embodiment of the present invention includes a mobile device 510 and an external server 520. In FIG. 5, a single mobile device 510 is illustrated for clarity, but is not limited thereto. Communication between the mobile device 510 and the external server 520 may be performed.

The mobile device 510 displays and provides a customized photobook service according to the plurality of image information, and receives a selection input from the user.

For example, the mobile device 510 stores a plurality of stored image information or a plurality of image information on an associated SNS (Social Networking Service) through an external server (Wireless Data Communication of Ethernet / 3G, 4G, 5G). 520). In addition, the mobile device 510 may receive information related to the analysis result from the external server 520 through wireless data communication, and may receive a selection input from the user. However, the communication between the mobile device 510 and the external server 520 is performed based on a Wi-Fi connection or a charging state.

According to an embodiment, the mobile device 510 may be at least one of a personal computer, a laptop computer, a smart phone, a tablet, and a wearable computer. It may include a display unit (not shown), a memory unit (not shown), an input unit (not shown), an output unit (not shown), and a communication unit / control unit (not shown). In this case, the communication unit / control unit may refer to the controller 130 illustrated in FIG. 1.

The display unit is based on a first screen including a plurality of items constituting a customized photobook service and a touch sensing surface, a sensor, or a sensor set that receives an input from a user based on haptic contact or tactile contact. The second screen including at least one item related to the function may be displayed.

The memory unit may include high speed random access memory, a magnetic disk, an SRAM, a DRAM, a ROM, a flash memory, or a nonvolatile memory.

The input unit may include a touch keyboard, a touch input, a touch pad, a dial, a slider switch, a button, and the like, and the output unit may output a warning sound by using an audio module, a speaker module, or a buzzer, or output a light emitting diode (LED). Warning light can be flickered by using, and vibration can be output by using vibration module.

The communication unit / control unit may convert an electrical signal into an electromagnetic signal or convert an electrical signal from the electromagnetic signal, and communicate with a communication network, another communication device and an external device through the electromagnetic signal, and may include a processor, a central processing unit, an application processor, Or a communication processor.

The external server 520 classifies and clusters select image information suitable for producing a photobook among the plurality of image information received from the mobile device 510 by item, and clusters the selected cluster image information and the user pattern information. And custom photobook services based on user preferences.

For example, the external server 520 may include at least one or more photobook information among photobook sizes, photobook pages, photobook styles, and photobook themes recommended according to user pattern information and user preferences, and selected templates ( You can place select images according to templates, resources, and layouts. In addition, the external server 520 may recommend the customized photobook service to the mobile device by arranging each of the clustered select images in the layout based on the face recognition result of the select image information.

More specifically, the external server 520 may receive a plurality of image information from the mobile device 510 after performing authentication with the mobile device 510 using user information, and deep learning of the big data model. Through the technique, items such as a theme, an object, text, a creation date and a location of a plurality of image information may be analyzed, and sharpness, affiliation, continuous shooting, and SNS upload may be analyzed.

Subsequently, the external server 520 extracts select image information suitable for producing a photo book from among the plurality of image information based on the analysis result, and extracts the extracted select image information based on a theme, an object, text, a creation date and a location It can be clustered according to the items of Exchangable Image File Format or Exif.

According to an embodiment, the external server 520 may push the use of the customized photobook service to the mobile device 510 when the capacity or number of clustered select images exceeds a preset criterion. In addition, the external server 520 may control the recommendation of the customized photobook service from the user's selection input through the mobile device 510.

According to another exemplary embodiment, in addition to recommending a customized photobook service using the select image information, the external server 520 may display a product type such as a frame, a card, a mug, a tumbler, a mobile phone case, or a garland using the select image information. 510, can be based on image, such as place, text, indicator base of statistical data, user base such as clicks, referrals, order history, search conditions, behavior patterns, and 100 days, 1st anniversary, 10th anniversary Depending on the event base such as, anniversary, personalized photobook service using the select image information, frame, card, mugs, tumbler, cell phone case, garland, etc. may be recommended.

6 is a flowchart illustrating a method of manufacturing a custom photobook according to an embodiment of the present invention.

The method illustrated in FIG. 6 may be performed by a custom photobook manufacturing apparatus installed with photobook editing software of the mobile device illustrated in FIG. 1 and providing a photobook service.

In operation 610, select image information suitable for making a photobook is classified and classified based on a machine learning algorithm among the plurality of image information received from the mobile device.

Step 610 may be a step of clustering the select image information received from the mobile device by item using a deep learning technique, a machine learning algorithm. For example, in operation 610, a plurality of image information stored and included in a mobile device possessed by a user or select image information suitable for making a photobook among a plurality of image information on an SNS (Social Networking Service) linked to the mobile device. It may be a step of classifying by item such as theme, object, text, creation date and location, and clustering according to the classification item.

In operation 620, the customized photobook service according to the clustered select image information, the user pattern information, and the user preference is recommended.

In operation 620, at least one or more of photobook information including custom photobook sizes, photobook pages, photobook styles, and photobook themes according to clustering classified by items, templates, and resources selected by the photobook information. And arranging the select image according to the layout and recommending the customized photobook service. In operation 620, the title of the photobook service may be determined using the clustered select image information.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments include, for example, processors, controllers, arithmetic logic units (ALUs), digital signal processors, microcomputers, field programmable arrays (FPAs), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For convenience of explanation, one processing device may be described as being used, but one of ordinary skill in the art will appreciate that the processing device includes a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as parallel processors.

The software may include a computer program, code, instructions, or a combination of one or more of the above, and configure the processing device to operate as desired, or process it independently or collectively. You can command the device. Software and / or data may be any type of machine, component, physical device, virtual equipment, computer storage medium or device in order to be interpreted by or to provide instructions or data to the processing device. Or may be permanently or temporarily embodied in a signal wave to be transmitted. The software may be distributed over networked computer systems so that they may be stored or executed in a distributed manner. Software and data may be stored on one or more computer readable recording media.

The method according to the embodiment may be embodied in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the media may be those specially designed and constructed for the purposes of the embodiments, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CDROMs, DVDs, and magneto-optical media such as floppy disks. (magnetooptical media), and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the embodiments have been described by the limited embodiments and the drawings as described above, various modifications and variations are possible to those skilled in the art from the above description. For example, the described techniques may be performed in a different order than the described method, and / or components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different manner than the described method, or other components. Or even if replaced or replaced by equivalents, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are within the scope of the claims that follow.

10: multiple image information
20: Select Image Information
100: custom photobook production device
210, 220, 230: clustering
310: photobook page
320: select image
330: layout
500: Custom Photobook Production System

Claims (16)

In the custom photobook production apparatus installed by the photobook editing software of the mobile device to provide a photobook service,
An image selector for classifying and clustering select image information suitable for producing a photobook among items of a plurality of image information received from the mobile device, and clustering the selected image information for each item;
A photobook recommendation unit recommending a customized photobook service based on the clustered select image information, user pattern information, and user preferences;
A pattern learner learning the user pattern information on the photobook production; And
A controller configured to push the recommendation of the photobook service based on the plurality of image information generated in the mobile device
Custom photobook production apparatus comprising a. delete The method of claim 1,
The pattern learning unit
The user preference is obtained based on a user usage pattern and an order pattern for photobook production, and the user pattern information according to the user preference in each photobook size, photobook page number, photobook style, and photobook theme. Photobook creation device to learn. The method of claim 1,
The image selector is
And a device for clustering the select image information received from the mobile device by item using a deep learning technique, which is the machine learning algorithm. The method of claim 4, wherein
The image selector is
And clustering the select image information by items such as a theme, an object, text, a creation date, and a location, and clustering the select image information by a person according to a facial recognition result. The method of claim 1,
The photobook recommendation unit
The clustered selector according to a template, a resource, and a layout selected by at least one photobook information of a customized photobook size, photobook page number, photobook style, and photobook theme according to clustering classified by items. Custom photobook production apparatus for recommending the customized photobook service by placing image information. The method of claim 6,
The photobook recommendation unit
And arranging each of the clustered select image information on the layout based on a facial recognition result extracted by the image selector to display the clustered select image information in a face center. The method of claim 1,
The control unit
When the plurality of image information generated in the mobile device is suitable for the select image information that is classified and clustered, and exceeds a predetermined capacity or number, a customized to push the use of the customized photobook service through the mobile device Photobook production device. The method of claim 1,
The control unit
Transmitting the plurality of image information included in the mobile device to an external server, receiving an analysis result of the plurality of image information from the external server, and transmitting the analysis result to the image selector and the photobook recommendation unit. Providing custom photobook production device. A mobile device displaying and providing a customized photobook service according to a plurality of image information, and receiving a selection input from a user; And
Among the plurality of image information received from the mobile device, selectable image information suitable for making a photobook is classified and clustered by items based on a machine learning algorithm, and the clustered select image information, user pattern information, and user preferences Include an external server that recommends custom photobook services,
The external server
According to a template, a resource, and a layout selected by at least one photobook information among photobook sizes, photobook pages, photobook styles, and photobook themes recommended according to the user pattern information and the user preferences. And placing the clustered select image information. delete The method of claim 10,
The external server
Based on a face recognition result of the select image information, placing each of the clustered select image information in the layout centered on a face to recommend the customized photobook service to the mobile device.
delete delete delete delete

Images