KR20230108209A - Method and apparatus for providng photo print service based user trends - Google Patents

Abstract

A method and apparatus for providing a photo printing service based on user trends are disclosed. A method for providing a photo printing service based on user trends according to an embodiment of the present invention includes acquiring photos stored in a user terminal corresponding to a user or stored in a server storage corresponding to a user account of the user, the user's trend ( The method may include selecting at least one printing target among the photos using at least one of trend information and trend information of all users, and transmitting a photo corresponding to the printing target to a photo printing terminal.

Description

Method and apparatus for providing photo printing service based on user trend {METHOD AND APPARATUS FOR PROVIDNG PHOTO PRINT SERVICE BASED USER TRENDS}

The present invention relates to a method and apparatus for providing a photo printing service based on a user trend, and more particularly, to a method and apparatus for providing a service so as to print photos matching a user's trend among user's photos.

The information described below simply provides background information related to an embodiment according to the present invention and does not constitute prior art.

With the development of technology, many users are taking pictures using smartphones. As the storage space of smartphones increases and photos taken on smartphones can be stored in remote storage spaces such as the cloud, it is common for users to save photos as they are taken without organizing them separately.

Therefore, when a user wants to print some photos, he or she has to directly select an object to be printed from among a large number of unorganized stored photos, which causes considerable inconvenience to the user. In addition, it is quite difficult for non-professional users to calibrate photos they want to print or photos they want to keep separately.

Conventionally, there are services that print photos at a cost, but with a complicated user interface and 'member registration, login, order selection, picture selection, size selection, image confirmation, order confirmation, delivery information input, payment, receipt of printed picture' As in, there is an inconvenience of having to go through many procedures of about 10 steps on average.

An object of the present invention is to provide a service that automatically selects a print target from among user's photos based on user trends and automatically transmits them to a photo print terminal so that photo prints can be made.

In addition, the present invention updates the user's trend information by performing machine learning based on the user's photo selection information, and selects a print target based on the trend information, so that photos matching the user's trend can be printed. It aims to provide a service that allows

In addition, an object of the present invention is to provide a service that allows users' photos to be printed according to user's intention by classifying user's photos by context and referring to various reference information according to hierarchical priority. .

Another object of the present invention is to provide a service that updates the user's preferred editing information by performing machine learning based on the user's photo editing information, and automatically corrects the user's photos based on the preferred editing information. .

To achieve the above object, a method for providing a photo print service based on user trends according to an embodiment of the present invention includes acquiring photos stored in a user terminal corresponding to a user or stored in a server storage corresponding to a user account of the user. Selecting at least one print target among the photos using at least one of the user's trend information and all users' trend information, and transmitting a photo corresponding to the print target to a photo printing terminal. steps may be included.

The method of providing a photo print service based on the user trend displays the photos and information on whether each of the photos is a print target on the user terminal, and adds at least one photo to the print target by the user. Alternatively, the method may further include providing a user interface for excluding at least one photo from the printing target.

The method of providing a photo printing service based on the user trend may further include updating trend information of the user and all users by performing machine learning based on a history of adding or excluding printing objects by the user.

The method of providing a photo printing service based on the user trend includes performing image analysis for recognizing at least one of a foreground and a background of the photos, and at least one of image analysis result information of the photos and location information corresponding to the photos. Further comprising classifying the photos into one of a plurality of contexts using one, and selecting the print target includes selecting the print target based on a preset priority among the contexts. steps may be included.

Acquiring the photos includes acquiring location information, location movement information, and time information corresponding to the photos together with the photos, and selecting the print target includes the location information, the location movement and selecting the print target based on a first hierarchical priority set in order of information and time information.

The method for providing a photo printing service based on the user trend includes determining the number of photos corresponding to a preset location range, a preset location movement range, and a preset time range among the photos as the number of similar compositions; Determining the search time of the user as the photo search time, and determining an area where the objects corresponding to the foreground included in the photos are the most disposed among areas in which the entire image is divided in a grid form as a target location The step of selecting the print target includes selecting the print target based on a second hierarchical priority set in the order of the number of similar compositions, the photo search time, and the target location. can do.

The step of selecting the print target includes determining a trend-reflecting photo corresponding to a preset similarity range with the trend information of all users among the photos, and determining the trend-reflecting photo ratio among the photos to determine the trend matching degree of the user. and selecting the print target so that the trend-reflecting photo is included in all print candidate photos as much as the trend matching ratio.

The method of providing a photo printing service based on the user trend may include, when editing is performed by the user on at least one of the photos, obtaining photo editing information on at least one of the photos, based on the photo editing information. The method may further include determining preferred editing information of the user by performing machine learning and correcting pictures corresponding to the printing target based on the preferred editing information of the user.

The contexts may include at least two of selfies, common people, travel, scenery, and companion animals.

The photo editing information may include an adjustment value for at least one of brightness, saturation, and brightness.

An apparatus for providing a photo printing service based on user trends according to an embodiment of the present invention includes a memory in which at least one program is recorded and a processor that executes the program, and the program is stored in a user terminal corresponding to a user or Acquiring photos stored in a server storage corresponding to a user account of a user, selecting at least one printing target among the photos using at least one of trend information of the user and trend information of all users and instructions for performing a step of transmitting a photo corresponding to the print target to a photo print terminal.

According to the present invention, it is possible to provide a service that automatically selects a print target from among user's photos based on user trends and automatically transmits them to a photo print terminal so that photo prints can be made.

In addition, according to the present invention, by performing machine learning based on the user's photo selection information to update the user's trend information, and selecting a print target based on this trend information, photos matching the user's trend can be printed. We can provide a service that allows you to

In addition, according to the present invention, it is possible to provide a service for printing photos more suitable for the user's intention by classifying user's photos according to context and referring to various reference information according to hierarchical priority.

In addition, according to the present invention, the present invention performs machine learning based on the user's photo editing information to update the user's preferred editing information, and provides a service that automatically corrects the user's photos based on the preferred editing information. can

1 is a block diagram illustrating subjects for providing a photo printing service according to an embodiment of the present invention.
2 is an operational flowchart illustrating a method of providing a photo printing service according to an embodiment of the present invention.
3 is an operational flowchart illustrating a method of providing a photo printing service according to another embodiment of the present invention.
4 is an operational flowchart illustrating a method of providing a photo printing service according to another embodiment of the present invention.
5 is an operational flowchart illustrating a method of providing a photo printing service according to another embodiment of the present invention.
6 is a diagram illustrating an example of photo classification and prioritization according to the present invention.
7 is a diagram illustrating an example of a method of selecting a print target based on trend matching according to the present invention.
8 is a diagram showing an example of a user interface according to the present invention.
9 is a diagram illustrating a computer system according to an embodiment of the present invention.

The present invention will be described in detail with reference to the accompanying drawings. Here, repeated descriptions, well-known functions that may unnecessarily obscure the subject matter of the present invention, and detailed descriptions of configurations are omitted. Embodiments of the present invention are provided to more completely explain the present invention to those skilled in the art. Accordingly, the shapes and sizes of elements in the drawings may be exaggerated for clarity.

Throughout the specification, when a certain component is said to "include", it means that it may further include other components without excluding other components unless otherwise stated.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating subjects for providing a photo printing service according to an embodiment of the present invention.

Referring to FIG. 1 , subjects for providing a photo print service according to an embodiment of the present invention include a photo print service providing device 110 , a user terminal 120 and a photo print terminal 130 .

The photo print service providing device 110 may refer to a device that selects a print target from photos stored in the user terminal 120 or stored in a server storage (not shown) corresponding to the user's user account.

The photo print service providing device 110 may perform a function of a platform for providing a photo print service.

The user terminal 120 is a terminal corresponding to a user who wants to receive a photo print service, transmits photos stored in the user terminal 120 or additional information to the photo print service providing device 110, and provides a photo print service providing device. A user interface related to a photo printing service may be provided from (110).

The user terminal 120 refers to a communication terminal capable of using a terminal application in a wired/wireless communication environment. For example, the user terminal 120 may be a portable terminal such as a smart phone, and the spirit of the present invention is not limited thereto, and a terminal loaded with a terminal application may be borrowed without limitation.

The user terminal 120 may be equipped with a terminal application for transmitting/receiving various data for the photo printing service to the photo printing service providing device 110 or providing a user interface related to the photo printing service to the user.

Here, the terminal application may be a dedicated application for providing a photo printing service or a browser for providing a photo printing service on a web page.

The photo printing terminal 130 is a terminal corresponding to a photo printing company that receives data of photos to be printed from the photo printing service providing device 110 and prints actual photos, and directly prints the photos to be printed. It may be a printing machine, or a server for managing or controlling so that photos to be printed are printed by another photo printing machine.

The photo print service providing device 110 and the user terminal 120 , the photo print service providing device 110 and the photo printing terminal 130 may be connected to each other through a communication network.

A communication network means an access path for transmitting and receiving data between the above subjects. For example, communication networks include wired networks such as LANs (Local Area Networks), WANs (Wide Area Networks), MANs (Metropolitan Area Networks), and ISDNs (Integrated Service Digital Networks), wireless LANs, wireless LANs, CDMA, Bluetooth, and satellite communications. It may cover networks, but the range of communication networks applicable to the present invention is not limited thereto.

2 is an operational flowchart illustrating a method of providing a photo printing service according to an embodiment of the present invention.

Referring to FIG. 2 , in the photo print service providing method according to an embodiment of the present invention, first, a photo print service providing apparatus 110 is stored in a user terminal 120 corresponding to a user or corresponding to the user account of the user. It is possible to obtain photos stored in the server storage to be (S210).

Here, the photo printing service providing apparatus 110 may further obtain location information, location movement information, and time information corresponding to the photos of the user together with the photos of the user.

Next, the photo printing service providing apparatus 110 may select at least one print target from among the user's photos by using at least one of the user's trend information and the trend information of all users (S220).

Here, the photo print service providing apparatus 110 may select a print target based on a first hierarchical priority set in the order of location information, location movement information, and time information.

A detailed description of the first hierarchical priority will be described later with reference to FIG. 6 .

Although not shown in FIG. 2 , the apparatus 110 for providing a photo printing service further includes determining the number of similar compositions, determining a photo search time, and determining a target location before selecting a print target, A print target may be selected based on a second hierarchical priority set in the order of the number of similar compositions, the photo search time, and the target location.

A detailed description of the second hierarchical priority will be described later with reference to FIG. 6 .

Also, although not shown in FIG. 2 , the apparatus 110 for providing a photo print service may select a print target based on a trend matching degree, which is a degree of matching of user photos with trends of all users.

A detailed description of a method of selecting a printing target based on the trend matching degree will be described later with reference to FIG. 7 .

In addition, although not shown in FIG. 2 , the photo printing service providing apparatus 110, when the photos are edited by the user, obtains photo editing information for the edited photos, based on the photo editing information. The method may further include determining user's preferred editing information by performing machine learning, and correcting photos to be printed based on the user's preferred editing information.

Here, the photo editing information may include an adjustment value for at least one of brightness, saturation, and brightness.

Here, the photo editing information is obtained by being classified according to context, and the preferred editing information is also classified and learned by context.

The preferred editing information is stored as a user preset and can be applied to a print target or to photos separately selected by the user.

Next, the photo printing service providing device 110 may transmit a photo corresponding to a printing target to the photo printing terminal 130 (S230).

The photo printing terminal 130 may print the photo received from the photo printing service providing device 110 and provide the printed photo to the user.

3 is an operational flowchart illustrating a method of providing a photo printing service according to another embodiment of the present invention.

Referring to FIG. 3 , in a photo print service providing method according to another embodiment of the present invention, after the photo print service providing apparatus 110 selects a print target from among user's photos, the photo print service is printed on the user terminal 120. A user interface for service provision may be provided (S310).

Here, the user interface displays the user's photos and information on whether each of the photos is a print target, and allows the user to add at least one photo to the print target or exclude at least one photo from the print target. It may be a user interface for enabling

A detailed description of the user interface will be described later with reference to FIG. 8 .

Next, when the photo printing service providing apparatus 110 receives an input to add or exclude a print object through the user interface, the print object may be updated accordingly (S320).

4 is an operational flowchart illustrating a method of providing a photo printing service according to another embodiment of the present invention.

Referring to FIG. 4 , in a photo print service providing method according to another embodiment of the present invention, after the photo print service providing device 110 updates a print object, based on a history of adding or excluding print objects by a user. Trend information of users and all users may be updated by performing machine learning with (S410).

The photo printing service providing apparatus 110 may first update the user trend information and update trend information of all users based on the user trend information of each user.

5 is an operational flowchart illustrating a method of providing a photo printing service according to another embodiment of the present invention.

Referring to FIG. 5 , in a method for providing a photo print service according to another embodiment of the present invention, after the photo print service providing apparatus 110 acquires photos of a user, at least one of a foreground and a background of the user's photos is displayed. Image analysis to recognize one may be performed (S510).

Next, the photo printing service providing apparatus 110 may classify the photos into one of a plurality of contexts using at least one of image analysis result information of the photos and location information corresponding to the photos (S520). ).

Here, the contexts may include at least two of selfies, common people, travel, scenery, and companion animals.

6 is a diagram illustrating an example of photo classification and prioritization according to the present invention.

Referring to FIG. 6 , photo classification and priority according to the present invention may be determined based on context, basic information, basic log, and preference tracking log items.

Context is used to classify photos, and priorities can be set in the order of selfies, public figures, travel, scenery, and companion animals.

Here, when a user accesses a photo printing service for the first time and no user trend is generated, a printing target may be selected according to the classification according to the context.

For example, the printing target may be selected according to the ratio of the number of photos for each context.

More specifically, out of 1000 total photos of the user, if 600 (60%) selfie photos, 400 (40%) general public photos, and 10 prints are taken, selfies are taken according to the ratio of the number of photos for each context. Six (60%) of the photos and four (40%) of the general public photos may be selected for printing.

In this case, the print target may be randomly selected from photos classified by context.

Basic information may be information used to classify photos by context.

In classifying the context of a certain photo as a selfie or a normal person, image analysis information may be selectively referred to (OR condition).

In classifying the context of a certain photo as travel, location information can be referred to as essential (AND condition).

Priority in the context of travel, scenery, and companion animals may be based on the following conditions among photos that satisfy main information among image analysis information.

AND conditions (high priority): people, landmarks

OR condition (low priority): person, landmark

The basic log may include location information, location movement information, and time information, and a first hierarchical priority may be set in the order of the location information, the location movement information, and the time information.

When a photo is searched according to the basic log, after referring to the top item in descending order based on the first hierarchical priority, if there is no photo corresponding to the lowest item, a picture of the second highest item may be searched.

For example, when searching for a photo in which the context (α) is 'selfie', the location information (A1) is 'no change' and the location change information (A2) is 'none', and there are no photos. , photos corresponding to '1-10m' in the location change information (A2), which is the second-order item, can be searched.

The preference tracking log may include the number of similar compositions, photo search time, and target location, and second hierarchical priorities may be set in the order of the similar composition number, photo search time, and target location.

The number of similar compositions may be information for learning a user's preferred picture composition for each context or for all pictures.

For example, the context (α) of specific photos is 'selfie', the location information (A1) is 'no change', the location change information (A2) is 'no', and the time information (A3) is 'within 10 minutes' and if the number of similar compositions (B) is '10 or more', it can be recognized as a case of attempting to take a 'life shot' in the same location.

The photo search time corresponds to the time of interaction with the user for each context or for all photos, and may be information for learning the user's preferred photo context or preferred photo context.

For example, the context (α) of specific photos is 'selfie', the location information (A1) is 'no change', the location change information (A2) is 'no', and the time information (A3) is 'within 10 minutes' , and if the photo search time (C) is 'more than 10 minutes', it can be recognized as a picture frequently checked for comparative analysis among the pictures that have been attempted to take a 'life shot'.

The target location may be information for learning a user's preferred photo composition for each context or for all photos.

For example, the context (α) of specific photos is 'selfie', the location information (A1) is 'no change', the location change information (A2) is 'no', and the time information (A3) is 'within 10 minutes' , and when the target location (D) corresponds to the 'center and bottom' of the areas in which the entire image is divided in the form of a grid, the user prefers a composition in which the shooting target is located in the center and bottom of the screen. Recognizable.

7 is a diagram illustrating an example of a method of selecting a print target based on trend matching according to the present invention.

Referring to FIG. 7 , trend information of individual users may be first learned, and then trend information of all users may be updated.

Next, a trend matching degree, which is a degree of matching between user trends of all users and user trends of individual users, may be calculated.

Here, the trend matching degree determines the trend reflecting photos corresponding to the trend information of all users and within a preset similarity range among the user's photos, and then the ratio of the trend reflecting photos among the user's photos can be calculated by the trend matching. there is.

As an optional embodiment, the trend matching degree may be calculated according to the similarity of the parameters included in the trend information of the user and the trend information of all users.

Here, the trend matching degree may be calculated for all of the user's photos or for each context.

Here, the print target may be selected from trend-reflecting photos as many as the number corresponding to the trend conformity among the number of copies to be printed, and the remaining number may be selected from photos other than trend-reflecting photos.

For example, if there are 300 trend-reflecting photos out of 1,000 total photos of the user, so the trend conformity is 30%, and the number of prints is 10, 3 out of trend-reflecting photos (30%), and non-trend-reflecting photos 7 sheets (70%) can be selected for printing.

In this case, the printing target may be randomly selected from trend-reflecting photos or non-trend-reflecting photos.

8 is a diagram showing an example of a user interface according to the present invention.

Referring to FIG. 8 , a user interface for providing a photo printing service may be provided through a screen 800 of a user terminal.

The user interface may display photos 810 owned by the user and photos 820 selected as a printing target among them.

The user may select one (830a or 830b) of the photos 820 selected as a print target and exclude it from the print target. In this case, the remaining number of copies 840 among the set print target sheets may be updated and displayed. .

Although not shown in FIG. 8 , the user may select as many photos 810 as the remaining number of sheets 840 and add the corresponding photos as a print target.

9 is a diagram illustrating a computer system according to an embodiment of the present invention.

An apparatus for providing a photo printing service according to an embodiment of the present invention may be implemented in a computer system 900 such as a computer-readable recording medium.

Referring to FIG. 9 , a computer system 900 includes one or more processors 910, memory 930, user interface input device 940, user interface output device 950, and storage communicating with each other through a bus 920. (960). In addition, computer system 900 may further include a network interface 970 coupled to network 980 . The processor 910 may be a central processing unit or a semiconductor device that executes processing instructions stored in the memory 930 or the storage 960 . Memory 930 and storage 960 may be various types of volatile or non-volatile storage media. For example, the memory may include ROM 931 or RAM 932 .

Specific implementations described herein are examples and do not limit the scope of the present invention in any way. For brevity of the specification, description of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection of lines or connecting members between the components shown in the drawings are examples of functional connections and / or physical or circuit connections, which can be replaced in actual devices or additional various functional connections, physical connection, or circuit connections. In addition, if there is no specific reference such as “essential” or “important”, it may not be a component necessarily required for the application of the present invention.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments and should not be determined, and all scopes equivalent to or equivalently changed from the claims as well as the claims described below are within the scope of the spirit of the present invention. will be said to belong to

110: photo printing service providing device
120: user terminal 130: photo printing terminal
900 computer system 910 processor
920: bus 930: memory
931: Rom 932: RAM
940: user interface input device
950: user interface output device
960: storage 970: network interface

Claims (11)

obtaining photos stored in a user terminal corresponding to a user or stored in a server storage corresponding to a user account of the user;
selecting at least one printing target among the photos using at least one of the user's trend information and all user's trend information; and
Transmitting a photo corresponding to the print target to a photo print terminal
A photo printing service providing method based on user trends, comprising: According to claim 1,
In the user terminal, the photos and information on whether each of the photos is a print target are displayed, and at least one photo is added to the print target by the user, or at least one photo is removed from the print target. Steps to provide a user interface to enable exclusion
Further comprising a photo printing service providing method based on user trends. According to claim 2,
Updating trend information of the user and all users by performing machine learning based on a history of adding or excluding printing objects by the user
Further comprising a photo printing service providing method based on user trends. According to claim 3,
performing image analysis to recognize at least one of a foreground and a background of the photos; and
Classifying the photos into one of a plurality of contexts using at least one of image analysis result information of the photos and location information corresponding to the photos.
Including more,
The step of selecting the print target is
A method of providing a photo printing service based on a user trend, comprising selecting the printing target based on a preset priority among the contexts. According to claim 3,
Acquisition of the photos
Obtaining location information, location movement information, and time information corresponding to the photos together with the photos.
including,
The step of selecting the print target is
Selecting the printing target based on a first hierarchical priority set in the order of the location information, the location movement information, and the time information.
A photo printing service providing method based on user trends, comprising: According to claim 5,
determining the number of photos corresponding to a preset location range, a preset location movement range, and a preset time range among the photos as the number of similar compositions;
determining a search time of the user for the photos as a photo search time; and
Determining, as a target location, an area in which objects corresponding to the foreground included in the photos are disposed the most among areas obtained by dividing the entire image in a grid form.
Including more,
The step of selecting the print target is
Selecting the print target based on a second hierarchical priority set in the order of the number of similar compositions, the photo search time, and the target location
A photo printing service providing method based on user trends, comprising: According to claim 3,
The step of selecting the print target is
determining a trend-reflecting picture corresponding to a predetermined similarity range with the trend information of all users among the pictures;
calculating a trend matching degree of the user by a ratio of the trend-reflecting picture among the pictures; and
Selecting the print target so that the trend reflecting photo is included in all print candidate photos as much as the trend matching ratio
A photo printing service providing method based on user trends, comprising: According to claim 3,
obtaining photo editing information on at least one of the photos when editing is performed by the user on at least one of the photos;
determining preferred editing information of the user by performing machine learning based on the photo editing information; and
correcting photos corresponding to the printing target based on the user's preferred editing information;
Further comprising a photo printing service providing method based on user trends. According to claim 4,
the contexts
A method of providing a photo printing service based on user trends, including at least two of selfies, common people, travel, scenery, and companion animals. According to claim 8,
Information on photo editing
A method of providing a photo printing service based on a user trend, including an adjustment value for at least one of brightness, saturation, and brightness. a memory in which at least one program is recorded; and
Processor running the program
including,
said program
obtaining photos stored in a user terminal corresponding to a user or stored in a server storage corresponding to a user account of the user;
selecting at least one printing target among the photos using at least one of the user's trend information and all user's trend information; and
Transmitting a photo corresponding to the print target to a photo print terminal
An apparatus for providing a photo printing service based on a user trend, including instructions for performing.