WO2014137201A2

WO2014137201A2 - System for providing contents curation services based on contexts and method therefor

Info

Publication number: WO2014137201A2
Application number: PCT/KR2014/001919
Authority: WO
Inventors: 고경환; 고영혁
Original assignee: (주)에이엔티홀딩스
Priority date: 2013-03-07
Filing date: 2014-03-07
Publication date: 2014-09-12
Also published as: KR101445691B1; KR20140110328A; WO2014137201A3

Abstract

The present invention relates to a system for providing contents curation services based on contexts and a method therefor. A system for providing contents curation services based on contexts according to the present invention includes: a contents collection device for collecting original contents and the original contexts corresponding to the original contents from at least one of social medias and devices connected through a communications network; a context analysis device for analyzing at least one of the original contents and the original contexts so as to extract at least one of the time context, place context, personality context, subject context, and interaction context for the original contents; and a curation device for curating the original contents based on at least one of the time context, place context, personality context, subject context, and interaction context.

Description

Content Curation Service System and Method Based on Context

The present invention relates to a context-based content curation service system and method, and more particularly, to collect content, such as photos and videos stored in social media, smart phones, laptops, desktop computers, etc. together with contexts. And a content curation service by reconstructing collected content based on a context.

With the proliferation of smart phones and the activation of social media, users have the opportunity to take and upload photos and videos anytime and anywhere. In particular, sharing these photos and videos with each other makes it easier to obtain a large amount of material related to them. Environment was created.

However, most people only store these photographs or videos as records of memories, but have difficulty in classifying them, organizing them, and reconstructing them in a desired form according to a specific purpose or theme. And as time goes by, the material that is relevant to them becomes more and more difficult to spend time and effort on. As a result, the existing photos and videos were mostly played in the device where they were taken or moved to a folder on a laptop or desktop, and further production beyond that point was terminated.

However, most people still have a strong basic desire for their memories, especially in life-threatening life events such as childhood, schooling, graduation, love affairs, work life, marriage, parenting, and sixtieth birthday feasts. Since the needs of Koreans are very strong, there has always been a demand for reproduction of their own special memories using existing photographs or videos. Accordingly, there is an urgent need for a technology that can be easily reconstructed into memories of the desired form using existing photographs or videos.

The present invention was devised to meet the above-described needs, and an object of the present invention is a content curation service system based on a context in which a user can easily reconstruct a desired picture or video and reconfigure it into a desired form. And a method.

Another object of the present invention is to provide a content curation service system and method based on a context in which a user selects a desired context item and filters and sorts the content based on the context item, and reconstructs the content using a design template. will be.

It is still another object of the present invention to provide a content curation service system and method based on a context capable of automatically reconstructing content of appropriate memories based on a context and recommending it to a user.

Another object of the present invention is to process the curated content containing the user's memories in one source multi use (OSMU) context-based content queue that can be provided in the form of social media, web pages, photos, albums, applications, etc. It is to provide a service system and method.

For this purpose, the context-based content curation service system according to one embodiment of the present invention collects original content and original context corresponding to the original content from at least one of respective social media and devices connected through a communication network. A content collection device; A context analysis device for analyzing at least one of the original content and the original context to extract at least one of a time context, a place context, a person context, a subject context, and an interaction context for the original content; And a curation apparatus that curates the original content based on at least one of the time context, place context, person context, subject context, and interaction context.

The context-based content curation service method according to one embodiment of the present invention includes: collecting original content and an original context corresponding to the original content from at least one of respective social media and devices connected through a communication network; Analyzing at least one of the original content and the original context to extract at least one of a time context, a place context, a person context, a subject context, and an interaction context for the original content; And curating the original content based on at least one of the time context, place context, person context, subject context, and interaction context.

According to the present invention, a user has an effect of automatically collecting photos or videos related to himself from social media, smart phones, laptops, etc. and easily reconstructing them into a desired form.

In addition, according to the present invention, the user may automatically filter and sort the contents based on the context item selected by the user, and may also reconfigure the contents in a direction desired by the user using a design template or the like. Have

In addition, according to the present invention, the system has the effect of rediscovering the memories that the user has forgotten by reconfiguring and recommending the appropriate contents based on the context to the user.

In addition, according to the present invention, the curation content containing the user's memories can be published and provided in the form of social media, web pages, photos, albums, applications, videos, and the like.

1 is a block diagram of a content curation service system based on a context according to an embodiment of the present invention.

2 is a view for explaining the function of the content collection device according to an embodiment of the present invention.

3 is a view for explaining the function of the context analysis apparatus according to an embodiment of the present invention.

4 is a view for explaining the function of the curation apparatus according to an embodiment of the present invention.

5 is a view for explaining the function of the content providing apparatus according to an embodiment of the present invention.

6 is a flowchart of a content curation service method based on a context according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings and preferred embodiments. For reference, in the following description, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention will be omitted.

Referring to FIG. 1, the content curation service system 100 according to an embodiment of the present invention may include a content collection device 110, a context analysis device 120, a curation device 130, and a content providing device 140. , Information storage device 150, and the like. For reference, these devices may be implemented in the form of one server, or two or more devices may be implemented in the form of one server.

Hereinafter, the functions and configurations of the devices will be described in detail with reference to FIGS. 2 to 5. For reference, in the present invention, 'contents' is a meaning including all materials or information related to personal memories, such as photographs, videos, texts, etc., which are most commonly used in social media or personal devices. Since is a photo (image) will be described below mainly for the convenience of description. However, of course, the present invention does not exclude other forms of content, such as video or text, which may be implemented in the same or similar manner as the photograph.

2 is a view for explaining the function of the content collection device 110 according to an embodiment of the present invention.

Referring to FIG. 2, the content collecting device 110 may be a smart device such as various social media such as Facebook, Twitter, Flickr, Picasa, Instagram, Foursquare, smart phones, tablets, and the like. And collect photos related to the user from existing generic devices such as laptops and desktops.

In detail, in the case of social media, the content collecting device 110 may receive the photos of the social media online through the consent of the user who is the photo owner, for example, from a service that provides an application programming interface (API). In the case of a smart device, photos may be automatically collected through a dedicated application for iOS, Android, or Windows Mobile, and transmitted to a content collecting device 110 on a network. In the case of a laptop or a desktop, the photo may be obtained through a separate client program. These data may be collected and transmitted to the content collection device 110.

In this case, the content collecting device 110 also collects the context of the picture when collecting each picture. For reference, in the present invention, 'context' refers to a social graph, interest graph, time, location, person, subject, interaction related to content (eg, photos, videos, text, etc.). (E.g., interactions between people, interactions between people and content, interactions between people and the service), and the like.

In addition, the content collecting device 110 associates the collected pictures and contexts with each other and stores them in the original content DB 151 and the original context DB 152, respectively. For reference, when the context collecting device 110 stores the context in association with the picture, the content collecting device 110 may collect comprehensive information related to the content collection, such as which source channel the picture was collected from, and for what reason (eg, new or updated). Record together.

3 is a view for explaining the function of the context analysis device 120 according to an embodiment of the present invention.

Referring to FIG. 3, the context analysis apparatus 110 analyzes the original content and the original context to determine the relation of the original content with a time context, a place context, a person context, a subject context, an interaction context, and the like, to determine the secondary context. Extract them. For example, the context analysis apparatus 110 analyzes a predetermined picture and its original context to determine information related to the picture (for example, when and where the picture was taken, to whom it was taken, what is the background or object of the picture, and the corresponding picture). The comment on who is commented, what is the content of the comment, which channel was downloaded through the ..., and analyzes its relevance.

Specifically, the time context may include, for example, the date the photo file was created, the date of recording in the EXIF metadata included by default in the photo, the date uploaded or stored on social media and smart devices, the date the user specified when the photo was taken directly After collecting all the information as much as possible, apply the highest priority among the collected dates. For reference, in addition to the time and place information, the EXIF metadata may acquire all the information such as the shooting condition and the photographing device.

Meanwhile, in addition to the information that can be determined by the shooting date and time, the time context may include specific event contexts such as season, morning / lunch / evening / night, anniversary, and birthday, and the like, for example, from social media such as Facebook. You can get information about the anniversary and get time contexts through text mining from the caption texts attached to the photo.

The place context reads and stores latitude and longitude values (e.g. Global Positioning System (GPS) values) in EXIF metadata for photos taken with a smartphone, and classifies them into administrative regions based on these values (e.g., the United States). , California, San Francisco, etc.) to step through the context of the place. In addition, when there is an adjacent sea, a mountain, or a park, the place classification may be layered and matched and stored. In particular, in the case of a context collected from social media, even a specific place name is often included in the original data, so the name may be read and stored as it is.

On the other hand, in the context of people, whether a person is related to a photo or not is analyzed by face image recognition, etc., or specified by the user or saved. In particular, in social media such as Facebook, the user directly Tag and know what the person's face is and how it relates to the person (e.g., friends, lovers, family), so you can determine and store the relevance based on that.

In addition, by collecting and comparing the photos taken directly from the social media with the photos stored directly from the device, it is possible to supplement who is the person in the picture and who is related to it even if it is not listed in the picture. That is, since the shape of the context may differ slightly depending on the channel, the accuracy and completeness of the context can be improved by considering it together. For example, since the information characteristics that can be obtained for each channel are different, the accuracy and completeness of the context can be improved by unifying the differences and filling and expanding the empty information.

In the case of a topic context, it can be extracted mainly by a user designating a topic related to the content. Also, information obtained through image recognition (eg, sea, mountains), titles, captions, comments, etc., attached to a photo or video can be extracted. The text information may be mined or extracted based on content in social media.

Meanwhile, in the case of the present invention, since social media can be utilized, information interacted with other people (eg, friends) in the social media can be extracted and managed as an interaction context. In addition, by using the interaction context, even when filtering or sorting, the most favored pictures or the pictures with the most comments can be extracted and checked.

For reference, all contexts, whether temporal or place context, can be data structures having both dependent hierarchies and independent substructures. In this case, the context of the lower layer includes the context of the upper layer. For example, assuming that a date and time are contexts, the date and time may be configured to include time zones such as season, morning / lunch / evening, and the like.

In the present invention, in order to analyze the context of the original content, image recognition technology (e.g., recognition of a person, shape, etc.), OCR (Optical Character Reader) technology (e.g., character recognition in an image), text mining technology (e.g., , Recognition of text in an image, text associated with an image in social media, etc.), and the like may be implemented directly in the context analysis device 120 or in a form connected to a separate server. Can be. For reference, when a text is connected, which context is tagged can be determined through the text mining reference DB of the context. For example, if the text context information includes the word 'galbi-tang', the reference DB ( 153) has a link of 'galbi-tang-Korean food', so that a picture having a corresponding context may be embodied in a form of attaching a context tag of 'Korean food'.

As described above, the context analysis apparatus 110 extracts a time context, a place context, a person context, a subject context, an interaction context, and the like for the original content by analyzing the original content (eg, a picture) and the corresponding original context. Then, the refined contexts are stored in separate context DBs with relevance of the original content. That is, the context analysis apparatus 110 extracts secondary new contexts (time, place, person, subject, interaction context, etc.) by analyzing the original content and the original context, and together with the relevance thereof, the time context DB 154. , The location context DB 155, the person context DB 156, the topic context DB 157, the interaction context DB 158, and the like. Then, since each context is associated with the corresponding content (eg, picture), it is possible to know which context (eg, picture) has what context (time, place, person, subject, interaction, etc.).

4 is a view for explaining the function of the curation device 130 according to an embodiment of the present invention.

Referring to FIG. 4, when a user accesses a system according to the present invention through a user interface or the like, the curation apparatus 130 uploads or stores pictures (contents) that the user uploads or stores through various channels. Shows. The secondary contexts extracted through the context analysis engine of the context analysis apparatus 120 are attached to the photos (contents) in a form of a tag, and the curation apparatus 130 designates the desired context. The context filters out the pictures (contents) that are tagged. For example, if the user selects three contexts of 'spring, France, family' as the AND condition, the curation apparatus 130 extracts and displays the pictures taken when the family travels to France in the spring. For reference, the photos may be arranged in various forms according to the context structure, for example, by date and time or by names of people included in the picture.

Meanwhile, in the preferred embodiment of the present invention, when extracting secondary contexts (time, place, person, subject, interaction context, etc.) with respect to the original content, the relatedness may be recorded together, in this case, a curation apparatus 130 may be extracted by considering the relevance when extracting pictures. For example, when extracting the secondary context for a given photo, 30% relevance to the time context of 'spring', 100% relate to the place context of 'France', and 80% relevance to the person's context of 'family' In this case, the curation device 130 extracts and sorts the photos that have a high overall relevance in consideration of the relevance of three contexts selected by the user, for example, 'spring, France, and family'. Can be. For reference, the 'relevance (correlation)' may be determined based on cumulative information that is directly designated by the user or obtained through social media. For example, if the context of the user's information is directly contained in the context, such as a flower blooming in spring, or if the photo has a lot of comments related to spring, it is highly relevant to the time context of 'spring'. The relevance score can vary depending on whether the information inferred from the reference DB is in the context.

In addition, the curation apparatus 130 may recommend and designate a suitable template among various design templates according to the context for the filtered and finally extracted photos, or the user may select and apply the design template directly from the design template DB 159. You may. For example, if contexts such as 'lover, travel, spring' are included in the photos, the curation device 130 may automatically recommend a design template that fits these themes. For reference, not only the design elements are included in the template, but also the conversations with friends attached to the original memories photos or the notes and writings left by the user can be used appropriately. In addition, the curation device 130 may provide not only a design template but also a DIY (Do It Yourself) editing function that allows a user to directly perform photo filtering effects or various editing functions. Curated content (eg, albums), which are curated outputs, can be given new titles and descriptions, and these elements can collectively create storytelling. Therefore, by adding context to simple photographs containing memories, complete storytelling memories contents can be generated.

5 is a view for explaining the function of the content providing device 140 according to an embodiment of the present invention.

The curation content (for example, album) generated as described above is encoded into a photograph and various production combinations as a component and stored in a separate DB, and the user can create albums created by the user through the content providing device 140. You can easily search and view. Of course, the content providing device 140 also provides functions for publishing such an album to other users or distributing it to neighbors, and curated content (eg, albums) basically provides a unique Uniform Resource Locator (URL). Since it can be distributed to various social media, it can also be delivered via SMS on a smartphone, and acquaintances can access and enjoy web pages with a single touch. In addition, it can be converted into a single large barrel image of the album can be stored separately to provide as a printed material, and can provide a variety of templates, such as albums, posters, postcards, wedding invitations in a printed form. And, beyond the two-dimensional album image, you can easily publish in a form that can be useful in a variety of situations such as ebooks, videos, presentation files, smartphone / tablet applications, etc. .

6 is a flowchart of a content curation service method based on a context according to an embodiment of the present invention. For reference, the context-based content curation service method according to the present invention may be implemented through the context-based content curation service system. Therefore, specific functions or implementation methods may be referred to the above description. Will be briefly described.

Referring to FIG. 6, first, in step S610, the content curation service system collects original content and an original context corresponding to the original content from at least one of respective social media and devices connected through a communication network. For example, the content curation service system may include various social media such as Facebook, Twitter, Flickr, Picasa, Instagram, Foursquare, etc., smart devices such as smartphones and tablets, and notebooks and desktops. Collect photos (original content) and corresponding original context associated with the user from an existing generic device such as the like. Then, the collected pictures and the contents are related to each other and stored in the original content DB and the original context DB, respectively.

In step S620, the content curation service system analyzes at least one of the original content and the source context collected in step S610 to extract at least one of a time context, a place context, a person context, a topic context, and an interaction context for the original content. do. For example, the content curation service system analyzes the original content and the original context, determines the relation of the original content with a time context, a place context, a person context, a subject context, an interaction context, and extracts secondary contexts. The content curation service system stores the extracted secondary contexts in a separate context DB together with the relevance of the original content.

In step S630, the content curation service system curates the original content based on at least one of a time context, a place context, a person context, a topic context, and an interaction context extracted in step S620. For example, the content curation service system may generate curation content by filtering and displaying contents in which the context is tagged in the form of a tag based on the context selected by the user, and reconfiguring the corresponding contents using a design template. In addition, the system itself can automatically reconfigure the contents of the appropriate memory based on the context and recommend it to the user. For reference, in this case, the content curation service system may extract and sort contents that are highly related in consideration of their relevance when extracting contents.

Finally, in step S640, the content curation service system displays the curation content generated in step S630 in a web format (e.g., social media, web page), print format (e.g., photo, album, poster), and interactive format (e.g., , Applications, e-books, and file formats (eg images, videos).

Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art to which the present invention pertains may be embodied in other specific various forms without changing the technical spirit or essential features of the present invention. The examples are to be understood in all respects as illustrative and not restrictive.

In addition, the scope of the present invention is specified by the appended claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts are included in the scope of the present invention. Should be interpreted as

Claims

In the context-based content curation service system,

A content collecting device for collecting original content and an original context corresponding to the original content from at least one of respective social media and devices connected through a communication network;

A context analysis device for analyzing at least one of the original content and the original context to extract at least one of a time context, a place context, a person context, a subject context, and an interaction context for the original content; And

And a curation device that curates the original content based on at least one of the time context, place context, person context, subject context, and interaction context.
The method of claim 1,

And a content providing device for providing curated content generated by curating the original content.
The method of claim 2,

And the curated content has a unique Uniform Resource Locator (URL).
The method according to any one of claims 1 to 3,

The context analysis apparatus extracts at least one of a time context, a place context, a person context, a subject context, and an interaction context for the original content in consideration of a channel from which the original content is collected.
The method according to any one of claims 1 to 3,

And the context analysis apparatus extracts at least one context directly from the original content using at least one of an image recognition technique, an optical character reader (OCR) technique, and a text mining technique.
The method according to any one of claims 1 to 3,

And the curation apparatus curates the original content based on a relationship between the original content and at least one of the time context, place context, person context, subject context, and interaction context.
The method according to any one of claims 1 to 3,

The curation apparatus curates the original content using a preset template.
The method according to any one of claims 1 to 3,

And at least one of the time context, the place context, the person context, the subject context, and the interaction context has a dependent hierarchical structure and a non-dependent independent structure.
The method according to claim 2 or 3,

The curation device automatically curates the original content based on at least one of the time context, place context, person context, subject context, and interaction context,

And the content providing device provides automatically generated curated content.
In the context-based content curation service method,

Collecting original content and an original context corresponding to the original content from at least one of each social media and device connected via a communication network;

Analyzing at least one of the original content and the original context to extract at least one of a time context, a place context, a person context, a subject context, and an interaction context for the original content; And

Curating the original content based on at least one of the time context, place context, person context, subject context, and interaction context.
The method of claim 10,

Providing curated content generated by curating the original content.
The method according to claim 10 or 11, wherein

Extracting the at least one context,

And extracting at least one of a time context, a place context, a person context, a subject context, and an interaction context for the original content in consideration of the channel from which the original content is collected.
The method according to claim 10 or 11, wherein

Extracting the at least one context,

Extracting at least one context directly from the original content using at least one of an image recognition technique, an optical character reader (OCR) technique, and a text mining technique.
The method according to claim 10 or 11, wherein

The curating step,

Curating the original content based on a relationship between the original content and at least one of the time context, place context, person context, subject context, and interaction context.
The method according to claim 10 or 11, wherein

The curating step,

And curating the original content using a preset template.
The method according to claim 10 or 11, wherein

The curating step,

And automatically curates the original content based on at least one of the time context, place context, person context, subject context, and interaction context.
A computer-readable recording medium having recorded thereon a program for executing the method of content-based curation service according to claim 10.
An apparatus for transmitting a program for performing a content curation service method based on a context according to claim 10.