KR101824677B1 - Social Network Service System and Method Using User's Emotion Expression - Google Patents

Abstract

The present invention relates to a social network service system and method using user′s emotional expression information. The social network service method according to the present invention includes the steps of: selecting a favorability evaluation input for contents posted by another user from a user; acquiring emotional expression data corresponding to an emotional expression by the selection and execution of the favorability evaluation input by the user; and obtaining favorability for the contents using the acquired emotional expression data. According to the present invention, the user can evaluate the favorability of the contents to be differentiated from other users. Familiarity between the user and a publisher can be improved by the evaluation of the favorability of the contents differentiated from other users. Also, the user can more interestingly evaluate the favorability.

Description

Technical Field [0001] The present invention relates to a social network service system and method using user's emotional expression information,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a social network service system and method, and more particularly, to a social network service system and method using a user's emotional expression information displayed for evaluating the likelihood of a content of another person.

Online services such as social network services provide a so-called social button function that allows a user to express his / her liking, enjoyment or support for a specific content.

A typical example of this social button is Facebook's "like button," which has a thumb-up style. In recent years, there has been a great deal of interest in 'like', 'love', 'haha', 'yay', 'wow', 'sad', 'angry' &Quot; and the like are also introduced. On the other hand, there is a method of representing the favorable size of the content by the number of stars.

Internet services with these social button functions typically show the number of users who liked each piece of content, and show some or all of the user list.

However, the evaluation of the content likelihood using the existing social buttons simply indicates whether or not the content is supported, or manually selects one of the icons corresponding to the predetermined emotional expressions.

Korean Patent Laid-Open No. 10-2014-0059110 (Apr. Korean Patent Publication No. 10-2017-0043588 (Apr. 21, 2017).

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a social network service system and method using a user's emotional expression information for evaluating the likelihood of a content of another person.

According to another aspect of the present invention, there is provided a method of providing a social network service, the method comprising: receiving a user's liking rating input for a content posted by another user; Acquiring corresponding emotional expression data, and obtaining a favorability for the content using the obtained emotional expression data.

The method may further include generating user representative data including at least one of moving picture data, image data, and audio data representing the user using at least a part of the obtained emotional expression data.

The method may further include the step of including the generated user representative data in a user list in which the likelihood of the content is evaluated.

According to an aspect of the present invention, there is provided a social network service system including a post management unit for providing content posted by another user to a user terminal, And a good feeling evaluation processing unit for obtaining good feeling for the content using emotional expression data corresponding to the emotional expression to be performed.

The good feeling evaluation processing unit may generate user representative data including at least one of moving picture data, image data, and audio data expressing the user using at least a part of the emotional expression data.

The post management unit may include the generated user representative data in a user list that evaluates the likelihood of the content.

The emotion expression data of the user may be obtained for a predetermined time from the time when the good feeling evaluation input is selected.

The acquired emotional expression data may include at least one of facial expression, sound, and gesture of the user.

The generated user representative data can be displayed as a comment on the posted content.

The user representative data may be generated when the user has achieved the highest likelihood expression.

According to the present invention, a user can evaluate the likelihood of a content differentiated from other users. You can increase familiarity between users and publishers by evaluating your content's appeal, which is different from other users. It also allows the user to perform a more interesting likelihood assessment.

1 is a block diagram illustrating a configuration of a social network service system according to an embodiment of the present invention.
2 is a block diagram showing the detailed configuration of the service server of FIG.
3 is a flowchart illustrating an operation of a social network service system according to an embodiment of the present invention.
4 to 10 are views illustrating a user terminal screen according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention.

1 is a block diagram illustrating a configuration of a social network service system according to an embodiment of the present invention.

Referring to FIG. 1, a social network service system according to the present invention may include a user terminal 100 and a service server 200, and may provide a social network service between users.

Here, social network service means online service that creates and strengthens social relations through free communication, information sharing, and network expansion among users. The social network service according to the present invention can include a service for sharing contents posted on one media page, such as a blog, a facebook, and a Twitter, among users, and sharing evaluation and comments about the posted content among users have. Of course, it may include a service for sharing contents posted on an online community bulletin board belonging to two or more users as well as a single media page among users.

The user terminal 100 and the service server 200 can exchange various information and data through the communication network 300.

The communication network 300 may include a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), an internet, a 3G, And may include various data communication networks including mobile communication network, Wi-Fi, Wireless Broadband Internet (WIBRO), or Long Term Evolution (LTE), and it does not matter whether it is wired or wireless and uses any communication method .

The user terminal 100 is an information communication terminal used by a user who is provided with a social network service according to the present invention. The user terminal 100 may be a desktop computer, a notebook computer, a smart phone, a tablet PC, a personal digital assistant (PDA), a web pad ), And the like, and can be implemented in an information communication terminal equipped with a microprocessor and having computation capability.

The user can use the social network service provided by the service server 200 using a web browser installed in the user terminal 100 or an app dedicated to the social network service according to the present invention.

For example, a user can upload a content to the service server 200 using the user terminal 100, and post it on a media page of himself or another person, a community bulletin board, or the like. Here, the content may include at least one of text, image, moving picture, and audio. Also, the user can use the user terminal 100 to receive contents posted on a one-person media page, a community bulletin board, or the like, and confirm the contents thereof.

The user can evaluate the likelihood of the content posted by the other user using the user terminal 100. [ The content likelihood evaluation according to the present invention is performed by acquiring data (hereinafter referred to as user emotion expression data) corresponding to the emotional expression performed by the user using the user terminal 100 and analyzing the data to obtain user's likelihood of the content. The emotion expression data may include at least one of a facial expression, a sound, and a gesture of the user.

The service server 200 may cause the content uploaded by the user to be posted on a media page, a community bulletin board, or the like of one's own or another person, and provide the requested content upon request of the user terminal 100. In addition, the service server 200 manages the user's likelihood evaluation result and the like according to the posted content, and can provide it according to the request of the user terminal 100.

2 is a block diagram illustrating components of a service server according to an exemplary embodiment of the present invention.

2, the service server 200 may include an interface unit 210, a post management unit 230, a favorability evaluation processing unit 250, a management unit 270, and a database unit 290.

The interface unit 210 may exchange various information and data for providing a social network service through the user terminal 100 and the communication network 300 in cooperation with a web browser of the user terminal 100 or a dedicated app, And the like.

The post management unit 230 stores and manages the uploaded content from the user terminal 100 in the database unit 290 and provides the content in response to a request from the user terminal 100. [ In addition, the post management unit 230 may store and manage the user's likelihood evaluation contents, favorite registration information, comment information, and the like for the posted content for each content in the database unit 290. [

The good impression rating processor 250 can obtain the user's likelihood of the content using the user emotion expression data.

The following method can be used for the evaluation of good feeling using user emotion expression data. For example, if the user emotion expression data is sound data for a laugh sound, it can be processed simply as increasing the likelihood in proportion to the laughter sound time and the laughter sound intensity. For example, the user's likelihood can be evaluated according to the ratio of the section corresponding to the laughter sound among the entire sections in which the user's emotional expression is input. Assuming that the entire user's emotional expression input time is 5 seconds, if it is determined that the laugh sound interval is 3 seconds, it can be determined that the laugh rate corresponds to 60%. In addition, it is also possible to obtain the likelihood by applying a feature value extracted from the sound data obtained by the user emotion expression data to a predetermined sound source acoustic model or the like. On the other hand, if the user's emotional expression data is image data of a smiling facial expression, the facial expression can be obtained by extracting feature points from the image of the user's face and applying it to a predetermined algorithm. Analyzing the facial image to analyze the degree of smile, anger, sadness, crying, etc., may use an already known image analysis algorithm. Of course, the likelihood can be calculated by the ratio of the section determined as a smiling face among the whole sections as described in the laughter sound.

The likelihood can be determined by a score within a predetermined range. For example, a score of 0 to 100 can be evaluated for favorability. Of course, it is also possible to implement such that the likelihood is evaluated at the level of the upper, middle, lower, and so on, and it is also possible to classify the good feeling evaluation as success or failure. For example, if you laughed over a certain century, it is a success, and if you fail to meet the criteria, you can treat it as a failure.

The good feeling evaluation processing unit 250 may generate user representative data expressing the user using the user emotion expression data. The user representative data may be generated using at least a part of the user emotion expression data, and may be composed of at least one of moving picture data, image data, and audio data. The user representative data generated in the good feeling evaluation processing unit 250 may be a movie clip having a short reproduction time, an audio clip, an animated GIF file, a thumbnail image, or the like. Meanwhile, according to the embodiment, the user representative data can be generated so as to be compensated only when the highest favorable feeling expression is achieved.

The user representative data may be stored in the database 290 and may be provided to the user terminal 100 at the request of the user.

The post management unit 230 may include the user representative data in the user list of the likelihood evaluation for the content. Then, the post management unit 230 may provide the content to the publisher with a good feeling evaluation user list. The content publisher can check the user representative data to see how other users express their emotions in favor of their content. For example, a content publisher may feel more intimate with the other party by checking that the opponent builds a smiling face or makes a laugh sound louder in order to evaluate the favorability of the content.

The user may also use his or her representative data to create or decorate new content. For example, a user can create a new content by loading a photograph stored in the user terminal 100 using a dedicated application, and adding user representative data in the form of a sticker image thereon. Of course, the user can upload the newly created content to the service server 200 and post it.

Also, the user can select one of the following types: 'like', 'love', 'haha', 'yay', 'wow', 'sad', 'angry' ) ', And the like, the user's representative data can be used as the emotional expression icon in the same way as the emotional expression for the content is performed with the icon corresponding to the emotional expression. If there are a plurality of user representative data held by the user, one of them may be selected and used as an emotional expression icon.

The good feeling evaluation processing unit 250 may provide an interaction with the screen of the user terminal 100 according to the good feeling obtained while the user expresses the emotional expression.

According to the embodiment, it is also possible to implement a good appraisal evaluation in the good impression level evaluation processing unit 250, generation of user representative data and provision of an interaction according to the good impression, in a dedicated app installed in the user terminal 100. That is, the special app evaluation processing unit according to the present invention can be included in the dedicated app.

The user representative data is previously stored in the database 290 of the service server 200. However, the storage location may be limited to the user terminal 100, and only when the user agrees, the service server 200 or another user To be provided to the mobile terminal. For example, when the good feeling evaluation processing unit 250 is implemented as an element of a dedicated application of the user terminal 100, the user representative data may be generated and stored in the user terminal 100.

On the other hand, the post management unit 230 manages information related to the number of favorable impressions evaluation scores, favorable impression cumulative scores, favorable evaluators list, and the like for each posted content, and provides the information to the user.

The management unit 270 manages the overall operation of the service server 200. The management unit 270 may also provide a predetermined reward to the user based on the number of times the user has performed a favorability evaluation on the post of the other person or the number of times the user has achieved the highest likelihood expression.

The database unit 290 stores various information and data related to the operation of the service server 200.

3 is a flowchart illustrating an operation of a social network service system according to an embodiment of the present invention.

Referring to FIGS. 1 to 3, the user can receive contents posted by a third party from the service server 200 and confirm the contents on the screen of the user terminal 100 (S310).

FIG. 4 illustrates an example of a user terminal screen according to an embodiment of the present invention.

The user terminal 100 can receive the content from the service server 200 and display it in the content display area 10 as shown in Fig. The user can select the buttons 21 and 22 to check the content before and after the content displayed on the current screen.

A favorability evaluation icon 30, a favorite icon 40, a comment icon 50, and the like for the content displayed on the current screen can be displayed around the content display area 10. [ A numerical value associated with the icon may be displayed next to each of the icons 30, 40, and 50.

For example, the user can select the favorite icon 40 and register the favorite content as favorites. The number displayed next to the favorite icon 40 may indicate the number of users who registered the favorite content.

The user can select a comment icon 50 and can comment on the content. The number displayed next to the icon 50 may indicate the number of comments on the content.

The user can select the favorability evaluation icon 30 to select the favorability evaluation input. And the number displayed next to the icon 30 may indicate the number of users who performed a favorability evaluation on the content. For example, if two users A and B evaluate the likelihood of the content, a 2 may be displayed next to the icon 30.

The value displayed next to the icon 30 according to the embodiment may indicate a favorable cumulative score for the content. For example, if the favorability score of the user A is 10 and the favorability score of the user B is 20, 30 may be displayed next to the icon 30.

On the other hand, when the mouse is brought on the good impression rating icon 30 or if the user touches the user without touching the user's hand, a list of users who have evaluated the goodwill with respect to the content may be displayed on the screen. The user list may include a profile image of each user. And may include the above-described user representative data according to the embodiment.

Referring again to FIG. 3, the user can check content posted by the other user on the user terminal 100, and then select a favorability evaluation input for the content (S320). For example, on the screen shown in FIG. 4, the user can select the good feeling evaluation input by clicking the icon 30. Of course, the shape of the icon 30 and the placement position on the screen may vary depending on the embodiment. Also, the user terminal 100 may be provided with a good impression rating input command by voice instead of the icon 30, and the good impression rating input may be selected in various other ways.

Next, the user terminal 100 may acquire emotional expression data corresponding to the emotional expression performed by the user for evaluating the likelihood of the contents posted by the other user (S330). In step S330, the user terminal 100 may acquire user emotion expression data through a microphone, a camera, an inertial sensor, or the like.

The means for acquiring user emotion expression data can be set in advance. For example, if the user emotional expression method menu item is selected from the configuration menu of the exclusive application, it is possible to select one of the following: 1) the camera; 2) the microphone; and 3) the inertial sensor. In this case, when the user selects the icon 30, the acquisition of the user's emotional expression data by the emotional expression method can be automatically applied and started. Of course, if the user clicks the icon 30, the emotional expression input method may be exemplified and the user may be selected.

The emotional expression performed by the user for the good impression evaluation may include at least one of facial expression, sound, and gesture operation. Of course, the user's emotional expression for favorability evaluation can be performed in a predetermined manner. Favorability evaluations may include negative evaluations as well as positive evaluations.

For example, a user may make a smiling facial expression or make a laugh sound for a favorability evaluation input. Of course, the user may make an emotion expression for favorability evaluation by applause or applause. In addition, the user can make a heart shape by collecting fingers or a gesture operation for setting up a thumb. Of course, the user may also perform a gesture operation with the user terminal 100 being held.

On the other hand, when the good feeling evaluation includes a negative evaluation, the user may make a crying face expression, make a crying sound, or may perform negative emotion expression in a predetermined manner.

According to the embodiment, the emotional expression method performed by the user can be determined in various ways other than those exemplified above.

In step S330, the user emotion expression data acquisition may be limited to a predetermined period of time from the time when the user inputs the good feeling evaluation input from the user.

Next, the user terminal 100 may provide the user emotion expression data obtained in step S330 to the service server 200 (S340).

The service server 200 may analyze user emotion expression data provided in step S340 and obtain a user's likelihood of the corresponding content (S350).

The service server 200 may cause the screen of the user terminal 100 to be provided with the interaction 60 as illustrated in FIGS. 5 to 7 based on the good feeling obtained in step S340 (S360).

As illustrated in FIGS. 5 and 6, the larger the good feeling obtained in step S350 is, the more the heart shape is filled. When the user achieves the highest likelihood expression, it may provide the same effect as popping a heart on the screen while filling up the heart shape as illustrated in FIG. FIG. 7 shows the case where the highest favorability is 40 points. If the side value of the good feeling evaluation icon 30 indicates the good feeling cumulative score, the value of '32' in FIG. 6 may be increased to '72' as shown in FIG. That is, whenever the goodness-of-feeling evaluation is completed, the side value of the goodwill rating icon 30 can be increased or decreased by the corresponding goodwill rating score.

On the other hand, when the content is subjected to the highest likelihood evaluation from another person, the shape or color of the goodwill rating icon 30 may be displayed differently as illustrated in FIG. In FIG. 6, the inner shape is an empty heart shape. In FIG. 7, the inner shape is changed to a heart shape filled with a diagonal pattern. Alternatively, the color of the icon 30, for example, which is displayed in blue, may be changed to a gold color and displayed in another way.

On the other hand, as shown in FIG. 8, when there is a content having the highest likelihood evaluation by the user, the user is allowed to express the favorability evaluation icon 30 with the user representative data of the user (favorability evaluator) when the content is displayed on the screen It is possible. So, when the user later confirms the content, he or she can immediately see that it is the content that he / she has previously rated the most favorable.

Of course, it is also possible to provide the user terminal 100 with an interaction based on the evaluation of good feeling in another form. Not only the visual representation but also the sound corresponding to the interaction at the user terminal 100 may be outputted or the vibration may be output.

Steps S330 to S360 may be repeatedly performed for a predetermined time.

When the predetermined time has elapsed (S380-Y), it is possible to terminate repeating the steps S330 to S360. On the other hand, if the highest likelihood expression is achieved within a predetermined time according to the embodiment (S370-Y), it is possible to terminate repeating from step S330 to step S360.

Then, the service server 200 may reflect the obtained user's good feeling to the contents while repeating steps S330 to S360 (S390). The user's likelihood finally reflected on the content may be determined as the maximum likelihood obtained during the repetition of the steps S330 to S360, or may be determined as an average of the likelihoods. Of course, it can be determined in other ways.

On the other hand, if the highest likelihood expression is achieved according to the embodiment, the service server 200 can be implemented so as to generate the user representative data as compensation for the highest likelihood expression. It is also possible to implement user representative data regardless of whether or not the highest favorability expression is achieved.

On the other hand, the user representative data may be used by the user to create or decorate new contents as illustrated in FIG. For example, a user can create a new content by loading a photo stored in the user terminal 100 into the photo decorating area 70 and adding the user representative data 80 in the form of a sticker image. Of course, the user can upload the newly created content to the service server 200 and post it.

On the other hand, as shown in FIG. 9, the user representative data may be used when the user inputs a comment about content posted by another person. For example, as shown in FIG. 4, when the comment icon 50 is selected on the screen for confirming the content of another person, the comment check box 90 can be displayed as shown in FIG. "I LOVE IT!" And "SO COOL!" In the comment check box 90. An icon such as a face emoticon, a heart icon, or the user's representative data 80 may be displayed, such as 'WOW !!!' and 'VERY NICE!'. Then, the user can select one of them and place it on the content displayed on the content display area 10, for example, on the photographic image. In FIG. 9, it is illustrated that various comments have already been carried out by various users, and further that the user representative data 80 is additionally running. Of course, it is also possible to select a comment icon 50 and input a comment desired by the user as text.

Embodiments of the present invention include a computer-readable medium having program instructions for performing various computer-implemented operations. The medium records a program for executing the above-described method. The medium may include program instructions, data files, data structures, etc., alone or in combination. Examples of such media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD and DVD, programmed instructions such as floptical disk and magneto-optical media, ROM, RAM, And a hardware device configured to store and execute the program. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, Of the right.

100: user terminal
200: service server
210: interface unit 230: post management unit
250: favorability evaluation processing unit 270:
290:
300: Network

Claims (14)

The user terminal selecting from the user a favorability evaluation input for content posted by another user,
The user terminal obtaining the emotional expression data corresponding to the emotional expression the user selects and performs the favorability evaluation input,
The goodness-of-feeling evaluation processing section obtaining the favorability of the content using the obtained emotion expression data,
Generating a user representative data including at least one of moving picture data, image data, and audio data expressing the user using at least a part of the obtained emotion expression data; and
Wherein the post management unit includes the generated user representative data in a user list that evaluates the likelihood of the content
Lt; / RTI >
Wherein the good feeling evaluation processing unit provides an interaction according to a good feeling obtained while the user performs emotional expression on a screen of the user terminal,
Wherein the post management unit provides the user list to a publisher that has posted the content,
The management unit provides predetermined rewards according to the number of times the user has achieved the highest favorable expression for the other's posts,
The user representative data is selected as a comment icon to be displayed on the content,
Wherein the user terminal obtains the emotional expression data for a predetermined time from a time when the good feeling evaluation input is selected,
The acquired emotional expression data includes:
And at least one of a facial expression, a sound, and a gesture of the user. delete delete delete delete delete The method of claim 1,
Wherein the user representative data is generated when the user achieves the highest likelihood expression. A user terminal selecting a favorability evaluation input for content posted by another user from a user and acquiring emotional expression data corresponding to the emotion expression selected and performed by the user,
Image data and audio data expressing the user using at least a part of the obtained emotional expression data using the emotional expression data acquired by the user terminal, A good feeling evaluation processing unit for generating representative data,
A post management unit for providing the content posted by another user to the user terminal and including the generated user representative data in a user list evaluating the likelihood of the content;
A management unit for providing a predetermined compensation according to the number of times the user has achieved the highest favorability expression for the post of the other person
Lt; / RTI >
Wherein the good feeling evaluation processing unit provides an interaction according to a good feeling obtained while the user performs emotional expression on a screen of the user terminal,
Wherein the post management unit provides the user list to a publisher that has posted the content,
The user representative data is selected as a comment icon to be displayed on the content,
Wherein the user terminal obtains the emotional expression data for a predetermined time from a time when the good feeling evaluation input is selected,
The acquired emotional expression data includes:
And at least one of facial expressions, sounds, and gestures of the user. delete delete delete delete delete 9. The method of claim 8,
Wherein the user representative data is generated when the user achieves the highest likelihood expression.

Images