KR102328998B1 - Device for learning and communication of emotion, operation method for the same, and method for recommendation and playing of video - Google Patents

Abstract

A method of operating an emotion learning and communication device is provided. The method of operating the emotion learning and communication device includes the steps of expressing a signal of an emotion inquiry, receiving a response signal to the signal of the emotion inquiry, and in response to the response signal, extracting an emotional image matching the response signal and displaying the emotional image together with a drawing process of the emotional image.

Description

Device for learning and communication of emotion, operation method for the same, and method for recommendation and playing of video

The present application relates to a device for emotion learning and communication, an operating method thereof, and a video recommendation and replay method, and more particularly, to an emotion learning and communication device capable of easily understanding and expressing one's emotions, and an operating method thereof It relates to a method of recommending and playing a video that helps to naturally watch a target video among a plurality of videos.

Emotional stability is important for all ages, but it requires special management, especially since it is a key issue for the development and growth of honorific language in children. Without emotional stability, learning, development, and rational judgment are not smooth, and without emotional stability, it is difficult to exert higher-order abilities.

Accordingly, various techniques for learning and controlling emotions have been developed.

For example, in the Republic of Korea Patent Registration No. 10-0798956 (Title of the Invention: Sound wave control method and apparatus for controlling user emotions in call mode), regardless of the user's intention, the A sound wave control method and device that can control the user's emotions by automatically generating it, and a sound wave according to the user's current emotion using a specific condition using a specific condition according to the call mode execution. Disclosed are a sound wave control method and apparatus for controlling user emotions in an effective call mode.

For another example, Republic of Korea Patent Publication No. 10-2020-0010680 (Title of the invention: an emotion recognition system, method, and computer-readable medium for performing emotion recognition of an object based on N frames using a machine learning model ), a reference frame extraction unit for deriving the reference frame of the target, a characteristic information extraction unit for extracting N first characteristic information for the N frames and second characteristic information for the reference frame, and the N Based on the first characteristic information and the second characteristic information, the emotion recognition of the target based on N frames using a machine learning model including an emotion determining unit that derives the emotion result of the target by the learned recurrent neural network model. An emotion recognition system for performing is disclosed.

One technical problem to be solved by the present application is to provide an emotion learning and communication device, and an operating method thereof.

Another technical problem to be solved by the present application is to provide an emotion learning and communication device that allows a user to easily understand and express their emotions, and an operating method thereof.

Another technical problem to be solved by the present application is to provide an emotion learning and communication device that allows a user to easily communicate and interact with their emotions and others, and an operating method thereof.

Another technical problem to be solved by the present application is to provide an emotional learning and communication device for emotional and emotional development of infants, and an operation method thereof.

Another technical problem to be solved by the present application is to provide a video recommendation and playback method.

Another technical problem to be solved by the present application is to provide a video recommendation and playback method for inducing a user to naturally view a specified target video among a plurality of videos.

Another technical problem to be solved by the present application is to provide a method for recommending and playing a video of an application running in a terminal.

Another technical problem to be solved by the present application is to provide a method for recommending and playing a video for infants.

The technical problem to be solved by the present application is not limited to the above.

In order to solve the above technical problem, the present application provides a method of operating an emotion learning and communication device.

According to an embodiment, the method of operating the emotion learning and communication apparatus includes expressing a signal of an emotion inquiry, receiving a response signal to the signal of the emotion inquiry, and matching the response signal in response to the response signal It may include extracting the emotional image to become, and displaying the emotional image together with a drawing process of the emotional image.

According to an embodiment, the extracting of the emotional image matching the response signal may include parsing a sentence included in the response signal, extracting an emotional expression phrase from the response signal, and a plurality of It may include extracting the emotional image corresponding to the emotional expression phrase from the image database in which the image is stored.

In order to solve the above technical problem, the present application provides an emotional learning and communication device.

According to an embodiment, the emotion learning and communication device includes an emotion inquiry unit expressing a signal of an emotion inquiry, a receiving unit receiving a response signal to the emotion inquiry signal, and matching the response signal in response to the response signal It may include an emotional image extracting unit for extracting an emotional image, and a display unit for displaying the emotional image together with a drawing process of the emotional image.

According to an embodiment, the emotion inquiry unit may include a visual or audio expression to express the emotion inquiry signal, and the receiving unit may include receiving the response signal of an electrical signal or a voice expression.

In order to solve the above technical problem, the present application provides a video recommendation and playback method.

According to an embodiment, as the video recommendation and playback method of an application running on a terminal, the video recommendation and playback method includes displaying a list of recommended videos including a target video, and the target video from among the list of recommended videos. If another video is selected, presenting an updated list of recommended videos including the target video while playing the selected video, and playing the target video when the target video is selected; It may include repeating steps until

According to an embodiment, compared with the list of recommended videos before the update, the target video is ranked higher in the updated list of recommended videos, the target video is a video expressing a movement in accordance with a song, and the When the target video is played, the front camera of the terminal operates and is photographed, and along with the target video, a video of another person imitating the movement of the target video and a video being recorded by the front camera of the terminal are displayed may include doing

The method of operating an emotion learning and communication apparatus according to an embodiment of the present application includes the steps of expressing a signal of an emotion inquiry, receiving a response signal to the signal of the emotion inquiry, in response to the response signal, matching the response signal It may include extracting the emotional image to become, and displaying the emotional image together with a drawing process of the emotional image. Accordingly, an emotional learning and communication device capable of easily understanding one's emotions and communicating and interacting with others may be provided. In particular, there may be provided an emotional learning and communication device capable of developing the emotions and emotions of an infant who is not good at expressing emotions.

In addition, the video recommendation and playback method according to an embodiment of the present application includes displaying a list of recommended videos including a target video, and playing the selected video when a video other than the target video is selected from the list of recommended videos. At the same time, it may include presenting an updated list of recommended videos including the target video, and repeating the step of playing the target video when the target video is selected until the target video is selected. Accordingly, the user of the terminal can naturally view the target video, and the terminal user's interest in the content of the target video can be improved.

1 is a flowchart illustrating an operation method of an emotion learning and communication apparatus according to an embodiment of the present application.
2 is a block diagram illustrating an emotion learning and communication apparatus according to an embodiment of the present application.
3 is a view for explaining the step of extracting an emotion expression phrase from a response signal in the emotion learning and communication apparatus and the operation method according to an embodiment of the present application.
4 is a view for explaining a drawing process of an emotion image in the emotion learning and communication apparatus and the operating method thereof according to an embodiment of the present application.
5 is a diagram for explaining an emotion image in an emotion learning and communication apparatus and an operating method thereof according to a modified example of an embodiment of the present application.
6 is a diagram for explaining expressing a signal of an emotion inquiry in an emotion learning and communication apparatus and an operating method thereof according to an embodiment of the present application.
7 is a flowchart illustrating a video recommendation and playback method according to an embodiment of the present application.
8 is a block diagram illustrating a video recommendation and playback method according to an embodiment of the present application.
9 to 11 are diagrams for explaining a recommended video list and a target video playback process of a video recommendation and playback method according to an embodiment of the present application.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the technical spirit of the present invention is not limited to the embodiments described herein and may be embodied in other forms. Rather, the embodiments introduced herein are provided so that the disclosed content may be thorough and complete, and the spirit of the present invention may be sufficiently conveyed to those skilled in the art.

In this specification, when a component is referred to as being on another component, it may be directly formed on the other component or a third component may be interposed therebetween. In addition, in the drawings, thicknesses of films and regions are exaggerated for effective description of technical content.

In addition, in various embodiments of the present specification, terms such as first, second, third, etc. are used to describe various components, but these components should not be limited by these terms. These terms are only used to distinguish one component from another. Accordingly, what is referred to as a first component in one embodiment may be referred to as a second component in another embodiment. Each embodiment described and illustrated herein also includes a complementary embodiment thereof. In addition, in the present specification, 'and/or' is used to mean including at least one of the elements listed before and after.

In the specification, the singular expression includes the plural expression unless the context clearly dictates otherwise. In addition, terms such as "comprise" or "have" are intended to designate that a feature, number, step, element, or a combination thereof described in the specification is present, and one or more other features, numbers, steps, configuration It should not be construed as excluding the possibility of the presence or addition of elements or combinations thereof. Also, in the present specification, the term “connection” is used to include both indirectly connecting a plurality of components and directly connecting a plurality of components.

In addition, in the following description of the present invention, if it is determined that a detailed description of a related well-known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

An emotion learning and communication apparatus, and an operating method thereof, according to an embodiment of the present application will be described with reference to FIGS. 1 to 6 .

1 is a flowchart for explaining an operation method of an emotion learning and communication apparatus according to an embodiment of the present application, FIG. 2 is a block diagram for explaining an emotion learning and communication apparatus according to an embodiment of the present application, FIG. 3 is a view for explaining the step of extracting an emotion expression phrase from a response signal in the emotion learning and communication apparatus and the operation method according to the embodiment of the present application, Figure 4 is the emotion learning and communication apparatus according to the embodiment of the present application And it is a view for explaining a drawing process of an emotional image in its operation method, FIG. 5 is a diagram for explaining an emotional image in an emotion learning and communication apparatus and an operation method thereof according to a modified example of an embodiment of the present application, FIG. 6 is a diagram for explaining expressing a signal of an emotion inquiry in an emotion learning and communication apparatus and an operation method thereof according to an embodiment of the present application.

1 to 6 , an emotion inquiry signal EIS may be expressed ( S110 ). The emotion inquiry signal EIS may be expressed by the emotion inquiry unit 110 included in the emotion learning and communication apparatus according to an embodiment of the present application.

The emotion learning and communication apparatus according to an embodiment of the present application may be a chatbot. That is, the emotion learning and communication device may be a chatbot that stores, manages, and updates various big data related to emotion, builds a database, and uses it through artificial intelligence and machine learning to communicate with the user.

The emotion inquiry unit 110 may express the emotion inquiry signal EIS in a visual or voice expression. For example, when the emotion inquiry signal EIS is a visual expression, the emotion inquiry unit 110 may inquire about the user's emotion using a picture, text, or symbol. Specifically, for example, as shown in FIG. 6 , the emotion inquiry unit 110 may inquire about the user's emotion by presenting a plurality of emoticons capable of expressing emotion to the user. In this case, the emotion inquiry unit 110 may include a display device.

Alternatively, as another example, when the emotion inquiry signal EIS is a voice expression, the emotion inquiry unit 110 may inquire about the user's emotion through sound. In this case, the emotion inquiry unit 110 may include a speaker.

Specifically, as shown in <Example 1> below, the user's emotions may be directly inquired in the language used by the user. Alternatively, as another example, the emotion inquiry unit 110 may indirectly inquire about the user's emotion in the language used by the user. Specifically, as shown in <Example 2> below, when the user is an infant, the emotion of the infant who is the user may be inquired as a method of inquiring about the emotion of the character preferred by the infant.

<Example 1>

How are you feeling?

<Example 2>

How was Pororo today?

Alternatively, as another example, the emotion inquiry unit 110 may simultaneously express the emotion inquiry signal EIS to the user through a voice expression and a visual expression.

A response signal RS to the emotional inquiry signal EIS is received (S120). The response signal RS may be received by the receiver 120 included in the emotion learning and communication apparatus according to an embodiment of the present application. The receiver 120 may be a display device having a touch screen panel or a microphone.

According to an embodiment, before expressing the emotion inquiry signal EIS, the step of learning the emotion by the user may be preceded. Specifically, the step of the user learning his/her emotions may be preceded so that the user can easily understand his/her emotions by using contents such as photos, voices, and images. For example, when the user is an infant, the step of understanding the child's emotions through a medium suitable for the development of infants and toddlers may be preceded. Specifically, a camera included in the emotion learning and communication device is driven, a facial expression of an infant is recognized through the camera, and the infant can learn their emotions through the recognized facial expression of the infant. If it is recognized that an infant is smiling, a phrase such as <Example 3> below is displayed, but a smiling photo or video is displayed in "Content 1", and an emotional expression word corresponding to "Content 1" is written. can

<Example 3>

“How do you feel (content 1) today?”

The response signal RS is a response of the user to the emotion inquiry signal EIS, and information expressing the user's emotions may be included. For example, as described above, the emotion inquiry unit 110 inquires about the user's emotion by presenting a plurality of emoticons capable of expressing emotion to the user, and the user selects any one of the plurality of emoticons presented by the user. If the emoticon is selected, the emoticon selected by the user may be the response signal RS. In this case, the receiver 120 may include a touch screen panel, and presentation of the plurality of emoticons and selection of the user may be performed using the touch screen panel.

Alternatively, for another example, when the emotion inquiry unit 110 inquires about the user's emotion through sound, the user can express his or her feelings verbally, and the sentence or word spoken by the user is the response signal (RS). can In this case, the expression of the emotion inquiry signal EIS and the reception of the response signal RS may be performed using a microphone.

Alternatively, as another example, as described above, when the emotion inquiry signal EIS is expressed by the emotion inquiry unit 110 by presenting a plurality of emoticons capable of expressing emotions to the user, the user It is possible to express the emotion of , and transmit the response signal RS to the receiver 120 .

Or, for another example, as described above, when the emotion inquiry unit 110 expresses the emotion inquiry signal (EIS) to the user at the same time as a voice expression and a visual expression (presenting a plurality of emoticons), The user transmits the response signal RS to the receiving unit 120 by selecting any one emoticon from among the plurality of emoticons, or the user expresses his or her emotions verbally to the response signal RS ) may be transmitted to the receiver 120 .

In response to the response signal RS, an emotional image EI matching the response signal RS may be extracted (S130).

When the user transmits the response signal RS to the receiver 120, the receiver 120 receives the response signal RS, and the emotion included in the emotion learning and communication apparatus according to an embodiment of the present application. may be transmitted to the image extraction unit 130 .

The emotional image extractor 130 may extract the emotional image EI from the image database 135 by using the response signal RS. The image database 135 may store a plurality of images corresponding to the emotional expression phrase. The image database 135 may be a technical configuration included in the emotion learning and communication device according to the embodiment of the present application, or an external database communicating with the emotion learning and communication device according to the embodiment of the present application can be

As described above, when the response signal RS is generated by selecting any one of the plurality of emoticons presented by the emotion inquiry unit 110, the emotion image extraction unit 130 may The emotional image EI corresponding to may be extracted from the image database 135 .

Alternatively, when the user expresses the response signal RS in words, the emotion image extraction unit 130 parses the sentence included in the response signal RS, and the emotion from the response signal RS The expression phrase may be extracted, and the emotion image EI corresponding to the emotion expression phrase may be extracted from the image database 135 .

For example, as shown in (a) of FIG. 3 , when the user expresses the response signal RS saying “I feel good eating jelly”, the receiving unit 120 responds to the response signal “I feel good eating jelly” (RS) is transmitted to the emotional image extracting unit 130, and the emotional image extracting unit 130 parses "I feel good eating jelly" into "Jelly", "Eat", and the like, and parses It is possible to extract “good” corresponding to the emotional expression phrase from among the phrases used in the expression of emotions, in this case, the emotional image extraction unit 130 selects the emotional image EI corresponding to the emotional expression phrase “good”. It may be extracted from the image database 135 .

Or, for another example, as shown in Fig. 3 (b), when the user expresses the response signal RS, "I fell on the quick board and cried", the receiving unit 120 says "I fell on the quick board and cried" The response signal RS is transmitted to the emotional image extraction unit 130, and the emotional image extraction unit 130 converts “I fell on the quick board and cried” to “quick board”, “fallen”, “cry”, etc. , and it is possible to extract "cry" corresponding to the emotion expression phrase from among the parsed phrases. In this case, the emotional image extraction unit 130 may extract the emotional image EI corresponding to the emotional expression phrase “cry” from the image database 135 .

The emotion image EI may be displayed together with the drawing process of the emotion easy EI ( S140 ).

The emotional image extraction unit 130 may transmit the emotional image EI to the display unit 140 , and the drawing process of the emotional image EI and the display of the emotional image EI are, according to an embodiment of the present application. may be performed by the display unit 140 included in the emotion learning and communication device according to the present invention. The display unit 140 may be a display device and/or a display device having a touch screen panel.

Specifically, as shown in FIGS. 4A and 4B , the process of drawing the emotional image EI is displayed over time, and the finally completed emotional image EI is displayed. can be That is, the emotional image EI is not expressed at once, and the process in which the emotional image EI is drawn and completed may be displayed according to time. Accordingly, when the user is an infant, it is possible to induce the infant's interest to improve the infant's concentration on the emotional image (EI), as well as to allow the infant to easily learn how to understand and express their emotions. can In addition, a child who has learned the drawing process of the emotional image EI can express their emotions to others by drawing the emotional image EI. Accordingly, not only children with normal development, but also children with developmental disabilities in which emotions are not easy to express can learn how to easily express their emotions.

According to a modification, the display unit 140 may display the emotional image EI together with the drawing process of the emotional image EI, but may not complete the emotional image EI. Specifically, when displaying the emotional image EI shown in FIG. 4A , the display unit 140 displays the emotional image EI together with the drawing process of the emotional image EI, In the emotional image EI, the emotional image EI may be displayed except for the “eye shape” corresponding to the main emotional expression part. Thereafter, the user may draw an “eye shape” to finally complete the emotional image EI. Accordingly, the user can more actively learn how to express his/her emotions.

According to a modification, the emotional image EI may be an image in which an object included in the response signal RS is personified. For example, specifically, as described with reference to (a) of FIG. 3 , when the response signal RS is “I feel good eating jelly”, the emotional image extraction unit 130 may From among the phrases in which the signal RS is parsed, "jelly", which is an object to be personified together with "good", which is the expression of emotion, may be extracted. Thereafter, the emotional image extraction unit 130 extracts an image of “jelly”, which is an object to be personified, from the image database 135, and the display unit 140 displays the emotion expression phrase “good”. “Jelly” can be personified and expressed so that the image can be expressed. That is, in this case, the emotional image EI may be a smiling jelly as shown in FIG. 5A . Even in this case, the emotional image (EI, smiling jelly) in FIG. can be displayed

For another example, specifically, as described with reference to FIG. 3 ( b ), when the response signal RS is “I fell and cried while riding a quickboard”, the emotional image extraction unit 130 is From among the phrases in which the response signal RS is parsed, it is possible to extract "quick board" which is an object to be personified together with "cry" which is the emotional expression phrase. Thereafter, the emotional image extraction unit 130 extracts an image of “quick board”, which is an object to be personified, from the image database 135, so that the image of “cry”, which is the emotional expression phrase, can be expressed. , “quick board” can be personified and expressed. That is, in this case, the emotional image EI may be a crying quickboard as shown in FIG. 5B . Even in this case, the emotional image (EI, crying quick board) of FIG. 5 (b) is not expressed at once, and the process of drawing and completing the emotional image (EI, crying quick board) according to time can be displayed

According to a modification, the emotion learning and communication apparatus according to an embodiment of the present application may include a record database for storing the emotion image EI and/or the emotion expression phrase. The record database may match and store the emotional image (EI) and/or the emotional expression phrase together with time information. The emotional image (EI) and/or the emotional expression phrase that are matched and stored together with time information in the record database may be transmitted to a third-party terminal. Specifically, when the user is an infant, the emotional image (EI) and/or the emotional expression phrase stored by matching with time information may be transmitted to the terminal of the infant's parent, relative, or teacher, and accordingly , a parent, relative, or teacher of the infant can easily check the emotional state of the infant for each time period.

In addition, according to one modification, when it is not easy to extract the emotional image EI matching the response signal RS because the response signal RS of the user (eg, an infant) is unclear, The emotion inquiry unit 110 may transmit the emotion inquiry signal EIS to a terminal of a third party (eg, a parent, relative, or teacher of an infant) to inquire about the user's emotion. Thereafter, the receiving unit 120 receives the response signal RS to the emotion inquiry signal EIS from a third party terminal, and the emotional image extracting unit 130 receives the emotion image extracting unit 130 from the third party terminal. The emotional image EI may be extracted using the response signal RS.

The importance of cognition, language ability, and thinking ability in the Nuri course, that is, from elementary school to high school, is increasing, and the effectiveness and importance of cognitive diagnosis are emerging. Learning and understanding one's emotions may be the entry into customized education by grasping the child's propensity, and accordingly, the emotional learning and communication device according to an embodiment of the present application may be a cornerstone leading to holistic education.

Hereinafter, a video recommendation and playback method according to an embodiment of the present application will be described with reference to FIGS. 7 to 11 .

7 is a flowchart illustrating a video recommendation and playback method according to an embodiment of the present application, FIG. 8 is a block diagram illustrating a video recommendation and playback method according to an embodiment of the present application, and FIGS. 9 to 11 is a diagram for explaining a recommended video list and a target video playback process of a video recommendation and playback method according to an embodiment of the present application.

7 to 11 , the method for recommending and playing a video according to an embodiment of the present application may be implemented through an application running in the terminal 260 . The terminal 260 may include various types of terminals such as a portable personal terminal, a PC, and a tablet.

The terminal 260 may include a recommended video list control unit 220 , a camera control unit 230 , a front camera 280 , a display unit 240 , and an input unit 250 .

A recommended video list 270 including the target video may be displayed ( S210 ). The recommended video list controller 220 may receive a video from the video database 210 that stores and manages various videos, and generates the recommended video list 270 .

As shown in FIG. 9 , the recommended video list 270 may include a plurality of other videos (video 1, video 2, video 3, and video 4) in addition to the target video.

The display unit 240 may receive the recommended video list 270 from the recommended video list controller 220 and display the recommended video list 270 on a screen. The display unit 240 may display thumbnails and representative screens of each of the target video and a plurality of other videos in the recommended video list 270 .

The target video is a video that the user of the terminal 260 should watch from among the videos in the recommended video list 270 , and is set by an administrator of the terminal 260 or a third party having a certain relationship with the user. It could be a video. Specifically, when the user is an infant, a parent, relative, or teacher of the infant may set a video desired by the infant to be viewed through the terminal 260 as the target video. By the manager of the terminal 260 or the third party, the recommended video list controller 220 may set the target video among the videos stored in the video database 210 . Alternatively, the target video may be a video produced and managed by an application manager implementing the video recommendation and playback method according to an embodiment of the present application. For example, the target video may be a video expressing a movement in accordance with a song.

When there is the target video to be displayed to the user, the manager of the terminal 260 or the third person may designate a genre, set and store the target video. Specifically, by classifying education, social relations, physical activity, art, music, and the like, the target video may be set and stored, and grouped and managed. In addition, the target video may be set, stored, and managed as a search through a recommendation, such as a recommendation of an acquaintance or a recommendation of an educational evaluation team. Specifically, it can be searched after being divided into videos by department, such as language, mathematics, science, and arts and sports.

In addition, the video database 210 may be a technical configuration included in the terminal 260 or may be an external database communicating with the terminal 260 .

It may be determined whether the target video is selected from the recommended video list 270 ( S220 ).

Specifically, the input unit 250 may receive, from the user of the terminal 260 , an input signal IS for selecting one video from the recommended video list 270 . For example, when the input unit 250 and the display unit 240 include a display device having a touch screen panel, a touch signal of a user of the terminal 260 may be the input signal IS. The input unit 250 may transmit the input signal IS to the recommended video list controller 220 .

As a result of receiving the input signal IS, if another video other than the target video is selected from among the recommended video list 270 , the selected video is played and an updated recommended video list 270 including the target video ) is presented (S230) and the target video is selected, the step of playing the target video (S235) may be repeatedly performed until the target video is selected.

Specifically, when another video other than the target video is selected from among the recommended video list 270 , the recommended video list controller 220 transmits the selected video to the display unit 240 , and the display unit 240 ) can play the selected video. In addition, along with the playback of the selected video, as shown in FIG. 10 , the recommended video list 270 including the target video is updated, and the updated recommended video list ( 270) may be displayed. In this case, the target video may be ranked higher in the updated recommended video list 270 than the recommended video list 270 before the update. As the number of times the user of the terminal 260 does not select the target video increases and the number of updates of the recommended video list 270 increases, in the updated recommended video list 270, the target video is higher may be ranked, and accordingly, it is possible to naturally induce the user of the terminal 260 to select the target video.

When the target video is selected from among the recommended video list 270 , the recommended video list controller 220 transmits the target video to the display unit 240 , and the display unit 240 displays the target video can play

As described above, the target moving image may be a moving image expressing movement in accordance with a song. In this case, when the target video is played, the recommended video list controller 220 operates the front camera 280 of the terminal 260 through the camera controller 230 to view the target video. The user of the terminal 260 may be photographed. The display unit 240 may display, along with the target video, a video of another person imitating the rhythm of the target video and a video being shot through the front camera 280 of the terminal 260 .

Accordingly, the user of the terminal 260 includes a song and rhythm played in the target video, a video of another person imitating the movement of the target video, and a video containing the image of herself being photographed through the front camera 280 . can be viewed simultaneously. That is, by simultaneously watching a video of another person imitating the movement of the target video and a video of oneself being photographed through the front camera 280, the user of the terminal 260 for the movement of the target video It can easily induce interest and imitation.

According to an embodiment, the recommended video list controller 220 may upload and/or store a video captured by the front camera 280 to the video database 210 . Accordingly, when a user of another terminal selects and views the target video, the video captured through the front camera 280 may be played back as another person's video.

It will be understood by those skilled in the art that the above-described embodiments of the present invention may be performed by computer program instructions. These computer program instructions may be embodied in the processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, such that the instructions performed by the processor of the computer or other programmable data processing equipment are not shown in the flowchart block(s). It creates a means for performing the functions of the embodiments of the invention. These computer program instructions may also be stored in a computer-usable or computer-readable memory that may direct a computer or other programmable data processing equipment to implement a function in a particular manner, the computer-usable or computer-readable memory The instructions stored in the . It is also possible to produce a manufactured item containing an instruction means for performing a function according to an embodiment of the present invention. The computer program instructions may also be mounted on a computer or other programmable data processing equipment, such that a series of operational steps are performed on the computer or other programmable data processing equipment to create a computer-executed process to create a computer or other programmable data processing equipment. It is also possible that instructions for performing the processing equipment provide steps for performing the functions described in the flowchart block(s). Additionally, each block may represent a module, segment, or portion of code that includes one or more executable instructions for executing specified logical function(s). Also, in some alternative implementations, it is possible for the functions mentioned in the blocks to occur out of order. For example, two blocks shown one after another may in fact be performed substantially simultaneously, or it is possible that the blocks are sometimes performed in the reverse order according to the corresponding function.

As mentioned above, although the present invention has been described in detail using preferred embodiments, the scope of the present invention is not limited to specific embodiments and should be construed according to the appended claims. In addition, those skilled in the art will understand that many modifications and variations are possible without departing from the scope of the present invention.

110: appraisal inquiry department
120: receiver
130: emotional image weight?z
135: image database
140: display unit
210: video database
220: recommended video list control unit
230: camera control
240: display unit
250: input unit
260: terminal
270: list of recommended videos
280: front camera

Claims (6)

expressing a signal for an emotional inquiry;
receiving a response signal to the emotional inquiry signal;
in response to the response signal, extracting an emotional image matching the response signal; and
Displaying the emotional image together with the drawing process of the emotional image, including displaying the process in which the emotional image is drawn over time,
The emotional image has a first configuration to a third configuration,
The step of displaying the emotional image,
displaying a first image having a first configuration;
after displaying the first image, displaying a second image in which a second configuration is added to the first image having a first configuration; and
After displaying the second image, displaying a third image in which a third configuration is added to the second image having the first and second configurations,
Before expressing the signal of the emotional inquiry,
The step in which the user learns emotions is preceded,
The step of the user learning the emotion,
photographing the user's facial expression through a camera; and
The method of operating an emotion learning and communication device comprising the step of displaying content of a photo or video corresponding to the captured user's facial expression and an emotion expression word corresponding to the content.
According to claim 1,
The emotional image further comprises a fourth configuration,
Completing the emotional image by the user drawing the fourth configuration on the third image that is not completed because the fourth configuration is omitted,
The step of extracting the emotional image matching the response signal,
parsing the sentence included in the response signal, and extracting an emotion expression phrase from the response signal; and
Method of operating an emotion learning and communication device comprising the step of extracting the emotion image corresponding to the emotion expression phrase from an image database in which a plurality of images are stored.
an appraisal inquiry unit that expresses a signal of an appraisal inquiry;
a receiving unit for receiving a response signal to the emotional inquiry signal;
in response to the response signal, an emotion image extraction unit for extracting an emotion image matching the response signal; and
Displaying the emotional image together with the drawing process of the emotional image, including a display unit for displaying the process of drawing the emotional image over time,
The emotional image has a first configuration to a third configuration,
The step of displaying the emotional image by the display unit,
displaying a first image having a first configuration;
after displaying the first image, displaying a second image in which a second configuration is added to the first image having a first configuration; and
After displaying the second image, displaying a third image in which a third configuration is added to the second image having the first and second configurations,
Before expressing the signal of the emotional inquiry,
The step in which the user learns emotions is preceded,
The step of the user learning the emotion,
photographing the user's facial expression through a camera; and
Emotion learning and communication apparatus comprising the step of displaying the content of the photo or video corresponding to the captured user's facial expression and the emotion expression word corresponding to the content.
4. The method of claim 3,
The emotion inquiry unit expresses a signal of the emotion inquiry by visual or voice expression,
The receiving unit, Emotion learning and communication device comprising receiving the response signal of the electrical signal or voice expression.
delete delete

Images