KR20190052584A - Terminal and server providing a video call service - Google Patents

Abstract

Disclosed are a terminal for providing a video call service, and a server for providing the video call service based on a user′s reputation index. According to the present invention, the server comprises: a communication interface performing communication with a terminal supporting a video call; a storage; a processor; and a memory storing instructions capable of being executed by the processor. The processor receives evaluation information of a user using a video call service from the terminal, updates cumulative evaluation information and a reputation index stored in the storage by corresponding to a user′ account based on the received evaluation information, and manages the video call service based on the updated reputation index.

Description

 TECHNICAL FIELD [0001] The present invention relates to a terminal and a server for providing a video call service,

To a terminal providing a video call service and a server providing a video call service.

With the development of science and technology, most people have terminals such as smart phones and tablet PCs. Such a terminal can photograph and reproduce images, communicate with other terminals to exchange information, and support video calls.

Meanwhile, various types of video call services based on video calls exist. For example, the random video chat service is a service for connecting a terminal of a user who requests a random video chat service use to a terminal of a randomly selected user among users using a random video chat service.

There is provided a server for providing a video call service based on rating information of a user based on evaluation information received from a terminal and a terminal providing a video call service by generating evaluation information corresponding to a gesture of a user of the video call service.

An application stored in a computer-readable storage medium according to the first aspect includes the steps of establishing a video call session between a first terminal of a first user and a second terminal of a second user, Detecting a gesture of the first user or the second user in a first video stream of the first user or a second video stream of the second user, the second video stream being received from the second terminal; Generating evaluation information on a counterpart of a user who has taken the detected gesture based on the detected gesture; And transmitting the generated evaluation information to a server for providing a video call service.

A server for providing a video call service according to a second aspect includes: a communication interface for performing communication with a terminal supporting a video call; storage; A processor; And a memory for storing instructions executable by the processor, wherein the processor is configured to receive the evaluation information for the user using the video call service from the terminal by executing the instructions, Updates cumulative evaluation information and reputation index corresponding to the user's account stored in the storage, and manages the video call service based on the updated reputation index.

The non-volatile computer readable storage medium having stored thereon instructions executable by the processor according to the third aspect establishes a video call session between the first terminal of the first user and the second terminal of the second user, Commands; Instructions for detecting a gesture of the first user or the second user in a first video stream captured by the first user or a second video stream captured from the second terminal and captured by the second user; Instructions for generating rating information for a party of a user who has taken the detected gesture based on the detected gesture; And transmitting the generated evaluation information to a server providing a video call service.

1 is a diagram illustrating an environment in which a video call service is provided.
2 is a block diagram illustrating a configuration of a UE according to an exemplary embodiment of the present invention.
3 is a block diagram illustrating a configuration of a server for providing a video call service according to an exemplary embodiment of the present invention.
4 is a diagram for explaining how a server providing a video call service according to another embodiment is implemented by a plurality of distributed servers.
5 is a diagram illustrating a process of generating evaluation information for a second user based on a gesture of a first user according to an embodiment.
6 is a diagram for explaining a process of generating evaluation information for a first user based on a gesture of a second user according to an embodiment.
7 is a view for explaining the types of information stored in a storage of a server providing a video call service according to an exemplary embodiment.
8 is a diagram for explaining a process of managing a video call service based on a reputation index of a user based on evaluation information received from a terminal according to an embodiment.
9 is a flowchart illustrating a method of generating evaluation information corresponding to a gesture of a user of a video call service and providing a video call service according to an exemplary embodiment of the present invention.
FIG. 10 is a flowchart illustrating a method of providing a video call service based on a reputation index of a user according to an embodiment.

Hereinafter, various embodiments will be described in detail with reference to the drawings. The embodiments described below may be modified and implemented in various different forms. In order to more clearly describe the features of the embodiments, a detailed description of known matters to those skilled in the art will be omitted.

In the present specification, when a configuration is referred to as being " connected " with another configuration, it includes not only a case of being directly connected, but also a case of being connected with another configuration in between. Also, when an element is referred to as " including " another element, it is to be understood that the element may include other elements as well as other elements.

In addition, terms including ordinals such as 'first' or 'second' used in this specification can be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The present embodiments are directed to a terminal providing a video call service and a server providing a video call service, and a detailed description of widely known matters to those skilled in the art will be omitted. do.

1 is a diagram illustrating an environment in which a video call service is provided.

A video call service means a service in which a plurality of users transmit their images to each other using their own terminals and receive and receive images of the other party. Users who use the video call service can send and receive video and voice through their terminals, and can send and receive text through the chat function. A user who wishes to use the video call service can designate the other party directly or use the video call service with the other party by designating the other party in a random or predetermined manner in a server providing the video call service.

Referring to FIG. 1, a terminal 100 is connected to a server 200 providing a video call service through a communication network. The server 200 may store various programs or applications and data that help a plurality of users to use the video call service using their respective terminals 100. The server 200 providing the video call service can perform both the local area communication and the remote area communication. The server 200 providing a video call service can be connected to a plurality of terminals 100 through a communication network. The terminal 100 may be various types of user terminals that can be used for connection with the server 200 providing the video call service. For example, the terminal 100 is a device capable of performing communication with a server 200 that provides a video call service, and may be a wearable device such as SmartWatch, a mobile device such as a smart phone, a tablet PC, a laptop computer, A stance unit such as a computer, or the like. In addition, the terminal 100 may be a video communication device supporting video communication, which can capture and reproduce video images so that video communication can be performed between users connected through a video communication service.

2 is a block diagram illustrating a configuration of a terminal 100 according to an embodiment.

2, the terminal 100 may include a memory 110, a processor 120, a user interface 130, a communication interface 140, and a voice and video input unit 150. It will be understood by those skilled in the art that other general-purpose components other than the components shown in FIG. 2 may be further included.

The memory 110 may store software or programs. For example, memory 110 may store programs such as applications, application programming interfaces (APIs), and the like, as well as various types of data. Memory 110 may store instructions executable by processor 120.

The processor 120 may execute instructions stored in the memory 110. The processor 120 may use various programs, contents, and data stored in the memory 110, or may store new programs, contents, and data in the memory 110.

The processor 120 may access the memory 110 and perform booting using the O / S stored in the memory 110. [ The processor 120 may perform various operations using various programs stored in the memory 110, contents, data, and the like. For example, the processor 120 may display a predetermined screen on the display 136 using various programs, contents, and data stored in the memory 110. The processor 120 may perform a control operation corresponding to a user's operation when a user operation is performed on one area of the display 136. [

The processor 120 may include a GPU (Graphic Processing Unit) specialized for graphics processing. The GPU displays the user interface screen in the area of the display 136 when the booting of the terminal 100 is completed. Specifically, the GPU can generate a screen displaying a video call layout including various objects such as contents, icons, menus, and the like. The GPU can calculate property values such as coordinate value, shape, size, color, etc., which each object will be displayed according to the video call layout of the screen. Then, the GPU can generate screens of various layouts including objects based on the computed attribute values. The screens generated in the GPU may be provided to the display 136 and displayed in each area of the display 136, respectively.

Meanwhile, the processor 120 may include a video processor and an audio processor. The processor 120 may control the video processor and the audio processor to process the video stream received through the communication interface 140 or the video data or audio data contained in the video stream stored in the memory 110. [

The user interface 130 may include an input unit 131 and an output unit 135.

The input unit 131 can receive various commands from the user. The input unit 131 may include at least one of a keypad 132, a touch panel 133, and a pen recognition panel 134.

The keypad 132 may include various types of keys, such as mechanical buttons, wheels, etc., formed in various areas such as the front or side portions of the body exterior of the terminal 100,

The touch panel 133 senses the touch input of the user and can output a touch event value corresponding to the sensed touch signal. When the touch panel 133 is combined with the display panel to constitute a touch screen, the touch screen may be implemented by various types of touch sensors such as an electrostatic type, a pressure sensitive type, a piezoelectric type, and the like.

The pen recognition panel 134 senses proximity input or touch input of the pen according to the operation of the user's touch pen (for example, a stylus pen) and outputs a sensed pen proximity event or a pen touch event . The pen recognition panel 134 may be implemented, for example, by the EMR method, and may detect the touch or proximity input according to the proximity of the pen or the change in intensity of the electromagnetic field due to the touch. The pen recognition panel 134 may include an electromagnetic induction coil sensor having a grid structure and an electronic signal processing unit for sequentially providing an AC signal having a predetermined frequency to each loop coil of the electromagnetic induction coil sensor.

The output unit 135 may include a display 136 and a speaker 137.

The display 136 may include a display panel and a controller for controlling the display panel. The display panel can be implemented in various ways such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an AM-OLED (Active-Matrix Organic Light-Emitting Diode), a PDP (Plasma Display Panel) The display panel may be flexible or wearable. The display 136 may be coupled to the touch panel 133 of the input unit 131 and provided as a touch screen.

The speaker 137 can output sound based on the audio data. For example, the speaker 137 can output the user's voice according to the audio data included in the video stream.

The communication interface 140 can perform communication with various types of external devices according to various types of communication methods. The communication interface 140 may include at least one of a Wi-Fi chip, a Bluetooth chip, an NFC chip, and a wireless communication chip. The processor 120 can communicate with various external devices using the communication interface 140. [

The Wi-Fi chip and the Bluetooth chip can perform communication using the WiFi method and the Bluetooth method, respectively. When a Wi-Fi chip or a Bluetooth chip is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The NFC chip refers to a chip operating in the NFC (Near Field Communication) mode using the 13.56 MHz band among various RF-ID frequency bands. The wireless communication chip can communicate with various communication standards such as IEEE (Institute of Electrical and Electronics Engineers), ZigBee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), LTE (Long Term Evolution), 5G Quot; chip "

The audio and video input unit 150 may include a microphone 151 and a camera 153. The microphone 151 can receive a user voice or other sound and convert it into audio data. The processor 120 may use the user's voice input through the microphone 151 for video communication or convert the audio data into the audio data and store the audio data in the memory 110. [ The camera 153 can take a still image or a moving image under the control of the user. The camera 153 may be a camera module located on the front or back of the terminal 100. The processor 120 may generate a video stream for video communication using a voice input through the microphone 151 and an image captured by the camera 153. [

Meanwhile, the terminal 100 can operate in a motion control mode or a voice control mode. When operating in the motion control mode, the processor 120 activates the camera 153 to photograph a user, track a user's motion change, and perform a corresponding control operation. When operating in the voice control mode, the processor 120 analyzes the user voice input through the microphone 151 and performs a control operation according to the analyzed user voice.

The names of the components of the terminal 100 may vary. In addition, the terminal 100 according to the present disclosure may be configured to include at least one of the above-described components, and some components may be omitted or further include other additional components. The terminal 100 may perform the following operations using at least one of the above-described components.

3 is a block diagram illustrating a configuration of a server 200 for providing a video call service according to an exemplary embodiment of the present invention.

Referring to FIG. 3, a server 200 for providing a video call service includes a memory 210, a processor 220, a storage 230, and a communication interface 240. It will be understood by those skilled in the art that other general-purpose components other than the components shown in FIG. 3 may be further included. Each component of the block diagram of FIG. 3 may be separated, added, or omitted depending on the implementation of the server 200 providing the video call service. That is, depending on the implementation method, one component may be divided into two or more components, two or more components may be combined into one component, and some components may be added or removed.

The memory 210 may store instructions executable by the processor 220. The memory 210 may store software or programs.

The processor 220 may execute instructions stored in the memory 210. The processor 220 may perform overall control of the server 200 providing the video call service. The processor 220 may obtain information and requests received via the communication interface 240 and store the received information in the storage 230. In addition, the processor 220 may process the received information. For example, the processor 220 may generate information used for a video call service from the information received from the terminal 100, or may perform a processing operation to manage received information and store the information in the storage 230 . The processor 220 may also provide the video call service to the terminal 100 through the communication interface 240 using the information stored in the storage 230 as a response to the request obtained from the terminal 100 Can be transmitted.

The storage 230 can store various kinds of software and information necessary for the server 200 providing the video call service to provide the video call service. For example, the storage 230 may store programs, applications, and various data used in the video call service, which are executed in the server 200 providing the video call service.

The storage 230 can store and manage personal information for each user using the video call service in a database. The storage 230 may store personal information of a user and various information used for a video call service for each account to be connected to the server 200 providing the video call service.

The communication interface 240 may perform communication with an external device including the terminal 100. [ For example, the server 200 providing the video call service receives a video call service start request from the terminal 100, a request for setting information for establishing a video call service environment, and the like, In response, the user can provide all the information related to the video call service.

FIG. 4 is a diagram for explaining how a server 200 for providing a video call service according to another embodiment is implemented with a plurality of distributed servers. The contents described in connection with the server 200 for providing the video call service can be applied as they are in the following description.

4, the distributed servers providing the video call service may include a load distribution server 200-1 and function servers 200-3, 200-5, and 200-7 for providing a video call service. have. The load balancing server 200-1 includes function servers 200-3, 200-5, and 200-7 that provide a video call service when there is a request for a video call service of an external device such as the terminal 100, And selects an optimal server by monitoring the statuses of the function servers 200-3, 200-5, and 200-7 that provide video call services to the terminal 100, (100).

5 is a diagram illustrating a process of generating evaluation information for a second user based on a gesture of a first user according to an embodiment.

Referring to FIG. 5, the second user, who is the other party of the video call with the first user, can make a video call through the first terminal 100-1 and the second terminal 100-2, respectively. The first terminal 100-1 and the second terminal 100-2 may be provided with an application for providing a video call service provided by the video call service provider. The first terminal 100-1 and the second terminal 100-2 can be connected to a server 200 providing a video call service by executing an application for providing a video call service, And can receive the video call service provided.

The first terminal 100-1 may transmit a request for using the video call service to the server 200 providing the video call service. In response to a request for use of the video call service of the first terminal 100-1, the server 200 providing the video call service transmits a video call request to the second terminal 100-2 of the second user, It is possible to provide the first terminal 100-1 with the information required for the video call so that the first terminal 100-1 can perform the video call. The server 200 providing the video call service may randomly select the other party of the video call or select it according to a predetermined rule in accordance with the use request of the video call service of the first terminal 100-1, Can be selected as the designated party. The first terminal 100-1 of the first user and the second terminal 100-2 of the second user can establish a video call session with each other for video call.

When a video call session is established between the first terminal 100-1 and the second terminal 100-2, the first video stream captured by the first user is transmitted from the first terminal 100-1 to the second terminal 100-1 -2), and the second video stream captured by the second user may be transmitted from the second terminal 100-2 to the first terminal 100-1. The first terminal 100-1 receives the second video stream from the second terminal 100-2 and the second terminal 100-2 receives the first video stream from the first terminal 100-1 can do.

The first terminal 100-1 may acquire the first video stream of the first user or the second video stream of the second user, which is received from the second terminal. The second terminal 100-2 can acquire the second video stream captured by the second user or the first video stream captured by the first terminal 100-1 and captured by the first user.

The first terminal 100-1 can display the image of the second user on the screen of the first terminal 100-1 based on the second video stream and can display the image of the first user 100-1 on the basis of the first video stream, Can be displayed in a part of the screen area where the image of the second user is displayed. The second terminal 100-2 can display the image of the first user on the screen of the second terminal 100-2 based on the first video stream and can display the image of the second user 100-2 on the basis of the second video stream, Can be displayed in a part of the screen area where the image of the first user is displayed. 5, the first terminal 100-1 displays an image of the second user on the screen of the first terminal 100-1 and transmits the image of the first user to the first terminal 100-1, 1) in a smaller display size in a part of the screen. The second terminal 100-2 displays the image of the first user on the screen of the second terminal 100-2 and the image of the second user on the screen of the second terminal 100-2 It is possible to display with a smaller display size.

When the first terminal 100-1 and the second terminal 100-2 execute the same application for providing a video call service and a video call is made between the first user and the second user, The functions of the first terminal 100-1 and the second terminal 100-2 are the same as those of the first terminal 100-1 and the second terminal 100-2, The description is omitted.

When a video call service is executed between the first terminal 100-1 and the second terminal 100-2, the first terminal 100-1 transmits the first video stream from the first video stream captured by the first user, Can be detected. The first terminal 100-1 may detect at least one gesture among the first user's facial expressions, gestures, and behaviors in the first video stream captured by the first terminal 100-1.

The gesture means, for example, non-verbal communication that a user transmits using a face, a hand, and a body, and can be a facial expression, a hand gesture, a gesture, and the like. By taking a gesture, the user can communicate his or her intention to the other party or induce a response to the other party. The expression is, for example, a user expressing his or her thoughts by moving eyes, eyebrows, noses, mouths, foreheads, balls, etc. through the face. For example, facial expressions can be blinking eyes, making the eyes bigger or cold, raising the lips, spreading the mouth, licking the lips, frowning the forehead. The gesture, for example, allows the user to take a predetermined shape or action with the hand, and the gesture shows the user's thought by letting the user take a predetermined shape or action. A hand gesture can be an OK sign, a thumb up or down, a 'V' hand, a hand waving back and forth, and a hand waving right and left. A gesture can be a twist, a shoulder shake, or an arm-brace.

Referring to FIG. 5, the first terminal 100-1 displays a smile image of the second user on the screen of the first terminal 100-1, and displays an image laughed by the first user on the screen of the second user 100-1 Is displayed in the lower left area of the screen area to be displayed. The first terminal 100-1 can detect the smile of the first user in the first video stream captured by the first user. For example, when the first user makes a gesture to raise the thumb, the first terminal 100-1 may detect the beck of the first user to raise the thumb in the first video stream. The first terminal 100-1 can detect the gesture of the first user in the first video stream based on the feature points in the face, hand, and body of the first user in the first video stream. The first terminal 100-1 may continuously detect the gesture of the first user at a real time or a predetermined interval interval.

The first terminal 100-1 can generate the evaluation information for the second user, which is the opponent of the first user who took the detected gesture, based on the detected gesture of the first user. The first terminal 100-1 may generate the emotion information or the icon information corresponding to the detected gesture as the evaluation information for the second user.

Since the gesture is a user consciously or unconsciously expressing his or her intention using a face, a hand, or a body, each gesture may have corresponding emotion information. The emotion information may be a feeling of the user depending on the gesture, a feeling of mood, an atmosphere, or expression itself. For example, the emotion information may be a joy, happiness, anger, pleasure, bitterness, sadness, depression, drowsiness, dullness, anxiety, laughter, satisfaction, smile, laughter, wink, crying, affirmation, (Refusal).

Also, each gesture may have corresponding icon information. The icon information may be a picture or symbol that intuitively depicts the gesture in a manner similar to a gesture, or represents the information of the emotion corresponding to the gesture. For example, the icon information may include a picture of a shape or a shape corresponding to each of the user's facial expressions, hand gestures, or gestures, or may include symbols or characters representing emotion information.

Referring to FIG. 5, the first terminal 100-1 may generate evaluation information for the second user based on the laughing expression of the detected first user. For example, the first terminal 100-1 may be an opponent of the first user who takes a smiling face of the 'smile' or 'smile icon' corresponding to the smile of the first user And can be generated as evaluation information for the second user. In another example, if the first user makes a gesture to raise the thumb, the first terminal 100-1 responds to the gesture of raising the thumb of the first user on the basis of the gesture of raising the thumb of the first user Quot; thumbnail icon ", or " thumbnail icon ", which is a counterpart of the first user who has picked up the thumb, may be generated as an evaluation criterion for the second user. Since the gesture taken by the first user is a response to the attitude or behavior of the second user, if a gesture of the first user is detected in the first video stream, the gesture of the second user, It becomes evaluation information.

The first terminal 100-1 may transmit the evaluation information about the second user generated by the first terminal 100-1 to the server 200 providing the video call service. The first terminal 100-1 may transmit the evaluation information about the second user to the server 200 providing the video call service in correspondence with the account of the second user. 5, the first terminal 100-1 transmits the icon information or the icon information generated based on the gesture of the first user detected in the first video stream to the server 200 providing the video call service, Lt; / RTI > Likewise, the second terminal 100-2 can transmit the emotion information or icon information generated based on the gesture of the second user detected in the second video stream to the server 200 providing the video call service have.

Meanwhile, the first terminal 100-1 may transmit the evaluation information about the second user to the second terminal 100-2. Since the evaluation information for the second user is generated in the first terminal 100-1 based on the gesture of the first user detected in the first video stream, feedback is given to the second user about what evaluation the second user will receive So as to induce positive dialogue and positive gestures among users who make video calls. Referring to FIG. 5, icon information 'smile icon' corresponding to the smile of the first user may be transmitted from the first terminal 100-1 to the second terminal 100-2. According to the icon information transmitted to the second terminal 100-2, a 'smile icon' may be displayed in the overlapping area of the second terminal 100-2 where the first video stream is displayed. Accordingly, the second user can recognize that the first user, who is the other party of the video call, makes a laughing smile and obtains the emotion information or icon information corresponding to the laughing expression as his own evaluation information.

On the other hand, the first terminal 100-1 receives the evaluation information on the first user from the second terminal 100-2, and transmits the evaluation information on the received first user to the area where the second video stream is displayed It is possible to superimpose them. Since the evaluation information for the first user is generated in the second terminal 100-2 based on the gesture of the second user detected in the second video stream, it is possible to give feedback to the first user on what evaluation the first user will receive Give. Referring to FIG. 5, when the second user is smiling, the second terminal 100-2 detects the smile expression of the second user in the second video stream captured by the second user, and responds to the smile expression As the evaluation information for the first user who is the other party of the second user who takes a smiling face of the 'smile' icon information or the 'smile icon' icon information. Icon information called a 'smile icon' corresponding to the smiling face of the second user may be transmitted from the second terminal 100-2 to the first terminal 100-1. According to the icon information transmitted to the first terminal 100-1, a 'smile icon' may be displayed in the area where the second video stream is displayed in the first terminal 100-1. Accordingly, the first user can recognize that the second user, who is the other party of the video call, smiles and acquires the emotion information or the icon information corresponding to the smiling face as his own evaluation information.

6 is a diagram for explaining a process of generating evaluation information for a first user based on a gesture of a second user according to an embodiment.

The process of making a video call with the second terminal 100-2 of the second user, which is the other party of the video call, in response to the use request of the video call service of the first terminal 100-1 is the same as that described in FIG. 5 Therefore, it is omitted.

Referring to FIG. 6, when the first terminal 100-1 and the second terminal 100-2 execute a video call service between the first terminal 100-1 and the second terminal 100-2, The gesture of the second user in the second video stream captured from the second user can be detected. The first terminal 100-1 may detect at least one gesture among the second user's facial expressions, gestures, and behaviors in the second video stream captured by the second terminal 100-2.

Referring to FIG. 6, the first terminal 100-1 displays a smile image of the second user on the screen of the first terminal 100-1, and displays an image laughed by the first user on the screen of the second user 100-1 Is displayed in the lower left area of the screen area to be displayed. The first terminal 100-1 can detect the smile expression of the second user in the second video stream captured by the second user. For example, if the second user makes an OK sign, the first terminal 100-1 may detect a hand gesture of the second user who performs an OK sign beacon in the second video stream. The first terminal 100-1 can detect the gesture of the second user in the second video stream based on the feature points in the face, hand, and body of the second user in the second video stream. The first terminal 100-1 can continuously detect the gesture of the second user in real time or at a predetermined interval interval.

The first terminal 100-1 can generate the evaluation information for the first user who is the other party of the second user who has taken the detected gesture based on the detected gesture of the second user. The first terminal 100-1 may generate the emotion information or the icon information corresponding to the detected gesture as the evaluation information for the first user.

Referring to FIG. 6, the first terminal 100-1 may generate evaluation information for the first user based on the smile expression of the detected second user. The first terminal 100-1 transmits the icon information of 'smile' or the icon information of 'smile icon' corresponding to the smile expression of the second user to the first user who is the opponent of the second user who takes a smiling face And can be generated as evaluation information. If the second user makes an OK sign, the first terminal 100-1 determines whether or not an emotion called " good (acceptable) " corresponding to a becky of raising the thumb of the second user on the basis of the hand gesture of the OK sign of the second user Information or 'OK icon' may be generated as the evaluation information for the first user, which is the opponent of the second user who has taken the OK sign beep. Since the gesture taken by the second user is a response to the attitude or behavior of the first user, if a gesture of the second user is detected in the second video stream, the gesture of the second user, which is the opposite of the second user, It becomes evaluation information.

The first terminal 100-1 may transmit the evaluation information of the first user generated by the first terminal 100-1 to the server 200 providing the video call service. The first terminal 100-1 may transmit the evaluation information about the first user to the server 200 providing the video call service in correspondence with the account of the first user. As shown in FIG. 6, the first terminal 100-1 transmits the icon information or the icon information generated based on the gesture of the second user detected in the second video stream to the server 200 providing the video call service, Lt; / RTI > Likewise, the second terminal 100-2 can transmit the emotion information or the icon information generated based on the gesture of the first user detected in the first video stream to the server 200 providing the video call service have.

The first terminal 100-1 can display the evaluation information on the first user generated by the first terminal 100-1 in an area where the second video stream is displayed. Since the evaluation information for the first user is generated in the first terminal 100-1 based on the gesture of the second user detected in the second video stream, feedback is given to the first user about what evaluation the first user will receive So as to induce positive dialogue and positive gestures among users who make video calls. 6, icon information 'smile icon' corresponding to a smiley face of a second user is generated in the first terminal 100-1, a 'smile icon' is displayed on the first terminal 100-1, The second video stream may be superimposed on the displayed area. Also, since the first terminal 100-1 generates the emotion information 'smile' corresponding to the smiling face of the second user at the first terminal 100-1, . Accordingly, the first user can recognize that the second user, who is the other party of the video call, smiles and acquires the emotion information or the icon information corresponding to the smiling face as his own evaluation information.

Referring to FIG. 6, when the first user laughs, the second terminal 100-2 detects the laughing expression of the first user in the first video stream captured by the first user, and responds to the laughing expression As the evaluation information for the second user who is the opponent of the first user who takes a smiling face of the 'smile' icon information or the 'smile icon' icon information. The icon information of the 'smile icon' corresponding to the smile of the first user can be displayed in the overlapping area of the second terminal 100-2 where the first video stream is displayed. In addition, the second terminal 100-2 can generate a voice called " laughing " as the emotion information " laugh " corresponding to the laughing expression of the first user is generated in the second terminal 100-2 Output. Accordingly, the second user can recognize that the first user, who is the other party of the video call, makes a laughing smile and obtains the emotion information or icon information corresponding to the laughing expression as his own evaluation information.

7 is a view for explaining the types of information stored in the storage 230 of the server 200 providing a video call service according to an exemplary embodiment.

5 and 6, the server 200 providing the video call service receives the evaluation information about the user using the video call service from the first terminal 100-1 or the second terminal 100-2, Lt; / RTI > The storage 230 of the server 200 providing the video call service can store not only the evaluation information of the user but also various information necessary for providing the video call service by the server 200 providing the video call service have.

Referring to FIG. 7, the storage 230 of the server 200 providing the video call service stores a plurality of kinds of cumulative evaluation information and cumulative evaluation information for each user of a plurality of users using the video call service It can store a total reputation index reflecting the corresponding Reputation Quotient and all kinds of reputation indices.

For example, the cumulative evaluation information may include cumulative emotion information, cumulative icon information, cumulative preference / avoidance degree information, and the like, depending on the type. The accumulated emotion information is, for example, information in the form of accumulating the emotion information received from the terminal 100 using the video call service, and the accumulated icon information may include, for example, icon information received from the terminal 100 It can be accumulated information. The emotion information or icon information may be evaluation information on a user corresponding to a gesture taken by a user of a user who uses the video call service in the first video stream of the first user or the second video stream of the second user . The cumulative preference / avoidance degree information may be information in the form of cumulative preference / avoidance degree information received from the terminal 100, for example. The preference / avoidance degree information may be a user who uses the video call service directly inputs a liking or a desire for the other party of the video call during or after the video call.

The reputation index may be a measure of how a user of a video call service receives an evaluation from other users. The aggregate reputation index may reflect the reputation index corresponding to each cumulative rating information and any reputation index. For example, the emotion reputation index is obtained based on cumulative emotion information, the icon reputation index is obtained based on the cumulative icon information, and the preference / avoidance index can be obtained based on the preference / avoidance degree information. The total reputation index may be a reputation index that reflects the emotion reputation index, the icon reputation index, and the likelihood / avoidance reputation index together. The total reputation index can be calculated with different weights depending on the type of reputation index.

Personal information may include personal information such as nationality, name, sex, and interests of the user using the video call service.

The cyber money information is a virtual money for using an additional service provided by a user who uses a video call service for a fee. For example, in order to perform a video call matching with a user having a desired condition, the user must pay a predetermined cyber money.

The server 200 providing the video call service receives the evaluation information on the user who uses the video call service and generates cumulative evaluation information corresponding to the user's account stored in the storage 230 based on the received evaluation information You can update your reputation index. The server 200 providing the video call service can receive the emotion information or the icon information corresponding to the gesture taken by the user of the user who uses the video call service as the evaluation information for the user. The server 200 providing the video call service can obtain the updated reputation index from the updated cumulative evaluation information by changing the weight according to the kind of the emotion information or the type of the icon information.

The server 200 providing the video call service can manage the video call service based on the updated reputation index. For example, the server 200 providing the video call service can manage the video call service by providing a video call matching supplementary service that matches a plurality of users using the video call service, based on the updated reputation index have. For example, the server 200 providing the video call service categorizes a plurality of users using the video call service based on the updated reputation index, and performs a user management corresponding to each category to which each user belongs By providing additional services, video call service can be managed.

Meanwhile, the server 200 providing the video call service can transmit the updated cumulative evaluation information or the updated reputation index to the terminal 100 through the communication interface 240.

8 is a diagram for explaining a process of managing a video call service based on a reputation index of a user based on evaluation information received from a terminal according to an embodiment.

The server 200 providing the video call service can receive the evaluation information on the user who uses the video call service and can update the cumulative evaluation information corresponding to the user's account stored in the storage 230. The server 200 providing the video call service can update the reputation index corresponding to the user's account based on the updated cumulative evaluation information corresponding to the account of the user.

Referring to FIG. 8, the server 200 for providing a video call service may receive first information such as 'smiley' and 'good (acceptance)' as well as 'smiley icon' and 'OK icon' Icon information can be received. The server 200 providing the video call service can update the received emotion information and icon information with the accumulated emotion information and the accumulated icon information. Accordingly, 'Smile', 'Good' (acceptance), 'Sadness', and 'Anger' are stored in the space corresponding to the first user account in the storage 230 as accumulated cumulative information, ',' OK icon ',' Angry icon ', and' Tear icon 'can be stored. On the other hand, the cumulative preference / avoidance information may be stored twice as 'down', which means avoidance or dislike. The server 200 providing the video call service can update the reputation index based on the updated cumulative evaluation information corresponding to the first user account. The server 200 for providing the video call service has a weighting value for each of the accumulated emotion information corresponding to the first user account, that is, 'smile', 'good (acceptance)', 'sadness' It is possible to obtain the emotion reputation index corresponding to the user account. The server 200 for providing the video call service may change the weights for the smile icon, the OK icon, the angry icon, and the tear icon, which are cumulative icon information corresponding to the first user account, 1 icon rating index corresponding to the user account can be obtained. The server 200 providing the video call service can acquire a preference / avoidance index corresponding to the first user account based on the second 'down' cumulative preference / avoidance information corresponding to the first user account . The server 200 providing the video call service can acquire a comprehensive reputation index corresponding to the first user account in consideration of the emotion reputation index, the icon reputation index, and the preference / avoidance index corresponding to the first user account . The server 200 for providing the video call service can calculate the overall reputation index with different weights according to the types of the flat indices corresponding to the first user account.

Referring to FIG. 8, the server 200 for providing a video call service may include second information such as 'smile', 'satisfaction', and 'smile icon' and 'thumbnail icon' Information can be received. The server 200 providing the video call service can update the received emotion information and icon information with the accumulated emotion information and the accumulated icon information. Accordingly, 'laugh', 'satisfaction', 'sleepiness', and 'unfiltered' are stored in the space corresponding to the second user account in the storage 230 as accumulated cumulative icon information, 'Thumb chuck icon', 'Yawning icon', and 'Upset icon' can be stored. On the other hand, cumulative preference / avoidance information may be stored twice as 'up', which means preference or appeal. The server 200 providing the video call service can update the reputation index based on the updated cumulative evaluation information corresponding to the second user account. The server 200 providing the video call service may change the weights of the cumulative emotion information corresponding to the second user account such as' laugh ',' satisfaction ',' sleepiness', and ' The corresponding emotion reputation index can be obtained. The server 200 for providing the video call service has a weight for each of the accumulated icon information corresponding to the second user account, i.e., the 'smiling face icon', the 'thumb thumb icon', the ' To obtain an icon reputation index corresponding to the second user account. The server 200 providing the video call service can acquire the preference / avoidance index corresponding to the second user account based on the second 'up' cumulative preference / avoidance information corresponding to the second user account . The server 200 providing the video call service can acquire the overall reputation index corresponding to the second user account in consideration of both the emotion reputation index, the icon reputation index, and the preference / avoidance index corresponding to the second user account . The server 200 providing the video call service can calculate the overall reputation index by changing the weights according to the types of the flat indices corresponding to the second user accounts.

The server 200 providing the video call service can manage the video call service based on the updated reputation index. The server 200 providing the video call service can manage the video call service based on at least one of the emotion reputation index, the icon reputation index, the preference / avoidance degree index, and the comprehensive reputation index.

Referring to FIG. 8, a server 200 for providing a video call service provides a video call matching supplementary service that matches a plurality of users using a video call service, based on the updated reputation index, can do. For example, the server 200 providing the video call service can perform video call matching between people who are within the same category as the reputation index, based on the updated reputation index of each of the plurality of users using the video call service, It is possible to provide a video call matching service such as a video call matching with a reputable user having a high reputation index to a paying user or a video call matching with a reputable user having a high reputation index to a new subscriber of the video call service.

The server 200 providing the video call service categorizes a plurality of users using the video call service based on the updated reputation index and provides a user management service corresponding to each category to which each user belongs, Video call service can be managed. For example, the server 200 providing the video call service categorizes a plurality of users who use the video call service based on the updated reputation index of each of the plurality of users using the video call service, Benefit, or warn the reputation index not to be blacklisted to low-level users, or temporarily or permanently restrict the use of the video call service to users of a category with a lower reputation index than the reputation index threshold A user management additional service corresponding to each category to which the user belongs can be provided.

9 is a flowchart illustrating a method of generating evaluation information corresponding to a gesture of a user of a video call service and providing a video call service according to an exemplary embodiment of the present invention.

In block 910, the first terminal 100-1 establishes a video call session between the first terminal 100-1 of the first user and the second terminal 100-2 of the second user, which is the other party of the video call .

In block 920, the first terminal 100-1 receives the first video stream of the first user or the second video stream of the second user 1002, which is received from the second terminal 100-2, Or the gesture of the second user.

When the first terminal 100-1 detects the gesture of the first user, the first terminal 100-1 detects the gesture of the first user in the first video stream captured by the first terminal 100-1, , A gesture, and an action.

In the case where the first terminal 100-1 detects the gesture of the second user, the first terminal 100-1 detects the gesture of the second user in the second video stream received from the second terminal 100-2, , A gesture, and an action.

At block 930, the first terminal 100-1 may generate evaluation information for the other party of the user who took the detected gesture, based on the detected gesture. The first terminal 100-1 can generate the emotion information or the icon information corresponding to the detected gesture as the evaluation information for the other party.

When detecting the gesture of the first user at the first terminal 100-1, the first terminal 100-1 may generate the evaluation information for the second user based on the detected gesture.

When detecting the gesture of the second user at the first terminal 100-1, the first terminal 100-1 may generate the evaluation information for the first user based on the detected gesture.

In block 940, the first terminal 100-1 may transmit the generated evaluation information to the server 200 providing the video call service.

When the first terminal 100-1 detects the gesture of the first user, the first terminal 100-1 transmits the evaluation information about the generated second user to the server 200 in correspondence with the account of the second user, Lt; / RTI >

When the first terminal 100-1 detects the gesture of the second user, the first terminal 100-1 transmits the evaluation information on the generated first user to the server 200 in correspondence with the account of the first user, Lt; / RTI >

When the first terminal 100-1 detects the gesture of the first user, the first terminal 100-1 may transmit the evaluation information on the generated second user to the second terminal 100-2 . Also, the first terminal 100-1 receives the evaluation information on the first user from the second terminal 100-2, and transmits the evaluation information on the received first user to the area where the second video stream is displayed It is possible to superimpose them.

When the first terminal 100-1 detects the gesture of the second user, the first terminal 100-1 superimposes the evaluation information on the generated first user on the area where the second video stream is displayed, can do.

FIG. 10 is a flowchart illustrating a method of providing a video call service based on a reputation index of a user according to an embodiment.

In block 1010, the server 200 providing the video call service can receive the evaluation information on the user using the video call service from the terminal 100 supporting the video call. The server 200 providing the video call service can receive the emotion information or the icon information corresponding to the gesture taken by the user of the user who uses the video call service as the evaluation information for the user.

In block 1020, the server 200 providing the video call service may update the cumulative rating information and reputation index corresponding to the user's account stored in the storage 230, based on the received rating information. The server 200 providing the video call service can obtain the updated reputation index from the updated cumulative evaluation information by changing the weight according to the kind of the emotion information or the type of the icon information.

In block 1030, the server 200 providing the video call service may manage the video call service based on the updated reputation index. For example, the server 200 providing the video call service can manage the video call service by providing a video call matching supplementary service that matches a plurality of users using the video call service, based on the updated reputation index have. For example, the server 200 providing the video call service categorizes a plurality of users using the video call service based on the updated reputation index, and provides a user management service corresponding to each category to which each user belongs So that the video call service can be managed.

The server 200 providing the video call service can transmit the updated cumulative evaluation information or the updated reputation index to the terminal using the video call service through the communication interface 240. [

Embodiments related to the method of generating the evaluation information corresponding to the gesture of the user of the video call service and providing the video call service described above may be applied to the gesture of the user of the video call service in the terminal 100 providing the video call service And providing the video call service by generating evaluation information indicating that the video call service is provided. In other words, the terminal 100 may be provided in the form of an application or a computer program stored in a computer-readable storage medium for executing each step of the method for providing the video call service described above.

Embodiments of a method for providing a video call service based on a user's reputation index may be implemented in a computer readable storage medium such as a server 200 so as to perform a method of providing a video call service based on a user's reputation index And may be provided in the form of a stored computer program. In other words, the server 200 may be provided in the form of a computer program or an application stored in a computer-readable storage medium for executing the respective steps of the method for providing the video call service described above.

The above-described embodiments may be embodied in the form of a computer-readable storage medium for storing instructions or data executable by a computer or a processor. At least one of the command and data may be stored in the form of program code, and when executed by the processor, a predetermined program module may be generated to perform a predetermined operation. Such computer-readable storage mediums may include read only memory (ROM), random access memory (RAM), flash memory, CD-ROMs, CD-Rs, CD + Rs, CD- , DVD-Rs, DVD + Rs, DVD-RWs, DVD + RWs, DVD-RAMs, BD-ROMs, BD-Rs, BD-R LTHs, BD- REs, magnetic tape, floppy disk, magneto- Data storage devices, optical data storage devices, hard disks, solid-state disks (SSDs), and instructions or software, associated data, data files, and data structures, Software, related data, data files, and data structures.

So far, the embodiments have been mainly described. It will be understood by those skilled in the art that the disclosed embodiments may be embodied in various other forms without departing from the essential characteristics thereof. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the invention being indicated by the appended claims rather than by the foregoing description of the embodiments, and all differences within the scope of equivalents thereof should be construed as being included in the scope of the invention.

Claims (15)

In the first terminal,
Establishing a video call session between the first terminal of the first user and the second terminal of the second user, which is the other party of the video call;
Detecting a gesture of the first user or the second user in a first video stream of the first user or a second video stream of the second user, the second video stream being received from the second terminal;
Generating evaluation information on a counterpart of a user who has taken the detected gesture based on the detected gesture; And
Transmitting the generated evaluation information to a server providing a video call service;
The method comprising the steps of: receiving a video call service request from a user; The method according to claim 1,
Wherein the step of generating evaluation information for the other party comprises:
And generates emotion information or icon information corresponding to the detected gesture as evaluation information for the other party. The method according to claim 1,
When detecting the gesture of the first user,
Wherein the detecting the gesture comprises:
Detecting at least one of a facial expression, a gesture, and an action of the first user in the first video stream captured by the first terminal,
Wherein the step of generating evaluation information for the other party comprises:
Generates evaluation information for the second user based on the detected gesture,
Wherein the step of transmitting to the server comprises:
And transmits the evaluation information for the generated second user to the server in correspondence with the account of the second user. The method of claim 3,
And transmitting the evaluation information for the generated second user to the second terminal. The method of claim 3,
Receiving evaluation information for a first user from the second terminal; And
Superimposing the evaluation information on the received first user in an area where the second video stream is displayed;
≪ / RTI > stored on a computer readable storage medium. The method according to claim 1,
When detecting the gesture of the second user,
Wherein the detecting the gesture comprises:
Detecting at least one gesture of the second user's facial expression, gesture, and behavior in the second video stream received from the second terminal,
Wherein the step of generating evaluation information for the other party comprises:
Generates evaluation information for the first user based on the detected gesture,
Wherein the step of transmitting to the server comprises:
And transmits the evaluation information for the generated first user to the server in correspondence with the account of the first user. The method according to claim 6,
And displaying the generated evaluation information for the first user overlaid on an area in which the second video stream is displayed. A communication interface for performing communication with a terminal supporting a video call;
storage;
A processor; And
And a memory for storing instructions executable by the processor,
Wherein the processor is configured to receive the evaluation information for the user using the video call service from the terminal by executing the instructions and to perform a cumulative evaluation corresponding to the account of the user stored in the storage based on the received evaluation information Updates the information and reputation index, and manages the video call service based on the updated reputation index. 9. The method of claim 8,
The processor comprising:
And receives the emotion information or the icon information corresponding to the gesture taken by the user of the user who uses the video call service as the evaluation information for the user. 10. The method of claim 9,
The processor comprising:
And obtains the updated reputation index from the updated cumulative evaluation information with a different weight according to the kind of the emotion information or the type of the icon information. 9. The method of claim 8,
The processor comprising:
Wherein the video call service is managed by providing a video call matching supplementary service that matches a plurality of users using the video call service based on the updated reputation index. 9. The method of claim 8,
The processor comprising:
Categorizing a plurality of users using the video call service based on the updated reputation index and providing a user management service corresponding to each category to which each user belongs, Server. 9. The method of claim 8,
The processor comprising:
And transmits the updated cumulative evaluation information or the updated reputation index to the terminal via the communication interface. 9. The method of claim 8,
The storage device
Storing a plurality of kinds of cumulative evaluation information, a reputation index corresponding to each cumulative evaluation information, and a comprehensive reputation index reflecting all types of reputation indices, for each user of each of a plurality of users using the video call service, The server that provides the service. Instructions for establishing a video call session between a first terminal of a first user and a second terminal of a second user that is a party of a video call;
Instructions for detecting a gesture of the first user or the second user in a first video stream captured by the first user or a second video stream captured from the second terminal and captured by the second user;
Instructions for generating rating information for a party of a user who has taken the detected gesture based on the detected gesture; And
And transmitting the generated evaluation information to a server providing a video call service;
Readable storage medium having stored thereon instructions executable by a processor comprising:

Images