KR20110041065A - System, server, terminal and method for delivering haptic contents during video call - Google Patents

Abstract

PURPOSE: A system, server, terminal and method for delivering haptic contents during a video call are provided to transfer more sentimental emotional mood through a pattern including character, number, symbol and so on during a video call. CONSTITUTION: A user terminal(20) includes pattern data generated to an image depending on the input of a pattern, and transfers the image through a communication network. A haptic content transfer server(30) extracts haptic contents corresponding to the pattern data received through a communication network. The haptic content includes the extracted haoptic contents in the image, and transfers the image to the terminal(40) of the other party.

Description

Haptic content delivery system, server, terminal and method for video call {System, Server, Terminal and Method for delivering haptic contents during video call}

The present invention relates to a technology for delivering haptic content during a call, and more particularly, when a user inputs a pattern including letters, numbers, symbols, and shapes during a video call, a user terminal or a haptic content delivery server is input to a pattern. The present invention relates to a haptic content delivery system, a server, a terminal, and a method of a video call in which a corresponding haptic content is extracted and transmitted to a counterpart terminal, and an output corresponding to the haptic content is made by the counterpart terminal.

As high-speed information communication is realized in voice call-oriented call patterns, video call technology through communication terminals is attracting attention. In addition, as the spread of communication terminals capable of video calls (hereinafter referred to as "video call terminals") is increasing, the frequency of video calls is increasing.

Since the video call terminal can display the video of the other party on the screen and output the voice of the other party during the video call, the video caller can easily exchange each other's emotional states in preparation for the call using only voice. .

However, since the video caller must deliver his or her emotional state to the other party only through the facial expression or voice during the video call, there is a limit to further conveying his or her various emotional states to the other party.

As such, the current video call is limited to simply viewing the counterpart's video, and thus, there is a need for a method capable of delivering a more detailed emotional state while adding interest in the call environment.

In order to solve the conventional problems, the present invention provides a haptic content delivery system, server, terminal and method during a video call that can deliver a detailed emotional state to the other party through a pattern including letters, numbers, symbols, and shapes during the video call. The purpose is to provide.

That is, in the present invention, when a user inputs a pattern during a video call, the user terminal or the haptic content delivery server extracts the haptic content corresponding to the input pattern and transmits the haptic content to the counterpart terminal, and outputs corresponding to the haptic content from the counterpart terminal. An object of the present invention is to provide a haptic content delivery system, server, terminal, and method during a video call.

In order to achieve this object, the haptic content delivery system during a video call according to the present invention is characterized in that it comprises a user terminal, a haptic content delivery server and the counterpart terminal. The user terminal supports the input of a pattern by the user during a video call to transmit the image to the counterpart terminal, and the pattern generated according to the input of the pattern to transmit the haptic content related to the emotional state of the user to the counterpart terminal. The data is included in the video and transmitted to the communication network. The haptic content delivery server extracts the haptic content corresponding to the pattern data received through the communication network, and includes the extracted haptic content in the image and transmits the haptic content to the counterpart terminal of the terminal that transmitted the pattern data. The counterpart terminal outputs the image and the haptic content received from the haptic content delivery server.

In addition, the haptic content delivery server of the video call according to the invention, characterized in that it comprises a transceiver, a database unit, and a controller. The transmitter / receiver receives an image including pattern data generated according to an input of a pattern matching the haptic content related to the emotional state of the user from the terminal during an image call transmitting an image between terminals through a communication network. The database unit stores the haptic content that matches a pattern predetermined by the user. The controller extracts the haptic content from the database in response to the pattern data received from the transceiver, and includes the extracted haptic content in an image to transmit to the counterpart terminal. In this case, the haptic content includes visual haptic content, haptic haptic content, auditory haptic content or olfactory haptic content, and the visual haptic content, haptic haptic content, auditory haptic content, or olfactory haptic content are different from each other in an execution state. Haptic content execution mode. The database unit also stores a haptic content extraction program for extracting haptic content corresponding to the pattern data.

In addition, the haptic content delivery terminal of the video call according to the present invention is characterized in that it comprises a communication unit, a camera unit, an input unit, a storage unit, a terminal control unit. The communication unit performs a video call with a counterpart terminal through a communication network. The camera unit captures an image during the video call. The input unit supports user input for a pattern. The storage unit stores haptic content related to the emotional state of the user. The terminal controller extracts the haptic content corresponding to the pattern data generated according to the input of the pattern, and includes the extracted haptic content in the image and transmits the haptic content to the counterpart terminal. The storage unit may include visual haptic content, haptic haptic content, auditory haptic content, or olfactory haptic content, and the haptic content, haptic haptic content, auditory haptic content, or olfactory haptic content may have different haptic contents. Contains the content execution mode. In addition, the pattern preferably includes at least one of letters, numbers, symbols and shapes. The apparatus further includes a haptic output unit including at least one of a vibration generator, a temperature generator, and a scent generator that receive the image including the haptic content from the counterpart terminal or the haptic content delivery server through the communication unit, and output the haptic content. It is preferable.

In addition, the haptic content delivery method of the video call according to the present invention, during the video call to transfer the image between the terminal via a communication network, the haptic content delivery server of the pattern matching the haptic content related to the emotional state of the user from the terminal Receiving the glyph data generated according to an input, extracting the haptic content corresponding to the glyph data by the haptic content delivery server, and including the haptic content extracted by the haptic content delivery server in the image And transmitting the data to the counterpart terminal of the terminal which has transmitted the data. At this time, before the video call, the haptic content delivery server matches the pattern and the haptic content by storing the haptic content corresponding to the designation of the haptic content by the terminal. In addition, prior to the step of receiving the glyph data, the haptic content delivery server in response to the haptic content service request signal transmitted from the terminal further comprises the step of establishing a session with the terminal, respectively.

In addition, the haptic content delivery method of the video call according to the present invention, during the video call between the terminal via the communication network, the terminal outputs the pattern data according to the input of the pattern matching the haptic content related to the emotional state of the user And extracting the haptic content corresponding to the pattern data output by the terminal, and including the haptic content extracted by the terminal in an image and transmitting the extracted haptic content to the counterpart terminal. In this case, the terminal may further include receiving an image including the haptic content from the counterpart terminal or the haptic content delivery server, and outputting the image and the haptic content.

As described above, the present invention delivers the haptic content corresponding to the user's pattern input during the video call, so that the detailed emotional state can be transmitted.

In addition, since the present invention can deliver a detailed emotional state during the video call, it is possible to improve the call environment satisfaction to the video caller, and to expand the use of the video call.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Here, in the description of the drawings, all of the components shown in the drawings are not essential components, and the same components will be given the same numbers.

1 is a block diagram showing a haptic content delivery system during a video call according to a first embodiment of the present invention.

Referring to FIG. 1, a haptic content delivery system 100 (hereinafter, referred to as a “haptic content delivery system”) of a video call according to the first embodiment is a user terminal 20 through which a video call is made through a communication network 10. ) And the counterpart terminal 40.

In the haptic content delivery system 100 of the present embodiment, when the user terminal 20 and the counterpart terminal 40 input a pattern including letters, numbers, symbols, and shapes through the user terminal 20 during a video call. When the user terminal 20 extracts the haptic content corresponding to the input pattern and the user terminal 20 transmits the extracted haptic content to the counterpart terminal 40 through the communication network 10, the counterpart terminal 40 An output corresponding to the transmitted haptic content is made. Accordingly, the haptic content delivery system 100 according to the first embodiment may transmit an emotional state to the other party through the corresponding haptic content.

Here, the configuration of the haptic content delivery system 100 will be described in more detail.

The communication network 10 performs a series of data transmission and reception operations for data transmission and information exchange between the user terminal 20 and the counterpart terminal 40. The communication network 10 performing such a function is an IP network providing a large data transmission / reception service and a seamless data service through IP, and may be an ALL-IP network that is an IP network structure integrating different networks based on IP. have. In addition, the communication network 10 may be one of a wired communication network, a mobile communication network, a wireless broadband (WiBro) network, a high-speed downlink packet access (HSDPA) network, and a satellite communication network.

Specifically, the communication network 10 includes a call controller 14 and a location register 16.

The call controller 14 is a part in charge of functions related to call and session processing, and may be one of a call state control function (CSCF) or a mobile switching center (MSC). In particular, the call controller 14 implemented with CSCF performs a function as a gateway to an incoming call, a call control function, a SPD (Serving Profile Database) function, an address processing function, and the like. In particular, the call controller 14 transmits an image including the haptic content transmitted from the user terminal 20 or the counterpart terminal 40 to the counterpart terminal 40.

The location register 16 is a master database of subscribers, and is responsible for tracking access means by maintaining a master list of services related to a subscriber or performing management of subscriber's location information. That is, the location register 16 stores additional service subscription information subscribed to by the subscriber. The location register 16 performing such a function may be one of a home location register (HLR) or a home subscriber server (HSS) that manages subscriber information in an All-IP network.

In addition, the user terminal 20 and the counterpart terminal 40 perform a video call between each other through the communication network 10. In addition, the user terminal 20 or the counterpart terminal 40 extracts the haptic content corresponding to the pattern including the input letters, numbers, symbols, and shapes, and transmits the haptic content to the counterpart. The user terminal 20 or the counterpart terminal 40 receives the haptic content transmitted from the counterpart and outputs the corresponding haptic content. The user terminal 20 and the counterpart terminal 40 which perform such a function are wired / wireless communication terminals capable of video calls through the communication network 10, and include mobile communication terminals, wired communication terminals, and Internet telephones. The user terminal 20 and the counterpart terminal 40 will be described in more detail with reference to FIG. 2.

2 is a block diagram showing a haptic content delivery terminal during a video call according to an embodiment of the present invention.

First, it is assumed that the haptic content delivery terminal, ie, the user terminal 20 or the counterpart terminal 40, has the same configuration during a video call according to an embodiment, and this will be described based on the user terminal 20.

Referring to FIG. 2, the user terminal 20 includes a communication unit 21, an input unit 22, a storage unit 23, a camera unit 24, a haptic output unit 25, a display unit 26, and a sound source processing unit 27. ) And the terminal control unit 28.

The communication unit 21 transmits and receives data for a video call with the counterpart terminal 40 through the communication network 10. In addition, the communication unit 21 transmits an image including haptic content to the counterpart terminal 40 under the control of the terminal control unit 28.

The input unit 22 provides a plurality of keys for the operation of the user terminal 20, and generates and transmits an input signal according to a user's key selection to the terminal controller 28. The user may generate a video call request signal and pattern data during the video call through the input unit 22. The input unit 22 may be a keypad, a pointing device such as a touch pad, or an input device such as a touch screen.

In this way, the input unit 22 for generating the pattern data supports a user operation to perform the input of the pattern. The input unit 22 may not only provide various methods of inputting a pattern, but may include an image processor (not shown) that performs signal processing corresponding to the pattern input. That is, in the case of a pattern displayed on the display unit 26 or a preset pattern in a plurality of keys, the digital value may be transmitted to the terminal controller 28 as it is, but in the case of a pattern arbitrarily input to the display unit 26, the image processing unit may image it. After the operation, the shape is analyzed from the image to obtain a digital value corresponding to the shape, and the digital value is transmitted to the terminal controller 28.

The storage unit 23 stores a program necessary for controlling the operation of the user terminal 20 and data generated while executing the program, and includes one or more volatile memory devices and nonvolatile memory devices. In addition, the storage unit 23 stores a haptic content extraction program for extracting haptic content in response to the pattern data generated according to the input of the pattern during the video call. The storage unit 23 stores the haptic content corresponding to the pattern, and the haptic content controls the user terminal so that the user's emotional state can be outputted from the user terminal in a visual, tactile, auditory or olfactory manner. Data. Thus, the storage unit 23 stores various haptic content so that the user terminal 20 can output time, touch, hearing, or smell. In addition, each of these various haptic contents includes different haptic content execution modes that vary in execution states.

The camera unit 24 obtains image data of the user for transmission through the communication unit 21. That is, the camera unit 24 captures the user's image in accordance with the acceptance of the video call through the input unit 22 to obtain image data. In this case, the camera unit 24 may include an image sensor, a signal processor, and an image processor. The image sensor converts the optical signal of the captured image into an analog signal. The signal processor converts an analog signal into a digital signal. The image processor obtains image data by processing an image signal input through the signal processor, and outputs the acquired image data through the communication unit 21 or the display unit 26 or stores the image data in the storage unit 23. In addition, the image processor processes the image data of the other party input through the communication unit 21 to output through the display unit 26 or to store in the storage unit (23).

The haptic output unit 25 executes vibration, temperature, aroma, etc. corresponding to the pattern. That is, the haptic output unit 25 includes a vibration generator, a temperature generator, a scent generator, and the like, which are executed in correspondence with the haptic content. The vibration generator is a vibration motor and executes vibration corresponding to the vibration haptic content. The temperature generator sets a temperature corresponding to the temperature haptic content, and sets the temperature such that the temperature of the user terminal 20 is equal to the temperature haptic content by comparing the current temperature with the temperature of the temperature haptic content. The scent generator generates various scents corresponding to the olfactory haptic content, and the type and intensity of the scent may be arbitrarily set by the user of the user terminal 20. In addition, the haptic output unit 25 may selectively communicate with the display unit 26 and the sound source processing unit 27 under the control of the terminal controller 28 to transmit various emotional states.

The display unit 26 displays information stored in the storage unit 23 including various function menus executed in the user terminal 20. In addition, the display unit 26 displays an image or haptic content of the counterpart under the control of the terminal controller 28. As the display unit 26 performing such a function, an LCD (Liquid Crystal Display) or a touch screen may be used. The touch screen simultaneously serves as a display device and an input device. As such, the touch screen may perform a pattern input. If the pattern is displayed on the touch screen and is a preset pattern, the digital value may be transmitted to the terminal controller 28 as it is, but in the case of a pattern arbitrarily input to the touch screen. After the imaging operation, the shape is analyzed from the image to obtain a digital value corresponding to the shape, and the digital value is transmitted to the terminal controller 28.

The sound source processor 27 digitizes the voice input through the microphone MIC under the control of the terminal controller 28 to obtain voice information, and demodulates the voice information received through the communication unit 21 to generate a speaker SPK. Output through

In addition, the terminal controller 28 is a microprocessor that performs overall control operations of the user terminal 20. In particular, the terminal controller 28 controls to extract the haptic content corresponding to the user's pattern input during the video call and transmit the haptic content to the counterpart terminal 40.

At this time, the process of the terminal control unit 28 to extract and transmit the haptic content is as follows.

The terminal controller 28 monitors whether the pattern is input through the input unit 22 or the display unit 26 during the video call. If it is determined that the pattern is input, the terminal controller 28 outputs the pattern data corresponding to the pattern. The terminal controller 28 extracts the haptic content that matches the pattern data from the storage unit 23. Subsequently, the terminal controller 28 transmits the image including the haptic content extracted to the other party through the communication network 10 to the communication unit 21. The haptic content extraction and transmission process may be performed by executing a haptic content extraction program. The haptic content extraction program may be executed simultaneously with a video call or may be executed when text data is generated during the video call.

As described above, the haptic content delivery system 100 according to the first embodiment extracts the haptic content corresponding to the input pattern using the terminals 20 and 40 shown in FIG. It can deliver effectively and add interest to video caller's call environment.

3 is a block diagram illustrating a haptic content delivery system during a video call according to a second embodiment of the present invention.

Referring to FIG. 3, the haptic content delivery system 200 according to the second embodiment of the present invention uses a user network 20 and a haptic content delivery server 30 during a video call through a communication network 10. Server ') and the counterpart terminal 40.

In the haptic content delivery system 200 of the present embodiment, when the user terminal 20 and the counterpart terminal 40 input a pattern including letters, numbers, symbols, and shapes through the user terminal 20 during a video call. The haptic content delivery server 30 extracts haptic content corresponding to the input pattern. When the haptic content delivery server 30 transmits the haptic content extracted to the counterpart terminal 40 through the communication network 10, an output corresponding to the haptic content transmitted from the counterpart terminal 40 is made.

Here, the function of each component of the haptic content delivery system 200 will be described in more detail.

The user terminal 20 and the counterpart terminal 40 perform a video call with each other through the communication network 10. The user terminal 20 or the counterpart terminal 40 transmits the pattern data generated corresponding to the pattern input including letters, numbers, symbols, and shapes to the haptic content delivery server 30 through the communication network 10. The user terminal 20 and the counterpart terminal 40 may be the terminal shown in FIG. 2, and may be a terminal capable of generating pattern data.

The communication network 10 performs a series of data transmission / reception operations for data transmission and information exchange between the user terminal 20, the haptic content delivery server 30, and the counterpart terminal 40. In particular, when the communication network 10 receives a haptic content service request signal from the user terminal 20 or the counterpart terminal 40 in a video call, the communication network 10 transmits a session and haptic content between the haptic content delivery server 30 and the user terminal 20. A session between the server 30 and the counterpart terminal 40 is established. That is, upon receiving a video call from the user terminal 20, the communication network 10 sets a video call path for the video call between the user terminal 20 and the counterpart terminal 40. When the communication network 10 receives the haptic content service request signal from the user terminal 20 or the counterpart terminal 40 during a video call, the communication network 10 establishes a session between the haptic content delivery server 30 and the user terminal 20. A session between the haptic content delivery server 30 and the counterpart terminal 40 is established.

The haptic content delivery server 30 communicates with the user terminal 20 and the counterpart terminal 40 through the communication network 10. That is, when the haptic content delivery server 30 receives the pattern data from the user terminal 20 or the counterpart terminal 40, the haptic content delivery server 30 loads the haptic content corresponding to the pattern input by the user of the terminal that sent the pattern data to the image. Send to the other party.

Here, the haptic content delivery server 30 includes a transceiver 31, a database 33, and a controller 35.

The transceiver 31 communicates with the user terminal 20 and the counterpart terminal 40 via the communication network 10. That is, the transceiver 31 receives the pattern data from the user terminal 20 or the counterpart terminal 40 under the control of the controller 35. In addition, the transmitter / receiver 31 controls the counterpart terminal by loading haptic content corresponding to a pattern including letters, numbers, symbols, and shapes input by the user of the terminal that transmits the pattern data under the control of the controller 35. Transmit to 40.

The database unit 33 stores a haptic content extraction program for extracting haptic content corresponding to the pattern data transmitted from the user terminal 20 or the counterpart terminal 40. In addition, the database unit 33 stores haptic content that matches a pattern predetermined by the user. The haptic content is data that controls the user terminal 20 or the counterpart terminal 40 so that the user terminal 20 or the counterpart terminal 40 can output the user's emotional state by a visual, tactile, auditory or olfactory method. to be. Thus, the database unit 33 stores various haptic content so that the user terminal 20 or the counterpart terminal 40 can output visual, tactile, auditory or olfactory sense. In addition, each of these various haptic contents includes different haptic content execution modes that vary in execution states.

In addition, the controller 35 performs an overall control operation of the haptic content delivery server 30. In particular, the controller 35 controls to transmit haptic content corresponding to the user's pattern input during the video call.

At this time, the process of the control unit 35 to extract and transmit the haptic content is as follows.

First, when the haptic content service request signal is input from the user terminal 20 or the counterpart terminal 40 during a video call between the user terminal 20 and the counterpart terminal 40, the controller 35 responds to the haptic content service request signal. Session with the user terminal and the other terminal.

Thereafter, the controller 35 monitors whether pattern data is input from the user terminal 20 or the counterpart terminal 40 during a video call between the user terminal 20 and the counterpart terminal 40. When the glyph data is input through the communication network 10, the haptic content corresponding to the glyph data is extracted from the database unit 33. Here, when the glyph data is a digital value, the haptic content is extracted by processing the digital value as it is, and when the glyph data is an image, the haptic content is converted after converting the data which is an image into a digital value and extracting the haptic content corresponding to the digital value. do. That is, the controller 35 may further include an image processor (not shown) for converting an image into a digital value.

Subsequently, the controller 35 transmits the extracted haptic content to the transceiver 31 to transmit the haptic content to the counterpart through the communication network 10. The haptic content extraction and transmission process may be performed by executing a haptic content extraction program. The haptic content extraction program may be executed simultaneously with a video call or may be executed when text data is generated during the video call.

As described above, the haptic content delivery system 200 during the video call according to the second embodiment extracts the haptic content corresponding to the pattern input through the haptic content delivery server 30 shown in FIG. And by transmitting to the counterpart terminal 40 can be expected to improve the efficiency of the network operation.

The haptic content delivery method of the video call made through the haptic content delivery system, the server, and the terminal will be described in detail.

4 is a flowchart illustrating a haptic content delivery method during a video call according to the first embodiment of the present invention.

The present embodiment relates to a haptic content delivery method during a video call made through the configuration shown in FIGS. 1 and 2.

Referring to FIG. 4, first, when the user terminal 20 sends a video call in step S1, the communication network 10 receives the request and sends a video call to the counterpart terminal 40 in step S2. That is, when the user terminal 20 originates a video call, the call controller 14 requests the subscriber register (location information and additional service information) of the user terminal 20 and the counterpart terminal 40 from the location register 16. do. The call controller 14 obtains routing information based on the received subscriber information. The call controller 14 requests video call reception to the counterpart terminal 40 using the obtained routing information.

Next, when the counterpart terminal 40 transmits the acceptance of the video call to the communication network 10 in step S3, the communication network 10 transmits the video for the video call between the user terminal 20 and the counterpart terminal 40 in step S4. Set the call path. That is, the call controller 14 requests the incoming call by paging the counterpart terminal 40, and when the counterpart terminal 40 accepts the call for the incoming request, the call controller 14 calls the user terminal 20 and the counterpart terminal. A video call path is set between 40.

As such, after the video call path is set between the user terminal 20 and the counterpart terminal 40, the user terminal 20 and the counterpart terminal 40 perform a video call through the set video call path.

Next, in step S5, the user terminal 20 determines whether there is a pattern input by the user during the video call.

As a result of the determination in step S5, if a pattern is not input, the video call between the user terminal 20 and the counterpart terminal 40 in step S4 is continuously performed.

As a result of the determination in step S5, when a pattern is input, in step S6, the user terminal device 20 outputs the pattern data corresponding to the input pattern.

Next, in operation S7, the user terminal 20 extracts haptic content corresponding to the pattern data from the storage unit 23.

For example, when the user inputs a heart pattern through the user terminal 20, a heart pattern corresponding to the heart pattern, a lip shape, a sound output of 'I love you', selected by the user Presents a variety of haptic content execution mode, such as the output of the temperature, the output of a specific scent to the user, and when the user selects a specific haptic content execution mode to extract the haptic content for controlling the counterpart terminal 20 from the storage unit 23 do.

Next, in step S8, the user terminal 20 includes the extracted haptic content in the image and transmits it to the communication network 10.

Next, in step S9, the communication network 10 transmits the image including the received haptic content to the counterpart terminal 40.

In operation S10, the counterpart terminal 40 outputs the corresponding haptic content. That is, the counterpart terminal 40 causes vibration, temperature, fragrance, etc., corresponding to the pattern. As in the above example, when the transmitted haptic content is vibration haptic content, the counterpart terminal 40 generates vibration.

Meanwhile, in the present embodiment, an example in which the user terminal 20 transmits haptic content to the counterpart terminal 40 has been described. However, the image including the haptic content may also be transmitted from the counterpart terminal 40 to the user terminal 20. Accordingly, even in the user terminal 20, vibration, temperature, aroma, etc. corresponding to the pattern can be executed.

5 is a flowchart illustrating a haptic content delivery method during a video call according to a second embodiment of the present invention.

Referring to FIG. 5, first, when the user terminal 20 sends a video call in step S21, the communication network 10 receives the request and sends a video call to the counterpart terminal 40 in step S22. That is, when the user terminal 20 originates a video call, the call controller 14 requests the subscriber register (location information and additional service information) of the user terminal 20 and the counterpart terminal 40 from the location register 16. do. The call controller 14 obtains routing information based on the received subscriber information. The call controller 14 requests video call reception to the counterpart terminal 40 using the obtained routing information.

Next, when the counterpart terminal 40 transmits the acceptance of the video call to the communication network 10 in step S23, the communication network 10 transmits an image for a video call between the user terminal 20 and the counterpart terminal 40 in step S24. Set the call path. That is, the call controller 14 requests the incoming call by paging the counterpart terminal 40, and when the counterpart terminal 40 accepts the call for the incoming request, the call controller 14 calls the user terminal 20 and the counterpart terminal. A video call path is set between 40.

As such, after the video call path is set between the user terminal 20 and the counterpart terminal 40, the user terminal 20 and the counterpart terminal 40 perform a video call through the set video call path.

Next, in step S25, it is determined whether a haptic content service request signal is generated from the user terminal 20 during the video call.

If the haptic content service request signal is not generated as a result of the determination in step S25, the video call between the user terminal 20 and the counterpart terminal 40 is continuously performed in step S24.

As a result of the determination in step S25, when the haptic content service request signal is generated from the user terminal 20, the haptic content service request signal is transmitted to the communication network 10 in step S26. Subsequently, in step S27, the communication network 10 transmits a haptic content service request signal to the haptic content delivery server 30.

Next, in steps S28 and S29, the haptic content delivery server 30 establishes a session with the user terminal and the counterpart terminal by the communication network 10, respectively.

Next, in step S30, it is determined whether there is a pattern input by the user in the user terminal 20.

As a result of the determination in step S30, if the pattern is not input, the input standby state is continuously maintained, and when the input waiting setting time has elapsed, the video call between the user terminal 20 and the counterpart terminal 40 in step S24 is continuously performed. To perform.

As a result of the determination in step S30, when a pattern is input, in step S31, the user terminal 20 outputs pattern data corresponding to the input pattern.

Next, in step S32, the user terminal 20 includes the pattern data in the image and transmits it to the haptic content delivery server 30.

Next, in step S33, the haptic content delivery server 30 extracts the haptic content corresponding to the pattern data from the database unit 33.

For example, when the user inputs a heart pattern through the user terminal 20, a heart pattern corresponding to the heart pattern, a lip shape, a sound output of 'I love you', selected by the user It transmits various haptic content execution modes such as temperature output, specific scent output, etc. to the user terminal 20, and when the user of the user terminal 20 selects a specific haptic content execution mode, the haptic for controlling the counterpart terminal 20 The content is extracted from the database unit 33.

Next, in step S34, the haptic content delivery server 30 includes the extracted haptic content in an image and transmits the haptic content to the counterpart terminal 40.

In operation S35, the counterpart terminal 40 outputs the corresponding haptic content. That is, the counterpart terminal 40 causes vibration, temperature, fragrance, etc., corresponding to the pattern. As in the above example, when the transmitted haptic content is vibration haptic content, the counterpart terminal 40 generates vibration.

Meanwhile, in the present embodiment, an example in which the haptic content delivery server 30 transmits the haptic content to the counterpart terminal 40 has been described. However, the haptic content delivery server 30 also provides an image including the haptic content to the user terminal 20. Can transmit Accordingly, even in the user terminal 20, vibration, temperature, aroma, etc. corresponding to the pattern can be executed.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples to aid understanding, and are not intended to limit the scope of the present invention. In addition to the embodiments disclosed herein, it is apparent to those skilled in the art that other modifications based on the technical idea of the present invention may be implemented.

The present invention relates to a haptic content delivery system, a server, a terminal, and a method during a video call. When a user inputs a pattern during a video call, the user terminal or the haptic content delivery server extracts haptic content corresponding to the input pattern, and the counterpart terminal. By transmitting to the other terminal to the output corresponding to the haptic content can be applied to the video call terminal to deliver a more detailed emotional state of the user.

1 is a block diagram showing a haptic content delivery system during a video call according to a first embodiment of the present invention.

2 is a block diagram showing a haptic content delivery terminal during a video call according to an embodiment of the present invention.

3 is a block diagram illustrating a haptic content delivery system during a video call according to a second embodiment of the present invention.

4 is a flowchart illustrating a haptic content delivery method during a video call according to the first embodiment of the present invention.

5 is a flowchart illustrating a haptic content delivery method during a video call according to a second embodiment of the present invention.

<Description of main parts of drawing>

10: communication network

20: user terminal

30: Haptic content delivery server

40: counterpart terminal

100, 200: Haptic Content Delivery System

Claims (13)

Supports input of a pattern by a user during a video call to transmit the image to the counterpart terminal, and transmits the pattern data generated according to the input of the pattern to transmit haptic content related to the emotional state of the user to the counterpart terminal. A user terminal included in and transmitted to a communication network; A haptic content delivery server extracting the haptic content corresponding to the pattern data received through the communication network and including the extracted haptic content in the image and transmitting the extracted haptic content to the counterpart terminal; And The counterpart terminal outputting the image and the haptic content received from the haptic content delivery server. Haptic content delivery system during a video call comprising a. A transmission / reception unit receiving an image including glyph data generated according to an input of a pattern matching a haptic content related to an emotional state of a user from a terminal during a video call transmitting an image between terminals through a communication network; A database unit for storing the haptic content that matches a pattern predetermined by the user; And The controller extracts the haptic content from the database in response to the pattern data received from the transceiver, and includes the extracted haptic content in the image and transmits the haptic content to the counterpart terminal of the terminal that transmitted the pattern data. Haptic content delivery server during a video call comprising a. The haptic content of claim 2, wherein the haptic content includes visual haptic content, haptic haptic content, auditory haptic content or olfactory haptic content, and each of the visual haptic content, haptic haptic content, auditory haptic content, or olfactory haptic content is executed. Haptic content delivery server during a video call, comprising a different haptic content execution mode different. The haptic content delivery server of claim 2, wherein the database unit stores a haptic content extraction program for extracting the haptic content corresponding to the pattern data. A communication unit for performing a video call with a counterpart terminal through a communication network; A camera unit for capturing an image during the video call; An input unit supporting a user input on a pattern; A storage unit which stores haptic content related to the emotional state of the user; And The terminal control unit extracts the haptic content corresponding to the pattern data generated according to the input of the pattern, and includes the extracted haptic content in the image and transmits it to the counterpart terminal. Haptic content delivery terminal during a video call comprising a. The apparatus of claim 5, wherein the storage unit comprises visual haptic content, haptic haptic content, auditory haptic content, or olfactory haptic content, and each of the visual haptic content, haptic haptic content, auditory haptic content, or olfactory haptic content is different from the execution state. Haptic content delivery terminal during a video call comprising a different haptic content execution mode. The haptic content transmission terminal of claim 5, wherein the pattern comprises at least one of a letter, a number, a symbol, and a shape. The haptic output of claim 5, wherein the haptic output comprises at least one of a vibration generator, a temperature generator, and a scent generator that receive the image including the haptic content from the counterpart terminal or the haptic content delivery server through the communication unit, and output the haptic content. Haptic content delivery terminal during a video call, characterized in that it further comprises a wealth. Receiving glyph data generated by the haptic content delivery server according to the input of the pattern matching the haptic content related to the emotional state of the user from the terminal during the video call to transmit the image between the terminals via a communication network; Extracting, by the haptic content delivery server, the haptic content corresponding to the glyph data; And Including the haptic content extracted by the haptic content delivery server in the image and transmitting the haptic content to the counterpart terminal of the terminal that transmitted the pattern data. Haptic content delivery method of a video call comprising a. 10. The method of claim 9, further comprising: matching and storing the haptic content and the haptic content by the terminal in response to the haptic content matching the pattern being designated by the terminal before the video call. Haptic content delivery method of a video call. 10. The method of claim 9, Before the step of receiving the glyph data, in response to the haptic content service request signal transmitted from the terminal, the haptic content delivery server establishes a session for each of the terminal and the counterpart terminal transmitting the glyph data Haptic content delivery method during a video call, characterized in that it further comprises a step. During a video call between terminals via a communication network, outputting, by the terminal, pattern data according to input of a pattern matching the haptic content related to the emotional state of the user; Extracting the haptic content corresponding to the pattern data output from the terminal; And Including the haptic content extracted by the terminal in the image and transmitting to the other terminal Haptic content delivery method of a video call comprising a. The method of claim 12, wherein the terminal further receives the image including the haptic content from the counterpart terminal or the haptic content delivery server and outputs the haptic content during the video call, characterized in that for outputting the haptic content Way.

Images