KR20180029391A - Consulting sever, expert device and customer device for providing consulting service - Google Patents

Abstract

A consulting server for providing a consulting service may include an image collecting part for collecting a customer image from an expert terminal and a customer terminal performing the consulting service, an analysis part for analyzing an object for a customer from the customer image, a measurement part for measuring the immersion degree of the customer with respect to the consulting service based on the analyzed object, and a service providing part for providing the customer terminal with the consulting service reflecting the immersion degree.

Description

TECHNICAL FIELD [0001] The present invention relates to a consulting server, an expert terminal, and a customer terminal that provide consulting services,

The present invention relates to a consulting server, an expert terminal, and a customer terminal for providing a consulting service.

With the development of smart terminals, various information can be accessed online, and counseling and education services of various fields are provided through smart terminals. However, online counseling or education services are relatively less involved than face-to-face services, and it is not easy to understand the status of customers.

Japanese Unexamined Patent Publication No. 4536558 discloses a configuration in which the eye movement of a viewer watching a program is grasped by the eye camera and the degree of concentration of the viewer with respect to the program is measured based on the number of movements of the eye obtained by the eye camera have.

We collect customer image from customer terminal receiving consulting service and analyze customer information from customer image. Further, the present invention intends to measure a customer's commitment to the consulting service based on the analyzed customer information, and to provide the consulting service reflecting the degree of commitment to the customer terminal. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to a first aspect of the present invention, there is provided a consulting server for providing a consulting service, comprising: an image collecting unit for collecting customer images from an expert terminal and a customer terminal performing a consulting service; An analyzing unit for analyzing an object for a customer from the customer image; A measurement unit measuring the degree of immersion of the customer in the consulting service based on the analyzed object; And a service providing unit for providing the consulting service reflecting the degree of engagement to the customer terminal.

In one example, the measuring unit may calculate motion information corresponding to the analyzed object from a plurality of frames included in the customer image, and compare the motion information calculated for each frame to measure the degree of immersion of the customer have.

In one example, the image collecting unit collects a professional image displayed on the customer terminal from the expert terminal, and the analyzing unit analyzes the customer's gaze on the expert image displayed on the customer terminal from the customer image, The measuring unit may measure the degree of immersion of the customer by determining whether the coordinates of the gaze of the customer's gaze are present in the object for the expert.

In one example, the image collecting unit collects a data image displayed on the customer terminal from the expert terminal, and the analyzing unit analyzes the customer's gaze on the data image displayed on the customer terminal, Analyzing a region in the data image corresponding to at least one keyword displayed on the data image, and the measuring unit is configured to analyze the region in the data image corresponding to the keyword extracted from the expert voice among the regions in the data image The degree of immersion of the customer can be measured.

In an exemplary embodiment, the service providing unit may change the arrangement of the expert image and the data image displayed through the customer terminal when the measured degree of immersion is less than or equal to a threshold value. The service providing unit may provide the current customer image to the customer terminal to confirm the consultation posture when the measured degree of immersion is below the threshold value. The service providing unit may provide the customer image as the immersion degree improvement guide image to the customer terminal when the immersion degree measured during the consulting service progress is equal to or greater than the threshold value. The service providing unit may provide the consultation service reflecting the measured degree of engagement and a guidance message to the customer terminal about the termination of the consulting service if the degree of immersion of the customer is not improved.

For example, the measuring unit may record the change of the immersion degree according to the consultation time of the consulting service to generate the past immersion information for the customer, and the service providing unit may transmit the past immersion information to the expert terminal .

In one example, an information receiving unit for receiving customer data including at least one of usage information of the consulting service, usage patterns of an application of the consulting service, and viewing history information on a channel provided by the consulting service from the customer terminal, The service providing unit may extract a list including a plurality of experts based on the customer data and provide the extracted list to the customer terminal.

A customer terminal provided with a consulting service according to the second aspect of the present invention includes a display unit for receiving a professional image from the expert terminal through a consulting service with an expert terminal and displaying the expert image; An image transmission unit for transmitting a customer image photographed during the consulting service to a consulting server; And a service receiving unit for receiving, from the consulting server, a consulting service that reflects the degree of engagement of the customer measured by the consulting server based on the customer image.

In one example, the display unit receives and displays a data image from the expert terminal, and the service receiver can change the arrangement of the displayed expert image and data image when the measured degree of immersion is below a threshold value.

In an exemplary embodiment, the service receiver may receive a current customer image from the consulting server to confirm a consultation posture when the measured degree of immersion is less than or equal to a threshold value. The service receiving unit may receive the customer image when the measured immersion level is higher than the threshold value during the consulting service in progress as the immersion degree improvement guide image from the consulting server. The service receiving unit may receive a guidance message on the termination of the consulting service from the consulting server if the immersion degree of the customer is not improved after providing the consulting service reflecting the measured degree of engagement.

In one example, customer data including at least one of usage information of the consulting service, usage pattern of the consulting service, and viewing history information on a channel provided by the consulting service is collected and transmitted to the consulting server The service receiving unit may receive a list including a plurality of experts extracted based on the customer data from the consulting server.

The expert terminal providing the consulting service according to the third aspect of the present invention includes a display unit for performing a consulting service with a customer terminal to receive and display a customer image from the customer terminal; An image transmission unit for transmitting a professional image photographed during the consulting service to a consulting server; And a service receiving unit for receiving, from the consulting server, a consulting service that reflects the degree of engagement of the customer measured by the consulting server based on the customer image and the expert image.

In one example, the service receiving unit receives from the consulting server past investment information for the customer, in which a change in the degree of immersion is recorded according to the consultation time of the consulting service, Can be received.

The above-described task solution is merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and the detailed description of the invention.

According to any of the above-mentioned tasks, the customer information of the customer terminal receiving the consulting service can be analyzed and the customer's degree of engagement with the consulting service can be measured based on the analyzed customer information. Also, the efficiency of consulting can be improved by providing the consulting service reflecting the immersion degree to the customer terminal. In addition, since the consulting service is provided based on the customer data, customized consulting (e.g., consulting field recommendation suitable for the customer) can be provided. In addition, the consulting service may be provided at a time when the customer is immersed well based on the customer's past immersion information about the consulting service.

1 is a configuration diagram of a consulting service providing system according to an embodiment of the present invention.
2 is a block diagram of the consulting server shown in FIG. 1, in accordance with an embodiment of the present invention.
3 is a flowchart illustrating a method of providing a consulting service in a consulting server according to an exemplary embodiment of the present invention.
4 is a block diagram of the customer terminal shown in FIG. 1 according to an embodiment of the present invention.
5 is a flowchart illustrating a method of receiving a consulting service at a customer terminal according to an exemplary embodiment of the present invention.
FIG. 6 is a block diagram of the expert terminal shown in FIG. 1, according to an embodiment of the present invention.
7 is a flowchart illustrating a method of providing a consulting service in an expert terminal according to an exemplary embodiment of the present invention.
FIG. 8 is a view for explaining a usage pattern of an application of a consulting service according to an embodiment of the present invention.
9A to 9C are views for explaining a method of measuring a customer's degree of immersion according to an embodiment of the present invention.
10A to 10C are diagrams for explaining a method of providing a consulting service reflecting the degree of immersion according to an embodiment of the present invention.
11 is an operational flow diagram illustrating a method of providing a consulting service, in accordance with an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

1 is a configuration diagram of a consulting service providing system according to an embodiment of the present invention.

Referring to FIG. 1, the consulting service providing system may include a consulting server 100, a customer terminal 110, and an expert terminal 120. However, since the consulting service providing system of FIG. 1 is only one embodiment of the present invention, the present invention is not limited to FIG. 1 and may be configured differently from FIG. 1 according to various embodiments of the present invention .

Generally, the components of the user image management system of FIG. 1 are connected through a network 140. 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term (LTE), Long Term (LTE), and the like are examples of such a network. Term Evolution, World Interoperability for Microwave Access (WIMAX), Wi-Fi, and the like.

The consulting server 100 can collect customer images from the expert terminal 120 and the customer terminal 110 that is in the process of consulting service and can measure the customer's degree of engagement with the consulting service from the customer image. The consulting server 100 may then provide the customer terminal 110 with a consulting service that reflects the measured degree of customer engagement. Here, the consulting service that reflects the degree of immersion of the customer may include, for example, a user interface screen for guiding the customer to concentrate on the consulting service by venturing around the customer.

The customer terminal 110 can receive a customer image while the consulting service with the expert terminal 120 is being performed as a terminal to receive consulting services from the expert terminal 120 and transmit the captured customer image to the consulting server 100. The customer terminal 110 can receive a consulting service reflecting the degree of customer's commitment measured by the consulting server 100 from the consulting server 100.

The expert terminal 120 is a terminal for providing consulting to the client terminal 110. The expert terminal 120 can photograph a professional image while the consulting service is in progress and transmit the photographed professional image to the consulting server 100. [ The expert terminal 120 receives the consulting service reflecting the degree of customer's commitment measured by the consulting server 100 from the consulting server 100 and selects consulting techniques suitable for the customer terminal 110 to provide consulting services .

The customer terminal 110 may include a mobile terminal capable of wireless communication, and according to various embodiments of the present invention, the customer terminal 110 may be various types of devices including a PC or an IPTV. For example, the customer terminal 110 may be a portable terminal that can access a remote server through a network. Herein, as an example of the portable terminal, a wireless communication device which is guaranteed to be portable and mobility may be a smart phone, a tablet PC, a PCS (Personal Communication System), a GSM (Global System for Mobile communications), a PDC (Personal Digital Cellular) , A PHS (Personal Handyphone System), a PDA (Personal Digital Assistant), an IMT (International Mobile Telecommunication) -2000, a CDMA (Code Division Multiple Access) -2000, a W-CDMA Internet) terminals, and the like can be included. However, the customer terminal 110 is not limited to the form shown in FIG. 1 or the preceding examples.

Hereinafter, the operation of each component of the consulting service providing system of FIG. 1 will be described in more detail.

FIG. 2 is a block diagram of the consulting server 100 shown in FIG. 1, in accordance with an embodiment of the present invention. 2, the consulting server 100 includes an information receiving unit 200, an image collecting unit 210, an analyzing unit 220, a measuring unit 230, a service providing unit 240, and a DB 250 can do. However, the consulting server 100 shown in FIG. 2 is only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG.

The information receiving unit 200 can receive customer data including at least one of usage information of the consulting service, usage pattern of the consulting service, and viewing history information on the channel provided by the consulting service from the customer terminal 110 have.

The analyzer 220 can analyze the consulting expert preferred by the customer based on the consulting service field including the consulting field in which the customer has conducted the consultation in the past and the number of consulting services.

The analysis unit 220 can analyze the consulting interest field and interest of the customer by grasping the consulting menu navigation of the customer based on the usage pattern of the application of the consulting service. 8, when a consultation field is selected by a customer on a screen displaying a plurality of counseling fields corresponding to DEPTH 0 (800) provided by an app of the consulting service, Perform field counting, and assign a first weight to the selected consulting field. Thereafter, when one counselor summary information is selected by the customer on the screen displaying a plurality of counters summary information corresponding to DEPTH 1 810 corresponding to the selected counseling field, the analyzer 220 analyzes the selected counselor summary information Perform counting, and assign a second weight to the selected counselor. Thereafter, when one item is selected by the customer on the screen displaying a plurality of counters' detailed information related to the selected counselor summary information as the DEPTH 2 (820), the analyzing unit 220 performs counting on the selected item , The third weight can be given to the item. Here, the third weight may be higher than the second weight, and the second weight may be higher than the first weight.

The analyzer 220 can analyze the field of the channel preferred by the customer based on the viewing history information on the channel provided by the consulting service. For example, if there is a history that the customer has watched the advertisement channel or the stock channel, the analysis unit 220 may determine that the customer prefers the real estate and financial channel.

For example, the analysis unit 220 may determine that the customer's interest in the list provided to the customer is low, if there is no detail using the consulting service in recent years even though the customer has a lot of past customer data.

The service providing unit 240 may extract a list including a consulting field, a channel field, and a plurality of consulting experts, which are preferred by the customer, based on the customer data, and provide the list to the customer terminal 110.

The service providing unit 240 may extract a list including a consulting field, a channel field, and a plurality of consulting experts, which are preferred by the customer, based on the use time of the customer's consulting service, and provide the list to the customer terminal 110. For example, the customer data can be weighted more heavily when the customer's consulting service utilization point is at the latest, and the more the customer's consulting service utilization point is in the past, the lower the weighting to the customer data. As another example, weights may be given to past customer data and additional weights may be assigned to patterns of usage for apps of the customer's consulting services.

For example, the service providing unit 240 may re-calculate the scores of the consulting field, the channel field, and a plurality of consulting professionals according to the use time of the customer's consulting service, The list may be extracted by a plurality of consulting experts and provided to the customer terminal 110.

The image collecting unit 210 may collect customer images from the expert terminal 120 and the customer terminal 110 in consulting service.

The analyzer 220 may analyze the object of the customer from the customer image.

The measurement unit 230 can measure the degree of customer's commitment to the consulting service based on the analyzed object. The measuring unit 230 may record the change in the degree of engagement according to the consultation time of the consulting service to generate the past immersion information for the customer.

The service providing unit 240 may provide past investment information to the expert terminal 120. 9A, the measuring unit 230 calculates motion information corresponding to an object for a customer from a plurality of frames included in a customer image, compares motion information calculated for each frame, Can be measured. For example, when the motion information 900 calculated from a plurality of frames is present within the predetermined immersion interval 920 based on the motion reference value 910, the measuring unit 230 may measure the degree of immersion of the customer for the consulting service Can be judged to be a section that is highly measured. The measurement unit 230 may determine that the customer's immersion level for the consulting service is low when the motion information 900 is after the specific point in time 930 when the motion information 900 is out of the pre- If the customer's degree of immersion is low, the service provider 240 may report the customer's immersion information to the expert terminal 120. Here, the motion reference value 910 is information calculated based on an average value of the customer's past immersion information (or a motion average value of the customer per unit time at the beginning of the consulting service process) and the customer's motion information per unit time, The section 920 may be a section calculated based on a motion deviation value per unit time of the past past immersion information and a motion average value of a customer per unit time in the initial stage of consulting service progress.

The image collecting unit 210 may collect the expert image displayed on the customer terminal 110 from the expert terminal 120. The analyzer 220 analyzes the customer's gaze on the expert image displayed on the customer terminal 110 from the customer image and analyzes the object on the expert from the expert image. The measuring unit 230 can measure the degree of immersion of the customer by determining whether or not the gaze coordinates of the customer's gaze are present in the object for the expert. 9B, the analyzer 220 may separate the object 950 and the background from the expert image 940 and extract the gaze coordinates for the customer's gaze on the expert image 940 . The measuring unit 230 can determine that the customer's degree of engagement is high when the gaze coordinates of the customer's gaze are present in the object 950 for the expert. In addition, the measurement unit 230 can determine that the degree of immersion of the customer is low when the number of times that the gaze coordinates of the customer's eyes are present outside the object 950 for the expert is frequent.

The image collecting unit 210 may collect a data image displayed on the customer terminal 110 from the expert terminal 120. The analysis unit 220 analyzes the customer's gaze on the data image displayed on the customer terminal 110, analyzes the expert voice from the data image, and analyzes the area in the data image corresponding to at least one keyword displayed on the data image Can be analyzed. The measuring unit 230 may determine whether the gaze coordinates of the customer's gaze are in an area corresponding to the keyword extracted from the expert voice among the areas in the data image and measure the customer's degree of immersion. 9C, the analyzer 220 analyzes the data image 960 to extract a plurality of texts displayed in the data image 960, extracts keywords (e.g., unlimited (970), half-packs (Step 980). At this time, the analyzer 220 may select the keywords with few overlaps in the priority order, and may select the keywords in consideration of the intervals in the data images. The analysis unit 220 may calculate the coordinate information of the selected keyword in the data image 960 and may set an area corresponding to the coordinate information of the keyword as a customer's gazing area for measuring the degree of immersion of the customer. When the keyword selected from the expert voice is detected, the measuring unit 230 can determine whether the customer's gaze is being gazed on in the area where the keyword is located, and measure the degree of immersion of the customer. In this case, if the keyword is duplicated in the image data, the measurement unit 230 may check whether the customer is gazing in each of the regions where the keyword is located. In one embodiment, the measuring unit 230 determines whether the customer is staring at the data base 960 by checking the customer's gaze at the time when the data base 960 is changed (for example, switching the page screen) It is possible to measure the degree of immersion of the customer by judging whether or not it exists in the data image 960.

The service provider 240 may provide the consulting service reflecting the degree of engagement to the customer terminal 110. 10A, the service provider 240 determines if the measured degree of immersion is below a threshold value. The arrangement of the data image 1010 and the expert image 1020 displayed on the screen 1000 of the customer terminal 110 can be changed to induce the customer to vent his surroundings and immerse himself in consulting. Referring to FIG. 10B, the service provider 240 may provide the current customer image 1030 to the customer terminal 110 to confirm the customer's attitude when the measured degree of immersion is below the threshold value . At this time, the service providing unit 240 can provide the customer image 1030 as the immersion degree improvement guide image to the customer terminal 110 when the immersion degree is higher than the threshold value during the consulting service. As another example, the service provider 240 may determine that the measured immersion is below a threshold. You can expose alarms or white noise for a certain period of time without changing the screen color of the consulting service or affecting consultation. Referring to FIG. 10C, the service provider 240 provides a consulting service that reflects the measured degree of engagement, and then transmits a guidance message 1040 for terminating the consulting service to a customer terminal (not shown) 110). At this time, if the customer's action (e.g., whether or not the consulting service is continued) in the guidance message 1040 is not received from the customer terminal 110, the progress of the consulting service may be terminated.

The DB 250 stores data input and output between the respective components in the consulting server 100 and stores data input and output between the consulting server 100 and components outside the consulting server 100 do.

Those skilled in the art will recognize that the information receiving unit 200, the image collecting unit 210, the analyzing unit 220, the measuring unit 230, the service providing unit 240 and the DB 250 may be separately implemented, It will be appreciated that more than one may be integrated.

3 is a flowchart illustrating a method of providing a consulting service in a consulting server according to an exemplary embodiment of the present invention. The method of providing a consulting service according to the embodiment shown in FIG. 3 is the same as that of FIG. 1 except that the consulting server 100, the customer terminal 110 and the expert terminal 120 according to the embodiment shown in FIGS. . Therefore, even though omitted in the following description, the contents described with respect to the consulting server 100, the customer terminal 110, and the expert terminal 120 of FIGS. 1 and 2 are the same as those of the consulting service providing method . ≪ / RTI >

3, in step S301, the consulting server 100 may collect customer images from the expert terminal 120 and the customer terminal 110 in consulting service.

In step S303, the consulting server 100 may analyze the object for the customer from the customer image.

In step S305, the consulting server 100 may measure the degree of engagement of the customer with respect to the consulting service based on the analyzed object.

In step S307, the consulting server 100 may provide the consulting service reflecting the immersion degree to the customer terminal 110. [

In the above description, steps S301 to S307 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

FIG. 4 is a block diagram of the customer terminal 110 shown in FIG. 1, according to an embodiment of the present invention. 4, the customer terminal 110 may include a display unit 400, an image transmission unit 410, a service reception unit 420, and an information transmission unit 430. However, the customer terminal 110 shown in FIG. 4 is only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG.

The display unit 400 can receive a professional image from the expert terminal 120 and display it by proceeding with a consulting service with the expert terminal 120.

The display unit 400 can receive and display the data image from the expert terminal 120.

The image transmission unit 410 may capture a customer image while the consulting service is in progress, and may transmit the captured customer image to the consulting server 100.

The service receiving unit 420 can receive a consulting service reflecting the degree of customer's commitment measured by the consulting server 100 based on the customer image from the consulting server 100. For example, the service receiving unit 420 may receive consulting services from the consulting server 100 in which the arrangement of the professional image and the data image is changed when the measured immersion degree of the customer is equal to or less than the threshold value. For example, the service receiving unit 420 can receive the current customer image from the consulting server 100 to confirm the customer's attitude when the measured degree of customer's immersion is below the threshold value. At this time, the service receiving unit 420 can receive the customer image in the case where the measured immersion level during the consulting service is higher than the threshold value, from the consulting server 100 as the immersion degree improvement guide image. For example, the service receiving unit 420 may provide a consulting service to the consulting server 100 to change the screen color of the consulting service or to output an alarm sound or a white noise when the measured immersion degree of the customer is below a threshold value. As shown in FIG.

The service receiving unit 420 may receive a consultation message from the consulting server 100 about the termination of the consulting service if the degree of engagement of the customer does not improve after providing the consulting service reflecting the measured degree of engagement.

The information transmission unit 430 collects customer data including at least one of usage information of the consulting service, usage pattern of the consulting service, and viewing history information on the channel provided by the consulting service, and transmits the collected customer data to the consulting server 100 Lt; / RTI >

The service receiving unit 420 can receive from the consulting server 100 a list including a plurality of experts extracted based on the customer data. For example, the service receiving unit 420 may receive from the consulting server 100 a list including a consulting field, a channel field, and a plurality of consulting experts preferred by the customer based on the customer data.

Those skilled in the art will appreciate that the display unit 400, the image transmission unit 410, the service reception unit 420, and the information transmission unit 430 may be separately implemented, or at least one of them may be integrated will be.

5 is an operational flowchart illustrating a method of receiving a consulting service in a customer terminal 110 according to an embodiment of the present invention. The method of receiving the consulting service according to the embodiment shown in FIG. 5 is performed by the consulting server 100, the client terminal 110 and the expert terminal 120 according to the embodiment shown in FIGS. 1 to 4 in a time- ≪ / RTI > Therefore, even though omitted in the following description, the contents described with respect to the consulting server 100, the customer terminal 110, and the expert terminal 120 of FIGS. 1 to 4 are not provided with the consulting service according to the embodiment shown in FIG. It can also be applied to receiving methods.

Referring to FIG. 5, in step S501, the customer terminal 110 can receive a professional image from the expert terminal 120 by displaying a consulting service with the expert terminal 120, and display the expert image.

In step S503, the client terminal 110 may transmit the client image photographed while the consulting service is in progress to the consulting server 100. [

In step S505, the customer terminal 110 can receive, from the consulting server 100, a consulting service reflecting the degree of customer's commitment measured by the consulting server 100 based on the customer image.

In the above description, steps S501 to S505 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

FIG. 6 is a block diagram of the expert terminal 120 shown in FIG. 1, according to an embodiment of the present invention. 6, the expert terminal 120 may include a display unit 600, an image transmitting unit 610, and a service receiving unit 620. However, the expert terminal 120 shown in FIG. 6 is only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG.

The display unit 600 can receive and display a customer image from the customer terminal 110 by performing a consulting service with the customer terminal 110.

The image transmission unit 610 can transmit the professional image photographed during the consulting service to the consulting server 100.

The service receiving unit 620 can receive a consulting service reflecting the degree of customer's commitment measured by the consulting server 100 based on the customer image and the expert image from the consulting server 100.

The service receiving unit 620 can receive the past immersion information about the customer recorded with the change of the immersion degree from the consulting server 100 according to the consultation time of the consulting service. In addition, the service receiving unit 620 can receive time-based information on the degree of customer's immersion before the consulting service.

Those skilled in the art will appreciate that the display unit 600, the image transmitting unit 610, and the service receiving unit 620 may be separately implemented, or at least one of them may be integrated.

7 is an operation flowchart illustrating a method of providing a consulting service in the expert terminal 120 according to an embodiment of the present invention. The method of providing a consulting service according to the embodiment shown in FIG. 7 is the same as that of the consulting server 100, the customer terminal 110 and the expert terminal 120 according to the embodiment shown in FIGS. 1 to 6 . Therefore, even if omitted here, the contents described with respect to the consulting server 100, the customer terminal 110 and the expert terminal 120 of FIGS. 1 to 6 are the same as those of the consulting service providing method . ≪ / RTI >

Referring to FIG. 7, in step S701, the expert terminal 120 proceeds with a consulting service with the client terminal 110 to receive and display the customer image from the client terminal 110. [0064] FIG.

In step S703, the expert terminal 120 may transmit the professional image photographed while the consulting service is in progress to the consulting server 110. [

In step S705, the expert terminal 120 can receive from the consulting server 110 a consulting service reflecting the degree of customer's commitment measured by the consulting server 110 based on the customer image and the expert image.

In the above description, steps S701 to S705 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

11 is an operational flow diagram illustrating a method of providing a consulting service, in accordance with an embodiment of the present invention. The method for providing a consulting service according to the embodiment shown in FIG. 11 is the same as that of the consulting server 100, the customer terminal 110 and the expert terminal 120 according to the embodiment shown in FIGS. 1 to 10C, . Therefore, even if the contents are omitted in the following description, the contents described with respect to the consulting server 100, the customer terminal 110 and the expert terminal 120 of FIGS. 1 to 10C are the same as those of the consulting service providing method . ≪ / RTI >

Referring to FIG. 11, in step S1101, the customer terminal 110 can receive a professional image from the expert terminal 120 by displaying a consulting service with the expert terminal 120, and display the expert image.

In step S1103, the expert terminal 120 can receive the customer image from the customer terminal 110 and display the customer image.

In step S1105, the consulting server 100 can receive the customer image photographed while the consulting service is in progress from the customer terminal 110. [

In step S1107, the consulting server 100 can receive the professional image photographed while the consulting service is in progress from the expert terminal 120. [

In step S1109, the consulting server 100 may analyze the object for the customer from the received customer image. Also, the consulting server 100 can analyze the customer's gaze on the expert image displayed on the customer terminal 110 from the customer image, and analyze the object to the expert from the expert image.

In step S1111, the consulting server 100 may measure the degree of engagement of the customer with respect to the consulting service based on the analyzed object.

In step S1113, the consulting server 100 may provide the consulting service reflecting the degree of immersion to the customer terminal 110. [

In step S1115, the consulting server 100 may provide the consulting service reflecting the degree of immersion to the expert terminal 120. [

In the above description, steps S1101 to S1115 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

One embodiment of the present invention may also be embodied in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

100: Consulting Server
110: Customer terminal
120: Expert terminal
200:
210:
220: Analytical Department
230:
240: Service Offering
250: DB
400:
410:
420:
430: Information transmission unit
600:
610:
630:

Claims (18)

A consulting server for providing a consulting service,
An image collecting unit for collecting a customer image from an expert terminal and a customer terminal performing a consulting service;
An analyzing unit for analyzing an object for a customer from the customer image;
A measurement unit measuring the degree of immersion of the customer in the consulting service based on the analyzed object; And
And providing a consulting service reflecting the degree of immersion to the customer terminal
The consulting server comprising:
The method according to claim 1,
Wherein the measuring unit calculates motion information corresponding to the analyzed object from a plurality of frames included in the customer image and compares motion information calculated for each frame to measure the degree of immersion of the customer, .
The method according to claim 1,
The image collecting unit collects the expert image displayed on the customer terminal from the expert terminal,
Wherein the analyzing unit analyzes the customer's gaze on the expert image displayed on the customer terminal from the customer image, analyzes the object for the expert from the expert image,
Wherein the measuring unit measures the degree of immersion of the customer by determining whether the coordinates of the customer's gaze are in an object for the expert.
The method according to claim 1,
The image collecting unit collects a data image displayed on the customer terminal from the expert terminal,
Wherein the analysis unit analyzes the customer's gaze on the data image displayed on the customer terminal, analyzes the expert voice from the data image,
Analyzing an area in the data image corresponding to at least one keyword displayed in the data image,
Wherein the measuring unit measures the degree of immersion of the customer by judging whether or not the gaze coordinates of the customer gaze correspond to the keyword extracted from the expert voice among the regions in the data image.
The method according to claim 1,
Wherein the service providing unit changes the arrangement of the expert image and the data image displayed through the customer terminal when the measured degree of immersion is less than or equal to a threshold value.
The method according to claim 1,
Wherein the service providing unit provides the current customer image to the customer terminal to confirm the consultation posture when the measured degree of immersion is below the threshold value.
The method according to claim 6,
Wherein the service providing unit provides the customer image as the immersion degree improvement guide image to the customer terminal when the immersion degree measured during the consulting service progress is equal to or greater than the threshold value.
The method according to claim 1,
Wherein the service providing unit provides the consulting service reflecting the measured degree of engagement and a guidance message to the customer terminal about the termination of the consulting service when the degree of engagement of the customer is not improved.
The method according to claim 1,
Wherein the measuring unit records the change in the degree of engagement according to the consultation time of the consulting service to generate the past immersion information for the customer,
Wherein the service providing unit provides the past immersion degree information to the expert terminal.
The method according to claim 1,
An information receiver for receiving customer data including at least one of usage information of the consulting service, usage patterns of the consulting service, and viewing history information on a channel provided by the consulting service from the customer terminal,
Further included,
Wherein the service providing unit extracts a list including a plurality of experts based on the customer data and provides the extracted list to the customer terminal.
1. A customer terminal provided with a consulting service,
A display unit for performing a consulting service with an expert terminal to receive and display a professional image from the expert terminal;
An image transmission unit for transmitting a customer image photographed during the consulting service to a consulting server; And
A service receiving unit for receiving from the consulting server a consulting service reflecting the degree of customer's commitment measured by the consulting server based on the customer image,
And a client terminal.
12. The method of claim 11,
The display unit receives and displays the data image from the expert terminal,
Wherein the service receiving unit changes the arrangement of the displayed expert image and the data image when the measured degree of immersion is less than or equal to a threshold value.
12. The method of claim 11,
Wherein the service receiving unit receives from the consulting server a current customer image for confirming a consultation posture when the measured degree of immersion is equal to or less than a threshold value.
12. The method of claim 11,
Wherein the service receiving unit receives from the consulting server a customer image in the case where the immersion degree measured during the consulting service progress is equal to or greater than a threshold, as an immersion degree improvement guide image.
12. The method of claim 11,
Wherein the service receiving unit receives a guidance message on termination of the consulting service from the consulting server when the degree of engagement of the customer is not improved after providing the consulting service reflecting the measured degree of engagement.
12. The method of claim 11,
An information transmission unit for collecting customer data including at least one of usage information of the consulting service, usage pattern of the consulting service, and viewing history information on channels provided by the consulting service, and transmitting the collected customer data to the consulting server
Further comprising:
Wherein the service receiving unit receives from the consulting server a list including a plurality of experts extracted based on the customer data.
In an expert terminal providing consulting services,
A display unit for receiving a customer image from the customer terminal through a consulting service with the customer terminal and displaying the customer image;
An image transmission unit for transmitting a professional image photographed during the consulting service to a consulting server; And
A service receiving unit for receiving from the consulting server a consulting service reflecting the degree of customer's commitment measured by the consulting server based on the customer image and the expert image,
Gt; terminal. ≪ / RTI >
18. The method of claim 17,
Wherein the service receiving unit receives from the consulting server the past immersion information for the customer in which the change in the immersion degree is recorded according to the consultation time of the consulting service,
Wherein the information processing unit receives information pertaining to time of the customer's immersion degree before the consulting service.

Images