KR102075506B1 - A System Providing Matching Platform Of Specialists Based on Video - Google Patents

Abstract

According to the present invention, a system for providing an expert matching platform based on a video comprises: a member subscription module including an expert subscription unit for receiving expert information including expert field information from experts, and a user subscription unit for receiving client information including information on field of interest from a user; a matching module for generating a consultation group by designating one of the experts as a consultant for the user as the information on field of interest of the user and the expert field information are identical; a brokerage module including a page generating unit for generating a consultation page for an online video consultation and a consultation performing unit for performing a video consultation as all members of the consultation group are connected to the consultation page; and a consultant evaluation module including a numerical value input unit for receiving an evaluation result for the consultant from the user as the video consultation is completed, and a result providing unit for providing the evaluation result for the consultant.

Description

A System Providing Matching Platform Of Specialists Based on Video}

The present invention relates to a system for providing an image-based expert matching platform. In more detail, an image-based expert can be provided to an expert by matching a user with an expert in a 1: 1 manner. An expert matching platform providing system.

In general, there are many visitors in Internet portal sites, and a lot of information generated therefrom is interchanged. Such exchange of information involves a large amount of information exchange through a search engine, including the transmission of simple information through a predetermined messenger. Search engines collect related data based on keywords input from users and provide them to users, which are used in many portal sites.

In addition, when a user accesses a specific portal site and wants to receive a predetermined related data, the user receives a plurality of information including a keyword by inputting the corresponding keyword. Therefore, since the accuracy of the data is determined according to the user's keyword selection, the user can search for the required information using a plurality of keywords. This search method is because only the keyword entered by the user is the basis of the data search, and the search engine itself searches only information such as documents and data including the keyword and lists unnecessary information, thereby reducing the reliability of the search.

As such, the existing knowledge search portal site has a problem in that the quality of knowledge that can be obtained according to individual ability is greatly different, and the reliability of the obtained knowledge is lowered. In addition, the existing knowledge search portal site has not only such a problem of deterioration of reliability, but also has a problem that high-level consulting is not possible.

In order to solve such a problem, as the prior art, Korean Patent Publication No. 10-2012-0087412, "Optimum expert consulting system and its control method using online" has been proposed, which is connected to the expert consulting site of the Internet An individual terminal which prepares and transmits question data in various areas requiring expert answers and receives and displays the results; The in-depth analysis of the question data in various areas requiring expert answers transmitted by the individual terminal and the type of method set for the questioner, in-depth analysis of the previous question and the search, and the in-depth analysis of the question It is composed of a site management server that extracts the results of closest professional answers from various Internet data and expert DBs and sends them to individual terminals that have asked questions.

The present invention further proposes an image-based expert matching platform providing system that enables an expert to provide various services required by the user by matching the user 1: 1 with the expert.

The present invention has been made to overcome the problems of the above technology, and provides a professional-based expert matching platform for providing a variety of services required by the user by matching the user 1: 1 with the expert The main purpose is to provide.

Another object of the present invention is to provide a subtitle during video consultation in order to prepare for a case where there is a counselor or client with poor pronunciation or incorrect pronunciation when communication is poor.

Another object of the present invention, in addition to input the user's evaluation score when evaluating the expert to analyze the facial expression or voice of the user to be able to analyze the expert evaluation scale through it.

It is a further object of the present invention to provide a new graph that allows a plurality of expert evaluation scales to be identified at a glance.

In order to achieve the above object, an image-based expert matching platform providing system includes an expert registration unit for receiving expert information including specialized field information from an expert and a user registration for receiving client information including interest field information from a user. Membership module including a unit; A matching module for designating a counseling group by designating any one of the experts as a counselor for the user according to the interest information of the user and the specialized field information; A mediation module including a page generation unit for generating a consultation page for on-line image consultation and a consultation progress unit for performing a video consultation as all members of the consultation group are connected to the consultation page; And a counselor evaluation module including a numerical input unit configured to receive an evaluation result of the counselor from the user as an image consultation is completed, and a result providing unit providing the evaluation result to the counselor.

The mediation module may include a counseling request receiver which receives counseling request information from any one of the members through a personal terminal possessed by a member of the counseling group, and another individual of the members according to the counseling request information received. Participation request sending unit for sending consultation participation request information to the terminal, and the consultation start unit for access processing the consultation group to the consultation page in response to the participation confirmation information is received from the personal terminal receiving the consultation participation request information Characterized in that.

The matching module may include a list generation unit configured to generate a counseling list including a plurality of experts in which the expertise information matches each other, and the counseling list for the expertise information that matches the interest information of the user. A list providing unit for providing the user to the user, a counselor selection unit for selecting any one of the experts belonging to the counseling list from the user, and a counseling group for designating the expert selected from the user as a counselor and creating the counseling group. Characterized in that it comprises a generator.

In addition, the mediation module,

As the image consultation proceeds, further comprises an image database for recording and storing in real time the user image input from the user and the counselor image input from the counselor,

The consultation page includes an image output region for outputting the user image and the counselor image, and other output regions other than the image output region, wherein the system includes a user voice and a counselor voice from the user image and the counselor image. A voice extracting unit for extracting each of the speech data, a text extracting unit for generating the counseling text into text, and a caption providing unit for outputting the counseling text to the other output area of the counseling page. Subtitle providing module; characterized in that it further comprises.

The image-based expert matching platform providing system according to the present invention,

1) by matching the user with the expert 1: 1 so that the expert can provide a variety of services that the user needs,

2) In case of poor communication, in case of consultation or client with incorrect pronunciation, the subtitle can be provided during video consultation.

3) In addition to entering the user's evaluation score when evaluating the expert, not only the user's facial expression or voice can be analyzed, but also the expert's evaluation scale can be analyzed through it

4) A new graph was provided to make it possible to identify multiple expert evaluation scales at a glance.

1 is a conceptual diagram showing a schematic configuration of a system of the present invention.
2 is a block diagram showing a detailed configuration of the system of the present invention.
3 is a conceptual diagram showing an example of a consultation page of the present invention.
4 is a conceptual diagram illustrating an example of a consultation list.
5 is a conceptual diagram of an example of a facial image.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. The accompanying drawings are not drawn to scale, and like reference numerals in each of the drawings refer to like elements.

1 is a conceptual diagram showing a schematic configuration of a system 1 of the present invention.

First, with reference to FIG. 1, each component of the image-based expert 3 matching platform providing system 1 will be described.

First, a user (2) is a person who wants to obtain expertise or information through the expert (3) matching platform of the present invention, and everyone who obtains the necessary information using the system (1) of the present invention is the user (2). Can be The user 2 is generally equipped with an expert 3 matching platform of the present invention provided in the form of a web page or an application, preferably an application with a personal terminal most preferably, such as a computer, a tablet PC or a smartphone. Will be used.

The expert 3 of the present invention may be referred to as a person who shares expertise or information with the user 2 through a matching platform. These experts (3) are not only those who can provide expertise such as doctors, lawyers, patent attorneys, accountants, but also any of the fields that require knowledge in real life, such as art, music, computer, electronics, cooking, education, health and beauty. Anyone who is fluent in a field can become an expert (3). The expert 3 can be matched with the user 2 through the platform of the present invention and can easily and conveniently share the knowledge known to the user 2 without restriction of a place or time. The above-mentioned expert 3 also generally uses a platform of the present invention provided in the form of a web page or application, preferably an application with a personal terminal most preferably, such as a computer, a tablet PC, and a smartphone.

The system 1 of the present invention, that is, the main server 10 is configured to implement an image-based expert 3 matching platform. As described above, the main server 10, that is, the system 1, includes a central processing unit (CPU) in a state in which a communication unit is provided so as to be able to communicate with a personal terminal possessed by each of the user 2 and the expert 3, respectively. And a program that can be executed in the central processing unit on a hardware basis with storage means such as memory and hard disk, that is, software can be installed and run. It will be described later as a structural unit of 'part', 'interface'.

The configuration of the 'module' or 'part' or 'interface' refers to a configuration of software such as FPGA or ASIC or software that is executed through CPU and memory while being installed and stored in the storage means of the main server 10. do. At this time, the configuration of the 'module', 'unit' and 'interface' is not limited to hardware, and may be configured to be in an addressable storage medium or may be configured to reproduce one or more processors. As an example, a 'module' or 'part' or 'interface' may refer to components such as software components, object-oriented software components, class components, and task components, processes, functions, attributes, and the like. Fields, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.

The functionality provided by these 'modules' or 'parts' or 'interfaces' may be combined into a smaller number of components and 'parts' or 'modules' or by additional components and 'parts' or 'modules'. Can be further separated.

In addition, the main server 10 refers to all kinds of hardware devices including at least one processor, and may be understood as a meaning encompassing a software configuration operating in the hardware device according to an embodiment. For example, a computing device as one example of a server may be understood as including, but not limited to, smartphones, tablet PCs, desktops, notebooks, and user clients and applications running on each device.

In the present invention, since the main server 10 performs the role of the system 1, unless otherwise mentioned, the expression system 1 is used instead of the main server 10. In this case, the system 1 The function and configuration of the same as the description for the main server described above.

2 is a block diagram showing a detailed configuration of the system 1 of the present invention.

With reference to FIG. 2, each configuration of the image-based expert 3 matching platform providing system 1 of the present invention will be described in more detail. The system 1 of the present invention allows the user 2 to communicate with the expert 3. 1 to 1 to provide a variety of services required by the user (2) by the expert (3), basically membership registration module 100, matching module 200, intermediary module 300 , The counselor evaluation module 400 may be configured, and a detailed configuration may be added thereto.

First, the membership registration module 100 includes a professional subscription unit 110 and a user subscription unit 120 to perform a role of receiving information of each of the expert 3 and the user 2. At this time, preferably, the expert subscription unit 110 and the user subscription unit 120 may each receive expert information or client information through a personal terminal such as a smart phone possessed by the expert 3 and the user 2. .

The expert subscription unit 110 receives expert information including specialty field information, which is information related to his / her specialty field, from the expert 3. At this time, the specialty information refers to the general user (2) even if he or she is performing as a karma or not as a patent, such as a patent attorney, legal counsel at an attorney, accounting at an accountant, or piano at a pianist. It means a specialty that can provide information. At this time, the specialty information may be more than one. In addition, the expert information may further include the name, photo, age, education, gender, etc. of the expert (3).

The user subscription unit 120 performs a role of receiving client information including information of interest from the user 2. At this time, the field of interest information refers to the field in which the client wants to seek advice from the expert (3). For users (2) who want to receive legal advice, the law and accounting for users (2) who want to receive counseling Can be processed as At this time, the interest information may be one or more. In addition, the client information may further include the client's name, photo, age, education, gender, and the like.

The matching module 200 serves to generate a counseling group by matching the user 2 and the expert 3 with the interest information and the specialized field information, respectively. In other words, any one of the experts 3 whose interest information of the user 2 and his / her specialty information coincide is designated as a counselor for the user 2, and the user 2 and the expert 3 (Consultor) is designated as a counseling group. In this case, since there is no restriction in the matching method, the expert 3 and the user 2 may be randomly matched in the system 1 dimension. However, in general, in the case of users (2) who want to seek advice or counseling, of course, he or she wants to select an expert (3) directly. The detailed configuration according to this is as follows.

3 is a conceptual diagram illustrating an example of the consultation list 91.

Referring to FIG. 2 and FIG. 3, the matching module 200 of the present invention includes a list generator 210, a list provider 220, a counselor selector 230, and a counselor group generator 240. It may be configured to include more.

First, as shown in FIG. 3, the list generation unit 210 generates a counseling list 91 listing a plurality of experts 3 whose professional field information matches each other, that is, a job or a professional field. As shown in FIG. 3, the counseling list 91 may display a picture or name of the expert 3, a company currently belonged to it, etc., and may display a job and the like so that the professional field information can be immediately known.

The list providing unit 220 serves to provide the user 2 with the consultation list 91 having the specialty information that matches the interest information of the user 2. This can be done by outputting the consultation list 91 to a personal terminal such as a smartphone of the user 2 as shown in FIG. At this time, the case of the user 2 like the example of FIG. 3 will be described. In the case of the example of FIG. 3, the user 2 wants to receive legal consultation. The interest information of the user 2 is a law. In this case, an expert 3 about the law, that is, a counseling list 91 for lawyers whose expertise is law, is provided to the user 2 described above. . As such, the user 2 is provided with a counseling list 91 for the experts 3 having the same specialty information as the field input by the user 2 as the interest information. The expert 3 belonging to the consultation list 91 can be grasped at a glance.

The counselor selection unit 230 performs a function of selecting one of the experts 3 belonging to the counseling list 91 provided to the user 2 from the user 2. At this time, the user 2 should select only one expert 3.

The counseling group generation unit 240 designates the expert 3 selected from the user 2 as a counselor for the user 2, and designates the user 2 and the expert 3 who have been in the client relationship with the counselor as one counselor. It acts as a counseling group. When the counseling group is matched like this, it can be said that the preparation for the video counseling is completed.

Returning to the description of the system 1 of the present invention, once the matching of the counseling group is completed, mediation of the full-scale video counseling should be made. Such a function is implemented through the mediation module 300, which is characterized in that the mediation module 300 can be used to mediate video counseling, including a page generation unit and a consultation progress unit. In this case, the detailed configuration of the mediation module 300 will be described with reference to the accompanying drawings.

4 is a conceptual diagram showing an example of the consultation page 20 of the present invention.

First, the configuration of the consultation page 20 of the present invention will be described with reference to FIG. 4 along with FIG. 2. The intermediary module 300 of the present invention may include a page generator for generating a consultation page 20 for on-line image consultation. In this case, the page generator generates a consultation page 20 as shown in FIG. 4. Can be done.

The consultation page 20 may basically be a web page for an online image consultation or an online based application. Such a consultation page 20 should basically be able to be linked with a speaker, a camera, and a microphone of each of the user 2 and the counselor's individual terminal, and in order for the consultation page 20 to manage a video consultation, the user ( Of course, the image output area 21 for outputting the user image input from 2) and the counselor image input from the counselor should be included as a matter of course.

Furthermore, in the case of the consultation page 20, various information and the like can be visually provided to the user 2 and the counselor (expert) 3 in addition to the image output. In addition, the output unit 22 may further include a variety of information visually output.

When the consultation page 20 is generated through the page generation unit, it should be possible to actually mediate the video consultation. As a detailed configuration for this, the present invention may further include a counseling request receiving unit 310, a participation request sending unit 320, and a counseling starting unit 330 as well as a counseling progress unit.

The counseling request receiving unit 310 serves to receive counseling request information through any one of the members of the counseling group, that is, the user 2 or the counselor (matched expert 3). That is to receive the intention to proceed with the video consultation through the personal terminal at this point, this can also be made based on the application. At this time, since the input of the consultation request information can be performed by any one of the members of the consultation group, any one of the user 2 and the counselor can request consultation with the matched counterpart. For example, this can be implemented through a "Request for consultation" button located in the application.

Participation request sending unit 320 serves to send the consultation participation request information to the personal terminal of the other members forming the consultation group as the consultation request information is received. This can be generally implemented through a push message or a pop-up. When one of the members of the counseling group clicks the 'Request for consultation' button, a message such as 'Matched person requests a consultation' is displayed. By sending the request information to the personal terminal of the consultation can notify other members that the consultation request has been received.

The counseling starter 330 performs a function of accessing the counseling group to the counseling page 20 as participation confirmation information is received from the personal terminal receiving the counseling participation request information. In other words, when the user clicks a button such as 'consulting' on the personal terminal in which the counseling participation request information is received, all the members of the counseling group are connected to the counseling page 20. Through this, the counseling page 20 of the counseling group is connected.

The counseling progress unit performs a video consultation as all members of the counseling group, that is, the user 2 and the counselor (matched expert 3), are connected to the counseling page 20. In addition to outputting the consultant image to the image output area 21, it is possible to perform a 1: 1 consultation between the user 2 and the counselor by providing a function such as an image chat so as to transmit and receive audio.

In addition, the mediation module 300 should transmit the user image and the counselor image in real time to the above-described consultation page 20, further including an image database 340 from the user 2 as the image consultation proceeds. Of course, the user image and the counselor image input from the counselor may be recorded and stored in real time. The user image and the counselor image recorded in this way may be downloaded and stored by the user 2 or the expert 3 to his personal terminal.

Finally, the counselor evaluation module 400 of the present invention performs a function of allowing the user 2 to evaluate a counselor who has consulted with him, that is, an expert 3, after the consultation is over. 400 basically includes a numerical input unit 410 and a result providing unit 420.

The numerical input unit 410 performs a function of receiving an evaluation result for the counselor from the user 2 as the image consultation is completed. In this case, the evaluation result may be input as a digitized score, It may be input as a form, or may be made by a button click or the like. Through this, the user 2 can input whether the counselor who has consulted with him has an outstanding talent for his / her specialty information, whether the consultation was satisfactory, or if there were other dissatisfaction or satisfaction points. . Most preferably, through the numerical input unit 410, the user 2 inputs an input satisfaction level value which is a numerical evaluation result for the counselor. The input satisfaction level is 1 or 100, and has a value in the range of 0 to 1 when 1 is perfect, and a value in the range of 0 to 100 when 100 is perfect.

The result providing unit 420 provides a function of providing the counselor who performed the consultation with the evaluation result input from the user 2, so that the feedback provided to the user after the consultation can be confirmed, thereby providing better service and Information can be provided.

Furthermore, the system 1 of the present invention may include a subtitle providing module 500. This is to consider that the voice of each other may not be properly transmitted if the other party's pronunciation is unclear or the communication signal is weak when communication is interrupted. To make it available. The caption providing module 500 should basically include a voice extractor 510, a text extractor 520, and a caption provider 530.

The voice extractor 510 extracts the user voice and the counselor voice from the user image and the counselor image, respectively. In this case, the user voice and the counselor voice may be separately extracted and stored, but may be integrated as voice data. It may be.

The text extracting unit 520 performs a function of generating a consultation text in which the voice data is textized, which is omitted since it is referred to a conventional speech to text (STT) function. . In this case, the counseling text may be textualized voice data in which user voice and counselor voice are integrated, or the user voice may be separately texted as user text, and the counselor voice may be separately texted as counselor text. .

The subtitle providing unit 530 performs a function of outputting, in real time, the consultation text generated by the text extraction unit 520 to the other output area 22 of the consultation page 20. Through the subtitle providing unit 530, the user 2 and the counselor can easily check the counseling text, which is a text subtitle which converts the voice input by the person or the counterpart into text in real time.

Furthermore, in the case of extracting the user text from the user's voice in this way, the user's counseling satisfaction can be grasped by extracting words indicating the user's satisfaction or dissatisfaction from the user's speech. This may be implemented through the text analysis unit 610 of the satisfaction analysis module 600, which may be further included in the system (1) of the present invention, the text analysis unit 610 is spoken by the user 2 during the video consultation It is to analyze and analyze the texts of the words, ie, the texts of the voices, and to calculate and analyze the text satisfaction scores that quantify the satisfaction with the consultation. The text analysis unit 610 may basically include a root list generation part 611, a word grasp part 612, an evaluation root extraction part 613, and a numerical calculation part 614.

The root list generation part 611 performs a function of generating a root list composed of a plurality of roots containing at least one of satisfaction and positive meanings. At this time, a root that includes satisfaction or positive meanings includes satisfaction or positive meanings in Korean such as 'satisfaction', 'good', 'good', 'good', 'joy', 'good', 'good'. Means root. In this case, the root refers to a practical meaning in a word, and of course, affixes or surveys may be excluded. In addition to the above-mentioned words, both roots containing the meaning of satisfaction in the Korean language or roots containing the meaning of conveying a positive mood can be included in the root list.

The word grasp part 612 serves to grasp the number of words contained in the entire user text, and analyzes individual words to separate the root and the ending. In this case, it is also possible to filter out macros or investigations that are not semantically unnecessary in order to improve computation speed.

The evaluation root extracting part 613 performs a function of extracting only the words included in the root list among the plurality of words included in the user text. Through this, only the number of words having a satisfactory or positive meaning among the words input from the user 2 can be grasped, which is used to calculate the text satisfaction level.

The numerical calculation part 614 compares the number of words included in the root list with the total number of words to calculate a text satisfaction level. At this time, in the numerical calculation part 614, the text satisfaction level calculation method is not limited, but most preferably, the number of all words input by the user 2 and the average of all users 2 using the platform. The number of words, the number of words included in the root list among the words input by the user 2, and the average number of positive meaning roots analyzed up to the present time (the words included in the root list among the words entered by the user 2 described above). The number of words is calculated for all users 2 using the platform of the present invention, and the averaged value) is compared with each other to calculate the text satisfaction level. At this time, there is no restriction on how to calculate the text satisfaction level. However, in the case of the text satisfaction level value, 100 is perfect or 1 is perfect. When 1 is perfect, it has a value in the range of 0-1, and when 100 is perfect, it has a value in the range of 0-100.

When the text satisfaction level is calculated through the text analysis unit 610 as described above, the counselor evaluation module 400 is based on the input satisfaction level and the text satisfaction level through the comprehensive calculation unit 430 which may be additionally included. Comprehensive satisfaction level is calculated. In this case, the general satisfaction level value may generally be an average value of the input satisfaction level value and the text satisfaction level value, or other numerical calculation methods may be applied.

In the case of calculating the comprehensive satisfaction level through the above-described configuration, the result providing unit 420 may provide the counselor with an evaluation result including the comprehensive satisfaction level.

Further, the satisfaction analysis module 600 analyzes not only the voice but also the image of the user 2 to consult the expert 3 by quantifying the consultation satisfaction level of the user 2 that can be grasped through the image. It can also be used as a measure of satisfaction. To this end, the image analyzer 620 may be further included. The image analyzer 620 analyzes the above-described user image and calculates an image satisfaction level value by quantifying the counseling satisfaction level of the user 2.

In the case of calculating the image satisfaction level, the comprehensive calculation unit 430 calculates the comprehensive satisfaction level based on the input satisfaction level, the text satisfaction level, and the image satisfaction level.

5 is a conceptual diagram illustrating a face image 4.

Referring to FIG. 2 together with FIG. 6, it is necessary to look at the change of the face of the user 2, that is, the expression change in order to determine the consultation satisfaction of the user 2 from the image of the user 2, that is, the user image. There is. Among them, it is necessary to be able to judge smiles, which are expressions that appear when satisfying, and for this purpose, the eyes, mouth, and dimples should be analyzed. Accordingly, the image analysis unit 620 may include a face image extraction part 621, an area detection part 622, an eye tail analysis part 623, an eyeball size analysis part 624, a dimple analysis part 625, and a mouth tail analysis part ( 626, a numerical analysis part 628 may be included.

The face image extraction part 621 performs a role of extracting the face image 4 which enlarges the face part of the user 2 from the user image. This is an enlarged process of only the face part from the image photographed by the user 2. Most recent images have higher quality than HD, so even if the video taken during video consultation is enlarged, facial images can be obtained without any loss of image quality.

The area detection part 622 detects the eyeball area 5, the lip area 6, and the dimple area 7 of the user 2 from the above-described face image 4. In this case, the eyeball area 5, the lip area 6, and the dimple area 7 may include two eyeball areas 5, one lip area 6, and two dimple area 7.

The eye tail analysis part 623 is a place where the analysis of the eye region 5 described above is performed, and when a person smiles or laughs loudly, the eye tail portion is generally folded and wrinkles are generated. At this time, the point where wrinkles are much increased is characterized by the fact that the curvature of the part is increased and the brightness is generally lowered. You can catch it. Accordingly, the eye tail analysis part 623 performs a function of generating a satisfaction signal when the brightness change value of the eye tail of the eyeball area 5 exceeds a preset threshold. For example, the threshold value may be set by the platform administrator. Therefore, when the user 2 smiles through the eye tail analysis part 623, it is possible to catch changes in brightness due to wrinkles generated at the eye tail.

At this time, the satisfaction signal is calculated as a signal to calculate that when the brightness change exceeding the threshold occurs, the user 2 has satisfied the response during a specific time when the brightness change above the threshold occurs. If the change in the brightness of the tail of the eye above the threshold lasts for 3 seconds, the satisfaction signal appears for 3 seconds.

The eyeball size analysis part 624 generally focuses on the fact that the size reduction of the eyeball area 5 occurs (when the eyes are closed or small) when smiling or laughing loudly. If the size reduction continues for more than the preset threshold time, the satisfaction signal is generated. At this time, the threshold time setting method or the detailed value is not limited, and the threshold time may also be set by the platform administrator. In this case, the eyeball size refers to the vertical length of the eye as described above with reference to FIG. At this time, it is obvious that the size of the eyes is reduced by the smile or the satisfaction, not the blinking of the eyes for a while. Therefore, the threshold time must be more than the time required to blink the eyes.

For example, when the threshold time is 2 seconds, as the eyeball size decreases with respect to the average eyeball size of the user 2 for 2 seconds or more, that is, the eyeball size of the user 2 is compared with the average eyeball size, Satisfaction signal is generated as it is observed to be reduced by 2 seconds or more. At this time, if the corresponding motion lasts 6 seconds, the satisfaction signal may be generated for 4 seconds.

The dimple analysis part 625 serves to generate a satisfaction signal as the brightness change value of the dimple area 7 exceeds a preset threshold. In this case, the threshold value is not limited to a setting method or a detailed value but may be set by a platform administrator. Some people show dimples when they smile, and these dimples have pit features that result in lower brightness than the surrounding area. That is, when the dimple appears, the brightness of the corresponding area is lowered. Therefore, when the change in the brightness of the dimple area 7 is greater than or equal to the preset threshold, the dimple appears to be present (smiled) and a satisfaction signal is generated. It will be done. If the change in the brightness of the auxiliary region 7 above the threshold value lasts for 3 seconds, the satisfaction signal is calculated for 3 seconds.

The mouth tail analysis part 626 plays a role of generating a satisfaction signal based on a position where a change occurs when smiling in the lip region 6, that is, the position of the mouth tail. In other words, when the mouth-tail position of the user 2 is raised by more than the threshold time than the average mouth-tail position, it is assumed that a positive mood appears and generates a satisfaction signal. At this time, the threshold time setting method and detailed values are not limited, and may be set by the platform administrator. Thus, the positive mood of the user 2 can be grasped | ascertained because the position of the mouth tip of the user 2 was raised compared with the average position.

The numerical analysis part 628 generates the satisfaction signal through the full length of the user image, the eye tail analysis part 623 and the eyeball size analysis part 624, the dimple analysis part 625, and the mouth tail analysis part 626. It calculates the image satisfaction value based on the length, the frequency of generating the satisfaction signal. At this time, the image satisfaction value is characterized in that it is calculated based on the following equation (1).

Equation 1,

는 영상만족도수치,

는

번째 만족시그널이 적어도 두 개의 영역에서 동시에 유지된 길이,

는

번째 만족시그널이 유지된 길이,

는 만족시그널의 시간가중치,

는 전체 만족시그널의 평균 길이,

는 유저영상의 전체 길이,

은 생성된 만족시그널의 총 빈도수를 의미한다.)(here,

The video satisfaction level,

Is

The length at which the first satisfying signal is maintained simultaneously in at least two areas,

Is

Length of the first satisfaction signal,

Is the time weight of the satisfaction signal,

Is the average length of the entire satisfaction signal,

Is the full length of the user image,

Is the total frequency of generated satisfaction signals.)

는

번째 만족시그널이 여러 영역에서 동시에 유지된 길이를 의미하는 것으로서, 미소는 일반적으로 눈, 입, 보조개에서 동시에 나타나는 점을 참조하였을 때, 안구영역(5) 및 입술영역(6)에서 만족시그널이 동시에 검출된 경우, 만족시그널이 중첩된 길이를 의미하는 것이다. 이 때 길이는 시간을 의미하며, 일반적으로 초 단위를 의미한다.here

Is

The first satisfaction signal is a length that is maintained at the same time in several areas, and when a smile is generally seen at the same time in the eyes, mouth, and dimples, the satisfaction signal is simultaneously observed in the eye area 5 and the lip area 6. If detected, it means the length of the satisfaction signal is overlapped. In this case, length means time and generally means unit of second.

In addition, r means the time weight value of the satisfaction signal, and the length of time that the satisfaction signal is displayed compared to the total length of the user image is extremely short, so that the weight is multiplied to correct it. At this time, there is no restriction on the size of the weight, and the setting method also does not place any restriction.

Equation 1 is an equation for calculating the image satisfaction level based on the total length of the user image, the length of the satisfaction signal is generated, the frequency of generating the satisfaction signal, etc. It is possible to know by quantifying how good feelings and satisfactions were expressed by facial expressions during video consultation. In the case of the numerically calculated output value, it can be referred to as an objective analysis rather than a subjective analysis, thereby increasing the reliability of the satisfaction value.

As described above, the satisfaction level of the present invention is composed of an input satisfaction level, a text satisfaction level, and an image satisfaction level. Although the general satisfaction value obtained by synthesizing this is also provided to the expert 3, the visualization graph 90 may be generated and provided to the expert 3 so as to make it more granular and intuitive.

To this end, the system (1) is output to the other output area 22, a graph generation module for generating a visualization graph 90 visualizing the input satisfaction value, the text satisfaction value and the image satisfaction value ( 700 may be further included. When the visualization graph 90 is generated as described above, the result providing unit 420 may provide the evaluation result and the visualization graph 90 to the counselor as the image consultation is completed. It can be provided.

In this case, the shape of the visualization graph 90 is not restricted, but most preferably, the input satisfaction value, the text satisfaction value, and the image satisfaction value can be grasped at a glance, and the comprehensive satisfaction level value can be grasped at a glance. It is desirable to be able to.

As described so far, the configuration and operation of the image-based expert matching platform providing system according to the present invention have been expressed in the above description and drawings, but this is merely an example, and the spirit of the present invention is not limited to the above description and drawings. And, of course, various changes and modifications are possible within the scope without departing from the spirit of the present invention.

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

1: System 2: User
3: expert 4: facial image
5: eye area 6: lip area
7: Auxiliary area 10: Main server
20: Consultation page 21: Video output area
22: other output area 30: basic circle
31: first vertex 32: second vertex
33: third vertex 40: basic triangle
50: first diameter 51: first display point
60: second diameter 61: second display point
70: third diameter 71: third display point
80: area diagram 100: membership module
110: professional registration 120: user registration
200: matching module 210: list generation unit
220: list providing unit 230: counselor selection unit
240: counseling group generation unit 300: intermediary module
310: counseling request receiver 320: participation request caller
330: starting counseling 340: video database
400: counselor evaluation module 410: numerical input unit
420: result provider 430: comprehensive output unit
500: subtitle providing module 510: voice extraction unit
520: text extraction unit 530: subtitle provider
600: satisfaction analysis module 610: text analysis unit
611: Root List Generation Part 612: Word Extraction Part
613: Evaluation root extract part 614: Numerical calculation part
620: image analysis unit 621: facial image extraction part
622: area detection part 623: eye tail analysis part
624: Eye size analysis part 625: Dimple analysis part
626: mouth tail analysis part
628: numerical analysis part 700: graph generation module
710: basic circular output unit 720: basic triangle output unit
730: vertex display unit 731: first corresponding part
732: second correspondence part 733: third correspondence part
740: input satisfaction display unit 750: text satisfaction display unit
760: image satisfaction display unit 770: figure display unit
90: visualization graph 91: consultation list

Claims (11)

As an image-based expert matching platform providing system,
A membership registration module including an expert subscription unit for receiving expert information including specialized field information from an expert and a user subscription unit for receiving client information including interest field information from a user;
A matching module for designating a counseling group by designating any one of the experts as a counselor for the user according to the interest information of the user and the specialized field information;
A page generation unit for generating a consultation page including an image output area for outputting the image of the user and the image of the counselor and other output areas except for the image output area, for online image consultation; A counseling progress unit that conducts video consultation as all members of the group are connected, and an image database that records and stores in real time a user image input from the user and a counselor image input from the counselor as the video consultation proceeds. Intermediary module comprising;
A counselor evaluation module including a numerical input unit configured to receive an evaluation result of the counselor from the user as an image consultation is completed, and a result providing unit providing the evaluation result to the counselor;
Counseling text including voice extracting unit for extracting voice data including user voice and counselor voice from the user image and counselor video, respectively, and user text with text of the user voice and counselor text with text of counselor voice. A caption providing module including a text extracting unit for generating a caption and a caption providing unit for outputting the consultation text to another output area of the consultation page;
And a satisfaction analysis module including a text analysis unit for analyzing the user text and calculating a text satisfaction level numerically quantifying the counseling satisfaction level of the user.
The counselor evaluation module,
A numerical input unit for receiving an input satisfaction level value which is a numerical evaluation result for the counselor from the user as the image consultation is completed, and a comprehensive calculation unit for calculating a comprehensive satisfaction level value based on the input satisfaction level value and the text satisfaction level value; and,
The result providing unit provides the counselor with an evaluation result including the comprehensive satisfaction level,
The satisfaction analysis module includes an image analysis unit for analyzing the user image and calculates the image satisfaction level numerical value of the consultation satisfaction of the user,
The comprehensive calculation unit calculates the comprehensive satisfaction level based on the input satisfaction level, the text satisfaction level, and the image satisfaction level,
The image analyzer,
A face image extraction part for extracting a face image in which the face part of the user is enlarged from the user image;
An area detection part for detecting the eye area, the lip area, and the auxiliary opening area of the user from the face image;
An eye tail analysis part for generating a satisfaction signal as a change in brightness of the eye tail of the eye region exceeds a preset threshold value;
An eye size analysis part for generating a satisfaction signal as the eye size of the eye area is reduced by more than a preset threshold time;
A dimple analysis part for generating a satisfaction signal as a brightness change value of the dimpled area exceeds a preset threshold value;
A mouth tail analysis part for generating a satisfaction signal as the mouth tail position of the lip region is increased by more than a preset threshold time compared to a standard position;
The image-based expert matching platform further comprises a numerical analysis part for calculating an image satisfaction level based on the total length of the user image, the length of the satisfaction signal generation, and the frequency of generation of the satisfaction signal. system. The method of claim 1,
The mediation module,
A counseling request receiver for receiving counseling request information from any one of the members through a personal terminal possessed by a member of the counseling group;
Participation request sending unit for sending the consultation participation request information to the other individual terminal of the member in accordance with the consultation request information, and
And a counseling starter configured to access and process the counseling group to the counseling page as the participation confirmation information is received from the personal terminal receiving the counseling participation request information. The method of claim 1,
The matching module,
A list generation unit for generating a consultation list including a plurality of the experts in which the specialty information matches each other;
A list providing unit which provides the user with the consultation list for the specialty information corresponding to the user's interest information;
A counselor selection unit for receiving any one of experts included in the counseling list from the user;
And a counseling group generation unit for designating the expert selected from the user as a counselor and generating the counseling group. delete delete delete The method of claim 1,
The text analysis unit,
A root list generating part for generating a root list consisting of a plurality of roots containing at least one of a satisfaction and a positive meaning, and
A word grasp part for grasping the word included in the user text and the number of words;
An evaluation root extracting part for grasping a word included in the root list among a plurality of words;
And a numerical calculation part that calculates the text satisfaction level by comparing the number of words included in the root list with respect to the total number of words. delete The method of claim 1,
The numerical analysis part,
The image-based expert matching platform providing system, characterized in that for calculating the image satisfaction level based on the following equation (1).
Equation 1,

(here,

The video satisfaction level,

Is

At least two concurrently held first satisfying signals,

Is

Length of the first satisfaction signal,

Is the time weight of the satisfaction signal,

Is the average length of the entire satisfaction signal,

Is the full length of the user image,

Is the total frequency of generated satisfaction signals) The method of claim 1,
The system,
And a graph generation module configured to generate a visualization graph that visualizes the input satisfaction level, the text satisfaction level, and the image satisfaction level as output to the other output area.
The result providing unit,
And providing the evaluation result and the visualization graph to the counselor as the image consultation is completed. delete

Images