KR102562810B1 - System for providing on line coaching service base on ai, method performing thereof and recording medium performing t hereof - Google Patents

Abstract

An online coaching service providing server according to an embodiment of the present invention includes a user face information receiving unit for receiving image information of a user using the online coaching service from a user terminal in the process of using the online coaching service between the user and the coach, and a communication interface between the user and the coach. An AI model generation unit that receives question information from the coach terminal during the online coaching service use process, analyzes the user's image information, determines the user's psychological state change according to the analysis result, and stores the question information and psychological state change in the online coaching information database After the real-time online coaching information management unit and the online coaching service between the user and the coach are started, the user's initial psychological state is applied to the pre-generated AI model, and the question information corresponding to the positive state change is obtained. and an online coaching service provider providing question information to a coach terminal when outputted.

Description

AI-based online coaching service providing system, its execution method and recording medium

The present invention relates to an AI-based online coaching service providing system, an execution method thereof, and a recording medium. The present invention relates to an AI-based online coaching service providing system, an execution method thereof, and a recording medium that enable a smooth online coaching service to be provided by providing coaches with question information that changes positively.

In today's modern life, it is almost impossible to live without experiencing some form of psychological test. Psychological testing is a part of the process of finding out comprehensive information about an individual testee. It systematically and quantitatively measures psychological attributes such as intelligence, academic ability, aptitude, personality, interests, and values, and measures the individual's unique behavior. It is used to detect differences between traits and to understand and predict human behavior.

Among these psychological tests, the projection test was developed in the early 20th century as a diagnostic tool to help psychotherapy, and is mainly used when experiencing mental and physical difficulties or when trying to understand an individual's personality. Representative picture psychological tests include the Rocha test, TAT test, HTP test, familialization (KFD) test, or DAP.

In order to receive such a psychological test, a psychological counselor who can conduct a psychological test can be invited when there are a large number of test subjects, but when the test subject is an individual, an examination institution that performs the psychological test, such as a psychological treatment center, a neurological test You should visit a psychiatrist yourself. In addition, in order to be notified of the result of the psychological test, they have to visit the inspection agency again or wait after the psychological test. That is, in the prior art, there was an inconvenience in that a test subject had to spend a long time in person visiting an examination institution for a psychological test.

In addition, if additional diagnosis or treatment is required as a result of the test, and if additional diagnosis or treatment is not possible at the examination institution that performed the psychological test, the test subject must go to another psychological treatment center or hospital where the diagnosis or treatment is available.

Then, the test subject has to directly find out which other psychotherapy centers or hospitals that can diagnose or treat them and where they are located. At this time, the test subject may be recommended by the testing institution that performed the psychological test to another psychological treatment center or hospital where the diagnosis or treatment is possible, but in any case, the test subject visits or contacts another psychological treatment center or hospital to make a reservation, After making an appointment, you must visit the corresponding psychotherapy center or hospital.

Therefore, since the test subject visits an examination institution for psychological examination and, if necessary for diagnosis or treatment, must visit other psychological treatment centers or hospitals, the process for diagnosis or treatment in psychological examination is complicated and cumbersome.

Korean Patent Publication No. 10-2009-0109920 discloses an online learning coaching service system and its method, but does not disclose a method for solving the above problems.

The present invention provides a coach with question information in which a change in a user's psychological state changes positively using an AI model that learns question information acquired through an online coaching service and changes in mental state to provide a smooth online coaching service An object of the present invention is to provide an AI-based online coaching service providing system, an execution method thereof, and a recording medium.

In addition, an object of the present invention is to provide an AI-based online coaching service providing system, an execution method thereof, and a recording medium that enable 1:1 coaching online without time and space constraints.

In addition, an object of the present invention is to provide an AI-based online coaching service providing system, an implementation method thereof, and a recording medium that enable a user to create a healthy corporate life by extracting potential by strengthening the user's mentality through online coaching.

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention not mentioned above can be understood by the following description and will be more clearly understood by the examples of the present invention. It will also be readily apparent that the objects and advantages of the present invention may be realized by means of the instrumentalities and combinations indicated in the claims.

In order to achieve this object, the online coaching service providing server includes a user face information receiving unit for receiving image information of a user using the online coaching service from a user terminal in the process of using the online coaching service between the user and the coach, and online coaching between the user and the coach. An AI model generation unit that receives question information from the coach terminal during service use, analyzes the user's video information, determines changes in the user's psychological state according to the analysis results, and responds to the question information and changes in the mental state to the online coaching information database After the real-time online coaching information management unit and the online coaching service between the user and the coach are started, the initial psychological state of the user is applied to the pre-generated AI model, and the question information corresponding to the positive state change is output. and an online coaching service provider providing question information to a coach terminal.

In addition, the method of automatically providing online coaching questions using AI running in the online coaching service providing server to achieve this purpose receives video information of the user using the online coaching service from the user terminal in the process of using the online coaching service between the user and the coach. In the process of using the online coaching service between the user and the coach, question information is received from the coach terminal, but after the online coaching service between the user and the coach starts, the user's initial mental state is applied to the pre-generated AI model If the question information corresponding to the change in mental state is positive, providing the question information to the coach terminal and analyzing the image information of the user to determine the change in the user's mental state according to the analysis result, and determining the change in the user's mental state according to the analysis result and storing the status change in correspondence with an online coaching information database.

According to the present invention as described above, by using an AI model that learns question information obtained through an online coaching service and changes in mental state, question information in which a change in a user's psychological state is positively changed is provided to the coach to provide a smooth online coaching service. has the advantage of being able to provide

In addition, according to the present invention, there is an advantage that 1:1 coaching can be performed online without time and space restrictions.

In addition, according to the present invention, there is an advantage in that it is possible to create a healthy company life by strengthening the user's mentality through online coaching and extracting potential.

1 is a diagram for explaining an AI-based online coaching service providing system according to an embodiment of the present invention.
Figure 2 is a block diagram for explaining the internal structure of the online coaching service providing server according to an embodiment of the present invention.
3 is a flowchart illustrating an embodiment of a method for automatically providing online coaching questions using AI according to the present invention.
4 to 6 are views for explaining a process of automatically providing online coaching questions using AI according to the present invention.

The above objects, features and advantages will be described later in detail with reference to the accompanying drawings, and accordingly, those skilled in the art to which the present invention belongs will be able to easily implement the technical spirit of the present invention. In describing the present invention, if it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to indicate the same or similar components.

1 is a diagram for explaining an AI-based online coaching service providing system according to an embodiment of the present invention.

Referring to FIG. 1 , the AI-based online coaching service providing system includes a user terminal 100, a coach terminal 200, and an online coaching service providing server 300.

The user terminal 100 is a terminal possessed by a user who accesses the online coaching service providing server 300 and uses the online coaching service.

The user terminal 100 is a digital device having a function to enable a user to communicate after accessing the online coaching service providing server 300 through a communication network in order to use the online coaching service. , desktop computers, notebook computers, etc.), workstations, PDAs, web pads, mobile phones, etc., any digital device equipped with a memory means and equipped with a microprocessor and equipped with arithmetic capability can be used as the user terminal 100 according to the present invention. can be adopted

The user terminal 100 includes an image capturing module 110 for capturing the front of the user using the online coaching service, or if the image capturing module 110 is not included, the image capturing module located in the front direction of the user ( 110) may be related.

When there is an image capture module 110 attached to the user terminal 100, the user terminal 100 is an application that can control the size and transmission period of the user's image information to be transmitted to the online coaching service providing server 300. It is pre-installed.

The performance of the image capture module 110 is about 20 to 30 fps in frames per second, and about 640*480 in resolution. On the other hand, the distance (d) between the user and the image capture module 110 is recommended to be about 45 cm ± 5 cm. In addition, it is preferable that the area where the video corresponding to the online coaching service is output has a size of about 190 mm in width and 95 mm in height and is displayed in the center of the screen.

The coach terminal 200 is a terminal possessed by a coach that accesses the online coaching service providing server 300 and provides an online coaching service to a user.

The coach terminal 200 provides question information to the online coaching service providing server 300 in the process of accessing the online coaching service providing server 300 and providing the online coaching service to the user, and the online coaching service providing server 300 When question information is received from, an online coaching service is provided using the question information.

The online coaching service providing server 300 intermediaries to provide the online coaching service between the user terminal 100 and the coach terminal 200 .

First, the online coaching service providing server 300 provides a propensity determination question to the user terminal 100 through a propensity determination procedure, and when a response to the propensity determination question is received, the user's propensity is determined by using the response. judge After that, the online coaching service providing server 300 matches a coach performing online coaching according to the user's preference.

If the online coaching service providing server 300 completes matching between the user and the coach, the online coaching service is provided between the user and the coach.

First, the online coaching service providing server 300 receives image information of a user using the online coaching service from the user terminal 100 in the process of providing the online coaching service between the user and the coach, and provides coaching services from the coach terminal 200. Receive questions.

After that, the online coaching service providing server 300 analyzes the user's image information, determines the change in the user's psychological state according to the analysis result, stores the question information and the change in the psychological state in correspondence, and after the online coaching service is terminated An AI model is created by learning the online coaching service evaluation result, question information, and mental state change received from the user terminal 100 .

The above AI model is a model that outputs question information in which a change in mental state corresponds to a change in positive state based on the user's initial mental state. Accordingly, the online coaching service providing server 300 may apply the initial mental state of the user to the AI model to receive question information corresponding to a positive state change and provide the output to the coach terminal 200 .

Hereinafter, a process of generating such an AI model will be described.

First, the online coaching service providing server 300 determines the user's initial mental state by using the user's image information received within a specific point in time from the time the online coaching service between the user and the coach is first provided.

In an embodiment, the online coaching service providing server 300 analyzes pixel values corresponding to the pupil area of the user's image information, calculates an average pixel value of the pixel values corresponding to the pupil area, and calculates the average pixel value for each pixel value. Based on the state database, a mental state corresponding to an average pixel value is determined as an initial mental state.

If question information is provided by the coach, the online coaching service providing server 300 analyzes the user's image information received from the user terminal 100 after the question information is provided by the coach, and identifies the pupil of the user's image information. extract the area

To explain the reason for extracting the pupil area as described above, the pupil is an empty space in the center of the inside of the iris, and the amount of light entering the eyeball is determined according to the size of the pupil. The size of the pupil is autonomously controlled by the contraction and relaxation of the pupillary sphincter and dilated pupil, and it is known that the size of the pupil reflexively changes according to the amount of light entering the eyeball.

However, the change in pupil size is not simply caused by the brightness of the surroundings. As already disclosed in many medical papers and academic journals, the change in the user's psychological state affects the change in pupil size. Therefore, in the present invention, after question information is provided in the process of providing an online coaching service between a user and a coach, a change in the pupil of the user is analyzed and learned to generate an AI model.

After that, the online coaching service providing server 300 compares the previous pupil area and the current pupil area used when determining the initial mental state to determine the current mental state.

In one embodiment, the online coaching service providing server 300 compares the pixel values of the previous pupil area and the current pupil area used when determining the initial mental state, so that the difference pixel value between the pixel values is a pixel equal to or greater than a specific value. Calculate the number of, and determine the current mental state according to the number of pixels whose difference pixel value is greater than or equal to a certain value.

In the above embodiment, the online coaching service providing server 300 may determine the mental state change to be no change if the number of pixels having a difference pixel value equal to or greater than a specific value is equal to or less than a specific value.

In the above embodiment, the online coaching service providing server 300 determines, when the number of pixels having a difference pixel value equal to or greater than a specific value is equal to or greater than a specific value, the number of pixels having a difference pixel value equal to or greater than a specific value according to an increase in the pixel value and the pixel value. Difference due to decrease The number of pixels having a pixel value equal to or greater than a specific value may be compared, and a current mental state may be determined according to the comparison result.

The online coaching service providing server 300 compares the initial psychological state and the current psychological state, determines the psychological state change as one of a positive state change and a negative state change according to the comparison result, and the online coaching service evaluation result, question information and Create an AI model by learning changes in mental state.

Therefore, after the online coaching service between the user and the coach starts, the online coaching service providing server 300 applies the initial mental state of the user to the AI model generated by the AI model generating unit 360 so that the change in mental state is positive. When the question information corresponding to the state change is output, the question information is provided to the coach terminal 200 .

In one embodiment, the online coaching service providing server 300 analyzes the online coaching service evaluation result received from the user terminal 100 and determines that the ratio of the number of keywords corresponding to a positive response to the total number of words is equal to or greater than the reference ratio. When the state change indicates a positive state change, the heading question information may be learned as question information corresponding to the positive state change.

In another embodiment, the online coaching service providing server 300 analyzes the online coaching service evaluation result received from the user terminal 100 so that the ratio of the number of keywords corresponding to a positive response to the total number of words is equal to or greater than the reference rate. If the psychological state change indicates a negative state change, the corresponding question information can be learned as question information corresponding to the negative state change according to the difference between the ratio of the number of keywords corresponding to a positive response to the total number of words and the reference ratio. can

Figure 2 is a block diagram for explaining the internal structure of the online coaching service providing server according to an embodiment of the present invention.

Referring to FIG. 2 , the online coaching service providing server 300 includes a user face information receiving unit 310, a question information receiving unit 320, a real-time online coaching information management unit 330, an online coaching information database 340, and an online coaching service. It includes a providing unit 350 and an AI model generating unit 360.

The user face information receiving unit 310 receives image information of a user using the online coaching service from the user terminal 100 in the process of using the online coaching service between the user and the coach, and provides the received image information to the AI model generator 360.

The question information receiver 320 receives question information from the coach terminal 200 in the process of using the online coaching service between the user and the coach and provides it to the AI model generator 360 .

The real-time online coaching information management unit 330 receives image information of a user using the online coaching service from the user face information receiving unit 310 in the process of providing the online coaching service between the user and the coach, analyzes the user's image information, and According to the analysis result, the user's psychological state change is determined, and the question information and the mental state change are stored in correspondence with the online coaching information database 340 .

First, the real-time online coaching information management unit 330 determines the user's initial mental state by using the user's image information received within a specific time point from the time the online coaching service between the user and the coach is first provided.

In an embodiment, the real-time online coaching information management unit 330 analyzes pixel values corresponding to the pupil area of the user's image information, calculates an average pixel value of the pixel values corresponding to the pupil area, and calculates a psychological value for each average pixel value. Based on the state database, a mental state corresponding to an average pixel value is determined as an initial mental state.

If question information is provided by the coach, the real-time online coaching information management unit 330 analyzes the user's image information received from the user terminal 100 after the question information is provided by the coach, and identifies the pupil of the user's image information. extract the area

To explain the reason for extracting the pupil area as described above, the pupil is an empty space in the center of the inside of the iris, and the amount of light entering the eyeball is determined according to the size of the pupil. The size of the pupil is autonomously controlled by the contraction and relaxation of the pupillary sphincter and dilated pupil, and it is known that the size of the pupil reflexively changes according to the amount of light entering the eyeball.

However, the change in pupil size is not simply caused by the brightness of the surroundings. As already disclosed in many medical papers and academic journals, the change in the user's psychological state affects the change in pupil size. Therefore, in the present invention, after question information is provided in the process of providing an online coaching service between a user and a coach, a change in the pupil of the user is analyzed and learned to generate an AI model.

After that, the real-time online coaching information management unit 330 determines the current mental state by comparing the previous pupil region and the current pupil region used when determining the initial mental state.

In one embodiment, the real-time online coaching information management unit 330 compares the pixel values of the previous pupil area and the current pupil area used when determining the initial mental state, so that the difference between the pixel values is a pixel value greater than or equal to a specific value. Calculate the number of, and determine the current mental state according to the number of pixels whose difference pixel value is greater than or equal to a certain value.

In the above embodiment, the real-time online coaching information management unit 330 may determine the mental state change as no change when the number of pixels having difference pixel values greater than or equal to a specific value is less than or equal to a specific value.

In the above embodiment, the real-time online coaching information management unit 330 calculates the number of pixels having difference pixel values greater than or equal to a specific value and the number of pixels having difference pixel values greater than or equal to a specific value when the number of pixels having difference pixel values greater than or equal to a specific value is greater than or equal to a specific value. Difference due to decrease The number of pixels having a pixel value equal to or greater than a specific value may be compared, and a current mental state may be determined according to the comparison result.

The real-time online coaching information management unit 330 compares the initial mental state and the current mental state, and determines the mental state change as one of a positive state change and a negative state change according to the comparison result.

After the online coaching service between the user and the coach starts, the online coaching service provider 350 applies the initial mental state of the user to the AI model generated by the AI model generator 360 so that the change in mental state is positive. When question information corresponding to is output, the question information is provided to the coach terminal 200 .

The AI model generating unit 360 learns the online coaching service evaluation result received from the user terminal, the question information derived from the online coaching information database 340, and the change in mental state after the online coaching service is terminated to create an AI model. generate

In one embodiment, the AI model generator 360 analyzes the online coaching service evaluation result received from the user terminal so that the ratio of the number of keywords corresponding to a positive response to the total number of words is equal to or greater than a reference ratio and the change in mental state is positive. When a state change is indicated, the heading question information may be learned as question information corresponding to a positive state change.

In another embodiment, the AI model generation unit 360 analyzes the online coaching service evaluation result received from the user terminal, and the ratio of the number of keywords corresponding to a positive response to the total number of words is equal to or greater than the reference ratio, but the change in mental state When a negative state change is indicated, the question information corresponding to the negative state change may be learned as question information corresponding to the negative state change according to the difference between the ratio of the number of keywords corresponding to a positive response to the total number of words and the reference ratio.

3 is a flowchart illustrating an embodiment of a method for automatically providing online coaching questions using AI according to the present invention.

Referring to FIG. 3 , the online coaching service providing server 300 receives image information of a user using the online coaching service from a user terminal in the process of using the online coaching service between the user and the coach (step S310).

The online coaching service providing server 300 receives question information from the coach terminal in the process of using the online coaching service between the user and the coach (step S320).

After the online coaching service between the user and the coach is started, the online coaching service providing server 300 applies the user's initial psychological state to a pre-generated AI model, and outputs question information corresponding to a positive change in mental state. Question information is provided to the coach terminal (step S330).

The online coaching service providing server 300 analyzes the user's image information, determines the change in the user's mental state according to the analysis result, and stores the question information and the change in the mental state in an online coaching information database (step S340).

4 to 6 are views for explaining a process of automatically providing online coaching questions using AI according to the present invention.

4 to 6, the online coaching service providing server 300 provides the user terminal 100 with a tendency determination question through a tendency determination procedure as shown in (a) to (c) of FIG. 4, and determines the tendency When a response to the question is received, the user's tendency is determined using the response. After that, the online coaching service providing server 300 matches a coach performing online coaching according to the user's tendency as shown in FIG. 5 .

The online coaching service providing server 300 may provide the online coaching service to the user terminal 100 after matching the coach performing online coaching, and may provide content according to the user's preference as shown in FIG. 6 .

Although described by the limited embodiments and drawings, the present invention is not limited to the above embodiments, and those skilled in the art can make various modifications and variations from these descriptions. Therefore, the spirit of the present invention should be grasped only by the claims described below, and all equivalent or equivalent modifications thereof will be said to belong to the scope of the spirit of the present invention.

100: user terminal,
200: coach terminal,
300: online coaching service providing server,
310: user face information receiver,
320: query information receiving unit;
330: real-time online coaching information management unit;
340 online coaching information database;
350: online coaching service provider;
360: AI model generation unit

Claims (7)

A user face information receiving unit for receiving image information of a user using the online coaching service from a user terminal in the process of using the online coaching service between the user and the coach;
AI model generation unit for receiving question information from the coach terminal in the process of using the online coaching service between the user and the coach;
a real-time online coaching information management unit that analyzes the user's image information, determines a change in the user's mental state according to the analysis result, and stores the question information and the change in the mental state in correspondence with an online coaching information database; and
After the online coaching service between the user and the coach starts, the user's initial psychological state is applied to the pre-generated AI model, and when the question information corresponding to the positive state change is output, the question information is provided to the coach terminal. Includes a coaching service provider;
The real-time online coaching information management unit
Among the user's image information, the pixel value corresponding to the pupil area is analyzed, the average pixel value of the pixel value corresponding to the pupil area is calculated, and the psychological state corresponding to the average pixel value is calculated based on the mental state database for each average pixel value. When the initial mental state is determined and question information is provided by the coach, the user's image information received from the user terminal is analyzed after the question information is provided by the coach, the pupil area is extracted from the user's image information, and the initial psychological state is determined. The pixel values of each of the previous pupil area and the current pupil area used in determining the state are compared to calculate the number of pixels whose difference pixel values between the pixel values are equal to or greater than a certain value, and to the number of pixels whose difference pixel values are equal to or greater than a certain value. If the number of pixels with difference pixel values greater than or equal to a certain value is greater than or equal to a certain value, the number of pixels with difference pixel values greater than or equal to a certain value as the pixel value increases and the difference pixel value as the pixel value decreases Comparing the number of pixels with a specific value or more, and determining the psychological state change as one of a positive state change and a negative state change according to the comparison result,
The AI model generating unit
By analyzing the online coaching service evaluation result received from the user terminal, if the ratio of the number of keywords corresponding to a positive response to the total number of words is greater than or equal to the standard ratio and the change in mental state indicates a change in positive state, the corresponding question information is set to a positive state. Learning with question information corresponding to change,
By analyzing the online coaching service evaluation result received from the user terminal, when the ratio of the number of keywords corresponding to a positive response to the total number of words is equal to or greater than the standard ratio, but the change in psychological state indicates a change in negative state, positive versus the total number of words Characterized in that the corresponding question information is learned as question information corresponding to a negative state change according to the ratio of the number of keywords corresponding to the response and the ratio of the difference between the reference ratio
Server providing online coaching service.
delete delete In the method of automatically providing online coaching questions using AI running on an online coaching service providing server,
Receiving image information of a user using an online coaching service from a user terminal in a process of using the online coaching service between a user and a coach;
Receiving question information from a coach terminal in a process of using an online coaching service between a user and a coach;
After the online coaching service between the user and the coach starts, applying the user's initial psychological state to the pre-generated AI model and providing the question information to the coach terminal when question information corresponding to a positive state change is output ; and
Analyzing the user's image information and determining a change in the user's mental state according to the analysis result;
Storing the question information and mental state change in correspondence with an online coaching information database;
The step of analyzing the user's image information and determining the change in the user's psychological state according to the analysis result
analyzing pixel values corresponding to the pupil area among image information of the user and calculating an average pixel value of the pixel values corresponding to the pupil area;
Based on the mental state database for each average pixel value, the mental state corresponding to the average pixel value is determined as the initial mental state, and if question information is provided by the coach, the user's information received from the user terminal after the question information is provided by the coach Analyzing image information;
The pupil area is extracted from the user's image information, and the difference between the pixel values is calculated by comparing the pixel values of the previous and current pupil areas used when determining the initial psychological state, and calculating the number of pixels whose pixel values are greater than or equal to a specific value. doing;
The current mental state is determined according to the number of pixels whose difference pixel value is greater than or equal to a certain value, and if the number of pixels whose difference pixel value is greater than or equal to a certain value is greater than or equal to a certain value, the number of pixels whose difference pixel value is greater than or equal to a certain value as the pixel value increases. and comparing the number of pixels having a difference pixel value equal to or greater than a specific value according to the decrease in the pixel value. and
Determining a mental state change as one of a positive state change and a negative state change according to the comparison result;
By analyzing the online coaching service evaluation result received from the user terminal, if the ratio of the number of keywords corresponding to a positive response to the total number of words is equal to or greater than the standard ratio and the change in mental state indicates a positive state change, the corresponding question information is set to a positive state. learning as question information corresponding to change; and
By analyzing the online coaching service evaluation result received from the user terminal, when the ratio of the number of keywords corresponding to a positive response to the total number of words is greater than the standard ratio, but the change in psychological state indicates a change in negative state, positive versus the total number of words Further comprising the step of learning the corresponding question information as question information corresponding to a negative state change according to the ratio of the number of keywords corresponding to the response and the ratio of the difference between the reference ratio
A method for automatically providing online coaching questions using AI.
delete delete A computer-readable recording medium storing a program for implementing the method of automatically providing online coaching questions using AI according to claim 4.