KR102451631B1 - Apparatus, method and program for providing telemedicine services - Google Patents

Abstract

The present invention provides an apparatus for providing a remote treatment service which can recommend a doctor suitable for performing a video treatment on a user to the user. According to an embodiment of the present invention, the apparatus comprises: a treatment matching unit receiving a treatment matching request from a user terminal of a user, providing a list in which a plurality of doctors are listed for the user terminal, receiving a doctor selection input and a treatment waiting request for one among the doctors from the user terminal, providing the treatment waiting request for a doctor terminal of a doctor corresponding to the doctor selection input, and receiving a treatment acceptance input from the doctor terminal; and a call connection unit providing a call request for the doctor terminal and the user terminal if the treatment acceptance input is received, and providing channel information for a call for the doctor terminal and the user terminal.

Description

APPARATUS, METHOD AND PROGRAM FOR PROVIDING TELEMEDICINE SERVICES

The present invention relates to an apparatus, method and program for providing telemedicine services.

Unless otherwise indicated herein, the material described in this section is not prior art to the claims of this application, and inclusion in this section is not an admission that it is prior art.

As ICT (Information and Communication Technologies) technology develops, users in a place where a network is provided can transmit images without interruption to each other.

Accordingly, many studies are being conducted on the technology for performing remote medical treatment using such an infrastructure.

Conventional technologies suggest a method of making a medical appointment between a user and a doctor and performing remote treatment through a video phone. No research is being done.

Republic of Korea Patent Publication No. 10-2021-0109031 (published on Dec. 8, 2001) Republic of Korea Patent Publication No. 10-2014-0037325 (published on March 27, 2014)

The present invention provides an apparatus, method and program for providing a telemedicine service, wherein the service providing apparatus provides a call request to a user's terminal and a doctor's terminal, and connects the user's terminal that has approved the call request and the doctor's terminal to work for the purpose of

Another object of the present invention is to provide an apparatus, method and program for providing telemedicine services, which can determine a doctor suitable for performing image treatment on a user and provide information about the determined doctor to the user. do.

Another aspect of the present invention is to provide an apparatus, method and program for providing a telemedicine service, capable of determining a treatment site image corresponding to an input received from a doctor's terminal and providing the determined treatment site image to a user's terminal. for another purpose.

Another object of the present invention is to provide an apparatus, method, and program for providing a telemedicine service, capable of de-identifying a user's facial parts and providing it to a doctor's terminal.

In one aspect of the present invention for achieving the above object, there is provided an apparatus for providing a telemedicine service.

The apparatus receives a medical treatment matching request from a user terminal of the user, provides a list of a plurality of doctors to the user terminal, and receives a doctor selection input and a medical treatment waiting request for any one of the doctors from the user terminal a treatment matching unit for receiving, providing the treatment waiting request to a doctor terminal of a doctor corresponding to the doctor selection input, and receiving a treatment acceptance input from the doctor terminal; and a call connection unit that provides a call request to the user terminal and the doctor terminal when the treatment acceptance input is received, and provides channel information for a call to the user terminal and the doctor terminal.

In addition, the medical treatment matching unit receives a first input for a symptom, inputs the first input as an input value to a pre-trained first machine learning model, and receives a first input from the first machine learning model, each of a plurality of departments and A corresponding first degree of matching is obtained, the departments having the first matching degree equal to or greater than a preset first standard matching degree are determined as first departments, and a plurality of questionnaires previously matched with the first departments in a database and stored , providing the questionnaires to the user terminal, receiving questionnaire results corresponding to the questionnaires from the user terminal, and a second matching degree corresponding to each of the first medical departments based on the questionnaire results determines the first department with the highest degree of matching as the second department, and searches the database for the doctors and the history information of each of the doctors that are matched with the second department, The list of the doctors stored in matching with the second department and the history information of each of the doctors may be provided to the user terminal.

In addition, the history information includes a waiting time, a rating, and a number of telemedicine, and the medical treatment matching unit determines a degree of recommendation corresponding to each of the doctors based on the waiting time, the rating, and the number of telemedicine, The doctors may provide to the user terminal the list listed in order of the highest degree of recommendation.

In addition, the apparatus receives a second input indicating a treatment site from the doctor terminal, inputs the second input as an input value to a pre-trained second machine learning model, and receives the second input from the second machine learning model. obtains a third degree of matching corresponding to each of the plurality of set images of the treatment area, and provides the images of the treatment area with the third degree of matching equal to or greater than a preset second reference level of matching to the doctor terminal, and from the doctor terminal The medical treatment assistant may further include a medical treatment assistant that receives an image selection input for any one of the treatment site images and provides the treatment site image corresponding to the image selection input to the user terminal.

In addition, the call connection unit receives an image in the form of a digital packet from any one of the user terminal and the doctor terminal, and provides the image to the other one of the user terminal and the doctor terminal, and the medical treatment assistant unit includes the user When a de-identification request is received from the terminal, and the voice included in the image matches the voice stored in advance with the user terminal in the database, a plurality of preset facial parts in the image may be de-identified.

According to an embodiment of the present invention, since the service providing apparatus provides a call request to the user's terminal and the doctor's terminal, and connects the user's terminal that has approved the call request and the doctor's terminal, the user's and doctor's phone numbers, While personal information such as e-mail and ID is not leaked, remote medical treatment can be performed through a video call.

According to another embodiment of the present invention, a doctor suitable for performing image treatment on the user may be recommended to the user.

In addition, according to the present invention, since the image of the treatment site corresponding to the input received from the doctor's terminal is provided to the user's terminal, telemedicine can be performed more smoothly.

In addition, since the present invention de-identifies the user's facial parts and provides it to the doctor's terminal, the user's face is not leaked and remote treatment can be performed through a video call at the same time.

1 is a schematic diagram of a system for providing a telemedicine service according to an embodiment.
FIG. 2 is a block diagram exemplarily illustrating a functional module of the service providing apparatus according to FIG. 1 .
FIG. 3 is a flowchart illustrating an embodiment of a process in which a medical treatment matching unit and a call connection unit connect a user and a doctor by wire according to FIG. 2 .
FIG. 4 is a flowchart illustrating another embodiment of a process in which a medical treatment matching unit and a call connection unit connect a user and a doctor by wire according to FIG. 2 .
FIG. 5 is a flowchart illustrating a process of matching a doctor by the medical treatment matching unit according to FIG. 2 .
6 is a flowchart illustrating a process in which the medical treatment assistant according to FIG. 2 provides an image of a medical treatment site to a user terminal.
FIG. 7 is a flowchart illustrating a process in which the medical treatment assistant according to FIG. 2 de-identifies or identifies the facial parts of the user in the image.
FIG. 8 is a diagram exemplarily illustrating a hardware configuration of the service providing apparatus according to FIG. 1 .

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It is to be understood that this does not preclude the possibility of the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram of a system for providing a telemedicine service according to an embodiment.

Referring to FIG. 1 , a system for providing a telemedicine service includes a service providing apparatus 100 , a user terminal 200 , and a doctor terminal 300 . In the illustrated embodiment,

The user terminal 200 is a terminal of a user who wants to receive telemedicine through a telemedicine service, and provides user information to the service providing apparatus 100 . In an embodiment, the user's information may include information that can specify the user, such as the user's name, age, resident registration number, address, and gender.

Also, the doctor terminal 300 is a terminal for remotely performing medical treatment on a user through a telemedicine service, and provides doctor information to the service providing apparatus 100 . The doctor information may include information that can specify the doctor, such as the doctor's name, age, resident registration number, address, gender, and doctor license information.

For example, the user terminal 200 and the pseudo terminal 300 can communicate, a desktop computer (desktop computer), a laptop computer (laptop computer), a notebook (notebook), a smart phone (smart phone), a tablet PC (tablet PC) , mobile phone, smart watch, smart glass, e-book reader, PMP (portable multimedia player), portable game console, navigation device, digital camera, DMB (digital multimedia broadcasting) player, digital audio recorder, digital audio player, digital video recorder, digital video player, PDA (Personal Digital Assistant) etc.

The service providing apparatus 100 may be a server for providing a telemedicine service to the user terminal 200 and the doctor terminal 300 .

First, the service providing apparatus 100 may receive a medical treatment matching request from the user terminal 200 , and provide a list of matched doctors and doctor information of each of the matched doctors to the user terminal 200 .

Also, the service providing apparatus 100 may receive a doctor selection input and a medical treatment waiting request from the user terminal 200 , and may provide the medical treatment waiting request to the doctor terminal 300 matching the doctor selection input.

Also, the service providing apparatus 100 may receive a medical treatment acceptance input from the doctor terminal 300 and connect the user terminal 200 and the doctor terminal 300 over a wire.

Also, the service providing apparatus 100 may provide the user terminal 200 and the doctor terminal 300 with a medical assistance service that helps to smoothly perform remote medical treatment.

Also, the service providing apparatus 100 may provide the prescription received from the doctor terminal 300 to the user terminal 200 .

Also, the service providing apparatus 100 may provide a medical treatment payment service to the user terminal 200 and the doctor terminal 300 .

FIG. 2 is a block diagram exemplarily showing a functional module of the service providing apparatus 100 according to FIG. 1 .

Referring to FIG. 2 , the service providing apparatus 100 includes a medical treatment matching unit 101 and a call connection unit 102 .

FIG. 3 is a flowchart illustrating an embodiment of a process in which the medical treatment matching unit 101 and the call connection unit 102 according to FIG. 2 connect a user and a doctor by wire.

First, the medical treatment matching unit 101 receives a medical treatment matching request ( S110 ) from the user terminal 200 . In an embodiment, the medical treatment matching unit 101 may provide a user interface through which a user may input a medical treatment matching request to the user terminal 200 .

When the medical treatment matching request is received, the medical treatment matching unit 101 matches the user with the doctor (S120).

In one embodiment, the medical treatment matching unit 101 may receive from the user terminal 200 a department for which the user wants to receive medical treatment, and search the database for history information of each of a plurality of doctors stored in advance matched with the medical department. have. Also, the medical treatment matching unit 101 may generate a list of searched doctors. In an embodiment, the medical treatment matching unit 101 may provide the user terminal 200 with a user interface through which the user can input a selection for at least one of a plurality of preset medical departments. In the database of the service providing apparatus 100 , history information of each of a plurality of preset departments and a plurality of doctors is matched in advance and stored.

5 is a flowchart illustrating a process in which the medical treatment matching unit 101 according to FIG. 2 matches a doctor.

Referring to FIG. 5 , the medical treatment matching unit 101 receives a first input for a symptom from the user terminal 200 ( S121 ). In one embodiment, the first input may be a text for a symptom or a voice for a symptom. In an embodiment, when the first input is a voice, the medical treatment matching unit 101 inputs the voice as an input value to the pre-trained STT (Speak To Text) model, and obtains a text corresponding to the voice from the STT model do.

Also, the medical treatment matching unit 101 inputs the first input as an input value to the pre-trained machine learning model, and obtains a first matching degree corresponding to each of the plurality of medical departments from the machine learning model (S123).

In an embodiment, pediatrics, internal medicine, otolaryngology, dentistry, etc. may be set as preset departments.

In an embodiment, the machine learning model may receive text data corresponding to the first input as an input value, and output a first degree of matching between the text data and each department. In an embodiment, the machine learning model may separate text data into morpheme units, generate vectors for a plurality of separated morphemes, and specify a probability corresponding to each department based on the generated vector. have. In an embodiment, the probability corresponding to each department means a first degree of matching corresponding to each department. In an embodiment, a Recurrent Neural Network (RNN), BERT, Random Forest, etc. may be used to train the machine learning model. However, the present invention is not limited thereto.

Also, the medical treatment matching unit 101 determines departments having a first matching degree equal to or greater than a preset first standard matching degree as first departments ( S123 ).

Also, the medical treatment matching unit 101 searches the database of the service providing apparatus 100 for a plurality of questionnaires previously matched with the first medical departments and stored ( S124 ).

In the database of the service providing apparatus 100 , each of a plurality of preset first medical departments and a questionnaire are matched and stored in advance. In an embodiment, the questionnaire may include a plurality of questions set to determine whether it is appropriate for the patient to receive treatment in the first department. In an embodiment, each of the plurality of items may include a plurality of options.

Also, the medical treatment matching unit 101 provides the searched questionnaires to the user terminal 200 , and receives questionnaire results corresponding to the questionnaires from the user terminal 200 ( S125 ).

In an embodiment, the medical treatment matching unit 101 may provide the user terminal 200 with a user interface through which the user may input a selection input for the items included in the questionnaire.

In an embodiment, the survey result may include a selection input input by the user for each of a plurality of questions included in the survey. The selection input may be an input for selecting any one of the options included in the question.

Also, the medical treatment matching unit 101 determines a second matching degree corresponding to each of the first medical departments based on the questionnaire result ( S126 ).

In an embodiment, in the database of the service providing apparatus 100 , each of the options included in the question and a preset score are matched and stored in advance. The options included in the question may be matched with different scores.

The medical treatment matching unit 101 determines a score corresponding to each of the items based on a selection input for each of the items included in the questionnaire result, and adds the sum of scores corresponding to the items to the first treatment department corresponding to the first treatment department. 2 Determine the matching degree.

Through this, the medical treatment matching unit 101 may determine the second matching degree for each of the first medical departments.

Also, the medical treatment matching unit 101 determines the first medical department having the highest second matching degree as the second medical department (S127).

In addition, the medical treatment matching unit 101 searches the database of the service providing apparatus 100 to match the second medical department and store the doctors and their history information ( S128 ).

In an embodiment, the history information may include a waiting time corresponding to the doctor, a rating corresponding to the doctor, the number of times of telemedicine corresponding to the doctor, and the like. Also, the history information may include doctor information corresponding to the doctor. The doctor terminal 300 may provide a waiting time corresponding to the doctor at preset time intervals. The medical treatment matching unit 101 modifies the doctor's existing waiting time to the newly received waiting time and stores it in the database.

Referring back to FIG. 2 , the medical treatment matching unit 101 provides a list of searched doctors to the user terminal 200 ( S130 ).

In an embodiment, the medical treatment matching unit 101 may provide the user terminal 200 with history information about each of the doctors together with the list of doctors.

In an embodiment, the medical treatment matching unit 101 may provide the user terminal 200 with a list of doctors in the order of the shortest waiting time.

In an embodiment, the medical treatment matching unit 101 may provide the user terminal 200 with a list of doctors in order of highest rating.

In an embodiment, the medical treatment matching unit 101 may provide the user terminal 200 with a list of doctors in the order of the highest number of telemedicine.

In an embodiment, the medical treatment matching unit 101 may determine a recommendation degree corresponding to each of the searched doctors, and provide the user terminal 200 with a list in which the doctors are listed in order of the highest degree of recommendation.

In an embodiment, the recommendation degree may be determined by Equation 1 below.

[Equation 1]

R= K1/T + P/K2 + N/K3

In Equation 1 above, R denotes a recommendation degree, K1 denotes a first coefficient, and T denotes a waiting time. In addition, P means a rating, K2 means the second coefficient, N means the number of telemedicine, and K3 means the third coefficient.

The medical treatment matching unit 101 may determine the average value of waiting times corresponding to doctors matched with the same second medical department as K1.

The medical treatment matching unit 101 may determine an average value of ratings corresponding to doctors matched with the same second medical department as K2.

The medical treatment matching unit 101 may determine an average value of the number of telemedicine visits corresponding to doctors matched with the same second medical department as K3.

The medical treatment matching unit 101 receives the ranking for each of the waiting time, the rating, and the number of telemedicine from the user terminal 200, and based on the ranking for each of the waiting time, the rating, and the number of telemedicine, the first coefficient, the first The second coefficient and the third coefficient may be corrected. For example, if the rankings for waiting time, rating, and number of telemedicine are 1st, 2nd, and 3rd, multiply the first coefficient, second coefficient, and third coefficient by 1.2, 0.9, and 1 to obtain the first coefficient, the second coefficient, and the second coefficient. The second coefficient and the third coefficient may be corrected. For example, if the rankings for waiting time, rating, and number of telemedicine are 3rd, 2nd, and 1st, multiply the first coefficient, second coefficient, and third coefficient by 1, 0.9, and 1.2 to obtain the first coefficient, the second coefficient The second coefficient and the third coefficient may be corrected. For example, if the rankings for waiting time, rating, and number of telemedicine are 3rd, 2nd, and 1st, multiply the first coefficient, second coefficient, and third coefficient by 1, 0.9, and 1.2 to obtain the first coefficient, the second coefficient The second coefficient and the third coefficient may be corrected. For example, if the rankings for waiting time, rating, and number of telemedicine are 2nd, 1st, and 3rd, multiply the first coefficient, the second coefficient, and the third coefficient by 1.1, 0.8, and 1 to obtain the first coefficient, the second coefficient The second coefficient and the third coefficient may be corrected. The medical treatment matching unit 101 may correct the first coefficient by multiplying the first coefficient by a value relatively greater than 1 as the rank of the waiting time is relatively high. The medical treatment matching unit 101 may correct the second coefficient by multiplying the second coefficient by a value relatively smaller than 1 as the rank of the waiting time is relatively high. The medical treatment matching unit 101 may correct the third coefficient by multiplying the third coefficient by a value relatively smaller than 1 as the rank of the waiting time is relatively high.

Also, the medical treatment matching unit 101 receives a doctor selection input and a medical treatment waiting request from the user terminal 200 ( S140 ).

The user may check the list of doctors searched through the user terminal 200 and history information of each of the doctors. Also, the medical treatment matching unit 101 may provide a user interface for inputting a doctor selection input for any one of the doctors included in the list to the user terminal 200 .

Also, the medical treatment matching unit 101 transmits the patient information and the medical treatment waiting request to the doctor terminal 300 corresponding to the doctor selection input (S150).

In an embodiment, the patient information may include the user's age, name, gender, and the like. In an embodiment, the patient information may include a selection input for each of the questions included in the questionnaire provided to the user terminal 200 and the questionnaire received from the user terminal 200 .

Also, the treatment matching unit 101 receives a treatment acceptance input from the doctor terminal 300 ( S160 ).

When the medical treatment acceptance input is received, the call connection unit 102 transmits a call request to the user terminal 200 and the doctor terminal 300 ( S210 ).

In one embodiment, the call request may be a Voice over Internet Protocol (VoIP) phone.

Also, the call connection unit 102 establishes a channel to connect the user terminal 200 and the doctor terminal 300 over the VoIP phone (S220).

Also, the call connection unit 102 receives a channel information request from the user terminal 200 that has received the VoIP call (S230), and returns the channel information to the user terminal 200 (S240).

Also, the call connection unit 102 receives a channel information request from the doctor terminal 300 receiving the VoIP call (S250), and returns the channel information to the doctor terminal 300 (S260).

Through this, the user terminal 200 may transmit an image input through the input interface device of the user terminal 200 to the call connection unit 102 through a channel opened in the form of a digital packet.

In addition, the call connection unit 102 transmits the received digital packet to the pseudo terminal 300 through the established channel, and the pseudo terminal 300 converts the received digital packet into an image to output the pseudo terminal 300 . provided to the physician via an interface device.

Also, the doctor terminal 300 may transmit an image input through the input interface device of the doctor terminal 300 to the call connection unit 102 through a channel established in the form of a digital packet.

In addition, the call connection unit 102 transmits the received digital packet to the user terminal 200 through the established channel, and the user terminal 200 converts the received digital packet into an image to the user through an output interface device. to provide.

Also, the user terminal 200 and the pseudo terminal 300 may directly transmit/receive an image in the form of a digital packet through an established channel.

Since the call connection unit 102 makes a VoIP call to the user and the doctor and medical treatment is performed over the VoIP phone, the user and the doctor can perform medical treatment without exposing personal information such as phone number, email, and ID to each other.

4 is a flowchart illustrating another embodiment of a process in which the medical treatment matching unit 101 and the call connection unit 102 according to FIG. 2 connect a user and a doctor by wire.

In the illustrated embodiment, steps S110, S120, S130, S140, S150 and S160 are the same as steps S110, S120, S130, S140, S150 and S160 described above with reference to FIG. 3 . do.

When the medical treatment acceptance input is received, the call connection unit 102 establishes a channel for connecting the user terminal 200 and the doctor terminal 300 over the VoIP phone (S310).

In addition, the call connection unit 102 transmits a call request to the user terminal 200 and the doctor terminal 300 (S320).

In one embodiment, the call request may be a Voice over Internet Protocol (VoIP) phone. In an embodiment, the call connection unit 102 may transmit a call request to the user terminal 200 and the doctor terminal 300 using a call application programming interface (API).

Also, the call connection unit 102 receives a channel information request from the user terminal 200 that has received the VoIP call (S330), and returns the channel information to the user terminal 200 (S340).

Also, the call connection unit 102 receives a channel information request from the doctor terminal 300 receiving the VoIP call (S350), and returns the channel information to the doctor terminal 300 (S360).

Through this, the user terminal 200 may transmit an image input through the input interface device of the user terminal 200 to the call connection unit 102 through a channel opened in the form of a digital packet.

In addition, the call connection unit 102 transmits the received digital packet to the pseudo terminal 300 through the established channel, and the pseudo terminal 300 converts the received digital packet into an image to output the pseudo terminal 300 . provided to the physician via an interface device.

Also, the doctor terminal 300 may transmit an image input through the input interface device of the doctor terminal 300 to the call connection unit 102 through a channel established in the form of a digital packet.

In addition, the call connection unit 102 transmits the received digital packet to the user terminal 200 through the established channel, and the user terminal 200 converts the received digital packet into an image to the user through an output interface device. to provide.

Also, the user terminal 200 and the pseudo terminal 300 may directly transmit/receive an image in the form of a digital packet through an established channel.

Since the call connection unit 102 makes a VoIP call to the user and the doctor and medical treatment is performed over the VoIP phone, the user and the doctor can perform medical treatment without exposing personal information such as phone number, email, and ID to each other.

Referring back to FIG. 2 , the service providing apparatus 100 includes a medical treatment assistant 103 .

6 is a flowchart illustrating a process in which the medical treatment assistant 103 according to FIG. 2 provides an image of a medical treatment site to a user terminal.

The medical treatment assistant 103 receives a second input instructing a treatment site from the doctor terminal 300 (S410).

In one embodiment, the second input may be text or voice.

In one embodiment, when the second input is a voice, the medical care assistant 103 inputs the voice as an input value to a pre-trained STT (Speak To Text) model, and obtains a text corresponding to the voice from the STT model .

In addition, the medical treatment assistant 103 inputs the second input as an input value to the pre-trained machine learning model, and obtains a third matching degree corresponding to each of the preset treatment site images from the machine learning model.

In an embodiment, the machine learning model may receive text data corresponding to the second input as an input value, and output a third degree of matching between the text data and each treatment site image. In one embodiment, the machine learning model divides text data into morpheme units, generates vectors for a plurality of separated morphemes, and specifies a probability corresponding to each treatment site image based on the generated vector. can do. In an embodiment, the probability corresponding to each treatment site image means a third degree of matching corresponding to each treatment site image. In an embodiment, a Recurrent Neural Network (RNN), BERT, Random Forest, etc. may be used to train the machine learning model. However, the present invention is not limited thereto.

Also, the medical treatment assistant 103 provides the medical treatment site images with the third matching degree equal to or greater than the preset second reference matching level to the doctor terminal 300 .

Also, the medical treatment assistant 103 receives an image selection input for any one of the treatment site images from the doctor terminal 300 (S440).

In an embodiment, the medical treatment assistant 103 may provide the doctor terminal 300 with a user interface through which the doctor can check the provided treatment site images and input an image selection input for any one of the treatment site images. have.

Also, the medical treatment assistant 103 provides an image of a treatment site corresponding to the image selection input to the user terminal 200 (S450).

Through this, the user can recognize the medical site that the doctor wants to check, and provide an image of the recognized medical site to the call connection unit 102 .

7 is a flowchart illustrating a process in which the medical treatment assistant 103 according to FIG. 2 de-identifies or identifies the facial parts of the user in the image.

The call connection unit 102 receives a de-identification request and an image (S510).

Also, the medical treatment assistant 103 determines whether the voice included in the image matches the pre-stored voice of the user ( S520 ). In an embodiment, the medical treatment assistant 103 may determine whether the waveform of the voice included in the image matches the waveform of the user's voice previously stored in the database.

Also, when the voice included in the image matches the voice of the user stored in advance, the medical treatment assistant 103 de-identifies a plurality of preset facial parts in the image.

In an embodiment, the medical treatment assistant 103 may input a frame included in the image as an input value to the machine learning model, and may obtain information about the area occupied by the plurality of facial parts from the machine learning model.

In one embodiment, the machine learning model, when a frame is input as an input value, outputs an object box for an object (eg, eyes, nose, mouth) corresponding to facial parts included in the frame, and an object box When an image including an object included in the image is input as an input value, a Mask-rcnn (Mask region convolutional neural network) model that is machine-learned to output information about a region occupied by the object in the image may be included.

In one embodiment, the medical care assistant 103 de-identifies the areas occupied by the plurality of facial parts. Various known de-identification methods may be used for de-identification of regions occupied by a plurality of facial parts.

Also, the call connection unit 102 provides an image in which a plurality of preset facial parts are de-identified to the doctor terminal 300 ( S530 ).

Also, the medical treatment assistant 103 may receive a disclosure request for at least one of the plurality of facial parts from the doctor terminal 300 ( S540 ).

Also, the medical treatment assistant 103 may provide a request for disclosure of at least one of the plurality of facial parts to the user terminal 200 ( S550 ).

Also, the medical treatment assistant 103 may receive a disclosure request approval from the user terminal 200 .

When the disclosure request approval is received, the medical treatment assistant 103 performs identification processing on the area occupied by the facial parts corresponding to the disclosure request in the image provided to the doctor terminal 300 ( S560 ). Various well-known identification processing methods can be used for identification processing for the non-identified part.

Referring back to FIG. 2 , the service providing apparatus 100 includes a prescription providing unit 104 .

When telemedicine through the VoIP phone is terminated, the prescription providing unit 104 receives a prescription from the doctor terminal 300 and provides the received prescription to the user terminal 200 .

In an embodiment, the prescription providing unit 104 may provide a user interface for inputting a prescription to the doctor terminal 300 . Also, the prescription providing unit 104 may provide a user interface capable of displaying the received prescription to the user terminal 200 .

In addition, the service providing apparatus 100 includes a payment unit 105 .

The payment unit 105 receives a payment request from the doctor terminal 300 and provides the received payment request to the user terminal 200 .

Also, the payment unit 105 receives payment information from the user terminal 200 and provides the received payment information to a separate payment server (not shown).

In addition, the payment unit 105 may receive information including whether payment is approved from the payment server, and provide information including whether the received payment is approved or not to the user terminal 200 and the doctor terminal 300 . have.

FIG. 8 is a diagram exemplarily illustrating a hardware configuration of the service providing apparatus 100 according to FIG. 1 .

Referring to FIG. 8 , the service providing apparatus 100 stores at least one processor 110 and instructions for instructing the at least one processor 110 to perform at least one operation. It may include a memory (memory).

The at least one operation may include the components 101 to 105 of the above-described service providing apparatus 100 or other functions or operation methods.

Here, the at least one processor 110 may mean a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods according to embodiments of the present invention are performed. can Each of the memory 120 and the storage device 160 may be configured as at least one of a volatile storage medium and a non-volatile storage medium.

For example, the memory 120 may be one of a read only memory (ROM) and a random access memory (RAM), and the storage device 160 is a flash-memory. , a hard disk drive (HDD), a solid state drive (SSD), or various memory cards (eg, micro SD card).

Also, the device 100 may include a transceiver 130 that performs communication through a wireless network. Also, the device 100 may further include an input interface device 140 , an output interface device 150 , a storage device 160 , and the like. Each component included in the device 100 may be connected by a bus 170 to communicate with each other.

For example, the device 100 can communicate with a desktop computer (desktop computer), a laptop computer (laptop computer), a notebook (notebook), a smart phone (smart phone), a tablet PC (tablet PC), a mobile phone (mobile phone) , smart watch, smart glass, e-book reader, PMP (portable multimedia player), portable game console, navigation device, digital camera, DMB (digital multimedia broadcasting) player , a digital audio recorder, a digital audio player, a digital video recorder, a digital video player, a personal digital assistant (PDA), or the like.

The methods according to the present invention may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer readable medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software.

Examples of computer-readable media may include hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as at least one software module to perform the operations of the present invention, and vice versa.

In addition, the above-described method or apparatus may be implemented by combining all or part of its configuration or function, or may be implemented separately.

Although the above has been described with reference to preferred embodiments of the present invention, those skilled in the art can variously modify and change the present invention within the scope without departing from the spirit and scope of the present invention as set forth in the claims below. You will understand that it can be done.

Claims (5)

A device for providing telemedicine services, comprising:
receiving a medical treatment matching request from a user terminal of a user, providing a list in which a plurality of doctors are listed to the user terminal, receiving a doctor selection input for any one of the doctors from the user terminal, and a request waiting for treatment; a medical treatment matching unit that provides the medical treatment waiting request to a doctor terminal of a doctor corresponding to a doctor selection input and receives a treatment acceptance input from the doctor terminal; and
and a call connection unit configured to provide a call request to the user terminal and the doctor terminal when the treatment acceptance input is received, and to provide channel information for a call to the user terminal and the doctor terminal;
The treatment matching unit,
receive a first input for a symptom;
inputting the first input as an input value to a pre-trained first machine learning model, and obtaining a first matching degree corresponding to each of a plurality of departments from the first machine learning model,
determining the departments having the first matching degree equal to or greater than a preset first standard matching degree as first departments;
Searching for a plurality of questionnaires stored in advance matching the first departments in the database,
providing the questionnaires to the user terminal, and receiving questionnaire results corresponding to the questionnaires from the user terminal;
determining a second matching degree corresponding to each of the first medical departments based on the questionnaire results;
determining the first department having the highest degree of second matching as a second department;
retrieving the doctors and the history information of each of the doctors stored by matching with the second department in the database,
providing, to the user terminal, the list of the doctors stored in matching with the second department and the history information of each of the doctors,
Device. delete ◈Claim 3 was abandoned when paying the registration fee.◈ According to claim 1,
The history information includes waiting time, rating, and number of remote treatment,
The treatment matching unit,
determining a degree of recommendation corresponding to each of the doctors based on the waiting time, the rating, and the number of telemedicine,
The doctors provide the list listed in the order of the highest degree of recommendation to the user terminal,
Device. ◈Claim 4 was abandoned when paying the registration fee.◈ 4. The method of claim 3,
receiving a second input indicating a treatment site from the doctor terminal, inputting the second input as an input value to a pre-trained second machine learning model, and a plurality of pre-set images of treatment area from the second machine learning model obtains a third degree of matching corresponding to each of the Further comprising a medical assistant unit receiving an image selection input for one, and providing the image of the medical treatment site corresponding to the image selection input to the user terminal,
Device. 5. The method of claim 4,
The call connection unit,
Receive an image in the form of a digital packet from any one of the user terminal and the pseudo terminal,
providing the image to the other of the user terminal and the pseudo terminal,
The medical assistant department,
Receiving a de-identification request from the user terminal,
When the voice included in the image matches the voice stored in advance with the user terminal in the database, de-identifying a plurality of preset facial parts in the image,
Device.

Images