KR20220019459A - System and method for providing medical tour service based on artificail intelligence - Google Patents

Abstract

Provided is a system for providing a medical tour service based on artificial intelligence, comprising: a user terminal receiving a user image and plastic surgery items from a user; and a platform server generating a predicted post-surgery image corresponding to the user image by using an artificial neural network, wherein the platform server incudes: an artificial intelligence analysis unit extracting a plurality of pre-surgery customer images similar to the user image among pre-surgery customer images corresponding to the plastic surgery items by using the artificial neural network performing machine learning based on pre-input learning data; a sample image extraction unit extracting a plurality of pre-surgery customer images and a post-surgery customer image corresponding to each pre-surgery customer image from a database; and an image synthesis unit generating the predicted post-surgery image based on selection information received from the user terminal and the user image. The present invention can enhance surgery reliability and accuracy.

Description

SYSTEM AND METHOD FOR PROVIDING MEDICAL TOUR SERVICE BASED ON ARTIFICAIL INTELLIGENCE

The present invention relates to a system and method for providing a medical tourism service, and more particularly, to a system and method for providing a medical tourism service based on artificial intelligence.

Recently, as the living environment has become more prosperous, the social interest in plastic surgery is greatly increasing, and in proportion to this social atmosphere, the technology related to virtual surgery is also making rapid development.

Conventionally, there is a problem that does not match the user image after the actual operation by deriving an image after plastic surgery by using the user selected from among the limited sample photos. That is, conventionally, there was a problem in that the reliability of the predicted image after molding was lowered due to simple synthesis using limited photos.

Accordingly, there is a need for a technique capable of improving surgical reliability and accuracy by generating a predictive image after plastic surgery using a face or body image most similar to a user using artificial intelligence.

The technical problem to be achieved by the present invention is to create an artificial intelligence-based medical tourism service providing system and to provide a way

According to one embodiment, a system for providing artificial intelligence-based medical tourism service is provided. The medical tourism service providing system includes a user terminal that receives a user image and a cosmetic surgery item from a user, and a platform server that generates an expected cosmetic surgery image corresponding to the user image using an artificial neural network, the platform server comprising: An artificial intelligence analysis unit that extracts a plurality of pre-surgery customer images similar to the user image from among the pre-surgery customer images corresponding to the plastic surgery items by using an artificial neural network that performs machine learning based on the learning data input in advance, a database A sample image extraction unit for extracting a plurality of customer images before cosmetic surgery and a customer image after molding corresponding to each customer image before cosmetic surgery, and the selection information received from the user terminal and the user image to generate the expected cosmetic image and an image synthesizing unit.

The user image includes the face image of the user, the plastic surgery item includes at least one of eyes, nose, and mouth, and the selection information includes a customer image after cosmetic surgery selected by the user from among the customer images after surgery, , the image synthesizing unit extracts a facial contour image from the user's face image, extracts an image of a portion corresponding to the cosmetic surgery item from the customer image after the user selected cosmetic surgery, the facial contour image and the plastic surgery You can merge the images of the parts corresponding to the items.

The user image includes a face image of the user, the plastic surgery item includes at least one of a forehead, a cheekbone, and a chin, and the selection information includes a customer image after surgery selected by the user from among the customer images after surgery, , the image synthesizing unit extracts an image of eyes, nose and mouth parts from the user's face image, extracts a facial contour image from the customer image after the user's selected cosmetic surgery, and the image of the eyes, nose and mouth parts and The face contour images may be merged.

The platform server may further include a doctor connection unit that transmits the user image, plastic surgery items, and surgery prediction image to the attending physician terminal when receiving a connection request message from the user terminal.

According to one embodiment, there is provided a method of providing an AI-based medical tourism service. The method of providing the medical tourism service comprises the steps of: a user terminal receiving a user image and a cosmetic surgery item from a user; and a platform server generating a cosmetic surgery prediction image corresponding to the user image using an artificial neural network, In the step of generating the plastic surgery prediction image, using an artificial neural network that performs machine learning based on the learning data input in advance, a customer image before plastic surgery similar to the user image among the customer images before plastic surgery corresponding to the plastic surgery item is selected. Extracting a plurality of images, extracting a plurality of pre-surgery customer images and a post-surgery customer image corresponding to each pre-surgery customer image from a database, and predicting the cosmetic surgery based on selection information received from the user terminal and the user image It may include generating an image.

By using artificial intelligence to generate a predictive image after plastic surgery using the image most similar to the user, it is possible to improve surgical reliability and accuracy.

By using artificial intelligence to provide a 24-hour response to a user's text or voice query, user satisfaction can be improved.

1 is a block diagram of a system for providing a medical tourism service according to an embodiment.
2 is a block diagram of a platform server of a system for providing medical tourism services according to an embodiment.
3 to 5 and 6 are diagrams for explaining an image synthesizing unit of a system for providing a medical tourism service according to an exemplary embodiment.
7 and 8 are diagrams for explaining an image correction unit of a system for providing a medical tourism service according to an exemplary embodiment.
9 and 10 are flowcharts of a method of providing a medical tourism service according to an exemplary embodiment.
11 is a block diagram of a platform server of a system for providing medical tourism services according to an embodiment.

Hereinafter, with reference to the accompanying drawings, the embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part "includes" a certain element, it means that other elements may be further included, rather than excluding other elements, unless otherwise stated.

1 is a block diagram of a system for providing a medical tourism service according to an embodiment. 2 is a block diagram of a platform server of a system for providing medical tourism services according to an embodiment. 3 to 5 and 6 are diagrams for explaining an image synthesizing unit of a system for providing a medical tourism service according to an exemplary embodiment. 7 and 8 are diagrams for explaining an image correction unit of a system for providing a medical tourism service according to an exemplary embodiment.

Referring to FIG. 1 , a medical tourism service providing system according to an embodiment includes a user terminal 100 , a platform server 200 , a doctor's terminal 300 , a transportation product providing server 400 , and an accommodation product providing server 500 . , a tourist destination product providing server 600 , a medical expense providing server 700 , an online medical service providing server 800 , and an online question and answer providing server 900 .

The user terminal 100 receives a user image and a cosmetic surgery item from a user through an app or a web.

The user image may include, as an example, a face and/or body image of the user. The user image is an embodiment, and may include front, left, right, and back images of the user's face or body. The user image is an embodiment, and may include a 3D scan image or video data of the user's face or body. The user image, as an embodiment, may include numerically expressed face composition ratio information.

Plastic surgery items are, in one embodiment, facial items (eg, eyes, nose, mouth, forehead, contour, lifting, etc.), body items (eg, chest, abdomen, arms, buttocks, thighs, calves, etc.), hair items ( Yes, including crown transplantation, hairline, etc.), semi-permanent items (e.g., eyebrows, eyeliner, hairline, wrinkles, acne, whitening pigment, scars, etc.), dental items (e.g. plastic surgery, whitening, orthodontics, prosthetics, etc.) can do.

The user terminal 100 is an embodiment, and includes a memory means such as a mobile communication terminal, a desktop computer, a notebook computer, a workstation, a palmtop computer, a personal digital assistant (PDA), a web pad, etc. And it may be a digital device equipped with a microprocessor and equipped with computing power.

The platform server 200 uses an artificial neural network to generate an expected cosmetic image corresponding to the user image.

Referring to FIG. 2 , the platform server 200 as an embodiment is a communication unit 210 , an artificial intelligence analysis unit 220 , a sample image extraction unit 230 , an image synthesis unit 240 , and a doctor connection unit 250 . , an image correction unit 260 , a payment management unit 270 , a product management unit 280 , and a database 290 .

The communication unit 210 may receive a user image and a cosmetic surgery item from the user terminal 100 .

The artificial intelligence analysis unit 220 uses an artificial neural network that performs machine learning based on the learning data input in advance, and extracts a plurality of pre-surgery customer images similar to the user image among the pre-surgery customer images corresponding to the plastic surgery items. .

The training data may include a customer image before cosmetic surgery and a customer image after cosmetic surgery corresponding to the customer image before cosmetic surgery.

As an embodiment, the artificial intelligence analysis unit 220 uses an artificial neural network that performs machine learning based on pre-input learning data, and a response text corresponding to a query text received from the user terminal 100 . Alternatively, voice data may be extracted. The communication unit 210 may transmit response text or response voice data corresponding to the extracted query text to the user terminal 100 . Through this, it is possible to respond in real-time in the form of text or voice to a user's query that is difficult to respond to for 24 hours.

The sample image extraction unit 230 may extract a plurality of customer images before cosmetic surgery and a customer image after molding corresponding to each customer image before molding from the database 290 .

The sample image extraction unit 230 converts the plurality of pre-surgery customer images extracted by the artificial intelligence analysis unit 220 and the customer images after cosmetic surgery corresponding to each pre-surgery customer image into a table form to transmit to the user terminal 100 . can In this case, the user may select one post-surgery customer image by referring to information in the form of a table including a customer image before molding and a customer image after molding through the user terminal 100 . The user terminal 100 may transmit the user image and selection information including the customer image after cosmetic surgery input by the user to the image synthesizing unit 240 .

The image synthesizing unit 240 may generate a shaping prediction image based on the selection information and the user image received from the user terminal 100 .

Referring to FIG. 3 , as an embodiment, the user image includes a face image of the user, the plastic surgery item includes at least one of eyes, nose, and mouth, and the selection information includes the cosmetic surgery selected by the user from among the customer images after plastic surgery. After the customer image may be included, the image synthesizing unit 240 extracts a facial contour image 3a from the user's face image, and an image 3b of a region corresponding to a cosmetic surgery item in the customer image after plastic surgery selected by the user ), and the facial contour image 3a and the image 3b of the area corresponding to the plastic surgery item may be merged.

The image synthesizing unit 240 uses a pre-stored morphing algorithm to merge the facial contour image 3a and the image 3b of the region corresponding to the plastic surgery item, thereby generating the cosmetic surgery prediction image 3c. can do.

Referring to FIG. 4 , as an embodiment, the user image includes a face image of the user, the cosmetic surgery item includes at least one of a forehead, a cheekbone, and a chin, and the selection information includes a cosmetic surgery selected by the user from among the customer images after plastic surgery. After including the customer image, the image synthesizing unit 240 extracts the image 4a of the eyes, nose and mouth from the user's face image, and extracts the facial contour image 4b from the customer image after the user's selection after plastic surgery In addition, images of the eyes, nose, and mouth and facial contour images can be merged.

The image synthesizing unit 240 uses a pre-stored morphing algorithm to merge the images 4a of the eyes, nose, and mouth and the facial contour image 4b to generate the expected cosmetic image 4c. can

In one embodiment, the communication unit 210 may receive the user image after molding from the user terminal 100, and the artificial intelligence analysis unit 220 is an artificial neural network that performs machine learning based on the learning data input in advance. Using this, it is possible to calculate a similarity score between the user image and the image synthesizing unit 240 after cosmetic surgery and the predicted image generated by the image synthesizing unit 240 . Through this, medical consumers can objectively evaluate a procedure or surgery, and quantify the accuracy of a plastic surgery prediction image.

Referring to FIG. 5 , as an embodiment, the user image includes a face image of the user, the plastic surgery item includes at least one of eyes, nose, and mouth, and at least one of a forehead, cheekbones, and chin, and the selection information is Among the customer images after plastic surgery, the image synthesizing unit 240 includes images of the eyes, nose, and mouth extracted from the user's face image, and the eyes and nose extracted from the customer image after cosmetic surgery selected by the user. And it is possible to change the width, length, and height to correspond to the image of the mouth, respectively, and merge it with the facial contour image extracted from the customer image after the user has selected the plastic surgery.

As an embodiment, the user image includes a user's body image, the plastic surgery item includes a body skeleton or body fat item, the selection information includes a customer image after plastic surgery selected by the user from among the customer images after plastic surgery, and image synthesis The unit 240 may merge the customer image after the user's selection by adjusting the size to fit the user's body proportions.

As an embodiment, the image synthesizing unit 240 uses a facial contour image extracted from a customer image after cosmetic surgery in relation to a facial contour image when merging a user image and a customer image selected by the user after cosmetic surgery, and the eye, which is a face component , nose, mouth, eyebrows, cheeks, cheekbones, eyelids, forehead, and eye protrusions, the average value of the user image and the customer image after the user's selection of the plastic surgery can be used.

The image synthesizing unit 240 may transmit the cosmetic surgery prediction image and the doctor's list to the user terminal 100 after generating the cosmetic surgery prediction image. In this case, the user may select a primary care physician through the user terminal 100 .

Referring to FIG. 6 , the user image includes a face image of the user, the cosmetic surgery item includes at least one of eyes, nose, and mouth, and at least one of a forehead, cheekbones, and chin, and the selection information is specific to the customer after plastic surgery. The image synthesizing unit 240 includes the image of the customer's specific face after the user selected from among the images of the face, and the image synthesizing unit 240 uses the image 5a of the eyes and nose extracted from the image of the customer's specific face after the user selected cosmetic surgery. By changing the width, length, and height to correspond to the images of the eyes and nose, respectively, the merged image 5b can be created by synthesizing the facial contour image extracted from the customer image after the user selected cosmetic surgery.

Referring to FIG. 7 , the user image includes a user's face image, the plastic surgery item includes at least one of a forehead, a cheekbone, and a chin, the selection information includes a celebrity image selected by the user, and the image synthesis unit 240 ) uses a facial contour image extracted from a celebrity image selected by the user in relation to the facial contour image, and uses the user image in relation to the face components, such as eyes, nose, mouth, eyebrows, cheeks, cheekbones, eyelids, forehead, and eye protrusions. By using the average value of the feature image extracted from the feature image extracted from and the feature image extracted from the celebrity image selected by the user, it is possible to generate an expected cosmetic surgery image.

When receiving a doctor connection request message from the user terminal 100 , the attending physician connection unit 250 may transmit a user image, a plastic surgery item, and a cosmetic surgery prediction image to the attending physician terminal 300 . In this case, the attending physician may transmit a connection acceptance message to the attending physician connection unit 250 through the attending physician terminal 300 . When receiving the connection acceptance message from the attending physician terminal 300 , the attending physician connection unit 250 may release the restriction on access to the database 290 for the attending physician terminal 300 . Through this, the attending physician can inquire the result data of the user.

The image correction unit 260 may correct the expected cosmetic image based on the image correction information received from the user terminal 100 . The image correction information is an embodiment, and includes correction information about the width, length, height, and position of eyes, nose, mouth, chin, cheekbones, forehead, and body parts in the user image (photo or 3D modeling data). can do.

The medical expense providing server 700 calculates medical expense information corresponding to the medical treatment item selected by the user from the user terminal 100 , stores it in the database 290 , and stores the calculated medical expense information in the user terminal 100 or the doctor's terminal 300 . ) is provided to

The online question and answer providing server 900 provides the platform server 200 with response text or response voice data corresponding to the question text received from the user terminal 100 .

Referring to FIG. 8 , the image corrector 260 may correct the expected cosmetic surgery image based on makeup request information received from the user terminal 100 . As an embodiment, the makeup request information may include makeup information for each face component.

When receiving the user connection acceptance message from the doctor's terminal 300 , the payment management unit 270 may deduct a preset amount from the prepaid doctor's point account.

As an embodiment, when receiving a user connection acceptance message from the attending physician terminal 300 , the payment management unit 270 may transmit a message requesting selection of a connection method to the user terminal 100 . The connection method is an embodiment, and may include a method of directly connecting through an app or web, and a method of connecting indirectly through providing a business name and phone number.

As an embodiment, the payment management unit 270 may store and manage payment amount information for medical products or medical services paid by a user through an online payment method (eg, credit card, account transfer, PayPal, etc.).

When receiving the user connection acceptance message from the doctor's terminal 300 , the product manager 280 may transmit at least one of traffic information, accommodation information, tourist destination information, and online medical service information to the user terminal 100 . As an embodiment, the product management unit 280 includes traffic information, lodging information, It is possible to receive tourist information and online medical service information (eg, including medical treatment or surgery information) in real time.

As an embodiment, the product management unit 280 transmits at least one of traffic information, lodging information, tourist destination information, and online medical service information to the user terminal 100, a prepaid transportation product providing server point account, accommodation products A preset amount may be deducted from the point account of the server receiving the corresponding information among the providing server point account, the tourist destination product providing server point account, and the online medical service providing server point account.

The database 290 is one embodiment, and the customer image before plastic surgery and the customer image after plastic surgery corresponding to the customer image before each surgery, the user's result data, the plastic surgery expected image, hospital information, medical staff information, procedure or surgery information, surgery cost Information, event and promotion information, consultation or treatment history, additional product information, and payment information may be stored.

The doctor's terminal 300 is an embodiment, and includes a memory means such as a mobile communication terminal, a desktop computer, a notebook computer, a workstation, a palmtop computer, a personal digital assistant (PDA), a web pad, etc. And it may be a digital device equipped with a microprocessor and equipped with computing power.

9 and 10 are flowcharts of a method of providing a medical tourism service according to an exemplary embodiment.

9 and 10 , the method of providing a medical tourism service according to an embodiment includes a step (S100) of the user terminal 100 receiving a user image including a face and body and a cosmetic surgery item from a user (S100), and a platform The server 200 includes a step (S200) of generating a prediction image corresponding to the user image by using an artificial neural network.

In the step (S200) of generating a plastic surgery prediction image, using an artificial neural network that performs machine learning based on pre-entered learning data, a customer image before plastic surgery similar to the user image among the customer images before plastic surgery corresponding to the cosmetic surgery item is selected. A step of extracting a plurality (S210), a step of extracting a plurality of customer images before molding from the database 290 and a customer image after molding corresponding to each customer image before molding (S220), selection information received from the user terminal 100 And generating a cosmetic surgery image based on the user image (S230), when receiving a connection request message from the primary care physician from the user terminal 100, sending the user image, cosmetic surgery items, and the cosmetic surgery prediction image to the attending physician terminal 300 It may include a step (S240) of.

Steps S100 to S240 are the same as the operation contents of the medical tourism service providing system described above, and thus a detailed description thereof will be omitted.

11 is a block diagram of a platform server of a system for providing medical tourism services according to an embodiment.

Referring to FIG. 11 , the platform server according to an embodiment may be implemented as a computer system, for example, a computer-readable medium. The computer system 1000 includes at least one of a processor 1010 , a memory 1030 , a user interface input device 1060 , a user interface output device 1070 , and a storage device 1080 in communication via a bus 1020 . may include Computer system 1000 may also include a network interface 1090 coupled to a network. The processor 1010 may be a central processing unit (CPU) or a semiconductor device that executes instructions stored in the memory 1030 or the storage device 1080 . The memory 1030 and the storage device 1080 may include various types of volatile or nonvolatile storage media. For example, the memory 1030 may include a read only memory (ROM) 1031 and a random access memory (RAM) 1032 . Embodiments of the present disclosure may be implemented as a computer-implemented method, or may be implemented as a non-transitory computer-readable medium having computer-executable instructions stored therein. In one embodiment, when executed by a processor, the computer readable instructions may perform a method according to at least one aspect of the present disclosure.

The server according to an embodiment includes a processor 1010 and a memory 1030, and the processor 1010 executes a program stored in the memory 1030, so that the user terminal 100 includes a face and a body from the user. A step of receiving a user image and a cosmetic surgery item, and a step of the platform server 200 generating an expected cosmetic surgery image corresponding to the user image using an artificial neural network may be performed.

The step of generating the plastic surgery prediction image is to extract a plurality of customer images before plastic surgery similar to the user image among the customer images before plastic surgery corresponding to the cosmetic surgery items by using an artificial neural network that performs machine learning based on the learning data input in advance. Step, extracting a plurality of pre-surgery customer images and post-surgery customer images corresponding to each pre-surgery customer image from the database 290, based on the selection information received from the user terminal 100 and the user image generating, when receiving a doctor connection request message from the user terminal 100 , transmitting a user image, a cosmetic surgery item, and a cosmetic surgery prediction image to the doctor terminal 300 .

Since the operation contents of the processor 1010 are the same as the operation contents of the platform server 200 described above, a detailed description thereof will be omitted.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto. is within the scope of the right.

Claims (5)

As a system that provides artificial intelligence-based medical tourism services,
A user terminal that receives a user image and a cosmetic surgery item from a user, and
Using an artificial neural network, comprising a platform server that generates a prediction image corresponding to the user image,
The platform server,
An artificial intelligence analysis unit that extracts a plurality of pre-surgery customer images similar to the user image from among the pre-surgery customer images corresponding to the plastic surgery items by using an artificial neural network that performs machine learning based on previously inputted learning data;
A sample image extraction unit for extracting a plurality of pre-surgery customer images and a post-molding customer image corresponding to each pre-surgery customer image from the database, and
A medical tourism service providing system comprising an image synthesizing unit for generating the cosmetic surgery prediction image based on the user image and the selection information received from the user terminal. In claim 1,
The user image includes a face image of the user,
The cosmetic surgery item includes at least one of an eye, a nose, and a mouth,
The selection information includes a customer image after molding selected by the user from among the customer images after molding,
The image synthesizing unit,
extracting a facial contour image from the user's face image, extracting an image of a portion corresponding to the cosmetic surgery item from the customer image after the user selected cosmetic surgery, A medical tourism service provision system that merges images. In claim 1,
The user image includes a face image of the user,
The cosmetic surgery item includes at least one of a forehead, a cheekbone, and a chin,
The selection information includes a customer image after molding selected by the user from among the customer images after molding,
The image synthesizing unit,
Extracting images of eyes, nose, and mouth from the user's face image, extracting a facial contour image from a customer image after the user's selected cosmetic surgery, and merging the image of the eyes, nose and mouth and the face contour image A system for providing medical tourism services. In claim 1,
The platform server,
When receiving a connection request message from the primary care physician from the user terminal, the medical tourism service providing system further comprising a doctor connection unit for transmitting the user image, plastic surgery items, and a cosmetic surgery prediction image to the doctor terminal. As a method of providing artificial intelligence-based medical tourism service,
The user terminal receiving the user image and cosmetic surgery items from the user, and
Including, by the platform server, generating an expected cosmetic image corresponding to the user image using an artificial neural network,
The step of generating the molding prediction image is,
Extracting a plurality of pre-surgery customer images similar to the user image among the pre-surgery customer images corresponding to the plastic surgery items by using an artificial neural network that performs machine learning based on the pre-input learning data;
extracting a plurality of pre-surgery customer images and post-molding customer images corresponding to each pre-surgery customer image from the database; and
and generating the cosmetic surgery prediction image based on the user image and selection information received from the user terminal.

Images