WO2024090835A1

WO2024090835A1 - Server, method, and system for providing virtual reality-based metered dose inhaler usage training service

Info

Publication number: WO2024090835A1
Application number: PCT/KR2023/015304
Authority: WO
Inventors: 이상학
Original assignee: 가톨릭대학교 산학협력단
Priority date: 2022-10-25
Filing date: 2023-10-05
Publication date: 2024-05-02
Also published as: KR20240057712A

Abstract

The present disclosure may be characterized by: displaying, on a virtual reality device, a UI related to the use of a metered dose inhaler; when selecting of the UI related to the use of the metered dose inhaler is completed, displaying a usage description UI through the virtual reality device; when selecting of the usage description UI is completed, describing instructions for using the metered dose inhaler through the virtual reality device; when describing of the instructions is completed, displaying a usage training UI through the virtual reality device; when selecting of the usage training UI is completed, displaying, through the virtual reality device, training content pre-set for each usage training process; receiving, from the virtual reality device, usage training information of a user according to the training content; determining whether a usage training level of the user satisfies a pre-set usage training condition on the basis of a result of analyzing the usage training information; and if the usage training level of the user does not satisfy the usage training condition, transmitting, to a terminal of the user, a result of analyzing usage training of the user.

Description

Server, method and system for providing virtual reality-based metered dose inhaler use training service

This disclosure relates to a server for providing training services for the use of metered dose inhalers. More specifically, the present disclosure relates to a server, method, and system for providing virtual reality-based metered dose inhaler use training services.

Drug inhalation treatment is a treatment method in which drugs are administered to the patient through a dedicated inhaler. The drug can be delivered directly to the place where it is needed most, maximizing its effectiveness and minimizing the drug's potential systemic side effects.

Inhalants used for drug inhalation treatment are divided into 'disease control agents', which continuously control symptoms such as breathing difficulties and prevent them from worsening, and 'symptom relievers', which are emergency drugs that expand narrowed airways in a short period of time, and are portable. It can be administered to the user by an asthma inhaler.

At this time, portable asthma inhalers can be divided into metered dose inhalers and dry powder inhalers depending on the inhalation container.

In particular, a metered-dose inhaler is an aerosol product in which a certain amount of inhalant is sprayed from a cartridge containing the drug in a sealed container such as an aluminum can using a propellant. Examples include Rapihaler, Ebohaler, and Respimat.

However, in drug inhalation treatment using a conventional metered-dose inhaler, it was difficult to collect objective data on the condition and environment in which the patient uses the metered-dose inhaler.

Therefore, after administering the drug, the patient had to rely on a form of medical treatment that involved consulting with a doctor and providing information about the condition and environment when using the metered-dose inhaler.

In addition, it was difficult to determine exactly how effectively the patient was using the metered dose inhaler, so it was difficult to provide separate instructions other than how to improve the effectiveness of use through medication guidance on how to use the metered dose inhaler. .

Therefore, recently, when a patient or a person interested in using a metered-dose respirator wants to use a metered-dose inhaler, a training service for the use of a metered-dose inhaler is offered, which provides an explanation of how to use the metered-dose inhaler and allows the user to determine whether the metered-dose inhaler is being used properly. Research is continuously being conducted.

The purpose of the embodiments disclosed in the present disclosure is to provide a method in which the use of a metered-dose inhaler can be shown and practiced once, and efficient training can be provided using a step-by-step follow function or a simultaneous follow function.

In addition, the purpose of the embodiments disclosed in the present disclosure is to provide a realistic educational environment that can increase immersion in inhalant education.

In addition, the embodiment disclosed in the present disclosure aims to provide immersion and practice intervention based on a program rather than actual personnel.

Additionally, the purpose of the embodiments disclosed in this disclosure is to provide a solution to the problem of training being impossible due to training time limitations or fatigue.

In addition, the embodiments disclosed in the present disclosure can improve the use of inhalants and compliance with drug use by increasing educational immersion, thereby enabling repeated education and practice, and providing an opportunity to improve proficiency in drug use. There is a purpose.

In addition, the embodiment disclosed in the present disclosure aims to reduce labor costs due to repeated training and provide continuous training.

The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below.

A server for providing a virtual reality-based metered dose inhaler use training service according to an aspect of the present disclosure for achieving the above-described technical problem includes: a communication unit that communicates with a virtual reality device and a user's terminal; and a processor that controls operations related to the provision of the virtual reality-based metered dose inhaler use training service, wherein the processor controls the virtual reality device to display a UI related to the use of the metered dose inhaler on the virtual reality device. When the selection of the UI related to the use of the metered dose inhaler is completed, control the virtual reality device to display a usage explanation UI through the virtual reality device, and when the selection of the usage explanation UI is completed, the virtual reality device Control the virtual reality device to explain how to use the metered dose inhaler, and when the explanation of how to use is completed, control the virtual reality device to display a usage training UI through the virtual reality device, and train the user. When the selection of the UI is completed, the virtual reality device is controlled to display preset training content for each usage training process through the virtual reality device, and the user's usage training information according to the training content is received from the virtual reality device. As a result of receiving and analyzing the usage training information, it is determined whether the user's usage training level satisfies the preset usage training conditions, and if the user's usage training level does not satisfy the usage training conditions, the user's usage training level is determined. It may be characterized in that the usage training analysis results are transmitted to the user's terminal.

In addition, the processor controls the virtual reality device to display a first usage training UI that follows step by step on how to use the metered-dose inhaler among the usage training UI, or how to use the metered-dose inhaler among the usage training UI. The virtual reality device may be controlled to display a second use training UI to be followed at the same time.

Additionally, the processor may control the virtual reality device to display training content corresponding to a training process for opening the lid of a metered-dose inhaler during the use training process.

Additionally, the processor may control the virtual reality device to display training content corresponding to a training process for shaking the metered dose inhaler during the use training process.

In addition, the processor may be characterized in that it controls the virtual reality device to display training content corresponding to the breathing training process of the metered dose inhaler during the use training process.

In addition, a method of providing a virtual reality-based metered dose inhaler use training service performed by a server according to another aspect of the present disclosure includes the steps of displaying a UI related to the use of a metered dose inhaler on a virtual reality device; When the selection of the UI related to the use of the metered dose inhaler is completed, displaying a usage explanation UI through the virtual reality device; When the selection of the usage explanation UI is completed, explaining how to use the metered dose inhaler through the virtual reality device; When the explanation of the usage is completed, displaying a usage training UI through the virtual reality device; When the selection of the usage training UI is completed, displaying preset training content for each usage training process through the virtual reality device; Receiving user usage training information according to the training content from the virtual reality device; As a result of analyzing the usage training information, determining whether the user's degree of usage training satisfies preset usage training conditions; and if the user's usage training level does not satisfy the usage training conditions, transmitting the user's usage training analysis result to the user's terminal; may include.

In addition, the usage training UI display step displays the method of using the metered dose inhaler to be followed step by step through the first usage training UI of the usage training UI, or through the second usage training UI of the usage training UI. , the method of using the metered-dose inhaler may be indicated so as to be followed at the same time.

Additionally, the training content display step may be characterized by displaying training content corresponding to a training process for opening the lid of a metered-dose inhaler during the use training process.

Additionally, the training content display step may be characterized by displaying training content corresponding to a training process for shaking the metered dose inhaler during the use training process.

In addition, the training content display step may be characterized by displaying training content corresponding to the breathing training process of the metered dose inhaler during the use training process.

In addition, a system for providing a training service for using a metered dose inhaler according to another aspect of the present disclosure includes a virtual reality device; user's terminal; and a server that communicates with the virtual reality device and the user's terminal, wherein the server controls the virtual reality device to display a UI related to the use of a metered-dose inhaler on the virtual reality device, and the metered-dose inhaler When the selection of the usage-related UI is completed, the virtual reality device is controlled to display a usage explanation UI through the virtual reality device, and when the selection of the usage explanation UI is completed, the metered-dose inhaler is displayed through the virtual reality device. Control the virtual reality device to explain how to use, and when the explanation of how to use is completed, control the virtual reality device to display a usage training UI through the virtual reality device, and selection of the usage training UI is completed. When doing so, the virtual reality device is controlled to display preset training content for each usage training course through the virtual reality device, the user's usage training information according to the training content is received from the virtual reality device, and the usage training is performed. As a result of analyzing the information, it is determined whether the user's usage training degree satisfies the preset usage training conditions, and if the user's usage training degree does not satisfy the usage training conditions, the user's usage training analysis result is determined. It may be characterized as being transmitted to the user's terminal.

In addition, the server controls the virtual reality device to display a first usage training UI that follows step by step on how to use the metered-dose inhaler among the usage training UI, or how to use the metered-dose inhaler among the usage training UI. The virtual reality device may be controlled to display a second use training UI to be followed at the same time.

Additionally, the server may control the virtual reality device to display training content corresponding to a training process for opening the lid of a metered dose inhaler during the use training process.

In addition, the server may control the virtual reality device to display training content corresponding to the shaking training process of the metered dose inhaler during the use training process.

In addition, the server may be characterized in that it controls the virtual reality device to display training content corresponding to the breathing training process of the metered dose inhaler during the use training process.

According to the means for solving the above-described problem of the present disclosure, it is possible to show and practice how to use a metered-dose inhaler once, and it provides the effect of enabling efficient education by using a step-by-step follow function or a simultaneous follow function.

In addition, according to the means for solving the above-described problem of the present disclosure, it provides the effect of creating a realistic educational environment to increase immersion in inhalant education.

In addition, according to the means for solving the above-described problem of the present disclosure, it is possible to provide the effect of immersion and practice intervention based on a program rather than actual personnel.

In addition, according to the above-described problem solving means of the present disclosure, it is possible to solve the problem of the inability to train due to limited training time or fatigue.

In addition, according to the means for solving the above-described problem of the present disclosure, it is possible to increase the use of inhalants and compliance with drug use by increasing immersion in education, thereby enabling repeated education and practice, and improving proficiency in drug use. provides.

In addition, according to the means for solving the above-described problem of the present disclosure, it provides the effect of reducing labor costs due to repeated training and enabling continuous training.

The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned may be clearly understood by those skilled in the art from the description below.

Figure 1 is a diagram showing a virtual reality-based metered dose inhaler use training service providing system of the present disclosure.

FIG. 2 shows the configuration of the virtual reality device of FIG. 1.

FIG. 3 shows the configuration of the display device of FIG. 2.

Figure 4 shows the configuration of the server of Figure 3.

Figures 5 to 7 are flow charts showing an example of a method of providing a virtual reality-based metered dose inhaler use training service performed by the server of Figure 1.

FIGS. 8 to 13 are diagrams showing an example of a process of training the use of a metered-dose inhaler using each UI displayed through the display device of FIGS. 2 and 3 and a metered-dose inhaler training device.

FIG. 14 is a diagram illustrating an example of a process of outputting usage training status judgment data for each type of training content according to input of usage training data for each type of training content based on the artificial intelligence model of the server of FIG. 1.

FIG. 15 is a diagram illustrating an example of a process for transmitting customized usage guidance according to the analysis results analyzed by the server of FIG. 1 to at least one of the user's terminal, the medical staff's terminal, an external server, and the guardian's terminal.

Like reference numerals refer to like elements throughout this disclosure. This disclosure does not describe all elements of the embodiments, and general content or overlapping content between embodiments in the technical field to which this disclosure pertains is omitted. The term 'part, module, member, block' used in the specification may be implemented as software or hardware, and depending on the embodiment, a plurality of 'part, module, member, block' may be implemented as a single component, or It is also possible for one 'part, module, member, or block' to include multiple components.

Throughout the specification, when a part is said to be “connected” to another part, this includes not only direct connection but also indirect connection, and indirect connection includes connection through a wireless communication network. do.

Additionally, when a part "includes" a certain component, this means that it may further include other components rather than excluding other components, unless specifically stated to the contrary.

Throughout the specification, when a member is said to be located “on” another member, this includes not only cases where a member is in contact with another member, but also cases where another member exists between the two members.

Terms such as first and second are used to distinguish one component from another component, and the components are not limited by the above-mentioned terms.

Singular expressions include plural expressions unless the context clearly makes an exception.

The identification code for each step is used for convenience of explanation. The identification code does not explain the order of each step, and each step may be performed differently from the specified order unless a specific order is clearly stated in the context. there is.

Hereinafter, the operating principle and embodiments of the present disclosure will be described with reference to the attached drawings.

In this specification, the virtual reality-based metered dose inhaler use training service provision system according to the present disclosure includes various devices that can perform computational processing and provide results to the user. For example, the virtual reality-based metered dose inhaler use training service provision system according to the present disclosure may include all of a computer, a server, and a portable terminal, or may take any one form.

Here, the computer may include, for example, a laptop equipped with a web browser, a desktop, a laptop, a tablet PC, a slate PC, etc.

A server processes information by communicating with an external device and may include an application server, computing server, database server, file server, mail server, proxy server, and web server.

Portable terminals are, for example, wireless communication devices that ensure portability and mobility, such as PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), and PDA ( Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminal, smart phone All types of handheld wireless communication devices, such as watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted-device (HMD), etc. It can be included.

The system for providing a virtual reality-based metered dose inhaler use training service according to the present disclosure controls the virtual reality device to display a UI related to the use of a metered dose inhaler on the virtual reality device, and when the selection of the UI related to the use of a metered dose inhaler is completed, The virtual reality device is controlled to display the usage instructions UI through the virtual reality device, and when the selection of the usage instructions UI is completed, the virtual reality device is controlled to explain how to use the metered dose inhaler through the virtual reality device, and the instructions for use are displayed. Once completed, the virtual reality device is controlled to display the usage training UI through the virtual reality device, and when the selection of the usage training UI is completed, the virtual reality device is controlled to display preset training content for each usage training course through the virtual reality device. control, receives the user's usage training information according to the training content from the virtual reality device, and as a result of analyzing the usage training information, determines whether the user's usage training level satisfies the preset usage training conditions, and performs the user's usage training If the degree does not meet the conditions of usage training, the user's usage training analysis result may be provided to be transmitted to the user's terminal.

This virtual reality-based metered-dose inhaler use training service provision system shows and practices how to use a metered-dose inhaler once, and efficient training can be provided using the step-by-step follow function or simultaneous follow function. A realistic educational environment can be created to increase educational immersion, immersion and practice intervention is possible based on programs rather than actual personnel, and problems of inability to train due to limited training time or fatigue can be solved. As immersion in education increases, use of inhalants can be promoted and compliance with medication use can be improved, allowing repetitive training and practice. Proficiency in using medications can be improved. Labor costs can be reduced through repeated training and continuous training can be possible. .

Below, we will look at the virtual reality-based metered dose inhaler use training service provision system in detail.

1 is a diagram illustrating a virtual reality-based metered dose inhaler use training service providing system of the present disclosure. FIG. 2 shows the configuration of the virtual reality device of FIG. 1.

FIG. 3 shows the configuration of the display device of FIG. 2. Figure 4 shows the configuration of the server of Figure 3.

Referring to FIGS. 1 to 4 , the virtual reality-based metered dose inhaler use training service providing system 100 may include a virtual reality device 110, a server 120, and a user terminal 130.

The virtual reality device 110 may include a virtual reality-based display device 111 and a metered dose inhaler training device 112. For example, virtual reality device 110 may be an Oculus VR device.

The display device 111 may display a UI 111a related to the use of a metered dose inhaler. The user may operate the metered dose inhaler training device 112 and select the UI 111a related to the use of the metered dose inhaler displayed through the display device 111.

The display device 111 may display the usage explanation UI 111b when the UI 111a related to the use of the metered dose inhaler is selected by manipulating the metered dose inhaler training device 112. The user may operate the metered dose inhaler training device 112 and select the usage explanation UI 111b displayed through the display device 111.

The display device 111 can explain how to use the metered dose inhaler when the usage explanation UI 111b is selected by manipulating the metered dose inhaler training device 112. The user can operate the metered dose inhaler training device 112 and watch and listen to the explanation on how to use the metered dose inhaler displayed on the display device 111.

The display device 111 may display the usage training UI 111c when the explanation of how to use the metered dose inhaler is completed by operating the metered dose inhaler training device 112. For example, the use training UI (111c) may include a first use training UI (111c-1) and a second use training UI (111c-2), and the display device 111 shows how to use the metered dose inhaler. The first use training UI (111c-1) may be displayed so that the user can follow the method of using the metered dose inhaler step by step, or the second use training UI (111c-2) may be displayed so that the user can follow the method of using the metered dose inhaler at the same time. The user may operate the metered dose inhaler training device 112 and select the usage training UI 111c displayed through the display device 111. For example, the user may operate the metered dose inhaler training device 112 to select the first use training UI 111c-1 or the second use training UI 111c-2 displayed through the display device 111. . The method of using a metered-dose inhaler may include a training course for opening the lid of the metered-dose inhaler, a shaking training course for the metered-dose inhaler, and a breathing training course for the metered-dose inhaler.

When the selection of the usage training UI 111c is completed by manipulating the metered dose inhaler training device 112, the display device 111 displays preset training content for each usage training process in order to analyze the user's metered dose inhaler usage training. can be displayed. The user may operate the metered dose inhaler training device 112 to train the user to use the metered dose inhaler according to the type of training content displayed through the display device 111.

For example, in order to analyze the user's training in using the metered-dose inhaler, the display device 111 may display first training content corresponding to a training process for opening the cap of the metered-dose inhaler during the training process. The user can operate the metered dose inhaler training device 112 to practice opening the cap of the metered dose inhaler displayed on the display device 111.

For another example, the display device 111 may display second training content corresponding to a training process for shaking the metered-dose inhaler during the use training process, in order to analyze the user's training in using the metered-dose inhaler. The user can operate the metered dose inhaler training device 112 to perform training by shaking the metered dose inhaler displayed on the display device 111.

As another example, the display device 111 may display third training content corresponding to the breathing training process of the metered dose inhaler during the use training process, in order to analyze the user's training in using the metered dose inhaler. The user can operate the metered dose inhaler training device 112 to perform breathing training for the metered dose inhaler displayed through the display device 111. At this time, the third training content may include mouth-holding training content, drug injection training content, breathing training content, breath-holding training content, and exhaling training content.

As shown in FIG. 4, the server 120 may include a communication unit 121, a memory 122, and a processor 123.

The communication unit 121 may communicate with the virtual reality device 110 and the user's terminal 130. The communication unit 121 includes at least one of the medical staff's terminal 140 related to the user's terminal 130, the external server 150 related to the user's terminal 130, and the guardian's terminal 160 related to the user's terminal 130. You can communicate with one. Here, the user's terminal 130 may be a terminal of a subject or a patient who has completed training in the use of a metered-dose inhaler, and the medical staff's terminal 140 may be a terminal of a subject or patient who has completed training in the use of a metered-dose inhaler. It may be a managing doctor's terminal, and the external server 150 may be a server for externally managing information on the status of the metered dose inhaler use training of a subject or patient who has completed training in the use of a metered dose inhaler. For example, the external server 150 may be at least one of a hospital server, a company server that studies the status of training for the use of metered dose inhalers, and a laboratory server. The guardian's terminal 160 may be a terminal that protects a subject or patient who has completed training in the use of a metered dose inhaler.

At this time, the communication unit 121 includes, in addition to the Wi-Fi module and the WiBro (Wireless broadband) module, GSM (global system for mobile communication), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), and UMTS (universal It may include a wireless communication module that supports various wireless communication methods such as mobile telecommunications system), Time Division Multiple Access (TDMA), Long Term Evolution (LTE), 4G, 5G, and 6G.

The memory 122 can store data for an algorithm for controlling the operation of components within the device or a program that reproduces the algorithm, and at least one device that performs the above-described operation using the data stored in the memory 122. It may be implemented with the processor 123. Here, the memory 122 and the processor 123 may each be implemented as separate chips. Additionally, the memory 122 and processor 123 may be implemented as a single chip.

The memory 122 can store data supporting various functions of the device and a program for the operation of the processor 123, can store input/output data, and can store a plurality of application programs running on the device. program or application), data and commands for operation of the device. At least some of these applications may be downloaded from an external server via wireless communication.

The memory 122 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), or a multimedia card micro type. micro type), card-type memory (e.g. SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), EEPROM (electrically erasable) It may include at least one type of storage medium among programmable read-only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. Additionally, the memory 122 is separate from the device, but may be a database connected wired or wirelessly.

The processor 123 may control operations related to the provision of a virtual reality-based metered dose inhaler use training service.

The processor 123 may control the virtual reality device 110 to display a UI 111a related to the use of a metered dose inhaler on the virtual reality device 110 . When the selection of the UI 111a related to the use of the metered dose inhaler is completed, the processor 123 may control the virtual reality device 110 to display the usage explanation UI 111b through the virtual reality device 110.

Once the selection of the usage explanation UI 111b is completed, the processor 123 may control the virtual reality device 110 to explain how to use the metered dose inhaler through the virtual reality device 100. When the explanation of usage is completed, the processor 123 may control the virtual reality device 110 to display the usage training UI 111c through the virtual reality device 110. For example, the processor 123 controls the virtual reality device 110 to display a first use training UI (111c-1) that follows step by step on how to use the metered dose inhaler among the use training UI (111c), or The virtual reality device 110 may be controlled to display a second usage training UI 111c-2 that simultaneously follows the usage training UI 111c on how to use the metered dose inhaler.

When the selection of the usage training UI 111c is completed, the processor 123 may control the virtual reality device 110 to display preset training content for each usage training process through the virtual reality device 110. For example, the processor 123 may control the virtual reality device 110 to display first training content corresponding to a training process for opening the lid of a metered-dose inhaler during a use training process. For another example, the processor 123 may control the virtual reality device 110 to display second training content corresponding to a training process for shaking a metered dose inhaler during a use training process. As another example, the processor 123 may control the virtual reality device 110 to display third training content corresponding to a breathing training process for a metered dose inhaler during a use training process.

The processor 123 receives the user's usage training information according to the training content from the virtual reality device 110, and as a result of analyzing the usage training information, determines whether the user's degree of usage training satisfies the preset usage training conditions. You can. If the user's usage training level does not satisfy the usage training conditions, the processor 123 may transmit the user's usage training analysis result to the user's terminal 130.

Figures 5 to 7 are flow charts showing an example of a method of providing a virtual reality-based metered dose inhaler use training service performed by the server of Figure 1. Figures 8 to 13 are diagrams showing an example of a process for training the use of a metered-dose inhaler using each UI displayed through the display device of Figure 3.

5 to 7, the virtual reality-based method of providing a training service for using a metered dose inhaler includes a use-related UI display step (S510), a use-related UI selection step (S520), a use description UI display step (S530), Usage explanation UI selection step (S540), usage explanation step (S550), usage training UI display step (S560), usage training UI selection step (S570), training content display step (S580), usage training information receiving step (S591) , may include a determination step (S592) and a transmission step (S93).

In the use-related UI display step, the metered-dose inhaler use-related UI 111a may be displayed on the virtual reality device 110 through the server 120 (S510). The display device 111 may display a UI 111a related to the use of a metered dose inhaler. For example, as shown in FIG. 8, the user may operate the metered dose inhaler training device 112 and select the UI 111a related to the use of the metered dose inhaler displayed through the display device 111 (S520).

In the usage explanation UI display step, when the selection of the UI 111a related to the use of the metered dose inhaler is completed through the server 120 (S520), the usage explanation UI 111b can be displayed through the virtual reality device 110. There is (S530). When the UI 111a related to the use of the metered dose inhaler is selected by manipulating the metered dose inhaler training device 112 (S520), the display device 111 may display the usage explanation UI 111b. For example, as shown in FIG. 9, the user may operate the metered dose inhaler training device 112 and select the usage explanation UI 111b displayed through the display device 111 (S540).

In the usage explanation step, when the selection of the usage explanation UI 111b is completed through the server 120 (S540), the usage of the metered dose inhaler can be explained through the virtual reality device 110 (S550). The display device 111 can explain how to use the metered dose inhaler when the selection of the usage explanation UI 111b is completed by manipulating the metered dose inhaler training device 112 (S540). For example, as shown in FIG. 10, a user can watch and listen to a description of how to use a metered-dose inhaler displayed through the display device 111.

In the usage training UI display step, when the explanation of usage is completed through the server 120 (S550), the usage training UI may be displayed through the virtual reality device 110 (S560). The display device 111 may display the usage training UI 111c when the explanation of how to use the metered dose inhaler is completed by operating the metered dose inhaler training device 112. For example, as shown in FIG. 9, the usage training UI 111c may include a first usage training UI 111c-1 and a second usage training UI 111c-2, and the display device 111 It may display the first use training UI (111c-1) to follow step by step how to use the metered dose inhaler, or it may display the second use training UI (111c-2) to follow simultaneously how to use the metered dose inhaler. there is. The user may operate the metered dose inhaler training device 112 and select the usage training UI 111c displayed through the display device 111 (S570). For example, the user may operate the metered dose inhaler training device 112 to select the first use training UI 111c-1 or the second use training UI 111c-2 displayed through the display device 111. .

In the training content display step, when the selection of the usage training UI is completed through the server 120 (S570), preset training content for each usage training process may be displayed through the virtual reality device 110 (S580). When the selection of the usage training UI 111c is completed by manipulating the metered dose inhaler training device 112, the display device 111 displays preset training content for each usage training process in order to analyze the user's metered dose inhaler usage training. can be displayed. The user may operate the metered dose inhaler training device 112 to train the user to use the metered dose inhaler according to the type of training content displayed through the display device 111.

For example, the training content display step may display, through the server 120, first training content corresponding to a training process for opening the cap of a metered-dose inhaler during the use training process. In order to analyze the user's training in using the metered-dose inhaler, the display device 111 may display first training content corresponding to a training process for opening the cap of the metered-dose inhaler during the training process. The user can operate the metered dose inhaler training device 112 to practice opening the cap of the metered dose inhaler displayed on the display device 111.

For another example, the training content display step may display, through the server 120, second training content corresponding to a training process for shaking the metered dose inhaler during the use training process. In order to analyze the user's training in using the metered dose inhaler, the display device 111 may display second training content corresponding to the training process for shaking the metered dose inhaler during the training process. The user can operate the metered dose inhaler training device 112 to perform training by shaking the metered dose inhaler displayed on the display device 111. For example, the user may perform the shaking exercise of the metered dose inhaler three or four times.

For another example, the training content display step may display, through the server 120, third training content corresponding to the breathing training process of the metered dose inhaler during the use training process. In order to analyze the user's training in using the metered dose inhaler, the display device 111 may display third training content corresponding to the breathing training process for the metered dose inhaler during the use training process. The user can operate the metered dose inhaler training device 112 to perform breathing training for the metered dose inhaler displayed through the display device 111. At this time, the third training content may include mouth-holding training content, drug spraying training content, breathing training content, breath-holding training content, and exhaling training content.

For example, as shown in Figure 11, through the breathing training content (C1), the user bites the inhalation port with both lips to prevent the drug from leaking out, and breathes in slowly and deeply while pressing hard on the thumb and middle finger. Marsh can conduct training. For another example, as shown in FIG. 12, the user can take his/her mouth off the metered dose inhaler and practice holding his/her breath for about 10 seconds through the breath holding training content (C2). For another example, as shown in FIG. 13, the user can train to exhale the breath he or she has been holding through the exhalation training content C3.

In the usage training information receiving step, the user's usage training information according to the training content may be received from the virtual reality device 110 through the server 120 (S591). In the determination step, as a result of analyzing the usage training information through the server 120, it may be determined whether the user's degree of usage training satisfies the preset usage training conditions (S592). As a result of analyzing the usage training information through an artificial intelligence model, the server 120 may determine whether the user's degree of usage training satisfies the preset usage training conditions.

Referring to FIG. 14, the server 140 stores the first usage training data (ID1), the second usage training data (ID1), and the third usage training data (ID3) received from the virtual reality device 110 as metadata. The input value is entered into the artificial intelligence model (AIM), and the first use training state judgment data (OD1), the second use training state judgment data (OD2), and the third determined by learning based on the artificial intelligence model (AIM) The result of the usage training status judgment data (OD3) can be output.

Here, the first use training status determination data OD1 may be data for determining whether the conditions for use training are satisfied or dissatisfied according to the input of the first use training data ID1. Additionally, the second use training status determination data OD2 may be data for determining whether the conditions for use training are satisfied or dissatisfied according to the input of the second use training data ID2. Additionally, the third use training status determination data OD3 may be data for determining whether the conditions for use training are satisfied or dissatisfied according to the input of the third use training data ID3.

An artificial intelligence model (AIM) may be built to learn through correlation the first training data (ID1), the second training data (ID1), and the third training data (ID3) included in the input data. The artificial intelligence model (AIM) is constructed and reinforced as a learning data set using the first training data (ID1), the second training data (ID1), and the third training data (ID3) using the CNN algorithm or RNN algorithm. You can do it.

Based on an artificial intelligence model (AIM), the server 120 generates first use training state determination data (OD1), second use training status judgment data (OD1), according to the input of first use training data, second use training data, and third use training data. Condition satisfaction data or condition dissatisfaction data of the use training state judgment data (OD2) and the third use training state judgment data (OD3) can be output.

At this time, if the first use training state determination data OD1 is in a condition unsatisfied state, the server 120 may output first condition unsatisfactory data corresponding to the degree of training deficiency of the first use training data. For example, when the user operates the metered-dose inhaler training device 112 and performs training to open the cap of the metered-dose inhaler displayed through the display device 111, the server 120 stores the lid in the image for a preset time. You can determine whether it exists or not. Here, the server 120 may output first condition satisfaction data if the lid in the image does not exist for a preset time, and may output first condition dissatisfaction data if the lid in the image does not exist for a preset time. . At this time, the degree of training deficiency of the first use training data may be calculated based on the lid removal time until the lid does not exist in the image.

Additionally, if the second usage training state determination data OD2 is in a condition unsatisfied state, the server 120 may output second condition unsatisfactory data including the degree of training deficiency of the second usage training data. For example, when the user operates the metered-dose inhaler training device 112 and performs training by shaking the metered-dose inhaler displayed through the display device 111, the server 120 determines the movement position of the metered-dose inhaler in the image. It can be determined whether the number of round-trip movements is the number of round-trip movements for each preset movement position. For example, the server 120 may determine whether the number of round trips for each movement position is 3 or 4 round trips at a preset movement position. Here, the server 120 may output second condition satisfaction data if the number of round trips for each movement position is a preset number of round trips for each movement position, and the number of round trips for each movement position is a preset number of round trips for each movement position. Otherwise, data that does not satisfy the second condition can be output. At this time, the degree of training deficiency of the second use training data can be calculated based on the number of round-trip movements for each movement position.

Additionally, if the third use training state determination data OD3 is in a condition unsatisfied state, the server 120 may output third condition unsatisfactory data including the degree of training deficiency of the third use training data. For example, when the user operates the metered dose inhaler training device 112 and performs breathing training for the metered dose inhaler displayed through the display device 111, the server 120 determines the lung movement position of the metered dose inhaler in the image. It can be determined whether it is a preset movement position for a preset time. Here, the server 120 may output data that satisfies the third condition if the lung movement position is a preset movement position for a preset time, and if the lung movement position is not a preset movement position for a preset time, the third condition is not satisfied. Data can be output. At this time, the degree of training deficiency of the third use training data can be calculated based on the lung movement position.

For example, when the user performs inhalation training during the metered dose inhaler breathing training, the server 120 displays the lung movement position (C1-1) corresponding to the inhalation training of the metered dose inhaler in the image. It can be determined whether it is a preset first movement position for a set time. For another example, when the user performs breath-holding training during breathing training for the metered-dose inhaler, the server 120 sets the lung movement position (C2-1) corresponding to the breath-holding training for the metered-dose inhaler in the image. It is possible to determine whether the current location has no movement for a period of time. For another example, when the user performs exhalation training during breathing training of the metered dose inhaler, the server 120 displays the lung movement position (C3-1) corresponding to the exhalation training of the metered dose inhaler in the image. It can be determined whether it is a preset second movement position for a set time.

Meanwhile, if the fourth usage training state determination data is in a condition unsatisfied state, the server 120 may output fourth condition unsatisfactory data including the degree of training deficiency of the fourth usage training data. For example, when the user operates the metered-dose inhaler training device 112 and performs training on holding the metered-dose inhaler displayed through the display device 111, the server 120 determines the location of the metered-dose inhaler in the image. You can determine whether it is in the preset mouth area. Here, the server 120 may output data that satisfies the fourth condition if the location of the metered-dose inhaler is within the preset mouth area, and may output data that satisfies the fourth condition if the location of the metered-dose inhaler is outside the preset mouth area. Data can be output. At this time, the degree of training deficiency of the fourth use training data can be calculated based on the distance between the location of the metered dose inhaler and the mouth area.

Meanwhile, if the fifth use training state determination data is in a condition unsatisfied state, the server 120 may output fifth condition unsatisfactory data including the degree of training deficiency of the fifth use training data. For example, when the user operates the metered dose inhaler training device 112 to perform drug injection training for the metered dose inhaler displayed through the display device 111, the server 120 determines the pressed position of the metered dose inhaler in the image. It can be determined whether the device is in the preset pressing area for the preset pressing time. Here, the server 120 may output the fifth condition satisfaction data if it is in the preset pressing area for a preset pressing time for the pressing position of the metered-dose inhaler, and the preset pressing time for the pressing position of the metered-dose inhaler. If at least one of the preset pressing areas is exceeded, data unsatisfied with the fifth condition can be output. At this time, the degree of training deficiency of the fifth use training data may be calculated based on at least one of the pressing time and pressing area of the metered-dose inhaler.

In the transmission step, if the user's usage training level does not satisfy the usage training conditions (S592), the user's usage training analysis result may be transmitted to the user's terminal 130 through the server 120 (S593). In addition, if the user's training level does not satisfy the usage training conditions, the server 120 sends the results of the user's usage training analysis to the medical staff's terminal 140, the external server 150, and the medical staff's terminal 140 related to the user's terminal 130. It may also be transmitted to at least one of the guardian's terminals 160. In addition, the server 120 may detect that the user's usage training level does not satisfy the usage training conditions, for example, when the user's usage training level is lower than the usage training conditions for determining a preset warning situation. , A warning situation can be notified through a notification unit such as a pop-up window, text message, SNS message, etc. in at least one of the user's terminal 130, the medical staff's terminal 140, the external server 150, and the guardian's terminal 160.

In this way, the server 120 provides accurate use training analysis results for each user regarding the training status of the metered dose inhaler among the user's terminal 130, the medical staff's terminal 140, the external server 150, and the guardian's terminal 160. Since at least one can be transmitted, it is possible to provide an accurate analysis service on the training status of metered dose inhaler use for each user.

Referring to FIG. 7, when the server 120 transmits the user's usage training analysis result to at least one of the user's terminal 130, the medical staff's terminal 140, the external server 150, and the guardian's terminal 160, Whether to transmit customized usage guide information can be requested from at least one of the user's terminal 130, the medical staff's terminal 140, the external server 150, and the guardian's terminal 160 (S594).

When a command to transmit customized usage guide information is requested from at least one of the user's terminal 130, the medical staff's terminal 140, the external server 150, and the guardian's terminal 160 (S595), the server 120 receives the customized information. The usage guide information can be transmitted to at least one of the user's terminal 130, the medical staff's terminal 140, the external server 150, and the guardian's terminal 160 (S596).

Referring to FIG. 15, the server 120 provides customized usage guide information to the user's terminal 130 and the medical staff to provide customized metered-dose inhaler use training according to the user's metered-dose inhaler use training analysis result information (SD1). It can be transmitted to at least one of the terminal 140, the external server 150, and the guardian's terminal 160. Here, the metered dose inhaler use training analysis result information (SD1) may be the result of the metered dose inhaler breathing training analysis. For example, the breathing training analysis result of a metered dose inhaler may be an inhalation training analysis result, a breath holding training analysis result, or an exhalation training analysis result.

At this time, if the inhalation training analysis result value, breath holding training analysis result value, or breath exhalation training analysis result value does not satisfy each preset standard value, the server 120 determines the training to be in a dissatisfied state, and responds accordingly. Customized usage guide information to provide customized training on the use of a metered dose inhaler can be transmitted to at least one of the user's terminal 130, the medical staff's terminal 140, the external server 150, and the guardian's terminal 160. Here, at least one of the user's terminal 130, the medical staff's terminal 140, and the guardian's terminal 160 may display each customized usage guide information on the screen. For example, at least one of the user's terminal 130, the medical staff's terminal 140, and the guardian's terminal 160 may display "1. Breathe in a little more, 2. Hold your breath a little more, 3. Breathe out a little more. "Each customized usage guide information can be displayed on the screen.

Meanwhile, the information on the training analysis results for the use of the metered-dose inhaler (SD1) includes the analysis results of the training for opening the cap of the metered-dose inhaler, the analysis result for the shaking training for the metered-dose inhaler, the analysis result for the mouth-holding training for the metered-dose inhaler, and the drug for the metered-dose inhaler. It may also include at least one of the injection training analysis results. At this time, the server 120 is the analysis result of opening the cap of the metered-dose inhaler, the shaking training analysis result of the metered-dose inhaler, the waiting-to-mouth training analysis result of the metered-dose inhaler, or the drug injection training analysis result of the metered-dose inhaler. If each of the preset standard values is not satisfied, the training is judged to be unsatisfactory, and in response to this, customized usage guidance information to provide customized training on the use of the metered dose inhaler is provided to the user's terminal 130 and the medical staff's terminal 140. ), an external server 150, or the guardian's terminal 160. Here, at least one of the user's terminal 130, the medical staff's terminal 140, and the guardian's terminal 160 may display customized usage guide information on the screen.

The external server 150 is a metered dose inhaler At least one of the use training analysis result information (SD1) and each customized use guide information can be received and converted into a database, and at least one of the researchers and medical staff can receive the databased metered dose inhaler use training analysis result information (SD1) and each At least one of the following: research on training in the use of metered-dose inhalers and improvement of convenience of use may be carried out using at least one of the customized usage guide information.

Meanwhile, a computer program stored in a computer-readable storage medium, when executed on one or more processors, performs the following operations for performing a method of providing a virtual reality-based metered dose inhaler use training service, the operations including: An operation of displaying a UI related to the use of a metered dose inhaler on the real device 110; When the selection of the UI 111a related to the use of the metered dose inhaler is completed, displaying the usage explanation UI 111b through the virtual reality device 110; When the selection of the usage explanation UI (111b) is completed, an operation of explaining how to use the metered dose inhaler through the virtual reality device (110); When the explanation of usage is completed, displaying the usage training UI (111c) through the virtual reality device (110); When the selection of the usage training UI 111c is completed, displaying preset training content for each usage training process through the virtual reality device 110; An operation of receiving user usage training information according to training content from the virtual reality device 110; An operation of determining whether the user's degree of usage training satisfies preset usage training conditions as a result of analyzing usage training information; and if the user's usage training level does not satisfy the usage training conditions, transmitting the user's usage training analysis result to the user's terminal 130; may include.

Here, the use training UI display operation displays the method of using the metered dose inhaler to be followed step by step through the first use training UI (111c-1) of the use training UI (111c), or the use training UI (111c) Through the second use training UI (111c-2), the method of using the metered dose inhaler can be displayed to be followed at the same time.

At this time, the training content display operation may display training content corresponding to the training process of opening the lid of the metered dose inhaler during the use training process, and display training content corresponding to the training process of shaking the metered dose inhaler during the use training process. During the use training process, training content corresponding to the breathing training process of the metered dose inhaler can be displayed.

Meanwhile, a computing device for providing a virtual reality-based metered dose inhaler use training service includes: a processor including one or more cores; and a memory storing instructions executable by the processor, wherein when the instructions are executed by the processor, the processor displays a virtual reality device 110 related to the metered dose inhaler use UI 111a. Controls the reality device 110, and when the selection of the UI 111a related to the use of the metered dose inhaler is completed, controls the virtual reality device 110 to display the usage explanation UI 111b through the virtual reality device 110. , When selection of the usage explanation UI 111b is completed, the virtual reality device 110 is controlled to explain how to use the metered dose inhaler through the virtual reality device 110, and when the explanation of usage is completed, the virtual reality device ( The virtual reality device 110 is controlled to display the usage training UI 111c through 110), and when the selection of the usage training UI 111c is completed, preset training for each usage training process is performed through the virtual reality device 110. The virtual reality device 110 is controlled to display content, the user's usage training information according to the training content is received from the virtual reality device 110, and as a result of analyzing the usage training information, the user's usage training level is preset. It is determined whether the conditions for use training are satisfied, and if the user's degree of use training does not satisfy the conditions for use training, the analysis result of the user's use training may be transmitted to the user's terminal 130.

Here, the processor controls the virtual reality device 110 to display a first use training UI (111c-1) that follows step by step on how to use the metered dose inhaler among the use training UI (111c), or a use training UI In (111c), the virtual reality device 110 may be controlled to display a second use training UI 111c-2 that simultaneously follows instructions on how to use the metered dose inhaler.

At this time, the processor may control the virtual reality device 110 to display training content corresponding to the training process for opening the cap of the metered dose inhaler during the use training process, and may correspond to the training process for shaking the metered dose inhaler during the use training process. The virtual reality device 110 may be controlled to display training content that corresponds to the breathing training process of the metered dose inhaler during the use training process.

Meanwhile, the present disclosure has been illustrated and explained as providing a virtual reality-based metered dose inhaler use training service using a virtual reality device, but is not limited thereto, and augmented reality-based metered dose inhaler use training is provided using an augmented reality device. Services may be provided, and mixed reality-based metered dose inhaler use training services may be provided using mixed reality devices.

At least one component may be added or deleted in response to the performance of the components shown in FIGS. 1 to 4. Additionally, it will be easily understood by those skilled in the art that the mutual positions of the components may be changed in response to the performance or structure of the system.

5 to 7 illustrate that a plurality of steps are sequentially executed, but this is merely an illustrative explanation of the technical idea of this embodiment, and those skilled in the art in the technical field to which this embodiment belongs will understand this embodiment. As long as it does not deviate from the essential characteristics of the example, various modifications and variations can be applied by changing the order shown in FIGS. 5 to 7 or executing one or more of the plurality of steps in parallel. Therefore, FIGS. 5 to 7 is not limited to time series order.

Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium that stores instructions executable by a computer. Instructions may be stored in the form of program code, and when executed by a processor, may create program modules to perform operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.

Computer-readable recording media include all types of recording media storing instructions that can be decoded by a computer. For example, there may be Read Only Memory (ROM), Random Access Memory (RAM), magnetic tape, magnetic disk, flash memory, optical data storage device, etc.

As described above, the disclosed embodiments have been described with reference to the attached drawings. A person skilled in the art to which this disclosure pertains will understand that the present disclosure may be practiced in forms different from the disclosed embodiments without changing the technical idea or essential features of the present disclosure. The disclosed embodiments are illustrative and should not be construed as limiting.

Claims

In a server for providing a virtual reality-based metered dose inhaler use training service,

a communication unit that communicates with a virtual reality device and a user's terminal; and

Comprising a processor that controls operations related to the provision of the virtual reality-based metered dose inhaler use training service,

The processor,

Controlling the virtual reality device to display a UI related to the use of a metered dose inhaler on the virtual reality device,

When the selection of the UI related to the use of the metered-dose inhaler is completed, controlling the virtual reality device to display a usage explanation UI through the virtual reality device,

When the selection of the usage explanation UI is completed, control the virtual reality device to explain how to use the metered dose inhaler through the virtual reality device,

When the explanation of how to use is completed, control the virtual reality device to display a usage training UI through the virtual reality device,

When the selection of the usage training UI is completed, controlling the virtual reality device to display preset training content for each usage training process through the virtual reality device,

Receive user usage training information according to the training content from the virtual reality device,

As a result of analyzing the usage training information, it is determined whether the user's degree of usage training satisfies the preset usage training conditions,

If the user's usage training level does not satisfy the usage training conditions, the server transmits the user's usage training analysis result to the user's terminal.
According to paragraph 1,

The processor,

Control the virtual reality device to display a first use training UI that follows step by step on how to use the metered dose inhaler among the use training UI,

Characterized in that the server controls the virtual reality device to display a second usage training UI that simultaneously follows the usage of the metered dose inhaler among the usage training UI.
According to paragraph 2,

The processor,

A server, characterized in that controlling the virtual reality device to display training content corresponding to a training process for opening the lid of a metered dose inhaler during the use training process.
According to paragraph 3,

The processor,

A server, characterized in that controlling the virtual reality device to display training content corresponding to the shaking training process of the metered dose inhaler during the use training process.
In number 4,

The processor,

Characterized in that the server controls the virtual reality device to display training content corresponding to the breathing training process of the metered dose inhaler during the use training process.
In a method of providing a virtual reality-based metered dose inhaler use training service performed by a server,

Displaying a UI related to the use of a metered dose inhaler on a virtual reality device;

When the selection of the UI related to the use of the metered dose inhaler is completed, displaying a usage explanation UI through the virtual reality device;

When the selection of the usage explanation UI is completed, explaining how to use the metered dose inhaler through the virtual reality device;

When the explanation of the usage is completed, displaying a usage training UI through the virtual reality device;

When the selection of the usage training UI is completed, displaying preset training content for each usage training process through the virtual reality device;

Receiving user usage training information according to the training content from the virtual reality device;

As a result of analyzing the usage training information, determining whether the user's degree of usage training satisfies preset usage training conditions; and

If the user's usage training level does not satisfy the usage training conditions, transmitting the user's usage training analysis result to the user's terminal; Method, including.
According to clause 6,

The usage training UI display step is,

Through the first usage training UI of the usage training UI, the method of using the metered dose inhaler is displayed to be followed step by step,

A method, characterized in that, through a second use training UI of the use training UI, instructions for using the metered dose inhaler are displayed to be followed at the same time.
In clause 7,

The training content display step is,

Characterized in that displaying training content corresponding to a training process for opening the lid of a metered dose inhaler during the use training process.
According to clause 8,

The training content display step is,

Characterized in that displaying training content corresponding to the shaking training process of the metered dose inhaler during the use training process.
According to clause 9,

The training content display step is,

Characterized in that displaying training content corresponding to the breathing training process of the metered dose inhaler during the use training process.
virtual reality devices;

user's terminal; and

Includes a server that communicates with the virtual reality device and the user's terminal,

The server is,

Controlling the virtual reality device to display a UI related to the use of a metered dose inhaler on the virtual reality device,

When the selection of the UI related to the use of the metered-dose inhaler is completed, controlling the virtual reality device to display a usage explanation UI through the virtual reality device,

When the selection of the usage explanation UI is completed, control the virtual reality device to explain how to use the metered dose inhaler through the virtual reality device,

When the explanation of how to use is completed, control the virtual reality device to display a usage training UI through the virtual reality device,

When the selection of the usage training UI is completed, controlling the virtual reality device to display preset training content for each usage training process through the virtual reality device,

Receive user usage training information according to the training content from the virtual reality device,

As a result of analyzing the usage training information, it is determined whether the user's degree of usage training satisfies the preset usage training conditions,

A system for providing a training service for the use of a metered-dose inhaler, characterized in that if the user's use training level does not meet the conditions for the use training, the analysis result of the user's use training is transmitted to the user's terminal.
According to clause 11,

The server is,

Control the virtual reality device to display a first use training UI that follows step by step on how to use the metered dose inhaler among the use training UI,

A system for providing a metered-dose inhaler use training service, characterized in that the virtual reality device is controlled to display a second use training UI that simultaneously follows the use of the metered-dose inhaler among the use training UIs.
According to clause 12,

The server is,

A system for providing a training service for the use of a metered dose inhaler, characterized in that controlling the virtual reality device to display training content corresponding to a training process for opening the lid of the metered dose inhaler during the use training process.
According to clause 13,

The server is,

A system for providing a training service for the use of a metered dose inhaler, characterized in that the virtual reality device is controlled to display training content corresponding to the shaking training process of the metered dose inhaler during the use training process.
In section 14,

The server is,

A system for providing a training service for the use of a metered dose inhaler, characterized in that controlling the virtual reality device to display training content corresponding to the breathing training process of the metered dose inhaler during the use training process.