KR20220119557A - Method of providing physical condition monitoring service - Google Patents

Abstract

In a method for providing a physical condition monitoring service using a terminal and a server communicating with the terminal, the present invention relates to the method for providing the physical condition monitoring service comprising: a photographing guide information transmission step of transmitting, by the photographing guide information, from the server to the terminal; and a photograph transmission step of transmitting a photograph file photographed through the terminal to the server. Therefore, the present invention is capable of having an effect of providing a correction result as a numerical value.

Description

Method of providing physical condition monitoring service

The present invention relates to a method for providing a physical condition monitoring service.

When there is a skeletal imbalance in the body, the tensile, compressive, and torsional stresses are concentrated in a specific area, resulting in chronic pain or tooth malocclusion, snoring, sleep apnea, rhinitis, facial asymmetry, straight neck turtle neck syndrome, spine Various diseases such as disc and strabismus can occur.

To this end, various treatments are being performed in dentistry and orthopedic surgery, which are medical institutions related to the skeleton, and massage and body correction services are also provided in various non-medical institutions. have.

However, since it takes a considerable amount of time (about 6 months to 3 years) to completely correct the body imbalance so that the body imbalance is resolved, it is difficult for the user to immediately recognize the correction effect.

To this end, conventionally, a method has been used in which a service provider periodically photographs a body with a camera, stores it in a computer, and provides the picture to users (patients, service beneficiaries) and other medical institutions whenever necessary.

In this method, data management is cumbersome from the service provider's point of view, and from the user's point of view, it is difficult to immediately monitor the process of changing one's physical condition whenever necessary.

Accordingly, there is a need for a service that allows a user to simply photograph the user's physical condition using a mobile device, analyze the physical condition through the photographed picture, and convert it into information, and inquire about the analyzed information and photos in real time.

The present invention has been devised to solve the above-described problems in the prior art, and has an object of accurately photographing a user's body state using a mobile device.

In addition, an object of the present invention is to provide a correction result as a numerical value by analyzing a photographed photograph.

Another object of the present invention is to enable real-time monitoring of the cumulative process of correcting body imbalance.

In addition, the present invention not only intermittently observes his or her body change state when the user's body uncomfortable symptoms or improved symptoms appear, but also time The purpose of this study is to more accurately identify the onset time and cause of disease by collecting physical data on a regular basis according to the flow of the disease.

In addition, the invention aims to devise a treatment method by inferring the time of occurrence of a cause when a disease occurs by collecting the growth direction and events and accidents during growth by applying the invention to a growing user.

According to an embodiment of the present invention, there is provided a method for providing a physical condition monitoring service using a terminal and a server communicating with the terminal, the method comprising: transmitting photographing guide information in which photographing guide information is transmitted from the server to the terminal; and a photo transmission step of transmitting a photo file taken through the terminal to the server.

In an exemplary embodiment, the photographing guide information may include a virtual guide line matching a specific part of the body.

In an exemplary embodiment, the specific body part may be at least one of an oral cavity, teeth, a part of the face, a head, a neck, an arm, a leg, a hip, a hand, and a foot.

In an exemplary embodiment, the server may further include a skeletal state analysis step in which the photo file is analyzed and processed into physical state information.

In an exemplary embodiment, in the skeletal state analysis step, the body state information may be extracted by analyzing left and right or vertical balance of the transmitted file or by analyzing the degree of separation of a body part from a preset reference line.

In an exemplary embodiment, the method may further include a distortion correction step of correcting distortion of the photo file in the server.

In an exemplary embodiment, in the distortion correction step, the distortion may be corrected based on the position of the feature point of the body.

In an exemplary embodiment, the feature point may be set by machine learning using an artificial neural network.

In an exemplary embodiment, the method may further include a step of transmitting a history of transmitting a photo file that is accumulated according to the shooting guide information from the server to the terminal.

In an exemplary embodiment, the method may further include a personal information protection consent step in which the personal information protection consent information is transmitted from the terminal to the server.

* The present invention has been devised to solve the above problems of the prior art, and has an effect of accurately photographing a user's physical condition using a mobile device.

In addition, the present invention has an effect of providing a correction result as a numerical value by analyzing a photographed photograph.

In addition, the present invention has the effect of monitoring the cumulative process of correcting body imbalance in real time.

In addition, the present invention not only intermittently observes his or her body change state when the user's body uncomfortable symptoms or improved symptoms appear, but also time Periodic collection of body data according to the flow of the disease has the effect of more accurately identifying the time of onset and the cause of the disease.

In addition, the invention has the effect of being able to devise a treatment method by inferring the time of occurrence of a cause when a disease occurs by collecting the growth direction and events and accidents during growth as data by applying the invention to a user in the growth period.

1 is a schematic diagram of a system for implementing a method for providing a physical condition monitoring service.
2 is a block diagram showing a detailed configuration of a system for implementing a method for providing a physical condition monitoring service.
3 illustrates a flow of processing a body photo by the method for providing a body condition monitoring service according to an embodiment of the present invention.
4 is a distortion correction step, showing a flow of correcting the distortion of the body picture by machine learning.
5 is a view of a main page provided to a device by a method for providing a physical condition monitoring service according to an embodiment of the present invention.
6 to 12 are provided to a device by the method for providing a physical condition monitoring service according to an embodiment of the present invention, and show pages for guiding photo taking.
13 to 19 are diagrams of pages that are provided to a device by a method for providing a body condition monitoring service according to an embodiment of the present invention, and are pages that provide body condition information cumulatively.
20 is a flowchart illustrating a user personal information protection consent procedure.
21 illustrates a state in which the user personal information protection consent procedure is implemented through a device.

Hereinafter, various embodiments of the present invention will be described with reference to the drawings.

First, FIG. 1 is a schematic diagram of a body condition monitoring system for implementing the method for providing the body condition monitoring service.

The body condition monitoring system according to an embodiment of the present invention is a server (S) that can be accessed through wired or wireless communication and stores information, and a terminal (A) that can be connected to the server (S) through wired or wireless communication. , B, C, D) and, the server (S) may include a server (E) for transmitting and receiving information through wired or wireless communication.

In addition, the terminals (A, B, C, D) may include a user terminal (A), a hospital terminal (B), a non-medical institution terminal (C), and an administrator terminal (D).

In this case, a user may be a patient or an individual who is a service beneficiary, a hospital is an institution that provides treatment to the user, and a non-medical institution means a health care service provider that provides massage or body correction services to the user outside of medical care And, the manager means a person who manages and controls the server (S).

In addition, the server (S) may be connected to a plurality of the user terminal (A), the hospital terminal (B), the non-medical institution terminal (C), and the manager terminal (D), respectively, as needed.

Here, the terminals A, B, C, and D may mean including an integral unit including a device that includes a digital camera function and enables transmission through a wired or wireless Internet network.

That is, it corresponds to a device for accessing through the Internet, and broadly, input devices such as a keyboard and mouse for inputting various data, output devices such as monitors and printers, transceivers such as modems or LANs, microprocessors or graphic cards, and the like. It may be composed of the same processing device and a storage device loaded with various programs for operating or controlling them.

For example, a personal communication system (PCS), a global system for mobile communications (GSM) terminal, a personal digital cellular terminal (PDC), a personal handyphone system (PHS) terminal, a personal information terminal (Personal) Digital Assistant; PDA), smart phone (Smart Phone), telematics (Telematics), wireless data communication terminal and / or portable Internet terminal, personal computer (Personal Computer), notebook (Notebook) and the like.

Meanwhile, the individual configurations of the server S will be described in detail with reference to FIG. 2 below.

The server S includes a terminal recognition unit 91 for recognizing terminals A, B, C, and D, and a data receiving unit for receiving a file including a photo file from the terminals A, B, C, and D ( 92), an operation unit 93 that processes the received file to derive body condition information, a storage unit 94 that accumulates and stores the photo file and body condition information, and stores the photo file and body condition information in the terminals A and B , C, D) and may include an information transmitter 95 for transmitting to the Health Insurance Corporation server (S).

The server S may be composed of a dedicated system and a wired/wireless communication network for implementing the method for providing a body condition monitoring service, as well as being implemented through a virtual file-based web cloud service.

Hereinafter, a method of providing a physical condition monitoring service according to an embodiment of the present invention will be described in detail with reference to FIG. 3 .

A method for providing a physical condition monitoring service according to an embodiment of the present invention includes a photographing guide information transmission step S1 in which photographing guide information is transmitted from the server S to the terminals A, B, C, and D; It may include a photo transmission step (S2) of transmitting a photo file taken through the terminals (A, B, C, D) to the server (S).

The photographing guide information may include a virtual guide line that matches a specific part of the body, and the specific body part includes an oral cavity, teeth, a part of the face (eyes, nose, mouth, ears), head, arms, legs, It may include at least one of chest, neck, buttocks, hands, and feet.

Therefore, the virtual guide line is provided on the screen photographed through the camera of the terminals (A, B, C, D), and the user's specific body part can be photographed by composing it to maintain consistency with the guide line. have.

This has an excellent effect of allowing you to take pictures of specific parts of the body in a state that can be analyzed with only a mobile phone camera without a separate professional shooting equipment.

A more specific embodiment thereof will be described later with reference to FIGS. 6 to 11 .

Meanwhile, the method for providing a physical condition monitoring service according to an embodiment of the present invention may further include a distortion correction step (S3) of correcting distortion of the photo file in the server.

The distortion correction step (S3) corresponds to a step of normally correcting distortion occurring on the outside of the picture by the lens when the camera and the body part are close when the body is photographed by the camera.

That is, the central part of the picture may be accurately captured, but the outside of the picture may be distorted by the curvature of the lens or expanded at an abnormal ratio as the terminal is not a professional body picture recording device, and this problem is corrected for the distortion Step S3 can solve it.

In particular, in the case of intraoral photography, the camera lens and the photographing site have no choice but to maintain a close state, so the distortion of the picture may be further aggravated. In this case, it can be applied more effectively.

The distortion correction step ( S3 ) will be described in more detail later with reference to FIG. 4 .

The method for providing a physical condition monitoring service according to an embodiment of the present invention includes a skeletal state analysis step (S4) in which the photo file is analyzed and processed into body state information in the server (S), and a distortion-corrected photo file and processing The method may further include a data storage step (S5) of accumulatively storing the obtained body state information in the storage unit 94 .

In the skeletal state analysis step, the calculator 93 may quantify the skeletal balance state of the body by analyzing the left-right or vertical balance of the distortion-corrected photo file.

In addition, in the skeletal state analysis step, the body state information may be extracted by analyzing the degree of separation of the body part from a preset reference line.

For example, in the case of a turtle neck patient, the degree of protrusion can be quantified by analyzing the degree of facial separation based on the virtual line connecting the neck and the foot with the preset reference line.

Thereafter, the method for providing a physical condition monitoring service according to an embodiment of the present invention includes a data upload step in which a distortion-corrected photo file and processed body condition information are transmitted from the server (S) to the Health Insurance Corporation server (E). (S6) and, a history transmission step (S7) of transmitting the distortion-corrected photo file and processed body state information from the server (S) to the terminals (A, B, C, D) may be further included. .

The distortion-corrected photo file and the processed body state information can be stored cumulatively over time, and the stored information can be stored in real time by users, hospitals, non-medical institutions, and managers through the history transmission step (S7). can be viewed.

In addition, the user's information is transmitted to the Health Insurance Corporation server (E) through the data upload step (S6), so that the medical records can be inquired from the Health Insurance Corporation.

4 is a detailed flow of the distortion correction step ( S3 ). In the distortion correction step ( S3 ), the distortion may be corrected based on the position of the characteristic point of the body.

The characteristic points of the body may be set by machine learning using an artificial neural network, and a computer operating the server S may input a training picture to the artificial neural network.

In this case, the training picture may be a picture that does not include the chess board. That is, it is to find feature points in the image itself using training photos similar to body photos. (P1)

The computer operating the server S may learn the artificial neural network to output feature points from the input photo, or the artificial neural network may learn to output matching feature vectors from a plurality of photos.

Thereafter, the delivered artificial neural network P3 may output a feature vector (feature point) for the input photo (P3). In the case of the feature point, it may be a part of the body, for example, in the case of the oral cavity, it may be a part of the incisors, molars, or the outer periphery of the tongue.

Thereafter, the artificial neural network may find matching feature points in the input photo based on the feature vector for the photo, and correct image distortion based on the matching feature points. (P4)

Accordingly, the distortion of the photo taken with the fisheye lens can be effectively corrected, and as the photo files are accumulated, the distortion correction level can be increased exponentially by machine learning.

5 illustrates an example in which the above-described method for providing a physical condition monitoring service is implemented through the web/application of the terminals A, B, C, and D. Referring to FIG.

The display of the terminals A, B, C, and D may include a main page 11 listing provided services, and the main page 11 includes a photo shooting selection area 111, a photographed picture and a physical condition. The history selection areas 112 for inquiring information may be partitioned from each other.

When the photographing selection area 111 is selected, the display of the terminal may be switched to the photographing portion selection page 21 shown in FIG. 6 .

The photographing site selection page 21 includes an oral selection area 211 , a tooth selection area 212 , a face selection area 213 , a whole body selection area 214 , a movement selection area 215 , and a growth selection area 216 . ) may be partitioned from each other.

Here, when a specific area is selected by the terminal user, the photographing guide information transmission step S1 may proceed.

First, when the oral selection area 211 is selected, the display of the terminal may be switched to the oral photo upload page 22 shown in FIG.

In the oral photograph upload page 22, an oral photographing guide area 222 and an oral photographing uploading area 221 may be partitioned from each other and disposed, and the oral photographing guide area 222 has a virtual virtual image suitable for the oral structure. Guidelines may be provided.

Accordingly, the terminal user may take a picture of the inside of the oral cavity along the virtual guideline, and the picture transmission step S2 may proceed through the oral picture upload area 221 .

Next, when the tooth selection area 212 is selected, the display of the terminal may be switched to the tooth photo upload page 23 shown in FIG. 8 .

A tooth photographing guide area 232 and a tooth photographing uploading area 231 may be partitioned from each other on the tooth photograph upload page 23, and the tooth photographing guide area 232 includes a virtual virtual image suitable for the tooth structure. Guidelines may be provided.

Accordingly, the terminal user may take a picture of the front of the tooth along the virtual guide line, and transmit the picture through the tooth picture upload area 232 ( S2 ).

Then, when the face selection area 213 is selected, the display of the terminal may be switched to the face photo upload page 24 shown in FIG. 9 .

In the face photo upload page 24, a face photo taking guide area 242 and a face photo upload area 241 may be partitioned from each other and arranged, and the face photo taking guide area 242 includes a virtual virtual image that fits the structure of the face. Guidelines may be provided.

Accordingly, the terminal user may take a face picture along the virtual guide line and transmit the picture through the face picture upload area 242 ( S2 ).

Also, when the whole body selection area 214 is selected, the display of the terminal may be switched to the full body photo upload page 25 shown in FIG. 10 .

On the whole-body photo upload page 25, a whole-body photo taking guide area 252 and a whole-body photo upload area 251 may be partitioned from each other and disposed, and the whole-body photo taking guide area 252 contains a virtual virtual image suitable for the whole body structure. Guidelines may be provided.

Accordingly, the terminal user may take a full-body picture along the virtual guideline, and transmit the picture through the whole-body picture upload area 252 ( S2 ).

Next, when the exercise selection area 215 is selected, the display of the terminal may be switched to the exercise photo upload page 26 shown in FIG. 11 .

In the case of mobility measurement, it corresponds to determining the part where the center of gravity is formed in the process of moving the body, such as walking, standing, or sitting, and measuring the degree of body balance.

That is, when an imbalance occurs in the skeleton, the center of gravity may be abnormally formed in the course of movement, in order to visualize and quantify this phenomenon.

To this end, in the exercise photo upload page 26, an exercise photo taking guide area 262 and an exercise photo upload area 261 may be partitioned from each other, and the exercise photo taking guide area 262 includes walking or standing / A virtual guideline suitable for the state of the body being seated may be provided.

Accordingly, the terminal user may take an exercise picture along the virtual guideline and transmit the picture through the exercise picture upload area 262 ( S2 ).

Next, when the growth selection area 216 is selected, the display of the terminal may be switched to the growth photo upload page 27 shown in FIG. 12 .

To this end, the growth photo upload page 27 may have a growth photo taking guide area 272 and a growth photo uploading area 271 partitioned from each other, and the growth photo taking guide area 272 includes the oral / Virtual guide lines for guiding dental/facial/full body/motor imaging may be disposed, and FIG. 12 shows an example of a case of whole body imaging.

Accordingly, the terminal user may take a growth picture along the virtual guideline, and the picture transmission step S2 may proceed through the growth picture upload area 272 .

Meanwhile, when the history selection area 112 is selected on the main page 11 , the display of the terminal may be switched to the history selection page 31 shown in FIG. 13 .

In the history selection page 31, an oral condition inquiry area 311, a dental condition inquiry area 312, a facial condition inquiry area 313, a whole body condition inquiry area 314, a motility state inquiry area 315, and growth The status inquiry areas 316 may be partitioned from each other.

Here, when a specific area is selected by the terminal user, the history transmission step (S7) may proceed.

First, when the oral condition inquiry area 311 is selected on the history selection page 31 , the display of the terminal may be switched to the oral history page 32 shown in FIG. 14 .

In the oral history page 32, an oral photo area 321 and an oral condition analysis area 322 providing oral photos listed in the order of time may be partitioned from each other and disposed.

In the oral condition analysis area 322 , information on the degree of left-right balance in the oral cavity and even teeth may be numerically provided.

Next, when the tooth condition inquiry area 312 is selected on the history selection page 31 , the display of the terminal may be switched to the tooth history page 33 shown in FIG. 15 .

In the tooth history page 33 , a tooth photo area 331 providing dental photos arranged in chronological order and a tooth condition analysis area 332 may be partitioned from each other and disposed.

In the tooth condition analysis area 332 , information regarding the degree of left-right balance and the arrangement state of teeth may be numerically provided.

Also, when the facial state inquiry area 313 is selected on the history selection page 31 , the display of the terminal may be switched to the facial history page 34 shown in FIG. 16 .

On the face history page 34 , a face photo area 341 providing face pictures listed in chronological order and a facial condition analysis area 342 may be partitioned from each other and disposed.

In the facial condition analysis area 342 , information regarding the degree of left-right balance of the face and the degree of protrusion of the mandible may be numerically provided.

Next, when the whole body state inquiry area 314 is selected on the history selection page 31, the display of the terminal may be switched to the whole body history page 35 shown in FIG.

In the whole body history page 35 , a whole body photo area 351 providing full body pictures listed in chronological order and a whole body state analysis area 352 may be partitioned from each other and disposed.

In the whole body state analysis area 352 , information on the degree of left-right balance of the whole body, the degree of forward protrusion of the head, and the inclination of the body may be numerically provided.

Next, when the exercise state inquiry area 315 is selected on the history selection page 31 , the display of the terminal may be switched to the exercise history page 36 shown in FIG. 18 .

In the exercise history page 36 , a kinetic photo area 361 providing kinetic photos listed in chronological order and a motility state analysis area 362 may be partitioned from each other and disposed.

In the movement state analysis area 362, information on the center of gravity in the movement state, the degree of separation of a specific part from the center of gravity, the inclination of the body, etc. may be numerically provided.

Next, when the growth status inquiry area 316 is selected on the history selection page 31 , the display of the terminal may be switched to the growth history page 36 shown in FIG. 19 .

In the growth history page 36 , a growth photo area 361 providing growth photos arranged in chronological order and a growth state analysis area 362 may be partitioned from each other and disposed.

Therefore, through the growth history page 36, data on a number of physical conditions such as the growth degree, growth direction, and imbalance during growth can be collected and provided, which in turn makes it possible to infer the time of occurrence of a cause when a disease occurs. It enables management throughout the life cycle.

according to the configuration described above. Users, hospitals and non-medical institutions can immediately monitor the progress of numerical correction of users, guide body correction more efficiently, and have the advantage of easily securing big data about the body.

Meanwhile, referring to FIG. 19 , the method for providing a physical condition monitoring service according to an embodiment of the present invention may further include steps of consenting to user privacy protection (T1, T2).

The personal information protection consent step (T1, T2) may be performed between the hospital terminal (B) and the server (S), and between the non-medical institution terminal (C) and the server (S), and the history transmission step ( S7) or before the photo transmission step (S2).

This is to protect sensitive medical information by obtaining consent before uploading or inquiring a user's body photo so that the user's information is not leaked to the outside.

Referring to FIG. 20 , it can be seen that the personal information protection agreement page 41 is shown on the display of the terminal.

A guide area 411 containing a personal information leakage prohibition notice, a consent area 412 and a non-consent area 413 may be partitioned from each other on the personal information protection consent page 41 .

Accordingly, when the consent area 412 is selected, the personal information protection consent steps T1 and T2 may proceed.

Even if the effect is not described in this specification, the present invention may additionally have different effects of each of the above-described components, and derive a new effect that cannot be seen in the prior art according to the organic coupling relationship between the above-described respective components. can do.

In addition, the embodiments shown in the drawings may be modified and implemented in other forms, and when implemented including the configuration claimed in the claims of the present invention or implemented within the scope of equivalents, it should be considered to belong to the scope of the present invention. something to do.

Server S User terminal A Hospital terminal B Non-medical institution terminal C
Manager Terminal D Health Insurance Corporation Server E

Claims (3)

A method for providing a body condition monitoring service using a terminal and a server communicating with the terminal, the method comprising:
a shooting guide information transmission step in which shooting guide information is transmitted from the server to the terminal;
a photo transmission step of transmitting a photo file taken through the terminal to the server;
a skeletal state analysis step of analyzing the photo file in the server and processing it into body state information;
a data storage step of accumulatively storing processed body state information in the server; and
A history transmission step in which the photo files accumulated according to the shooting guide information and the body state information processed in the skeletal state analysis step are transmitted from the server to the terminal;
The body state information processed in the skeletal state analysis step and provided to the terminal includes body balance information including a numerical value indicating the degree of left-right symmetry of the body shown in the photographed photo file,
The body balance information including the photo file taken through the terminal and the numerical value indicating the degree of left-right symmetry corresponding thereto is sequential in the order of the time the photos were taken so that the change in the left-right balance state of the body can be checked on one page are listed and provided on the display of the terminal,
The specific part of the body is
A method for providing a physical condition monitoring service, comprising the oral cavity, teeth, face and trunk. According to claim 1,
The shooting guide information is
Includes a virtual guideline that matches a specific part of the body,
In the skeletal state analysis step,
A method for providing a body condition monitoring service, characterized in that the body condition information is extracted by analyzing the vertical balance of the transmitted file or by analyzing the degree of separation of a body part from a preset reference line. According to claim 1,
Distortion correction step of correcting the distortion of the photo file in the server; Physical condition monitoring service providing method further comprising a.

Images