WO2016140400A1

WO2016140400A1 - Three-dimensional biological information processing method and system therefor

Info

Publication number: WO2016140400A1
Application number: PCT/KR2015/005243
Authority: WO
Inventors: 태주호
Original assignee: 재단법인차세대융합기술연구원
Priority date: 2015-03-05
Filing date: 2015-05-26
Publication date: 2016-09-09
Also published as: KR101581785B1

Abstract

The present disclosure provides a three-dimensional biological information processing method and a system therefor, wherein the three-dimensional biological information processing method comprises: an initial screen display step for displaying a three-dimensional body model, an input tool type selection part, and a degree information input bar on a screen; a degree input step for receiving degree information which a user has selected; a position input step for receiving position information which the user has designated on a surface of the three-dimensional body model, using an input tool; a corresponding information display step for displaying designated position information and selected degree information on the screen to correspond to each other; and a storage step for processing and storing the designated degree information and the selected position information. Therefore, the present disclosure enables efficient displaying and storing of various biometric information on three-dimensional modeling.

Description

3D biological information processing method and system

Disclosed is a three-dimensional biological information processing method and system (3D Biological Data Processing Method And System Thereof), a three-dimensional modeling to express a variety of biological information that the user wants to input by using three-dimensional modeling 3 A method and system for processing dimension data.

This section provides background information related to the present disclosure which is not necessarily prior art.

1 illustrates a computer-assisted pain evaluation method shown in US Pat. No. 8,046,241. To enter the pain the patient is currently experiencing, the front and rear parts of the human body are displayed on the screen. The patient selects a portion of the human body drawing. You will then be taken to the next screen, where you will select a color to indicate the degree of pain. In addition, a check box for selecting a type of pain appears, and the user inputs a type of pain thereof.

According to the input information, the pattern of pain is displayed on the screen according to the information finally input by the patient on the next screen, and the patient is checked whether it is correct. This sequence of inputs can be stored on a computer or sent to a doctor.

Biological information, such as the human body, has various phenomena and causes, and accordingly, expression may be required for recording. However, when a two-dimensional limited input screen is provided as in the case of FIG. 1, the user may not express information as desired, and thus, the user may be more likely to omit or exaggerate it. On the contrary, if there are too many options for expression, it may be confusing to choose what expression is appropriate for oneself and may have difficulty in proper input. In addition, a part having a three-dimensional position in an actual three-dimensional space may be difficult to express in a two-dimensional image, or may be unclear even if expressed.

In the present disclosure, the user may enable an intuitive expression corresponding to his or her human body or a desired organism. It also automates some of the content of the input, allowing quick and easy input of features of biometric information.

This will be described later in the section titled 'Details of the Invention.'

This section provides a general summary of the disclosure and is not a comprehensive disclosure of its full scope or all of its features ).

According to an aspect of the present disclosure, in the three-dimensional biological information processing method, the initial screen display step of displaying a three-dimensional body model, the input tool type selection unit and the accuracy information input bar on the screen, the degree of accepting the degree information selected by the user An input step, a position input step in which the user receives the specified location information by using an input tool on the surface of the three-dimensional body model, a corresponding information display step of matching the specified location information with the selected degree information, and displaying the specified degree information; Provided is a three-dimensional biological information processing method comprising a storage step of processing and storing the selected location information.

This is described later in the section titled 'Details of the Invention.'

1 is a view showing the prior art of a computer-based pain treatment apparatus presented in US Patent No. 8,046,241.

2 is a diagram illustrating a biological information input screen according to an embodiment of the present invention.

3 is a diagram illustrating overlapping biological information input screens according to an embodiment of the present invention.

4 is a view showing a biological information input on a two-dimensional plane according to an embodiment of the present invention.

5 is a diagram illustrating a display marker for displaying biological information according to an embodiment of the present invention.

6 is a diagram for automatically expressing degree information according to an embodiment of the present invention.

7 illustrates a display according to a brush in accordance with an embodiment of the present invention.

8 is a diagram illustrating a biological information input screen for a dog according to another embodiment of the present invention.

9 is a view simultaneously representing two or more three-dimensional body model according to another embodiment of the present invention.

10 is a view showing various operations of the three-dimensional body model according to another embodiment of the present invention.

The present disclosure will now be described in detail with reference to the accompanying drawing (s).

2 is a diagram illustrating an embodiment of a biological information input method according to the present disclosure. Three-dimensional modeling (100, hereinafter, three-dimensional body model) of the target organism appears on the screen. On one side of the three-dimensional body model 100, the input tool type selection unit 230 for selecting the type of input tool that allows input of biological information on the modeling, precision information input bar that can indicate the degree of strength of biological information There is 220. When the type of the input tool and the intensity of the biological information are selected, the input device 111 may be used to directly designate a location in the 3D body model and input biological information according to the corresponding location.

Biological information relates to physiology, ecology, and pathology, for example, pain, itching, fever, rash, ringworm, wound, abrasions, wounds, burns, bruises, hair loss, scalp troubles, etc. (human body, animals, plants, insects) , Carcasses, etc.).

The user uses the 3D body model 100 to input biological information. In order to input information about the human body, a modeling of a human body divided into males or females may be selected, and in order to input information on a plant, an insect, or the like, a 3D modeling of a related organism may be selected to be displayed on the screen. In the initial screen, the user can select the three-dimensional body model 100 of the desired creature.

3D body model 100 can be easily rotated in any direction desired by the user so that the user can express the biological information in the correct position. In addition, it can be enlarged or reduced as necessary. As a result, the user can intuitively view the three-dimensional body model 100 to increase the display accuracy. In addition, the user can check in advance the portion he wants to express through the three-dimensional body model 100, and can make an input screen for easy input.

In addition, when the user places the input tool 111 on any part of the three-dimensional body model surface 100, the system can automatically rotate the three-dimensional body model such that the portion is the center of the screen. For example, when the front surface of the three-dimensional body model 100 is displayed, moving the input tool 111 to the dorsal surface, the three-dimensional body model 100 is automatically rotated so that the position of the specified dorsal representation is the center of the screen Done.

After checking the input screen in advance through rotation and zooming, the user selects a method of inputting biological information. You select the type of input tool, which can be a marker marker mode, a brush mode, or an eraser mode.

In the display marker 111 mode, the range and shape of the displayed biological information to be input can be determined. The display marker 111 allows the cross section to have the shape of a circle or an ellipse in order to make the area display part on the 3D biological model 100. The length of the width and height diameter orthogonal to the center of the ellipse can be arbitrarily designated by the user using the

input bars

211 and 212, thereby making it possible to vary the size and shape of the display marker 111. In addition, there may be a rotation input bar 213 that enables the display marker 111 to be rotated based on the center. According to another embodiment, the shape of the display marker 111 displayed according to the user's convenience may be specified in various polygonal shapes such as triangles and squares.

On the other hand, in displaying the biological information on the three-dimensional body model using the display marker 111, it may be necessary to express only the local part in detail while facilitating the location of the display marker 111. This is because when the size of the screen representing the three-dimensional body model 100 is small, the difference between the hue of the three-dimensional body model 100 and the hue of the display marker 111 is not large or the size of the display marker 111 is small. This will be the case when it becomes difficult to estimate the position. According to FIG. 5, in order to solve this problem, as the display marker 111 approaches the surface direction from a predetermined distance on the surface of the three-dimensional body model 100, a trapezoidal conical column is reduced in area and a constant pattern is formed on the side. It can be expressed as (511, 512). This regular pattern can be automatically assigned a color that can be contrasted with the background picture so that it can be seen clearly against the background picture, and its thickness and shape can also be specified. For example, a color that is complementary to the main color of the background is automatically selected, and lines can be made thicker. In the present embodiment, it is represented by a plurality of straight lines, but may be represented by various patterns. The size of the area display portion of the display marker 111 generated on the three-dimensional body model can be adjusted by adjusting the lateral inclination of the trapezoidal conical column using the conical slope input bar 214. When the inclination is minimized, the area display unit 512 displayed by the marker is minimized, and when the inclination is close to 90 degrees, the display marker is close to the cylinder, and the area display unit 511 is made to display biological information by the originally designated size. It becomes possible.

The input tool may be in brush mode. In the brush mode, the biological information is displayed at the position where the user places the brush and enters a display command. The user can adjust the thickness of the brush.

In addition, the input tool may be in an eraser mode. If the user thinks that the displayed display information is not appropriate, only the desired portion can be erased. As many expressions as erased parts are possible, the biological information displayed in the three-dimensional body model can be completely different from the initial display. In the eraser mode, the size, shape, and direction of the eraser may be changed using the size and

shape control options

211 and 212 and the direction option 213 of the display marker 111.

Biological information may have information about intensity. For example, pain is expressed in several stages by dividing the pain from the painless to very painful in 10 sections. This may be expressed as pain analogue (Visual Analog Scale, VAS). The user may adjust the degree information input bar 220 displayed on the screen to input the degree of biological information intensity. The degree information input bar 220 is composed of a spectrum of colors, and is defined to increase in intensity gradually from left to right. The user can select one or more intensities. In addition, according to another exemplary embodiment described with reference to FIG. 6, the spectrum of colors of the degree information input bars 611 and 621 may be represented by a palette consisting of ten levels of colors according to pain criteria.

The input tool is the display marker 111, and two pieces of information may be input to the precision information input bar 220. If necessary, one or more pieces of information may be input, but in the present embodiment, two pieces of information are inputted. These two values may mean a maximum value and a minimum value in a predetermined range, or may be a center and an outer of an area to be displayed by the display marker 111. For example, two values are selected on the accuracy information input bar 220, and for adjusting the size of the display marker 111 area, the width input bar 211, the height input bar 212, and the rotation input bar ( After adjusting 213 and determining the position of the display marker 111 on the three-dimensional body model 100, the two values become the maximum and minimum values at specific positions within the area of the display marker 111, respectively. Depending on the intention of the user, the maximum value may be set at the center inside the circular area, the minimum value at the outermost part, and vice versa (612, 613 in FIG. 6). After the positions corresponding to the maximum and minimum values within the area of the display marker 111 are determined, the accuracy information values according to the positions between the maximum and the minimum are automatically generated at the corresponding positions. do. For example, when colors 1 and 16 are selected from the left side of the accuracy information input bar 220, colors 1 and 16 become center and outermost values, respectively, and 2 to 15 become intermediate values. will be. Gradual changes in intensity will also be represented by the color corresponding to each value and displayed on the screen at its corresponding location.

There may be a preview unit 221 on the side information input bar 220. Once the maximum and minimum values are determined, it is possible to know in advance how the color distribution will appear within the area of the display marker 111, from the center to the outside or vice versa. In addition, it is possible to determine how much the point of the maximum or minimum selected color is compared to the total size of the color so that it can be reflected in the preview and the display by the display marker 111.

6 shows an embodiment in which the precision information input bars 611 and 621 have 10 steps. The circular area display unit 612 can be displayed by selecting the maximum at the center, the minimum at the outside, or vice versa. When the value corresponding to the center and the outermost value are determined, the values in the middle of the input bars 611 and 621 are also determined to be displayed within the area of the display marker 111. For example, when colors 1 and 5 are selected from the left side of the input bars 611 and 621, colors 1 and 5 become center and outermost values, respectively, and 2 to 4 become intermediate values. will be. This is intended to be expressed in various ways depending on the actual case of biological information. In addition, the user may adjust the position of the selected color on the color palette of the accuracy information input bar 621 to make the area display unit 622 in which the expression ratio of the color is displayed small.

According to another exemplary embodiment, two or more values may be designated in the input bars 611 and 621 to enable display only in the color corresponding to the values. For example, when colors 2 and 6 are selected from the left side of the input bars 611 and 621, colors 2 and 6 are displayed according to a ratio selected by the user in the area shape of the display marker 111. Will be.

7 illustrates a method of displaying when the user selects a brush mode and only one color is selected on the precision information input bar 622. Basically, when the user first specifies the display in the area display unit 701, a non-uniform color distribution (display) is made. When discontinuous expression is made first and the user wants to express the entire area display unit 701 in the same color, the same portion is overlapped and designated several times (FIG. 7 (b)) to display the area display unit ( 701 may enable the same color representation throughout. In addition, as shown in FIG. 7 (c), another color may be selected and painted. In this way, it is possible to indicate biological information that can appear in several ways, such as in skin diseases in which many spots and the like appear at the local area. For example, if the head (including hair) shows degree information and indications, it indicates information indicating the scalp or hair symptoms (eg, hair loss, oily / dry scalp problems) and at the same time headache and The information on the same body side is represented by different colors and different display methods (brush or display marker 111).

3 is a diagram illustrating a case where a user has a biological information input at a position where at least some overlap. When the first marker 312 and the second marker 313 are formed on the three-dimensional body model by the marker marker 111 and they are displayed to overlap, the outer lines of the first marker and the second marker are automatically smoothly connected. do. As such, the first indication 312 and the second indication 313 can be represented as one piece of biological information. This allows the user to supplement and display the divided display because the user cannot find an appropriate input method due to the variety of pain locations. As a result, the local parts of the biological model can be expressed in three dimensions in the form of a collection group having the epicenter of two or more biological phenomena (eg, pain). Even if the user adds the third marks 314 to overlap, the same function can be performed.

If necessary, the user may allow at least a part of the expression by the display marker 111 and the expression by the brush to overlap the 3D body model 100. In this case, the strength of the final precision information is applied to the overlapped positions. If necessary, the average or initial information of the precision information may be maintained at the location. The brush allows you to adjust the thickness of the colored particles.

The information displayed on the screen is also stored as data in the system. The location information representing the location on the three-dimensional body model, the degree information representing the strength of the biological information at the location, and the input time are stored in the system as one data set. In the present embodiment, the location information may be information of a triaxial Cartesian coordinate system, and the intensity of biological information may be intensity of pain.

If necessary, the user may separately input user description information such as the type of biological information and the depth information of the biological information, and all values are stored as one data set. Multiple data sets are automatically generated in the area of the three-dimensional body model marked as biological information by the input tool.

A plurality of data sets may be created including area information according to the center position of the display marker 111. For example, one data set contains the input date, the surface slope of the cylindrical marker, the ellipse width diameter, the ellipse height diameter, the center / external accuracy information, the three-dimensional coordinates of the marker center, and the smallest unit within the marker marker area. The position of the point, the degree information of the minimum unit point may be input. It is possible to extend the content of the data as needed.

The system can send this collection of data to the outside in the form of a file with a certain format, if necessary. The data sent to the outside can be used in various biological big data processing systems using web, cloud service, and social network to additionally obtain statistical information. The format of the file may be a standard format of biological information data set by an external agency, or may be its own file format. In addition, you will be able to output compatible file formats of popular spreadsheet programs such as Matlab or Excel, so that you can handle them in a general database.

4 is a screen displaying data sets on a two-dimensional plane 410 according to the present disclosure. The location on the surface of the three-dimensional body model is expanded and displayed on the two-dimensional screen. If you spread the data on one plane and examine the flow of data over time, you might find a pattern. This allows the user to use the biological information of the data set already entered to provide new perspectives and useful directions and ideas for processing and analyzing data.

In FIG. 8, a method of inputting various biological information and using a non-human organism as a 3D body model will be described. If the object to which biological information is to be input is to input information about an animal other than the human body, for example, a dog, the relevant three-dimensional body model 100 can be selected on the initial screen, Male and female divisions or species divisions can also be selected.

The biological information to be input may basically be information input by the precision information input bar 220, but may additionally or generally be photographs, videos, sound information, electromagnetic wave information, or electrical activity information in the visible and invisible light regions. have. This can enable information input by selecting the multimedia input icon 801 shown in FIG. Photographs in the visible region refer to general photographic information, allowing the user to realistically know the state observed from the outside. The photograph of the invisible light region may be, for example, an infrared photograph, and it is possible to grasp the distribution of heat, etc., through the infrared information of the living body. The video information may be an image recording a specific movement of the living body, and the sound information may be various sounds and sound wave information generated by the living body. Electromagnetic wave information may include information generated when a living body is detected using the radar principle, for example, information about organs and body activities (heart rate, respiration, gait, etc.) such as the heart and lungs by a small RF radar. have. The electrical activity information relates to electrical information generated by the living body, and may include information such as an electrocardiogram, myocardial map, and brain wave. This information is collected by contactable or contactless methods by invasive implantable or noninvasive wearable sensors, and processed by personal computers, smart devices, and measurement equipment capable of wired and wireless communication. Could be.

Such multimedia input information may be a component of a data set of the 3D body model 100. Such multimedia information may be displayed on the 3D body model along with its location and accuracy information, and if necessary, the information may be displayed by a user's call request (such as touching a user's icon).

9 shows that various three-dimensional body models 901 and 902 can be expressed on a single screen. This will allow the user to conveniently enter biological information and additional multimedia information for multiple objects at once. In this state as well, the three-dimensional body models 901 and 902 may be rotated to view information from various directions and input information.

10 illustrates a three-dimensional body model 1000 capable of various posture transformations. The three-dimensional body model 1000 allows movement. It is possible to move freely. For example, the three-dimensional body model 1000 can be used to designate movements such as idle, walk, run, eat, and dead. This can be expressed. If the user stops in the desired state, the three-dimensional body model 1000 will be stopped in that state, and it will be able to input various biological information and additional multimedia information while rotating it.

3D biological information processing method according to the method of the present disclosure may be composed of the following steps. First select the 3D body model. The three-dimensional body model can be a variety of organisms such as humans and animals. One of these may be selected or a plurality may be selected and displayed on the screen. The three-dimensional body model may be able to move. Next, in the initial screen display step, the degree information input bar, the input tool selection bar, and the multimedia information input bar are displayed to allow the user to select the desired information type. When the type is selected, the user rotates and enlarges the 3D body model to select a desired position, and has an information input step of inputting the selected degree information or degree information and multimedia information using an input tool. Corresponding information display step of correlating the designated location information with the selected degree information or the degree information and the multimedia information on the screen to configure the data set to be stored in the system. If necessary, one or more stored degree information or degree information, multimedia information, and location information are displayed on a two-axis plane, and the information plane display step for retrieving the multimedia information is provided.

Such a three-dimensional biological information processing method can be implemented in a computer system. If it meets the purpose of increasing the accessibility of the user and simplify the input, it can be implemented in various mobile devices such as personal PCs, smartphones, tablets, PCs, pads. It will also be independent of the type of drive system. To this end, it may be implemented in the form of an application stored in the memory of each information device to execute the functions described above.

Hereinafter, various embodiments of the present disclosure will be described.

(1) A three-dimensional biological information processing method, comprising: a three-dimensional body model, an initial screen display step of displaying an input tool type selection unit and a precision information input bar on a screen, a degree input step of accepting a degree information selected by a user, and a user Position input step of accepting the specified location information by using the input tool on the surface of the 3D body model, corresponding information display step of matching the specified location information with the selected degree information, and processing the specified degree information and the selected location information 3D biological information processing method comprising a storage step of storing.

(2) The input tool has a predetermined area deformable by the user, the area display unit is generated in the corresponding information display step, and the selected degree information is at least one or more within the area display unit.

(3) Before the corresponding information display step, the selected precision information has the highest value and the lowest value, and further includes the step of causing the degree information changing therebetween to be automatically selected in the degree information selection bar. Dimensional biological information processing method.

(4) after the storing step, when the additional location information input by the user and the additional degree information are input, when the area display part by the additional location information and the area display part by the previous location information are at least partially overlapped, the area display part is integrated. 3D biological information processing method characterized in that the display.

(5) before the storing step, further comprising the step of receiving and storing the biological information type from the user.

(6) The location information includes three-dimensional coordinate information, and a three-dimensional biological information processing method characterized in that a data set including a recording time is created by processing in a storing step.

(7) The position input step further comprises the step of automatically rotating the three-dimensional body model according to the position of the input tool on the three-dimensional body model.

And (8) after the storing step, displaying one or more stored degree information and location information on a two-axis plane, if the user designates it.

(9) The location input step further comprises the step of further inputting the user description information.

10. The storing step further comprises the step of receiving and storing the multimedia information further three-dimensional biological information processing method.

(11) A multi-axis rotatable 3D body model and a display module for displaying an input tool for inputting accuracy information on the screen, and an input for receiving position information using two or more accuracy information selected from the input tool and the surface of the 3D body model. Module and a three-dimensional biological information processing application stored in a medium for executing a storage module for processing and storing precision information and position information.

Claims

In the three-dimensional biological information processing method,

An initial screen display step of displaying a three-dimensional body model, an input tool type selection unit, and an accuracy information input bar on a screen;

A degree input step of accepting the degree information selected by the user;

A location input step of accepting location information specified by a user using an input tool on a surface of a three-dimensional body model;

A corresponding information display step of displaying the corresponding position information and the selected degree information on the screen in correspondence; And

And a storage step of processing and storing the specified degree information and the selected location information.
According to claim 1,

The input tool has a predetermined area deformable by the user, the area display unit is generated in the corresponding information display step, and the selected degree information is at least one or more in the area display unit.
The method of claim 2, wherein before the corresponding information display step:

The selected degree information has a highest value and a lowest value, and the degree information changing therebetween is automatically selected in the degree information selection bar; further comprising the 3D biological information processing method.
The method of claim 3, wherein after the storing step,

Inputting additional location information and additional degree information input by a user;

3. The method of claim 3, wherein when the area display unit by the additional location information and the area display unit by the previous location information are at least partially overlapped, the area display unit is displayed.
The method of claim 1, wherein prior to the storing step:

And receiving and storing the biological information type from the user. 3D biological information processing method further comprising.
According to claim 1,

The position information includes three-dimensional coordinate information, and a three-dimensional biological information processing method is characterized in that a data set including a recording time is created by processing in a storing step.
The method of claim 1, wherein the location input step

And rotating the three-dimensional body model automatically according to the position of the input tool on the three-dimensional body model.
The method of claim 1, wherein after the storing step,

And displaying one or more stored degree information and location information on a two-axis plane, if the user designates it.
The method of claim 1, wherein the location input step comprises:

3. The method of claim 3, further comprising inputting user description information.
The method of claim 1, wherein the storing step,

3. The method of claim 3, further comprising receiving and storing multimedia information.
A display module for displaying a multi-axis rotatable three-dimensional body model and an input tool for inputting accuracy information on a screen;

An input module for receiving position information using at least two degree information selected by the input tool and a surface of the three-dimensional body model; And,

And a storage module for processing and storing the degree information and the location information.