KR102200998B1 - Virtual reality based musculoskeletal health status measurement system - Google Patents

Abstract

The present invention relates to a virtual reality-based musculoskeletal health state measurement system, and more particularly, to provide a measurement VR content that induces a user to perform a plurality of repetitive task operations with different degrees of difficulty in a virtual reality environment. The present invention relates to a virtual reality based musculoskeletal health state measurement system capable of measuring a user's musculoskeletal health state by comparing and analyzing a user's motion with a standard motion.
A virtual reality-based musculoskeletal health state measurement system according to the present invention comprises: a VR device equipped with a measurement VR content that induces a user to perform a plurality of repetitive work operations having different degrees of difficulty in a virtual reality environment; A motion sensor capable of acquiring a work motion of a user using the VR device; A standard DB in which a standard operation operation matched with the measured VR content is stored; A state measurement server for measuring a user's musculoskeletal health state by comparing and analyzing a user's work motion acquired from the motion sensor and a standard work motion stored in the standard DB; It characterized in that it includes.

Description

Virtual reality based musculoskeletal health condition measurement system {VIRTUAL REALITY BASED MUSCULOSKELETAL HEALTH STATUS MEASUREMENT SYSTEM}

The present invention relates to a virtual reality-based musculoskeletal health state measurement system, and more particularly, to provide a measurement VR content that induces a user to perform a plurality of repetitive task operations with different degrees of difficulty in a virtual reality environment. The present invention relates to a virtual reality-based musculoskeletal health state measurement system capable of measuring a user's musculoskeletal health state by comparing and analyzing a user's motion with a standard motion.

Currently, research using virtual reality technology is actively underway with the development of IT technology.

The Virtual Reality was first conceived as a virtual experience by Morton Haylig in 1956, and then called the Ultimate Display of Ivan Sutherland (1965) and the artificial reality of Myron Kruger (1983). It began to be called the term virtual reality by Near.

The virtual reality can be defined in various ways in various aspects, but can be summarized in two representative positions.

First, from a technology-oriented perspective, it is defined as "an electronic environment simulation experienced through a headmounted goggle that enables users to interact in a realistic 3D situation and through clothes connected by a network" (Coates, 1992).

On the contrary, from an experience-oriented perspective, it can be defined as "real or simulated environment in which the perceiver experiences a remote presence" (Steuer, 1992).

In general, it can be defined as "a human-computer interface through which users can interact in real time in a virtual world in which sensory immersion created by a computer is made", which is widely known to the public.

As such, virtual reality has a long history, but from the 1990s it began to be used in earnest in various fields such as architecture, games, exhibitions, military, and medical care.

As a related prior art, “Rehabilitation Treatment Method Using Virtual Reality Equipment” has been proposed in Korean Patent Publication No. 10-2017-0087214 (published on July 28, 2017).

On the other hand, musculoskeletal disorders (MSDs) are acute or chronic diseases in which minor damage accumulates in muscles, ligaments, tendons, intervertebral discs, cartilage, bones or related nerves and blood vessels in specific body parts, resulting in pain or decreased function. Say.

Musculoskeletal disorders are reported to be caused by direct causes such as simple repetitive work, lifting heavy objects, and taking inappropriate postures that place a burden on a specific body part, as well as lifestyle habits, stress, and lack of exercise due to indirect causes.

Musculoskeletal disorders are health disorders that occur over a long period of time, mainly for workers engaged in tasks that repeatedly burden the body, and are more likely to occur in older workers than workers in younger age groups, and are accompanied by a decrease in strength and restriction of movement. Because of this, it places a lot of activity restrictions on work and daily life.

In particular, the musculoskeletal disease rate of farmers is 2.4 times that of non-farmers, and it is reported that there is a difference in the prevalence of symptoms for each crop.

It is reported that the prevalence of musculoskeletal disorders in farmers is higher in facility cultivated farmers than in rice cultivation farmers in both upper limb, lower back and lower extremities, and the incidence of musculoskeletal disease is considered to be related to the decrease in health-related quality of life of farmers.

In a study on the effect of muscle strength exercise of farmers on mental and social and physical health level, the application of muscle strength exercise to farmers can be used as a treatment program suitable for preventing and managing musculoskeletal diseases by providing psychological stability and improving physical ability. It is believed to be useful in reducing the level of low back pain.

Therefore, the occurrence of diseases and accidents due to the burden of the musculoskeletal system is an important factor in the safety and health of farmers, and the lack of social participation of elderly farmers, social isolation and emotional loneliness and depression that come from boring life, and the deterioration of mental and physical function are also resolved. There is a need for research on the plan for this.

The present invention was conceived by the necessity of a musculoskeletal health state measurement system incorporating virtual reality technology, and is a virtual method capable of measuring the user's musculoskeletal health state by comparing and analyzing the user's motion corresponding to the VR content with the standard motion. It is to provide a reality-based musculoskeletal health condition measurement system.

In order to achieve the above object, the virtual reality-based musculoskeletal health state measurement system according to the present invention is provided with measurement VR content that induces a user to perform a plurality of repetitive task operations with different degrees of difficulty in a virtual reality environment. VR devices; A motion sensor capable of acquiring a work motion of a user using the VR device; A standard DB in which standard operation operations matched with the measured VR content are stored; A state measurement server for measuring a user's musculoskeletal health state by comparing and analyzing a user's work motion acquired from the motion sensor and a standard work motion stored in the standard DB; It characterized in that it includes.

In addition, the virtual reality based musculoskeletal health state measurement system according to the present invention includes a feedback server that provides a user with a feedback corresponding to the user's musculoskeletal health state measured by the state measurement server; It characterized in that it further includes.

Here, the feedback server is characterized in that it provides a training VR content capable of training to prevent musculoskeletal diseases through feedback to the user.

Here, the user using the VR device is a farmer, and the measured VR content is characterized by inducing the user to perform a farming operation repeated for each crop in a virtual reality environment.

Here, the condition measurement server is characterized in that the comparative analysis is performed focusing on a specific body part determined based on the exposure weight of a body risk factor related to agricultural work.

Here, the condition measurement server categorizes the specified specific body parts into keypoint joints, target joints, relation joints, and concern joints according to predetermined criteria, and for each classification It is characterized in that the comparative analysis is performed by varying the addition point.

With the configuration as described above, the virtual reality-based musculoskeletal health state measurement system according to the present invention has the advantage of being able to measure the user's musculoskeletal health state through virtual reality-based motion analysis without going through a radiographic examination, etc. There is an advantage of being able to receive feedback according to the status.

1 is a configuration diagram of a virtual reality-based musculoskeletal health state measurement system according to an embodiment of the present invention
2 is an exemplary diagram of measured VR content used in a virtual reality based musculoskeletal health state measurement system according to an embodiment of the present invention
3 is a block diagram showing a process of acquiring and analyzing a user's work motion in a motion sensor according to an embodiment of the present invention
4 is a type of depth camera that can be used in a motion sensor according to an embodiment of the present invention

Hereinafter, a virtual reality-based musculoskeletal health state measurement system according to the present invention will be described in more detail with reference to embodiments shown in the drawings.

1 is a block diagram of a virtual reality based musculoskeletal health state measurement system according to an embodiment of the present invention.

Referring to FIG. 1, a virtual reality-based musculoskeletal health state measurement system according to an embodiment of the present invention includes a VR device 10, a motion sensor 20, a standard DB 30, a state measurement server 40, and It consists of a feedback 50.

The VR device 10 is a configuration in which a measurement VR content that induces a user to perform a plurality of repetitive work operations having different difficulty levels in a virtual reality environment is provided.

In an embodiment of the present invention, the user using the VR device 10 is a farmer, and the measured VR content is configured to induce the user to perform a farming operation repeated for each crop in a virtual reality environment.

Agricultural work-related musculoskeletal disorders mainly occur in muscle systems such as the deltoid muscle, trapezius, and triceps brachii in the joints of the waist, shoulders, and elbows in the case of fruit crops. It occurs in the muscle system such as the vertebral carpi, lateral oblique muscle, and biceps femoris, and field crops mainly occur in the muscle system such as the oblique muscles, broad back muscles, hamstring muscles, and heel tendons of joints such as the neck, waist, knees, and ankles. It is investigated.

Table 1 below shows peppers, pears, rice, lettuce, which are generally cultivated in ordinary farms among rice paddies, fields, and fruit crops based on the exercise prescription service for each agricultural task for the risk management of musculoskeletal diseases of the "Farmers Health and Safety Information Center". Repetitive agricultural work motions for each crop that can be mounted on the VR content measured by the VR device 10 in connection with musculoskeletal diseases, targeting seven crops such as cucumbers, are illustrated.

Crop Work name Crop Work name No chili pepper Vinyl covering cucumber Formally Formally Back-type pesticide spray 1 Building a holding Erecting pillars and tying a rope Wait 1st stage sunchigi and string tie harvesting 3-stage succession wash Back-type pesticide spray 2 Turn over to dry 5-stage succession Collect harvesting Poultry Remove the feed plate Sorting packaging Washing with high pressure spray melon grafting Fowl removal Formally Chaff Temperature management Attaching a feed plate Modified Chick moving in Picking Watching Chicken harvesting Shipment Sorting packaging Add residual feed Pesticide spray ship Tying grape Pruning Crystal, enemy Vinyl covering Bagging Sunchigi harvesting Bag Sorting packaging Choosing an Egg rice plant Seedling harvesting Fertilizer spraying Sorting packaging Move bed Common work Compost cycle Rice transplanter planting Rotor Back-type herbicide spray Goal riding Herbicide spraying Flattening work

Meanwhile, FIG. 2 illustrates measurement VR content that induces a user to repeatedly perform a farming operation of harvesting apples with varying degrees of difficulty in a virtual reality environment.

Referring to FIG. 2, a user first selects a difficulty level according to the measured VR content, and repeatedly performs an operation of harvesting and placing a plurality of apples having different heights and positions from each other in a virtual reality environment of the selected difficulty level.

The motion sensor 20 is a component capable of acquiring a work motion of a user using the VR device 10.

The motion sensor 20 may use a motion analysis method based on area designation by scanning the motion range of the skeleton using a depth camera.

Motion analysis through the depth camera (ToF Method) converts image information into position information of each joint through a skeleton analysis module as shown in FIG. 3, and motion analysis module (Motion Analysis) Module) can have a structure to store the result data analyzed through the musculoskeletal information DB (Musculoskeletal Health DB), the collected data can be used as VR-based training content (VR Training Content) resource data.

Depth cameras are largely divided into three types: stereo vision, structured pattern, and ToF (Time of Flight).

The stereo vision method combines two 2D image sensors as shown in (a) of FIG. 4 to obtain depth information by using a viewpoint discrepancy between the cameras. The operating range for effective depth information detection is up to 3 meters.

The structured pattern method is an optical 3D scanning method as shown in Fig. 4(b), and uses a triangulation algorithm to convert the distortion of the projected pattern due to surface roughness into 3D information and detect depth information through it. .

The ToF (Time of Flight) method uses a light source located in the near-infrared part of the optical spectrum as shown in Fig. 4(c), and the in phase receptor operates when the optical signal is on, and the out phase receptor operates when the optical signal is off. The depth information is detected through the period and the time interval when the optical signal hits an object and returns. In the case of ToF, it is suitable for real-time acquisition and analysis of musculoskeletal motion data because it enables high-speed real-time image processing, less noise due to lighting changes than stereo vision or structured pattern methods, and no errors in image processing-based depth information such as textureless or occlusion. .

In an embodiment of the present invention, a depth camera of Orbbec using a ToF sensor was used to acquire musculoskeletal motion data.

Based on the image, human body joints are marked as joints, the coordinates corresponding to the X-axis and Y-axis of each joint are analyzed, and the coordinates corresponding to the Z-axis of the joint are analyzed through depth information. The location information of the joint is derived from the world coordinate system. In order to obtain motion data of one frame, a skeleton is formed by collecting a number of joint information.

The standard DB 30 is a configuration in which a standard work operation matched to the measured VR content is stored.

The standard DB 30 may be constructed in a way that a normal person acquires a work motion through the motion sensor 20 while wearing the VR device 10.

The state measurement server 40 is a component that measures the user's musculoskeletal health state by comparing and analyzing the user's work motion acquired by the motion sensor 20 and the standard work motion stored in the standard DB 30.

In one embodiment of the present invention, the state measurement server 40 is a user's motion acquired from the motion sensor 20 for musculoskeletal motions centered on a specific body part determined based on the exposure weight of a body risk factor related to agricultural work. And the standard DB 30 is configured to compare and analyze by determining the matching rate.

Table 2 below summarizes specific body parts (joints) related to agricultural work that are the subject of comparative analysis in the condition measurement server 40.

Joint name number Joint name number Joint name number Head 0 L Hand 7 L Knee 14 BaseSpine One Spine 1 8 L Foot 15 R Shoulder 2 Root Spine 9 R Wrist 16 R Elbow 3 R Hip 10 L Wrist 17 R Hand 4 R Knee 11 Neck 18 L Shoulder 5 R Foot 12 R Hand Grip 19 L Elbow 6 L Hip 13 L Hand Grip 20

On the other hand, in an embodiment of the present invention, the condition measurement server 40 determines the specified specific body part (joint) according to a predetermined standard, a Keypoint Joint, a target joint, and a relation joint. And a Concern Joint, and the addition point is different for each classification to be compared and analyzed.

In other words, for accurate evaluation of the musculoskeletal condition, the keypoint joint, which is the most important to check the musculoskeletal condition, the target joint, which is a target joint of the musculoskeletal but may not necessarily be the main element of the motion, and the severity of performance success and failure. It is classified as a relation joint to be judged, a concern joint that supports the performance of the movement and can affect the movement and goal achievement.

In the case of shoulder check, the elbow has a range of motion of ±90° horizontally and ±180° vertically, including errors. Therefore, in the Elbow Joint, 1/4 of the sphere in space is the moving area, and for classification purposes, the condition is determined as'low' for 45° or less,'normal' for 45° or more and 120°, and'high' for 120° or more. can do.

For example, when the final evaluation score is 100pt by combining the movement and achievement rate of each joint, 50pt is allocated to the Keypoint Joint, 10pt to the Relation Joint, and 20pt to the Concern Joint. The goal achievement score is handled together when the Relation Joint reaches the content goal.

In the case of Keypoint Joint, it is divided into 3 stages, and is calculated as the sum of 15pt for'Low', 15pt for'Normal', and 20pt for'High'.

Relation Joint is a measure that can determine the speed of motion in addition to achieving the goal when a certain number of times must be successful during a limited time, so performance evaluation is reflected together. The sum of the acquired points distributed by 10pt each taking into account the time limit, the number of achievements, and the difficulty of the operation becomes a partial score.

Concern Joint is an item to determine whether it has influenced the goal achievement regardless of the target joint. Add up the scores. If the Concern Joints are out of range, it is possible to estimate postural imbalance or a disease of the body part.

For example, 30pt + (10pt+(10pt+10pt+7pt)) + (10pt+10pt) for normal difficulty in which all 10 successes in 40 seconds within a 1 minute time limit by moving the elbow to a normal level through measurement VR content ) = 87pt.

The feedback server 50 is a component that provides the user with a feedback corresponding to the user's musculoskeletal health state measured by the condition measurement server 40.

The feedback provided by the feedback server 50 may be the opinion of an expert, and as in an embodiment of the present invention, it may be configured to provide a training VR content capable of training to prevent musculoskeletal diseases as feedback to a user.

The user can prevent musculoskeletal diseases by training the training VR content provided from the feedback server 50 through the VR device 10.

Measurement VR content for measuring musculoskeletal health status and training as feedback The work movements of multiple users through VR content are delivered to a big data analysis platform, and are linked with elemental information such as farmers' life patterns and average health information to analyze health status. Can be used as element information.

The virtual reality-based musculoskeletal health state measurement system described above and illustrated in the drawings is only one embodiment for implementing the present invention and should not be construed as limiting the technical idea of the present invention. The scope of protection of the present invention is determined only by the matters described in the following claims, and the improved and modified embodiments without departing from the gist of the present invention will be apparent to those of ordinary skill in the technical field to which the present invention belongs. It will be said that it belongs to the scope of protection of the present invention.

10 VR device
20 Motion sensor
30 Standard DB
40 Condition Measurement Server
50 Feedback Server

Claims (6)

A VR device equipped with a measurement VR content that induces a user to perform a plurality of repetitive work operations having different difficulty levels in a virtual reality environment;
A motion sensor capable of acquiring a work motion of a user using the VR device;
A standard DB in which standard operation operations matched with the measured VR content are stored;
A state measurement server for measuring a user's musculoskeletal health state by comparing and analyzing a user's work motion acquired from the motion sensor and a standard work motion stored in the standard DB; Including,
The user using the VR device is a farmer, and the measured VR content induces the user to perform repeated farming operations for each crop in a virtual reality environment,
The condition measurement server compares and analyzes a specific body part determined based on the exposure weight of a body risk factor related to agricultural work,
The condition measurement server categorizes the specified body parts into Keypoint Joint, Target Joint, Relation Joint, and Concern Joint according to predetermined criteria, and additional points for each classification Virtual reality-based musculoskeletal health state measurement system, characterized in that the comparison and analysis by different. The method of claim 1,
A feedback server for providing a user with a feedback corresponding to the user's musculoskeletal health state measured by the condition measurement server; Virtual reality-based musculoskeletal health state measurement system, characterized in that it further comprises. The method of claim 2,
The feedback server is a virtual reality-based musculoskeletal health state measurement system, characterized in that it provides the user with a training VR content capable of preventing musculoskeletal diseases as feedback. delete delete delete

Images