KR102563386B1 - Smart safety electric walkers mounted augmented reality displays for seniors - Google Patents

Abstract

The present invention relates to a smart safety electric walker equipped with an augmented reality display for seniors, comprising: at least two or more wheels installed at the bottom; a driving unit and a braking unit electrically connected to the wheel; a lower frame connecting the wheel and the drive unit; and an upper frame extending vertically from the lower frame, supporting a handle, and connected to the braking unit; a pair of handles provided on both sides of the top of the upper frame, equipped with biosignal collection sensors, and spaced apart from each other; an AR display unit provided in an area between the pair of handles and installed on the upper frame of the body unit; a sensor unit including a GPS sensor, a gyroscope sensor, and an acceleration sensor included in the body unit; and a control unit built into the main body unit, wherein the control unit collects at least one of information about the speed, impact amount, shaking, height, rotation, and inclination of the walker from the sensor unit, and stores it in daily life. At least one of the collected information on the speed, impact received, shaking, height, rotation, and tilt of the walker is compared with at least one of the information on the speed, impact received, shaking, height, rotation, and tilt of the walker collected in the fall situation. The present invention relates to an AR smart safety electric walker equipped with an augmented reality display for seniors, which determines whether a fall accident has occurred according to a preset algorithm.

Description

SMART SAFETY ELECTRIC WALKERS MOUNTED AUGMENTED REALITY DISPLAYS FOR SENIORS}

The present invention relates to a method for providing a smart safety electric walker equipped with an augmented reality display for seniors, and more particularly, a bio-signal detection sensor, a gyro sensor, etc. are mounted to obtain user information and to obtain user information based on the obtained data. The present invention relates to a walker that provides healthcare services to people and effectively assists the walking of senior (elderly) users by utilizing an AR display.

Walkers are devices that help people with walking difficulties to walk, and among them, adult walkers are mainly developed for the elderly, the disabled, and patients who have difficulty walking on their own.

However, this type of walker loses its ability to assist walking when the inclination increases, is difficult to use in places with complicated traffic, restricts the user's ability to move their arms normally, causes their posture to bend forward, and cannot be used on stairs.

In addition, the ability to assist walking is reduced on a slope. To compensate for this, an electric walker was developed, and a walker equipped with a brake was developed for safety on a steep slope.

Recently, augmented reality content can further increase the effect of reality by synthesizing graphics on the basis of the real world and reinforcing information obtained with both eyes in reality.

Augmented reality technology has emerged and developed to assist with real-world tasks such as airplane manufacturing processes, medical care, and training. As a result, it has been proven that augmented reality technology can increase the efficiency of certain tasks by placing 3D graphics on real objects.

Therefore, by grafting augmented reality technology to a walker and providing a walker for seniors, not only effectively assists walking using augmented reality, but also develops a system that utilizes information collected through mounted sensors to prevent crisis, health A technology capable of providing content such as care, data communication, and data analysis is required.

Registered Patent Publication No. 10-1731210 (2017.04.27.)

An object of the present invention is to solve the above-mentioned problems of the prior art, and to propose an improved walker for the elderly by adding functions that could not be provided in existing walkers.

First, it is equipped with an AR display so that senior users with poor cognitive abilities can provide efficient route guidance services when moving.

In addition, since a simple fall accident occurring in an existing walker can be fatal to seniors, it includes a configuration for requesting help from passers-by or guardians so that seniors can respond as quickly as possible in an emergency.

In addition, the collected bio-signals are stored, analyzed through artificial intelligence, and data is transmitted to the guardian through the mobile app provided to the user's terminal, and the analyzed information is used for digital healthcare and medical care, and information By further developing usable contents, we can expect the effect of a multifunctional smart electric walker.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood from the description below.

As a technical means for achieving the above-described technical problem, a smart safety electric walker equipped with an augmented reality display for seniors according to an embodiment of the present invention includes at least two or more wheels installed at the bottom; a driving unit and a braking unit electrically connected to the wheel; a lower frame connecting the wheel and the drive unit; and an upper frame extending vertically from the lower frame, supporting a handle, and connected to the braking unit; a pair of handles provided on both sides of the top of the upper frame, equipped with biosignal collection sensors, and spaced apart from each other; an AR display unit provided in an area between the pair of handles and installed on the upper frame of the body unit; a sensor unit including a GPS sensor, a gyroscope sensor, and an acceleration sensor included in the body unit; and a control unit built into the main body unit, wherein the control unit collects at least one of information about the speed, impact amount, shaking, height, rotation, and inclination of the walker from the sensor unit, and stores it in daily life. At least one of the collected information on the speed, impact received, shaking, height, rotation, and tilt of the walker is compared with at least one of the information on the speed, impact received, shaking, height, rotation, and tilt of the walker collected in the fall situation. Thus, it may be determined whether a fall accident has occurred according to a preset algorithm.

In addition, the upper frame and the lower frame may be formed to have a hollow center and have a predetermined thickness of a cylindrical structure, and a lead wire electrically connecting the wheel, the driving unit, and the braking unit may be embedded in the empty space. there is.

In addition, the control unit receives the user's heart rate and breathing information from the biosignal collection sensor, receives GPS information and movement distance information about a place where the walker is currently located from the GPS sensor, and receives an impulse received from the gyroscope sensor. , information on shaking, height, rotation, and inclination may be received, and information on speed and acceleration of the walker may be received from the acceleration sensor.

In addition, the AR display unit includes a camera for capturing the same direction as the user's front view, a speaker, and a display panel for displaying a screen, and includes healthcare contents, navigation contents, game contents, emergency response contents, and A user interface may be provided through the AR display unit.

In addition, the control unit receives and analyzes the user's heart rate, breathing rate, and moving distance from the biosignal collection sensor and the GPS sensor, and when at least one of the heart rate, breathing rate, and moving distance of a preset value is observed, the AR It may be to provide the healthcare content that outputs a message recommending a break through the display unit as an augmented reality image to the AR display unit.

In addition, the control unit controls to display a navigation guide image for a destination set by the user in augmented reality through the AR display unit, by performing machine learning on route information that the user has moved in the past, and moving the most. To provide the navigation content that provides a navigation guide image to move on one route, and when the walking course guidance program is executed, the moving distance guided according to the navigation content, the amount of exercise set by the user, and the user's heart rate and respiratory rate In consideration of this, additional route guidance may be provided to fill the required amount of exercise, or rest guidance may be provided when it is determined that a break is necessary.

Also, the control unit may provide a user interface for selecting and executing the navigation content, the healthcare content, and the game content.

In addition, the control unit may provide the game content by executing a game program stored in the main body unit.

In addition, when the angular velocity measured by the sensor unit is equal to or greater than a preset threshold value, the controller sequentially determines whether the acceleration measured by the sensor unit is equal to or greater than a preset threshold value, and if the angular velocity is greater than or equal to the preset threshold value, the angle measured from the sensor unit is determined. It may be determined whether is greater than a preset threshold value, and if it is greater than, it is determined that the user has fallen from the walker, and the emergency handling content requesting a response input from the user may be provided.

In addition, when it is determined that the user has fallen, the controller sequentially determines whether the average acceleration measured by the sensor unit for a preset period is equal to or less than a preset threshold, and if it is equal to or less than the average acceleration measured for the preset period It is determined whether the angular velocity is less than or equal to a preset threshold value, and if it is less than or equal to, it is determined whether the average angle measured during a preset period of time is less than or equal to a preset threshold value, and if it is less than or equal to, the user is considered to be in a state where the user is lying without movement after a fall occurs. Therefore, it may be determined that it is an emergency situation, and a response input may be requested from the user.

In addition, when a fall accident occurs, the control unit detects an emergency situation, and a response input is not received from the user, the control unit provides the emergency response content, but the emergency response content is provided to the guardian terminal when the current accident situation occurs. It provides GPS information of the location and a message informing that it is an accident situation, transmits the user's identity, the GPS information and a message informing that it is an accident situation to the 119 rescue team or police station, and the accident situation at the largest output volume through the speaker of the AR display unit. It may be to call for help by notifying the occurrence of this by voice.

In addition, the guardian terminal interworks with the walker through a mobile application, receives and stores GPS information, bio-signal information, and emergency occurrence signal collected from the walker, and through the mobile application, the GPS information, bio-signal information and An emergency occurrence signal may be displayed on the screen of the guardian terminal.

According to an embodiment of the present invention, a method for providing a fall detection system for seniors includes: a smart safety motorized walker equipped with an augmented reality display for seniors includes at least two or more wheels installed at the bottom; a driving unit and a braking unit electrically connected to the wheel; a lower frame connecting the wheel and the drive unit; and an upper frame extending vertically from the lower frame, supporting a handle, and connected to the braking unit; a pair of handles provided on both sides of the top of the upper frame, equipped with biosignal collection sensors, and spaced apart from each other; an AR display unit provided in an area between the pair of handles and installed on the upper frame of the body unit; a sensor unit including a GPS sensor, a gyroscope sensor, and an acceleration sensor included in the body unit; and a control unit built into the main body unit, comprising: (a) collecting at least one of information about speed, impact amount, shaking, height, rotation, and inclination of the walker from the sensor unit; (b) At least one of previously stored information on the speed, impact, shake, height, rotation, and tilt of the walker collected in daily life and the speed, impact, shake, height, rotation, and tilt of the walker collected in a fall situation Comparing at least one of the information about and determining whether a fall accident has occurred according to a preset algorithm; and (c) if it is determined that a fall accident has occurred, determining whether it is an emergency situation and providing emergency response content.

In addition, in the step (a), the control unit receives the user's heart rate and breathing information from the biosignal collection sensor, and receives GPS information and movement distance information about a place where the walker is currently located from the GPS sensor, Information about the amount of impact, shaking, height, rotation, and inclination received from the gyroscope sensor may be received, and information about speed and acceleration of the walker may be received from the acceleration sensor.

In the step (b), when the angular velocity measured by the sensor unit is equal to or greater than a predetermined threshold value, the control unit sequentially determines whether the acceleration measured by the sensor unit is greater than or equal to a predetermined threshold value, and if it is greater than or equal to, It is determined whether the angle measured by the sensor unit is greater than or equal to a predetermined threshold value, and if it is greater than or equal to, it is determined that the user has fallen from the walker, and the emergency handling content requesting a response input from the user may be provided.

In the step (c), when the controller determines that the user has fallen, sequentially determines whether the average acceleration measured by the sensor unit for a preset period is equal to or less than a preset threshold value, and if it is equal to or less than the preset threshold value, It is determined whether the average angular velocity measured during the period is less than or equal to a predetermined threshold value, and if it is less than or equal to, it is determined whether the average angular velocity measured during the predetermined period is less than or equal to a predetermined threshold value, and if it is less than or equal to, it is determined that the user has not moved since the fall occurred. Considering that it is in a collapsed state, it is determined that it is an emergency situation, and a response input may be requested from the user.

Further, in the step (c), when a fall accident occurs, an emergency situation is detected by the control unit, and a response input is not received from the user, the control unit provides the emergency response content, but the emergency response content is provided to the guardian. The terminal provides GPS information of the current accident situation and a message informing that the accident situation occurred, transmits the user's identity, the GPS information, and a message informing that the accident situation is transmitted to the 119 rescue team or police station, and displays the most You can call for help from the surroundings by notifying the occurrence of an accident with a loud volume.

The method may further include (d) providing a user interface through which the control unit selects and executes navigation contents, healthcare contents, and game contents.

In addition, in the step (d), the control unit controls to display a navigation guide image for a destination set by the user in augmented reality through the AR display unit, but performs machine learning on route information that the user has traveled in the past. When the walking course guide program is executed, the movement distance guided according to the navigation content, the amount of exercise set by the user, In consideration of the user's heart rate and respiratory rate, additional route guidance may be provided to fill the required amount of exercise, or rest guidance may be provided when it is determined that a break is necessary.

In the step (d), the control unit receives and analyzes the user's heart rate, respiration, and moving distance from the biosignal collection sensor and the GPS sensor, and at least one of heart rate, breathing rate, and moving distance equal to or greater than a preset value. When is observed, the healthcare content that outputs a message recommending a break as an augmented reality image to the AR display unit may be provided through the AR display unit.

In the step (d), the control unit may provide the game content by executing a game program stored in the body unit.

In the present invention, the walker does not stop at assisting walking, but it can provide comprehensive health care and medical care services by analyzing collected user information (biological signal information, GPS information, gyro sensor information) with AI.

In addition, it is designed to cope with an emergency by detecting a fall accident, and the user's safety can be guaranteed through an emergency response function that conventional walkers cannot provide.

Furthermore, by providing augmented reality content and voice guidance through an augmented reality display mounted on a walker, it is possible to effectively provide route guidance to seniors with poor cognitive abilities.

In this process, the collected and analyzed data can be reported to the user or guardian through an application installed on the terminal owned by the user, and through this, it is possible to quickly grasp what situation the senior is in.

1 is an exemplary view of a smart safety electric walker and a guardian terminal equipped with an augmented reality display for seniors according to an embodiment of the present invention.
Figure 2 is an exemplary view of a smart safety motorized walker equipped with an augmented reality display for seniors according to an embodiment of the present invention.
3 is a block diagram showing the internal configuration of a control unit according to an embodiment of the present invention.
4 is a block diagram showing the internal configuration of a sensor unit according to an embodiment of the present invention.
5 is a flowchart illustrating a sequence of performing emergency response content according to an embodiment of the present invention.
6 is a flowchart illustrating operations of providing a user interface and providing contents according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail so that those skilled in the art can easily practice the present invention with reference to the accompanying drawings. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected" but also the case where it is "electrically connected" with another element interposed therebetween. . In addition, when a certain component is said to "include", this means that it may further include other components without excluding other components unless otherwise stated.

In this specification, a "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized using two or more hardware, and two or more units may be realized by one hardware. On the other hand, '~ unit' is not limited to software or hardware, and '~ unit' may be configured to be in an addressable storage medium or configured to reproduce one or more processors. Therefore, as an example, '~unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables. Functions provided within components and '~units' may be combined into smaller numbers of components and '~units' or further separated into additional components and '~units'. In addition, components and '~units' may be implemented to play one or more CPUs in a device or a secure multimedia card.

The "guardian terminal" referred to below may be implemented as a computer or portable terminal capable of accessing a server or other terminals through a network. Here, the computer is, for example, a laptop, desktop, laptop, VR HMD (for example, HTC VIVE, Oculus Rift, GearVR, DayDream, PSVR, etc.) equipped with a web browser, etc. can include Here, the VR HMD is for PC (for example, HTC VIVE, Oculus Rift, FOVE, Deepon, etc.), for mobile (for example, GearVR, DayDream, Stormtrooper, Google Cardboard, etc.), and for console (PSVR) and It includes all independently implemented Stand Alone models (eg, Deepon, PICO, etc.). A portable terminal is, for example, a wireless communication device that ensures portability and mobility, and includes not only a smart phone, tablet PC, and wearable device, but also Bluetooth (BLE, Bluetooth Low Energy), NFC, RFID, and ultrasonic waves (Ultrasonic). , various devices equipped with communication modules such as infrared, Wi-Fi, and LiFi. In addition, "network" refers to a connection structure capable of exchanging information between nodes such as terminals and servers, such as a local area network (LAN), a wide area network (WAN), and the Internet. (WWW: World Wide Web), including wired and wireless data communications networks, telephone networks, and wired and wireless television communications networks. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, infrared communication, ultrasonic communication, visible light communication (VLC: Visible Light Communication), LiFi, and the like, but are not limited thereto.

First, referring to FIG. 1, a smart safety electric walker equipped with an augmented reality display for seniors according to an embodiment of the present invention will be described.

A smart safety electric walker equipped with an augmented reality display for seniors according to an embodiment of the present invention provides a smart safety walker equipped with an AR display for seniors who have difficulty walking due to lack of muscle strength to prevent falls accidents. This is a technology for minimizing the damage caused by a fall accident to the user by detecting and linking the walker with the terminal owned by the senior's guardian to inform the guardian that the user of the walker is in an emergency through the guardian's terminal 400.

To this end, the guardian terminal 400 can communicate with the walker by wire/wireless connection, and can transmit/receive information to and from the walker in conjunction with the walker through an application or program.

Referring to FIG. 2, the smart safety electric walker equipped with an augmented reality display for seniors has at least two or more wheels 110 installed at the bottom, and a driving unit 120 and a braking unit electrically connected to the wheels 100. (130).

Each wheel 110 and the drive unit 120 are connected through a lower frame 140 and may be connected to an upper frame 150 extending vertically from the lower frame 140 .

At this time, the upper frame 150 and the lower frame 140 have empty centers and are formed to have a predetermined thickness in a cylindrical structure, and the wheel 110, the drive unit 120 and the brake unit are placed in the empty space in the center of the frame. Conductive wires electrically connecting the 130 to each other may be internal.

The driving unit 120 and the braking unit 130 serve to move and brake the walker according to a user's manipulation, and may operate by consuming power or fuel.

The body unit 160 may include an upper frame 150, a control unit 200, a handle 170, a braking unit 130, an AR display unit 180, and a sensor unit 190.

The upper frame 150 is provided on both sides of the top of the upper frame 150, has a built-in biosignal collection sensor, supports a pair of handles 170 disposed spaced apart from each other, and is perpendicular to the handle 170 in a downward direction. It is connected to the braking unit 130 formed at a predetermined interval.

The AR display unit 180 is connected to the upper frame 150 or the body unit 160 and installed in one area between the pair of handles 170 .

The AR display unit 180 includes a camera 181 that captures the same direction as the user's front view, a speaker, and a display panel that displays a screen, and includes healthcare contents, navigation contents, and game contents received from the controller 200. , emergency response contents and user interface can be provided through the display panel.

The sensor unit 190 may include a GPS sensor 191, a gyroscope sensor 192 and an acceleration sensor 193, and may be installed on the outer surface of the upper frame 150 or in the inner space of the upper frame 150. can be installed

In addition, the body unit 100 includes a controller 200, and the controller 200 collects at least one of information about the speed, amount of impact received, shaking, height, rotation, and inclination of the walker from the sensor unit 190. can

In addition, the control unit 200 receives the user's heart rate and breathing information from the biosignal collection sensor built into the handle 170, and receives GPS information and movement distance information about the place where the walker is currently located from the GPS sensor 191. Information about the amount of impact, shaking, height, rotation, and inclination received by the walker can be received from the gyroscope sensor 192.

Similarly, information on the speed and acceleration of the walker may be received from the acceleration sensor 193 .

In addition, the control unit 200 provides information on the speed, received impact, shake, height, rotation, and tilt of the walker collected in daily life and information on the speed, received impact, shake, height, rotation, and tilt of the walker collected in a fall situation. It may be that the information is already stored.

Through this, the controller 200 may compare a plurality of pieces of information measured in each situation and determine whether a fall accident has occurred according to a preset algorithm.

The control unit 200 according to an embodiment of the present invention may include a memory in which a program (or application) for controlling a smart safety electric walker equipped with an augmented reality display for seniors is stored and a processor executing the above program. there is. Here, the processor may perform various functions according to the execution of programs stored in memory.

Referring to FIG. 3 , the control unit 200 of the present invention includes a fall accident determination unit 210, an emergency determination unit 220, a content providing unit 230, and a user interface providing unit 240.

The fall accident determination unit 210 serves to detect a fall accident, which is an accident in which the user falls off the walker, based on information received from the sensor unit 190 .

When a fall accident occurs, the emergency determination unit 220 determines whether an emergency has occurred to the user based on information received from the sensor unit 190 .

The fall accident determination and the method of performing the emergency determination will be described in detail later.

The content provider 230 may provide healthcare content, navigation content, game content, and emergency response content.

For healthcare content, the control unit 200 receives the user's heart rate and breathing rate from the bio-signal collection sensor built into the handle 170, receives and analyzes the moving distance from the GPS sensor 191, and measures the heart rate over a preset value. , Respiratory rate and moving distance are observed, it may be to output a message recommending a break through the AR display unit 180 to the AR display unit 180 as an augmented reality image.

For the navigation content, the navigation guide image for the destination set by the user is displayed in augmented reality through the AR display unit 180, and machine learning is performed on route information that the user has traveled in the past, so that the route traveled the most. It may be to provide a navigation guide image to move to .

In addition, when the user selects the walking course guide through the user interface, the walking course guide program is executed, and the moving distance guided according to the navigation content, the amount of exercise set by the user, and the user's heart rate and breathing rate per minute or second are displayed. In consideration of this, a function of providing additional route guidance to fill a required amount of exercise or providing rest guidance when it is determined that a break is necessary may be provided.

The game content may be provided by executing a game program stored in the controller 200, and may be played by manipulating the AR display unit 180.

The user interface providing unit 240 is provided as a display panel of the AR display unit 180, and a user can select and execute navigation contents, healthcare contents, and game contents by manipulation.

In the case of emergency response content, it may be always provided even if the user does not set it through the user interface, and according to an additional embodiment of the present invention, both the guardian terminal 400 and the walker accept consent to stop providing In this case, it may be to temporarily stop execution for a preset time.

A detailed description of the provision of emergency response contents will be described later.

Referring to FIG. 4 , the sensor unit 190 according to an embodiment of the present invention may include a GPS sensor 191, a gyroscope sensor 192, and an acceleration sensor 193.

Since the GPS sensor 191 is included in the sensor unit 190, it may be installed inside or outside the upper frame 150, collect information about the location of the walker, and provide it to the control unit 200.

The gyroscope sensor 192 may be installed inside or outside the upper frame 150, collect information about angular velocity generated as the walker moves, and provide the information to the control unit 200.

The acceleration sensor 193 may also be installed inside or outside the upper frame 150, collect information on acceleration generated as the walker moves, and provide the information to the control unit 200.

Hereinafter, a method for detecting a fall of a user and determining an emergency situation by the fall accident determination unit 210 and the emergency determination unit 220 of the control unit 200 according to an embodiment of the present invention will be described.

First, the sensor unit 190 includes acceleration values, angular velocity values, and angle values generated while the walker moves through the GPS sensor 191, the gyroscope sensor 192, and the acceleration sensor 193 included in the sensor unit 190. can measure

The sensor unit 190 measures the angular velocity of the walker through the gyroscope sensor 192, and measures the acceleration and angle of the walker through the acceleration sensor 193 and transmits them to the fall accident determination unit 210, thereby resulting in a fall accident. The determination unit 210 may determine the postures of the user riding the walker and the walker.

At this time, the angle of the walker is measured using the gravity and acceleration sensor 193, and the angle can be measured using the acceleration value measured from the acceleration sensor 193 and gravity, that is, gravitational acceleration.

The measurement of the angle using the acceleration uses the angle between gravity and the upper frame 150 because the change in angle also occurs when there is a change in acceleration due to motion.

The upper frame 150 according to an embodiment of the present invention is formed perpendicular to the ground surface. At this time, assuming that the axis formed by the upper frame 150 is the X axis, in an ideal case, the angle between the upper frame 150 and gravity forms 180°.

In the case of assuming the X axis as described above, if the X axis and the vertical axis are formed, the Y axis and the X axis and the Y axis meet at one point and are parallel to the Z axis can be naturally assumed.

Therefore, when a measuring object, that is, a walker lies down or collapses horizontally with the ground, the angle between gravity and the X-axis approaches 90°. Accordingly, when a fall occurs, it is possible to detect that the object has fallen or collapsed through the angle of the object.

In the present invention, in measuring the angle, a plurality of samples are collected and an average value between the samples is used, which is referred to as an average angle value.

In this process, the number of samples to be measured may be flexibly changed, and may be set to an appropriate number according to the performance and conditions of the plurality of sensors included in the sensor unit 190 mounted on the walker.

Hereinafter, for convenience of description, the average angle value is described as an angle value, the average angular velocity value as an angular velocity value, and the average acceleration value as an acceleration value.

The fall accident determination unit 210 according to an embodiment of the present invention first starts to determine whether a fall accident has occurred through the angular velocity value collected from the gyroscope sensor 192 and a predetermined threshold value.

Thereafter, the determination is continued through the acceleration value and the angle value collected from the acceleration sensor 193.

In the fall behavior, the change in angular velocity appears first. Therefore, after the determination based on the angular velocity value, the acceleration value is determined, and when the angular velocity value is greater than or equal to the threshold value, the acceleration value is determined next, and then the angle value is determined.

At this time, since each value used for the determination uses an average value for a preset period or a preset number of samples, the change in the angle value may appear slower than the angular velocity and acceleration, so the angle value is determined last.

When both the measured angular velocity value and the acceleration value exceed the threshold value, and the average angle value among the measured sample data exceeds the threshold value, it is determined that a fall accident has occurred. That is, after a large change in angular velocity and acceleration, the final posture of the object may be judged to determine the final fall.

In addition, since the present invention collects the angular velocity and acceleration with a plurality of samples and periods between the collecting processes, by detecting a predetermined period between the collection of the angular velocity value and the collection of the acceleration value, the two values are separated by a time interval. It is also possible to detect in real time when changes are made with .

Next, a method for the emergency determination unit 220 according to an embodiment of the present invention to determine a user's emergency will be described below.

The walker of the present invention checks the movement of the target after a fall accident has occurred in order to determine an emergency situation.

In this case, if the object is recognized as being in a state of being knocked down without movement after a fall accident, it may be determined as an emergency situation.

To this end, the emergency determination unit 220 according to an embodiment of the present invention checks the acceleration value, angular velocity value, and angle value of the sample measured within a predetermined time after the fall is detected.

First, it is determined whether the measured acceleration value of the sample is less than a predetermined threshold value.

When the measured acceleration value is less than a predetermined threshold value, it is determined whether the angular velocity value is less than the threshold value.

When the angular velocity value is also smaller than the threshold value, it is finally determined whether the value of the state in which the angular velocity value is greater than the threshold value is maintained for a predetermined time or longer.

When a state in which the angle value is greater than the threshold value is observed for a predetermined period of time or longer, the user's state is determined to be an emergency situation.

According to another embodiment of the present invention, the above-described processes of determining an acceleration value, determining an angular velocity value, and determining an angular value may be simultaneously performed.

According to an additional embodiment of the present invention, when a state in which the angle value is greater than the threshold value is observed for a predetermined period of time or longer, an operation of requesting a response signal from the user may be performed before determining the user's state as an emergency situation. .

In this case, it is determined that an emergency has occurred when the user's response signal is not additionally input within a preset time after the above-described process.

In addition, according to an additional embodiment of the present invention, after the above-described process, before determining the user's condition as an emergency, a process of detecting an abnormal heart rate may be additionally performed.

If a response signal from the user is not input within a preset time through the biosignal sensor built into the handle 170, the user's heart rate may be immediately measured to classify an emergency situation according to the condition.

Through the above process, if it is determined that the user's situation is an emergency, the heart rate is measured, and if the heart rate is higher or lower than a preset normal heart rate, it is determined as emergency A. Therefore, emergency A is to inform the medical center or guardian terminal 400 that an emergency situation has been detected and that an abnormal heart rate has occurred, and to provide emergency response contents so that more rapid and appropriate measures can be taken.

Through the above-described process, it is determined that the user's situation is an emergency situation, but when the user moves away from the walker and the heart rate is not measured, it is determined as an emergency situation B.

Emergency B is a situation in which a fall and an emergency are detected, but the heart rate is normal or the user's heart rate is not detected. It is to provide emergency response contents so that you can take action more quickly and appropriate to the condition of the target.

Emergency response content provides a message informing that the current accident situation and GPS information of the location where the accident situation occurred to the guardian terminal 400, and informs the 119 rescue team or police station of the user's identity and GPS information about the location and accident situation It may be to send a message and request help from the surroundings by notifying by voice that an accident situation occurs through the speaker of the AR display unit 180 with the largest output volume.

Referring to FIG. 5, the order of providing emergency response contents according to the present invention is as follows.

A smart safety electric walker equipped with an augmented reality display for seniors according to an embodiment of the present invention acquires data generated from the movement of the walker (S101).

By analyzing the acquired data, it is determined and detected whether an accident in which the user falls from the walker has occurred (S102).

When it is determined that a fall accident has occurred, it is determined and detected whether an emergency has occurred to the user (S103).

When it is determined that an emergency has occurred, a response signal is requested from the user, and reception of the response signal is waited for a preset time (S104).

If a response signal is not received from the user within a preset time, information on the user's heart rate is collected through the biosignal sensor (S105).

Emergency situations are classified based on the collected information on the user's heart rate, and a procedure suitable for the emergency situation is performed (S106).

Referring to FIG. 6 , the smart safety electric walker equipped with an augmented reality display for seniors according to an embodiment of the present invention may display a user interface on a display panel (S201).

The user can select and receive navigation content from the user interface (S202), and can receive healthcare content based on the user's bio-signal and information collected from the sensor unit 190 even while using the navigation content (S202). S203).

In addition, game contents stored in the control unit 200 or the body unit 100 may be provided by manipulating the user interface (S204).

An embodiment of the present invention may be implemented in the form of a recording medium including instructions executable by a computer, such as program modules executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

Although the methods and systems of the present invention have been described with reference to specific embodiments, some or all of their components or operations may be implemented using a computer system having a general-purpose hardware architecture.

The above description of the present invention is for illustrative purposes, and those skilled in the art can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts should be construed as being included in the scope of the present invention. do.

100: body part 110: wheel
120: driving unit 130: braking unit
140: lower frame 150: upper frame
170: handle 180: AR display unit
181: camera 190: sensor unit
191: GPS sensor 192: gyroscope sensor
193: acceleration sensor 200: control unit
210: fall accident determination unit 220: emergency situation determination unit
230: content providing unit 240: user interface providing unit
400: guardian terminal

Claims (20)

In a smart safety motorized walker equipped with an augmented reality display for seniors,
At least two or more wheels installed on the bottom; a driving unit and a braking unit electrically connected to the wheel; a lower frame connecting the wheel and the drive unit; and an upper frame extending vertically from the lower frame, supporting a handle, and connected to the braking unit;
a pair of handles provided on both sides of the top of the upper frame, equipped with biosignal collection sensors, and spaced apart from each other;
an AR display unit provided in an area between the pair of handles and installed on the upper frame of the body unit;
a sensor unit including a GPS sensor, a gyroscope sensor, and an acceleration sensor included in the body unit; and
Including; a control unit built into the main body unit,
The control unit collects at least one of the information about the speed, the amount of impact received, shaking, height, rotation, and tilt of the walker from the sensor unit, and the speed of the walker, the amount of impact received, shaking, height, At least one of the rotation and inclination information is compared with at least one of the information on the speed, received impact, shaking, height, rotation and inclination of the walker collected in the fall situation to determine whether a fall accident has occurred according to a preset algorithm would,
The AR display unit includes a camera capturing the same direction as the user's front view, a speaker, and a display panel displaying a screen, and includes healthcare contents, navigation contents, game contents, emergency response contents, and a user interface received from the controller. A smart safety electric walker equipped with an augmented reality display for seniors, which provides a through the AR display unit. According to claim 1,
The upper frame and the lower frame have a hollow center, are formed to have a predetermined thickness of a cylindrical structure, and a lead wire electrically connecting the wheel, the driving unit, and the braking unit is embedded in the empty space. A smart safety motorized walker with an augmented reality display for people. According to claim 1,
The control unit
The user's heartbeat and respiration information are received from the bio-signal collection sensor, GPS information and movement distance information about the place where the walker is currently located are received from the GPS sensor, and the amount of shock received from the gyroscope sensor, shaking, height, A smart safety electric walker equipped with an augmented reality display for seniors, which receives information about rotation and inclination, and receives information about speed and acceleration of the walker from the acceleration sensor. delete According to claim 1,
The control unit,
The user's heart rate, breathing rate, and moving distance are received and analyzed from the bio-signal collection sensor and the GPS sensor, and when at least one of the heart rate, breathing rate, and moving distance above a preset value is observed, a break is recommended through the AR display unit. A smart safety electric walker equipped with an augmented reality display for seniors, which provides the healthcare content that outputs a message to the AR display unit as an augmented reality image. According to claim 1,
The control unit,
The navigation guide image for the destination set by the user is controlled to be displayed through the AR display unit in augmented reality, but navigation is performed to move to the route the user traveled the most by performing machine learning on route information traveled in the past. To provide the navigation content that provides a guide image,
When the walking course guide program is executed, additional route guidance is provided to fill the required amount of exercise, or rest is required, in consideration of the movement distance guided according to the navigation contents, the amount of exercise set by the user, and the user's heart rate and respiration rate. A smart safety motorized walker equipped with an augmented reality display for seniors that provides break guidance if it is determined to be appropriate. According to claim 1,
The control unit,
A smart safety electric walker equipped with an augmented reality display for seniors, which provides a user interface for selecting and executing the navigation content, the healthcare content, and the game content. According to claim 7,
The control unit,
A smart safety electric walker equipped with an augmented reality display for seniors, wherein the game content is provided by executing a game program stored in the body unit. According to claim 1,
The control unit,
When the angular velocity measured from the sensor unit is equal to or greater than a preset threshold value, it is sequentially determined whether the acceleration measured from the sensor unit is equal to or greater than a preset threshold value, and if the angular velocity is equal to or greater than the preset threshold value, the angle measured from the sensor unit is equal to or greater than the preset threshold value. A smart safety electric walker equipped with an augmented reality display for seniors, which determines whether or not the user has fallen from the walker and, if abnormal, determines that the user has fallen from the walker, and provides the emergency response content requesting a response input from the user. . According to claim 9,
The control unit,
When it is determined that the user has fallen, it is sequentially determined whether the average acceleration measured from the sensor unit for a preset period is equal to or less than a preset threshold value, and if the average angular velocity measured for a preset period is equal to or less than the preset threshold value It is determined whether it is less than or equal to, and if it is less than or equal to, it is determined whether the average angle measured during a predetermined period is less than or equal to a predetermined threshold value, and if it is less than or equal to, it is regarded as a state in which the user is lying down without movement after a fall, and it is determined that it is an emergency situation. A smart safety electric walker equipped with an augmented reality display for seniors, which determines and requests a response input from the user. According to claim 1,
When a fall accident occurs, the control unit detects an emergency situation, and a response input is not received from the user, the control unit provides the emergency response content, and the emergency response content is provided to the guardian terminal at the location where the current accident occurred. Provides GPS information and a message informing that it is an accident situation, transmits the user's identity and the GPS information, and a message informing that it is an accident situation to the 119 rescue team or police station, and an accident situation occurs at the largest output volume through the speaker of the AR display unit A smart safety motorized walker equipped with an augmented reality display for seniors that calls for help from the surroundings by announcing the situation by voice. According to claim 1,
The guardian terminal interworks with the walker through a mobile application, receives and stores GPS information, bio-signal information, and emergency occurrence signal collected from the walker, and uses the mobile application to receive and store the GPS information, bio-signal information, and emergency situation. A smart safety electric walker equipped with an augmented reality display for seniors, which displays a generated signal on the screen of the guardian terminal. In the senior fall detection method through a smart safety electric walker,
The smart safety electric walker,
At least two or more wheels installed on the bottom; a driving unit and a braking unit electrically connected to the wheel; a lower frame connecting the wheel and the drive unit; and an upper frame extending vertically from the lower frame, supporting a handle, and connected to the braking unit; a pair of handles provided on both sides of the top of the upper frame, equipped with biosignal collection sensors, and spaced apart from each other; an AR display unit provided in an area between the pair of handles and installed on the upper frame of the body unit; a sensor unit including a GPS sensor, a gyroscope sensor, and an acceleration sensor included in the body unit; And a control unit built into the main body; includes,
(a) collecting at least one of information about speed, impact amount, shaking, height, rotation, and inclination of the walker from the sensor unit;
(b) At least one of previously stored information on the speed, impact, shake, height, rotation, and tilt of the walker collected in daily life and the speed, impact, shake, height, rotation, and tilt of the walker collected in a fall situation Comparing at least one of the information about and determining whether a fall accident has occurred according to a preset algorithm; and
(c) if it is determined that a fall accident has occurred, determining whether it is an emergency situation and providing emergency response content;
In step (b),
The control unit, when the angular velocity measured by the sensor unit is equal to or greater than a preset threshold value, sequentially determines whether the acceleration measured by the sensor unit is equal to or greater than a preset threshold value; Senior fall detection through a smart safety electric walker that determines whether it is greater than a set threshold value, determines that the user has fallen from the walker, and provides the emergency response content requesting a response input from the user. method. According to claim 13,
In step (a),
The control unit receives user's heartbeat and respiration information from the biosignal collection sensor, receives GPS information and moving distance information about a place where the walker is currently located from the GPS sensor, and receives shock and shaking from the gyroscope sensor. , height, rotation, and slope information, and receiving information about the speed and acceleration of the walker from the acceleration sensor, a senior fall detection method through a smart safety electric walker. delete According to claim 13,
In step (c),
When the control unit determines that the user has fallen, it sequentially determines whether the average acceleration measured from the sensor unit for a preset period of time is equal to or less than a preset threshold value, and if it is less than or equal to, the average angular velocity measured for a preset period of time is equal to or less than a preset threshold value. It is determined whether it is less than or equal to a threshold value, and if it is less than or equal to, it is determined whether the average angle measured during a preset period of time is less than or equal to a preset threshold value, and if it is less than or equal to, the user is deemed to be in a state where the user is lying down without movement after a fall, in an emergency situation. A senior fall detection method through a smart safety electric walker, which determines that it is, and requests a response input from the user. According to claim 13,
In step (c),
When a fall accident occurs, the control unit detects an emergency situation, and a response input is not received from the user, the control unit provides the emergency response content, and the emergency response content is provided to the guardian terminal at the location where the current accident occurred. Provides GPS information and a message informing that it is an accident situation, transmits the user's identity and the GPS information, and a message informing that it is an accident situation to the 119 rescue team or police station, and an accident situation occurs at the largest output volume through the speaker of the AR display unit A method for detecting senior falls through a smart safety motorized walker, which calls for help from the surroundings by notifying the person of the fall by voice. According to claim 13,
(d) providing, by the control unit, a user interface for selecting and executing navigation contents, healthcare contents, and game contents; According to claim 18,
In step (d),
The control unit controls to display a navigation guide image for a destination set by the user in augmented reality through the AR display unit, and performs machine learning on route information that the user traveled in the past to perform the most traveled route. To provide the navigation content that provides a navigation guide image to move to,
When the walking course guide program is executed, additional route guidance is provided to fill the required amount of exercise, or rest is required, in consideration of the movement distance guided according to the navigation contents, the amount of exercise set by the user, and the user's heart rate and respiration rate. A method for detecting senior falls through a smart safety motorized walker, which provides break guidance if it is determined to be the case. According to claim 18,
In step (d),
The control unit receives and analyzes the user's heart rate, breathing rate, and moving distance from the bio-signal collection sensor and the GPS sensor, and when at least one of the heart rate, breathing rate, and moving distance of a preset value is observed, the AR display unit A method for detecting a senior fall through a smart safety electric walker, wherein the healthcare content is provided by outputting a message recommending rest as an augmented reality image to the AR display unit.

Images