WO2019206177A1

WO2019206177A1 - Intelligent navigation method and device for lost alzheimer's patients

Info

Publication number: WO2019206177A1
Application number: PCT/CN2019/084048
Authority: WO
Inventors: 郑亢; 卢立; 苗成林; 曹启晨; 陈琦; 陈文�; 张小光
Original assignee: 深圳市前海安测信息技术有限公司
Priority date: 2018-04-27
Filing date: 2019-04-24
Publication date: 2019-10-31
Also published as: CN110415353A

Abstract

An intelligent navigation method and device (10) for lost Alzheimer's patients. The method comprises: capturing real-world scene images around an Alzheimer's patient by means of a video recorder (S21); identifying body movement information of the patient from the real-world scene images (S22); determining whether the patient is lost according to the body movement information (S23); when the patient is lost, activating a speaker to play route inquiry information to inquire the patient about current travel destination information (S24); receiving voice answer information of the patient by means of a voice receiver, and identifying the current travel destination information of the patient from the voice answer information (S25); performing matching to obtain a panoramic navigation screen of a route forgotten by the patient from a memory according to the current travel destination information of the patient (S26); presenting the panoramic navigation screen in the form of video navigation on a display screen of the patient to give directions (S27), such that the patient can be guided to the current travel destination. The method can automatically plan a navigation route to give directions when the patient is lost, preventing the patient from being lost.

Description

Intelligent navigation device and method for forgetting route of Alzheimer's disease patients

Technical field

The invention relates to the field of nursing of patients with Alzheimer's disease, in particular to an intelligent navigation device and method for forgetting route of Alzheimer's disease patients.

Background technique

Alzheimer's Disease (AD) is known as Alzheimer's disease. The clinical manifestations are near forgetting, cognitive impairment, visual spatial function impairment, loss of recognition and misuse, especially in patients over 60 years old. The safety risks of the elderly living alone in this disease are even more worrying for their children. With the increase of the elderly population, there will be more Alzheimer's patients in China than any other country in the world. The problem is more prominent. Alzheimer's disease will bring a heavy social and economic burden to our country. Alzheimer's disease often occurs in old age or early age, and the risk of disease increases with age. Memory disorders often occur in the early stages of Alzheimer's disease, especially when the memory impairment is more serious, and the events that occur in a few hours or even minutes before the patient can't be recalled. In the early stages of Alzheimer's disease, it is often manifested as a moment when the mind is awake and there is a situation in which the brain amnesia is almost forgotten. This state is called interstitial brain amnesia. For example, patients cannot remember the daily chores that occur on the day, and do not know their loved ones or friends. Going out of the way to find a home route is easy to lose. Because the patient can not find the way to go home, it is not only easy to lose, but also will produce anxiety, which will further deepen the patient's condition. However, at present, the navigation system needs to manually set the travel destination to plan the travel route. When the Alzheimer's disease patient forgets the route, the current navigation system cannot automatically plan the travel route according to the actual scene of the patient to guide the patient to travel, and thus is not applicable. For Alzheimer's disease travel.

technical problem

The main object of the present invention is to provide an intelligent navigation device and method for forgetting the route of Alzheimer's disease patients, aiming at solving the problem that the existing navigation system cannot automatically plan the travel navigation according to the actual scene of the patient when the Alzheimer's disease patient forgets the route. Technical issues with the route.

Technical solution

To achieve the above object, the present invention provides a forgotten route intelligent navigation device for a patient with Alzheimer's disease, comprising a video recorder, a speaker, a display screen and a voice receiver, the smart navigation device further comprising a plurality of computer program instructions An intelligent navigation system, a processor adapted to implement computer program instructions, and a memory adapted to store computer program instructions, the computer program instructions being loaded by the microprocessor and performing the following steps: acquiring Alzheimer's disease in real time through a video recorder The actual scene image around the patient; the patient's limb movement information is identified from the captured reality scene image; the patient is forgotten according to the limb motion information; when the patient forgets the route, the speaker broadcast route query information is opened to ask the patient for the purpose of the trip. Receiving the voice response information of the patient through the voice receiver, and identifying the current travel destination information of the patient from the voice answer information; and matching the panoramic navigation screen of the patient's forgotten route from the memory according to the current travel destination information of the patient Will be all Navigation screen presented on the video display screen in the form of a navigation guide to a patient reaches this travel destination.

Preferably, the computer program instructions are loaded by the microprocessor and further perform the following steps: controlling the speaker to play the voice route information to assist in guiding the patient's travel route.

Preferably, the panoramic navigation screen stored by the memory is pre-photographed by the guardian and imported into the memory through the USB port of the smart navigation device.

Preferably, the video recorder is a panoramic camera, and the camera of the 360-degree rotating video recorder captures a realistic scene image including a real environment scene and a limb motion information of the patient.

Preferably, displaying the matched panoramic navigation screen on the display screen includes guiding the route arrow to guide the patient to the current travel destination.

In another aspect, the present invention also provides an intelligent navigation method for a forgotten route of a patient with Alzheimer's disease, which is applied to an intelligent navigation device for a forgotten route of an Alzheimer's disease patient, the device comprising a video recorder, a speaker, a display screen, The voice receiver and the memory, the method comprises the following steps: collecting a real scene image of the Alzheimer's disease patient in real time through a video recorder; identifying the patient's limb motion information from the collected reality scene image; judging according to the limb motion information Whether the patient forgets the route; when the patient forgets the route, the speaker broadcast route inquiry information is turned on to inquire the patient's current travel destination information; the voice answer information of the patient is received through the voice receiver, and the patient's current travel destination is identified from the voice answer information. The local information is matched; the panoramic navigation screen of the patient's forgotten route is matched from the memory according to the current travel destination information of the patient; and the panoramic navigation screen is presented on the display screen in the form of video navigation to guide the patient to the current travel destination.

Preferably, the method for intelligently guiding the forgotten route of the Alzheimer's disease patient further comprises the steps of: controlling the speaker to play the voice route information to assist in guiding the patient's travel route.

Beneficial effect

Compared with the prior art, the intelligent navigation device and method for forgetting the route of the Alzheimer's disease patient of the present invention adopts the above technical solution, and achieves the following technical effects: according to the AD patient when the Alzheimer's disease patient forgets the route The real-life scene automatically plans the travel route to guide the route, preventing AD patients from losing when they forget the route.

DRAWINGS

1 is a block diagram showing the structure of a preferred embodiment of the forgotten route intelligent navigation device of the Alzheimer's disease patient of the present invention;

2 is a flow chart of a preferred embodiment of a flow chart of a preferred embodiment of the forgotten route intelligent navigation method for a patient with Alzheimer's disease in accordance with the present invention.

The object, features, and advantages of the invention will be further described in conjunction with the embodiments.

BEST MODE FOR CARRYING OUT THE INVENTION

The specific embodiments, structures, features and functions of the present invention are described in detail below with reference to the accompanying drawings and preferred embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Referring to Fig. 1, Fig. 1 is a block diagram showing the configuration of a preferred embodiment of the forgotten route intelligent navigation device for a patient with Alzheimer's disease of the present invention. In the present embodiment, the Alzheimer's disease forgetting route intelligent navigation device 1 includes, but is not limited to, an Alzheimer's disease forgetting route intelligent navigation system 10, a video recorder 11, a speaker 12, and a display screen 13. , a voice receiver 14, a memory 15, and a microprocessor 16. The video recorder 11, the speaker 12, the display screen 13, the voice receiver 14, and the memory 15 are all connected to the microprocessor 16 via a data bus, and can pass the microprocessor 16 and the Alzheimer's disease. The patient forgets the route intelligent navigation system 10 to perform information interaction. In the present embodiment, the Alzheimer's disease forgetful route intelligent navigation device 1 can be integrated on a device such as a hat, a headband or a helmet worn by a patient with Alzheimer's disease (AD) on the head.

In this embodiment, the video recorder 11 can be a 360-degree panoramic camera or a small panoramic image capturing device for capturing realistic scene images around the patient. The speaker 12 can be a woofer, earphone or other sounding device for playing route query information and voice route information when the AD patient forgets the route. The display screen 13 is used to display a panoramic navigation screen to guide a patient travel route (for example), and the voice receiver 14 is configured to receive voice response information of an AD patient. The memory 15 can be a read-only memory unit ROM, an electrically erasable memory unit EEPROM or a flash memory unit FLASH and the like, for storing a plurality of panoramic navigation screens of AD patients' daily travel routes, such as a patient from home. Panoramic navigation screens to common routes such as the vegetable market, from the vegetable market to the home, from the home to the supermarket, from the supermarket to the home. The microprocessor 16 may be a central processing unit (CPU), a microcontroller (MCU), a data processing chip, or an information processing unit having a data processing function for performing the forgotten route intelligence of the Alzheimer's disease patient. The navigation system 10 automatically plans a travel route according to the actual scene of the AD patient to help the AD patient to lose the route when the route is forgotten.

In this embodiment, the Alzheimer's disease forgotten route intelligent navigation system 10 is composed of program modules composed of various computer program instructions, including but not limited to, a real scene monitoring module 101, an image recognition module 102, and a voice. Identification module 103 and route navigation module 104. A module referred to in the present invention refers to a series of computer program instructions that can be executed by the microprocessor 16 and that are capable of performing a fixed function, which are stored in the memory 15.

The real scene monitoring module 101 is configured to control the video recorder 11 to perform a 360 degree rotation to acquire a real scene image of the AD patient. In the embodiment, the video recorder 11 is a panoramic camera, and the camera of the video recorder 11 can be rotated 360 degrees to capture a realistic scene image including the real environment scene of the patient and the limb motion information of the patient.

The image recognition module 102 is configured to identify the limb motion information of the patient from the collected real scene image. In this embodiment, the image recognition module 102 can use the existing image recognition technology to identify the limb motion information of the AD patient from the real scene image, including the facial expressions and limb movements often exhibited by the AD patient's amnesia forgetting route, such as AD. The patient walks at the intersection for a long time (for example, more than 5 minutes), walks back and forth at the intersection (for example, repeatedly going back and forth from one intersection to another intersection), and sets the course marks and other physical movements on the roadside. A person skilled in the art can set the facial expression and the body motion information often expressed in the amnesia forgetting route of the AD patient according to the clinical manifestation of the amnesia forgetting route of the AD patient, as a specific example of the embodiment.

The image recognition module 102 is further configured to determine, according to the limb motion information, whether the AD patient has forgotten the route; specifically, the image recognition module 102 determines whether the AD patient forgets the route according to the limb motion information. For example, when an AD patient walks at an intersection for a longer period of time, walks back and forth at an intersection, or sets a course action on the roadside, the image recognition module 102 determines that the AD patient has forgotten the route; since the AD patient may exist The above-mentioned several kinds of limb movement behaviors occur during intermittent amnesia. AD patients may have daily routes such as forgetting to go home or going to the vegetable market. At this time, the post-trigger condition of the route navigation system is started to guide the patient home, which is to prevent the patient from amnesia. Losing is a very safe practice.

The voice recognition module 103 is configured to open the speaker 12 to play the route query information when the AD patient forgets the route, and query the AD patient for the current travel destination information. In this embodiment, the voice inquiry module 103 generates a voice inquiry command to ask the patient whether to go home, ask whether to go to the market, or ask whether to go to a common destination such as a supermarket. These inquiry commands are simple common question and answer instructions, which are preset and saved in the In the memory 15, the patient answers these voice inquiry commands only if the AD patient answers "yes" or "no", thereby alleviating the AD patient's answer, and facilitating the AD patient to easily answer the travel destination information.

The voice recognition module 103 is further configured to receive the voice answer information of the AD patient through the voice receiver 14, and identify the current travel destination information of the patient from the voice answer information. For example, when the speaker 12 plays a voice query command to ask the patient whether to go home, if the voice recognition module 103 recognizes that the AD patient answers "Yes" from the voice answer information, the voice recognition module 103 identifies the AD patient from the voice answer information. The travel destination information is destination information of "go home"; if the AD patient is identified as "no", the memory 15 plays another voice query command "ask whether to go to the market", so that the AD patient is repeatedly asked for AD. The patient answers the travel destination information.

The route navigation module 104 is configured to match the panoramic navigation screen of the AD patient forgetting route from the memory 15 according to the current travel destination information of the patient. In this embodiment, the memory 15 stores a plurality of panoramic navigation screens of daily travel routes of AD patients, such as panoramic navigation of a patient from home to the market, from the market to the home, from the home to the supermarket, from the supermarket to the home. In the screen, the panoramic navigation screen is pre-photographed by the guardian and imported into the memory 15 through the USB port.

The route navigation module 104 is configured to present the matched panoramic navigation screen on the patient display screen 13 in the form of panoramic navigation for route guidance. At this time, the AD patient can refer to the panoramic navigation screen on the display screen 13 to guide the road map. At this time, the route navigation screen displays the route indication arrow to help the AD patient find the home route or the vegetable market route, thereby preventing the AD patient from getting lost and causing the loss. Serious consequences. Since the AD patient may still have a cognitive impairment and the visual space function is impaired, the panoramic navigation screen guidance road map on the display screen 13 may not be recognized, and the route navigation module 104 is further configured to control the speaker 12 to play the voice route information to guide the patient. The travel route, for example, the route navigation module 104 controls the speaker 12 to play route information according to the guidance route map, for example, forward direction, right turn, and the like, thereby guiding the AD patient to the travel destination by voice, further ensuring AD patients do not lose their effect when they forget the route.

In another aspect, the present invention also provides an intelligent navigation method for a forgotten route of a patient with Alzheimer's disease, which is applied to a forgotten route intelligent navigation device 1 of an Alzheimer's disease patient wearing an Alzheimer's disease head, which can be The actual scene of AD patients automatically plans the travel navigation route to prevent AD patients from losing when they forget the route.

As shown in FIG. 2, FIG. 2 is a flow chart of a preferred embodiment of a flow chart of a preferred embodiment of the forgotten route intelligent navigation method for a patient with Alzheimer's disease according to the present invention. In this embodiment, the various method steps of the Alzheimer's disease forgetting route intelligent navigation method are implemented by a computer software program stored in a computer readable storage medium in the form of computer program instructions (eg In the memory 15), the computer readable storage medium may include: a read only memory, a random access memory, a magnetic disk or an optical disk, etc., the computer program instructions being loadable by a processor (for example, the microprocessor 16) and performing the following steps S21 to S28 . Referring to FIG. 1 and FIG. 2, the method for intelligently guiding the forgotten route of the Alzheimer's disease patient comprises the following steps:

In step S21, the real scene image of the Alzheimer's patient is collected by the video recorder in real time; specifically, the real scene monitoring module 101 controls the video recorder 11 to perform 360 degree rotation to collect the real scene image of the AD patient. In the embodiment, the video recorder 11 is a panoramic camera, and the camera of the video recorder 11 can be rotated 360 degrees to capture a realistic scene image including the real environment scene of the patient and the limb motion information of the patient.

Step S22, identifying the limb motion information of the patient from the collected real scene image. In this embodiment, the image recognition module 102 can use the existing image recognition technology to identify the limb motion information of the AD patient from the real scene image, including the facial expressions and limb movements often exhibited by the AD patient's amnesia forgetting route, such as AD. The patient walks at the intersection for a long time (for example, more than 5 minutes), walks back and forth at the intersection (for example, repeatedly going back and forth from one intersection to another intersection), and sets the course marks and other physical movements on the roadside. A person skilled in the art can set the facial expression and the body motion information often expressed in the amnesia forgetting route of the AD patient according to the clinical manifestation of the amnesia forgetting route of the AD patient, as a specific example of the embodiment.

Step S23, determining whether the AD patient has forgotten the route according to the limb motion information; specifically, the image recognition module 102 determines whether the AD patient forgets the route according to the limb motion information. For example, when an AD patient walks at an intersection for a longer period of time, walks back and forth at an intersection, or sets a course action on the roadside, the image recognition module 102 determines that the AD patient has forgotten the route; since the AD patient may exist The above-mentioned several kinds of limb movement behaviors occur during intermittent amnesia. AD patients may have daily routes such as forgetting to go home or going to the vegetable market. At this time, the post-trigger condition of the route navigation system is started to guide the patient home, which is to prevent the patient from amnesia. Losing is a very safe practice. If the AD patient forgets the route, the process proceeds to step S24; if the AD patient does not forget the route, the process proceeds to step S21 to continue monitoring the reality scene image of the AD patient.

Step S24, the speaker play route inquiry information is turned on to inquire the patient's current travel destination information; specifically, the voice recognition module 103 turns on the speaker 12 to play the route query information to inquire the AD patient about the current travel destination information. In this embodiment, the voice query module 103 generates a voice query command to ask the patient whether to go home, ask whether to go to the market, or ask whether to go to a common destination such as a supermarket. These inquiry commands are simple common question and answer instructions, which are preset and saved in the In the memory 15, when the AD patient answers these voice inquiry commands, the AD patient only needs to answer "yes" or "no", thereby reducing the difficulty of the AD patient's answer, facilitating the AD patient to easily answer the travel destination information, and improving the voice. The accuracy of the identification.

Step S25, receiving the voice answer information of the patient through the voice receiver, and identifying the current travel destination information of the patient from the voice answer information; in the embodiment, the voice recognition module 103 receives the voice of the AD patient through the voice receiver 14. The information is answered, and the patient's current travel destination information is identified from the voice answer information. For example, when the speaker 12 plays a voice query command to ask the patient whether to go home, if the voice recognition module 103 recognizes that the AD patient answers "Yes" from the voice answer information, the current travel destination information of the AD patient is identified from the voice answer information. If it is recognized that the AD patient answers "No", the speaker 12 plays another voice inquiry command "Ask whether to go to the market", so that the AD patient is repeatedly asked for the AD patient to answer the present question. Secondary travel destination.

Step S26, the panoramic navigation screen of the patient forgetting route is matched from the memory according to the current travel destination information of the patient; specifically, the route navigation module 104 matches the forgotten route of the AD patient from the memory 15 according to the current travel destination information of the patient. Panoramic navigation screen. In this embodiment, the memory 15 stores a plurality of panoramic navigation screens of daily travel routes of AD patients, such as panoramic navigation of a common route from a home to a vegetable market, from a vegetable market to a home, from a home to a supermarket, and from a supermarket to a home. In the screen, the panoramic navigation screen of the daily travel route is pre-photographed by the guardian and imported into the memory 15 through the USB port.

Step S27, the panoramic navigation screen is presented on the patient display screen in the form of video navigation to guide the patient to the current travel destination; specifically, the route navigation module 104 presents the matched panoramic navigation screen in the panoramic display form on the patient display. The route guidance patient on the screen 13 arrives at the current travel destination, and the AD patient can refer to the panoramic navigation screen on the display screen 13 to guide the road map. At this time, the route navigation screen displays a route indication arrow to help the AD patient find the home route or The vegetable market route, thus preventing AD patients from getting lost and causing serious consequences of loss.

Step S28, controlling the speaker to play the voice route information to guide the patient's travel route; since the AD patient may still have cognitive impairment and the visual space function is impaired, the panoramic navigation screen guidance route map on the display screen 13 may not be recognized, the embodiment of the present invention The route navigation module 104 can also control the speaker 12 to play the voice route information to guide the patient travel route. For example, the route navigation module 104 controls the speaker 12 to play the route information according to the guidance route map, for example, forward direction, right turn, and the like. Thus, the AD patient is guided to the destination of the trip by voice, further ensuring that the AD patient does not lose the effect when forgetting the route.

The intelligent navigation device and method for forgetting the route of the Alzheimer's disease patient of the invention can real-time collect the real scene image of the AD patient when traveling, and identify the limb movement information of the patient from the real scene image, and judge the patient according to the limb working information Whether to forget the route, when the Alzheimer's disease patient forgets the route, the navigation route is automatically planned according to the actual scene of the patient, and the navigation route is presented on the patient display screen in the form of a panoramic navigation screen to prevent AD patients from being in the route. Lost when the route was forgotten.

The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and equivalent structural or equivalent functional changes made by the description of the present invention and the accompanying drawings may be directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Industrial applicability

Claims

An intelligent navigation device for a forgotten route of an Alzheimer's disease patient, comprising a video recorder, a speaker, a display screen and a voice receiver, characterized in that the smart navigation device further comprises an Alzheimer consisting of a plurality of computer program instructions The patient forgets the route intelligent navigation system, a microprocessor adapted to implement computer program instructions, and a memory adapted to store computer program instructions that are loaded by the microprocessor and perform the following steps:

Real-time image capture of real-life scenes around Alzheimer's patients through a video recorder;

Identifying the limb movement information of the patient from the acquired realistic scene image;

Judging whether the patient has forgotten the route according to the body motion information;

When the patient forgets the route, the speaker play route inquiry information is opened to ask the patient for the current travel destination information;

Receiving the patient's voice answer information through the voice receiver, and identifying the patient's current travel destination information from the voice answer information;

The panoramic navigation screen of the patient's forgotten route is matched from the memory according to the current travel destination information of the patient;

A panoramic navigation screen is presented on the display screen in the form of video navigation to guide the patient to the current destination.
The forgotten route intelligent navigation device of the Alzheimer's disease according to claim 1, wherein the computer program instructions are loaded by the microprocessor and further perform the following steps: controlling the speaker to play the voice route information to guide the patient's travel route.
The forgotten route intelligent navigation device for Alzheimer's disease according to claim 1, wherein the panoramic navigation screen stored in the memory is pre-photographed by the guardian and imported into the office through the USB port of the smart navigation device. In the memory.
The forgotten route intelligent navigation device for Alzheimer's disease according to claim 1, wherein the video recorder is a panoramic camera, and the camera of the 360-degree rotating video recorder is used to ingest a real environment including the patient's side. Realistic scene image of scene and limb motion information.
The forgotten route intelligent navigation device for Alzheimer's disease according to any one of claims 1 to 4, wherein the displayed panoramic navigation screen on the display screen includes a guidance route arrow to guide the patient to reach the present Secondary travel destination.
An intelligent navigation method for forgetting the route of Alzheimer's disease, which is applied to a forgotten route intelligent navigation device for Alzheimer's patients, the device comprising a video recorder, a speaker, a display screen, a voice receiver and a memory, wherein The method includes the following steps:

Real-time image capture of real-life scenes around Alzheimer's patients through a video recorder;

Identifying the limb movement information of the patient from the acquired realistic scene image;

Judging whether the patient has forgotten the route according to the body motion information;

When the patient forgets the route, the speaker play route inquiry information is opened to ask the patient for the current travel destination information;

Receiving the patient's voice answer information through the voice receiver, and identifying the patient's current travel destination information from the voice answer information;

The panoramic navigation screen of the patient's forgotten route is matched from the memory according to the current travel destination information of the patient;

A panoramic navigation screen is presented on the display screen in the form of video navigation to guide the patient to the current destination.
The method for intelligently guiding a forgotten route of a patient with Alzheimer's disease according to claim 6, wherein the method further comprises the steps of: controlling the speaker to play the voice route information to assist in guiding the patient's travel route.
The method for intelligently guiding a forgotten route of a patient with Alzheimer's disease according to claim 6, wherein the panoramic navigation screen stored in the memory is pre-photographed by a guardian and imported through a USB port of the smart navigation device. In the memory.
The method for intelligently guiding a forgotten route of a patient with Alzheimer's disease according to claim 6, wherein the video recorder is a panoramic camera, and the camera of the 360-degree rotating video recorder is used to ingest a real environment including the patient's side. Realistic scene image of scene and limb motion information.
The method for intelligently guiding a forgotten route of a patient with Alzheimer's disease according to any one of claims 6 to 9, wherein the displayed panoramic navigation screen on the display screen includes a guidance route arrow to guide the patient to the present invention. Secondary travel destination.