WO2021196517A1 - Community service robot for assisting mobility of the elderly - Google Patents

Community service robot for assisting mobility of the elderly Download PDF

Info

Publication number
WO2021196517A1
WO2021196517A1 PCT/CN2020/112544 CN2020112544W WO2021196517A1 WO 2021196517 A1 WO2021196517 A1 WO 2021196517A1 CN 2020112544 W CN2020112544 W CN 2020112544W WO 2021196517 A1 WO2021196517 A1 WO 2021196517A1
Authority
WO
WIPO (PCT)
Prior art keywords
elderly
main control
control terminal
robot
module
Prior art date
Application number
PCT/CN2020/112544
Other languages
French (fr)
Chinese (zh)
Inventor
邓辅秦
李伟科
林淮荣
黄永深
冯华
岳洪伟
丁毅
龙佳乐
张建民
王栋
钟东洲
李澄非
习江涛
Original Assignee
五邑大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 五邑大学 filed Critical 五邑大学
Publication of WO2021196517A1 publication Critical patent/WO2021196517A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00Manipulators not otherwise provided for
    • B25J11/008Manipulators for service tasks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation

Definitions

  • the invention relates to the field of intelligent robots, in particular to a community service robot assisting the elderly to travel.
  • the purpose of the present invention is to provide an elderly-assisted travel community service robot, which has a good intelligent control effect and can provide accurate assistance guidelines for the elderly in the community.
  • a travel-assisted community service robot for the elderly includes a main body, and the main body is provided with:
  • the main control terminal can realize overall control and store the big data of the elderly in the community;
  • a camera device that can acquire and feed back characteristic information of the elderly, and is connected to the main control terminal;
  • the collaboration module can assist the elderly according to instructions and is connected to the main control terminal;
  • the positioning and navigation module can provide a moving path for the collaborative robot to reach the residential address of the elderly, and are respectively connected with the navigation module and the main control terminal.
  • the one or more technical solutions provided in the embodiments of the present invention have at least the following beneficial effects: real-time acquisition of characteristic information of the elderly through the camera module, so as to understand the living conditions of the elderly in the community, and be able to compare the information with the elderly
  • the pre-stored big data is compared, so as to accurately know the real identity of the elderly and their supporting address and other information. Therefore, the collaboration module and the positioning and navigation module can provide corresponding assistance for the elderly so that they can return to their location.
  • the residential address in the community does not need to worry about the situation where the elderly are left unattended in the community, and the above modules or devices are all under the overall control of the main control terminal to achieve their work.
  • the overall control effect is more intelligent and effective, and there is no need
  • the manual care also improves the efficiency of guidance and assistance to the elderly. Therefore, the present invention has reasonable design, high-efficiency control intelligence, and can provide accurate assistance guidelines for the elderly in the community, thereby solving the worries of children.
  • the camera device includes a first camera used for face recognition of the elderly and a second camera used for recording the face recognition process of the elderly, the first camera and the second camera are both Connect with the main control terminal.
  • the step of performing face recognition on the elderly by the first camera includes:
  • ⁇ i is the difference
  • ⁇ k is the feature vector and u is the unit vector
  • the cooperation module includes a seat, a driving mechanism, and a collaborative robot for supporting the elderly.
  • a movable wheel is installed under the seat, and the driving mechanism is respectively connected to the movable wheel and the main control terminal.
  • the collaborative robot is connected to the main control terminal.
  • the positioning and navigation module includes a positioning module for locating a specific position of the collaborative robot and a navigation module for planning a moving path of the collaborative robot, and both the positioning module and the navigation module are connected to the Collaborative robots.
  • a display screen with a remote communication connection function is also provided on the main body, and the display screen is connected with the main control terminal.
  • a network transmission module for realizing communication between the cooperation module and the master control terminal is provided.
  • the main control terminal adopts a microprocessor or a host computer.
  • FIG. 1 is a schematic block diagram of the structure of a travel-assisted community service robot for the elderly according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of the steps of the first camera in the travel-assisted community service robot for the elderly to perform face recognition on the elderly according to an embodiment of the present invention.
  • an embodiment of the present invention provides a travel-assisted community service robot for the elderly, including a main body, and the main body is provided with:
  • the main control terminal 200 can realize overall control and store big data of the elderly in the community;
  • a camera device which can acquire and feed back characteristic information of the elderly, and is connected to the main control terminal 200;
  • the collaboration module 500 can assist the elderly according to instructions, and is connected to the main control terminal 200;
  • the positioning and navigation module 700 can provide a moving path for the collaborative robot to reach the residence of the elderly, and is connected to the navigation module and the main control terminal 200 respectively.
  • the feature information of the elderly is acquired in real time through the camera module, so as to understand the living conditions of the elderly in the community, and the elderly information can be compared with pre-stored big data, so as to accurately know the elderly.
  • the real identity of the person and its supporting address and other information therefore, the collaboration module 500 and the positioning and navigation module 700 can provide corresponding assistance to the elderly so that they can return to their residential address in the community without worrying about the elderly in the community.
  • Unattended situations, and all the above modules or devices are under the overall control of the main control terminal 200 to achieve their work. Therefore, the overall control effect is more intelligent and effective, without manual care, and it also improves the protection for the elderly.
  • the guidelines help efficiency. Therefore, the present invention has reasonable design, high-efficiency control intelligence, and can provide accurate assistance guidelines for the elderly in the community, thereby solving the worries of children.
  • the main control terminal 200 adopts a microprocessor or a host computer. Whether it is a microprocessor or a host computer, it has good communication transmission, overall control and other functions, and can complete instructions fetching, executing instructions, and communicating with external memory. Exchange information with logical components and other operations, and has good storage space, can integrate big data information of the elderly in the community, which is very convenient and reliable; in addition, between the collaboration module 500 and the main control terminal 200
  • the network transmission module 400 for realizing communication between the two is provided, and transmission methods such as 5G can be adopted, which is beneficial to speed up the communication speed between the cooperation module 500 and the main control terminal 200, and makes the assistance control for the elderly more timely.
  • the camera device includes a first camera 100 for face recognition of the elderly and a second camera 300 for recording the face recognition process of the elderly.
  • the first camera Both the 100 and the second camera 300 are connected to the main control terminal 200.
  • the division of labor between the two cameras can not only realize face recognition, but also record real-time information of the elderly for file viewing.
  • the steps of the first camera 100 performing face recognition on the elderly include:
  • ⁇ i is the difference
  • ⁇ k is the feature vector and u is the unit vector
  • the core image information of the elderly can be reflected, so that the training set images and the test set images of the elderly can be used to transform the images in the training set.
  • the characteristics of the elderly are characterized, and finally the face recognition of the elderly can be realized through comparison. It can be seen that this face recognition method can be realized with the help of simple training, which is very efficient and reliable.
  • the collaboration module 500 designed by the inventor includes a seat, a driving mechanism, and a collaborative robot for assisting the elderly.
  • a movable wheel is installed under the seat, and the driving mechanism is connected to the movable wheel and the main body respectively.
  • the control terminal 200 is connected, and the collaborative robot is connected with the main control terminal 200.
  • the driving mechanism can drive the seat to move. At this time, it only needs to be guided by the assisting robot correctly. This reduces the workload of the collaborative robot, and makes the overall help for the elderly more organized.
  • the driving mechanism is a motor, which can be installed under the seat.
  • the positioning and navigation module 700 includes a positioning module for locating a specific location of the collaborative robot and a navigation module for planning a moving path of the collaborative robot, and both the positioning module and the navigation module are connected to the Collaborative robots.
  • the positioning module can feed back the specific location information of the collaborative robot to the main control terminal 200, such as through GPS, so as to stimulate the navigation module to plan the movement path for the collaborative robot. It can be seen that there is a cooperative relationship between the two. The cooperation can provide a stable and accurate path planning scheme for the collaborative robot, and the control effect is better. Since the specific method of path planning has been explained in the field, it will not be repeated here.
  • the main body is also provided with a display screen 600 with a remote communication connection function, and the display screen 600 is connected to the main control terminal 200.
  • the real-time information of the elderly can be visually transmitted to the control terminal 200 through the display screen 600, which can more accurately reflect the real-time information of the elderly, so as to determine whether they are sick, fatigued, etc. Symptoms have good practical guiding significance.
  • a smart pill box is also set on the main body, and some special medicines for the elderly can be configured inside, so that they can be used by the elderly in emergency situations, which is very convenient.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Manipulator (AREA)

Abstract

Disclosed is a community service robot for assisting the mobility of the elderly, comprising a main body, the main body being provided with: a main control end, capable of achieving overall control and storing big-data information of the elderly in a community; a camera device, capable of acquiring and feeding back feature information of the elderly, and being connected to the main control end; a collaboration module, capable of assisting the elderly according to an instruction, and being connected to the main control end; and a location and navigation module, capable of providing a movement path for a collaborative robot to reach a home address of the elderly, and being connected to the navigation module and the main control end. Compared with the traditional technology, the present invention has a rational design and is intelligent and efficient in control, and can provide accurate assistance and guidance for the elderly in a community, thereby alleviating worries of children.

Description

一种老年人协助出行式社区服务机器人A community service robot assisting the elderly to travel 技术领域Technical field
本发明涉及智能机器人领域,尤其是一种老年人协助出行式社区服务机器人。The invention relates to the field of intelligent robots, in particular to a community service robot assisting the elderly to travel.
背景技术Background technique
随着社会人口的不断发展,老龄化趋势日趋严重,尤其是在一些社区内,基本占据了老年人的主要活动区域,由于年轻子女工作繁忙,大多没有时间和精力来仔细看顾社区中的老年人,因此,老年人的照料问题显得尤为重要。目前,有的通过聘请专人看护来解决,但这样相对耗费较高,且智能化程度不高,还一种手段是通过手机或其它电子终端确认老年人位置坐标实现监控,但是老年人的健忘性使得其对于这类设备的使用不是很了解,且也存在着外出携带不方便等缺点。With the continuous development of the social population, the aging trend is becoming more and more serious, especially in some communities, which basically occupy the main activity area of the elderly. Due to the busy work of young children, most of them do not have the time and energy to carefully look after the elderly in the community. Therefore, the care of the elderly is particularly important. At present, some of them are solved by hiring a dedicated person to look after, but this is relatively expensive and the degree of intelligence is not high. Another method is to confirm the location coordinates of the elderly through mobile phones or other electronic terminals to achieve monitoring, but the elderly are forgetful It is not very familiar with the use of this type of equipment, and there are also disadvantages such as inconvenience to carry when going out.
发明内容Summary of the invention
为了解决上述问题,本发明的目的是提供一种老年人协助出行式社区服务机器人,具有良好的智能化控制效果,能够为社区内老年人提供准确的援助指引。In order to solve the above problems, the purpose of the present invention is to provide an elderly-assisted travel community service robot, which has a good intelligent control effect and can provide accurate assistance guidelines for the elderly in the community.
为了弥补现有技术的不足,本发明实施例采用的技术方案是:In order to make up for the deficiencies of the prior art, the technical solutions adopted in the embodiments of the present invention are:
一种老年人协助出行式社区服务机器人,包括主体,所述主体上设置有:A travel-assisted community service robot for the elderly includes a main body, and the main body is provided with:
主控端,能够实现统筹控制并储存社区老年人的大数据资料;The main control terminal can realize overall control and store the big data of the elderly in the community;
摄像装置,能够获取并反馈老年人的特征信息,与所述主控端相连接;A camera device that can acquire and feed back characteristic information of the elderly, and is connected to the main control terminal;
协作模块,能够根据指令对老年人进行协助,与所述主控端相连接;The collaboration module can assist the elderly according to instructions and is connected to the main control terminal;
定位导航模块,能够为所述协作机器人提供到达老年人住址的移动路径,分别与所述导航模块和所述主控端相连接。The positioning and navigation module can provide a moving path for the collaborative robot to reach the residential address of the elderly, and are respectively connected with the navigation module and the main control terminal.
本发明实施例中提供的一个或多个技术方案,至少具有如下有益效果:通过摄像模块实时获取老年人的特征信息,从而了解老年人在社区内的生活状态,并且能够将该老年人信息与预先存储的大数据进行比对,从而准确获知该老年人的真实身份以及其配套的住址等信息,因此,协作模块配合上定位导航模块则可以为老年人提供相应协助,使其能够返回其在社区内的住址,无需操心老年人在社区内无人看顾的情况,并且,以上各模块或装置均是在主控端统筹控制下实现工作的,因此,整体上控制效果更为智能有效,无需由人工进行看顾,也提高了对老年人的指引帮助效率。因此,本发明设计合理,控制智能高效,能够为社区内 老年人提供准确的援助指引,从而解决了子女后顾之忧。The one or more technical solutions provided in the embodiments of the present invention have at least the following beneficial effects: real-time acquisition of characteristic information of the elderly through the camera module, so as to understand the living conditions of the elderly in the community, and be able to compare the information with the elderly The pre-stored big data is compared, so as to accurately know the real identity of the elderly and their supporting address and other information. Therefore, the collaboration module and the positioning and navigation module can provide corresponding assistance for the elderly so that they can return to their location. The residential address in the community does not need to worry about the situation where the elderly are left unattended in the community, and the above modules or devices are all under the overall control of the main control terminal to achieve their work. Therefore, the overall control effect is more intelligent and effective, and there is no need The manual care also improves the efficiency of guidance and assistance to the elderly. Therefore, the present invention has reasonable design, high-efficiency control intelligence, and can provide accurate assistance guidelines for the elderly in the community, thereby solving the worries of children.
进一步地,所述摄像装置包括用于对老年人进行人脸识别的第一摄像头以及用于记录对老年人的人脸识别过程的第二摄像头,所述第一摄像头和所述第二摄像头均与所述主控端相连接。Further, the camera device includes a first camera used for face recognition of the elderly and a second camera used for recording the face recognition process of the elderly, the first camera and the second camera are both Connect with the main control terminal.
进一步地,所述第一摄像头对老年人进行人脸识别的步骤,包括:Further, the step of performing face recognition on the elderly by the first camera includes:
从拍摄的包含老年人的图片中对所有老年人进行训练,获得所有老年人的人脸向量的平均值Train all the elderly from the taken pictures containing the elderly, and obtain the average value of the face vectors of all the elderly
Figure PCTCN2020112544-appb-000001
Figure PCTCN2020112544-appb-000001
其中,
Figure PCTCN2020112544-appb-000002
为平均值,M为图片中老年人的训练人像个数,Γ为训练人脸向量;
in,
Figure PCTCN2020112544-appb-000002
Is the average value, M is the number of training portraits of the elderly in the picture, and Γ is the training face vector;
计算每个老年人的人脸向量与所述平均值之间的差值Calculate the difference between the face vector of each elderly person and the average value
Figure PCTCN2020112544-appb-000003
Figure PCTCN2020112544-appb-000003
其中,Φ i为差值; Among them, Φ i is the difference;
获取老年人的人脸向量的特征向量Get the feature vector of the face vector of the elderly
Figure PCTCN2020112544-appb-000004
Figure PCTCN2020112544-appb-000004
其中,λ k为特征向量,u为单位向量; Among them, λ k is the feature vector and u is the unit vector;
将老年人的训练集图像和测试集图像均投影到所述特征向量上,使测试集图像中的每个图像找到训练集图像中的最近邻,将所述找到的图像与主控端中社区老年人的大数据资料进行比对,从而实现对老年人进行人脸识别。Project the training set image and the test set image of the elderly on the feature vector, make each image in the test set image find the nearest neighbor in the training set image, and compare the found image with the community in the main control terminal The big data data of the elderly are compared, so as to realize the face recognition of the elderly.
进一步地,所述协作模块包括座椅、驱动机构以及用于搀扶老年人的协作机器人,所述座椅下方安装有移动轮,所述驱动机构分别与所述移动轮和所述主控端相连接,所述协作机器人与所述主控端相连接。Further, the cooperation module includes a seat, a driving mechanism, and a collaborative robot for supporting the elderly. A movable wheel is installed under the seat, and the driving mechanism is respectively connected to the movable wheel and the main control terminal. Connected, the collaborative robot is connected to the main control terminal.
进一步地,所述定位导航模块包括用于定位所述协作机器人具体位置的定位模块以及用于规划所述协作机器人的移动路径的导航模块,所述定位模块和所述导航模块均连接到所述协作机器人。Further, the positioning and navigation module includes a positioning module for locating a specific position of the collaborative robot and a navigation module for planning a moving path of the collaborative robot, and both the positioning module and the navigation module are connected to the Collaborative robots.
进一步地,所述主体上还设置有具有远程通信连接功能的显示屏,所述显示屏与所述主控端相连接。Further, a display screen with a remote communication connection function is also provided on the main body, and the display screen is connected with the main control terminal.
进一步地,所述协作模块与所述主控端之间设置有用于实现两者间通信的 网络传输模块。Further, a network transmission module for realizing communication between the cooperation module and the master control terminal is provided.
进一步地,所述主控端采用微处理器或上位机。Further, the main control terminal adopts a microprocessor or a host computer.
本发明的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。The additional aspects and advantages of the present invention will be partly given in the following description, and partly will become obvious from the following description, or be understood through the practice of the present invention.
附图说明Description of the drawings
下面结合附图给出本发明较佳实施例,以详细说明本发明的实施方案。Hereinafter, preferred embodiments of the present invention are given in conjunction with the drawings to illustrate the implementation of the present invention in detail.
图1是本发明实施例的一种老年人协助出行式社区服务机器人的结构示意框图;FIG. 1 is a schematic block diagram of the structure of a travel-assisted community service robot for the elderly according to an embodiment of the present invention;
图2是本发明实施例一种老年人协助出行式社区服务机器人中的第一摄像头对老年人进行人脸识别的步骤流程示意图。FIG. 2 is a schematic diagram of the steps of the first camera in the travel-assisted community service robot for the elderly to perform face recognition on the elderly according to an embodiment of the present invention.
具体实施方式Detailed ways
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following further describes the present invention in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not used to limit the present invention.
需要说明的是,如果不冲突,本发明实施例中的各个特征可以相互结合,均在本发明的保护范围之内。在某些情况下,可以以不同于系统中的模块划分,或流程图中的顺序执行所示出或描述的步骤。It should be noted that if there is no conflict, the various features in the embodiments of the present invention can be combined with each other, and all fall within the protection scope of the present invention. In some cases, the steps shown or described may be executed in a different order from the module division in the system or the order in the flowchart.
下面结合附图,对本发明实施例作进一步阐述。The embodiments of the present invention will be further described below in conjunction with the accompanying drawings.
参照图1,本发明实施例提供的一种老年人协助出行式社区服务机器人,包括主体,所述主体上设置有:Referring to Fig. 1, an embodiment of the present invention provides a travel-assisted community service robot for the elderly, including a main body, and the main body is provided with:
主控端200,能够实现统筹控制并储存社区老年人的大数据资料;The main control terminal 200 can realize overall control and store big data of the elderly in the community;
摄像装置,能够获取并反馈老年人的特征信息,与所述主控端200相连接;A camera device, which can acquire and feed back characteristic information of the elderly, and is connected to the main control terminal 200;
协作模块500,能够根据指令对老年人进行协助,与所述主控端200相连接;The collaboration module 500 can assist the elderly according to instructions, and is connected to the main control terminal 200;
定位导航模块700,能够为所述协作机器人提供到达老年人住址的移动路径,分别与所述导航模块和所述主控端200相连接。The positioning and navigation module 700 can provide a moving path for the collaborative robot to reach the residence of the elderly, and is connected to the navigation module and the main control terminal 200 respectively.
在本实施例中,通过摄像模块实时获取老年人的特征信息,从而了解老年人在社区内的生活状态,并且能够将该老年人信息与预先存储的大数据进行比对,从而准确获知该老年人的真实身份以及其配套的住址等信息,因此,协作模块 500配合上定位导航模块700则可以为老年人提供相应协助,使其能够返回其在社区内的住址,无需操心老年人在社区内无人看顾的情况,并且,以上各模块或装置均是在主控端200统筹控制下实现工作的,因此,整体上控制效果更为智能有效,无需由人工进行看顾,也提高了对老年人的指引帮助效率。因此,本发明设计合理,控制智能高效,能够为社区内老年人提供准确的援助指引,从而解决了子女后顾之忧。In this embodiment, the feature information of the elderly is acquired in real time through the camera module, so as to understand the living conditions of the elderly in the community, and the elderly information can be compared with pre-stored big data, so as to accurately know the elderly. The real identity of the person and its supporting address and other information, therefore, the collaboration module 500 and the positioning and navigation module 700 can provide corresponding assistance to the elderly so that they can return to their residential address in the community without worrying about the elderly in the community. Unattended situations, and all the above modules or devices are under the overall control of the main control terminal 200 to achieve their work. Therefore, the overall control effect is more intelligent and effective, without manual care, and it also improves the protection for the elderly. The guidelines help efficiency. Therefore, the present invention has reasonable design, high-efficiency control intelligence, and can provide accurate assistance guidelines for the elderly in the community, thereby solving the worries of children.
优选地,所述主控端200采用微处理器或上位机,无论是微处理器或是上位机,均具有良好的通信传输、统筹控制等功能,能够完成取指令、执行指令以及与外界存储器和逻辑部件交换信息等操作,且具有良好的空间存储,能够整合社区老年人的大数据信息,这是非常方便可靠的;还有,在所述协作模块500与所述主控端200之间设置有用于实现两者间通信的网络传输模块400,可采用5G等传输方式,有利于加快协作模块500与主控端200之间的通信速度,使得对于老年人的帮助控制更加及时。Preferably, the main control terminal 200 adopts a microprocessor or a host computer. Whether it is a microprocessor or a host computer, it has good communication transmission, overall control and other functions, and can complete instructions fetching, executing instructions, and communicating with external memory. Exchange information with logical components and other operations, and has good storage space, can integrate big data information of the elderly in the community, which is very convenient and reliable; in addition, between the collaboration module 500 and the main control terminal 200 The network transmission module 400 for realizing communication between the two is provided, and transmission methods such as 5G can be adopted, which is beneficial to speed up the communication speed between the cooperation module 500 and the main control terminal 200, and makes the assistance control for the elderly more timely.
更进一步地,参照图1,所述摄像装置包括用于对老年人进行人脸识别的第一摄像头100以及用于记录对老年人的人脸识别过程的第二摄像头300,所述第一摄像头100和所述第二摄像头300均与所述主控端200相连接。具体地,两个摄像头分工配合,既能实现人脸识别,又能记录老年人即时信息,以便备档查看。Further, referring to FIG. 1, the camera device includes a first camera 100 for face recognition of the elderly and a second camera 300 for recording the face recognition process of the elderly. The first camera Both the 100 and the second camera 300 are connected to the main control terminal 200. Specifically, the division of labor between the two cameras can not only realize face recognition, but also record real-time information of the elderly for file viewing.
更进一步地,参照图2,所述第一摄像头100对老年人进行人脸识别的步骤,包括:Furthermore, referring to FIG. 2, the steps of the first camera 100 performing face recognition on the elderly include:
S100、从拍摄的包含老年人的图片中对所有老年人进行训练,获得所有老年人的人脸向量的平均值S100. Train all the elderly from the taken pictures containing the elderly, and obtain the average value of the face vectors of all the elderly
Figure PCTCN2020112544-appb-000005
Figure PCTCN2020112544-appb-000005
其中,
Figure PCTCN2020112544-appb-000006
为平均值,M为图片中老年人的训练人像个数,Γ为训练人脸向量;
in,
Figure PCTCN2020112544-appb-000006
Is the average value, M is the number of training portraits of the elderly in the picture, and Γ is the training face vector;
S200、计算每个老年人的人脸向量与所述平均值之间的差值S200. Calculate the difference between the face vector of each elderly person and the average value
Figure PCTCN2020112544-appb-000007
Figure PCTCN2020112544-appb-000007
其中,Φ i为差值; Among them, Φ i is the difference;
S300、获取老年人的人脸向量的特征向量S300. Obtain the feature vector of the face vector of the elderly
Figure PCTCN2020112544-appb-000008
Figure PCTCN2020112544-appb-000008
其中,λ k为特征向量,u为单位向量; Among them, λ k is the feature vector and u is the unit vector;
S400、将老年人的训练集图像和测试集图像均投影到所述特征向量上,使测试集图像中的每个图像找到训练集图像中的最近邻,将所述找到的图像与主控端200中社区老年人的大数据资料进行比对,从而实现对老年人进行人脸识别。S400. Project both the training set image and the test set image of the elderly on the feature vector, so that each image in the test set image finds the nearest neighbor in the training set image, and compare the found image with the main control terminal Compare the big data of the elderly in 200 communities, so as to realize the face recognition of the elderly.
具体地,通过对老年人图片进行训练、向量化及特征向量化,能够将老年人的核心图像信息反映出,从而可借助于老年人的训练集图像和测试集图像来将训练集图像中的老年人特征表征出来,最终则可通过对比实现老年人的人脸识别,可见,此人脸识别方式借助于简单的训练即可实现,非常高效可靠。Specifically, through training, vectorization, and feature vectorization of the pictures of the elderly, the core image information of the elderly can be reflected, so that the training set images and the test set images of the elderly can be used to transform the images in the training set. The characteristics of the elderly are characterized, and finally the face recognition of the elderly can be realized through comparison. It can be seen that this face recognition method can be realized with the help of simple training, which is very efficient and reliable.
其中,发明人所设计的协作模块500包括座椅、驱动机构以及用于搀扶老年人的协作机器人,所述座椅下方安装有移动轮,所述驱动机构分别与所述移动轮和所述主控端200相连接,所述协作机器人与所述主控端200相连接。Among them, the collaboration module 500 designed by the inventor includes a seat, a driving mechanism, and a collaborative robot for assisting the elderly. A movable wheel is installed under the seat, and the driving mechanism is connected to the movable wheel and the main body respectively. The control terminal 200 is connected, and the collaborative robot is connected with the main control terminal 200.
具体地,若老年人不需要座椅,则只需协作机器人将其搀扶即可(其中,搀扶具体可通过Part Affinity Fields(PAFs)的自下而上的人体姿态估计算法来判断老年人的骨骼,以对其进行正确部位搀扶),否则由协作机器人帮助其坐上座椅,尤其是,采用驱动机构可驱动座椅移动,此时只需由协助机器人正确引导其路线即可,相对而言,减轻了协作机器人的工作负担,使得对于老年人的整体帮助更具有条理性,优选地,所述的驱动机构为电机,可以安装在座椅下方。Specifically, if the elderly do not need a seat, they only need to be supported by the collaborative robot (where the support can be specifically determined by the bottom-up body posture estimation algorithm of Part Affinity Fields (PAFs) to determine the bones of the elderly , To support it in the correct position), otherwise the collaborative robot will help it to sit on the seat. In particular, the driving mechanism can drive the seat to move. At this time, it only needs to be guided by the assisting robot correctly. This reduces the workload of the collaborative robot, and makes the overall help for the elderly more organized. Preferably, the driving mechanism is a motor, which can be installed under the seat.
更进一步地,定位导航模块700包括用于定位所述协作机器人具体位置的定位模块以及用于规划所述协作机器人的移动路径的导航模块,所述定位模块和所述导航模块均连接到所述协作机器人。Furthermore, the positioning and navigation module 700 includes a positioning module for locating a specific location of the collaborative robot and a navigation module for planning a moving path of the collaborative robot, and both the positioning module and the navigation module are connected to the Collaborative robots.
具体地,定位模块可以将协作机器人具体位置信息反馈到主控端200上,比如通过GPS方式等,从而激发导航模块为协作机器人规划移动路径,可见两者之间存在着相互配合的关系,通过配合能够为协作机器人提供稳定准确地路径规划方案,控制效果更佳,由于路径规划的具体方式在本领域中已有阐述,故在此不作赘述。Specifically, the positioning module can feed back the specific location information of the collaborative robot to the main control terminal 200, such as through GPS, so as to stimulate the navigation module to plan the movement path for the collaborative robot. It can be seen that there is a cooperative relationship between the two. The cooperation can provide a stable and accurate path planning scheme for the collaborative robot, and the control effect is better. Since the specific method of path planning has been explained in the field, it will not be repeated here.
更进一步地,所述主体上还设置有具有远程通信连接功能的显示屏600,所述显示屏600与所述主控端200相连接。Furthermore, the main body is also provided with a display screen 600 with a remote communication connection function, and the display screen 600 is connected to the main control terminal 200.
在本实施例中,通过显示屏600可以将老年人的实时信息以直观地视频方式传递给主控端200,能够更准确地反映老年人的即时信息,以便于判断其是否出现生病、乏力等症状,具有良好的实际指导意义,相应地,主体上还设置了智能药盒,内部可配置一些老年人专用药,以便于在紧急情况下供老年人进行使用,非常方便。In this embodiment, the real-time information of the elderly can be visually transmitted to the control terminal 200 through the display screen 600, which can more accurately reflect the real-time information of the elderly, so as to determine whether they are sick, fatigued, etc. Symptoms have good practical guiding significance. Correspondingly, a smart pill box is also set on the main body, and some special medicines for the elderly can be configured inside, so that they can be used by the elderly in emergency situations, which is very convenient.
以上内容对本发明的较佳实施例和基本原理作了详细论述,但本发明并不局限于上述实施方式,熟悉本领域的技术人员应该了解在不违背本发明精神的前提下还会有各种等同变形和替换,这些等同变形和替换都落入要求保护的本发明范围内。The above content has described the preferred embodiments and basic principles of the present invention in detail, but the present invention is not limited to the above-mentioned embodiments. Those skilled in the art should understand that there will be various types without departing from the spirit of the present invention. Equivalent deformations and replacements, these equivalent deformations and replacements all fall within the scope of the claimed invention.

Claims (8)

  1. 一种老年人协助出行式社区服务机器人,其特征在于,包括主体,所述主体上设置有:A travel-assisted community service robot for the elderly, which is characterized by comprising a main body, and the main body is provided with:
    主控端,能够实现统筹控制并储存社区老年人的大数据资料;The main control terminal can realize overall control and store the big data of the elderly in the community;
    摄像装置,能够获取并反馈老年人的特征信息,与所述主控端相连接;A camera device that can acquire and feed back characteristic information of the elderly, and is connected to the main control terminal;
    协作模块,能够根据指令对老年人进行协助,与所述主控端相连接;The collaboration module can assist the elderly according to instructions and is connected to the main control terminal;
    定位导航模块,能够为所述协作机器人提供到达老年人住址的移动路径,分别与所述导航模块和所述主控端相连接。The positioning and navigation module can provide a moving path for the collaborative robot to reach the residential address of the elderly, and are respectively connected with the navigation module and the main control terminal.
  2. 根据权利要求1所述的一种老年人协助出行式社区服务机器人,其特征在于:所述摄像装置包括用于对老年人进行人脸识别的第一摄像头以及用于记录对老年人的人脸识别过程的第二摄像头,所述第一摄像头和所述第二摄像头均与所述主控端相连接。The travel-assisted community service robot for the elderly according to claim 1, wherein the camera device includes a first camera for face recognition of the elderly and a first camera for recording the faces of the elderly. The second camera in the identification process, the first camera and the second camera are both connected to the main control terminal.
  3. 根据权利要求2所述的一种老年人协助出行式社区服务机器人,其特征在于,所述第一摄像头对老年人进行人脸识别的步骤,包括:The travel-assisted community service robot for the elderly according to claim 2, wherein the step of performing face recognition on the elderly by the first camera comprises:
    从拍摄的包含老年人的图片中对所有老年人进行训练,获得所有老年人的人脸向量的平均值Train all the elderly from the taken pictures containing the elderly, and obtain the average value of the face vectors of all the elderly
    Figure PCTCN2020112544-appb-100001
    Figure PCTCN2020112544-appb-100001
    其中,
    Figure PCTCN2020112544-appb-100002
    为平均值,M为图片中老年人的训练人像个数,Γ为训练人脸向量;
    in,
    Figure PCTCN2020112544-appb-100002
    Is the average value, M is the number of training portraits of the elderly in the picture, and Γ is the training face vector;
    计算每个老年人的人脸向量与所述平均值之间的差值Calculate the difference between the face vector of each elderly person and the average value
    Figure PCTCN2020112544-appb-100003
    Figure PCTCN2020112544-appb-100003
    其中,Φ i为差值; Among them, Φ i is the difference;
    获取老年人的人脸向量的特征向量Get the feature vector of the face vector of the elderly
    Figure PCTCN2020112544-appb-100004
    Figure PCTCN2020112544-appb-100004
    其中,λ κ为特征向量,u为单位向量; Among them, λ κ is the feature vector and u is the unit vector;
    将老年人的训练集图像和测试集图像均投影到所述特征向量上,使测试集图像中的每个图像找到训练集图像中的最近邻,将所述找到的图像与主控端中社区老年人的大数据资料进行比对,从而实现对老年人进行人脸识别。Project the training set image and the test set image of the elderly on the feature vector, make each image in the test set image find the nearest neighbor in the training set image, and compare the found image with the community in the main control terminal The big data data of the elderly are compared, so as to realize the face recognition of the elderly.
  4. 根据权利要求1所述的一种老年人协助出行式社区服务机器人,其特征在于:所述协作模块包括座椅、驱动机构以及用于搀扶老年人的协作机器人,所述座椅下方安装有移动轮,所述驱动机构分别与所述移动轮和所述主控端相连接,所述协作机器人与所述主控端相连接。The travel-assisted community service robot for the elderly according to claim 1, wherein the collaboration module includes a seat, a driving mechanism, and a collaborative robot for assisting the elderly, and a mobile robot is installed under the seat. Wheel, the driving mechanism is respectively connected with the moving wheel and the main control terminal, and the collaborative robot is connected with the main control terminal.
  5. 根据权利要求4所述的一种老年人协助出行式社区服务机器人,其特征在于:所述定位导航模块包括用于定位所述协作机器人具体位置的定位模块以及用于规划所述协作机器人的移动路径的导航模块,所述定位模块和所述导航模块均连接到所述协作机器人。The travel-assisted community service robot for the elderly according to claim 4, wherein the positioning and navigation module includes a positioning module for locating the specific position of the collaborative robot and for planning the movement of the collaborative robot. The navigation module of the path, the positioning module and the navigation module are both connected to the collaborative robot.
  6. 根据权利要求1所述的一种老年人协助出行式社区服务机器人,其特征在于:所述主体上还设置有具有远程通信连接功能的显示屏,所述显示屏与所述主控端相连接。The travel-assisted community service robot for the elderly according to claim 1, wherein the main body is also provided with a display screen with a remote communication connection function, and the display screen is connected to the main control terminal. .
  7. 根据权利要求1所述的一种老年人协助出行式社区服务机器人,其特征在于:所述协作模块与所述主控端之间设置有用于实现两者间通信的网络传输模块。The travel-assisted community service robot for the elderly according to claim 1, wherein a network transmission module for realizing communication between the cooperation module and the main control terminal is provided.
  8. 根据权利要求1至7任一所述的一种老年人协助出行式社区服务机器人,其特征在于:所述主控端采用微处理器或上位机。The travel-assisted community service robot for the elderly according to any one of claims 1 to 7, wherein the main control terminal adopts a microprocessor or an upper computer.
PCT/CN2020/112544 2020-03-31 2020-08-31 Community service robot for assisting mobility of the elderly WO2021196517A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010246740.9A CN111438698A (en) 2020-03-31 2020-03-31 Travel-assisting type community service robot for old people
CN202010246740.9 2020-03-31

Publications (1)

Publication Number Publication Date
WO2021196517A1 true WO2021196517A1 (en) 2021-10-07

Family

ID=71649461

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/112544 WO2021196517A1 (en) 2020-03-31 2020-08-31 Community service robot for assisting mobility of the elderly

Country Status (2)

Country Link
CN (1) CN111438698A (en)
WO (1) WO2021196517A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113954091A (en) * 2021-10-15 2022-01-21 北京小乔机器人科技发展有限公司 Robot with online medicine purchasing function

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111438698A (en) * 2020-03-31 2020-07-24 五邑大学 Travel-assisting type community service robot for old people

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160052137A1 (en) * 2014-08-21 2016-02-25 Elwha Llc Systems, devices, and methods including a wheelchair-assist robot
CN108247648A (en) * 2018-01-25 2018-07-06 四川智慧锦诚科技有限公司 Improve the intelligent robot of safety in utilization
CN108904159A (en) * 2018-07-24 2018-11-30 北京理工大学 Control method, device and the seat robot of seat robot
CN109262623A (en) * 2018-09-30 2019-01-25 宁波大学 A kind of traction navigation autonomous mobile robot
CN109446988A (en) * 2018-10-29 2019-03-08 江苏环宇臻视智能科技有限公司 Face identification method
CN110587622A (en) * 2019-09-09 2019-12-20 深圳市三宝创新智能有限公司 Old-people-and-disabled-helping robot with wheelchair
CN111438698A (en) * 2020-03-31 2020-07-24 五邑大学 Travel-assisting type community service robot for old people

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170090599A (en) * 2016-01-29 2017-08-08 (주)다나티앤씨 Walking Assistance Device
CN106965196A (en) * 2017-04-24 2017-07-21 黄国彬 A kind of service robot
CN109015676A (en) * 2018-08-13 2018-12-18 范文捷 A kind of robot for accompanying the walking of old man open air

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160052137A1 (en) * 2014-08-21 2016-02-25 Elwha Llc Systems, devices, and methods including a wheelchair-assist robot
CN108247648A (en) * 2018-01-25 2018-07-06 四川智慧锦诚科技有限公司 Improve the intelligent robot of safety in utilization
CN108904159A (en) * 2018-07-24 2018-11-30 北京理工大学 Control method, device and the seat robot of seat robot
CN109262623A (en) * 2018-09-30 2019-01-25 宁波大学 A kind of traction navigation autonomous mobile robot
CN109446988A (en) * 2018-10-29 2019-03-08 江苏环宇臻视智能科技有限公司 Face identification method
CN110587622A (en) * 2019-09-09 2019-12-20 深圳市三宝创新智能有限公司 Old-people-and-disabled-helping robot with wheelchair
CN111438698A (en) * 2020-03-31 2020-07-24 五邑大学 Travel-assisting type community service robot for old people

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113954091A (en) * 2021-10-15 2022-01-21 北京小乔机器人科技发展有限公司 Robot with online medicine purchasing function

Also Published As

Publication number Publication date
CN111438698A (en) 2020-07-24

Similar Documents

Publication Publication Date Title
WO2021196517A1 (en) Community service robot for assisting mobility of the elderly
WO2021077295A1 (en) Three-dimensional human body model reconstruction method, storage device and control device
WO2020010979A1 (en) Method and apparatus for training model for recognizing key points of hand, and method and apparatus for recognizing key points of hand
EP3751519A1 (en) Method, apparatus, device and medium for calibrating pose relationship between vehicle sensor and vehicle
CN112307940A (en) Model training method, human body posture detection method, device, equipment and medium
US20210224980A1 (en) 3D/2D Vascular Registration Method and Its Means
CN112489774B (en) Clinical trial subject recruitment system
WO2021129345A1 (en) Scene map building method, device, and storage medium
CN113936085B (en) Three-dimensional reconstruction method and device
CN111741254B (en) Visual digital twin high-end equipment system based on unmanned aerial vehicle information terminal
CN108682013A (en) A kind of gastroscope image intelligent processing unit
CN111566700B (en) Method and control device for determining the pose of an object in the surroundings of an object by means of multitasking learning
CN113610911A (en) Training method and device of depth prediction model, medium and electronic equipment
CN108613672A (en) Object positioning method, object positioning system and electronic equipment
CN111626226A (en) Neck rotation recognition method and system
CN110650532A (en) RFID-based medical bed positioning system and positioning method thereof
Gao et al. Coarse TRVO: A robust visual odometry with detector-free local feature
Leroux et al. Robot grasping of unknown objects, description and validation of the function with quadriplegic people
WO2022047827A1 (en) Emotional avatar-based mixed reality cooperation system
CN110119216A (en) Smart pen and teaching equipment
CN212967132U (en) Internet-based hardware architecture of regional medical remote diagnosis and treatment system
US11615544B2 (en) Systems and methods for end-to-end map building from a video sequence using neural camera models
Kemp A wearable system that learns a kinematic model and finds structure in everyday manipulation by using absolute orientation sensors and a camera
JPS58169987U (en) industrial robot
CN116152073B (en) Improved multi-scale fundus image stitching method based on Loftr algorithm

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20928428

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20928428

Country of ref document: EP

Kind code of ref document: A1