KR101643812B1 - Apparatus and method for guaranteeing robot safety using robot guardian module - Google Patents
Apparatus and method for guaranteeing robot safety using robot guardian module Download PDFInfo
- Publication number
- KR101643812B1 KR101643812B1 KR1020140105930A KR20140105930A KR101643812B1 KR 101643812 B1 KR101643812 B1 KR 101643812B1 KR 1020140105930 A KR1020140105930 A KR 1020140105930A KR 20140105930 A KR20140105930 A KR 20140105930A KR 101643812 B1 KR101643812 B1 KR 101643812B1
- Authority
- KR
- South Korea
- Prior art keywords
- robot
- risk
- user
- information
- state
- Prior art date
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
- B25J19/02—Sensing devices
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Robotics (AREA)
- Automation & Control Theory (AREA)
- Manipulator (AREA)
- Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Multimedia (AREA)
- Evolutionary Computation (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The present invention relates to a robot guardian module and a robot safety assurance apparatus and method using the robot guardian module. More particularly, the present invention relates to a robotic guardian module, It analyzes the status information of the detected user and the status information of the robot to deduce the risk of the robot to the user and the risk of the robot, determines the risk, and controls the robot according to the determined risk, And a robot safety assurance apparatus and method using the same.
Description
The present invention relates to a robot guardian module and a robot safety assurance apparatus and method using the same. More particularly, the present invention relates to a robot guardian module, The present invention relates to a robot guardian module for ensuring security of a user and safety of a robot by controlling the robot security device and method and a robot safety assurance method using the same.
Robots such as humanoids have a human-friendly appearance, and autonomous robots are being opened, demonstrating smooth joint movements such as stepping up and down, sideways and curved walking, and dynamic bipedal walking (walking on two feet). As such, the robot industry has been developed with the ultimate goal of providing various services on behalf of human beings or in cooperation with human beings.
Currently, Cog, developed by MIT vs. the Institute of Artificial Intelligence, and Asimo, developed by Honda, Japan, have the most human-like functions of existing robots. Robot technology, which is not different from human beings, not only appearance but also motion and intelligence, is still possible in the future.
However, due to the steady development of the robot industry, demand for service robots for various purposes such as guidance robots and educational robots is continuously increasing. Therefore, there is an increasing number of cases where human and service robots coexist in the same space. Therefore, it is necessary to prevent human injury caused by a service robot providing services to humans in a space where human and service robots coexist together, It is required to present a technique for ensuring the safety of the robot.
The present invention has been proposed in order to satisfy the demands of the development of robotic technology as described above, and it is an object of the present invention to provide a robotic robot that determines the risk of a robot to a user based on multiple information sensed through a sensor module, And to provide a robot guardian module and a robot safety assurance apparatus and method using the same, which can prevent a dangerous situation caused by a robot by controlling the robot, thereby ensuring safety of the user and safety of the robot.
In order to achieve the object of the present invention, the robot guardian module according to the present invention analyzes user's heartbeat information, voice information, and image information sensed by a heartbeat sensor, a voice sensor, and an image sensor, A state part recognizing an associated heart rate change, screaming and facial expression information, and recognizing an operation state of the robot by analyzing state information of the robot sensed by the robot state sensor; A risk inferring unit for inferring a risk of the robot to the user and a risk of the robot by analyzing the heartbeat change, screaming and facial expression information of the user recognized from the status part and the operation state of the robot; And a risk judgment unit for classifying the risk inferred from the risk inferring unit according to the risk level to determine the risk corresponding to the inferred risk and transmitting the risk information for removing the risk situation to the robot control module by controlling the robot .
The risk determining unit determines the risk by analyzing the size of the user's heartbeat change, the size and frequency of screaming of the user, the degree of danger represented by the user's facial expression, and the operating state of the robot.
In order to achieve the object of the present invention, a robot safety assurance apparatus using a robot guardian module according to the present invention includes a heartbeat sensor, a voice sensor, an image sensor, and a robot status sensor, A sensor module for detecting state information of the user including the image information and the state information of the robot, and determining the risk by deducing the risk of the robot to the user and the risk of the robot based on the information detected from the sensor module And a robot control module for controlling the robot according to the risk information transmitted from the robot guardian module.
In order to achieve the object of the present invention as described above, the robot safety determination method using the robot guardian module according to the present invention includes analyzing user's heartbeat information detected from a heartbeat sensor to recognize a user's heart- Recognizing the scream related to the dangerous feeling by analyzing the user's voice information sensed by the sensor, recognizing the user's facial expression related to the dangerous feeling by analyzing the user's image information sensed by the image sensor, A first step of analyzing information and recognizing an operation state of the robot; A second step of analyzing a heartbeat of the perceived user, a scream, a facial expression, and an operating state of the robot to deduce a risk of the robot to the user and a risk of the robot; And a third step of classifying the inferred risk by the risk level, determining the risk corresponding to the inferred risk, and transmitting the risk information to the robot control module by controlling the robot to remove the risk situation.
In order to achieve the object of the present invention as described above, a robot security assurance method using a robot guardian module according to the present invention is characterized in that a sensor module detects a state of a user including heartbeat information, voice information, A first step of detecting state information of the robot indicating whether or not the robot is present; A second step of analyzing the state information of the detected user and the state information of the detected user to determine the risk by deducing the risk of the robot to the user and the risk of the robot; And a third step of the robot control module controlling the robot according to the determined risk to eliminate the dangerous situation.
The present invention determines the risk of a robot to a user on the basis of multiple information sensed by a sensor module and controls the robot according to the determined risk, thereby eliminating the dangerous situation caused by the robot to secure the safety of the user and the safety of the robot .
The present invention has an effect of detecting the state information of the robot and diagnosing and coping with the operation state of the robot.
1 is a block diagram showing a robot guardian module and a robot safety assurance apparatus using the same according to the present invention,
FIG. 2 is a flowchart illustrating a robot security assurance method using a robot guardian module according to the present invention,
3 is a diagram illustrating an example of a method for inferring a risk based on voice information of a user,
4 is an exemplary diagram showing facial expression information stored in a database in order to infer a risk based on facial information of a user.
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
1 is a block diagram showing a robot guardian module and a robot safety assurance apparatus using the same according to the present invention. 1, the robot safety assurance apparatus according to the present invention includes a
The
A sensor for detecting user status information such as the
The
The
The risk inferring
A safety
The
When the inferred risk is the first level, the
FIG. 2 is a flowchart illustrating a robot safety assurance method using a robot guardian module according to the present invention. As shown in FIG. 2, the robot safety assurance method using the robot guardian module according to the present invention includes a state information of a user including heartbeat information, voice information, and image information of a user, A second step S12 for determining the risk level by inferring whether the risk of the robot to the user and the risk of the robot are analyzed by analyzing the detected state information of the user and the state information of the robot, , S14, and S16), and a third step (S18) of controlling the robot according to the determined risk to remove the dangerous situation.
In the second step S12, S14, and S16, the user is aware of the emotional state felt by the user through analysis of the detected state information of the user, transmits the state information of the user, and analyzes the state information of the detected robot (S12) of recognizing the normal state of the robot and transmitting the state information of the robot to the robot, and analyzing the transmitted state information of the user and the state information of the robot, (S14) deducing whether or not the robot is dangerous, and classifying and determining the risk according to the reasoned risk (S16).
Now, the operation of the robot guardian module according to the present invention and the robot safety assurance apparatus using the same will be described in detail.
The
The
The
That is, the heart rate change hold
The
The facial
In this way, the perceived information of the user, such as the change of the heart beat of the user, the screaming, and the facial expression corresponding to the degree of danger, are transmitted to the risk inferring
The robot status hold
The risk inferring
In other words, the risk inferring
The
The
For example, a method for the
Upon receiving the user's image information from the image sensor, the
Each pre-stored facial information has a risk level set according to the degree of risk. For example, when the risk is classified into three levels of "safety", "warning" and "danger", the action unit 1 (AU1) is classified as a "warning" level,
If the detected facial expression information is a facial expression of the action unit AU1 + 2, the
For example, when the inferred risk level is the highest level, " RISK ", the
When the risk level is the " warning " level, the
When the risk level is the "safe" level, the
The operation of controlling the robot according to the risk level is not limited thereto and can be variously implemented according to the service type or the state of the user provided by the service robot.
The safety
A safety
100: sensor module 110: heart rate sensor
120: voice sensor 130: image sensor
140: Robot status sensor 200: Robot Guardian module
210: state change unit 211: heart rate change branch
212: voice recognition section 213: facial expression branch
214: Robot status part 220: Risk inference part
230: Risk judging unit 300: Robot control module
400: Safety Mode Switch
Claims (13)
A risk inferring unit for inferring a risk of the robot to the user and a risk of the robot by analyzing the heartbeat change, screaming and facial expression information of the user recognized from the status part and the operation state of the robot; And
And a risk judgment unit for classifying the risk inferred from the risk inferencing unit by the risk level to determine the risk corresponding to the inferred risk and transmitting the risk information for controlling the robot to the risk control unit for removing the risk situation, Robot Guardian Module.
A robot guardian module for analyzing the magnitude of the user's heart rate change, the size and frequency of screaming of the user, the degree of danger represented by the user's facial expression, and the operation status of the robot.
A robot guardian module that determines a risk and deduces risk information based on information detected from the sensor module by deducing a risk of the robot to the user and a risk of the robot, and transmits the risk information; And
And a robot control module for controlling the robot according to the risk information transmitted from the robot guardian module;
The robot guardian module includes:
The sensor module recognizes the emotion state of the user through the analysis of the state information of the user and transmits the state information of the user, and analyzes the state information of the robot detected from the sensor module, A state in which the robot recognizes and transmits state information of the robot;
A risk inferring unit that comprehensively analyzes the state information of the user transmitted from the state receiving unit and the state information of the robot to deduce a risk of the robot to the user and a risk of the robot; And
And a risk judgment unit for determining a risk corresponding to the inferred risk from the risk inferring unit and transmitting the risk information to the robot.
A heartbeat change unit for analyzing a heartbeat of a user sensed by the heartbeat sensor and recognizing a heartbeat change of a user having a sudden change over a predetermined size;
A voice recognition unit for analyzing a voice of a user detected by the voice sensor and recognizing whether the voice is screaming;
A facial expression unit for analyzing a user's image sensed by the image sensor and recognizing a facial expression corresponding to a danger; And
And a robot state recognition unit for recognizing whether the robot is in a normal state by analyzing state information of the robot detected from the robot state sensor.
The level of risk of the robot to the user is analyzed from the user's image information, the size of the user's screaming analyzed from the user's voice information and the frequency of occurrence, the size of the user's heartbeat change related to the risk appraisal analyzed from the user's heartbeat information And the degree of danger represented in the facial expression of the user, and the operation state of the robot are comprehensively analyzed and classified into the first to third levels.
If the inferred risk is the first level, it is determined that the robot and the user are in a safe state, and the risk information for maintaining the current operation of the robot is transmitted to the robot control module.
When the inferred risk is the second level, determines that the risk related degree of the robot to the user is the warning level, transmits the risk information for decelerating or abruptly stopping the current speed of the robot to the robot control module,
When the inferred risk is the third level, it is determined that the degree of risk related to the user is a dangerous level, and the risk information for switching the power supply to the robot and switching the robot to the lock state is transmitted to the robot control module And a robot safety device using the robot guardian module.
A second step of analyzing a heartbeat of the perceived user, a scream, a facial expression, and an operating state of the robot to deduce a risk of the robot to the user and a risk of the robot; And
And a third step of classifying the inferred risk by the risk level, determining the risk corresponding to the inferred risk, and transmitting the risk information to the robot control module to control the robot to remove the risk situation, How to determine robot safety of module.
Classifying the risk into the first to third levels according to the size of the user's heart rate change, the size and occurrence frequency of the user, the degree of danger represented by the user's facial expression, and whether the robot is operating normally;
Transmitting the risk information for maintaining the current operation of the robot to the robot control module when the inferred risk is the first level, determining that the robot and the user are in a safe state;
If the inferred risk is the second level, determining that the degree of risk to the user is a warning level and transmitting the risk information for decelerating or stopping the current speed of the robot to the robot control module; And
If the inferred risk is the third level, it is determined that the degree of risk of the robot to the user is a dangerous level, and the risk information for switching off the power supply to the robot and switching the robot to the lock state is transmitted to the robot control module And determining the robot safety of the robot guardian module.
A second step of analyzing the state information of the detected user and the state information of the detected user to determine the risk by deducing the risk of the robot to the user and the risk of the robot; And
And a third step of the robot control module controlling the robot according to the determined risk to eliminate the dangerous situation;
The second step comprises:
Recognizes the change of the heart-beat related to the risk by analyzing the detected user's heartbeat information, recognizes the screaming by analyzing the detected user's voice information, and recognizes the facial expression corresponding to the danger by analyzing the detected user's image information, A first sub-step of analyzing state information of the robot to recognize an operation state of the robot;
A second sub-step of comprehensively analyzing the perceived user's heart rate change, scream, facial expression, and the operation state of the robot to deduce a risk of the robot to the user and the risk of the robot; And
A third step of comprehensively analyzing the risk of the inferred risk by comprehensively analyzing the size of the heartbeat change of the user, the size and occurrence frequency of the scream of the user, the degree of danger represented by the expression of the user, Wherein the robot is provided with a plurality of robots.
Transmitting the risk information for maintaining the current operation of the robot to the robot control module when the inferred risk is the safety level;
Transmitting risk information for decelerating or stopping the current speed of the robot to the robot control module when the inferred risk is the warning level; And
Further comprising the step of transmitting, to the robot control module, risk information for turning off the power supply to the robot and switching the robot to a lock state when the inferred risk is a dangerous level. Robot safety assurance method.
And analyzing only one of the user's heartbeat information, the user's voice information, and the user's image information according to the service environment provided by the robot to the user, and determining the risk by deducing the risk of the robot to the user Robot Safety Assurance Method Using Robot Guardian Module.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020140105930A KR101643812B1 (en) | 2014-08-14 | 2014-08-14 | Apparatus and method for guaranteeing robot safety using robot guardian module |
PCT/KR2015/008533 WO2016024849A1 (en) | 2014-08-14 | 2015-08-13 | Robot guardian module, and robot safety ensuring device and method using same |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020140105930A KR101643812B1 (en) | 2014-08-14 | 2014-08-14 | Apparatus and method for guaranteeing robot safety using robot guardian module |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20160020772A KR20160020772A (en) | 2016-02-24 |
KR101643812B1 true KR101643812B1 (en) | 2016-07-28 |
Family
ID=55304393
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020140105930A KR101643812B1 (en) | 2014-08-14 | 2014-08-14 | Apparatus and method for guaranteeing robot safety using robot guardian module |
Country Status (2)
Country | Link |
---|---|
KR (1) | KR101643812B1 (en) |
WO (1) | WO2016024849A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102522898B1 (en) * | 2016-05-09 | 2023-04-19 | 한국전자통신연구원 | Method and apparatus for adjusting safty of collaborating robot by recognizing emotion status of worker |
CN107256021A (en) * | 2017-07-25 | 2017-10-17 | 陕西舜洋电子科技有限公司 | Study of Intelligent Robot Control method for volleyball training |
CN107972040A (en) * | 2017-11-10 | 2018-05-01 | 深圳市赛亿科技开发有限公司 | Intelligent robot |
CN114770531A (en) * | 2022-04-14 | 2022-07-22 | 江苏西顿科技有限公司 | Safety monitoring system and method for explosion-proof robot |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100583920B1 (en) * | 2005-01-06 | 2006-05-29 | 가락전자 주식회사 | Robot system based on network using robot having face-motion sensing function |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20040034164A (en) * | 2002-10-21 | 2004-04-28 | (주)메드 밴 | Nursing robot and mornitoring system using nursing robot |
JP2006289508A (en) * | 2005-04-05 | 2006-10-26 | Sony Corp | Robot device and its facial expression control method |
KR20090036654A (en) * | 2007-10-10 | 2009-04-15 | 주식회사 그랜드포트 | The apparatus for expressing status of robot's health state and emotional state with a heart pulsation and method thereof |
KR20100028358A (en) * | 2008-09-04 | 2010-03-12 | 삼성전자주식회사 | Robot and method for controlling safe of the same |
KR20120071555A (en) * | 2010-12-23 | 2012-07-03 | 한국전자통신연구원 | Apparatus for rehabilitation robot |
KR101945185B1 (en) * | 2012-01-12 | 2019-02-07 | 삼성전자주식회사 | robot and method to recognize and handle exceptional situations |
KR101407158B1 (en) | 2012-11-12 | 2014-06-13 | 재단법인대구경북과학기술원 | lifesaving system and method to save thereof |
-
2014
- 2014-08-14 KR KR1020140105930A patent/KR101643812B1/en active IP Right Grant
-
2015
- 2015-08-13 WO PCT/KR2015/008533 patent/WO2016024849A1/en active Application Filing
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100583920B1 (en) * | 2005-01-06 | 2006-05-29 | 가락전자 주식회사 | Robot system based on network using robot having face-motion sensing function |
Also Published As
Publication number | Publication date |
---|---|
WO2016024849A1 (en) | 2016-02-18 |
KR20160020772A (en) | 2016-02-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101643812B1 (en) | Apparatus and method for guaranteeing robot safety using robot guardian module | |
JP2020126644A (en) | Method and device for alerting abnormal driver situation detected by using humans' status recognition via v2v connection | |
US10748404B2 (en) | Method and apparatus for recognising microsleep in a driver of a vehicle | |
JP2017536595A5 (en) | ||
US10016898B2 (en) | Robot system using a vision sensor | |
US9782897B2 (en) | Robot system using a vision sensor | |
US20090033501A1 (en) | Online monitoring method of driver state and system using the same | |
Agrawal et al. | Emotion and gesture recognition with soft computing tool for drivers assistance system in human centered transportation | |
US11457837B2 (en) | Direction control apparatus with sensor, and method and system for determining driver status using the same | |
JP7256086B2 (en) | Method, device, equipment and storage medium for identifying passenger status in unmanned vehicle | |
JP7154959B2 (en) | Apparatus and method for recognizing driver's state based on driving situation judgment information | |
US11960285B2 (en) | Method for controlling robot, robot, and recording medium | |
US11427208B2 (en) | Driver condition determination apparatus, method and computer program product | |
US11662061B2 (en) | Power tool safety system | |
Brygo et al. | Humanoid robot teleoperation with vibrotactile based balancing feedback | |
KR101513540B1 (en) | Apparatus and method for controlling vehicle by gesture recognition with hand | |
US20240142997A1 (en) | Method for controlling robot, robot, and recording medium | |
Tomari et al. | Enhancing wheelchair manoeuvrability for severe impairment users | |
Vroon et al. | Detecting Perceived Appropriateness of a Robot's Social Positioning Behavior from Non-Verbal Cues | |
JP2021103391A (en) | Watching device | |
KR101159941B1 (en) | Elevator monitoring system and operating method thereof | |
Paulo et al. | Classification of reaching and gripping gestures for safety on walking aids | |
Mohan et al. | False alarm metrics for human–robot interactions in service robots | |
KR20180135751A (en) | Bed having falling warning function and control method thereof | |
JP7465664B2 (en) | Work machine monitoring device and work machine monitoring method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant | ||
FPAY | Annual fee payment |
Payment date: 20190627 Year of fee payment: 4 |