WO2020184751A1

WO2020184751A1 - Safety device for mobile robot for preventing accident

Info

Publication number: WO2020184751A1
Application number: PCT/KR2019/002835
Authority: WO
Inventors: 박정우; 최영호; 엄태영; 박지현; 배기덕
Original assignee: 한국로봇융합연구원
Priority date: 2019-03-11
Filing date: 2019-03-12
Publication date: 2020-09-17
Also published as: KR20200108631A; KR102202352B1

Abstract

The present invention relates to a safety device for a mobile robot for preventing an accident, and the present invention relates to a safety device capable of preventing an accident of a mobile robot by combining a primary safety device using a plurality of RGB-D cameras and a secondary safety device using a bumper. A safety device for a robot mounted on the robot, according to one aspect of the present invention, comprises: a primary safety device; and a secondary safety device connected to the primary safety device, wherein the primary safety device includes a plurality of RGB-D cameras that capture RGB (red, green, blue) and visual depth, and the secondary safety device includes: a bumper that absorbs a physical shock applied from the outside; and a contact sensor disposed on the exterior of the bumper. The plurality of RGB-D cameras are arranged to be spaced apart from each other at a predetermined distance such that a field of view can be adjusted so as to capture all directions of adjacent areas of the safety device for a robot, an occurrence of an event in a 3D space can be primarily detected on the basis of information obtained through the plurality of RGB-D cameras, and the occurrence of the event in the 3D space can be secondarily detected by using at least one of a displacement of the bumper and information sensed by the contact sensor.

Description

Safety device for mobile robots to prevent accidents

The present invention relates to a safety device for a mobile robot for preventing accidents, and the present invention prevents accidents of a mobile robot by combining a primary safety device using a plurality of RGB-D cameras and a secondary safety device using a bumper. It is about a safety device that can be done.

Robot technology is gradually approaching people's surroundings in a human-friendly way.

In the past, robots were often used for dangerous or simple repetition of tasks in the industrial industry, but in recent years, such as object transfer robots, home service robots, building guidance service robots, and outdoor reconnaissance robots, they enter human life and move autonomously. As mobile robots performing missions have been commercialized, their use is gradually increasing.

Since these mobile robots share a living space of a person and move together, a device for preventing accidents such as applying various sensors or algorithms or embedding mechanical safety devices is essential.

However, safety devices for mobile robots using conventional ultrasonic sensors or light detection and ranging (LIDAR) have advantages and disadvantages depending on the characteristics of each sensor and have limitations in function.

In addition, sensors used to prevent accidents in mobile robots have a relatively weak role in preventing accidents, as safety is the main purpose, not the awareness of the surrounding environment.

Therefore, there is a growing need for a safety device for a mobile robot to prevent accidents that can solve the above problems.

The present invention is to provide a user with a safety device for a mobile robot for preventing accidents.

Specifically, the present invention is to provide a user with a safety device capable of preventing accidents of a mobile robot by combining a first safety device using a plurality of RGB-D cameras and a second safety device using a bumper.

Meanwhile, the technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned are clearly to those of ordinary skill in the technical field to which the present invention belongs from the following description. It will be understandable.

The first safety device as an aspect of the present invention for achieving the above technical problem; And a second safety device connected to the first safety device, wherein the first safety device includes a plurality of red, green, blue (RGB) and visual depths. RGB-D camera; Including, the secondary safety device, a bumper for absorbing a physical shock applied from the outside; And a contact sensor disposed on the exterior of the bumper, wherein the plurality of RGB-D cameras are disposed at a predetermined distance so that the viewing angle can be adjusted to photograph all directions of an area adjacent to the safety device for the robot, The occurrence of an event in a three-dimensional space is primarily detected based on information acquired through the plurality of RGB-D cameras, and the three-dimensional space is performed using at least one of the displacement of the bumper and the information sensed by the contact sensor. It is possible to detect the occurrence of the event in the secondary.

In addition, the plurality of RGB-D cameras includes two or more RGB cameras and a depth camera for photographing the visual depth, and the two or more RGB cameras and a depth camera for photographing the visual depth Based on the information acquired through, an obstacle in the 3D space is identified, and in conjunction with a 3D motion recognition algorithm, the robot may take a response action on the identified obstacle.

In addition, the secondary safety device may include a spring inserted between the body of the robot and the bumper; And a switch disposed on the inside of the bumper, wherein the contact sensor may have a strip-shaped structure.

In addition, the spring provides a function of fixing the bumper in a predetermined direction based on an elastic force using compression, and the switch may detect displacement of the bumper when the belt-shaped contact sensor malfunctions.

In addition, by using at least one of the displacement of the bumper, information sensed by the contact sensor, and information sensed by the switch, an obstacle in the three-dimensional space is identified, and in conjunction with a three-dimensional motion recognition algorithm, the robot You can take action to respond to obstacles you have identified.

In addition, the belt-shaped contact sensor may be composed of a plurality of layers, and the bumper and the spring may be inserted and disposed between the plurality of layers.

In addition, the plurality of RGB-D cameras are arranged so that the viewing angles at least partially overlap, and based on the partially overlapping viewing angles, the plurality of RGB-D cameras may photograph all directions of an area adjacent to the safety device for the robot. .

The present invention can provide a user with a safety device for a mobile robot for preventing accidents.

Specifically, the present invention can provide a user with a safety device capable of preventing accidents of a mobile robot by combining a primary safety device using a plurality of RGB-D cameras and a secondary safety device using a bumper.

According to the safety device for a mobile robot for preventing accidents provided by the present invention, an obstacle approaching the mobile robot can be recognized in a three-dimensional space, so that an accident can be prevented in advance and an accurate accident prevention response is possible.

In addition, it is possible to respond to physical contact or impact in an unexpected situation.

In addition, the present invention has the advantage that it is possible to construct a safety device inexpensively and that a mobile robot can be applied to a complex environment.

On the other hand, the effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art from the following description. I will be able to.

1 is a block diagram illustrating the configuration of a safety device for a mobile robot for preventing accidents proposed by the present invention.

Figure 2 shows an example of a safety device for a mobile robot for preventing accidents proposed by the present invention.

3 shows a block diagram of a safety device for a mobile robot for preventing accidents proposed by the present invention.

4 shows a specific example of a primary safety device using a plurality of RGB-D cameras according to the present invention.

5 shows a recognition area of a primary safety device according to the present invention.

6 shows a specific example of a secondary safety device for recognizing an obstacle physically in contact using the bumper according to the present invention.

종래기술 및 문제점Conventional technology and problems

In the past, robots were often used for dangerous or simple task repetition in the industrial industry, but in recent years, such as object transfer robots, home service robots, building guidance service robots, and outdoor reconnaissance robots, they enter human life and move autonomously and provide services. As mobile robots performing missions have been commercialized, their use is gradually increasing.

Since these mobile robots share and move people's living spaces, a device for preventing accidents such as applying various sensors or algorithms or installing mechanical safety devices is essential.

For example, ultrasonic sensors or LIDARs are often used to recognize the environment around the robot by interlocking algorithms and to analyze its location indoors/outdoors, but it is avoided when an object or person corresponding to an obstacle approaches the vicinity by interlocking with an algorithm for safety. It is also used for the purpose of preventing contact accidents in advance by means of stopping or stopping.

Nevertheless, in order to prevent physical contact in close proximity to the robot, an infrared curtain sensor or bumper is sometimes applied.

In the case of an infrared curtain sensor, it is the same device as the non-contact sensor of an elevator, and a plurality of infrared sensor transceivers form an array and are used as a method of detecting an obstacle entering a two-dimensional plane.

In addition, in the case of a bumper, as a spring-based bumper, it is used as a method of responding appropriately by giving an electrical signal when an on/off switch is applied to the bumper, and additionally, as a spring-based bumper.

In addition, if there is a step that falls on the robot's moving path, accidents such as the robot fall may occur.Therefore, a separate distance sensor looking down is placed at the bottom of the robot to detect it before falling to prevent accidents. Sometimes it does.

In addition, sensors used to prevent accidents in mobile robots have a relatively weak role in preventing accidents, as the main purpose is to recognize the surrounding environment, not safety.

Specifically, when the surface of an obstacle is made of a material capable of absorbing sound waves, the ultrasonic sensor has a problem in that it is not properly recognized, and as the sound waves are diffused and spread, it is not possible to grasp the exact location of the recognized obstacle.

In addition, LIDAR has a wide recognition range and can grasp the position of an almost accurate obstacle, but generally recognizes only a two-dimensional space of a specific height, and has a problem that only a narrow range of three-dimensional space is recognized only when expensive products are used. .

In addition, in the case of the bumper, if an on/off switch is used in addition to using a spring mechanically, as many as possible of the switches should be placed around the bumper of the robot to recognize physical shocks coming from various directions. Since the switch is pressed only when a certain displacement occurs, there is a problem that it takes a long time to be recognized.

In addition, when an ultrasonic sensor or other distance sensor is used to recognize a falling step, there is a problem in that a two-dimensional area that can be recognized is very narrow, and a plurality of them must be used to recognize all directions.

사고 방지를 위한 모바일 로봇용 안전장치Safety device for mobile robots to prevent accidents

In the present invention, it is intended to provide a user with a safety device for a mobile robot for preventing accidents that can solve the above problems.

In other words, the present invention is to provide a safety device that can prevent accidents of a mobile robot by combining a first safety device using a plurality of RGB-D cameras and a second safety device using a bumper.

Prior to the detailed description of the present invention, a configuration of a safety device for a mobile robot for preventing accidents applied to the present invention will be described with reference to the drawings.

Referring to FIG. 1, the safety device 100 for a mobile robot for preventing accidents includes a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a sensing unit 140, An output unit 150, a memory 160, an interface unit 170, a control unit 180, a power supply unit 190, a bumper unit 200, and the like may be included.

However, since the components shown in FIG. 1 are not essential, a safety device for a mobile robot may be implemented to prevent accidents having more components or fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between a safety device for a mobile robot and a wireless communication system for preventing accidents or between a device and a network in which the device is located.

For example, the wireless communication unit 110 may include a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, a location information module 115, and the like.

The broadcast reception module 111 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and/or broadcast-related information, or a server that receives and transmits a previously-generated broadcast signal and/or broadcast-related information to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal in a form in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 includes, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcasting (DVB-H). -Handheld), ISDB-T (Integrated Services Digital Broadcast-Terrestrial), and other digital broadcasting systems can be used to receive digital broadcasting signals. Of course, the broadcast reception module 111 may be configured to be suitable for not only the digital broadcasting system described above, but also other broadcasting systems.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external device, and a server on a mobile communication network.

It may contain various types of data according to transmission/reception of text/multimedia messages.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be embedded or external to a safety device for a mobile robot for preventing accidents. As a wireless Internet technology, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), and the like may be used.

The short-range communication module 114 refers to a module for short-range communication. Short range communication technology such as Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra-Wideband (UWB), ZigBee, and Wi-Fi (Wireless Fidelity, Wi-Fi), etc. Can be used.

The location information module 115 is a module for acquiring the location of a safety device for a mobile robot for preventing accidents, and a representative example thereof is a GPS (Global Position System) module.

Referring to FIG. 1, an audio/video (A/V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122.

The camera 121 processes image frames such as still images or moving pictures obtained by the image sensor in the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110.

Two or more cameras 121 may be provided depending on the use environment.

The camera 121 according to the present invention may be an RGB-D camera.

The RGB-D camera captures color (RGB: red-green-blue) images and depth images.

The RGB-D camera for acquiring the color (RGB) image and the depth image may include a depth sensor integrally included in the RGB camera, or a separate depth camera.

A typical camera acquires only an RGB image, but an RGB-D camera used in an embodiment of the present invention uses a camera capable of acquiring depth information.

In order to capture the depth image, SwissRanger 4000, PMD[vision] CamCube, D-IMager, or Microsoft's Kinect may be used according to design conditions.

In addition, the microphone 122 receives an external sound signal by a microphone in a recording mode, a voice recognition mode, and the like and processes it as electrical voice data. The processed voice data may be converted into a format transmittable to a mobile communication base station through the mobile communication module 112 and then output. Various noise removal algorithms may be implemented in the microphone 122 to remove noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for controlling the operation of a safety device for a mobile robot for a user to prevent accidents. The user input unit 130 may include a key pad, a dome switch, a touch pad (positive pressure/power failure), a jog wheel, a jog switch, and the like.

The sensing unit 140 controls the opening/closing status of the safety device for mobile robots for preventing accidents, the location of the safety devices for mobile robots for preventing accidents, the presence of user contact, the defense of the safety devices for mobile robots for preventing accidents, and preventing accidents. It detects the current state of the safety device for mobile robots to prevent accidents, such as acceleration/deceleration of the safety device for mobile robots, and generates a sensing signal to control the operation of the safety device for mobile robots to prevent accidents.

The sensing unit 140 may sense whether the power supply unit 190 supplies power, whether the interface unit 170 is coupled to an external device, or the like.

Meanwhile, the sensing unit 140 may include a proximity sensor (not shown).

The output unit 150 is for generating output related to visual, auditory, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, a haptic module 154, and a projector module ( 155) and the like may be included.

The display unit 151 displays (outputs) information processed by a safety device for a mobile robot to prevent accidents.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. display) and a 3D display.

Some of these displays may be configured as a transparent type or a light-transmitting type so that the outside can be seen through them. This may be referred to as a transparent display, and a representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmission type structure.

Two or more display units 151 may exist depending on the implementation type of the safety device for a mobile robot for preventing accidents. For example, in a safety device for a mobile robot for preventing accidents, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be disposed on different surfaces.

When the display unit 151 and a sensor (hereinafter referred to as'touch sensor') for detecting a touch motion form a mutual layer structure (hereinafter, referred to as a'touch screen'), the display unit 151 It can also be used as an input device. The touch sensor may have, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or a capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only a touched position and area, but also a pressure at the time of touch.

When there is a touch input to the touch sensor, a signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know whether an area of the display unit 151 is touched.

The proximity sensor (not shown) may be disposed in an inner area of the safety device for a mobile robot for preventing accidents wrapped by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity using the force of an electromagnetic field or infrared rays without mechanical contact. Proximity sensors have a longer lifespan and higher utilization than contact sensors.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch screen is capacitive, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, an action of allowing the pointer to be recognized as being positioned on the touch screen by approaching the touch screen without contacting the pointer is referred to as "proximity touch", and the touch The act of actually touching the pointer on the screen is referred to as "contact touch". A position at which a proximity touch is performed by a pointer on the touch screen means a position at which the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

Meanwhile, the sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a recording mode, a voice recognition mode, and a broadcast reception mode. The sound output module 152 also outputs sound signals related to functions performed in a safety device for a mobile robot for preventing accidents. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of a safety device for a mobile robot for preventing an accident.

The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, by vibration.

The video signal or audio signal may also be output through the display unit 151 or the audio output module 152, so that they 151 and 152 may be classified as part of the alarm unit 153.

The haptic module 154 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 can be controlled.

For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to vibration, the haptic module 154 is used for stimulation such as an arrangement of pins that move vertically with respect to the contact skin surface, a blowing force or suction force of air through a jet or inlet, a grazing on the skin surface, contact of an electrode, and electrostatic force It can generate various tactile effects, such as the effect by the effect and the effect by reproducing the feeling of coolness using an endothermic or heat generating element.

The haptic module 154 may not only transmit a tactile effect through direct contact, but may also be implemented so that a user can feel the tactile effect through muscle sensations such as a finger or an arm. Two or more haptic modules 154 may be provided depending on the configuration aspect of the safety device for a mobile robot for preventing accidents.

The projector module 155 is a component for performing an image project function using a safety device for a mobile robot for preventing accidents, and is displayed on the display unit 151 according to a control signal from the controller 180 An image identical to or at least partially different from the image to be used may be displayed on an external screen or wall.

Specifically, the projector module 155 generates an image to be output to the outside by using a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, and light generated by the light source. It may include an image generating means (not shown) for performing and a lens (not shown) for expanding the image to the outside at a predetermined focal length. In addition, the projector module 155 may include a device (not shown) capable of adjusting an image projection direction by mechanically moving a lens or the entire module.

The projector module 155 may be divided into a cathode ray tube (CRT) module, a liquid crystal display (LCD) module, a digital light processing (DLP) module, and the like according to the device type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by expanding and projecting an image generated by reflecting light generated from a light source onto a digital micromirror device (DMD) chip.

Preferably, the projector module 155 may be provided in a longitudinal direction on the side, front or rear of the safety device for a mobile robot for preventing accidents. Of course, it is natural that the projector module 155 may be provided at any position of a safety device for a mobile robot for preventing accidents, if necessary.

Meanwhile, the memory unit 160 may store a program for processing and control of the controller 180, and temporarily store input/output data (eg, messages, audio, still images, moving pictures, etc.). It can also perform a function for. The frequency of use of each of the data may also be stored in the memory unit 160. In addition, the memory unit 160 may store data on vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The memory 160 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), and RAM. (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic It may include at least one type of storage medium among a disk and an optical disk. The safety device for a mobile robot for preventing accidents may operate in connection with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a passageway with all external devices connected to a safety device for a mobile robot for preventing accidents. The interface unit 170 receives data from an external device or receives power and transmits it to each component inside the safety device for a mobile robot to prevent accidents, or transmits data inside the safety device for a mobile robot to the outside. To the device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port to connect a device equipped with an identification module, an audio input/output (I/O) port, A video input/output (I/O) port, an earphone port, etc. may be included in the interface unit 170.

The identification module is a chip that stores various information for authenticating the right to use safety devices for mobile robots to prevent accidents, and includes a user identification module (UIM), a subscriber identification module (SIM), and general purpose. It may include a user authentication module (Universal Subscriber Identity Module, USIM), and the like. A device equipped with an identification module (hereinafter,'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to a safety device for a mobile robot to prevent accidents through the port.

When the safety device for mobile robot for accident prevention is connected to an external cradle, the interface unit serves as a path through which power from the cradle is supplied to the safety device for mobile robot for accident prevention, or in the cradle by a user. It may be a path through which various input command signals are transmitted to the mobile device. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile device is correctly mounted on the cradle.

The controller 180 generally controls the overall operation of the safety device for a mobile robot to prevent accidents.

The power supply unit 190 receives external power and internal power under the control of the controller 180 to supply power necessary for the operation of each component.

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions, in some cases herein. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as procedures and functions described in the present specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. The software code can be implemented as a software application written in an appropriate programming language. The software code may be stored in the memory 160 and executed by the controller 180.

In addition, referring to FIG. 1, the safety device 100 for a mobile robot may include a bumper part 200.

The bumper part 200 according to the present invention refers to a safety device for recognizing an obstacle physically in contact with the bumper.

사고 방지를 위한 모바일 로봇용 안전장치의 기술적 특징Technical features of safety devices for mobile robots to prevent accidents

In the present invention, a safety device that can prevent accidents of a mobile robot is proposed by combining a primary safety device using a plurality of RGB-D cameras 121 and a secondary safety device using the bumper unit 200. .

If the device proposed by the present invention is used in a mobile robot, it is possible to determine the location of obstacles approaching the robot in three-dimensional space, thereby enabling a more accurate accident prevention response, and also enabling a response to physical contact in unexpected situations. I expect to be able to do it.

Referring to FIG. 2, the safety device 100 to be presented in the present invention is a primary safety device and a bumper unit for recognizing an approaching obstacle by linking information of a plurality of RGB-D cameras 121 with a motion recognition algorithm. 200), it is composed of a secondary safety device that recognizes obstacles in contact physically.

3, a safety device for a mobile robot for preventing accidents proposed by the present invention includes a first safety device 300, a second safety device 200, a control unit 180, and an output unit 150. I can.

First, the primary safety device 300 may include a plurality of RGB-D cameras for photographing red, green, and blue (RGB) and visual depth.

The plurality of RGB-D cameras includes two or more RGB cameras and a depth camera for photographing the visual depth,

An obstacle in the three-dimensional space may be identified based on information acquired through the two or more RGB cameras and a depth camera that photographs the visual depth.

In addition, by interlocking with a 3D motion recognition algorithm under the control of the controller 180, the robot may take a response action for the identified obstacle.

In addition, the plurality of RGB-D cameras 121 may be disposed so that the viewing angles at least partially overlap.

Accordingly, in the present invention, based on the partially overlapping viewing angle, the plurality of RGB-D cameras 121 may take an all-round view of an area adjacent to the safety device for the robot.

Referring to FIG. 4A, the RGB-D camera 121 of the primary safety device includes two or more RGB cameras for viewing color information and a depth camera for viewing visual depth.

In the present invention, information on a three-dimensional space with respect to an area to be checked can be recognized through a combination of the aforementioned cameras.

In addition, as shown in (b) of Figure 4, a plurality of RGB-D cameras 121 on the top of the mobile robot 100 to adjust the viewing angle so that the area close to the robot can be seen, and surrounding the robot 100 By placing at regular intervals and interlocking with the 3D motion recognition algorithm, the entire area that enters the camera's field of view from the robot can be viewed in three dimensions.

5 shows a recognition area of the primary safety device according to the present invention, (a) shows an example of a recognition area from the side, and (b) shows an example of the recognition area viewed from above.

As shown in FIG. 5, in the present invention, using the information thus obtained, an algorithm for safety is interlocked by recognizing an obstacle approaching in a three-dimensional space under the camera and responding to it, such as avoiding or stopping. .

In addition, the present invention interlocks an algorithm for preventing an accident in which the robot falls by recognizing a step falling around the robot.

Returning to FIG. 3 again, the secondary safety device 200 is a bumper part 200, and the bumper part 200 according to the present invention includes a bumper 210, a bumper spring 220, an on/off switch 230 ) And a band-shaped contact sensor 240 may be included.

First, the bumper 210 is configured in a structure capable of absorbing physical impacts applied from the outside in a horizontal direction to the ground.

Next, a bumper spring 220 is disposed between the body of the mobile robot 100 and the bumper 210.

The spring applied to the bumper spring 220 uses a compression spring, and the bumper 210 is fixed by standing in a vertical direction so as to have elastic force in all directions.

In addition, by placing an electrical on/off switch 230 inside the bumper 210, even if a contact sensor malfunctions, it is possible to recognize the push of the bumper 210 in duplicate.

In addition, by placing the belt-shaped contact sensor 240 on the edge of the bumper 210, when pressure is generated by an external physical shock to the bumper 210, an electrical signal can be sent to immediately recognize and respond for safety.

Referring to (a) of FIG. 6, the bumper part 200 shows a specific arrangement of the bumper 210, the bumper spring 220, the on/off switch 230, and the belt-shaped contact sensor 240.

Referring to (a) of FIG. 6, a plurality of bumpers 210 configured in a structure capable of absorbing physical impacts applied from the outside in a horizontal direction to the ground are shown.

Further, referring to (b) of FIG. 6, a bumper spring 220 is disposed between the body of the mobile robot 100 and the bumper 210.

At this time, the spring applied to the bumper spring 220 uses a compression spring, and the bumper 210 is fixed by standing in a vertical direction so as to have elastic force in all directions.

In addition, as shown in (b) of FIG. 6, even if an electrical on/off switch 230 is placed inside the bumper 210, even if a contact sensor malfunctions, the bumper 210 is pressed twice. Can be recognizable.

In addition, as shown in (a) of FIG. 6, by placing a belt-shaped contact sensor 240 on the edge of the bumper 210, when pressure due to an external physical shock occurs in the bumper 210, an electrical signal is sent immediately. You can make a response for awareness and safety.

In addition, the present invention may include an output unit 150.

The safety device 100 for a robot according to the present invention may include an obstacle avoidance unit 156, an emergency stop unit 157 and a corresponding motion unit 158.

In the present invention, the occurrence of an event in a three-dimensional space is primarily detected based on information acquired through a plurality of RGB-D cameras 121, and the displacement of the bumper 210 and the information sensed by the contact sensor 240 The occurrence of an event in the 3D space is secondarily detected using at least one of.

In addition, in the present invention, when the belt-type contact sensor 240 malfunctions, the switch 230 detects the displacement of the bumper 210 instead.

As a result, in the present invention, an obstacle in the three-dimensional space is identified using at least one of the displacement of the bumper 210, information sensed by the band-type contact sensor 240, and information sensed by the switch 230.

In this case, through the obstacle avoiding unit 156 on the output unit 150, when an obstacle exists in the 3D space, the robot may control to avoid it.

In addition, based on the emergency stop unit 157, the robot can be controlled to stop in order to prevent collision with an obstacle in the 3D space.

Also, based on the corresponding motion unit 158, it is possible to control to take a motion corresponding to an event in the 3D space that has occurred.

Therefore, the present invention adjusts the viewing angle so that the area close to the robot 100 is visible, and arranges a plurality of RGB-D cameras 121 at regular intervals around the robot 100, and interlocks with the 3D motion recognition algorithm. Algorithm for safety that detects and avoids or stops when an obstacle approaches in the 3D space under the camera by collecting and using information in 3D over the entire area of the camera's field of view at a close distance of the robot It is possible to provide a user with a safety device linked to.

In addition, the present invention fixes the bumper 210 with a compression spring 220 erected in a vertical direction on the body of the mobile robot 100, and a belt-shaped contact sensor 240 and an on/off switch ( 230), when pressure or displacement of the bumper 210 occurs in the bumper 210 by an external physical impact, it is possible to provide a safety device to the user to immediately recognize and respond to safety by sending an electrical signal.

As a result, the present invention can provide a safety device for a mobile robot combining a safety device based on an RGB-D camera and a safety device based on a bumper.

사고 방지를 위한 모바일 로봇용 안전장치에 따른 효과Effects of safety devices for mobile robots to prevent accidents

In addition, the above-described embodiments of the present invention can be implemented through various means. For example, embodiments of the present invention may be implemented by hardware, firmware, software, or a combination thereof.

In the case of hardware implementation, the method according to embodiments of the present invention includes one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), and Programmable Logic Devices (PLDs). , Field Programmable Gate Arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and the like.

In the case of implementation by firmware or software, the method according to the embodiments of the present invention may be implemented in the form of a module, procedure, or function that performs the functions or operations described above. The software code may be stored in a memory unit and driven by a processor. The memory unit may be located inside or outside the processor, and may exchange data with the processor through various known means.

Detailed description of the preferred embodiments of the present invention disclosed as described above has been provided to enable those skilled in the art to implement and implement the present invention. Although the above has been described with reference to preferred embodiments of the present invention, those skilled in the art will understand that various modifications and changes can be made to the present invention without departing from the scope of the present invention. For example, those skilled in the art may use the configurations described in the above-described embodiments in a manner that combines with each other. Thus, the invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The present invention may be embodied in other specific forms without departing from the spirit and essential features of the present invention. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention. The invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. In addition, the embodiments may be configured by combining claims that do not have an explicit citation relationship in the claims, or may be included as new claims by amendment after filing.

Claims

Primary safety device; And in the safety device for a robot mounted on the robot, including; a second safety device connected to the first safety device,

The primary safety device,

Including; a plurality of RGB-D cameras for shooting RGB (red, green, blue) and visual depth,

The secondary safety device,

A bumper that absorbs a physical shock applied from the outside; And

Includes; a contact sensor disposed on the exterior of the bumper,

The plurality of RGB-D cameras are arranged at a predetermined distance so that the viewing angle can be adjusted to photograph all directions of an area adjacent to the safety device for the robot,

Firstly detecting the occurrence of an event in a three-dimensional space based on information acquired through the plurality of RGB-D cameras,

A safety device for a robot, characterized in that the occurrence of an event in the three-dimensional space is secondarily detected using at least one of the displacement of the bumper and the information sensed by the contact sensor.

The method of claim 1,

Based on information obtained through the two or more RGB cameras and a depth camera that photographs the visual depth, an obstacle in the three-dimensional space is identified,

A safety device for a robot, characterized in that in conjunction with a 3D motion recognition algorithm, the robot takes a response action on the identified obstacle.

The method of claim 1,

The secondary safety device,

A spring inserted between the body of the robot and the bumper; And

A switch disposed on the inside of the bumper; further includes,

The contact sensor is a safety device for a robot, characterized in that the belt-shaped structure.

The method of claim 3,

The spring,

Provides a function of fixing the bumper in a certain direction based on the elastic force using compression,

The switch,

When the belt-type contact sensor malfunctions, a safety device for a robot, characterized in that for detecting displacement of the bumper.

The method of claim 4,

An obstacle in the three-dimensional space is identified using at least one of the displacement of the bumper, information sensed by the contact sensor, and information sensed by the switch,

The method of claim 3,

The band-shaped contact sensor is composed of a plurality of layers,

The safety device for a robot, characterized in that the bumper and the spring are inserted and disposed between the plurality of layers.

The method of claim 1,

The plurality of RGB-D cameras are arranged so that the viewing angles at least partially overlap,

Based on the partially overlapping viewing angles, the plurality of RGB-D cameras photographs all directions of an adjacent area of the safety device for a robot.