WO2024063625A1

WO2024063625A1 - Total collaborative robot control system based on artificial intelligence camera

Info

Publication number: WO2024063625A1
Application number: PCT/KR2023/014615
Authority: WO
Inventors: 최홍일
Original assignee: (주) 마가커피
Priority date: 2022-09-25
Filing date: 2023-09-25
Publication date: 2024-03-28
Also published as: KR102518302B1

Abstract

The present invention relates to a total collaborative robot control system based on an artificial intelligence camera. The system may comprise: a collaborative robot; a central control server that communicates with and controls the collaborative robot; an artificial intelligence camera that communicates with the central control server and images the inside of a shop in which the collaborative robot is located; a database unit that receives and stores a method for the central control server to control the collaborative robot according to the position or movement, input to the artificial intelligence camera, of an object; and a communication unit that transmits data related to the space, physical objects, or use from a shop manager or the collaborative robot to the central control server.

Description

Collaborative robot total control system based on artificial intelligence camera

The present invention relates to a collaborative robot total control system based on an artificial intelligence camera.

Robots have been developed for industrial use and have played a part in factory automation. Recently, the field of application of robots has expanded further, and medical robots, aerospace robots, etc. have been developed, and household robots that can be used in general homes are also being created. Among these robots, those that can run on their own are called artificial intelligence robots.

As the use of robots increases, the demand for robots that can provide a variety of information, fun, and services beyond the repetitive performance of simple functions is increasing.

Accordingly, various robots that provide convenience to people by being deployed in homes, restaurants, stores, public places, etc. are being developed.

Additionally, it is being proposed for services that remotely control robots to care for patients. For example, prior literature (U.S. registered patent US9361021) refers to remotely controlling a robot to perform the function of caring for a patient, selectively displaying patient information through a display, and displaying real-time images of the patient. Function is provided.

Meanwhile, the above-mentioned background technology is technical information that the inventor possessed for deriving the present invention or acquired in the process of deriving the present invention, and cannot necessarily be said to be known technology disclosed to the general public before filing the application for the present invention. .

The purpose of the present invention is to detect through an artificial intelligence camera the presence of an object recognized as a person within the movement radius of a plurality of operating collaborative robots and stop the operation of the corresponding collaborative robot to prevent damage to the objects (people) and the collaborative robot. We provide a collaborative robot total control system based on an artificial intelligence camera that can be minimized.

The technical problem of the present invention is not limited to the technical problem mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below.

A collaborative robot total control system based on an artificial intelligence camera according to an embodiment of the present invention may include a collaborative robot that makes coffee using a coffee machine.

A collaborative robot total control system based on an artificial intelligence camera according to an embodiment of the present invention includes a central control server that communicates with the collaborative robot and controls the collaborative robot; An artificial intelligence camera that communicates with the central control server and takes pictures of the store where the collaborative robot is located; a database unit that receives and stores a method of controlling the collaborative robot by the central control server according to the position or movement of an object input to the artificial intelligence camera; and a communication unit that transmits data related to space, objects, and usage from the store manager or the collaborative robot to the central control server.

According to one embodiment, the collaborative robot can perform in-store tasks including making or serving drinks.

According to one embodiment, the central control server determines that there is a possibility of collision with the collaborative robot when an object recognized as a person through the artificial intelligence camera exists within the range where multiple collaborative robots drive, and the object is The operation of a nearby collaborative robot can be stopped.

According to one embodiment, the central control server may call a store manager to manually control the collaborative robot that has stopped operating.

According to one embodiment, the data related to space, objects, and use may mean a store drawing possessed by the store manager or data related to recognition of spaces and objects recognized by the artificial intelligence camera.

According to one embodiment, the collaborative robot may include an artificial neural network in the form of software or hardware learned to recognize at least one of the properties of space and properties of objects including obstacles.

According to one embodiment, the central control server may include an artificial neural network in the form of software or hardware trained to recognize at least one of the properties of space and properties of objects including obstacles.

According to one embodiment, the collaborative robot may include a deep neural network including a Convolutional Neural Network (CNN) or a Deep Belief Network (DBN) learned through deep learning.

According to one embodiment, the central control server may include a deep neural network including a Convolutional Neural Network (CNN) or a Deep Belief Network (DBN) learned through deep learning.

According to one embodiment, the central control server may communicate with the collaborative robot and receive the current operating state of the collaborative robot in real time.

According to one embodiment, the central control server may learn a deep neural network based on data received from the collaborative robot and data input through the communication unit, and then transmit the updated deep neural network structure data to the collaborative robot. there is.

According to one embodiment, the collaborative robot may have an artificial intelligence deep neural network structure updated by the updated deep neural network structure data of the central control server.

According to one embodiment, the collaborative robot includes: a first support that is formed in the shape of a cylinder and is located at the bottom, and is installed so that the position is fixed; a second support formed in the shape of 'ㅗ' and fixed to a side of the first support, the driving of which is controlled by the first support; a third support located at the top of the second support, formed in the shape of 'L', and the driving of which is controlled by the first support; a fourth support connected to an upper end of the third support, the driving of which is controlled by the first support; a cylindrical fifth support connected to the lower end of the fourth support; and a gripper located at the bottom of the fifth support and driven to grip a coffee making tool in the store.

According to one embodiment, the first support communicates with the central control server and matches the control signal transmitted from the central control server to the second support, the third support, the fourth support, and the fifth support. The grip part can be controlled.

According to one embodiment, the collaborative robot may further include a protection member surrounding the third support.

According to one embodiment, the protective member includes two end surfaces that contact each other to surround the third support, and a separate end surface that is formed to be separable; An insertion groove that has a predetermined width and is formed long in the longitudinal direction and has a plurality of rectangular grooves formed at regular intervals; a fitting frame that is formed to a width that can be forcefully fitted to the width of the fitting groove and is formed in an angled 'U' shape, and is fitted into the fitting groove; and a buffer portion fitted inside the center formed by the shape of the fitting frame.

According to one embodiment, the separate end face is provided with an attachable material on both end faces, and is positioned to surround the third support, and then the two end faces are in contact with each other and attached to enable the protective member to surround the third support. can do.

According to one embodiment, the buffer unit may be formed in a configuration capable of absorbing shock generated from the outside.

According to one embodiment, the fitting frame may be provided with a separate attachment material so that the buffer part can be fixed to the inside so that the buffer part can be positioned on the inside of the grooved frame.

According to one embodiment, the buffer unit includes: a first absorbing unit provided on one end, the upper and lower ends of which are rounded, and primarily absorbs shock generated from the outside; a second absorber provided on the other end of the first absorber and secondarily absorbing shocks generated from the outside, and having a plurality of air layers formed in the longitudinal direction to increase the efficiency of shock absorption; A connecting air part connecting the air generated when the first absorbing part is contracted in the direction of the other end surface in the process of primarily absorbing shock to escape through the air layer; and an elastic portion located inside the air layer and thirdly absorbing shock occurring from the outside.

According to one embodiment, the first absorber is made of a material capable of absorbing shock so that it can primarily absorb shock generated from the outside, and when a shock occurs from the outside, it is contracted and driven in the direction of the other end surface. It can primarily absorb shock.

According to one embodiment, the second absorber may be made of a material capable of absorbing shock so as to absorb the shock transmitted through the first absorber, and when the shock is transmitted through the first absorber, the second absorber may be made of a material capable of absorbing shock. Shock can be absorbed secondarily by shrinking in the direction of the cross section.

According to one embodiment, the width of the air layer may become narrow as the second absorber absorbs shock and shrinks in the direction of the other end surface.

According to one embodiment, the connecting air portion is formed to be empty inside, so that the air discharged by the first absorbing portion can flow into the air layer as the first absorbing portion is contracted to the other end surface.

According to one embodiment, the air layer may have the other end face open so that air flowing in through the connecting air portion is discharged.

An unmanned coffee production and sales system through advance reservation according to an embodiment of the present invention may include a production robot that produces coffee using a coffee machine.

An unmanned coffee manufacturing and sales system through advance reservation according to an embodiment of the present invention includes a manufacturing control server that communicates with the manufacturing robot; And it may further include a plurality of user terminals that communicate with the manufacturing control server and are registered as customers using the store.

According to one embodiment, the manufacturing control server includes a transceiver that communicates with the user terminal and receives a manufacturing menu and current location information where the user terminal is located from the user terminal; An arrival prediction unit that analyzes the minimum expected time for the user to arrive at the store based on the current location information received from the user terminal; a production command unit that transmits a beverage production command to the production robot based on the beverage production time of the production menu received from the user terminal; a manufacturing information unit that stores a beverage manufacturing recipe manufactured by the manufacturing robot within the store and an average manufacturing time according to the recipe; And after confirming that the manufactured beverage is located at the pickup stand located in the store, it may include a pickup confirmation unit that checks through the user terminal whether the beverage has been completely picked up from the pickup stand to the user.

According to one embodiment, the production command unit compares the result of analyzing the minimum expected time for the user to arrive in the store, analyzed by the arrival prediction unit, and the beverage production time of the production menu received from the user terminal, and determines the possible arrival time. A beverage production command can be sent to the manufacturing robot so that the beverage production is completed in accordance with the minimum expected time and placed on the pick-up table.

According to one embodiment, when receiving a beverage production command from the production command unit, the manufacturing robot completes beverage production according to the beverage production recipe stored in the production information section and then places the completed beverage on the pickup stand. It can be positioned.

According to one embodiment, the manufacturing robot includes: a first support that is formed in the shape of a cylinder and is located at the bottom, and is installed so that the position is fixed; a second support formed in the shape of 'ㅗ' and fixed to a side of the first support, the driving of which is controlled by the first support; a third support located at the top of the second support, formed in the shape of 'L', and the driving of which is controlled by the first support; a fourth support connected to an upper end of the third support, the driving of which is controlled by the first support; a cylindrical fifth support connected to the lower end of the fourth support; and a gripper located at the bottom of the fifth support and driven to grip a coffee making tool in the store.

According to one embodiment, the gripper holds the portafilter and then receives coffee bean powder from the grinder into the portafilter, inserts the portafilter containing the coffee bean powder into the coffee machine, and then grips the beverage cup to purify the water purifier. After receiving water through the coffee machine, the beverage cup can be placed in the coffee machine so that the coffee solution extracted from the coffee machine is accommodated in the beverage cup, and after extraction of the coffee solution is completed, the beverage cup can be placed on the pickup stand.

According to one embodiment, the manufacturing robot may further include a protection member surrounding the third support.

According to one embodiment, the protective member includes a separated end surface that is formed to be separable, meaning that both end surfaces are in contact with each other to surround the third support. An insertion groove that has a predetermined width and is formed long in the longitudinal direction and has a plurality of rectangular grooves formed at regular intervals; a fitting frame that is formed to a width that can be forcefully fitted to the width of the fitting groove and is formed in an angled 'U' shape, and is fitted into the fitting groove; and a buffer portion fitted inside the center formed by the shape of the fitting frame.

According to one aspect of the present invention described above, the collaborative robot total control system based on an artificial intelligence camera proposed by the present invention detects the presence of an object recognized as a human within the movement radius of a plurality of operating collaborative robots and Damage to the object and the collaborative robot can be minimized by stopping the operation.

In addition, the third support of the collaborative robot moves to the greatest extent during the process of making coffee, and may be subject to shock when struck by other members or people. To prevent this, a protective member is positioned to surround the outer surface to cause shock. Collaborative robots can be protected from shock.

In addition, the protective member is provided with a first absorption part, a second absorption part, and an elastic part that can absorb shock in stages, so it can absorb everything from small shocks to large shocks.

In addition, the air layer, which is a part of the protective member, has an open other end, so the air flowing in through the connecting air part or the air generated when the second absorber contracts is discharged through the open other end, thereby increasing the buffering role of the buffer. You can.

Additionally, the shock applied to the third support can be minimized by absorbing residual shock or vibration that has not yet been absorbed by the first and second absorbers by the elastic portion.

Additionally, this can minimize the impact on the collaborative robot.

The effects of the present invention are not limited to the effects mentioned above, and various effects may be included within the range apparent to those skilled in the art from the details described below.

1 to 5 are diagrams showing the configuration of a collaborative robot total control system based on an artificial intelligence camera according to an embodiment of the present invention.

6 to 11 are diagrams showing the configuration of a collaborative robot, which is a part of a collaborative robot total control system based on an artificial intelligence camera according to another embodiment of the present invention.

The detailed description of the present invention described below refers to the accompanying drawings, which show by way of example specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the invention are different from one another but are not necessarily mutually exclusive. For example, specific shapes, structures and characteristics described herein may be implemented in one embodiment without departing from the spirit and scope of the invention.

When a component is said to be “connected” or “coupled” to another component, it is understood that it may be directly connected to or fastened to that other component, but that other components may exist in between. It should be. On the other hand, when it is mentioned that a component is "directly connected" or "directly fastened" to another component, it should be understood that there are no other components in the middle.

Additionally, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the detailed description that follows is not intended to be taken in a limiting sense, and the scope of the invention is limited only by the appended claims, together with all equivalents to what those claims assert, if properly described. Similar reference numbers in the drawings refer to identical or similar functions across various aspects.

Below, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

Referring to FIGS. 1 to 5, the collaborative robot total control system 1000 based on an artificial intelligence camera according to an embodiment of the present invention communicates with the collaborative robot 300 and the collaborative robot 300 to control the collaborative robot 300. A central control server 100 that controls the central control server 100, an artificial intelligence camera 500 that communicates with the central control server 100 and takes pictures of the store where the collaborative robot 300 is located, and objects input to the artificial intelligence camera 500. A database unit 700 that receives and stores the method by which the central control server 100 controls the collaborative robot 300 according to location or movement, and centrally collects data related to space, objects, and use from the store manager or the collaborative robot 300. It may include a communication unit 900 that transmits data to the control server.

The collaborative robot 300 can perform in-store tasks including making or serving beverages.

If an object recognized as a person through the artificial intelligence camera 500 exists within the operating range of multiple collaborative robots, the central control server 100 determines that there is a possibility of collision with the collaborative robot 300 and collides with the object. The operation of a nearby collaborative robot 300 can be stopped.

The central control server 100 may call a store manager to manually control a collaborative robot that has stopped operating.

Data related to space, objects, and use may refer to a store drawing possessed by a store manager, or data related to the recognition of space and objects (people, animals, and other moving objects) recognized by the artificial intelligence camera 500.

The collaborative robot 300 may include an artificial neural network in the form of software or hardware learned to recognize at least one of the properties of space and properties of objects, including obstacles.

The central control server 100 may include an artificial neural network in the form of software or hardware trained to recognize at least one of the properties of space and properties of objects, including obstacles.

The collaborative robot 300 may include a deep neural network including CNN or DBN learned through deep learning.

The central control server 100 may include a deep neural network including CNN or DBN learned through deep learning.

The central control server 100 can communicate with the collaborative robot 300 to receive the current operating status of the collaborative robot in real time.

The central control server 100 learns a deep neural network based on the data received from the collaborative robot 300 and data input through the communication unit 900, and then transmits the updated deep neural network structure data to the collaborative robot 300. You can.

The collaborative robot 300 may have its artificial intelligence deep neural network structure updated by the updated deep neural network structure data of the central control server 100.

The collaborative robot 300 is formed in the shape of a cylinder and located at the bottom, and has a first support 310 installed to fix the position, and is formed in the shape of a 'ㅗ' and is fixed to the side of the first support 310, A second support 330, the driving of which is controlled by the first support 310, is located at the top of the second support 330 and is formed in the shape of 'ㄴ', and the driving of which is controlled by the first support 310. A third support 350, connected to the upper end of the third support 350, and a fourth support 370, the driving of which is controlled by the first support 310, connected to the lower end of the fourth support 370 It may include a cylindrical fifth support 380 and a gripper 390 located at the bottom of the fifth support 380 and driven to grip a coffee making tool in the store.

The first support 310 communicates with the central control server 100 and includes a second support 330, a third support 350, a fourth support 370, and the like in accordance with the control signal transmitted from the central control server 100. The fifth support 380 and the gripper 390 can be controlled.

When receiving a beverage production command from the central control server 100, the collaborative robot 300 grips the portafilter (G) through the gripper 390 and then grinds the coffee bean powder from the grinder 200 into the portafilter ( G), insert the portafilter (G) containing the coffee bean powder into the coffee machine (600), hold the beverage cup (A), receive water through the water purifier (400), and extract it from the coffee machine (600). The beverage cup (A) can be placed in the coffee machine (800) so that the coffee concentrate can be accommodated in the beverage cup (A), and the beverage cup (A) can be placed on the pickup stand (800) after extraction of the coffee concentrate is completed.

The coffee production process using a collaborative robot total control system based on an artificial intelligence camera according to an embodiment of the present invention can be divided into 'on-site kiosk ordering' and 'APP ordering'.

For on-site kiosk ordering, select a specific menu (Iced Americano - add syrup) at the kiosk, pay, operate the robot (: grab the cup and place it in front of the label machine - attach a label for beverage information and move to the ice machine - move to the coffee machine - machine Click the button - Receive the coffee extracted through the machine and move to the syrup device - Add the syrup and install the lid - Move to the storage deck (pickup stand) - Send a message containing a QR code to the customer), Storage deck (pickup stand) ) can be done in the order of recognizing the customer's QR through the QR code reader provided in the machine and picking up the coffee.

In the case of APP ordering, it is the same as on-site kiosk ordering, but can be configured to allow delivery selection.

As described above, the use of an artificial intelligence camera, which is a part of the collaborative robot total control system based on an artificial intelligence camera according to an embodiment of the present invention, is mainly used when a person or other object approaches within a safe distance of the robot, and the camera recognizes the object. After measuring the distance, control the primary warning sound and the secondary robot to stop and transmit the information to the manager.

When applied to production lines or the restaurant industry in the future, it can be used as a more intelligent technology that not only improves safety but also improves functionality and efficiency through fine-tuning the robot by measuring the distance between the robot and the object.

Meanwhile, a plurality of collaborative robots (300, 301) and the central control server (100) communicate wirelessly using wireless communication technologies such as IEEE 802.11 WLAN, IEEE 802.15 WPAN, UWB, Wi-Fi, Zigbee, Z-wave, Blue-Tooth, etc. It can be implemented as follows. The collaborative robot 300 may vary depending on the communication method of other devices or the central control server 100 with which it wishes to communicate.

In particular, a plurality of

collaborative robots

300 and 301 can implement wireless communication with other collaborative robots 300 and/or the central control server 100 through a 5G network. When the collaborative robot 300 communicates wirelessly through a 5G network, real-time response and real-time control are possible.

In addition, the plurality of

collaborative robots

300 and 301 and the central control server 100 can communicate using the Message Queuing Telemetry Transport (MQTT) method and the HyperText Transfer Protocol (HTTP) method.

In addition, the plurality of

collaborative robots

300 and 301 and the central control server 100 can communicate with a PC, mobile terminal, and other external servers through HTTP or MQTT.

In some cases, the plurality of collaborative robots (300, 301) and the central control server (100) support two or more communication standards and can use the optimal communication standard depending on the type of communication data and the type of device participating in communication. there is.

The store manager can check or control information about the collaborative robots 300 in the robot system through a manager terminal such as a PC or mobile terminal.

The central control server 100 is implemented as a cloud server, and the user can use the data stored in the central control server 100 to which the user terminal 3 is communicated and the functions and services provided by the central control server 100. You can. The cloud central control server 100 is linked to the collaborative robot 300 to monitor and control the collaborative robot 300 and provide various solutions and content remotely.

The central control server 100 can store and manage information received from collaborative robots 300 and other devices. The central control server 100 may be a server provided by the manufacturer of the collaborative robots 300 or a company entrusted with the service by the manufacturer. The central control server 100 may be a control server that manages and controls the collaborative robots 300.

The central control server 100 can control the collaborative robots 300 collectively or for each individual robot. Additionally, the central control server 100 can set at least some robots among the collaborative robots 300 into groups and then control them for each group.

Meanwhile, the central control server 100 may be configured with information and functions distributed across a plurality of servers, or may be configured as one integrated server.

The store manager can transmit data related to space, objects, and usage to the central control server 100.

Here, the data is space, and the object-related data is data related to the recognition of space and objects recognized by the collaborative robot 300, or the space acquired by the artificial intelligence camera 500 ( It may be image data about space and objects.

Using image data about space and objects acquired by the artificial intelligence camera 500, the distance between an object and a robot can be measured, allowing the robot's position to be finely adjusted.

Here, an object may mean a person, an animal, or other moving object, and as will be described later, the collaborative robot 300 and the central control server 100 use a CNN (Convolutional Neural Network), RNN ( Since it can include deep neural networks (DNN) such as Recurrent Neural Network (DBN) and DBN (Deep Belief Network), it has the advantage of being able to learn and apply various situations that can recognize even the sudden appearance of objects.

Depending on the embodiment, the collaborative robot 300 and the central control server 100 use artificial neural networks (Artificial Neural Networks in the form of software or hardware) learned to recognize at least one of the properties of objects such as users, voices, spatial properties, and obstacles. : ANN) may be included.

According to one embodiment of the present invention, the collaborative robot 300 and the central control server 100 use a Convolutional Neural Network (CNN), a Recurrent Neural Network (RNN), and a Deep Belief Network (DBN) learned through deep learning. ), etc. may include a deep neural network (DNN). For example, the first support 310 of the collaborative robot 300 may be equipped with a deep neural network (DNN) structure, such as a convolutional neural network (CNN).

The central control server 100 learns a deep neural network (DNN) based on data received from the collaborative robot 300, data input by the user, etc., and then sends the updated deep neural network (DNN) structure data to the collaborative robot ( 300). Accordingly, the deep neural network (DNN) structure of artificial intelligence provided by the collaborative robot 300 can be updated.

In addition, usage-related data is data acquired according to the use of the collaborative robot 300, and may include usage history data, detection signals obtained from the artificial intelligence camera 500, etc.

The learned deep neural network structure (DNN) can receive input data for recognition, recognize the attributes of people, objects, and spaces included in the input data, and output the results.

In addition, the learned deep neural network structure (DNN) receives input data for recognition, analyzes and learns data related to the usage of the collaborative robot 300, and can recognize usage patterns, usage environments, etc. there is.

Meanwhile, data related to space, objects, and usage may be transmitted to the central control server 100 through the communication unit 900.

The central control server 100 can learn a deep neural network (DNN) based on the received data and then transmit the updated deep neural network (DNN) structure data to the artificial intelligence

collaborative robots

300 and 301 to update them. there is.

One or more robots 100 can be provided to provide services in a designated location such as a home. For example, the robot system may include a robot that interacts with a user at home or the like and provides various entertainment to the user.

Artificial intelligence

collaborative robots

300 and 301 can perform assigned tasks while traveling in a specific space. The artificial intelligence

collaborative robots

300 and 301 can perform autonomous driving by creating a path to a predetermined destination and tracking driving by following a person or another robot.

In order to prevent safety accidents, the artificial intelligence

collaborative robots

300 and 301 can drive while detecting and avoiding obstacles while moving based on image data and sensing data acquired through the artificial intelligence camera 500.

Meanwhile, the central control server 100 may further include a motion detection sensor that detects the motion of the collaborative robot 300 and outputs motion information. For example, a gyro sensor, a wheel sensor, an acceleration sensor, etc. can be used as a motion detection sensor.

Additionally, the collaborative robot 300 may include an obstacle detection sensor that detects an obstacle, and the obstacle detection sensor may include an infrared sensor, an ultrasonic sensor, an RF sensor, a geomagnetic sensor, a Position Sensitive Device (PSD) sensor, and an obstacle detection sensor within the driving area. It may include a cliff detection sensor that detects the presence of a cliff on the floor, light detection and ranging (Lidar), etc.

The terminal carried by the store user to transmit data related to space, objects, and use transmitted through the communication unit 900 is a general term for devices equipped with computational processing capabilities by each having a memory and a processor. For example, there are personal computers, handheld computers, personal digital assistants (PDAs), mobile phones, smart devices, tablets, etc.

The server has a memory in which a plurality of modules are stored, a processor that is connected to the memory, responds to the plurality of modules, and processes service information provided to the terminal or action information that controls the service information. It may include a new means and a UI (user interface) display means.

Memory is a device that stores information, including USB (Universal Serial Bus), high-speed random access memory, magnetic disk storage, flash memory devices, and other non-volatile solid state memory devices. It may include various types of memory, such as non-volatile memory such as -state memory device).

The communication means transmits and receives service information or action information with the terminal in real time.

The UI display means outputs service information or action information of the device in real time. The UI display means may be an independent device that directly or indirectly outputs or displays the UI, or may be a part of the device.

A program for executing a method according to an embodiment of the present invention may be recorded on a computer-readable recording medium.

Computer-readable media may include program instructions, data files, data structures, etc., singly or in combination. The media may be specially designed and constructed or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROM, RAM, flash memory, etc. It includes specially configured hardware devices to store and execute the same program instructions. Here, the medium may be a transmission medium such as an optical or metal line or waveguide containing a carrier wave that transmits signals specifying program commands, data structures, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

Although one preferred embodiment of the present invention has been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements can be made by those skilled in the art using the basic concept of the present invention defined in the following claims. It falls within the scope of rights of the present invention.

Referring to FIGS. 6 to 8 , the collaborative robot 300 according to another embodiment of the present invention may further include a protection member 360 surrounding the third support 350.

More specifically, the protective member may include a separation section 362, a fitting groove 364, a fitting frame 366, and a buffer portion 368.

The separation cross-section 362 refers to both cross-sections that come into contact to surround the third support 350, and can be formed so that the protection member 360 can be separated from the third support 350.

That is, the separating end face 362 is provided with an attachable material on both end faces, so that it is positioned to surround the third support 350, and then both end faces are in contact with each other and attached to enable the protective member to surround the third support 350. can be formed.

The fitting groove 364 has a predetermined width and is formed long in the longitudinal direction, and may have a plurality of square grooves formed at regular intervals.

The fitting frame 366 is formed to a width that can be forcefully fitted into the width of the fitting groove 364, and is formed in an angled 'U' shape, and can be fitted into the fitting groove 364.

In addition, the fitting frame 366 may be provided with a separate attachment material so that the buffer part 368 can be positioned on the inside of the grooved frame 366 so that the buffer part 368 can be fixed to the inside.

The buffer portion 368 may be formed to fit inside the center formed by the shape of the fitting frame 366.

Additionally, the buffer portion 368 may be formed in a configuration capable of absorbing shocks generated from the outside.

The buffer portion 368 may include a first absorbent portion 3687, a second absorbent portion 3681, a connecting air portion 3685, and an elastic portion 367.

The first absorbing part 3687 is provided on one end, and the upper and lower ends of one end are formed in a round shape, and can primarily absorb shock generated from the outside.

In addition, the first absorber 3687 may be made of a material capable of absorbing shock so that it can primarily absorb shock generated from the outside, and when a shock occurs from the outside, it is contracted and driven in the direction of the other end surface. It can primarily absorb shock.

Here, the first absorber 3687 may be formed of a sponge material that can primarily absorb shocks generated from the outside, but is not limited to this and can primarily absorb shocks generated from the outside. Any material that exists can be included regardless of its name.

The second absorber 3681 is provided on the other end surface of the first absorber 3687 and secondarily absorbs shocks generated from the outside, and has a plurality of air layers 3683 in the longitudinal direction to increase the efficiency of shock absorption. may be formed.

In addition, the second absorber 3681 may be made of a material capable of absorbing shock so as to absorb the shock transmitted through the first absorber 3687, and the second absorber 3687 may absorb the shock transmitted through the first absorber 3687. When transmitted, shock can be absorbed secondarily by contracting and driving in the direction of the other end surface.

Here, the second absorber 3681 may be formed of a sponge material that can primarily absorb shocks generated from the outside, but is not limited to this and can primarily absorb shocks generated from the outside. Any material that exists can be included regardless of its name.

The width of the air layer 3683 may become narrow as the second absorber 3681 absorbs shock and shrinks in the direction of the other end surface.

Additionally, the air layer 3683 may have its other end open so that air flowing in through the connection air portion 3685 is discharged.

That is, the other end of the air layer 3683 is open, so the air flowing in through the connecting air part 3685 or the air generated when the second absorption part 3681 is contracted can be discharged through the open other end, forming a buffer. The buffering role of (368) can be increased.

The connecting air portion 3685 may be connected so that air generated when the first absorbing portion 3687 is contracted in the direction of the other end surface in the process of primarily absorbing shock escapes through the air layer 3683.

In addition, the connecting air portion 3685 is formed to be empty inside, so that as the first absorbing portion 3687 is contracted to the other end surface, the air discharged by the first absorbing portion 3687 will flow into the air layer 3683. You can.

The elastic portion 367 is located inside the air layer 3683 and can thirdly absorb shock occurring from the outside.

9 to 11, the elastic part according to another embodiment of the present invention includes a fixing part 3671, a spring part 3677, a contraction limiting part 3672, a fixed end part 3676, and a fitting fixing part ( 3671) and a protrusion 3675.

The fixing part 3671 has a spiral groove 36711 formed on the outside and is formed in the shape of a circular plate with a predetermined thickness, with grooves of different diameters formed on one side and the other side, and positioned at the other end to be inserted. It may be fixed to one inner surface of the frame 366.

The fixing part 3671 can be rotationally fastened to the inside of the fixing end 3676, which will be described later, by a spiral groove 36711 formed on the outside.

The spring part 3677 is fixed by fitting into a groove formed on one side of the fixing part, and can be driven to contract or relax by shock or vibration generated from the outside.

The other end of the spring part 3677 is inserted into one end of the fixing part, and one end is inserted into one side of the fitting fixing part described later and can be driven to contract or relax.

Here, the spring portion 3677 may be formed in the shape of a coil spring that can be contracted or released, and the other end may be formed with a diameter that can be fixed to the groove 3678 formed on one side of the fixing portion 3671. The diameter may be formed to be a diameter that can be fixed to the groove formed at the other end of the fitting portion 3671.

The contraction limiting unit 3672 may limit the contracting length of the spring unit 3677.

The distance over which the spring part 3677 can be contracted may be limited as the distance it moves in the other end direction is limited by being caught by the protruding part 3675 and the fitting part 3671 by the contraction limiting part 3672 described above.

That is, one end of the spring part 3677 is fixed to the other end of the fitting part 3671, which will be described later, and the fitting part 3671 moves in the direction of the other end by an impact generated from the outside to contract and drive, but the fitting part (3677) 3671 may be caught by the contraction limiting part 3672, thereby limiting the length at which the spring part 3677 is driven to contract.

Meanwhile, the shrinkage limiting portion 3672 may be formed in the shape of a circular band with a diameter that can be positioned at one end of the fixing portion 3671.

The fixed end portion 3676 has a spiral protrusion 36741 formed on its inner surface to correspond to the spiral groove 36711 formed on the outer surface of the fixed portion 3671, and surrounds the outer surface of the fixed portion 3671. It may be located at one end of the fixture.

The fixed end portion 3676 may be formed in the shape of a circular band having a diameter that allows the fixed portion 3671 to be positioned on the inner surface.

In addition, the fixed end portion 3676 is provided with a cover shape at one end that covers certain portions of both sides, thereby preventing the protrusion 3675, which will be described later, from being released to the outside.

The fixing part 3671, the fitting part 3671, and the protrusion 3675 are located on the empty inside of the fixed end part 3676, but an empty space is formed between the fixing part 3671 and the fitting part 3671. The protruding part 3675 and the fitting part 3671 may move in the other end direction due to shock or vibration generated when the first absorbing part 3687 is contracted and driven in the other end direction.

The fitting fixing part 3671 may be fitted and fixed inside the fixing end part 3676.

The fitting fixing part 3671 may have a groove formed at the other end having a diameter equal to or larger than the diameter of one end of the spring part 3677 so that the spring part 3677 is inserted into it.

The fitting fixing part 3671 is provided with a cover shape at one end that covers a certain portion of both sides, so that the protrusion 3675 can be located at one end.

The protrusion 3675 is located at one end of the fitting and fixing part 3671, but is located on the empty inside of the fixing end 3676, and is formed in a round shape in one direction, and one end of the round shape is one end of the fixing end 3676. It may protrude in one direction.

The protrusion 3675 has first screw grooves 36755 formed at both ends, and a screw 36753 penetrating the first screw groove 36755 is formed on the inside of the fitting portion 3671 to form a second screw groove 36763. ) It can be rotated through and fixed to one end of the fitting part (3671).

The above-mentioned elastic part 367 absorbs the remaining shock or vibration that has not yet been absorbed by the first absorbing part 3687 and the second absorbing part 3681 to minimize the shock applied to the third support 350. You can.

In addition, through this, the impact applied to the collaborative robot 300 can be minimized.

The above-described embodiments are for illustrative purposes, and those skilled in the art will recognize that the above-described embodiments can be easily modified into other specific forms without changing the technical idea or essential features of the above-described embodiments. You will understand. Therefore, the above-described embodiments should be understood in all respects as illustrative and not restrictive. For example, each component described as unitary may be implemented in a distributed manner, and similarly, components described as distributed may also be implemented in a combined form.

The scope sought to be protected through this specification is indicated by the patent claims described later rather than the detailed description, and should be interpreted to include the meaning and scope of the claims and all changes or modified forms derived from the equivalent concept.

Claims

A collaborative robot total control system based on an artificial intelligence camera, including a collaborative robot that makes coffee using a coffee machine.
According to claim 1,

A central control server that communicates with the collaborative robot and controls the collaborative robot;

An artificial intelligence camera that communicates with the central control server and takes pictures of the store where the collaborative robot is located;

a database unit that receives and stores a method of controlling the collaborative robot by the central control server according to the position or movement of an object input to the artificial intelligence camera; and

It further includes a communication unit that transmits space, objects, and usage-related data from the store manager or the collaborative robot to the central control server,

The collaborative robot is,

Perform in-store tasks including preparing or serving beverages;

The central control server is,

If an object recognized as a person through the artificial intelligence camera exists within the operating range of multiple collaborative robots, it is determined that there is a possibility of collision with the collaborative robot and the operation of the collaborative robot close to the object is stopped,

The central control server is,

Calling the store manager to manually control the collaborative robot that has stopped running,

The space, objects, and use-related data are,

It refers to a store drawing held by the store manager or data related to the recognition of spaces and objects recognized by the artificial intelligence camera,

The collaborative robot is,

It includes an artificial neural network in the form of software or hardware learned to recognize at least one of the properties of space and properties of objects, including obstacles,

The central control server is,

It includes an artificial neural network in the form of software or hardware learned to recognize at least one of the properties of space and properties of objects, including obstacles,

The collaborative robot is,

Contains deep neural networks, including CNN or DBN trained with deep learning,

The central control server is,

Contains deep neural networks, including CNN or DBN trained with deep learning,

The central control server is,

Communicate with the collaborative robot to receive the current operating status of the collaborative robot in real time,

The central control server is,

After training a deep neural network based on data received from the collaborative robot and data input through the communication unit, the updated deep neural network structure data is transmitted to the collaborative robot,

The collaborative robot is,

The deep neural network structure of artificial intelligence provided by the updated deep neural network structure data of the central control server is updated,

The collaborative robot is,

A first support formed in the shape of a cylinder and located at the bottom, installed so that the position is fixed;

a second support formed in the shape of 'ㅗ' and fixed to a side of the first support, the driving of which is controlled by the first support;

a third support located at the top of the second support, formed in the shape of 'L', and the driving of which is controlled by the first support;

a fourth support connected to an upper end of the third support, the driving of which is controlled by the first support;

a cylindrical fifth support connected to the lower end of the fourth support; and

It includes a gripping part located at the bottom of the fifth support and driven to grip a coffee making tool in the store,

The first support is,

Based on an artificial intelligence camera that communicates with the central control server and controls the second support, the third support, the fourth support, the fifth support, and the grip unit in accordance with the control signal transmitted from the central control server. Collaborative robot total control system.
According to claim 2,

The collaborative robot is,

It further includes a protective member surrounding the third support,

The protective member is,

a separate end surface that refers to both end surfaces in contact with each other to surround the third support and is formed to be separable;

An insertion groove that has a predetermined width and is formed long in the longitudinal direction and has a plurality of rectangular grooves formed at regular intervals;

a fitting frame that is formed to a width that can be forcefully fitted to the width of the fitting groove and is formed in an angled 'U' shape, and is fitted into the fitting groove; and

It includes a buffer portion fitted inside the center formed by the shape of the fitting frame,

The separation cross section is,

An attachable material is provided on both end surfaces, positioned to surround the third support, and then both end surfaces are attached in contact with each other to enable the protective member to surround the third support,

The buffer part,

It is formed in a structure that can absorb shocks occurring from the outside,

The fitting frame is,

An attachment material is separately provided so that the buffer part can be fixed to the inside so that the buffer part can be positioned on the inner side of the groove,

The buffer part,

a first absorbing portion provided on one end, the upper and lower ends of which are rounded, and primarily absorbing shocks generated from the outside;

a second absorber provided on the other end surface of the first absorber and secondarily absorbing shocks generated from the outside, and having a plurality of air layers formed in the longitudinal direction to increase the efficiency of shock absorption;

A connecting air part connecting the air generated when the first absorbing part is contracted in the direction of the other end surface in the process of primarily absorbing shock to escape through the air layer; and

It includes an elastic part located inside the air layer and thirdly absorbing shock occurring from the outside,

The first absorption unit,

It is made of a material capable of absorbing shocks so that it can primarily absorb shocks occurring from the outside.

When a shock occurs from the outside, it primarily absorbs the shock by contracting and driving in the direction of the other end surface.

The second absorbing part,

It is made of a material capable of absorbing shock so as to absorb the shock transmitted through the first absorber,

When a shock is transmitted through the first absorber, it is contracted and driven in the direction of the other end surface to secondarily absorb the shock,

The air layer is,

As the second absorber absorbs shock and shrinks in the direction of the other end surface, the width becomes narrower,

The connecting air part,

The interior is formed to be empty, and as the first absorber is contracted to the other end surface, the air discharged by the first absorber flows into the air layer,

The air layer is,

A collaborative robot total control system based on an artificial intelligence camera, where the other end is open so that the air flowing in through the connecting air portion is discharged.