KR20130064270A - Hri integrated framework apparatus and method for providing hri service using the same - Google Patents
Hri integrated framework apparatus and method for providing hri service using the same Download PDFInfo
- Publication number
- KR20130064270A KR20130064270A KR1020110130803A KR20110130803A KR20130064270A KR 20130064270 A KR20130064270 A KR 20130064270A KR 1020110130803 A KR1020110130803 A KR 1020110130803A KR 20110130803 A KR20110130803 A KR 20110130803A KR 20130064270 A KR20130064270 A KR 20130064270A
- Authority
- KR
- South Korea
- Prior art keywords
- user
- service
- unit
- information
- robot interaction
- Prior art date
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
- B25J9/161—Hardware, e.g. neural networks, fuzzy logic, interfaces, processor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Automation & Control Theory (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Manipulator (AREA)
Abstract
Description
The present invention relates to a human robot interaction integrated framework device and a method for providing a human robot interaction service using the same. More specifically, the human robot interaction integrated framework device which enables various types of human robot interaction services by providing continuous user information on who, where, what is done by fusing information from various sensors and the same The present invention relates to a method for providing human robot interaction service.
Human-Robot Interaction (also referred to as "HRI") technology is a technology that enables robots to interact and interact naturally with humans, just as humans interact with each other.
Intelligent service robots need to be able to interact with humans in the same way as humans in order to provide necessary services while living with humans in everyday environments. Therefore, HRI technology that deals with human-robot interaction problem is the first technology to be solved in the practical use of intelligent service robot, and it is a technology that is the key to the success of robot industrialization.
HRI technology is the core technology of intelligent robots that design and implement robotic systems and interaction environments to enable human and robots to interact cognitively and emotionally through various communication channels. There are differences from human-computer interaction (HCI), such as the variety of interactions or control levels.
Since R & D mainly focuses on improving the performance of element technology in the field of HRI technology, it does not lead to improvement of HRI function in robots that require optimized coupling between element technologies.
Interaction between the robot and the user takes place continuously, but recognition by conventional individual user recognition components is only one time. Therefore, a service application that wants to provide a service using these components cannot use useful information as much as possible, and the recognition performance provided is not satisfactory. In addition, for certain applications, it is necessary to improve performance by introducing an approach other than video and audio, which is highly dependent on the environment.
An object of the present invention is to integrate human robot interaction framework apparatus that enables various types of human robot interaction service by providing continuous user information on who, where and what by fusing information from various sensors And it provides a method for providing a human robot interaction service using the same.
Human robot interaction integrated framework device according to an embodiment of the present invention for solving the above problems is
A tracking unit which detects the user's information using specific sensors and tracks the user's state based on the detected user's information; ID recognition unit for recognizing the user ID based on the detected user information; A behavior recognition unit recognizing a gesture of the user based on the detected user information; A multi integration unit for integrating the user's state, the user's ID, and the user's gesture, and obtaining information on the human robot interaction service based on the integrated result; And an interworking unit for receiving a request for a human robot interaction service from a service application and providing a user with the user through the service application.
According to an embodiment of the present invention, the human robot interaction integrated framework device and the method for providing a human robot interaction service using the same are continuously and permanently monitored for the conventional single and volatilized recognition result as well as the integration of individual recognition components. Monitoring can provide recognition results that are satisfactory to real users.
In addition, the present invention may not only perform a user's command, but may also provide a foundation for providing an optimal service by determining a situation by a robot by itself.
1 is a block diagram schematically illustrating an environment for providing a human robot interaction service using a human robot interaction integrated framework device according to an embodiment of the present invention.
2 is a block diagram showing a human robot interaction integrated framework device according to an embodiment of the present invention.
3 is a flowchart illustrating a method for providing a human robot interaction service according to an embodiment of the present invention.
The present invention will now be described in detail with reference to the accompanying drawings. Hereinafter, a repeated description, a known function that may obscure the gist of the present invention, and a detailed description of the configuration will be omitted. Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art. Accordingly, the shapes and sizes of the elements in the drawings and the like can be exaggerated for clarity.
First, in the related art, a service application that intends to provide a human robot interaction service directly drives a user recognition engine at a specific time point, receives image and voice data from a robot, and analyzes it, and uses the analyzed result to interact with the human robot. Provided action services. At this time, the service application developer had to work hard to perform a task for the user recognition engine to maintain optimal performance. In addition, by running the user recognition engine along with the service application, it was inevitable to use the computing resources.
However, the human robot interaction integrated framework device according to an embodiment of the present invention can register information about a specific user by only registering the corresponding event, without the burden of having to directly recognize a user. Can be provided.
While the user application has no choice but to run the recognition engine at a specific point in time to provide the human robot interaction service, the human robot interaction integrated framework device according to the embodiment of the present invention is independent of the application's requirements. It is advantageous to provide user information with high reliability by performing recognition in advance when it is advantageous for recognition. In addition, it is possible to provide high recognition performance by fusion of a plurality of recognizers and recognition results.
Hereinafter, a human robot interaction integrated framework device and a method for providing a human robot interaction service using the same according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.
1 is a block diagram schematically illustrating an environment for providing a human robot interaction service using a human robot interaction integrated framework device according to an embodiment of the present invention.
Referring to FIG. 1, an environment for providing a human robot interaction service according to an embodiment of the present invention includes a human robot interaction integrated
The human robot interaction integrated
In addition, the human robot interaction integrated
The
For example, the
In addition, the
Next, the human robot interaction integrated
2 is a block diagram showing a human robot interaction integrated framework device according to an embodiment of the present invention.
First, the human robot interaction integrated
Referring to FIG. 2, the human robot interaction integrated
The
The
The
The
The database 145 stores the human robot interaction service information obtained from the
The
As such, the human
Next, a method of providing a human robot interaction service using a human robot interaction integrated framework device will be described in detail with reference to FIG. 3.
3 is a flowchart illustrating a method for providing a human robot interaction service according to an embodiment of the present invention.
First, in order for the
(1) Event: The
(2) Query: The
(3) request: The
Referring to FIG. 3, the human robot
The
The human robot interaction integrated
When the event registered in step S320 occurs, the human robot
After receiving the callback function, the
The human robot interaction integrated
As such, the human robot interaction integrated framework device and the method for providing a human robot interaction service using the same according to an exemplary embodiment of the present invention fuse a user's information about who, where and what by fusing information obtained from various sensors. Information can be provided to provide various types of human robot interaction services.
As described above, the best embodiment has been disclosed in the drawings and the specification. Although specific terms have been employed herein, they are used for purposes of illustration only and are not intended to limit the scope of the invention as defined in the claims or the claims. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.
10;
100; Human Robot Interaction Integrated Framework Device
210;
110;
130; A
145;
Claims (1)
ID recognition unit for recognizing the user ID based on the detected user information;
A behavior recognition unit recognizing a gesture of the user based on the detected user information;
A multi integration unit for integrating the user's state, the user's ID, and the user's gesture, and obtaining information on the human robot interaction service based on the integrated result; And
Interworking unit for receiving a request for a human robot interaction service from a service application, and providing a user with a human robot interaction service corresponding to the request through the service application
Human robot interaction framework device comprising a.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020110130803A KR20130064270A (en) | 2011-12-08 | 2011-12-08 | Hri integrated framework apparatus and method for providing hri service using the same |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020110130803A KR20130064270A (en) | 2011-12-08 | 2011-12-08 | Hri integrated framework apparatus and method for providing hri service using the same |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20130064270A true KR20130064270A (en) | 2013-06-18 |
Family
ID=48861270
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020110130803A KR20130064270A (en) | 2011-12-08 | 2011-12-08 | Hri integrated framework apparatus and method for providing hri service using the same |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20130064270A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20190076380A (en) * | 2017-12-22 | 2019-07-02 | 한국전자통신연구원 | Apparatus and method for detecting action based on multi-modal |
KR20210071851A (en) * | 2019-12-06 | 2021-06-16 | 주식회사 원더풀플랫폼 | Helper system using helper robot |
-
2011
- 2011-12-08 KR KR1020110130803A patent/KR20130064270A/en not_active Application Discontinuation
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20190076380A (en) * | 2017-12-22 | 2019-07-02 | 한국전자통신연구원 | Apparatus and method for detecting action based on multi-modal |
KR20210071851A (en) * | 2019-12-06 | 2021-06-16 | 주식회사 원더풀플랫폼 | Helper system using helper robot |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9900685B2 (en) | Creating an audio envelope based on angular information | |
TWI734406B (en) | Method for organizing a network of nodes | |
US10528816B2 (en) | System and method for retrieving and displaying supplemental information and pertinent data using augmented reality | |
CN103226436A (en) | Man-machine interaction method and system of intelligent terminal | |
CN107170446A (en) | Semantic processing server and method for semantic processing | |
CN103514075B (en) | The method and apparatus that monitoring api function is called in the terminal | |
US20150103776A1 (en) | Event driven anonymous device identifier generation | |
US20170305009A1 (en) | Control system and control method | |
US11514600B2 (en) | Information processing device and information processing method | |
CN105843503B (en) | Using open method, device and terminal device | |
WO2015128954A1 (en) | Device information providing system, and device information providing method | |
CN110825594B (en) | Data reporting and issuing method, client and server | |
WO2019228236A1 (en) | Method and apparatus for human-computer interaction in display device, and computer device and storage medium | |
US20240022633A1 (en) | Method and system for providing web content in virtual reality environment | |
CN107195301A (en) | Intelligent robot semantic processing method and device | |
US20160379071A1 (en) | User Identification Method and Electronic Device | |
CN110784523B (en) | Target object information pushing method and device | |
WO2012111252A1 (en) | Information processing device | |
KR20130064270A (en) | Hri integrated framework apparatus and method for providing hri service using the same | |
US20140218516A1 (en) | Method and apparatus for recognizing human information | |
US8625468B2 (en) | Systems and methods for granting feature control based on user location | |
CN106533798A (en) | Detection method and device | |
KR102302029B1 (en) | System for recogniting multiple input based on artificial intelligent | |
KR20110096372A (en) | Method for providing user interface of terminal with projecting function | |
CN105159181A (en) | Control method and device for intelligent equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WITN | Withdrawal due to no request for examination |