KR102313875B1 - robot with a trasparent LCD dispaly and control method thereof - Google Patents

Abstract

The present invention is technology related to a display mainly applied to a delivery robot and a guide robot which are recently developed. The present invention relates to the technology configuring a display device by connecting a transparent LCD and a transparent OLED to one side surface of an upper portion of the robot by using a rotational shaft, which allows a character to be floated in a transparent space to attract attention of people, is structurally and economically beneficial as compared to the technology of applying a display device to an entire of one side surface of the existing robot, and emphasizes guidance or advertisement and promotion of the robot.

Description

A robot with a transparent LCD display and its control method {robot with a trasparent LCD dispaly and control method thereof}

The present invention relates to a delivery robot or a guide robot to which a transparent LCD display and a character are applied.

[Document 1] Korean Patent Application Laid-Open No. 10-2019-0095189 Robot system and its control method

[Document 2] Korean Patent Laid-Open Patent Publication No. 10-2011-0016165 Intelligent display device capable of promoting and method for promoting the same

[Document 3] Korean Patent Laid-Open Patent Publication No. 10-2011-0072292 Interactive customer service system and customer service method of robot and display device

[Document 4] Republic of Korea Patent Publication No. 10-2013-0112221 Advertisement and content-linked conversation service providing system and method using robot

In the document 1, a robot system communicates with a robot, a server that stores information about the operation of the robot, and the robot and the server, receives the robot's motion from the robot, receives the stored character's motion from the server, and responds to the robot It relates to a technology that can include a terminal for displaying a character to the image.

Document 2 relates to an intelligent display device capable of promoting and a method for promoting the same. In more detail, it relates to an intelligent display device capable of publicity, and a method for promoting the same, by determining a promotion target based on situational information grasped through an image recognition means and using an image output means and a driving means for promotion.

Document 3 relates to a customer service system and a customer service method for guiding a user with audio-visual information through an interaction between a robot guiding a user and a display device on which the user's requirements are displayed on the screen. The customer service system according to the present invention is a customer service system that provides information to customers through mutual communication and output between an intelligent service robot and a digital information display device using a wired or wireless network, using a movement function and an external recognition function to recognize the customer, receive the customer's request as input, transmit it to the display device, and send it to the display device.

A robot that guides the displayed result content by voice; and a display device that has a content DB in which the content is stored, receives the customer's request from the robot, retrieves the corresponding result content from the content DB, and provides information to the customer using a screen display and voice output function. Thus, it relates to a technology in which a robot mediates between a customer and a display device to provide a content providing service according to the customer's requirements.

Document 4 relates to an advertisement and content-linked conversation service system using a robot and a method therefor, and provides a system and method capable of providing advertisements and contents in a robot by combining advertisements and contents with a voice-based conversation service. There is a purpose.

The present invention for achieving this object, a robot that generates a dialogue based on a user's voice, receives and outputs the 'advertisement and content dialogue' generated based on the dialogue; and a dialogue service device that converts the dialogue input from the robot into advertisements and content sentences, and transmits the converted advertisement and contents sentences and 'advertisements and contents dialogues' including motion information of the robot to the robot; It relates to technology including

[Document 1] Korean Patent Application Laid-Open No. 10-2019-0095189 Robot system and its control method [Document 2] Korean Patent Laid-Open Patent Publication No. 10-2011-0016165 Intelligent display device capable of promoting and method for promoting the same [Document 3] Korean Patent Laid-Open Patent Publication No. 10-2011-0072292 Interactive customer service system and customer service method of robot and display device [Document 4] Republic of Korea Patent Publication No. 10-2013-0112221 Advertisement and content-linked conversation service providing system and method using robot

Technologies related to a display device connected to a robot such as the above documents are being released and are being commercialized. In particular, there is a need for a display device technology for more effective guidance, advertisement, and publicity applied to courier robots, which are recently rapidly expanding. In addition, the display device applied to the existing robot is mainly applied to one side of the robot, so it is expensive in price, but there is a problem in that there is a lack of advertising or publicity because it can be viewed only from one side.

As the technology of transparent LCD or transparent OLED has recently been developed, it is necessary to have a technology that can be applied to robots.

Therefore, in order to solve the above problem, the present invention places a display device using a transparent LCD (Liquid Crystal Display) or transparent OLED (Organic Light Emitting Diodes) on the upper side of the robot, and guides or cautions using characters or objects, and advertisements and publicity Its purpose is to provide technology that can do

According to an embodiment of the present invention, an embedded computing board mounted on the robot by installing a rotatable shaft on one side of the upper part of the robot and having a transparent LCD or transparent LED display device connected to the shaft and The present invention relates to a technology for recognizing surrounding people using an image camera, rotating the display device in the direction in which people are, and giving attention or guidance, publicity, and advertisement using a speaker provided in the display device and the robot.

In another embodiment of the present invention, the present invention implements a character (mainly a three-dimensional character) in a three-dimensional space in the transparent LCD or transparent OLED display device, and the character uses an image camera mounted on the robot. It has a technology of recognizing surrounding people and rotating the character in the direction in which the people are in order to guide, promote, and advertise using a speaker provided in the robot. In detail, if the character can rotate in addition to rotating the display device, the character floating in the air moves and changes direction because the transparent LCD is transparent by rotating the character without excessively rotating the display device. Because it increases people's concentration by showing

According to another embodiment of the present invention, a character implemented on the display device is implemented in the shape of a human or animal face in a transparent space to provide a technology that can personify a robot in guiding, promoting, and advertising.

The present invention has an effect that the robot can attract people's attention by applying a transparent LCD or a transparent OLED display device connected to a rotating shaft on one side of the upper part of the robot, so that the character is floating in a transparent space, and the entire side of the existing robot It is advantageous in terms of price compared to technology that uses a display device and has superior effects in robot guidance, advertisement, and publicity.

1 is a diagram illustrating a basic embodiment of the present invention;
2 is an explanatory diagram of a transparent LCD display device connection control method of the present invention;
3 is an explanatory diagram for an additional application method of a character in the control method of FIG.

The present invention relates to a display-related technology that is mainly applied to a delivery robot and a guide robot, which has been developed in recent years, and relates to a technology for configuring a display device by connecting a transparent LCD or a transparent OLED to an upper side of the robot using a rotating shaft.

And the present invention has the following technical differentiation and effects.

1) Levitation effect: By applying transparent LCD or transparent OLED, it can attract people's attention through the effect of floating in the air. In other words, if a character or object is applied in a three-dimensional space with a program on a transparent LCD display device, the background is transparent, so it has the effect of floating in the air like a hologram, which can attract people's attention, It is advantageous compared to the existing technology in publicity and advertisement.

2) Higher brightness compared to hologram: This is a technology that shows objects in the air. Projection of objects through existing holograms has the same effect as the present invention, but it cannot be commercialized for robots that are applied outdoors because it is invisible outdoors. And OLED has its own physical reflective medium, so it has a higher brightness than holograms, so it can be practically used outdoors to some extent.

3) Interaction effect with character: Although the display device applied to the existing robot body cannot guide the direction using the character or express the face of the robot, the present invention allows a character floating in the air to give direction, attention, or guidance using a three-dimensional space. And it is advantageous for spatial expression using a character and has a feature that can make it more realistic in the anthropomorphic expression of a robot through human face expression.

1 is a transparent LCD display device (or transparent OLED display device, 400) connected to the rotation shaft 200 of the upper side of the robot 100 mainly applied for delivery or guidance as a basic embodiment of the present invention and rotated left and right ) is composed of Here, the transparent LCD may be replaced with a transparent OLED having superior visual performance and color expression in the long term.

And the robot 100 includes an embedded computing board 300 for overall control and graphic processing of the transparent LCD display device 400, and an image camera 500 to capture surrounding objects and people. do

And the embedded computing board 300 includes a CPU 300, a memory 320, and a GPU (Graphic Processing Unit, 330) for processing a plurality of image images, and includes I/O such as GPIO (General Purpose Input/Output). It has a 340 and is connected to peripheral devices such as a transparent LCD display device 400 and an image camera 500 so that the CPU 300 controls the peripheral devices.

The embedded computing board 300 as described above has recently been widely applied in the field of robotics, so many images captured in real-time from the video camera are processed using the GPU 330, and mainly analyzed using an artificial intelligence program based on Linux OS or Windows OS. Therefore, it is applied to various controls such as attention and guidance of robots and AI conversation. In the present invention, the artificial intelligence program module 350 is included as software in the memory 320 mainly applied to the SD card (Secure Digital Memory Card). In addition, the memory 320 mainly includes a DDR type RAM.

In addition, the AI program module 350 is connected to peripheral devices such as the CPU 300, the video camera 500, the microphone 700, and the speaker 600 in the present invention, so as to function for artificial intelligence object recognition and artificial intelligence voice recognition. and artificial intelligence dialogue and judgment function, and the role of peripheral adjustment.

In addition, it is preferable to apply a small rotational slip ring 210 driven by a DC voltage and low current, which is commonly applied to a recent robot, as the rotation shaft 200 connected to rotationally drive the transparent LCD display device 400 .

And as a main feature, a character 410 or an object is applied as a graphic process to the transparent LCD display device 400 that is connected to the rotation shaft 200 and displayed, so that people around the character 410 or the part other than the object, that is, , because the background 420 is transparent due to the transparent LCD display device 400, the character 410 or the object appears to be floating in the air. In other words, in the background of the character 410 or the object, the background 420 of the display area of the transparent LCD display device 400 excluding the character 410 or the object, that is, the blank space must occupy a certain part of the character. When the 410 or the object moves or changes, the background 420 part is transparent in contrast with the character 410 or the object, so that the effect of the character 410 or the object floating in the air is more may appear large. In addition, the character 410 may be mainly a person or an animal, and the object may be mainly a product or a symbol.

Then, by using the artificial intelligence program module 350 built in the memory 320 in the image camera 500 to search for surrounding images, it is possible to determine whether there is a person. When a person is identified, the transparent LCD display device 400 is rotated in the direction of the person by the program of the artificial intelligence program module 350 according to the people information captured by the video camera 500 .

And according to the program of the artificial intelligence program module 350 according to the rotation of the transparent LCD display device 400, the character 410 or the object is mainly applied as a 3D graphic image or a 3D real image, and the transparent LCD Under the three-dimensional program space of the display device 400, the character 410 can attract people's attention by rotating or moving left or right in the direction of the person, and the transparent LCD display device 400 is When rotating to the left or right toward the direction of the person, the character 410 rotates and moves to the left or right in the same direction, and a technology that provides guidance, explanation, and attention using the speaker 600 mounted on the robot 100 This can be implemented.

In addition, through the microphone 700 configured in the robot 100, the voice recognition and analysis using the artificial intelligence program module 350 of the people around you can also talk with people by applying the character 410. And at this time, the character 410 can be applied by making a face shape of a person or an animal, etc. In this case, there is an anthropomorphic effect, so that a sense of realism can be increased when talking with people.

2 is a transparent LCD display device 400 of the robot 100 of the present invention relates to a control method applied.

When the robot 100 is stationary or moving, the CPU 310 of the embedded computing board 300 uses the image camera 500 and the artificial intelligence program module 350 to check whether there are people around. (100S)

And according to the presence or absence of a person, the artificial intelligence program module 350 determines whether guidance or attention of the robot 100 is required according to a predetermined program standard (200S).

The program criterion for determining whether the guidance or attention is necessary is whether the surrounding brightness is dark enough for the display effect of the transparent LCD display device 400 to occur, and whether people are at a distance within the range or if there is a problem during the movement of the robot 100 The artificial intelligence program module 350 determines whether or not the

When the artificial intelligence program module 350 determines that a person is recognized and guidance or attention is required, the transparent LCD display device 400 is displayed according to a predetermined program of the artificial intelligence program module 350 in the direction in which the person is present. It rotates left or right using the rotating shaft 200 (300S).

And the character 410 displayed on the transparent LCD display device 400 by the determination of the artificial intelligence program module 350 also rotates or moves in the direction of the person. (400S)

At this time, since the character 410 is a graphic display, it may be necessary to direct according to the movement of the transparent LCD display device 400 or to attract people's attention with various movements such as various movements, and the effect of the present invention may be added. can

And the character 410 gives attention or guides and explains through the speaker 600 according to a predetermined program. (500S)

After giving the attention or guiding and explaining, the robot 100 works next according to a predetermined program. (600S)

3 is an explanatory diagram for an additional application method of a character in the control method of FIG. 2,

The artificial intelligence program module 350 determines whether a conversation between the character 410 and the person is necessary after the robot 100 recognizes a person using the image camera 500 (100S). (110S)

When the AI program module 350 determines that a conversation is necessary, only the face of the entire character 410 is displayed on the transparent LCD display device 400 (120S). At this time, the character's face is the lower robot. It is more desirable for personification to display the neck as well as connected to (100).

Then, a conversation is conducted with a person through the speaker 600 using the artificial intelligence voice recognition technology using the microphone 700 and the artificial intelligence program module 350 (130S).

100 robots
200 axis of rotation
300 Embedded Computing Board
400 Transparent LCD display device (or transparent OLED display device)
500 video camera
600 speakers
700 microphone

Claims (7)

robot 100; Embedded computing board 300; and a three-dimensional character 410 including a transparent LCD display device 400 and a transparent background 420 on the transparent LCD display device 400 provided on an upper side of the robot 100,
The transparent LCD display device 400 of the robot 100 moves to the left or right.
A rotating shaft 200 connected to the transparent LCD display device 400 to be rotated is included,
Recognizing a person with the image camera 500 and rotating the transparent LCD display device 400 connected to the rotation shaft 200 in the direction in which the person is,
The three-dimensional character 410 is also interlocked in the direction in which the video camera 500 recognizes a person so that the three-dimensional character 410 is levitated in the air in contrast with the transparent background 420 by movement. Transparent LCD display application robot including one artificial intelligence program module 350
The transparent LCD display application robot according to claim 1, comprising replacing the transparent LCD display device 400 with a transparent OLED display device.
The robot according to claim 1, wherein the three-dimensional character 410 is replaced with a three-dimensional object capable of expressing goods or symbols. The robot according to claim 1, wherein the rotating shaft 200 includes applying a small rotating slip ring 210.
robot 100; Embedded computing board 300; Transparent LCD display device 400; And in the robot 100 control method provided with an image camera 500,
Using the video camera 500 and the artificial intelligence program module 350 to check whether there are people around when the robot 100 is stationary or moving; (100S)
After confirming with the video camera 500, determining whether guidance or attention of the robot 100 is required by the artificial intelligence program module 350 according to the presence or absence of a person; (200)
When it is determined that the guidance or attention is necessary, the artificial intelligence program module 350 recognizes a person with the video camera 500 and uses the rotating shaft 200 to rotate the transparent LCD display device 400 in the direction of the person. Rotating left or right; (300S) and
The three-dimensional character 410 is also linked with the recognition direction of the image camera 500 and moves in the direction of the person to be contrasted with the transparent background 420 so that the three-dimensional character 410 is levitated in the air. Including one of the artificial intelligence program module 350; Transparent LCD display application robot control method comprising (400S)
[Claim 6] The method of claim 5, wherein the transparent LCD display device 400 is replaced with a transparent OLED display device. The method according to claim 5, wherein the three-dimensional character 410 is replaced with a three-dimensional object capable of expressing goods or symbols.

Images