KR101280226B1 - Method for composing the image signals in a robot and a robot thereof - Google Patents

Abstract

The present invention relates to a method for synthesizing an image in a robot and the robot. More specifically, the present invention relates to a method of synthesizing a moving image taken by an image camera provided by a robot with a specific animation.

In the present invention, a control unit for controlling each component of the robot; Image synthesizing means for synthesizing the stored graphic animation and the image photographed with the image camera included;

According to the control signal of the control unit, a robot for synthesizing the image, characterized in that the image is stored in the image synthesizing means and the image camera provided with the image of the front part of the robot synthesized and then displays the synthesized image And methods thereof are presented.

Robot, Image Synthesis

Description

Method for composing the image signals in a robot and a robot

1 is a schematic configuration diagram of a robot synthesizing an image according to an embodiment of the present invention.

2 is a schematic configuration diagram of an image synthesizing means included in a robot according to an embodiment of the present invention.

3 is a flowchart illustrating a method of synthesizing an image in a robot according to an exemplary embodiment of the present invention.

<Description of Major Symbols in Drawing>

101: key input unit 103: moving mechanism

104: image synthesis means

201: image camera 202: image camera buffer

203: Graphic animation storage unit 204: Graphic animation input unit

205: synthesis unit 206: screen buffer

207: display unit

The present invention relates to a method for synthesizing an image in a robot and the robot. The present invention relates to a moving picture processing technology for receiving a moving picture of a user from a robot having an image camera to a moving picture camera, synthesizing the moving picture of the user and a predetermined graphic animation according to a predetermined program, and outputting it to the screen.

Recently, various programs using robots have been developed. The robot is not only limited to functions such as house expenses or cleaning, but also displays a predetermined children's program on the screen provided by the robot so that the children's program can be more familiar to children. Such children's programs are generally composed of character animations. Any program consisting only of character animations cannot give the user a sense of participation, which is not enough to increase participation in the program. In addition, only the user's motion is input to the image camera and exported to the screen without reconfiguration, which is not enough to increase the completeness of the program.

The present invention is to solve the above problems, an object of the present invention is to synthesize a graphic character or graphic animation already produced in a robot equipped with an image camera and a method for synthesizing a moving image input through the image camera and performing the method To provide a robot.

In order to achieve the above object, the present invention, the control unit for controlling each component of the robot; Image synthesizing means for synthesizing the stored graphic animation and the image photographed with the image camera included;

A robot for synthesizing a moving image, comprising synthesizing an image of a graphic animation stored in the image synthesizing means and an image image photographed by an image camera according to a control signal of the controller and displaying the synthesized image; A method of synthesizing moving images in the robot is presented.

Hereinafter, with reference to the accompanying drawings, the configuration and operation of the embodiment of the present invention will be described in detail.

1 is a schematic configuration diagram of a robot synthesizing a moving image according to an embodiment of the present invention.

As can be seen in Figure 1, the robot 100 according to an embodiment of the present invention is a control unit 105 for controlling the key input unit 101, the movement mechanism 103, the image synthesizing means 104 and the components )

The key input unit 101 is a means for inputting a signal for performing a specific function to a robot having various functions. When a signal for selecting an image combining function of the present invention is input to the key input unit 101, the robot 100 performs image combining according to an embodiment of the present invention.

The movement mechanism 103 is a mechanical configuration for moving the robot, and has a wheel shape, a human leg shape, and the like, and moves the robot according to a control signal from the controller 105.

The image synthesizing means 104 is a component for synthesizing an image taken by an image camera with a specific video stored in a robot, and synthesizes an image according to a control signal of the controller. More specific configuration and operation thereof will be described with reference to FIG. 2 below.

The controller 105 performs a function of controlling the overall system of the robot. In particular, the present invention has a main function in controlling the image synthesis by the image synthesizing means 104 according to the method of the present invention.

2 is a schematic configuration diagram of an image synthesizing means included in a robot according to an embodiment of the present invention.

As can be seen from FIG. 2, the configuration includes an image camera 201, a camera image buffer 202, an animation storage unit 203, an animation input unit 204, a synthesis unit 205, and a screen buffer ( 206 and a display unit 207.

The image camera 201 is a digital camera, which photographs the situation in front of the robot, digitizes it, and transmits the image to the camera image buffer. The shooting speed of the camera is suitable to shoot at 30 frames per second (FPS). The image is made in bmp file format.

The camera image buffer 202 stores the image photographed by the image camera 201 as a bmp-type image, and transmits each frame image to the combining unit 205 according to a control signal of the controller 105. Done.

The animation storage unit 203 stores a specific graphic animation to be synthesized with the image photographed by the image camera, and then synthesizes each image of the graphic animation stored according to a control signal of the controller 105. Will be sent to.

Here it is classified into the following processes. If the graphic type is graphic by unit, the control unit calls out the graphic image according to the storyboard and synthesizes it with each image image captured by the image camera. If the graphic type is flash type, the control unit stores the flash image stored in the control unit. It executes using the engine and synthesizes a specific image extracted from each image with each image taken by the image camera. In this case, the extracted and synthesized flash image is a flash image executed at the same time as the shooting time of each frame of the image camera. That is, the flash image extracted during execution by using each shooting frame of the image camera and the flash engine is synchronized.

The animation input unit 204 is a part for inputting a specific graphic animation to be synthesized with the image captured by the image camera 201 to the robot.

The synthesizing unit 205 synthesizes the images received from the camera image buffer 202 and the animation storage unit 203 according to the image synthesizing control signal of the control unit 105. In the embodiment of the present invention, a PIPP method is used as an image synthesis method. That is, the predetermined portion is processed with a designated color (for example, blue) for transparent processing on a certain portion of each animation image, and the image photographed by the image camera is synthesized with the transparent processed portion.

In synthesizing the camera image and the graphic animation in the synthesis unit, there is a difference depending on the type of graphic. First, in the case of the graphic for each unit, it is synthesized using the time interval information by the storyboard generated in the graphic production process. The storyboard is stored in the storage unit together with the graphic image and then read by the control unit and synthesized according to the storyboard.

Suppose a storyboard is created with graphics for each unit and corresponding time interval information, as shown below.

Image number number 1 No.2 number 3 4 times 5 times No. 6 No. 7 Time interval 3 2 5 2 12 4 3

In addition, since 30 frames per second are input to the camera image, the camera image is sequentially synthesized with the image of the camera image and the corresponding time which sequentially enter the buffer according to the graphic time interval of each unit. That is, it is synthesized as shown in the table below.

Frames per second One 2 3 4 5 6 7 8 9 10 11 12 13 14 15 ... Image number One One One 2 2 3 3 3 3 3 4 4 5 5 5 ...

Next, in the case of Flash graphics, when an animation engine is operated separately and executed, the Flash graphics engine receives the images output by the animation engine according to the number of image frames input to the image camera. Will be synthesized. In other words, a graphic image executed at the time of capturing the individual frames captured by the image camera and the respective frame images are synthesized.

The screen buffer 206 temporarily stores the synthesized images and transmits the synthesized images to the display unit 207 according to a signal from the controller.

The display unit 207 displays images from the screen buffer 206 so that users can view the synthesized image on the screen. This includes LCD panels.

In order to synthesize a graphic animation and a camera image in a robot, it is first necessary to create a graphic animation to be synthesized and store it in the robot. In an embodiment of the present invention, the following procedure is followed.

First, create character and graphic animation. At this time, when producing graphic for each unit, animation time interval is decided by story board. When producing graphic animation such as flash, the animation time interval by storyboard is set in flash.

Next, parts that are not necessary in the graphic animation for the composition with the camera image are transparently processed. For this transparent processing, the blank areas are processed in the color promised with the synthesis program such as blue. Then, when synthesizing the graphic animation and the camera image by the compositing program, only the transparent image portion (for example, the blue portion) of the graphic animation is synthesized. At this time, the inputs per second are processed as the number of inputs per second of the moving image coming into the image camera. For the efficiency of the program, the inputs per second are adjusted from 30 FPS (frame per second) to 10 FPS.

Finally, the graphic animation produced as described above is stored in the animation storage unit 203 through the animation input unit 204 of the robot.

3 is a flowchart illustrating a method of synthesizing a moving image in a robot according to an embodiment of the present invention.

The method comprises the steps of: first determining, by the controller 105, the type of graphics to be synthesized previously stored in the storage 203 (S301);

If the graphic type is a Flash type, executing the image data of the storage unit 203 by using the flash engine in the control unit 105 and simultaneously photographing the front of the camera with an image camera (S302);

Extracting a flash execution image according to a shooting time of each frame of the image camera by the control unit (S303);

Transmitting the extracted flash image and the image frame image to the combining unit 205 according to the control signal of the control unit 105 (S304);

Reading the storyboard of the graphics stored in the storage unit 203 in the control unit 105 when the graphic type is a graphic for each unit (S305);

Photographing the front of the camera with the image camera 201 by the control unit 105 (S306);

Transmitting the corresponding image of the storage unit and the camera image frame image to the synthesis unit according to the control signal of the controller 105, wherein the corresponding image of the storage unit is a designated image to be synthesized in order by referring to the storyboard in the controller; (S307);

Synthesizing the image received from the combining unit 205 (S308);

Transmitting the image synthesized by the combining unit 205 to the screen buffer 206 (S309);

And receiving and displaying the image synthesized by the display unit 207 from the screen buffer 207 (S310). When the synthesis of the image data stored in the storage unit is completed, the moving image synthesis procedure is completed. do. That is, when the execution by the flash engine on the stored image data is completed or when the synthesis with the graphic image according to the storyboard is completed, the synthesis procedure is completed.

According to the present invention, by synthesizing the moving picture and the graphic animation taken by the image camera of the robot to display the synthesized animation can provide a function that allows the user to feel the sense of being with the character in the animation, the user's various contents Increase your immersion in

Claims (13)

An image camera which captures the situation in front and obtains an image image; An animation storage unit for storing graphic animations; A synthesizing unit for synthesizing the image images sequentially input according to the graphic time interval of each unit of the graphic animation by using the graphic of each unit of the graphic animation and corresponding time interval information; And A controller for controlling the synthesis of the graphic animation and the image image; Image synthesis robot comprising a. The method according to claim 1, The synthesizing unit, the image synthesis robot, characterized in that for transparent processing to a specified color for a predetermined portion of each image of the graphic animation in accordance with the PIPP method, and synthesizes the image image to the transparent processing. The method according to claim 1, A camera image buffer which stores the image image photographed by the image camera as a bmp-type image and transfers each frame image to the synthesis unit according to a control signal of the controller; Image synthesizing robot further comprises. The method according to claim 1, An animation input unit which inputs a specific graphic animation synthesized with the image image captured by the image camera to the synthesis unit; Image synthesizing robot further comprises. The method according to claim 1, A display unit configured to display a synthesized image of the graphic animation and the image image on a screen; Image synthesizing robot further comprises. The method of claim 5, A screen buffer which temporarily stores the synthesized images and transfers the synthesized images to the display unit according to a control signal of the controller; Image synthesizing robot further comprises. The method according to claim 1 or 4, The image camera is an image synthesizing robot, characterized in that shooting at 30 frames per second. An image synthesis method of a robot including an image camera, a synthesis unit, an animation storage unit, a display unit, and a control unit, (a) the image camera photographing the front to obtain an image image; (b) the control unit transferring unit graphic animations stored in the image image and the animation storage unit to the synthesis unit; (c) synthesizing the image images sequentially input according to the graphic time interval of each unit of the graphic animation by using the unit-specific graphic of the graphic animation and corresponding time interval information. Making; And (d) the control unit displaying the synthesized image on the display unit or storing the synthesized image in the animation storage unit; Image synthesis method of the robot comprising a. The method of claim 8, And repeating steps (a) to (d) until the synthesis of the image image and the graphic animation is completed. The method of claim 8, In the step (c), the synthesizing process transparently processes a predetermined color of each image of the graphic animation according to a PIPP scheme, and synthesizes the image image on the transparently processed portion. . The method of claim 8, In the step (b), the control unit stores a bmp-type image in the camera image buffer for the image image photographed by the image camera, and transfers each frame image to the synthesis unit. Image Synthesis Method. The method of claim 8, In the step (a), the image camera captures 30 frames per second to obtain an image image of a robot. The method of claim 8, In the step (b), the control unit inputs a specific graphic animation synthesized with the image image to the synthesis unit through an animation input unit.

Images