KR20110041648A - Storage-media saving multimedia contents for robot-control and creating method of multimedia contents for robot-control - Google Patents

Abstract

PURPOSE: A storing medium and multimedia content generating method are provided to supply an operation file which controls an operation of a robot according to various multimedia files in order to drive a robot. CONSTITUTION: A multimedia file(200) includes an image, a sound source, or a text. An operation command(314) is included in order for an operation file to drive a robot. A plurality of operation frames(310) includes the operation file. Synchronization data(312) is saved in a synchronization area. The operation command is stored in an operation command area.

Description

Storage media for storing multimedia contents for robot operation and method for generating multimedia contents for robot operation {Storage-media saving multimedia contents for robot-control and Creating method of multimedia contents for robot-control}

The present invention relates to a storage medium in which multimedia content including an operation file for driving a robot is stored and a method of generating the multimedia content.

Recently, robots have been developed and distributed for various purposes in various fields such as commercial, home, and toy robots.

As a result, the performance of the robot is gradually developed, and it is possible to express not only a simple movement but also a precise movement of a person.

However, in the control method for controlling the robot, the controller controls the operation of the robot, or inserts a storage medium in which the movement is programmed to control the operation of the robot.

However, the prior art as described above has the following problems.

That is, in the case of controlling the robot using the controller, the user must have a control ability to precisely and quickly adjust the controller in order to control the robot precisely and quickly.

In the case of using a programmed storage medium, since the robot implements only a limited kind of operation, there is a problem in that various robot operations cannot be implemented.

The present invention has been made to solve the conventional problems as described above, an object of the present invention is to create a motion file for the user to control the operation of the robot according to various multimedia files, thereby controlling the operation of the robot The present invention provides a method of generating multimedia content for driving a robot.

According to a feature of the present invention for achieving the above object, the present invention provides a multimedia file including at least one of an image, a sound source or a text; And corresponding to the multimedia file, the operation file comprising an operation command for driving the robot: the operation file is composed of a set of a plurality of operation frames: the operation frame is the multimedia file. And a storage area for storing the sync data for setting a relative position with the storage device, and a storage medium for storing the multimedia content for driving the robot.

In this case, the operation command is specified by the user among those selected from the robot motion database according to the information extracted from the multimedia file: The robot motion database includes: a classification criterion for classifying actions that the robot can express; An operation command of a robot corresponding to the classification criteria may be stored.

Information extracted from the multimedia file is classified according to the type of the multimedia; When the multimedia is an image, the motion or expression of an object in the image; When the multimedia is a sound source, at least one of rhythm, lyrics, or a designated operation of the sound source; When the multimedia is text, it may be any of verbs, adjectives, and nouns in the text.

On the other hand, the present invention comprises the steps of (A) determining the multimedia type of the selected multimedia file; (B) reading the multimedia file in the set division unit; (C) extracting information of the read multimedia file; (D) extracting an operation command from the robot motion database using the extracted information; And (E) generating a multimedia file using a extracted motion command to generate a motion file.

At this time, the information extraction of the multimedia file of step (C) may be to set the classification criteria for each category according to the type of the multimedia.

The robot motion database includes: a classification criterion for classifying motions that the robot can express; An operation command of a robot corresponding to the classification criteria may be stored.

In addition, the step (D) may include: (D1) comparing the classification criteria set in the step (C) with the robot motion database; (D2) extracting operation instructions corresponding to the classification criteria from the robot operation database; (D3) displaying the extracted operation commands to a user; And (D4) receiving a user's selection command for any one or more of the displayed operation commands.

In the step (E), the operation frame is generated using the operation command selected in the step (D) while repeatedly performing the steps (B) to (D) over the entire multimedia file. It may be performed by combining the operation frame.

As described above, in the storage medium in which the multimedia content for driving the robot according to the present invention and the method for generating the multimedia content for driving the robot, the following effects can be expected.

That is, the user generates an operation file for controlling the operation of the robot according to various multimedia files, thereby controlling the operation of the robot, there is an advantage that can be elaborate a variety of robot control.

In addition, the present invention has an advantage that the fun of the user is increased because the driving of the robot is controlled in conjunction with various multimedia files.

Hereinafter, with reference to the accompanying drawings, a specific embodiment of the storage medium for storing the multimedia content for driving the robot according to the present invention as described above and the method for generating the multimedia content for driving the robot will be described in detail.

1 is a flowchart illustrating a method of driving a robot using multimedia content according to the present invention.

First, a method of driving a robot using multimedia content according to the present invention will be described.

As shown in FIG. 1, the robot according to the present invention is controlled and operated by wireless communication with a mobile terminal.

In this case, the wireless communication may use a variety of commercialized communication methods such as Bluetooth, Wi-Fi.

In more detail, first, the mobile terminal plays the multimedia content 100 (S10).

In this case, the multimedia content 100 is data including the multimedia file 200 and the operation file 300 for operating the robot. Hereinafter, in the present specification, the multimedia file 200 and the operation file 300 may be used. The included data is referred to as multimedia content 100.

When the multimedia content 100 is played, the terminal reads the operation file 300 included in the multimedia content 100 (S20).

Then, the read operation file 300 is transmitted to the robot (S30).

When the operation file 300 is received by the robot (S40), the robot stores the received operation file 300 in a buffer (S50).

The robot drives the robot according to the buffered motion file 300 (S60).

After the robot is driven, a response message according to the operation result of the robot is transmitted to the mobile terminal (S70 and S80).

The present invention relates to a robot driven as described above, the multimedia content for driving the robot and a method of generating the same.

Therefore, hereinafter, the configuration of the multimedia content and a method of generating the same will be described in detail.

Figure 2 is a schematic diagram showing the configuration of multimedia content according to the present invention, Figure 3 is a flow chart showing a method for generating multimedia content according to the present invention, Figure 4 is a robot for generating multimedia content according to the present invention An example diagram showing a table stored in an operation database.

As shown in FIG. 2, the multimedia content 100 according to the present invention includes a multimedia file 200 and an operation file 300.

The multimedia file 200 is a file in which generally speaking multimedia data is stored. The multimedia file 200 is a (motion / still) image, a sound source, or a text file.

In addition, the operation file 300 corresponds to the multimedia file 200 and is a file including an operation command of the robot to move the robot.

The motion file 300 is composed of a plurality of motion frames 310 (P1, P2, P3 ...).

In this case, the operation frame 310 includes a sync area 312 and an operation command area 314, and an operation command for controlling driving of the robot is stored in the operation command area 314. The sink area 312 stores sync data indicating a position of the multimedia data corresponding to the operation command and a position of the operation frame 310.

The sync data allows the motion frame 310 transmitted to the robot to be buffered in order, and the multimedia file 200 to be played when the mobile terminal pauses / plays the multimedia content 100. To operate the robot according to the position of.

On the other hand, the operation command is an operation command corresponding to the multimedia file 200, and consists of an operation command selected by the user among the operation commands presented to the user by the terminal. The contents selected by the user by presenting the operation command according to the multimedia file will be described below in detail in the method of generating the multimedia contents.

Hereinafter, a method of generating multimedia content as described above using a mobile terminal will be described in detail.

The generation of the multimedia content 100 starts with the selection of the multimedia file 200 to generate the multimedia content 100 from the user and the creation of the multimedia content 100 corresponding thereto (S100).

Thereafter, the mobile terminal determines the type of the selected multimedia file 200 (S110).

That is, it is determined whether the multimedia file 200 relates to a multimedia of an image, a sound source, and text.

In operation S120, the multimedia file 200 is classified and read in units of sync units.

In this case, the sync unit refers to the multimedia file 200 corresponding to one operation frame 310, and is classified differently according to the type of the multimedia file 200.

That is, when the multimedia file 200 is an image file, the sync unit may be set to correspond to a preset time or the number of frames.

In addition, when the multimedia file 200 is a sound source file, the sync unit may be set according to a preset measure or time.

When the multimedia file 200 is a text file, the multimedia file 200 may be set according to a preset sentence or paragraph.

Next, the multimedia information is read from the multimedia file 200 (S130).

The reading of the multimedia information is also performed differently according to the type of the multimedia, which will be described below in order.

I) when the multimedia file 200 is an image file.

In the case of an image file, the movement of the target object, which is the subject of the image, is extracted from the read multimedia file 200 to simplify the movement. Since a technique of extracting motion from the image may be achieved by using a commercially available technique such as a VMD used in an intelligent surveillance camera, a detailed description thereof will be omitted.

The extracted and simplified data are compared with the classification criteria table to classify the classification criteria with high similarity. Here, the classification criteria refers to a list of the operations that the robot can express.

In addition, in the read multimedia file 200, the expression of the target object to be the subject of the image is extracted and simplified. That is, the main point of the object (lip shape point, eye shape point) is searched for and simplified. The extracted and simplified data are compared with the classification criteria table to classify the classification criteria with high similarity.

Ii) On the other hand, if the multimedia file 200 is a sound source file, the rhythm of the sound source is extracted. At this time, the information about the sound source is stored in a separate area of the sound source file, and if the information about the rhythm of the sound source is included in the sound source information, it is selected as a classification criterion.

On the other hand, if there is no information about the rhythm in the sound source file, the waveform of the sound source is extracted, and the classification criteria for the rhythm are selected by comparing it with the classification criteria table.

When lyrics information is included in a separate area of the sound source file, a classification criterion is selected from the lyrics information. In this case, since the method of selecting the classification criteria from the lyrics information is the same as that of the text file to be described later, it will be omitted here.

When the information on the designation operation is recorded in a separate area of the sound source file, the designation operation is selected as the classification criteria. In this case, the designation operation may be an operation for expressing the sound source, for example, a dance operation of a singer.

Now. As the compression technology of the sound source has been developed, and as the amount of information on the sound source increases, a sound source containing information on the dance movement of the singer has been developed.

I) If the multimedia file 200 is a text file, a word included in the text file is extracted.

Then, an emotional state or movement represented by the text file is extracted from the extracted words through an ontology database, and the classification criteria are selected by comparing the extracted emotional state and movement with a classification criteria table.

In the same manner as described above, after selecting the classification criteria, the robot operation database is searched to extract an operation command corresponding to the classification criteria (S150).

Here, the robot motion database, as shown in Figure 4, the operation command (a1, a2) corresponding to each of the classification criteria (A1, A2, ..., B1, B2, ..., C1, C2, ...), respectively. , ..., b1, b2, ..., c1, c2, ...) dl is stored.

Next, the extracted operation command is displayed to the user so that the user selects some of them (S160). In this case, the display of the user may be easily recognized by the user by using an emo conti or a video.

On the other hand, when the user selects an operation command in step 160, the operation frame 310 is generated using the selected operation command (S170). In this case, the operation frame 310 includes sync data corresponding to the location of the multimedia file 200.

The generated motion frame 310 is stored (S180), and the motion file 300 is generated and stored by repeating the steps 120 to 180 over the multimedia file 200 (S190). (S200).

The generated motion file 300 forms the multimedia content 100 together with the multimedia file 200.

The rights of the present invention are not limited to the embodiments described above, but are defined by the claims, and those skilled in the art can make various modifications and adaptations within the scope of the claims. It is self-evident.

The present invention relates to a storage medium storing a multimedia content including an operation file for driving a robot and a method of generating the multimedia content. According to the present invention, an operation file for a user to control the operation of the robot according to various multimedia files By generating the control of the operation of the robot through this, there is an advantage that can be elaborate a variety of robot control.

1 is a flowchart illustrating a method of driving a robot using multimedia content according to the present invention.

2 is a schematic diagram showing the configuration of multimedia contents according to the present invention;

3 is a flowchart illustrating a method for generating multimedia content according to the present invention;

4 is an exemplary view showing a table stored in a robot motion database for generating multimedia content according to the present invention.

* Description of the symbols for the main parts of the drawings *

100: multimedia content 200: multimedia files

300: motion file 310: motion frame

312: sink area 314: operation command area

Claims (8)

A multimedia file including at least one of an image, a sound source, and text; Corresponding to the multimedia file, comprising a motion file comprising a motion command for driving the robot: The action file is, It consists of a set of multiple motion frames: The operation frame, And a sink area for storing sync data for setting a relative position with the multimedia file, and an operation command area for storing the operation command. The method of claim 1, The operation command, According to the information extracted from the multimedia file, ones selected from the robot motion database are designated by the user: The robot motion database, A classification criterion for classifying the operations that the robot can express; Storage medium for storing multimedia content for driving the robot, characterized in that the operation command of the robot corresponding to the classification criteria is stored. The method of claim 2, The information extracted from the multimedia file, Classified according to the type of multimedia; When the multimedia is an image, the motion or expression of an object in the image; When the multimedia is a sound source, at least one of rhythm, lyrics, or a designated operation of the sound source; If the multimedia is a text, the storage medium is stored multimedia content for driving the robot, characterized in that any one of the verb, adjective or noun in the text is stored. (A) determining a multimedia type of the selected multimedia file; (B) reading the multimedia file in the set division unit; (C) extracting information of the read multimedia file; (D) extracting an operation command from the robot motion database using the extracted information; And (E) a method of generating multimedia content for driving a robot, comprising the step of generating an operation file by using the extracted operation command. The method of claim 4, wherein Extracting information of the multimedia file of step (C), The method of generating multimedia content for driving a robot, characterized in that for setting the classification criteria for each category according to the type of the multimedia. The method of claim 5, The robot motion database, A classification criterion for classifying the operations that the robot can express; And generating an operation command of a robot corresponding to the classification criterion. The method of claim 6, Step (D), (D1) comparing the classification criteria set in the step (C) with the robot motion database; (D2) extracting operation instructions corresponding to the classification criteria from the robot operation database; (D3) displaying the extracted operation commands to a user; And And (D4) receiving a user's selection command for any one or more of the displayed operation commands. The method according to any one of claims 4 to 7, Step (E), While repeating steps (B) to (D) over the entire multimedia file, an operation frame is generated using the operation command selected in step (D), and the operation frame is combined. A method of generating multimedia content for driving a robot.

Images