KR20110126013A - Authoring method for synchronizing motion with moving image, and recording medium of its implementing program - Google Patents

Abstract

PURPOSE: An authoring method for synchronizing a motion with a moving image is provided to determine each frame of a moving picture and inserts a motion to the frame. CONSTITUTION: An authoring method for synchronizing a motion with a moving image comprises steps of: storing information about a system type of each motion(S200); receiving the system type input from a user(S300); receiving a moving picture for performing a synchronization(S400); receiving an input of a moving picture sync location(S700); creating a motion information file(S900); and converting the motion information file into a command signal(S1000).

Description

A recording method recording an authoring method for synchronizing motion pictures with motion and a program for implementing the method {AUTHORING METHOD FOR SYNCHRONIZING MOTION WITH MOVING IMAGE

The present invention relates to an authoring method for synchronizing motion with motion pictures and a recording medium recording a program for implementing the method. In particular, by automatically synchronizing motion with motion pictures, a robot or a chair can move according to motion pictures. The present invention relates to an authoring method for synchronizing motion pictures and motions that can easily generate a command signal, and a recording medium recording a program for implementing the method.

Recently, 4D movies as well as 3D movies have attracted much attention from theatres. If it is a 3D movie that simply moves away from the two-dimensional video that is displayed on a flat panel display, and allows viewers to feel the spatial three-dimensional effect by wearing three-dimensional glasses, the 4D movie is not only a spatial three-dimensional but also vibration or water or wind. It also makes you feel tactile. In order to implement this, it is necessary to analyze the motion of a person or an object in a movie, generate a command corresponding to the motion, and synchronize the motion with the movie. Each command is intended to vibrate a chair installed in a theater or to spray water or air.

In recent years, as the technology for controlling robots has been rapidly developed, technologies for moving robots in accordance with specific videos using robots capable of using various motions have been steadily developed, and these technologies have been developed in a wide range of fields including industries. It is applied in various ways. Of course, this technology also requires synchronization of motion and video.

Conventionally, a method of synchronizing a motion with a video by extracting a time when a specific motion is played using a program for playing a video and inputting a command corresponding to the specific motion at a corresponding time. However, this method is inconvenient because it is a simple time synchronization method of extracting the time when a specific motion is reproduced, and there is a problem that the work takes a long time.

The present invention has been proposed to solve the above problems of the conventionally proposed methods, and after loading a video to synchronize motion in a video editing program such as a conventional video editor, By providing a motion list to select motions, users can specify each frame of the video and insert and synchronize the desired motions with a simple click. It is an object of the present invention to provide a recording medium recording a program to be implemented.

In addition, the present invention, by using a method similar to the file format for processing subtitles, by storing the output of the video and motion synchronization work in a separate motion information file, by converting the motion information file to a specific command to the actual system Since a signal for driving or controlling can be generated, even a single motion information file can be utilized in various systems through a conversion operation, and a work for synchronizing a motion with a video that can easily database a result of a synchronized operation. Another object is to provide a recording medium recording a method and a program for implementing the method.

According to a feature of the present invention for achieving the above object, authoring method for synchronization of video and motion,

(1) storing a plurality of motions;

(2) receiving and playing a video for synchronizing motion;

(3) displaying a motion list to the user so that the user can select a specific motion among the plurality of motions;

(4) receiving a specific motion selected by a user from the motion list;

(5) receiving a sync position of the video to synchronize the received specific motion to the video;

(6) synchronizing the received specific motion to the sink position; And

(7) repeating steps (4) and (6) to synchronize at least one or more motions to the video, and then generating a motion information file including the sync position and the type of motion to which the motions are synchronized; It characterized by including the configuration.

Preferably, in the step (3)

The motion list may be displayed to the user in a manner of arranging icons showing motion pictures corresponding to each motion.

Preferably,

Storing information about a system type that can be driven for each motion; And

The method may further include receiving a system type to be driven or controlled by the user.

In step (3), a list of only motions that can be driven according to the input system type may be displayed to the user.

Preferably,

The method may further include converting the motion information file into a command signal that may be directly applied to driving or controlling the various types of other systems using a specific interface based on the system type.

In order to achieve the above object, the present invention can provide a recording medium recording a program for implementing the authoring method for synchronization of motion pictures and motion.

According to the recording medium which records the authoring method for synchronizing motion with motion picture proposed in the present invention, and a program for implementing the method, a motion picture motion synchronization program is loaded in a video editing program such as a conventional video editor. Then, by providing a motion list so that the user can select various kinds of motions, the user can designate each frame of the video to insert and synchronize a desired motion with a simple click, thereby making the operation very easy.

In addition, the recording medium recording the authoring method and the program for implementing the method for synchronizing the motion picture and motion according to the present invention, the result of the work of synchronizing the motion picture and motion using a method similar to the file format processing subtitles Is saved as a separate motion information file, the signal can be generated to drive or control the actual system by converting the motion information file into a specific command, so even one motion information file can be utilized in various systems through the conversion operation. The result of the synchronized work can be easily databased.

1 is a flow chart of an authoring method for synchronizing motion with video according to an embodiment of the present invention.
2 is a diagram illustrating a screen for receiving a system type from a user in an authoring method for synchronizing a video with a motion according to an embodiment of the present invention.
3 is a diagram illustrating a screen displaying a motion list in an authoring method for synchronizing a video and a motion according to an embodiment of the present invention;
4 is a diagram illustrating a screen displaying a motion list in an authoring method for synchronizing a video and a motion according to an embodiment of the present invention.
FIG. 5 is a view showing contents stored in a motion information file of an authoring method for synchronizing motion with a video according to an embodiment of the present invention; FIG.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. However, in describing the preferred embodiment of the present invention in detail, if it is determined that the detailed description of the related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. The same or similar reference numerals are used throughout the drawings for portions having similar functions and functions.

In addition, throughout the specification, when a part is 'connected' to another part, it is not only 'directly connected' but also 'indirectly connected' with another element in between. Include. In addition, the term 'comprising' of an element means that the element may further include other elements, not to exclude other elements unless specifically stated otherwise.

1 is a flowchart of an authoring method for synchronizing a video with a motion according to an embodiment of the present invention. As shown in FIG. 1, the authoring method for synchronizing motion with a video according to an embodiment of the present invention includes storing a plurality of motions (S100), for a system type that can be driven for each motion. Storing information (S200), receiving a system type to be driven or controlled by the user (S300), receiving and playing a video for synchronizing motions (S400), and a user selecting a specific motion among a plurality of motions. Displaying a motion list to the user to select a step (S500), receiving a specific motion selected by the user from the motion list (S600), and receiving a sink position of the video to synchronize the received specific motion to the video. (S700), the step of synchronizing a specific motion received at the sink position (S800), repeating steps S600 to S800 at least one in the video After synchronizing the above motions, generating a motion information file including the synchronized sync position, the type of motion (S900), and using a specific interface based on the system type, the motion information file is divided into various And switching to a command signal that can be directly applied to driving or controlling the system (S1000).

In step S100, a plurality of motions are stored. Motion includes chair vibration, tilt left, forward tilt, and up and down movement, and for robots with controllable limbs, lifting the left arm, bending the knee, walking forward, and balancing with the left foot. Of course, in addition to the motion mentioned, any type of motion can be stored, including the user's five senses.

In step S200, information about a system type that can be driven for each motion is stored. In one embodiment, in the case of lifting the left arm, it cannot be driven in a chair but only in a robot with a controllable arm. Thus, lifting the left arm can store information about a robot with controllable arms. Of course, one system type does not correspond to one motion. In one embodiment, in the case of vibration, since both the chair and the robot can be driven, the vibration can store both information about the chair and the robot.

In step S300, a system type to be driven or controlled is received from a user. The step S300 will be described in detail with reference to FIG. 2.

2 is a diagram illustrating a screen for receiving a system type from a user in an authoring method for synchronizing a video with a motion according to an embodiment of the present invention. As shown in FIG. 2, a user may enter a chair, robot or other system type. If the user directly inputs the system type as a character, it may cause a problem in recognizing the classification of the system type. Thus, by providing a button for each system type, the user may select a specific system type. At this time, the applicable motion list may be automatically updated according to the system type input by the user.

In step S400, a video for synchronizing motion is received and played. The input video does not limit the extension, playback time and file size, and can be played if it contains video information. At this time, the user can play the video in a size large enough to recognize the movement in the video.

In operation S500, the motion list is displayed to the user so that the user can select a specific motion from among the plurality of motions. In this case, the applicable motion list may be automatically updated according to the system type input by the user in step S300. The step S500 will be described in detail with reference to FIGS. 3 and 4.

3 and 4 are views illustrating a screen displaying a motion list in an authoring method for synchronizing motion with a video according to an embodiment of the present invention. As shown in FIG. 3, when the user selects the robot as the system type, the motion list includes various types of motions such as lifting the left arm forward, lifting the right arm forward, lifting the left foot forward, lifting the right foot, shaking the head, and vibration for 10 seconds. Include. In this case, for each user's convenience, each motion module such as an arm, a leg, and a head may be classified and displayed. Therefore, the user can easily select a specific motion to synchronize while checking the video.

Alternatively, as shown in FIG. 4, the authoring method for synchronizing a video with a motion according to an exemplary embodiment of the present invention provides a motion list to a user in a manner of arranging icons showing motion pictures corresponding to each motion. I can display it. The similarity of characters such as arms and feet prevents the user from confusing motion choices, and expresses each motion in the form of pictures so that the user can quickly understand the motion driven by the motion. At this time, the icon for the motion that the user frequently uses is displayed on the top so that the user can conveniently select the motion.

In operation S600, a specific motion selected by the user is received from the motion list. While the video is playing, the user may select a specific motion in a frame to synchronize the motion and then press an additional button to synchronize the specific motion. For the convenience of the user, it is possible to select a specific motion in both the state in which the video is being played and the state in which the video is paused.

In operation S700, a sync position of a video for synchronizing an input specific motion with a video is received. The sync position is synonymous with the sync position used when inserting subtitles. Although the sink position may be directly input by the user, it is preferable for the user's convenience to automatically receive the sink position when the user inputs a specific motion in step S600. Therefore, step S600 and step S700 may be performed at the same time.

In step S800, the specific motion received at the sink position is synchronized. A plurality of specific motions may be synchronized to one sync position. In one embodiment, the robot can implement lifting the left arm forward and lifting the right foot at the same time. During the synchronization process, when the video is played, the subtitles can be displayed when the video is played so that the user can immediately check the result.

In step S900, after repeating steps S600 to S800 to synchronize at least one or more motions to the video, a motion information file including the sync position and the type of motions to which the motions are synchronized is generated. The operation S900 will be described in detail with reference to FIG. 5.

FIG. 5 is a diagram illustrating contents stored in a motion information file of an authoring method for synchronizing a video with a motion according to an embodiment of the present invention. FIG. As shown in FIG. 5, the motion information file of the authoring method for synchronizing motion with a video according to an embodiment of the present invention may include basic information and motion information, and the sync information corresponds to the sync time. At least one motion content may be included. However, the motion content may be coded and stored for recognition in a computer. Since the motion information file uses the same structure as the subtitle file, the user can easily grasp the synchronization result of the video and the motion through the motion information file. In addition, since the motion information file has a uniform format, a user can database a plurality of motion information files with great convenience.

In step S1000, the motion information file is converted into a command signal that can be directly applied to driving or controlling various types of other systems using a specific interface based on the system type. As the system types vary, the types of command signals used for the system types also vary. Therefore, in order to convert the motion information file into a command signal that can be directly applied to the driving or control of each system, it is necessary to use a specific, highly scalable interface.

The specific interface converts the motion, which is the result of the motion information file, into actual instructions according to the controller type of the PLC of each system. For this purpose, the specific interface may include specific hardware that is responsible for electrical signal conversion and specific software that is responsible for software signal conversion. In this case, the specific interface may convert the motion information file into a protocol file suitable for each system, and then transfer an appropriate driving signal to each system using the converted protocol file.

In operation S1000, however, the motion information file may include a motion that cannot be converted in the process of converting the motion information file into a command signal. Thus, the motion is excluded from switching to the command signal, but the user confirms that the conversion is excluded. You can send a guide message so that you can.

Finally, a recording medium recording a program for implementing a method for authoring a video and motion synchronization according to an embodiment of the present invention is a small flash memory that can be read by being inserted into a computer, an internal or external hard disk, or an electronic device. Can be. Of course, if the program plays a role in recording, any recording medium can be used.

The present invention described above may be variously modified or applied by those skilled in the art, and the scope of the technical idea according to the present invention should be defined by the following claims.

S100: storing a plurality of motions
S200: storing information about a system type that can be driven for each motion
S300: step for receiving a system type to be driven or controlled from the user
S400: step of receiving and playing a video for synchronizing motion
S500: displaying a list of motions to the user so that the user can select a specific motion among a plurality of motions
S600: step of receiving a specific motion selected by the user from the motion list
S700: step for receiving a sink position of the video for synchronizing the inputted specific motion to the video
S800: synchronizing a specific motion received at the sink position
S900: generating a motion information file including the synchronized sync position and the type of motion
S1000: converting the motion information file into a command signal that can be directly applied to driving or controlling the system based on the system type

Claims (5)

(1) storing a plurality of motions;
(2) receiving and playing a video for synchronizing motion;
(3) displaying a motion list to the user so that the user can select a specific motion among the plurality of motions;
(4) receiving a specific motion selected by a user from the motion list;
(5) receiving a sync position of the video to synchronize the received specific motion to the video;
(6) synchronizing the received specific motion to the sink position; And
(7) repeating steps (4) and (6) to synchronize at least one or more motions to the video, and then generating a motion information file including the sync position and the type of motion to which the motions are synchronized; Authoring method for synchronizing motion with the video, characterized in that it comprises a.
The method of claim 1, wherein in step (3),
A motion method for synchronizing motion with a video, characterized in that for displaying the motion list to a user in a manner of arranging icons showing motion pictures corresponding to each motion.
The method of claim 1,
Storing information about a system type that can be driven for each motion; And
The method may further include receiving a system type to be driven or controlled by the user.
In the step (3), the method for authoring a video and motion synchronization, characterized in that for displaying a list of motions that can be driven according to the input system type to the user.
The method of claim 1,
And converting the motion information file into a command signal that can be directly applied to driving or controlling the various other systems using a specific interface based on the system type. Authoring method for.
A recording medium recording a program for implementing an authoring method for synchronizing motion picture and motion according to any one of claims 1 to 4.

Images