KR20120011770A - Method for creating music video contents at a sensor attached device - Google Patents

Abstract

PURPOSE: A method for generating a music video in a terminal with a sensor is provided to inexpensively generate a music video using a sensor, a button, or a touch screen attached to a terminal. CONSTITUTION: A music player(210) plays a background music. A motion sensing unit(220) senses motion of a terminal by a sensor, a button, or a touch screen. A controller(230) operates a character by changing a character image displayed on a display of the terminal according to the motion of the terminal. A display unit(250) generates a video by recording a change of the display.

Description

How to create a music video on a device with a sensor {METHOD FOR CREATING MUSIC VIDEO CONTENTS AT A SENSOR ATTACHED DEVICE}

The present invention relates to a method for generating a music video in a terminal. In particular, the present invention relates to a method for generating a music video in a terminal capable of sensing a three-dimensional movement of the terminal.

As the dissemination of personal computers has become common and operations on personal computers have become easier, the production and distribution of contents by personal computer users has become common, and this trend has been extended to portable terminal users.

Recently, portable terminal users tend to produce and distribute the contents of the terminal directly. Therefore, users want to easily create contents using the terminal, and accordingly, a method of a method has been required. That is, the necessity of an application that allows a user to easily create content using the functions of portable terminals is increasing. In particular, as a gyroscope sensor or a touch screen that detects three-dimensional movement is attached to the portable terminal, Increasingly, there is a growing need for an application that can easily produce content using the sensor or the touch screen.

An object of the present invention is to efficiently produce a music video in a terminal capable of sensing a three-dimensional movement of the terminal.

In addition, an object of the present invention is to generate a music video at a low cost by using a sensor, a button, or a touch screen attached to a terminal without adding another device.

In addition, an object of the present invention is to make it easy to distribute a music video to other users by transmitting the music video produced by the user to a streaming server or a third party server, or via an email or a messenger.

The present invention provides a method for generating a music video in a terminal, the method being performed in the terminal and playing background music; Detecting a movement of the terminal; Controlling the display of the terminal by displaying a character image stored in advance and modifying the character image according to the movement of the terminal to operate the character; Generating an image by recording the motion of the character; And generating a music video by combining the video material with the background music.

The controlling of the display of the terminal may include controlling an operation of a character displayed on the terminal; And controlling a change of the background screen displayed on the terminal, wherein the character image or the background screen may include a picture taken by the user of the terminal using the terminal.

The detecting of the movement of the terminal may include detecting a movement of the terminal by using a sensor attached to the terminal, clicking a button of the terminal, or touching a touch screen of the terminal. It may also include a scope sensor or a G sensor.

The controlling of the display of the terminal may further include acquiring a change of the character or a change of the background screen according to the movement of the terminal from an operation library, wherein the motion library matches the movement of the terminal. It may include a control value for controlling the relative movement of the plurality of control coordinates mapped to the character image.

In this case, one or more motion libraries exist, and a motion library in which motions of the character matching the movement of the terminal are obtained may be selected by the user of the terminal from among the one or more motion libraries.

The operation library may be received from a server or another terminal.

In addition, the operation library may be editable by a user of the terminal.

The method may further include transmitting the generated music video to a server or another terminal.

In addition, the transmitting may include transmitting the generated music video to a server or another terminal through short-range communication.

Alternatively, the transmitting may include transmitting the generated music video to a streaming server; Receiving a URL from the streaming server that can access the music video; And transmitting the URL to a server or another terminal.

Meanwhile, the present invention provides a terminal for generating a music video, comprising: a music player for playing background music; A motion detecting unit for detecting a movement of the terminal, comprising a sensor, a button or a touch screen, wherein the motion detecting unit detects the movement of the terminal through detection of the sensor, click of the button, or touch input of the touch screen. Sensing, a motion detecting unit; A controller configured to operate a character by modifying a character image displayed on a display of the terminal according to the movement of the terminal; The display unit may include a display unit for generating an image by recording the change of the display, and generating the music video by combining the image with the background music and displaying the image on the terminal.

And a motion library storage unit including one or more motion libraries storing changes in a control value or a background screen for controlling relative movement of a plurality of control coordinates mapped to the character image in response to movement of the terminal. The controller may change the character and the background screen according to the motion library obtained from the storage.

The terminal may further include a transmission unit for transmitting the generated music video to a server or another terminal.

The present invention has an effect of easily producing a music video in a terminal capable of sensing a three-dimensional movement of the terminal.

In addition, the present invention has the effect of generating a music video at a low cost by using a sensor, a button, or a touch screen attached to the terminal without adding another device.

In addition, the present invention has an effect that the music video can be easily distributed to other users by transmitting the music video produced by the user to a streaming server or a third party server or via an email or a messenger.

1 is a view of the overall system according to an embodiment of the present invention.
2 is a block diagram of a terminal according to a preferred embodiment of the present invention.
3 is a flowchart illustrating operations of a terminal according to an exemplary embodiment of the present invention.
4 to 6 illustrate an example of music video generation according to a preferred embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiments of the present invention illustrated below may be modified in various other forms. That is, the scope of the present invention is not limited to the embodiments described below, and it should be understood that the present invention includes all the transformations, equivalents, and substitutes included in the spirit and technical scope of the present invention.

"Terminal" in the present invention refers to any type of known device that is portable. For example, terminals include mobile phones, smart phones, notebook computers, personal digital assistants (PDAs), portable multimedia players (PMPs), and the like.

In addition, the term "sensor" in the present invention refers to a sensor capable of detecting the movement of the device to which the sensor is attached, and the sensor refers to all known sensors such as a gyroscope sensor, a G sensor, and the like. Include. In particular, the sensor of the present invention, as well as the acceleration, the horizontal, vertical movement of the terminal attached to the sensor, as well as the three-dimensional movement that occurs in three dimensions, for example, the movement distance of the terminal can be detected. It can be a gyroscope sensor.

In addition, the "music video" in the present invention includes all possible types of video clips, which adds a video matching with the music, and the "character" in the present invention is a character appearing in the video and adjusted by the user. It refers to a possible object, and includes all types of images that can be visualized on the display screen of the terminal such as a picture or a picture. In particular, the character image can be transformed in various ways so that the character can operate in various ways. For example, a plurality of control coordinates are mapped to the character image, and divided into respective regions surrounded by connecting three or more control coordinates linearly with each other. In accordance with the relative movement between the control coordinates, each of the divided regions may be enlarged, reduced, deformed, rotated, or moved to deform the character image. Here, the character image may be two-dimensional or three-dimensional.

In addition, the "background wallpaper" in the present invention, as a background in a video, can be changed by a user and includes all types of images that can be visualized on a display screen of a terminal such as a picture or a picture.

1 is a view of the overall system according to a preferred embodiment of the present invention. The system includes a terminal 200, a network 100, a streaming server 110, a third party server 120, an email server 130, and a messenger server 140.

The terminal 200 is a terminal implemented to generate a music video, and is provided through a network 100 that communicates with a streaming server 110, a third party server 120, an email server 130, and a messenger server 140. It can forward its music video to the servers. A detailed configuration of the terminal 200 will be described later with reference to FIG. 2.

On the other hand, the network 100 refers to all kinds of communication networks capable of communication, may be Ethernet or the Internet, and may include a router, a gateway, and the like. The network 100 supports the communication between the streaming server 110, the third party server 120, the e-mail server 130, and the messenger server 140 and the terminal 200. Or wireless.

Meanwhile, the streaming server 110, the third party server 120, the email server 130, and the messenger server 140 are computer systems capable of providing a communication service, and the streaming server 110 is a voice or video on the Internet. The third party server 120 provides a web service according to its purpose, for example, a blog service, a search service, a community service, and the like. The email server 130 refers to a server implemented to provide an email service, and the messenger server 140 refers to a server implemented to support data communication between terminals.

2 shows a block diagram of a terminal 200 according to a preferred embodiment of the present invention. The terminal 200 includes a music player 210, a motion detector 220, a controller 230, an operation library storage 240, a display 250, and a transmitter 260.

The music player 210 plays background music of a music video to be created by the user. When the user of the terminal wants to generate a music video, the music player 210 starts to play the background music, and when the user wants to end the music video, the music player ends the playback of the background music.

Meanwhile, the motion detector 220 detects the motion of the terminal 200. The motion detector 220 generally includes a sensor, in particular, a gyroscope sensor, and detects the movement of the terminal 200 using the sensor. Of course, the motion detector 220 may detect the movement of the terminal 200 by clicking a button included in the terminal, in addition to the motion detection using the sensor, and if the screen of the terminal is a touch screen, By touching the touch screen, the movement of the terminal 200 may be detected. In addition to detecting the movement of the terminal 200, the motion detector 220 determines what kind of motion the motion is specifically, and transmits the motion to the controller 230.

Meanwhile, the controller 230 causes the music player 210 to play background music when the user of the terminal 200 wants to generate a music video. In addition, the controller 230 obtains data from the motion library storage 240 according to the motion of the terminal detected by the motion detector 220, and displays the character displayed on the display 250 based on the data. Control the operation, appearance, wallpaper and more. In addition, the controller 230 transmits the generated music video to the system outside the terminal 200 through the transmitter 260.

Meanwhile, the motion library storage unit 240 stores one or more motion libraries and transmits the motion of the character to the controller 230 based on the movement of the terminal transmitted through the controller 230. In this regard, the motion library stores effects such as changes in the background of the screen on which the character appears, background shaking, and relative movement of the character and the background, in addition to the motion of the character according to the movement of the terminal. Such a motion library may be a default motion library that stores the basic motions of the character for all possible number of terminal motions detectable by the motion detector 220, may be a user-defined motion library, or It may also be an operation library received from another terminal or server. In particular, in relation to the motion of the character, the motion library includes control values for a plurality of control coordinates mapped to the character image to control the character. That is, for example, a plurality of control coordinates may be mapped to a character image, and the control library may include a value for a relative position change of each control coordinate in response to the movement of the terminal in the motion library, thereby controlling each control in response to the movement of the terminal. Coordinates move according to the motion library, and a plane formed by linearly connecting a plurality of control coordinates to each other (for example, may be a triangular plane formed by linearly connecting at least three control coordinates) of the control coordinates. It can also be moved, transformed, rotated, enlarged and reduced together as it moves. Accordingly, the character image is deformed so that the character can operate according to the movement of the terminal. That is, the motion library includes control values for moving, transforming, rotating, enlarging and reducing the character image.

In this regard, the operation library storage 240 may include an operation library generator (not shown). The action library generator supports a user to generate an action library. For example, the user can support the user to edit the existing motion library, and can also support the user to replace the existing character or wallpaper stored in the existing motion library with a picture taken using the camera of the terminal. . If the motion library generator supports replacing a character or a background with a picture, the motion library generator analyzes a pose of a person in a picture, a saturation, a chromaticity of a background screen, and the like to match the motion of the terminal one-to-one with the motion library. May be generated, or the user may directly create a motion library to match one-to-one movement of a specific picture with the terminal. In addition, the motion library generator may map control coordinates for character control to a person image of the picture in order to generate a music video using the person in the picture as a character.

On the other hand, the display 250 displays the character and the background screen to the user of the terminal, and displays the movement of the character or the change of the background screen according to the movement of the terminal to the user. In addition, the display unit 250 includes a recording unit (not shown) and a coupling unit (not shown), and the recording unit records the video displayed on the screen on the display unit 250 as a video, and the coupling unit, Combine recorded video with background music. The display unit 250 may transmit the recorded music video to the transmission unit 260 to transmit it to another terminal or server.

On the other hand, the transmitter 260 distributes the music video generated in the terminal to another terminal or server. The transmitter 260 may directly distribute the music video content to the target terminal. Also, the transmission unit 260 may distribute the music video content by transmitting the music video content to the streaming server 110 and then transmitting the URL received from the streaming server 110 to a target terminal or server.

3 is a flowchart illustrating a music video generation in a terminal according to an exemplary embodiment of the present invention. When the music video generation process is started, first, the music player 210 starts to play the music of the music video (step 310). When the motion detector 220 detects the movement of the terminal (step 320), the movement of the terminal is defined, and the movement of the character and the change of the background screen according to the movement of the terminal are obtained from the motion library. Based on the obtained information, the display screen is changed, that is, the motion of the displayed character, the display background, and the like are changed (step 330). This change in display is recorded and combined with the background music to create a music video clip (step 340). The series of steps 320 to 340 is repeatedly performed until the playback of the background music is finished, and when the music player 220 notifies the controller 230 that the playback of the background music is finished, the controller 230 The series of steps is completed and the generated video clips are stored as a music video as one. If necessary, the music video can be distributed to the desired terminal or server.

Hereinafter, an embodiment of generating a music video in a terminal capable of detecting a motion will be described with reference to FIGS. 4 to 6. For convenience, the movement that can be recognized by the terminal in the above embodiment is a movement of tilting the terminal to the right (hereinafter referred to as' movement 1 ') and a movement of the terminal to move upward (hereinafter,' It is assumed that there is only a motion 2 ') and a touch input detection (hereinafter, referred to as' motion 3') on the touch screen of the terminal. In addition, in the motion library storage unit 240 of the terminal, as shown in FIG. 4, the motion library 1 and the motion library storing motions, backgrounds, and effects of characters corresponding to the motions 1, 2, and 3. Assume 2 is stored. In motion library 1, for motion 1, the character raises his right hand, and for motion 2, the character jumps, while the firecracker pops on the background of the display screen. For the background, the background is changed to a background with hearts drawn around the character. In motion library 2, for motion 1, the character moves to the right, and for motion 2, the character raises both hands, while "ye!" It creates a speech bubble with the description, and changes the default wallpaper of the background screen for the movement 3.

When the user of the terminal as described above starts playing the background music, the user moves the terminal to the right once in accordance with the music and once to the top. Then touch the touch screen of the terminal once. With respect to the movement of the terminal, the terminal detects the movement of the terminal in the order of movement 1, movement 2, and movement 3 through the motion detection unit, and changes the movement of the character and the change of the background screen according to the movements 1 to 3 Obtained from the device and displayed on the display unit of the terminal, as shown in FIGS. In this case, the user may select whether to control the movement of the character according to which of the motion library 1 or the motion library 2, or if the user does not select the motion library 1 may be selected as the default motion library. In FIG. 5, the user appears on the display screen of the terminal when the user selects the operation library 1. In FIG. 6, the user appears on the display screen of the terminal when the user selects the operation library 2.

The terminal records the change of the display screen as described above and combines it with the background music to generate a music video clip. The terminal continuously detects the movement of the terminal until the music is finished playing and changes the display screen accordingly, records the change and combines it with the background music. The generated music video can be transmitted to another terminal or server using a near field communication or other possible wireless communication network, or can be transmitted to a streaming server or a third party server, or to an email server or a messenger server. Can be. One embodiment as described above is only an example for explaining the present invention in detail, the present invention is not limited to these embodiments.

Those skilled in the art may appreciate that various example logic blocks and algorithm steps described in connection with the embodiments disclosed herein may be implemented in electronic hardware, computer software, or a combination thereof. To clearly illustrate this possibility of replacing hardware and software, various illustrative steps have been described above primarily in terms of their functionality. Whether such functionality is implemented in hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but should not interpret it as causing a decision of such implementation to fall outside the scope of the present invention.

Although described above with reference to a preferred embodiment of the present invention, those skilled in the art will be added, omitted, within the scope not departing from the spirit and scope of the present invention described in the claims It will be understood that substitutions and other changes are possible.

100: network 110: streaming server
120: third party server 130: email server
140: messenger server 200: terminal
210: music player 220: motion detector
230: control unit 240: operation library storage unit
250: display unit 260: transmission unit

Claims (13)

A method of generating a music video in a terminal, which is performed in the terminal,
Playing background music;
Detecting a movement of the terminal;
Controlling the display of the terminal by displaying a character image stored in advance and operating the character by modifying the character image according to the movement of the terminal;
Generating an image by recording the motion of the character; And
And generating a music video by combining the video material with the background music. The method of claim 1,
Controlling the display of the terminal,
Controlling an operation of a character displayed on the terminal; And
Controlling a change in the background screen displayed on the terminal;
The character image or the background screen, the user of the terminal includes a picture taken using the terminal, the music video generation method in the terminal. The method of claim 1,
Detecting the movement of the terminal,
Detecting the movement of the terminal by using a sensor attached to the terminal, clicking a button of the terminal, or touching a touch screen of the terminal,
The sensor comprises a gyroscope sensor or a G sensor, the music video generation method in the terminal. The method of claim 2,
Controlling the display of the terminal,
Acquiring a change of the character's motion or a background screen according to the movement of the terminal from a motion library;
The motion library includes a control value for controlling the relative movement of a plurality of control coordinates mapped to the character image in accordance with the movement of the terminal, music video generation method in the terminal. The method of claim 4, wherein
At least one motion library exists, and a motion library in which motions of the character matched with movements of the terminal is obtained is selected by a user of the terminal among the one or more motion libraries. The method of claim 4, wherein
And the operation library is received from a server or another terminal. The method of claim 4, wherein
The operation library is editable by the user of the terminal. The method of claim 1,
And transmitting the generated music video to a server or another terminal. The method of claim 8,
The transmitting may include transmitting the generated music video to a server or another terminal through short-range communication. The method of claim 8,
The transmitting step,
Transmitting the generated music video to a streaming server;
Receiving a URL from the streaming server that can access the music video; And
And transmitting the URL to a server or another terminal. In the terminal for generating a music video,
A music player for playing background music;
A motion detecting unit for detecting a movement of the terminal, comprising a sensor, a button or a touch screen, wherein the motion detecting unit detects the movement of the terminal through detection of the sensor, click of the button, or touch input of the touch screen. Sensing, a motion detecting unit;
A controller configured to operate a character by modifying a character image displayed on a display of the terminal according to the movement of the terminal;
And a display unit for recording a change of the display to generate an image and generating the music video by combining the image with the background music and displaying the image on the terminal. The method of claim 11,
And a motion library storage unit including one or more motion libraries storing changes of a control value or a background screen for controlling relative movement of a plurality of control coordinates mapped to the character image in response to movement of the terminal.
The control unit changes the character and the background screen according to the motion library obtained from the storage unit, music video generation terminal. The method of claim 11,
And a transmission unit for transmitting the generated music video to a server or another terminal.

Images