KR101459701B1 - Method for creating music video contents at a sensor attached device - Google Patents

Abstract

The present invention provides a method for generating a music video in a terminal capable of detecting motion.
The present invention relates to a method and apparatus for playing back music, controlling a display by changing a character or a background screen displayed on the terminal screen as the terminal senses its movement, recording the display change to generate a video, By combining the video material with the background music to generate a music video, a music video is generated in the terminal.
As described above, a device capable of sensing three-dimensional motion of a terminal, for example, a sensor, a button, or a terminal with a touch screen is more dynamically You can create music videos. Then, the generated music video can be actively distributed through a streaming server, a third party server, an e-mail server, and a messenger server.

Description

[0001] METHOD FOR CREATING MUSIC VIDEO CONTENTS [0002] AT A SENSOR ATTACHED DEVICE [0003]

The present invention relates to a method for generating a music video in a terminal. In particular, the present invention relates to a method for generating a music video in a terminal capable of sensing three-dimensional movement of the terminal.

As the spread of personal computers becomes more common and the operation of personal computers becomes easier, content production and distribution by personal computer users is becoming common, and this tendency is also being extended to portable terminal users.

Recently, portable terminal users tend to produce and distribute contents of their own terminals. Therefore, users want to easily produce contents using terminals, and it is necessary to design a method accordingly. That is, there is a growing need for an application that allows a user to easily create content using the functions of portable terminals. Particularly, since a gyroscope sensor or a touch screen capable of sensing three-dimensional movement is attached to the portable terminal , There is a growing need for an application that can more easily produce content using the sensor or the touch screen.

An object of the present invention is to effectively produce a music video in a terminal capable of sensing three-dimensional motion of a terminal.

Another object of the present invention is to generate a music video at low cost by using a sensor, a button, and a touch screen attached to the terminal, without needing to add another device.

Another object of the present invention is to make it possible to easily distribute a music video to another user by transmitting the music video produced by the user himself / herself to a streaming server or a third party server or transmitting the music video through an e-mail or a messenger.

The present invention relates to a method for generating a music video in a terminal, the method comprising the steps of: playing back music played on the terminal; Detecting movement of the terminal; Controlling a display of the terminal by displaying a previously stored character image and modifying the character image according to movement of the terminal to operate the character; Recording a motion of the character to generate a video image; And combining the video with the background music to generate a music video.

The controlling the display of the terminal may include: controlling an operation of a character displayed on the terminal; And controlling a change of a background screen displayed on the terminal, wherein the character image or the background screen may include a picture taken by a user of the terminal using the terminal.

Also, the sensing of the movement of the terminal senses movement of the terminal by using a sensor attached to the terminal, or by clicking a button of the terminal or by touching a touch screen of the terminal, A scope sensor or a G sensor.

Further, the step of controlling the display of the terminal may further include obtaining from the operation library the operation of the character or the change of the background screen according to the movement of the terminal, wherein the operation library matches the motion of the terminal And a control value for controlling relative movement of the plurality of control coordinates mapped to the character image.

At this time, one or more operation libraries exist, and an operation library in which an operation of the character matched to the motion of the terminal is obtained may be selected by the user of the terminal from among the one or more operation libraries.

And the operation library may be received from a server or another terminal.

The operation library may be editable by a user of the terminal.

The method may further include transmitting the generated music video to a server or another terminal.

In addition, the transmitting may include transmitting the generated music video to a server or another terminal through a short distance communication.

Or transmitting the generated music video to the streaming server; Receiving a URL from the streaming server, the URL accessible to the music video; And transmitting the URL to a server or another terminal.

According to another aspect of the present invention, there is provided a terminal for generating a music video, comprising: a music playback unit for playing background music; Wherein the motion detection unit includes a sensor, a button or a touch screen, and the movement detection unit detects movement of the terminal through sensing of the sensor, clicking of the button, or touch input of the touch screen A motion detection unit detecting the motion of the subject; A controller for modifying a character image displayed on a display of the terminal according to movement of the terminal to operate the character; A display unit for recording a change of the display to generate a video, combining the video with the background music to generate a music video, and displaying the music video on the terminal.

And an operation library storing one or more operation libraries for storing a control value or a change of a background screen for controlling a relative movement of a plurality of control coordinates mapped to the character image matching the movement of the terminal , The control unit may change the character and the background screen according to the operation library obtained from the storage unit.

The terminal may further include a transmitter for transmitting the generated music video to a server or another terminal.

INDUSTRIAL APPLICABILITY The present invention has the effect of easily producing a music video in a terminal capable of sensing three-dimensional movement of the terminal.

Further, the present invention has an effect of generating a music video at a low cost by using a sensor attached to the terminal, a button, or a touch screen, without needing to add another device.

In addition, the present invention has an effect that the music video produced by the user himself / herself can be easily transmitted to other users by transmitting the music video to a streaming server or a third party server or transmitting the music video through an e-mail or a messenger.

1 is a view of an overall system according to an embodiment of the present invention.
2 shows a block diagram of a terminal according to a preferred embodiment of the present invention.
3 is a flowchart illustrating an operation of a terminal according to a preferred embodiment of the present invention.
Figures 4-6 illustrate an example of music video generation, in accordance with a preferred embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the following embodiments of the present invention may be modified into various other forms. It is to be understood that the scope of the present invention is not limited to the embodiments described below, but includes all transformations, equivalents, and alternatives falling within the scope and spirit of the present invention.

The term "terminal " in the present invention refers to any type of known portable device. For example, the terminal includes a mobile phone, a smart phone, a notebook computer, a personal digital assistant (PDA), and a portable multimedia player (PMP).

The term "sensor" in the present invention refers to a sensor capable of sensing the movement of a device to which the sensor is attached, and the sensor may be any known sensor, for example, a gyroscope sensor, . Particularly, the sensor according to the present invention detects movement in three dimensions, for example, a moving distance of a terminal, and the like, as well as sensing movement in the acceleration, A gyroscope sensor.

Further, the "music video" in the present invention includes all possible types of video clips that add images matching music, and the "character" in the present invention is a character appearing in the video, Refers to possible objects and includes all types of images that can be visualized on the display screen of the terminal, such as photographs or pictures. Particularly, the character image can be modified in various ways so that the character can operate in various ways. For example, a plurality of control coordinates are mapped to a character image, and divided into respective areas surrounded by three or more control coordinates , The character image can be transformed by enlarging, reducing, deforming, rotating, and moving each of the divided regions according to the relative movement between the control coordinates. Here, the character image may be two-dimensional or three-dimensional.

The " background screen " in the present invention is a background in a video, which can be changed by a user and includes all types of images that can be displayed on a display screen of the terminal, such as a photograph or a picture.

1 is a view of an overall system according to a preferred embodiment of the present invention. The system includes a terminal 200, a network 100, a streaming server 110, a third party server 120, an e-mail server 130, and a messenger server 140.

The terminal 200 is a terminal implemented to generate music video and through a network 100 in communication with a streaming server 110, a third party server 120, an email server 130, a messenger server 140, And can transmit its own music video to the servers. The specific configuration of the terminal 200 will be described later with reference to Fig.

Meanwhile, the network 100 refers to any type of communication network capable of communication, and may be an Ethernet or the Internet, and may include a router, a gateway, and the like. The network 100 supports communication between the streaming server 110, the third party server 120, the e-mail server 130, and the messenger server 140 and the terminal 200, Or wireless.

The streaming server 110 is a computer system capable of providing communication services. The streaming server 110 is a computer system capable of providing communication services. The third party server 120 provides a web service according to its purpose, for example, a blog service, a search service, a community service, and the like The e-mail server 130 refers to a server implemented to provide an e-mail service, and the messenger server 140 refers to a server configured to support data communication between terminals.

2 shows a block diagram of a terminal 200 according to a preferred embodiment of the present invention. The terminal 200 includes a music reproducing unit 210, a motion sensing unit 220, a control unit 230, an operation library storage unit 240, a display unit 250, and a transmission unit 260.

The music reproduction unit 210 reproduces the background music of the music video to be generated by the user. When the user of the terminal wishes to generate a music video, the music playback unit 210 starts playback of the background music, and ends the playback of the background music when the user wishes to end the music video generation.

Meanwhile, the motion sensing unit 220 senses the motion of the terminal 200. The motion detection unit 220 generally includes a sensor, in particular, a gyroscope sensor, and detects movement of the terminal 200 using the sensor. Of course, in addition to the motion detection using the sensor, the motion sensing unit 220 can detect the motion of the terminal 200 through a click of a button included in the terminal. Also, when the terminal's screen is a touch screen, The user can sense the movement of the terminal 200 by touching the touch screen. In addition to sensing the motion of the terminal 200, the motion sensing unit 220 determines what the motion is specifically and transmits the motion to the controller 230.

On the other hand, the controller 230 allows the music player 210 to reproduce the background music when the user of the terminal 200 wants to generate music video. The control unit 230 acquires data from the operation library storage unit 240 according to the operation of the terminal sensed by the motion sensing unit 220 and displays the character displayed on the display unit 250 on the basis of the data And controls the operation, appearance, background screen, and the like. In addition, the control unit 230 transmits the generated music video to the system outside the terminal 200 through the transmission unit 260.

Meanwhile, the operation library storage unit 240 stores one or more operation libraries, and transmits the operation of the character to the control unit 230 based on the movement of the terminal transmitted through the control unit 230. In this regard, the operation library stores, in addition to the operation of the character according to the movement of the terminal, a change in the background of the screen where the character appears, a background shake, and a relative movement of the character and the background. Such an operation library may be a default operation library that stores the basic operation of the character for every possible number of terminal motions detectable by the motion sensing unit 220, may be a user defined operation library, Or may be an operation library received from another terminal or a server. In particular, with respect to the motion of the character, the motion library includes control values for a plurality of control coordinates mapped to the character image to control the character. That is, for example, a plurality of control coordinates may be mapped to a character image, and by including values for relative position changes of respective control coordinates corresponding to terminal movement in the operation library, Coordinates move in accordance with the operation library, and a plane formed by linearly connecting a plurality of control coordinates (for example, a triangle plane formed by linearly connecting at least three control coordinates) It may be moved, transformed, rotated, enlarged or reduced together with movement. Accordingly, the character image is transformed so that the character can operate according to the movement of the terminal. That is, the operation library includes control values for moving, transforming, rotating, enlarging, and reducing the character image.

In this regard, the operation library storage unit 240 may include an operation library generation unit (not shown). The operation library generation unit supports the user to create an operation library. For example, a user can support editing of an existing motion library, and a user can also replace an existing character or wallpaper stored in an existing motion library with a picture taken using a camera of the terminal . If the operation library generation unit supports to replace the character or background screen with a picture, the operation library generation unit analyzes the pose of the person in the picture, the saturation and chromaticity of the background screen, Or to allow the user to create a motion library such that the motion of a particular picture and the terminal is directly matched one to one. In addition, the operation library generation unit may map control coordinates for character control to a portrait image of a photograph so that a music video can be generated using a character in the photograph as a character.

On the other hand, the display unit 250 displays the character and the background screen to the user of the terminal, and displays the behavior of the character or the change of the background screen to the user according to the motion of the terminal. In addition, the display unit 250 includes a recording unit (not shown) and a coupling unit (not shown). The recording unit records video on the screen of the display unit 250, Combine recorded video with background music. The display unit 250 may transmit the recorded music video to the transmitting unit 260 and transmit the music video to another terminal or server.

Meanwhile, the transmitting unit 260 distributes the music video generated by the terminal to another terminal or server. The transmitting unit 260 can directly distribute the music video contents to the target terminal. The transmitting unit 260 may also distribute the music video contents by transmitting the music video contents to the streaming server 110 and then transmitting the URL received from the streaming server 110 to the target terminal or the server.

3 is a flowchart of a music video generation in a terminal according to a preferred embodiment of the present invention. When the music video generating process is started, first, the music reproducing unit 210 starts to reproduce the background music of the music video (step 310). When the motion detection unit 220 detects motion of the terminal (step 320), it defines the motion of the terminal and acquires the motion of the character and the change of the background screen from the motion library according to the motion of the terminal. Based on the obtained information, the display screen is changed, that is, the operation of the displayed character, the display background, and the like are changed (step 330). This change in display is recorded and combined with background music to create a music video clip (step 340). The series of steps 320 to 340 is repeated until the playback of the background music is terminated. When the music playback unit 220 notifies the control unit 230 that the playback of the background music is terminated, the control unit 230 Ends the series of steps and stores the generated video clips as one music video. If necessary, the music video can be distributed to a target terminal or a server.

Hereinafter, an embodiment of generating a music video in a terminal capable of detecting motion will be described with reference to FIGS. 4 to 6. FIG. For the sake of convenience, the motion recognizable by the terminal in the above embodiment is a motion in which the terminal tilts to the right (hereinafter referred to as' motion 1 ') and a motion in which the terminal moves upward (hereinafter referred to as' Motion 2 '), and touch input detection (hereinafter, referred to as' motion 3') on the touch screen of the terminal. 4, the operation library storage unit 240 of the mobile terminal includes an operation library 1 and a motion library 2 storing motion, background, and effects of the character corresponding to the motion 1, motion 2, and motion 3, 2 is stored. In the case of the motion library 1, the character is allowed to perform the right-handed motion for the motion 1, and the character is allowed to perform the jump motion for the motion 2, so that the firecracker is fired on the background of the display screen, The background image is changed to the background image in which the heart is drawn around the character. In the case of Motion Library 2, for the motion 1, the character is moved to the right, while for the Motion 2, the character performs the motion for both hands, and "ye!" And motion 3 is changed to the default background screen of the background screen.

When the background music reproduction starts, the user of the terminal as described above moves the terminal once toward the right and moves up once according to the music. Touch the touch screen of the terminal once. In response to the movement of the terminal, the terminal senses the movement of the terminal in the order of the movement 1, the movement 2 and the movement 3 through the movement detection unit, and the operation of the character and the change of the background screen according to the movement 1 to the movement 3, And displays it on the display unit of the terminal, as shown in Figs. 5 and 6. Fig. At this time, the user can select whether to control the movement of the character according to which of the operation library 1 or the operation library 2. If the user does not select it, the operation library 1 can be selected as the default operation library. FIG. 5 shows a display screen of the terminal when the user selects the operation library 1, and FIG. 6 shows the display screen of the terminal when the user selects the operation library 2.

The terminal records the change of the display screen as described above and combines it with the background music to generate a music video clip. The terminal continuously detects the movement of the terminal until the reproduction of the music ends and changes the display screen accordingly, and records the change and combines with the background music. The music video thus generated may be transmitted to another terminal or server using short-range wireless communication or another possible wireless communication network, or may be transmitted to a streaming server or a third party server and transmitted to an email server or a messenger server . The above-described embodiment is merely an example for explaining the present invention concretely, and the present invention is not limited to these embodiments.

Those skilled in the art will appreciate that the various illustrative logical blocks and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. In order to clearly illustrate this alternative possibility of hardware and software, various exemplary steps have been described above primarily in terms of their functionality. Whether such functionality is implemented in hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the present invention as defined by the appended claims. Substitutions, and other modifications may be made without departing from the spirit and scope of the invention.

100: network 110: streaming server
120: Third party server 130: Email server
140: messenger server 200: terminal
210: Music playback unit 220:
230: control unit 240: operation library storage unit
250: display unit 260:

Claims (9)

A method for generating a music video in a portable terminal, the method comprising:
Playing background music;
Sensing a movement of the mobile terminal using at least one of a sensor-gyroscope sensor, a G sensor, and a touch screen attached to the portable terminal while the background music is being reproduced;
Displaying a pre-stored character image;
Obtaining a change in the operation of the character corresponding to the defined operation from the operation library after defining the operation of the movement of the portable terminal;
Controlling the display of the portable terminal by modifying the character image to operate the character according to the change in the operation of the character obtained;
Generating a video image by recording a screen change displayed on the display; And
Combining the video material with the background music to generate and store the music video,
Wherein the operation library includes a control value for controlling relative movement of a plurality of control coordinates mapped to the character image to match the motion of the portable terminal. The method according to claim 1,
The step of controlling the display of the portable terminal includes:
Controlling a change of a background screen displayed on the portable terminal,
The character image or the background screen is displayed on the screen,
The method of claim 1, wherein the step of displaying the music video comprises the steps of: The method according to claim 1,
Wherein the operation library includes at least one operation library and the operation of the character matched to the motion of the portable terminal is obtained includes a music video selected by the user of the portable terminal among the at least one operation library, Generation method. The method according to claim 1,
Wherein the operation library is received from a server or another portable terminal. The method according to claim 1,
Wherein the operation library is editable by a user of the portable terminal. The method according to claim 1,
And transmitting the generated music video to a server or another portable terminal. The method according to claim 6,
Wherein the transmitting comprises:
Transmitting the generated music video to a streaming server;
Receiving a URL from the streaming server, the URL accessible to the music video; And
And transmitting the URL to a server or another portable terminal. A portable terminal for generating a music video,
A music player for playing background music;
A gyroscope sensor, a G sensor, and a touch screen attached to the portable terminal while the background music is being reproduced;
Wherein the mobile terminal is configured to define a motion of the mobile terminal sensed by the motion sensing unit and to acquire a change in the motion of the character corresponding to the defined motion from the motion library, A control unit for controlling a screen displayed on a display unit by modifying an image to operate a character;
A display unit displaying a previously stored character image and modifying and displaying the character image under the control of the control unit;
A recording unit for recording a screen change displayed on the display unit and generating a video image; And
And a combining unit for generating and storing a music video by combining the video material generated by the recording unit with the background music,
Wherein the operation library includes a control value for controlling a relative movement of a plurality of control coordinates mapped to the character image in accordance with a motion of the portable terminal. 9. The method of claim 8,
And a transmitting unit for transmitting the generated music video to a server or another terminal.

Images