KR20180136599A - Server, apparatus and computer program stored in computer-readable medium for providing singing service - Google Patents

Abstract

Disclosed is a karaoke service device to provide a high quality karaoke service to a user. According to one embodiment of the present invention, a server comprises: a reception module to receive a composite image generated at least partially based on a first image photographing at least a part of a user and a second image generated at least partially based on karaoke service use information, wherein the karaoke service use information includes at least one of time information, price information, information about the number of songs, and song selection information with which the user is to use the karaoke service device; a memory module to store the composite image based on user identification information, wherein the user identification information includes at least one of information of the user′s ID, information of the user′s gender, information of the user′s age, and information of the user′s residential area, and history information of a karaoke service device used by the user; and a control module to determine a category of the composite image based on either or both of the user identification information and the karaoke service use information and determine information on positions to store and share the composite image based on the determined category.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a server, a device, and a computer program stored in a computer-readable medium for providing a song service.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to the field of entertainment and, more particularly, to a server, an apparatus and a computer program stored in a computer-readable medium for providing a song service.

A song service device installed in a karaoke room stores information for implementing functions such as song selection, reservation, performance, and the like. Accordingly, when the user uses the song service device or selects the song service, the user selects the desired song using the search results displayed on the booklet or the display of the song service device, and the song service device plays the music accordingly. Korean Patent No. 10-0831410 discloses a method and system for efficiently implementing a karaoke function in a set-top box.

Moreover, recently, a culture that enjoys leisure time by going to a karaoke room or a movie theater is becoming a new trend. Furthermore, there is an active tendency to create new contents on their own without being satisfied with passive cultural consumption enjoying various contents provided on-line.

UCC (User Created Contents), which means contents created by users in accordance with this phenomenon, and PCC (Proteur Created Contents), which means contents produced by users with expert knowledge, which is a development type of UCC Is increasing. Also, as various audition programs and song contest programs through the media and the internet medium have become popular, "star" has been born on the basis of UCC and PCC as described above. Therefore, there are users who are not entertainers but want to show the same talent and ability to many people.

Accordingly, users who use the song service device require various and high-quality services for the song service device. This demand can be an improvement on the quality of music or video. Alternatively, such a request may be an enhancement to an additional service for the song that the user has singed. Such a request may be, for example, a recording file in which a recording file of a song called by the user himself or a recording file in which an image is recorded, or a song which is outputted to the display unit of the song service apparatus and is viewed while directly watching his / Sharing the video they are singing, and so on.

The combination of these functions with a song service device can enhance the value added of the song service device and provide a more entertaining environment for the user.

Accordingly, there is a need in the art to increase the entertainment factor of a song service.

There is also a growing demand in the industry for providing a variety of additional content related to song services.

The present invention has been devised in response to the above-described background art, and is intended to provide a high-quality song service to a user.

Disclosed is a server designed to solve the above-described problems. The server according to an embodiment of the present invention receives a composite image generated based at least in part on a first image captured by at least a part of a user and a second image generated based at least in part on song service utilization information Wherein the song service utilization information includes at least one of time information, amount information, grain number information, and selection information for the user to use the song service device; A memory module for storing the composite image based on user identification information, the user identification information including at least one of ID information of the user, gender information of the user, age information of the user, Song service device history information; And a control module for determining a category for the composite image based on at least one of the user identification information and the song service use information and for determining position information for storing the composite image and position information for sharing based on the determined category, ; ≪ / RTI >

Alternatively, the control module may additionally generate a user interface for allowing editing of the composite image.

Alternatively, the control module may further determine to award a score for the composite image based at least in part on feedback of other users to the composite image, wherein the feedback is based on at least one of: , The number of non-recommendation, the number of sharing, and the evaluation score given from other users.

Alternatively, the control module further determines a point for the user based at least in part on the score for the composite image and the user's song service usage information, An editing operation, a sharing operation on the composite image, and a payment information processing operation generated based at least in part on the song service usage information.

Alternatively, the control module may be further configured to, in at least one of cases where feedback of other users to the composite image is received and the point exceeds a predetermined threshold point, to the user device corresponding to the user It may decide to transmit at least one of feedback information of other users to the composite image and point information including the point.

Alternatively, the control module may further categorize one or more composite images received from the song service device based on at least one of the song service identification information of the song service device and the location information where the song service device is physically located have.

Alternatively, the control module may further execute a predetermined algorithm based on a user-selected input comprising the user's song service usage information and confrontation request information received from the song service device, Determining a confrontation partner for performing a song confrontation among a plurality of other users who are using another song service apparatus connected through the other song service apparatus, allowing the song confrontation based on whether the user and the confrontation partner received the confrontation approval, The conflicting request information includes at least one of gender information, age information, average song score information of the user, local information of a location where the song service device is located, confrontation history information of the user, ranking information of the user, Can contain at least one of the local information The.

A computer program stored on a computer-readable medium, comprising a plurality of instructions executed by one or more processors in accordance with another embodiment of the present invention, is disclosed. The computer program comprising instructions for: receiving a composite image generated based at least in part on a first image captured by at least a portion of a user and a second image generated based at least in part on song service utilization information, Wherein the information includes at least one of time information, amount information, music number information, and selection information for the user to use the song service device; And storing the synthesized image on the basis of user identification information, wherein the user identification information includes at least one of ID information of the user, gender information of the user, age information of the user, Service device history information; And determining a category for the composite image based on at least one of the user identification information and the song service utilization information, and determining location information for storing the composite image and location information for sharing based on the determined category; . ≪ / RTI >

According to an embodiment of the present invention, it is possible to provide a high-quality song service to a user.

Various aspects are now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following examples, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. However, it will be apparent that such aspect (s) may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing one or more aspects.
1 is a diagram illustrating a system in which various aspects of the present invention may be implemented.
2 is a diagram illustrating an appearance of a song service apparatus according to an embodiment of the present invention.
3 is a view showing another appearance of a song service apparatus for providing a song service to a user according to an embodiment of the present invention.
4 illustrates components of a song service device device according to an embodiment of the present invention.
5 is a flow chart of a method performed by a song service device to provide a song service to a user in accordance with an embodiment of the present invention.
6 is an exemplary diagram of a composite image that can be generated in a song service apparatus according to an embodiment of the present invention.
Figure 7 illustrates aspects of a user performing a song confrontation in accordance with one embodiment of the present invention.
Figure 8 illustrates components of a server in accordance with an embodiment of the present invention.
9 is a first example of a user interface according to an embodiment of the present invention.
10 is a second example of a user interface according to an embodiment of the present invention.
11 is a third example of a user interface according to an embodiment of the present invention.
12 is a fourth example of a user interface according to an embodiment of the present invention.

Various embodiments and / or aspects are now described with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. However, it will also be appreciated by those of ordinary skill in the art that such aspect (s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of one or more aspects. It is to be understood, however, that such aspects are illustrative and that some of the various ways of practicing various aspects of the principles of various aspects may be utilized, and that the description set forth is intended to include all such aspects and their equivalents.

As used herein, the terms "an embodiment," "an embodiment," " an embodiment, "" an embodiment ", etc. are intended to indicate that any aspect or design described is better or worse than other aspects or designs. .

In addition, the term "or" is intended to mean " exclusive or " That is, it is intended to mean one of the natural inclusive substitutions "X uses A or B ", unless otherwise specified or unclear in context. That is, X uses A; X uses B; Or when X uses both A and B, "X uses A or B" can be applied to either of these cases. It should also be understood that the term "and / or" as used herein refers to and includes all possible combinations of one or more of the listed related items.

It is also to be understood that the term " comprises "and / or" comprising " means that the feature and / or component is present, but does not exclude the presence or addition of one or more other features, components and / It should be understood that it does not. Also, unless the context clearly dictates otherwise or to the contrary, the singular forms in this specification and claims should generally be construed to mean "one or more. &Quot;

The terms "user device" and "user terminal ", as used herein, are often used interchangeably.

1 is a diagram illustrating a system in which various aspects of the present invention may be implemented.

Referring to FIG. 1, a system according to an embodiment of the present invention may include a server 100, a song service device 200, and a user device 300. As shown, the server 100 may be connected to the song service devices 200, 200a, 200b via a network, which are respectively connected to user devices 300, 300a .... and 300h, Lt; / RTI > Optionally or alternatively, the server 100 may be directly connected to the user devices 300i and 300k via a network.

According to one embodiment of the present invention, the server 100 may be associated with one or more song service devices 200 to allow the song service device 200 to provide song services. In addition, the server 100 may be associated with one or more user devices 300 to allow the user device 300 to provide content related to the song service.

The term "song service" as used herein may include an accompaniment sound that is reproduced in the song service apparatus 200. [ Further, it may be an image displayed on the song service apparatus 200. Alternatively, this "song service" may be any additional content for the song that the user has called himself. The content may be, for example, a recording file of a song called by the user himself or a recording file in which a video is recorded, or a song itself being outputted to the display unit of the song service apparatus, Sharing on the video that the user is singing, and the like, and the scope of rights of the present invention is not limited thereto.

As used herein, the term "server 100" is used to allow or allow the provision of content related to a song service that may be provided in the song service device 200 or the user device 300, in accordance with an embodiment of the present invention. do. Such a server 100 will be described later with reference to FIG.

The server 100 according to an exemplary embodiment of the present invention includes an Enterprise Application Integration (EAI) server, an Application Programming Interface (API) server, a Cash Management Service (CMS) server, an external server, a management server and / You may. 1, the user device 300 and / or the song service device 200 may be operated in connection with other servers (not shown).

The term "song service device 200" as used herein may be used interchangeably with "karaoke device" and "karaoke device ". The song service apparatus 200 according to an embodiment of the present invention includes a song service apparatus main body including a button provided in the song service apparatus 200 itself and outputting an accompaniment sound for the song corresponding to the button input, A display unit connected to the main body and outputting a background image and subtitles, and a plurality of loudspeakers for mixing and outputting the user's voice input through the microphone and the sound output from the main body. The song service apparatus 200 may further include a remote control for allowing a user to input information about a song to be sung in the vicinity of the song service apparatus 200 or to control the operation state of the main body. The exemplary description of the song service apparatus 200 as described above is merely an example according to an embodiment of the present invention, and the scope of rights of the present invention is not limited thereto. That is, the song service apparatus 200 according to the present invention may be collectively referred to as any apparatus that stores information for implementing functions such as song selection, reservation, and performance. 2 to 4 below.

According to an embodiment of the present invention, the user equipment 300 may include a user terminal, a user equipment, a mobile, a PC, a mobile phone, a kiosk, a cellular phone, a cellular, a cellular terminal, a subscriber unit, , A remote station, a PDA, a remote terminal, an access terminal, a user agent, a handheld device having a wireless connection capability, any device capable of using a wireless connection mechanism, such as a wireless modem, .

The user device 300 may also be referred to as any device capable of using a wired connection mechanism such as a wired facsimile, a PC with a wired modem, a wired telephone, a terminal capable of wired communication, and the like, but is not limited thereto .

The server 100 and the song service apparatus 200 may be connected to each other via a network to transmit and receive various information. In addition, the song service apparatus 200 and the user apparatus 300 may be connected to each other via a network to transmit / receive various information. In addition, the server 100 and the user device 300 may be connected to each other via a network to transmit / receive various information. Information that can be transmitted and received between the server 100, the song service apparatus 200, and the user apparatus 300 will be described later.

In addition, such information may be stored in a database of at least one of the server 100, the song service device 200, and the user device 300 or a computer-readable storage medium. According to an aspect of the present invention, a computer-readable storage medium may be included in at least one of server 100, song service device 200, and user device 300. Such storage media may include any type of storage medium in which programs and data are stored so that they can be read by a computer system. According to one aspect of the present invention, such medium may be a ROM (Read Only Memory), a RAM (Random Access Memory), a CD (Compact Disk) -ROM, a DVD Storage devices, and the like, and may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Additionally, such media may be distributed over networked systems and may store computer readable codes and / or instructions in a distributed manner.

According to an embodiment of the present invention, the network may be a Public Switched Telephone Network (PSTN), a Digital Subscriber Line (xDSL), a Rate Adaptive DSL (RADSL), a Multi Rate DSL (MDSL) ), Universal Asymmetric DSL (UADSL), High Bit Rate DSL (HDSL), and Local Area Network (LAN).

In addition, the network shown here can be classified into a Code Division Multiple Access (CDMA), a Time Division Multi Access (TDMA), a Frequency Division Multiple Access (FDMA), an Orthogonal Frequency Division Multiple Access (OFDMA), a Single Carrier- Various wireless communication systems such as other systems may be used.

A network according to an aspect of the present invention may be configured without regard to its communication mode such as wired and wireless, and may be configured with various communication networks such as a personal area network (PAN) and a wide area network (WAN) . In addition, the network may be a known World Wide Web (WWW) or may use a wireless transmission technology used for short-distance communication such as infrared (IrDA) or Bluetooth.

The components included in the system shown in Fig. 1 are exemplary, and only a part of the components constitute the system, or additional component (s) other than the components may be included in the system.

For example, there may be other servers not shown in the system.

It is to be understood that the singing service apparatus 200 and / or the server 100 are not limited to the server 100 and the song service apparatus 200, And performing some or all of the operations may be included in the scope of the present invention.

It is to be understood that the present invention is described herein with emphasis only on the server 100 and the user device 300. In other words, the user device 300 and / And performing some or all of the operations may be included in the scope of the present invention.

It will be apparent to those skilled in the art that, alternatively, or alternatively, that the song service device 200 and / or the user device 300 perform some or all of its operations are also within the scope of the present invention .

A server 100 for allowing a song service device to provide a song service in association with one or more song service devices in accordance with an embodiment of the present invention, Will be described.

Figure 2 illustrates components of a song service device device according to an embodiment of the present invention.

Referring to FIG. 2, components of the song service apparatus 200 as shown in FIGS. 3 to 4 will be described.

The song service apparatus 200 according to an exemplary embodiment of the present invention includes a camera unit 210, an illumination unit 210a, a user recognition unit 220, an RF module 220a, an NFC module 220b, A cash settlement module 230b, a mobile settlement module 230c, a display unit 240, a control unit 250, an image synthesizing unit 251, a chroma key unit 230c, a cash settlement module 230b, A processing unit 253, a list generation unit 255, a confrontation determination unit 257, a video format conversion unit 259, a memory unit 260, a voice processing unit 270, a reception unit 281, a user input module 281a ), A transmission unit 283, and a network unit 290.

As described above, "song service device 200" can be used interchangeably with "karaoke device" and "karaoke device ". The song service apparatus 200 according to an exemplary embodiment of the present invention may include a button provided in the song service apparatus 200 itself and may include a song service for outputting an accompaniment sound for a song corresponding to the button input, A display unit connected to the main body and outputting a background image and subtitles, and a plurality of speakers for mixing and outputting the user's voice input through the microphone and the sound output from the main body. The song service apparatus 200 may further include a remote control for allowing a user to input information about a song to be sung in the vicinity of the song service apparatus 200 or to control the operation state of the main body. The exemplary description of the song service apparatus 200 as described above is merely an example according to an embodiment of the present invention, and the scope of rights of the present invention is not limited thereto. That is, the song service apparatus 200 according to the present invention can be collectively referred to as any apparatus storing information for implementing functions such as song selection, reservation, and performance.

Accordingly, the components of the song service apparatus 200 shown in FIG. 2 are not essential, and a song service apparatus 200 having components having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The song service apparatus 200 as described above may include a camera unit 210. The camera unit 210 photographs at least a part of the user based at least in part on the song service utilization information input from the user. To this end, the camera unit 210 may be located at the center of the front upper end of the song service apparatus 200, or the camera unit 210 may be located at an outer extended position of the song service apparatus 200. In addition, the camera unit 210 as described above may include one or more cameras so that the user's image may be acquired at various angles, or an appropriate camera unit 210 corresponding to the user's movement may be selected and photographed. Here, the song service utilization information may include at least one of time information, amount information, grain number information and selection information for the user to use the song service apparatus, and the scope of rights of the present invention is not limited thereto.

When a plurality of cameras constitute the camera unit 210, at least some of the cameras of the camera unit 210 are arranged to photograph an image frame including a user, and some of the cameras are arranged to photograph an image frame As shown in FIG. For example, some of the cameras may be arranged to photograph image frames including other users who are using karaoke with the user. And may be arranged to capture image frames that are directly related to the game rules.

Also, in general, a user who uses the song service apparatus 200 stops at one place and moves to various points and sings instead of singing. Thus, in order to photograph the user, position identification for the user may be required. In this case, for example, the user's location can be identified from the location identification module included in the microphone in which the user's voice is input, and the direction of the camera unit 210 can be switched to the location of the identified user. Alternatively, another camera unit 210 adjacent to the position of the identified user may be controlled to photograph the user.

The lighting unit 210a may output a signal for notifying the occurrence of an event of the song service apparatus 200. [ Examples of the events generated in the song service apparatus 200 include a song service score, a song service start notification, a song service end notification, a confrontation approval request notification, a large circle rejection notification, a confrontation reception notification, It will be apparent to those skilled in the art that the scope of the present invention is not limited by the scope of the present invention. The illumination unit 210a may include an LED (Light Emission Diode) to inform the user of the occurrence of an event through the blinking of the LED.

The LEDs may be disposed on the back side of the song service apparatus 200, and may be blinked according to a blinking pattern stored in advance according to the occurrence of an event. For example, it may be arranged in a direction toward the outside of the song service apparatus 200, and may be blinked according to a blinking pattern stored in advance according to the occurrence of an event.

In addition, the illumination unit 210a is configured to assist the camera unit 210 to facilitate shooting with respect to the user, because the physical space in which the song service apparatus 200 is located is generally formed with low saturation. In addition, the illumination portion 210a may be configured as a flatlight that performs diffuse overall illumination and / or a spotlight that is illumination that condenses light. It may also be composed of a light other than a flat light and / or a spot light.

According to an embodiment of the present invention, the song service apparatus 200 may include a user recognition unit 220 for identifying a user. The user recognition unit 220 may include at least one of an RFID module 220a, an NFC module 220b, and a biometric data identification module 220c.

For example, the user recognition unit 220 can receive user information by recognizing remote user information using radio waves by using RFID (Radio Frequency Identification) technology, which is a kind of local area communication technology. More specifically, the user can have a card and a mobile terminal including the RFID module. Information identifying the user (e.g., a personal ID of a user registered in the database server, an identification code, etc.) may be recorded in the RFID module held by the user. The song service apparatus 200 can update a database (e.g., song use information) for the identified user or store new data by identifying the RFID module held by the user. In one embodiment of the invention, the user recognition module may be integrated into the receiving module.

In addition to the above-described RFID technology, the user recognition unit 220 may include various technologies (e.g., a local communication technology such as Bluetooth, etc.) capable of transmitting and receiving user's unique information in a contact / non-contact manner. The user recognition unit 220 may be configured to recognize the user's biometric data (voice, fingerprint, etc.) in cooperation with the microphone, touch pad, camera module, etc. of the camera unit 2100, the voice processing unit 270, the receiving unit 281, and the network unit 290, , And a biometric data identification module 220c that identifies a face (e.g., a face).

The settlement unit 230 according to the embodiment of the present invention is configured to process the settlement for using the song service apparatus 200 based at least in part on the song service use information. The settlement unit 230 may include a cash settlement module 230a, a card settlement module 230b, and a mobile settlement module 230c.

For example, the payment unit 230 may generate payment information based at least in part on the predetermined payment algorithm and the song service usage information. As another example, the payment unit 230 may generate payment information based at least in part on the predetermined payment algorithm and the song service usage information. For example, if the predetermined payment algorithm is 1,000 won for two songs and the song service use information received from the user is four songs, the payment information may be determined to be 2,000 won.

As another example, payment information may be generated based additionally on user information. For example, for users under the age of 19, payment information may be generated by a 10% discount off the total payment amount. Alternatively, such payment information may be generated on the basis of the usage history of the user. For example, when the user's total song service use time is 10 hours or more, the song service use information for calculating the payment amount may be subtracted from two songs and payment information may be generated. The foregoing is merely exemplary explanations in accordance with one embodiment of the present invention, and the scope of rights of the present invention is not limited thereto.

The payment unit 230 may determine whether payment has been completed according to the payment information, and may generate a user interface (UI) for allowing the user to input the user into the song service apparatus 200 and allow the user to use the payment service. The payment information, desired selection information, and recommended selection information may be displayed in the user interface, and the scope of rights of the present invention is not limited thereto.

The payment unit 230 may process the payment information based on the approval action of the user in cooperation with the financial server through the network. Alternatively, the control unit 250 operates in cooperation with the settlement unit 230. [ The control unit 250 can process the payment information based on the approval action of the user in cooperation with the user device 300 via the network.

In addition, the settlement unit 230 may include a tag module that inserts a chip (e.g., an NFC) capable of functioning as a payment means and allows payment like a credit card.

In addition, the settlement unit 230 according to an embodiment of the present invention may further include a settlement module for performing settlement. Such a payment module may include a cash payment module, a bank payment module, a card payment module, a mobile payment module, and an ARS payment module. For example, the mobile payment module may operate by inputting user information including a mobile phone number and a resident registration number, and then entering an authentication number into a mobile phone.

The display unit 240 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light emitting diode a light-emitting diode (OLED), a flexible display, and a 3D display. Some of the display units 240 may be transparent or light transmissive so that the display unit 240 can see the outside through the display unit 240. This may be referred to as a transparent display module, and a typical example of the transparent display module is TOLED (Transparent OLED) or the like.

In an embodiment of the present invention, there may be more than one display unit 240 depending on the implementation of the song service apparatus 200. In this regard, reference will be made to the appearance of the song service apparatus 200 shown in FIG. For example, in the song service apparatus 200, a plurality of displays may be spaced apart or arranged integrally on one surface, and may be disposed on different surfaces, respectively. For example, the display unit 240 may include a display disposed at the upper end of the song service apparatus 200, a display disposed at the lower end, or may include one of the displays. However, the position of the display unit 240 is only an example, and the display unit 240 may be disposed at various positions for design needs or visual effects.

In one aspect of the present invention, the display portion 240 may be configured with a touch screen configured to receive a user's selection input. In this case, the display module may be included in the receiving unit 281. [ Or the display unit 240 may be provided in the song service apparatus 200 instead of the receiver unit 281. [

In addition, the display unit 240 configured with a touch screen may include a touch sensor. The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 240 or a capacitance generated in a specific portion of the display unit 240 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch. If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 250. [ Thus, the control unit 250 can recognize which area of the display module is touched or the like.

Alternatively, or alternatively, the display portion 240 and the voice processing portion 270 described below may be sometimes referred to as an "output portion ". The voice processing unit 270 may include a receiver, a speaker, a buzzer, and the like. The voice processing unit 270 may output a signal for notifying the occurrence of an event of the song service apparatus 200. As an example of an event to be generated in the song service apparatus 200, there may be a start notification of a song service or the like, and various events not described may exist. In addition, the audio processing unit 270 can process the user's voice and the accompaniment sound inputted from the microphone.

The display unit 240 according to an exemplary embodiment of the present invention may output one or more of the image related to the selected music information including the caption information, the first image, the second image, and the composite image.

Also, the display unit 240 can output a third image, which is captured by at least a part of the opponent determined according to an embodiment of the present invention, which will be described later. The display unit 240 may include at least one display unit as described above. The display unit 240 may include at least one of a video related to the selected music information including the caption information, the first video, the second video, The different images can be output on the same frame or on different frames. For example, an image related to the selected music information including caption information may be output from the first display unit 240a (see FIG. 3) and a synthesized image from the second display unit 240b (see FIG. 3) have.

Further, the display unit 240 may include a user interface (GUI) for providing any one of various information transmitted and received in executing a computer program stored in a computer-readable medium for providing a song service according to an embodiment of the present invention, . For example, a user interface for performing settlement from the user may be output to the display unit 240. [ Reference is made to Fig. 6 in this regard.

The control unit 250 may perform the operations described below in unison. Or may further include components that are subdivided or linked organically as shown, allowing each component to perform the following operations. The control unit 250 may include an image combining unit 251, a chroma key processing unit 253, a list generating unit 255, a confrontation determining unit 257, and a video format converting unit 259 .

The control unit 250 may generate a composite image based at least in part on a first image photographed from the camera unit 210 and a second image generated based at least in part on the song service utilization information.

The control unit 250 may further generate the composite image by analyzing the first image, extracting each part of the user's body, and matching the second image with each part of the extracted body.

In addition, the controller 250 may further transparentize the background of the first image. In this way, even when the background where the song service apparatus 200 is located is dirty, a portion excluding the user included in the first image is made transparent, so that a higher quality composite image can be generated. Also, the control unit 250 may generate the composite image by further combining at least one of the text selected by the user and the image selected and input by the user. In this way, it is possible to allow the user to perform additional editing operations on the composite image, so that it is possible to sufficiently reflect the individual's preference in the composite image generation. It is also clear that while the entertainment aspect is enhanced in creating composite images, familiarity with other users for creating and editing composite images can be enhanced as well.

The control unit 250 may generate the composite image by adjusting the size and position of the user in the first image to synthesize the user with the second image in the first image.

Here, the second image includes at least one object to be synthesized, and the control unit 250 additionally allows the first image to be reproduced, and the object to be synthesized of the second image The synthesized image may be generated based on a user selection input for a synthesized position of the synthesized image. This composite image can be performed, for example, by the image synthesis unit 251. [

According to a further embodiment of the present invention, a composite object to be synthesized with the photographed image and a composite image with the composite object may be selected. According to a further embodiment of the present invention, such a moving image is reproduced and the combining target object can be synthesized in the moving image by designating a combining position of the combining target object on a moving image to be reproduced, for example, through a touch screen . Further, during the generation of the composite image, the composite object is displayed in an overlay form at the composite position of the composite object, and the composite result of the moving image and the composite object is displayed in a preview form . The user interface presented in this overlay and preview form may be output through the display 240 of the song service device 200 and may optionally or alternatively be coupled to a user device 300 associated with the user Lt; / RTI >

In more detail, the control unit 250 may generate a composite image based on a chroma key technique. The chroma key technique is an image synthesis method that adds special effects and text to a video program. It is the technique most commonly used to remove specific color parts and extract other elements to synthesize them with other images. An example of an image generated based on such a chroma key technique is to combine an image of a weather castor with a graphical image of a weather forecast and transmit it to a single screen.

In order to produce a composite image using a chroma key technique, a desired part of a moving image is extracted, and then the image is synthesized with a background image, a foreground image, or a background music to be synthesized. The operations as described above can be performed, for example, by the chroma key processing unit 253.

According to a further embodiment of the present invention, the control unit 250 may control at least one of the at least one second video (e.g., video) based on at least one of the number of objects photographed by the camera unit 210, And generate a second image candidate list including the determined one or more second images. For example, the operation as described above may be performed by the list generating unit 255 of the control unit 250. [ More specifically, the list generating unit 255 may output a second image candidate list including at least one second image for generating a composite image to the display unit 240 based on the identification information of the user have. For example, if the user is female, the background image of the music video of the female idol group may be included in the candidate list. As another example, if there are three users, a background image including composite objects (e.g., a mustache, cross hair, etc.) that can emphasize humor against three persons may be included in the candidate list.

Further, the control unit 250 may generate recommendation selection information for the user based at least in part on the user information input from the user. The user information includes at least one of the user's nationality information, gender information, age information, and song service usage history information, as described above. In more detail, the control unit 250 may generate recommendation selection information based on the user information of the user and the song service history information of one or more other users having user information within a predetermined similar range.

For example, a sixth user, a first user in his twenties, a second user in his thirties, a third user in his forties, a fourth user in his fifties, a male in the fifth, , A seventh user in his forties, and an eighth user in his fifties. In this case, the recommendation selection information may be generated for the first user based on the song service history information of the second user and the other twenties who have user information within the similar range of the same females. Alternatively, the recommendation selection information may be generated based on at least the song service history information of the twenties female and the song service history information of the fifth user who is male in their 20s to the first user. As another example, in consideration of the age of the parents, the recommended user selection information may be generated based on the song service history information of the fourth user who is a females in their 50s than a third user in the forties. It is to be understood that the foregoing is merely illustrative of exemplary embodiments of the present invention, and the scope of the present invention is not limited thereto.

In addition, the control unit 250 may execute a predetermined algorithm based on the user selection input including the received song service information and confrontation request information of the user so that the other song service apparatus connected to the song service apparatus via the network To determine a confrontation partner for performing a song confrontation among one or more other users in use. Here, the user's song service information includes at least one of time information, amount information, music number information, and selection information for the user to use the song service apparatus, and the scope of rights of the present invention is not limited thereto.

Also, as described above, the control unit 250 may determine a confrontation partner for performing a song confrontation based on the recommendation selection information and the like generated by the control unit 250. [ Furthermore, the control unit 250 may allow the song confrontation based on whether the user and the confrontation partner have received the confrontation. For example, the operations as described above can be performed by the opponent determination unit 257 constituting the control unit 250. [ Accordingly, the song service apparatus 200 can provide a confrontation mode including one or more confrontation partners to be confronted through the network unit 290, thereby enhancing the satisfaction of the user in using the song service.

The conflicting request information may include at least one of gender information, age information, average song score information of the user, local information of a location where the song service device is located, confrontation history information of the user, ranking information of the user, And at least one of the resident local information. In addition, when the user and the opponent perform a song confrontation, the display unit 240 may output a third video image of at least a part of the opponent opponent. Reference is made to Fig. 7 in this regard.

In addition, the control unit 250 generates payment information based at least in part on the predetermined payment algorithm and the song service use information, as described above in the payment unit 230, and determines whether or not the payment is completed based on the payment information And may allow a predetermined operation to be performed when it is determined that settlement based on the generated payment information has been completed. Wherein the predetermined operation includes at least one of an accompaniment sound reproducing operation based on the user's selection information of the song service apparatus, the composite video output operation of the display unit, and the composite video transmission operation of the network unit, It will be clear to those skilled in the art that the economic benefits of the conventional commercial service device may also occur.

The control unit 250 may further include a video format conversion unit 259 to convert the composite video into a server 100 connected to the song service apparatus 200 via a network and a user apparatus 300 corresponding to the user In order to transmit to at least one, the format of the composite image can be converted. Further, the synthesized image may be automatically converted into a SWF (ShockWave Flash) format or FLV (Flash Video) format, and then transmitted to an external portal site or stored on a recording medium so that the composite image can be re-edited later. Accordingly, it is possible to induce a connection from the user to the external portal site, and allow the composite image to be displayed on a SNS (Social Network Service) related to the portal site or the user using the recording medium. In addition, since the composite image can be converted into a format for multimedia messaging service (MMS) and then transmitted, the user can receive the composite image to his or her own user device (e.g., mobile phone) A video message including the composite image may be transmitted to the device.

It will be clear to those skilled in the art that the controller 250 according to an embodiment of the present invention can communicate with all of the other components described above and below to organically control their operation. Those skilled in the art will also readily understand that the operation of the song service apparatus 200 itself can be controlled.

The memory unit 260 according to an embodiment of the present invention may store a program for the operation of the controller 250 and temporarily or permanently store input / output data.

In the memory unit 260, a variety of information for composing various information and a composite image for the operation of the song service apparatus 200, converting the image format, and determining a confrontation partner may be stored. In addition, the memory unit 260 may store user information for user recognition. The various information as described above may be stored in the memory unit 260 or alternatively or alternatively may be provided by transmitting and receiving from the server 100 whenever necessary.

In the memory unit 260 according to an exemplary embodiment of the present invention, images (background image, foreground image, etc.) to be composited can be stored in order to generate a composite image, and predetermined algorithms Lt; / RTI >

The memory unit 260 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A magnetic disk, and / or an optical disk. The song service apparatus 200 may operate in association with a web storage that performs a storage function of the memory unit 260 on the Internet.

Alternatively, or in the alternative, the receiving unit 281 and the transmitting unit 283 may include a network unit 290. [ Thus, the above-described information may be transmitted and / or received from the server 100 associated with the song service device 200, and / or transmitted and / or received from the user device 300. [

That is, the user can input various information for using the song service apparatus 200 through the receiving unit 281 of the song service apparatus 200 as described above.

The receiving unit 281 may further include, for example, a user input module 281a. The user input module 281a may include at least one of a touch input module, a keyboard input module, a voice input module, and an image input module, for example. In addition to the above-described information through the user input module, a user's input for controlling the song service device 200 and / or the song service device used by the user to confront the user can be received. The input module may include, for example, a keypad, a dome switch, a touchpad (static / static), a jog wheel, a jog switch, and the like. Further, the input module may include a camera module, a microphone, or the like.

Further, such user input module 281a may include a short range communication module as described below. In one embodiment of the invention, the input module may comprise a local communication module of a network communication module. If the input module comprises a local communication module, the input module may be configured to receive user input entered by the external console device. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

For example, when the user input module 281a performs near-field communication using infrared communication, the external console device may be an infrared remote controller. Alternatively, when the input module performs short-range communication using the Bluetooth function, the external console device may be a mobile device including a Bluetooth module. The mobile device including the Bluetooth module may be, for example, a smart phone including a Bluetooth module.

The user input module 281a may receive a signal by sensing a user's key operation or a touch input, or may receive a voice or an action through a user's camera module or a microphone and convert the received voice or action into an input signal. For this purpose, known Speech Recognition or Motion Recognition techniques may be used.

Furthermore, the user input module 281a may receive user input to control at least one of the camera module and the microphone module. For example, the user input module 281a may receive an input from a user to adjust the focus of a moving picture to be photographed by the camera module, or to designate a part of the user's body to be photographed. Further, an input for adjusting the shooting angle and the view angle may be received.

The transmitting unit 283 according to an embodiment of the present invention is configured to transmit the synthesized image to at least one of a server connected to the song service apparatus via a network and a user apparatus corresponding to the user. Through this, the user can increase utilization and satisfaction with the composite image and the song service. In this regard

Network portion 290 includes one or more modules that enable wireless communication between the song service device 200 and the wireline or wireless communication system or between the song service device 200 and the network in which the other song service device 200 is located can do. Alternatively, the network unit 290 as described above may include one or more modules that enable the information transmission with the user device 300 related to the song service apparatus 200 and the user using the song service apparatus 200 .

The network unit 290 may include a wired / wireless Internet module for network connection. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies. Wired Internet technologies include XDSL (Digital Subscriber Line), FTTH (Fiber to the home), and PLC (Power Line Communication).

In addition, the network unit 290 can transmit / receive data to / from an electronic device including a local communication unit, located relatively close to the song service apparatus 200 and including a local communication unit. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The network unit 290 can sense the connection state of the network and the transmission / reception speed of the network.

The data received through the network unit 290 may be output through the display unit 240, the voice processing unit 270, the memory unit 260, or other electronic devices For example, user device 300).

The components of the song service device 200 shown in FIG. 2 are not essential, and a song service device 200 having more or fewer components may be implemented.

According to an embodiment of the present invention, the song service apparatus 200 may be adapted to reproduce only the accompaniment sound, to take a photograph of a user singing out of singing a song according to the accompaniment sound, And a synthesized image of the use selected from the user. This results in a remarkable effect that non-specialists can shoot high-quality movies. Therefore, users who want to support audition and the like can produce audiograms without paying a high cost. In addition, users who use the song service apparatus 200 can be provided with memorable videos without paying a high cost.

According to the song service apparatus 200 for providing a song service according to an embodiment of the present invention having the technical features as described above, it is possible to overcome the limitations of the conventional motion picture producer simply combining the user's appearance and background. In addition, there is an effect that makes it possible for more people to use the video by making it possible for the user to create an image that is more sophisticated and emphasizing the entertainment aspect. In addition, it can be displayed on a TV or an internet medium by using the produced video, and it can participate in an audition linked with a broadcasting station and a company. To this end, the song service apparatus 200 described in FIGS. 2 to 4 and the server 100 described later in FIG. 8 directly transmit audio / video files generated by the song service apparatus 200 to a server providing an audition channel To be transmitted. Thus, the user can satisfy the desire to participate in the broadcast and the desire to participate in the audition, and the user of the entertainment industry can easily be found in the aspect of the broadcasting station and the agency.

According to a further aspect of the present invention, a computer-readable storage medium may be included within the song service device 200. Such storage media may include any type of storage medium in which programs and data are stored so that they can be read by a computer system.

Additionally, the program may comprise a computer program stored on a computer-readable medium, for example comprising a plurality of instructions executed by one or more processors, the program comprising instructions for receiving song service usage information input from a user, Wherein the song service utilization information includes at least one of time information, amount information, curry information, and selection information for the user to use the song service device; Instructions for generating a composite image based at least in part on a first image captured from a camera module and a second image generated based at least in part on the song service utilization information ; Outputting at least one of the video related to the selected music information including the caption information, the first video, the second video and the composite video; And transmitting the synthesized image to at least one of a server connected to the song service apparatus and a user apparatus corresponding to the user.

According to one aspect of the present invention, such a medium may be a ROM (Read Only Memory), a RAM (Random Access Memory), a CD (Compact Disk) -ROM, a DVD Storage devices, and the like, and may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Additionally, such media may be distributed over a system coupled to the network module and may store computer readable codes and / or instructions in a distributed manner.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the controller 250 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory unit 260 and can be executed by the control unit 250. [

Hereinafter, an exemplary configuration of the song service apparatus 200 will be described with reference to FIGS. 3 to 4. FIG.

FIG. 3 is a diagram illustrating an appearance of a song service apparatus according to an embodiment of the present invention.

4 is a view showing another appearance of a song service apparatus for providing a song service to a user according to an embodiment of the present invention.

3 to 4, the song service apparatus 200 related to an embodiment of the present invention may be formed by mounting the components shown in Fig. 2 in the song service apparatus 200. [

In short, the song service apparatus 200 may be provided with a camera for capturing a user. Such a camera can generally be a CCD camera. In addition, an illumination unit 210a for assisting the photographing of the camera may be further included. Furthermore, an image recording apparatus capable of storing a photographed image by a user may be included in the song service apparatus 200. Alternatively, the photographed image may be transmitted via a network to a user device or a server associated with the user. A microphone for inputting a voice of a user, and a speaker for reproducing an accompaniment sound and a microphone for outputting the voice of the micro-input user. Further, the display unit may output images, and the images that can be output from the display unit may be a predetermined image including lyric information on the selection information selected by the user. Alternatively, an image may be displayed in which a scene in which the user sings according to the accompaniment sound corresponding to the selection information is photographed.

The song service apparatus 200 is provided in a wireless or wired communication form.

3, the display portion 240 of the song service device 200 may include one or more display portions (e.g., 240a and 240b) to output on different frames of the display portion for different images . The above-described contents are merely exemplary descriptions according to one embodiment of the present invention, and the scope of rights of the present invention is not limited thereto.

3 and 4, a physical space in which the song service apparatus 200 is located may be located in at least one of a movable space and a fixed space. As an example, the song service device 200 may be located within the shape of a mobile booth 200a as shown in FIG. The movable booth 200a may be formed as an independent booth, for example. Such a stand-alone booth may further include moving means for facilitating movement of the booth, allowing a variety of physical spaces in which the song service device 200 can be located. For example, the mobile booth may include wheels that extend inwardly and / or outwardly from the lower end of the booth, thereby enhancing ease of movement. Alternatively, such an independent booth may be used while being located inside the cargo area of the large cargo. Alternatively, such an independent booth may be located in a portion of the multiplex, such as a portion of a game room, CGV, or the like. In addition, the song service apparatus 200 may be formed in a fixed space such as a karaoke room.

Further, both physical space and removable space can provide additional items to further enhance the user's entertainment aspect. For example, makeup tools, wigs, costumes, accessories, and the like may be provided independently or together in the space where the song service device 200 is located, and some cost may be additionally required by the user in using it have. According to the technical features as described above, it is obvious that the economic effect of the practice of carrying out the invention also exists.

Referring to Fig. 4, in more detail, the independent booth can be manufactured in any form as a movable booth. It may also be manufactured in various shapes other than rectangular as shown in Fig. 4, so that other means for assisting movement or fixation can be mounted.

Also, a chroma key panel used as a background can be formed in the inside of the independent booth when photographing the state of singing by the user. In general, chroma key panels can be manufactured in various shapes as well as matte blue or green screen used for image synthesis, as well as panels of cheap cloth or matte materials.

According to the song service apparatus 200 according to an embodiment of the present invention including the technical features described above with reference to FIG. 2, after acquiring a user's moving image according to a user's intention, A series of processes of generating a synthesized image by a background image, a foreground image, or a voice selected by a user from among various background images, foreground images stored in the storage unit 260, or voices input from the user can be automatically performed.

5 is a flow chart of a method performed by a song service device to provide a song service to a user in accordance with an embodiment of the present invention.

The steps (s) of some of the steps shown in Fig. 5 may be omitted in accordance with an embodiment of the present invention. Further, the steps shown in FIG. 5 are exemplary and additional steps may also be included within the scope of the present invention.

The steps shown in FIG. 5 may be performed by the song service apparatus 200. FIG. In more detail, the method presented below may be performed by, for example, each module of the song service device 200.

As another example, the following steps may be performed by a computer-readable medium for providing a song service. 5 may also be performed by the hardware of the server 100 (see FIG. 1) or by the OS itself according to another embodiment of the present invention.

The foregoing steps are exemplary descriptions only in accordance with one embodiment of the present invention and may include additional steps or may be performed with fewer steps. Further, each of the steps shown in FIG. 5 may be omitted or added as needed.

According to an embodiment of the present invention, the song service utilization information input from the user may be received (S510). Here, the song service utilization information may include at least one of time information, amount information, grain number information, and selection information for the user to use the song service apparatus.

Additionally, at least a portion of the user may be photographed (S520).

In addition, a composite image may be generated based at least in part on a first image captured from the camera module and a second image generated based at least in part on the song service utilization information (S530).

In addition, at least one of the video related to the selected music information including the caption information, the first video, the second video, and the composite video may be output at step S540.

In addition, the synthesized image may be transmitted to at least one of a server connected to the song service apparatus and a user apparatus corresponding to the user (S550).

A detailed description of each step as described above will be made with reference to FIG. 2, and a more detailed description will be omitted here.

The foregoing description is only illustrative in accordance with one embodiment of the present invention, and various examples not described above may be included within the scope of the present invention.

6 is an exemplary diagram of a composite image that can be generated in a song service apparatus according to an embodiment of the present invention.

The figures 61, 62, 63, 64, 65 and 66 shown in FIG. 6 are an example of a composite image synthesized by the song service apparatus 200 or synthesized by the server 100 described below.

Referring again to FIG. 4, an image for a user P using a song service is obtained through the song service device 200 according to an embodiment of the present invention, Therefore, a composite image (for example, 61, 62, 63, 64, 65, and 66) containing the image of the user who is using the song service can be provided.

6, even when the user P who is using the song service is one, the second image (i.e., the image to be composited) generated in advance in association with the selection information selected by the user P For example, the appearance of a dancer can be included, which can further enhance the user's interest in creating a composite image.

It will be apparent to those skilled in the art that the examples of the composite images shown in FIG. 6 are only illustrative drawings according to the embodiment of the present invention, and the scope of the present invention is not limited thereto.

More specifically, a predetermined image corresponding to the selection information selected by the user P can be photographed and stored in the memory unit 160 or the server 100. [ When the accompaniment sound is reproduced from the song service apparatus 200 based on the above-mentioned selection information, on the basis of the actual image of the user P photographed by the camera section 210 and the selection information, for example, A synthesized image combined with an augmented reality system in which a singer and a user P are singing together may be provided by synthesizing a virtual image of a singer or a related character. Through this, it is obvious that the user can not only improve the convenience of producing a composite image, but also can improve the fun.

For example, the augmented reality system renders a virtual image using three-dimensional perspective projection such that an actual camera projects a real image on data modeled in three dimensions in advance to match the virtual image to the real image. Then, it is generated by synthesizing a real image and a virtual graphic. At this time, the augmented reality system has a problem of knowing the exact position and direction of virtual objects in a two-dimensional screen in order to synthesize a virtual graphic object at a precise position of a real image. To solve this problem, three-dimensional coordinates of a certain point in the real world are required, and these coordinates are coordinate values based on the camera.

Therefore, the augmented reality system according to the above-described example uses a marker to obtain the relative three-dimensional coordinates of the camera with respect to a certain point or object in the real world from the image of the camera unit. According to another embodiment of the present invention, an augmented reality image can also be provided through marker recognition. For example, the microphone collects the voice of the user P, outputs the collected voice through the speaker, and loads the virtual image at the position of the marker recognized by the marker recognition unit. The virtual image and the camera unit A composite image in which the actual image of the user to be obtained is synthesized may be provided.

Figure 7 illustrates aspects of a user performing a song confrontation in accordance with one embodiment of the present invention.

FIG. 7 illustrates a first user P1 and a second user P2 performing a song confrontation according to an embodiment of the present invention. Although the two users are shown singing songs in one space, let us explain the song confrontation according to an embodiment of the present invention, assuming that the songs are singing in another space.

By executing a predetermined algorithm based on the user selection input including the user's song service information and confrontation request information as described above, one or more other users using the song service device and another song service device connected via the network (For example, a second user) for performing a song confrontation among the users can be determined. The song confrontation may be allowed based on whether the user (for example, first user) and the confrontation permission received from the confrontation partner have been approved.

It is very interesting to use people and song services that are similar in taste to people offline or online. The present invention connects users having similar tastes by utilizing information using conditions inputted by users. The present invention can enhance enjoyment of using a song service device through real-time song confrontation between users. This can have a significant effect of increasing the satisfaction of the song service provided.

As described above, the display unit 240 may output a third image in which at least a part of the confrontation party (for example, a second user) has been photographed. Referring to FIG. 7, 73 may be an example of the third image. The image 71 output by the display unit 240 may be a first image of which at least a portion of the first user is photographed. In addition, the images of the first user and the second user output by the display unit 240 may be the second image of the first user and the second image of the second user, which have already been synthesized. In addition, although the song service apparatus 200 is shown as having one display unit 240 in FIG. 7, the song service apparatus 200 may include two or more display units.

Here, the user's song service information may include at least one of time information, money information, music number information, and selection information for the user to use the song service apparatus.

Here, the confrontation request information includes at least one of gender information, age information, average song score information of the user, local information of a place where the song service device is located, confrontation history information of the user, ranking information of the user, And / or information.

Furthermore, a song confrontation according to an embodiment of the present invention can be displayed in real time through an application installed in the server 100 or the user device 300, which will be described later. In this case, it is possible to receive a response from other viewers in real time, and the song service apparatus 200 being used by the first user P1 and the display unit (not shown) of the song service apparatus 200 being used by the second user P2 240 may display an additional frame for displaying it. The publication of the song confrontation and the reception of the viewer response as described above can be determined based on the selection input of the first user and the second user.

The controllers D1 and D2 for controlling the operation of the song service apparatus 200 shown in FIG. 7 may be a remote controller or a user apparatus 300 having an application capable of performing a function of a remote controller, Lt; / RTI >

Figure 8 illustrates components of a server according to another embodiment of the present invention.

The server 100 for providing the song service may include a receiving module 110, a memory module 120, a control module 130 and a network module 140. [

The receiving module 110 receives a composite image that is generated based at least in part on a first image captured by at least a portion of a user and a second image generated based at least in part on the song service usage information. The song service utilization information may include at least one of time information, amount information, music number information, and selection information for the user to use the song service apparatus.

Also, the memory module 120 may store the composite image based on the user identification information. Here, the user identification information includes at least one of ID information of the user, gender information of the user, age information of the user, information of the user's residence area, and history information of the song service device used by the user, The scope of rights is not limited thereto.

The control module 130 determines a category for the composite image based on at least one of the user identification information and the song service use information, and determines, based on the determined category, position information for storing the composite image and position information .

In other words, the control module 130 may store the time information, the amount information, the grain number information and the music selection information, the ID information of the user, the gender information of the user, the age information of the user, A category in which the synthesized image generated for the user belongs is determined based on at least one of the user's residence area information and the song service history information used by the user. Thus, referring to FIG. 9, it facilitates the publication of a web site on a synthesized image.

More specifically, the one or more composite images received from the song service device 200 are based on at least one of the song service device identification information of the song service device 200 and the place information where the song service device 200 is physically located Can be categorized.

In addition, the control module 130 may generate a user interface for allowing editing of the composite image. This will be described later with reference to FIG.

Additionally, the control module 130 determines to award a score for the composite image based, at least in part, on feedback of other users to the composite image, wherein the feedback includes a number of hits, A recommendation number, a sharing count, and an evaluation score given from other users. The exemplary descriptions as described above are merely illustrative in accordance with one embodiment of the present invention, and various elements not described may be included within the scope of the present invention.

Additionally, the control module 130 may determine a point for the user based at least in part on the score for the composite image and the user's song service usage information. These points may be used to perform at least one of an editing operation on the base composite image, a sharing operation on the composite image, and a payment information processing operation generated based at least in part on the song service usage information.

In addition, the control module 130 may be configured to cause the user device corresponding to the user to perform the synthesis of the composite image in at least one of cases where feedback of other users for the composite image is received and the point exceeds a predetermined threshold point And to transmit at least one of the feedback information of other users to the image and the point information including the point. In this way, the user can monitor the feedback of other users to the synthesized image that he uploaded.

The control module 130 additionally executes a predetermined algorithm based on the user selection input including the user's song service usage information and confrontation request information received from the song service device 200, 200 and a plurality of other users using another song service apparatus connected via a network can determine a confrontation partner for performing a song confrontation. Further, the control module 130 permits the song confrontation based on whether the user and the confrontation partner have received the confrontation. Here, the confrontation request information includes at least one of gender information, age information, average song score information of the user, local information of a place where the song service device is located, confrontation history information of the user, ranking information of the user, Information, and the scope of the present invention is not limited thereto. As described above, the gender information, the age information, the average song score information of the user, the local information of the location of the song service device, the confrontation history information of the user, the ranking information of the user, It is possible to enhance the user's interest in the use of the song service apparatus 200 because the opponent is determined based on the match request information including at least one of the match request information.

The network module 140 also allows the user device 300 and / or the song service device 200 to access the server 100 to send and receive various information.

According to an embodiment of the present invention, the network may be a Public Switched Telephone Network (PSTN), a Digital Subscriber Line (xDSL), a Rate Adaptive DSL (RADSL), a Multi Rate DSL (MDSL) ), Universal Asymmetric DSL (UADSL), High Bit Rate DSL (HDSL), and Local Area Network (LAN).

In addition, the network shown here can be classified into a Code Division Multiple Access (CDMA), a Time Division Multi Access (TDMA), a Frequency Division Multiple Access (FDMA), an Orthogonal Frequency Division Multiple Access (OFDMA), a Single Carrier- Various wireless communication systems such as other systems may be used.

A network according to an aspect of the present invention may be configured without regard to its communication mode such as wired and wireless, and may be configured with various communication networks such as a personal area network (PAN) and a wide area network (WAN) . In addition, the network may be a known World Wide Web (WWW) or may use a wireless transmission technology used for short-distance communication such as infrared (IrDA) or Bluetooth.

The components included in the system shown in Fig. 8 are illustrative, and only a part of the components constitute the system, or additional component (s) other than the components may be included in the system.

According to a further aspect of the present invention, a computer-readable storage medium may be included within the server 100. Such storage media may include any type of storage medium in which programs and data are stored so that they can be read by a computer system.

Additionally, the program may be stored on a computer-readable medium, for example, comprising a plurality of instructions executed by one or more processors, the computer program causing a computer to perform the steps of: A command to receive a composite image generated based at least in part on a second image generated based at least in part on the information, wherein the song service utilization information includes at least one of a time information for the user to use the song service device, At least one of music information and song selection information; And storing the synthesized image on the basis of user identification information, wherein the user identification information includes at least one of ID information of the user, gender information of the user, age information of the user, Service device history information; And determining a category for the composite image based on at least one of the user identification information and the song service utilization information, and determining location information for storing the composite image and location information for sharing based on the determined category; . ≪ / RTI >

According to one aspect of the present invention, such a medium may be a ROM (Read Only Memory), a RAM (Random Access Memory), a CD (Compact Disk) -ROM, a DVD Storage devices, and the like, and may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Additionally, such media may be distributed over a system coupled to the network module and may store computer readable codes and / or instructions in a distributed manner.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The described embodiments may be implemented by the control module 130 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code may be stored in the memory module 120 and executed by the control module 130.

9 is a first example of a user interface according to an embodiment of the present invention.

10 is a second example of a user interface according to an embodiment of the present invention.

11 is a third example of a user interface according to an embodiment of the present invention.

12 is a fourth example of a user interface according to an embodiment of the present invention.

9 to 12, and the interfaces described above may be displayed, for example, on the display portion of the user device 300. [

According to an embodiment of the present invention as described above, at least a portion of the user is a composite image generated based at least in part on a first image captured and a second image generated based at least in part on the song service utilization information May be categorized, sorted and stored, for example. Also, a highlight image may be generated based at least in part on user feedback on the composite image. Further, in order to receive user feedback on the confrontation image, it can be determined that it can be output in any category. These images may be distributed to any web site and / or any application based on input at the song service device 200 and / or input at the user device 300.

FIG. 9 illustrates an exemplary web site for distributing images associated with events generated in accordance with an embodiment of the present invention. In such a web site, images generated according to an embodiment of the present invention may include images related to the song service, for example, at least one of song service apparatus identification information, a song service apparatus user identification information, As shown in FIG. Also, it may be retrieved and / or classified according to at least one of the elements described above at any of the above websites.

For example, a composite video / confrontation video related to the same genre may be classified for each country based on area information in which the song service apparatus included in the song service apparatus identification information is located. Alternatively, the composite video / confrontation video may be classified based on the nationality of the user included in the song service user identification information.

FIG. 10 illustrates an interface that may be output at the user device 300 when a selection input for at least one of the images displayed on any web site as shown in FIG. 9 is received. The interface as shown may be delivered to various locations over the network. For example, an image included in the interface can be shared with other account attention SNS through the SNS service account.

Figure 11 is an image editing application that may be provided to a singing service device user in accordance with one embodiment of the present invention. As described above, the user can be provided with a composite video / confrontation video. For example, the image may be received by a user device associated with the user. In this case, the user can edit the image according to his / her preference. 11 shows an editing layout that can be provided to the user, and the scope of rights of the present invention is not limited thereto.

In addition, the edited and produced video based on Fig. 11 can be distributed to any website shown in Fig. 10 and reproduced in the user apparatus shown in Fig.

Figure 12 illustrates a point system that may be provided to users using a computer program stored on a server, device, and computer readable medium for providing the song service, in accordance with one embodiment of the present invention. As described above, a point for the user may be determined based, at least in part, on the score for the composite image and the user's song service usage information.

Referring to the user interface 307 of FIG. 12, Mr. Choi has obtained 8,195 points, and using these points, the editing operation for the composite image, the sharing operation for the composite image, and the song service utilization information are at least partially And a payment information processing operation based on the generated payment information.

In addition, in order to facilitate the utilization of the point, in the case of at least one of when the feedback of other users for the composite image is received and the point exceeds the predetermined threshold point, the user corresponding to the user At least one of the feedback information of other users to the composite image and the point information including the point may be transmitted to the device 300.

9 to 12 and described above are merely exemplary steps for providing song services to user device 300 (109, 111, and 113), and the scope of rights of the present invention is not limited thereto. In other words, The elements shown in FIGS. 9-12 and displayed in the above-described interfaces may be omitted, added, or changed by the needs of those skilled in the art and / or user.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the appended claims. It will be understood that the invention may be varied and varied without departing from the scope of the invention.

Those of ordinary skill in the art will understand that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referenced in the above description may include voltages, currents, electromagnetic waves, magnetic fields or particles, Or particles, or any combination thereof.

Those skilled in the art will appreciate that the various illustrative logical blocks, modules, processors, means, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be embodied directly in electronic hardware, (Which may be referred to herein as "software") or a combination of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the design constraints imposed on the particular application and the overall system. Those skilled in the art may implement the described functionality in various ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The various embodiments presented herein may be implemented as a method, apparatus, or article of manufacture using standard programming and / or engineering techniques. The term "article of manufacture" includes a computer program, carrier, or media accessible from any computer-readable device. For example, the computer-readable medium can be a magnetic storage device (e.g., a hard disk, a floppy disk, a magnetic strip, etc.), an optical disk (e.g., CD, DVD, etc.), a smart card, But are not limited to, devices (e. G., EEPROM, cards, sticks, key drives, etc.). The various storage media presented herein also include one or more devices and / or other machine-readable media for storing information. The term "machine-readable medium" includes, but is not limited to, a wireless channel and various other media capable of storing, holding, and / or transferring instruction (s) and / or data.

It will be appreciated that the particular order or hierarchy of steps in the presented processes is an example of exemplary approaches. It will be appreciated that, based on design priorities, certain orders or hierarchies of steps in processes may be rearranged within the scope of the present invention. The appended method claims provide elements of the various steps in a sample order, but are not meant to be limited to the specific order or hierarchy presented.

The description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features presented herein.

Claims (8)

As a server,
A receiving module for receiving at least a portion of a user a first image photographed and a composite image generated based at least in part on a second image generated based at least in part on the song service usage information, A time information, a money amount information, a piece number information, and a selection information for a user to use the song service device;
A memory module for storing the composite image based on user identification information, the user identification information including at least one of ID information of the user, gender information of the user, age information of the user, Song service device history information; And
A control module for determining a category for the composite image based on at least one of the user identification information and the song service use information, and determining position information for storing the composite image and position information for sharing based on the determined category;
/ RTI >
server.
The method according to claim 1,
In addition,
Generating a user interface for allowing editing of the composite image,
server.
The method according to claim 1,
In addition,
Determine to award a score for the composite image based at least in part on feedback of other users to the composite image,
The feedback,
And a score obtained from other users, the number of views, the number of recommendation, the number of non-recommendation, the number of sharing,
server.
The method of claim 3,
In addition,
Determining a point for the user based at least in part on the score for the composite image and the user's song service usage information,
And,
And a payment information processing operation generated based at least in part on the editing operation on the composite image, the sharing operation on the composite image, and the song service utilization information,
server.
5. The method of claim 4,
In addition,
In the case of at least one of when the feedback of other users for the composite image is received and the point exceeds a predetermined threshold point,
Determining to transmit at least one of feedback information of other users to the composite image and point information including the point to the user equipment corresponding to the user,
server.
The method according to claim 1,
In addition,
Categorizing one or more composite images received from a song service device based on at least one of song service identification information of the song service device and location information where the song service device is physically located,
server.
The method according to claim 1,
In addition,
A plurality of song service apparatuses connected to the song service apparatus via a network by executing a predetermined algorithm based on a user selection input including the user's song service utilization information and confrontation request information received from the song service apparatus, Determining a confrontation partner for performing a confrontation among other users of the confrontation partner, and allowing the confrontation based on whether or not the confrontation is received from the confrontation partner,
Further,
At least one of gender information, age information, average song score information of the user, local information of the place where the song service device is located, confrontation history information of the user, ranking information of the user, doing,
server.
23. A computer program stored on a computer-readable medium, comprising a plurality of instructions executed by one or more processors,
The computer program comprising:
A command to receive at least a portion of a composite image generated based at least in part on a first image captured and a second image generated based at least in part on the song service usage information, The time information, the amount information, the number of pieces of music information, and the selection information for using the song service device;
And storing the synthesized image on the basis of user identification information, wherein the user identification information includes at least one of ID information of the user, gender information of the user, age information of the user, Service device history information; And
Determining a category for the composite image based on at least one of the user identification information and the song service utilization information, and determining location information to store the composite image and location information to share based on the determined category;
/ RTI >
A computer program stored on a computer-readable medium.

Images