KR102011868B1 - Apparatus for providing singing service - Google Patents

Abstract

According to an embodiment of the present invention, a server may receive a composite image generated based at least in part on a first image photographed by at least a portion of a user and a second image generated based at least in part on song service usage information. A receiving module, wherein the song service usage information includes at least one of time information, money information, music information, and music selection information to which the user intends to use a song service apparatus; A memory module configured to store the synthesized image based on user identification information, wherein the user identification information is used by the user's ID information, the user's gender information, the user's age information, the user's residence information, and the user's ID information. At least one of song service device history information; And a control module configured to determine a category for the synthesized image based on at least one of the user identification information and the song service use information, and determine location information to store the synthesized image and location information to share based on the determined category. It can include;

Description

Server device for providing song confrontation service {APPARATUS FOR PROVIDING SINGING SERVICE}

TECHNICAL FIELD The present invention relates to the field of entertainment and, more particularly, to a computer program stored in a server, an apparatus and a computer readable medium for providing a song service.

The song service apparatus installed in the karaoke stores information for implementing functions such as song selection, reservation, and performance. Therefore, when a user uses or wants to select a song service device, the user selects a desired song using a search result displayed on a booklet or a display of the song service device, and the song service device plays music accordingly. Korean Patent No. 10-0831410 discloses a method for efficiently implementing a karaoke function in a set-top box and a system for the same.

Moreover, the recent trend of enjoying leisure time alone in karaoke or movie theaters has become a new trend. Furthermore, there is a growing tendency to create new contents by themselves without being satisfied with the passive culture consumption that enjoys various contents provided online.

In line with this phenomenon, user-generated content (UCC), which means user-generated content, and production of content-produced content (PCC), which is user-produced content, is an advanced form of UCC. This is increasing. In addition, as a variety of audition programs and song contest programs through the media and Internet media, the "star" is born based on the UCC and PCC as described above. Therefore, there are users who want to show the same talents and abilities as many entertainers even if they are not entertainers.

Accordingly, users who use the song service device request the song service device with various and high quality services. This demand may be an improvement in the quality of music or images. Or this request may be an enhancement to an additional service for the song that the user himself sang. Such a request may include, for example, a recording file of a song sung by a user or a recording file recording a video, or a song being watched while watching the appearance of the user by outputting the appearance of the user's calling to the display unit of a song service device, or It can be a sharing of the video that you sing.

The incorporation of these functions into the song service device can enhance the added value of the song service device and provide a more entertaining environment for the user.

Accordingly, there is a need in the art to increase the entertainment element of song services.

In addition, there is an increasing demand in the art to provide various additional contents related to song services.

The present invention is devised in response to the above-described background, and is to provide a high quality song service to a user.

Disclosed is a server devised to solve the problems as described above. According to an embodiment of the present invention, the server receives a composite image generated based at least in part on a second image generated based at least in part on a first image photographed by at least a portion of a user and song service usage information. A receiving module, wherein the song service usage information includes at least one of time information, money information, music information, and music selection information to which the user intends to use a song service apparatus; A memory module configured to store the synthesized image based on user identification information, wherein the user identification information is used by the user's ID information, the user's gender information, the user's age information, the user's residence information, and the user's ID information. At least one of song service device history information; And a control module configured to determine a category for the synthesized image based on at least one of the user identification information and the song service use information, and determine location information to store the synthesized image and location information to share based on the determined category. It can include;

Alternatively, the control module may additionally generate a user interface for allowing editing of the composite image.

Alternatively, the control module additionally determines to assign a score to the composite image based at least in part on feedback from other users of the composite image, wherein the feedback is a number of views and recommendations for the composite image. It may include at least one of, the deprecated number, the number of shares, and evaluation scores granted from other users.

Alternatively, the control module additionally determines a point for the user based at least in part on the score for the composite video and the song service usage information of the user, and the point is determined for the composite video. It may be used to perform at least one of an editing operation, a sharing operation on the composite image, and a payment information processing operation generated based at least in part on the song service usage information.

Alternatively, the control module may additionally be directed to a user device corresponding to the user in at least one of when feedback of other users on the composite image is received and when the point exceeds a predetermined threshold point. It may be determined to transmit at least one of feedback information of other users of the synthesized image and point information including the point.

Alternatively, the control module may further categorize one or more composite images received from the song service device based on at least one of song service identification information of the song service device and location information where the song service device is physically located. have.

Alternatively, the control module additionally executes a predetermined algorithm based on a user selection input comprising the user's song service usage information and a confrontation request information received from a song service device to thereby establish the song service device and the network. Determine a confrontation partner for performing a song confrontation among a plurality of other users who are using other song service devices connected through the device, and allow the song confrontation based on whether the confrontation received from the user and the confrontation partner is approved; The confrontation request information may include gender information, age information, average song score information of the user, region information of the location where the song service device is located, confrontation history information of the user, ranking information of the user, and the user's residence. May include at least one of local information The.

Disclosed is a computer program stored on a computer-readable recording medium including a plurality of instructions executed by one or more processors according to another embodiment of the present invention. And the computer program is further configured to receive a composite image generated based at least in part on a first image of which at least a portion of the user is captured and a second image generated based at least in part on song service usage information—using the song service. The information includes at least one of time information, money information, music information, and music selection information to which the user intends to use a song service device; A command for storing the synthesized image based on user identification information, wherein the user identification information includes ID information of the user, gender information of the user, age information of the user, location information of the user, and a song used by the user. At least one of service device history information; And determining a category for the synthesized image based on at least one of the user identification information and the song service use information, and determining the location information to store the synthesized image and the location information to share based on the determined category. It may include.

According to an embodiment of the present invention, a high quality song service can be provided to a user.

Various aspects are now described with reference to the drawings, wherein like reference numerals are used to refer to like components throughout. In the following examples, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. However, it will be apparent that such aspect (s) may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing one or more aspects.
1 illustrates a system in which various aspects of the invention may be implemented.
2 is a view showing the appearance of the song service apparatus according to an embodiment of the present invention.
3 is a view showing another appearance of a song service apparatus for providing a song service to a user according to an embodiment of the present invention.
4 illustrates components of a song service device apparatus according to an embodiment of the present invention.
5 is a flowchart of a method performed by a song service apparatus to provide a song service to a user according to an embodiment of the present invention.
6 is an exemplary view of a composite image that can be generated in a song service apparatus according to an embodiment of the present invention.
7 illustrates aspects of a user performing a song battle in accordance with one embodiment of the present invention.
8 illustrates components of a server according to an embodiment of the present invention.
9 is a first example of a user interface according to an embodiment of the present invention.
10 is a second example of a user interface according to an embodiment of the present invention.
11 is a third example of a user interface according to an embodiment of the present invention.
12 is a fourth example of a user interface according to an embodiment of the present invention.

Various embodiments and / or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. However, it will also be appreciated by one of ordinary skill in the art that this aspect (s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of the one or more aspects. However, these aspects are exemplary and some of the various methods in the principles of the various aspects may be used and the descriptions described are intended to include all such aspects and their equivalents.

As used herein, “an embodiment”, “an example”, “aspect”, “an example”, etc., may not be construed as having any aspect or design described being better or advantageous than other aspects or designs. .

In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or”. In other words, unless specified otherwise or unambiguously in context, "X uses A or B" is intended to mean one of the natural implicit substitutions. That is, X uses A; X uses B; Or where X uses both A and B, "X uses A or B" may apply in either of these cases. Also, it is to be understood that the term "and / or" as used herein refers to and includes all possible combinations of one or more of the related items listed.

In addition, the terms "comprises" and / or "comprising" mean that such features and / or components are present, but exclude the presence or addition of one or more other features, components, and / or groups thereof. It should be understood that it does not. Also, unless otherwise specified or in the context of indicating a singular form, the singular in the specification and claims should generally be interpreted as meaning "one or more."

As used herein, the terms "user device" and "user terminal" can often be used interchangeably.

1 illustrates a system in which various aspects of the invention may be implemented.

Referring to FIG. 1, a system according to an embodiment of the present invention may include a server 100, a song service device 200, and a user device 300. As shown, server 100 may be connected to song service devices 200, 200a, 200b via a network, which may be connected to user devices 300, 300a .... and 300h, respectively. May be connected. Alternatively, or alternatively, the server 100 may be directly connected to the user devices 300i and 300k via a network.

According to an embodiment of the present invention, the server 100 may allow the song service device 200 to provide a song service in association with one or more song service devices 200. In addition, the server 100 may be linked with one or more user devices 300 to allow the user device 300 to provide content related to the song service.

As used herein, the term “song service” may include an accompaniment sound reproduced by the song service device 200. In addition, the image may be displayed on the song service apparatus 200. Alternatively, this "singing service" may be any additional content about the song that the user has sung. The content may be, for example, a recording file of a song sung by a user or a recording file recording a video, or a song itself while being watched by a user, while the appearance of the user himself is output to the display unit of a song service device, or It may be a sharing of the video that he sings, etc. The scope of the present invention is not limited thereto.

As used herein, the term "server 100" permits the provision or management of content related to a song service that may be provided by the song service device 200 or the user device 300 in accordance with one embodiment of the present invention. do. Such a server 100 will be described later with reference to FIG. 8.

The server 100 according to an embodiment of the present invention includes an enterprise application integration (EAI) server, an application programming interface (API) server, a cash management service (CMS) server, an external server, an operation server, and / or a call center server. You may. In addition, although not shown in FIG. 1, the user device 300 and / or the song service device 200 may operate in connection with another server (not shown).

The term "song service device 200" as used herein may be used to be often interchangeable with "karaoke devices" and "karaoke devices." The song service apparatus 200 according to an exemplary embodiment of the present invention includes a main body of a song service apparatus including a button provided in the song service apparatus 200 itself and outputting an accompaniment sound for a song corresponding to the corresponding button input. The display unit may be connected to the main body to output a background image and a subtitle, and a plurality of speakers configured to mix and output a sound output from the main body and a user's voice input through a microphone. The song service apparatus 200 may further include a remote control for allowing a user to input information about a song to be sung at a short distance of the song service apparatus 200 or to control an operation state of the main body. The exemplary description of the song service apparatus 200 as described above is merely an example according to an embodiment of the present invention, and the scope of the present invention is not limited thereto. That is, the song service apparatus 200 according to the present invention may refer to any device that stores information for implementing functions such as song selection, reservation, and performance. It will be described later with reference to 2 to 4.

According to an embodiment of the present invention, the user device 300 includes a user terminal, a user equipment, a mobile, a PC capable of wireless communication, a mobile phone, a kiosk, a cellular phone, a cellular, a cellular terminal, a subscriber unit, a subscriber station, a mobile station, and a terminal. , Remote station, PDA, remote terminal, access terminal, user agent, portable device with wireless connection function, any device that can use a wireless connection mechanism, such as, but not limited to, a wireless modem, and the like. Does not.

In addition, the user device 300 may be referred to as any device capable of using a wired connection mechanism such as a wired fax machine, a PC having a wired modem, a wired telephone, a terminal capable of wired communication, and the like, but is not limited thereto. Does not.

The server 100 and the song service apparatus 200 may be connected to a network to transmit and receive various information. In addition, the song service device 200 and the user device 300 may be connected to a network to transmit and receive various information. In addition, the server 100 and the user device 300 may be connected to a network to transmit and receive various information. Information that can be transmitted and received between the server 100, the song service device 200, and the user device 300 will be described later.

In addition, the information may be stored in a database or a computer-readable storage medium of at least one of the server 100, the song service device 200, and the user device 300. According to an aspect of the present invention, the computer-readable storage medium may be included in at least one of the server 100, the song service device 200, and the user device 300. Such storage media may include any type of storage media on which programs and data are stored such that they can be read by a computer system. According to one aspect of the present invention, such a medium may include a read only memory (ROM), a random access memory (RAM), a compact disc (CD) -ROM, a digital video disc (DVD) -ROM, a magnetic tape, a floppy disk, and optical data. Storage, and the like, and may also include those implemented in the form of a carrier wave (eg, transmission over the Internet). Additionally, such media may be distributed over networked systems, storing computer readable codes and / or instructions in a distributed fashion.

According to an embodiment of the present invention, the network is a public switched telephone network (PSTN), x Digital Subscriber Line (xDSL), Rate Adaptive DSL (RADSL), Multi Rate DSL (MDSL), and Very High Speed DSL (VDSL). ), Various wired communication systems such as Universal Asymmetric DSL (UDASL), High Bit Rate DSL (HDSL), and Local Area Network (LAN).

In addition, the networks presented herein include Code Division Multi Access (CDMA), Time Division Multi Access (TDMA), Frequency Division Multi Access (FDMA), Orthogonal Frequency Division Multi Access (OFDMA), Single Carrier-FDMA (SC-FDMA), and Various wireless communication systems can be used, such as other systems.

The network according to an aspect of the present invention may be configured regardless of communication modes such as wired and wireless, and may be configured with various communication networks such as a personal area network (PAN) and a wide area network (WAN). Can be. In addition, the network may be a well-known World Wide Web (WWW), or may use a wireless transmission technology used for short-range communication such as infrared (IrDA) or Bluetooth (Bluetooth).

Components included in the system shown in FIG. 1 are exemplary, and only some of the components may constitute the system, or additional component (s) other than the components may be included in the system.

For example, there may be other servers not shown in the present system.

In the present specification, the server 100 and the song service apparatus 200 will be mainly described, and thus only to describe an embodiment of the present invention. In other words, the song service apparatus 200 and / or the server 100 may be described. It should be made clear that performing some or all of the operations may be included in the scope of the present invention.

In addition, in the present specification, the server 100 and the user device 300 will be described with emphasis, so that only one embodiment of the present invention will be described. In other words, the user device 300 and / or the server 100 It should be made clear that performing some or all of the operations may be included in the scope of the present invention.

Alternatively, or alternatively, it will be apparent to those skilled in the art that the song service device 200 and / or the user device 300 may perform some or all of its operations may also be included within the scope of the present invention. .

Hereinafter, the server 100 and the song service apparatus 200 for allowing the song service apparatus to provide a song service in association with one or more song service apparatuses according to an embodiment of the present invention may be provided. The method for doing so will be described.

2 illustrates components of a song service device apparatus according to an embodiment of the present invention.

Referring to FIG. 2, each component of the song service apparatus 200 as illustrated in FIGS. 3 to 4 will be described.

Song service apparatus 200 according to an embodiment of the present invention is a camera unit 210, lighting unit 210a, user recognition unit 220, RF module 220a, NFC module 220b, biometric data identification module ( 220c), payment unit 230, cash storage module 230a, card payment module 230b, mobile payment module 230c, display unit 240, control unit 250, image synthesizing unit 251, chroma key Processing unit 253, list generation unit 255, confrontation determination unit 257, image format conversion unit 259, memory unit 260, audio processing unit 270, receiving unit 281, user input module 281a ), A transmitter 283, and a network unit 290.

As mentioned above, the "song service device 200" may be used to be often interchangeable with the "karaoke device" and the "karaoke device". Song service apparatus 200 according to an embodiment of the present invention, for example, including a button provided on the song service device 200 itself, a song service for outputting accompaniment for the song corresponding to the button input The apparatus may include a main body, a display unit connected to the main body and outputting a background image and a subtitle, and a plurality of speakers configured to mix and output a sound output from the main body and a voice of a user input through a microphone. The song service apparatus 200 may further include a remote control for allowing a user to input information about a song to be sung at a short distance of the song service apparatus 200 or to control an operation state of the main body. The exemplary description of the song service apparatus 200 as described above is merely an example according to an embodiment of the present invention, and the scope of the present invention is not limited thereto. That is, the song service apparatus 200 according to the present invention may collectively refer to any device that stores information for implementing functions such as song selection, reservation, and performance.

Thus, the components of the song service apparatus 200 shown in FIG. 2 are not essential, and the song service apparatus 200 having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The song service apparatus 200 as described above may include a camera unit 210. The camera unit 210 captures at least a portion of the user based at least in part on the song service usage information input from the user. To this end, the camera unit 210 may be located at the center of the upper front of the song service device 200, or the camera unit 210 may be located at an externally extended position of the song service device 200. In addition, the camera unit 210 as described above may include one or more cameras, so that an image of the user may be obtained from various angles, or an appropriate camera unit 210 may be selected and photographed according to the movement of the user. Here, the song service usage information may include at least one of time information, money information, music information, and music selection information that the user intends to use the song service apparatus, and the scope of the present invention is not limited thereto.

When a plurality of cameras constitute the camera unit 210, at least some cameras of the camera unit 210 are arranged to shoot an image frame including a user, and some other cameras are image frames directly or associated with the user. Can be arranged to shoot. For example, some other cameras may be arranged to capture image frames that include other users who are using karaoke with the user. It may be arranged to photograph image frames directly related to the game rules.

In addition, a user who uses the song service apparatus 200 generally stops at one place and sings instead of singing at various points. Thus, in order to photograph the user, location identification with respect to the user may be required. In this case, for example, the user's location may be identified from the location identification module included in the microphone to which the user's voice is input, and the direction of the camera unit 210 may be changed to the identified user's location. Alternatively, another camera unit 210 adjacent to the identified user's location may be controlled to photograph the user.

The lighting unit 210a may output a signal for notifying occurrence of an event of the song service device 200. Examples of events generated by the song service device 200 include providing a song service score, a song service start notification, a song service end notification, a confrontation approval request notification, a match rejection reception notification, a confrontation reception notification, and the like. It will be apparent to those skilled in the art that the scope of the present invention is not limited to the description. The lighting unit 210a may include a light emission diode (LED) to notify the user of an event through the blinking of the LED.

The LEDs may be disposed on the rear surface of the song service device 200 and may blink along a flashing pattern stored in advance according to occurrence of an event. For example, the song service apparatus 200 may be disposed in a direction facing the outside of the song service apparatus 200 and may flicker along a flashing pattern stored in advance according to occurrence of an event.

In addition, since the lighting unit 210a is generally formed with a low saturation of the physical space in which the song service device 200 is located, the lighting unit 210a is configured to assist the camera unit 210 to facilitate shooting for the user. In addition, the lighting unit 210a may be configured as a spotlight, which is a flat light that diffuses general illumination and / or a light that collects light. It may also consist of illuminations other than flat and / or spotlights.

According to an embodiment of the present invention, the song service apparatus 200 may include a user recognition unit 220 identifying a user. The user recognition unit 220 may be configured with at least one of an RFID module 220a, an NFC module 220b, and a biometric data identification module 220c.

For example, the user recognition unit 220 may receive user information by recognizing remote user information using radio waves by using a radio frequency identification (RFID) technology, which is a type of a short range communication technology. In more detail, a user may carry a card and a mobile terminal including an RFID module. In the RFID module possessed by the user, information (for example, a personal ID, an identification code, etc.) of the user registered in the database server may be recorded. The song service apparatus 200 may update a database (for example, song usage information) for the identified user or accumulate new data by identifying the RFID module possessed by the user. In one embodiment of the present invention, the user recognition module may be integrated into the receiving module.

In addition to the RFID technology described above, the user recognition unit 220 may include various technologies (for example, short-range communication technologies such as Bluetooth) that may transmit and receive unique information of the user in a contact / contactless manner. In addition, the user recognition unit 220 may be linked to a microphone, a touch pad, a camera module, etc. of the camera unit 2100, the voice processing unit 270, the receiving unit 281, and the network unit 290, and the user's biometric data (voice, fingerprint, etc.). , Biometric data identification module 220c for identifying a face).

The payment unit 230 according to an embodiment of the present invention is configured to process a payment for using the song service device 200 based at least in part on song service usage information. The payment unit 230 may include a cash storage module 230a, a card payment module 230b and a mobile payment module 230c.

For example, the payment unit 230 may generate payment information based at least in part on a predetermined payment algorithm and the song service usage information. As another example, the payment unit 230 may generate payment information based at least in part on a predetermined payment algorithm and the song service usage information. For example, when the predetermined payment algorithm is 1,000 won for two songs and four pieces of song service use information received from the user are used for four songs, the payment information may be determined to be 2,000 won.

As another example, payment information may be generated based on user information. For example, payment information may be generated by discounting 10% from the total payment amount to a user under 19 years old. Alternatively, such payment information may be generated based on the user's usage history additionally. For example, when the total song service use time of the user is 10 hours or more, two songs may be subtracted from the song service use information for calculating the payment amount, and payment information may be generated. The foregoing is only an exemplary description according to an embodiment of the present invention, the scope of the present invention is not limited thereto.

In addition, the payment unit 230 may determine whether payment is completed according to the payment information, and may generate a user interface (UI) for allowing a user input to the song service device 200 and the use of the user. The user interface may display the above-described payment information, desired selection information, and recommended selection information, and the scope of the present invention is not limited thereto.

The payment unit 230 may process payment information based on a user's approval behavior in cooperation with a financial server through a network. Alternatively, the controller 250 operates in conjunction with the payment unit 230. The controller 250 may process the payment information based on the user's approval behavior in cooperation with the user device 300 through the network.

In addition, the payment unit 230 may include a tag module that allows a payment like a credit card by inserting a chip (for example, NFC) that can function as a payment means.

Additionally, the payment unit 230 according to an embodiment of the present invention may further include a payment module for performing payment. Such a payment module may include a cash payment module, a bank payment module, a card payment module, a mobile payment module and an ARS payment module. For example, the mobile payment module may operate by inputting user information including a mobile number and a social security number and then inserting an authentication number into a mobile phone to make a payment.

The display unit 240 according to an embodiment of the present invention is, for example, a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light emitting diode (organic) light-emitting diodes (OLEDs), flexible displays, and 3D displays. Some of these displays 240 may be configured to be transparent or light transmission so that the outside can see through. This may be referred to as a transparent display module. A representative example of the transparent display module is TOLED (Transparant OLED).

In an embodiment of the present invention, two or more display units 240 may exist according to an implementation form of the song service apparatus 200. In this regard, the appearance of the song service apparatus 200 illustrated in FIG. 3 will be referred to. For example, in the song service apparatus 200, a plurality of displays may be spaced apart from or integrally disposed on one surface, or may be disposed on different surfaces. For example, the display unit 240 may include both a display disposed at the top of the song service device 200 and a display disposed at the bottom thereof, or may include one of these displays. However, the display unit 240 described above is merely an example of the position where the display unit 240 is disposed, and the display unit 240 may be disposed at various positions for design needs or visual effects.

In an aspect of the present invention, the display unit 240 may be configured as a touch screen implemented to receive a user's selection input. In this case, the display module may be included in the receiver 281. Alternatively, the display unit 240 may be provided in the song service apparatus 200 in place of the receiver 281.

Additionally, the display unit 240 configured as a touch screen may include a touch sensor. The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display 240 or a capacitance generated at a specific portion of the display 240 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 250. As a result, the controller 250 may recognize which area of the display module is touched.

Alternatively, or in the alternative, the display unit 240 and the audio processing unit 270 described below may sometimes be collectively referred to as an “output unit”. The voice processor 270 may include a receiver, a speaker, a buzzer, and the like. The voice processor 270 may output a signal for notifying occurrence of an event of the song service device 200. An example of an event occurring in the song service apparatus 200 may include a start notification of a song service, and various events not described. In addition, the voice processing unit 270 may process the voice and the accompaniment of the user input from the microphone.

Again, the display unit 240 according to an embodiment of the present invention may output one or more of the image, the first image, the second image, and the composite image related to the music selection information including subtitle information.

In addition, the display unit 240 may output a third image in which at least a portion of the confrontation opponent determined according to an embodiment of the present invention, which will be described later, is photographed. As described above, the display unit 240 may include one or more display units, and among the images, the first image, the second image, and the composite image related to the music selection information including the caption information as described above. Different images may be output on the same frame or may be output on different frames. For example, an image related to the music selection information including caption information may be output from the first display unit 240a (see FIG. 3), and a composite image may be output from the second display unit 240b (see FIG. 3). have.

Furthermore, the display unit 240 may provide a user interface for any one of various types of information transmitted and received in executing a computer program stored in a computer readable medium for providing a song service according to an exemplary embodiment of the present invention. You can also output For example, a user interface for performing a payment from a user may be output to the display unit 240. In this regard, reference is made to FIG. 6.

The controller 250 may perform the operations described below. Alternatively, by further including components that are subdivided but organically connected as shown, each component may be allowed to perform the following operations. The controller 250 as described above may include an image synthesizer 251, a chroma key processor 253, a list generator 255, a confrontation determination unit 257, and an image format converter 259. .

The controller 250 may generate a composite image based at least in part on the first image photographed from the camera unit 210 and the second image generated based at least in part on the song service usage information.

The controller 250 may additionally generate the composite image by analyzing the first image to extract each part of the user's body and matching the second image to each extracted part of the body.

In addition, the controller 250 may additionally make the background of the first image transparent. Through this, even when the background where the song service apparatus 200 is located is dirty, the part of the first image other than the user included in the first image may be made transparent, thereby generating a higher quality composite image. In addition, the controller 250 may generate the composite image by further combining at least one of a text selected and input from the user and an image selected and input from the user. Through this, it is possible to allow the user to further edit the composite image, thereby fully reflecting the individual's preference in generating the composite image. In addition, it is clear that the entertainment aspect of generating a composite image can be enhanced, and the intimacy with other users who create and edit the composite image can also be enhanced.

The controller 250 may generate the synthesized image by adjusting the size and position of the user in the first image to synthesize the user in the first image with the second image.

Here, the second image includes at least one composition target object, and the controller 250 additionally allows to reproduce the first image, and the composition target object of the second image on the reproduced first image. The synthesized image may be generated based on a user selection input for the synthesized position. Such a synthesized image may be performed by, for example, the image synthesizer 251.

According to a further embodiment of the present invention, a synthesis target object to be synthesized with the captured image and a video to be synthesized with the synthesis target object may be selected. According to a further embodiment of the present invention, such a video is played, and the synthesis target object may be synthesized in the video by designating a composition position of the synthesis target object on the played video through, for example, a touch screen. . Furthermore, while generating such a composite image, the synthesis target object is displayed in an overlay form at the synthesis position of the synthesis target object, and the result of the synthesis of the video and the synthesis target object is presented in a preview form. Can be. The user interface presented in the form of an overlay and a preview may be output through the display unit 240 of the song service device 200. Alternatively, alternatively, alternatively, the user device 300 associated with the user may be displayed. It can also be output.

In more detail, the controller 250 may generate a synthesized image based on chroma key technology. The chroma key technique is an image synthesis method that adds special effects and text to an image program. The chroma key technique is most commonly used when composing other images by removing specific color parts and extracting only other elements. As an example of an image generated based on the chroma key technique, there is a method of synthesizing the image of the weather caster and the graphic image of the weather forecast and outputting it to one screen.

In order to produce a synthesized image using the chroma key technique, a video must be taken and then a specific portion desired can be extracted and then synthesized with a background image, a foreground image, or background music to be synthesized. As described above, the operations as described above may be performed by the chroma key processing unit 253.

According to a further embodiment of the present disclosure, the controller 250 may include at least one second image based on at least one of the number of subjects photographed by the camera unit 210, the song service usage information, and the identification information of the user. Determine a second image candidate list and generate a second image candidate list including the determined one or more second images. For example, the above-described operation may be performed by the list generator 255 of the controller 250. In more detail, the list generator 255 may output the second image candidate list including the at least one second image for generating the composite image to the display unit 240 based on the identification information of the user. have. For example, if the user is a female, the background image of the music video of the female idol group may be included in the candidate list. As another example, when there are three users, a background image including synthetic objects (eg, a mustache, a crest head, etc.) that can emphasize humor for three people may be included in the candidate list.

In addition, the controller 250 may generate recommendation selection information for the user based at least in part on the user information input from the user. As described above, the user information includes at least one of nationality information, gender information, age information, and song service use history information of the user. In more detail, the controller 250 may generate recommendation selection information based on song service history information of one or more other users having user information within a predetermined similar range with the user information of the user.

For example, a first user who is a woman in her 20s, a second user who is a woman in her 30s, a third user who is a woman in her 40s, a fourth user who is a woman in her 50s, a fifth user who is a man in her 20s Assume that there is a seventh user who is a man in his 40s and an eighth user who is a man in his 50s. In this case, recommendation selection information may be generated to the first user based on song service history information of the second user and the other twenties women having the user information within the similar range among the same women. Alternatively, the recommendation selection music information may be generated in the first user based on at least song service history information of other 20s women and song service history information of a fifth user who is 20s. As another example, the first user may generate recommended selection information based on song service history information of a fourth user who is a woman in their 50s than a third user who is a woman in her 40s in consideration of the age of the parent. The foregoing descriptions are merely exemplary descriptions according to an embodiment of the present invention, and the scope of the present invention is not limited thereto.

In addition, the controller 250 executes a predetermined algorithm based on the user selection input including the received song service information and the confrontation request information of the user, whereby the other song service apparatus connected to the song service apparatus via a network. One or more other users who are using may determine a confrontation partner for performing a song confrontation. The song service information of the user includes at least one of time information, money information, music information, and music selection information that the user intends to use the song service device, and the scope of the present invention is not limited thereto.

In addition, as described above, the controller 250 may determine a confrontation partner for performing a song confrontation with the user based on the recommended selection music information generated by the controller 250. Further, the controller 250 may allow the song confrontation based on whether the confrontation received from the user and the confrontation opponent is approved. For example, the above-described operations may be performed by the confrontation determination unit 257 constituting the control unit 250. Accordingly, the song service apparatus 200 may provide a confrontation mode including one or more confrontation opponents confronting through the network unit 290, thereby enhancing a user's satisfaction in using the song service.

As described above, the confrontation request information includes gender information, age information, average song score information of the user, region information of the location where the song service device is located, confrontation history information of the user, ranking information of the user, and the user. It may include at least one of the area information inhabited. In addition, when the user and the confrontation partner performs a song confrontation, the display unit 240 may output a third image in which at least a portion of the confrontation partner is photographed. In this regard, reference is made to FIG. 7.

In addition, as described above in the payment unit 230, the controller 250 generates payment information based at least in part on a predetermined payment algorithm and the song service usage information, and determines whether payment is completed according to the payment information. And, if it is determined that the payment according to the generated payment information is completed, it may be allowed to perform a predetermined operation. Since the predetermined operation includes at least one of an accompaniment sound reproduction operation based on the music selection information of the user of the song service apparatus, the synthesis image output operation of the display unit, and the synthesis image transmission operation of the network unit, the song It will be apparent to those skilled in the art that economic effects in the art of commercially available service devices may also occur.

In addition, the control unit 250 includes an image format conversion unit 259, among the server 100 and the user device 300 corresponding to the user connected to the song service device 200 via the synthesized video network; In order to transmit at least one, it may be converted into a format of the composite image. Furthermore, the composite image may be automatically converted into a SWF (ShockWave Flash) format or a FLV (Flash Video) format, and then transmitted to an external portal site for later re-editing or stored in a recording medium. Therefore, a user can be instructed to access the external portal site, and the recording medium can be used to post the composite image to the portal site or SNS (Social Network Service) related to the user. In addition, since the synthesized video can be converted into a format for MMS (Multimedia Messaging Service) and then transmitted, the user can receive the synthesized video on his or her user device (for example, a mobile phone) or a user of a second user. The device may transmit a video message including the composite video to the device.

It will be apparent to those skilled in the art that the controller 250 according to an embodiment of the present invention can communicate with all of the other components described above and below, so that their operations can be controlled organically. It will also be apparent to those skilled in the art that the song service device 200 can control the operation of itself.

The memory unit 260 according to an embodiment of the present invention may store a program for the operation of the controller 250, and may temporarily or permanently store input / output data.

The memory unit 260 may store various pieces of information for the operation of the song service device 200 and various pieces of information for generating a synthesized image, converting an image format, and determining a confrontation partner. In addition, the memory unit 260 may store user information for user recognition. The various information as described above may be stored in the memory unit 260 or alternatively, or alternatively, provided by transmitting and receiving from the server 100 whenever necessary.

The memory unit 260 according to an embodiment of the present invention may store images (background image, foreground image, etc.) to be synthesized in order to generate a composite image, and predetermined algorithms may be used to utilize a chroma key technique. Can be stored.

The memory unit 260 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, It may include a storage medium of at least one type of magnetic disk, optical disk. The song service apparatus 200 may operate in association with a web storage that performs a storage function of the memory unit 260 on the Internet.

Alternatively, or alternatively, the receiving unit 281 and the transmitting unit 283 may include a network unit 290. Accordingly, the above-described information may be transmitted and / or received from the server 100 associated with the song service device 200, or may be transmitted and / or received from the user device 300.

That is, the user may input various information for using the song service apparatus 200 through the receiver 281 of the song service apparatus 200 as described above.

The receiver 281 may further include, for example, a user input module 281a. The user input module 281a may include, for example, at least one of a touch input module, a keyboard input module, a voice input module, and an image input module. In addition to the above-described information through the user input module, a user's input for controlling the song service device 200 and / or the song service device used by the user to be confronted by the user may be received. The input module may include, for example, a keypad, a dome switch, a touch pad (constant voltage / capacitance), a jog wheel, a jog switch, and the like. In addition, the input module may include a camera module or a microphone.

In addition, the user input module 281a may include a short range communication module as described below. In one embodiment of the present invention, the input module may include a short range communication module of the network communication module. If the input module includes a near field communication module, the input module may be configured to receive user input input by an external console device. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

For example, when the user input module 281a performs near field communication using infrared communication, the external console device may be an infrared remote controller. Alternatively, when the input module performs short range communication using a Bluetooth function, the external console device may be a mobile device including a Bluetooth module. The mobile device including the Bluetooth module may be, for example, a smartphone including the Bluetooth module.

The user input module 281a may detect a key operation or a touch input of the user and receive a signal, or may receive a voice or an operation through a camera module or a microphone of the user and convert it into an input signal. For this purpose, well-known speech recognition techniques or motion recognition techniques may be used.

Further, the user input module 281a may receive a user input for controlling at least one of the camera module and the microphone module. For example, the user input module 281a may receive an input from the user to adjust the focus of the video captured by the camera module or to designate a body part of the user. In addition, an input for adjusting the photographing angle and angle of view may be received.

In addition, the transmission unit 283 according to an embodiment of the present invention is configured to transmit the composite video to at least one of a server connected to the song service device and a network and a user device corresponding to the user. Through this, the user can increase the utilization and satisfaction with the composite video and song service.

The network unit 290 includes one or more modules that enable wireless communication between the song service device 200 and the wired / wireless communication system or between the song service device 200 and the network in which the other song service device 200 is located. can do. Alternatively, the network unit 290 as described above may include one or more modules that enable information transmission with the song service device 200 and the user device 300 associated with the user who is using the song service device 200. It may include.

The network unit 290 may include a wired / wireless internet module for network connection. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like. Wired Internet technologies may include Digital Subscriber Line (XDSL), Fibers to the home (FTTH), Power Line Communication (PLC), and the like.

In addition, the network unit 290 may include a short range communication unit, and may transmit and receive data to and from the electronic device including the short range communication unit, which is located at a relatively short distance with the song service apparatus 200. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The network unit 290 may detect a connection state of a network and a transmission / reception speed of the network.

The data received through the network unit 290 is output through the display unit 240, the voice processing unit 270, stored through the memory unit 260, or other electronic devices in the short range through the local area communication unit ( For example, it may be transmitted to the user device 300.

The components of the song service apparatus 200 shown in FIG. 2 are not essential, and the song service apparatus 200 having more or fewer components may be implemented.

According to an embodiment of the present invention, the song service apparatus 200 merely plays back the accompaniment and moves away from the user singing according to the accompaniment, photographing the user who sings, or pre-stored various synthetic target images. It is possible to produce a composite target image selected from the user and a composite image for the use. Through this, a remarkable effect occurs that even a non-expert can shoot a high-fidelity video. Therefore, the user who wants to apply for the audition can produce the audition photograph without paying a high cost. In addition, users who use the song service apparatus 200 without receiving an expensive cost may be provided with images containing memories.

According to the song service apparatus 200 for providing a song service according to an embodiment of the present invention having the technical features as described above, it is possible to simply overcome the limitations of the conventional video maker that synthesizes the appearance and background of the user. In addition, by enabling users to produce more advanced and entertainment-oriented video, there is an effect that makes more people available. In addition, the produced video may be directly published on TV and Internet media, and may also participate in audition associated with a broadcasting station or a planning company. To this end, the song service apparatus 200 described with reference to FIGS. 2 to 4 and the server 100 described below with reference to FIG. 8 directly transmit a voice / video file generated by the song service apparatus 200 to a server providing an audition channel. Allow to send. As a result, it is possible to satisfy the desire for participation in broadcasting and the desire for participation in audition on the user side, and it is possible to easily identify talented users in the entertainment world in terms of broadcasting stations and agencies.

According to a further aspect of the present invention, a computer readable storage medium may be included in the song service apparatus 200. Such storage media may include any type of storage media on which programs and data are stored such that they can be read by a computer system.

Additionally, the program is a computer program stored on a computer-readable recording medium, for example, comprising a plurality of instructions executed by one or more processors, the instructions for receiving song service usage information input from a user. Song service usage information, the user including at least one of time information, price information, music information, and music selection information of the user who wants to use the song service device; Generating a composite image based at least in part on a first image photographed from a camera module and a second image generated based at least in part on the song service usage information ; Outputting one or more of an image related to the music selection information including caption information, the first image, the second image, and the composite image; And a command for transmitting the synthesized video to at least one of a server connected to the song service device through a network and a user device corresponding to the user.

According to one aspect of the present invention, such a medium may be a ROM (Read Only Memory), a RAM (Random Access Memory), a CD (Compact Disk) -ROM, a DVD (Digital Video Disk) -ROM, a Magnetic Tape, a Floppy Disk, Optical Data Storage, and the like, and may also include those implemented in the form of a carrier wave (eg, transmission over the Internet). In addition, such media may be distributed over systems coupled with network modules to store computer readable codes and / or instructions in a distributed fashion.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 250 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code may be implemented in software applications written in a suitable programming language. The software code may be stored in the memory unit 260 and executed by the controller 250.

Hereinafter, an exemplary form of the song service apparatus 200 will be described with reference to FIGS. 3 to 4.

3 is a diagram illustrating an appearance of a song service apparatus according to an exemplary embodiment of the present invention.

4 is a view showing another appearance of a song service apparatus for providing a song service to a user according to an embodiment of the present invention.

3 to 4, the song service apparatus 200 according to an embodiment of the present invention may be formed by mounting the components shown in FIG. 2 in the song service apparatus 200.

In summary, the song service apparatus 200 may be provided with a camera for photographing the user. Such a camera may generally be a CCD camera. In addition, the lighting unit 210a may be further included to assist in photographing the camera. In addition, an image recording apparatus capable of storing a photographed image by a user may be included in the song service apparatus 200. Alternatively, the captured image may be transmitted to a user device or a server related to the user through a network. A microphone for inputting a user's voice and a speaker for accompaniment and reproduction of the user's voice input to the microphone may be included. In addition, the display unit may output images, and the images output from the display unit may be predetermined images including lyrics information about selection information selected by a user. Alternatively, an image of photographing a user singing in accompaniment with the accompaniment information may be output.

The song service device 200 is provided in a form that can communicate wirelessly or by wire.

Referring to FIG. 3, the display unit 240 of the song service apparatus 200 may include one or more display units (eg, 240a and 240b) to output different images on different frames of the display unit. . The foregoing description is merely an exemplary description according to an embodiment of the present invention, the scope of the present invention is not limited thereto.

3 and 4, the physical space in which the song service device 200 is located may be located in at least one of a mobile space and a fixed space. For example, the song service apparatus 200 may be located in the form of the mobile booth 200a as shown in FIG. 4. The movable booth 200a may be formed as, for example, an independent booth. Such an independent booth may further include moving means for facilitating the movement of the booth, thus allowing a variety of physical spaces in which the song service device 200 may be located. For example, the mobile booth may include wheels that extend inwardly and / or outwardly at the bottom of the booth to enhance ease of movement. Alternatively, these independent booths may be used while moving inside the cargo compartment of a large cargo. Alternatively, these independent booths may be located in a part of the recreation room, part of a multiplex such as CGV. In addition, the song service apparatus 200 may be formed to be located in a fixed space such as karaoke.

Furthermore, both physical and removable spaces can provide additional items to further enhance the entertainment aspect of the user. For example, makeup tools, wigs, costumes, accessories, etc. may be provided independently or together in the space where the song service device 200 is located, and some additional costs may be required for users to use them. have. According to the technical features as described above, it is evident that there is also an economic effect of the practice of carrying out the invention.

Referring to FIG. 4, in more detail, the independent booth may be manufactured in any form as a movable booth. It may also be fabricated in various shapes other than rectangular, as shown in FIG. 4, so that other means for assisting movement or fixation may be mounted.

In addition, the independent booth may be formed with a chroma key panel to be used as a background when shooting the user singing. In general, chroma key panels can be manufactured in various forms as well as matt blue or green screens used for image synthesis, as well as inexpensive cloth or matte panels.

According to the song service apparatus 200 according to an embodiment of the present invention including the technical features as described above in FIG. 2, after acquiring a video of the user according to the user's intention, the memory unit of the user apparatus 300 is provided. A series of processes for generating a composite image from a background image, a foreground image, or a voice selected by the user among various background images, foreground images, or voices input from the user may be automatically performed.

5 is a flowchart of a method performed by a song service apparatus to provide a song service to a user according to an embodiment of the present invention.

Some of the step (s) shown in FIG. 5 may be omitted in accordance with one embodiment of the present invention. In addition, the steps illustrated in FIG. 5 are exemplary and additional steps may be included within the scope of the present invention.

Steps shown in FIG. 5 may be performed by the song service apparatus 200. In more detail, the method presented below may be performed by the respective modules of the song service apparatus 200, for example.

As another example, the following steps may be performed by a computer readable medium for providing a song service. In addition, the method shown in FIG. 5 may be performed by the hardware of the server 100 (see FIG. 1) or by the OS itself according to another embodiment of the present invention.

The above-described steps are merely exemplary descriptions according to an embodiment of the present invention, and may further include additional steps or be performed in fewer steps. In addition, each step illustrated in FIG. 5 may have some steps omitted or added as necessary.

According to an embodiment of the present invention, the song service usage information input from the user may be received (S510). Here, the song service usage information may include at least one of time information, price information, music information, and music selection information that the user wants to use the song service apparatus.

In addition, at least a portion of the user may be photographed (S520).

In addition, a synthesized image may be generated based at least in part on the first image photographed from the camera module and the second image generated based at least in part on the song service use information (S530).

In addition, at least one of an image related to the music selection information including caption information, the first image, the second image, and the composite image may be output (S540).

In addition, the synthesized video may be transmitted to at least one of a server connected to the song service device through a network and a user device corresponding to the user (S550).

Detailed description of each step as described above will be described with reference to FIG. 2, and more detailed description thereof will be omitted.

The foregoing descriptions are merely exemplary descriptions according to an embodiment of the present invention, and various examples which are not described above may be included in the scope of the present invention.

6 is an exemplary view of a composite image that can be generated in a song service apparatus according to an embodiment of the present invention.

6, 62, 63, 64, 65, and 66 illustrated in FIG. 6 are examples of synthesized images synthesized by the song service apparatus 200 or synthesized by the server 100 described later.

Referring back to FIG. 4, an image of a user P using a song service is obtained through the song service apparatus 200 according to an embodiment of the present invention, and the user may be provided with the technical features as described above. Therefore, the user may be provided with composite images (eg, 61, 62, 63, 64, 65, and 66) including his or her own use of the song service.

It should be noted that in FIG. 6, even when there is only one user P using a song service, the second image (that is, the image to be synthesized) that is pre-generated in relation to the selection information selected by the user P is included in the song. For example, the figure of the dancer may be included, so that the user may be more interested in generating the composite image.

It will be apparent to those skilled in the art that the examples of the composite images shown in FIG. 6 are only exemplary drawings in accordance with an embodiment of the present invention, and the scope of the present invention is not limited thereto.

In more detail, a predetermined image corresponding to the selection information selected by the user P may be photographed and stored in the memory unit 160 or the server 100. When the accompaniment sound is reproduced from the song service device 200 on the basis of the selection music information, for example, based on the actual image of the user P photographed by the camera unit 210 and the selection music information, By synthesizing a virtual image of a singer or a related character, a synthetic image combined with an augmented reality system in which the singer and the user P sing together may be provided. Through this, it is apparent that the user can not only enjoy the convenience of producing the composite image but also improve the fun.

For example, the augmented reality system renders a virtual image by using a three-dimensional perspective projection method such as a real camera projecting the data modeled in three dimensions in advance to match the virtual image to the real image. After that, it is generated by synthesizing the real picture and the virtual graphic. At this time, the augmented reality system has a problem of knowing the exact position and orientation of the virtual objects in the two-dimensional screen in order to synthesize the virtual graphic object at the exact position of the live image. To solve this problem, three-dimensional coordinates of a certain point in the real world are required, and this coordinate becomes a coordinate value based on a camera.

Accordingly, the augmented reality system according to the above example uses a marker to obtain the relative three-dimensional coordinates of the camera with respect to any point or object in the real world in the image of the camera unit. According to another embodiment of the present invention, an augmented reality image may also be provided through marker recognition. For example, the microphone collects the voice of the user P, outputs the collected voice through the speaker, and loads a virtual image at the position of the marker recognized by the marker recognition unit, and by the rendered virtual image and the camera unit A synthesized image obtained by synthesizing the actual image of the obtained user may be provided.

7 illustrates aspects of a user performing a song battle in accordance with one embodiment of the present invention.

FIG. 7 illustrates a first user P1 and a second user P2 performing a song battle according to an embodiment of the present invention. Although the two users are shown to sing in one space, the song confrontation according to an embodiment of the present invention will be described on the premise of singing in another space.

One or more other users using the other song service apparatus connected to the song service apparatus via a network by executing a predetermined algorithm based on the user selection input including the user's song service information and the confrontation request information as described above. Among them, a confrontation partner (eg, a second user) for performing a song confrontation may be determined. The song confrontation may be allowed based on whether the confrontation received from the user (eg, the first user) and the confrontation opponent is approved.

It's very interesting to use a song service with someone who shares your tastes offline or online. The present invention connects users with similar tastes by using information using conditions input by the users. The present invention can enhance the enjoyment of using the song service device through the real-time song confrontation between users. This may have a remarkable effect of increasing satisfaction with the song service provided.

As described above, the display unit 240 may output a third image in which at least a portion of the opponent (eg, the second user) is photographed. Referring to FIG. 7, 73 may be an example of a third image. The image 71 output by the display unit 240 may be a first image in which at least a portion of the first user is photographed. In addition, the images of the first user and the second user output by the display unit 240 may be the second image of the first user and the second image of the second user, which are already synthesized. In addition, although the song service apparatus 200 is illustrated to have one display unit 240 in FIG. 7, two or more display units may be provided.

The song service information of the user may include at least one of time information, money information, music information, and music selection information that the user intends to use the song service device.

Here, the confrontation request information may include gender information, age information, average song score information of the user, region information of the location where the song service device is located, confrontation history information of the user, ranking information of the user, and the region where the user resides. It may include at least one of the information.

Furthermore, a song confrontation according to an embodiment of the present invention may be posted in real time through an application installed in the server 100 or the user device 300 described later. In this case, a response may be received from other viewers in real time, and the display unit of the song service device 200 being used by the first user P1 and the song service device 200 being used by the second user P2 ( An additional frame for displaying this may be displayed at 240. The posting of the song confrontation and the viewer response reception as described above may be determined based on the selection input of the first user and the second user.

In addition, the controllers D1 and D2 for controlling the operation of the song service apparatus 200 illustrated in FIG. 7 may be remote controllers or user equipments 300 equipped with an application that may perform a function of a remote controller. It may be.

8 illustrates components of a server according to another embodiment of the present invention.

The server 100 for providing a song service may include a reception module 110, a memory module 120, a control module 130, and a network module 140.

The receiving module 110 receives a composite image generated based at least in part on a first image photographed by at least a portion of the user and a second image generated based at least in part on the song service usage information. The song service usage information may include at least one of time information, price information, music information, and music selection information that the user intends to use the song service apparatus.

In addition, the memory module 120 may store the composite image based on user identification information. Here, the user identification information includes at least one of ID information of the user, gender information of the user, age information of the user, residence area information of the user, and song service device history information used by the user. The scope of the right is not limited thereto.

The control module 130 determines a category for the synthesized image based on at least one of the user identification information and the song service usage information, and based on the determined category, location information to store the synthesized image and location information to be shared. Determine.

In other words, the control module 130 may include time information, money information, music information, music selection information, ID information of the user, gender information of the user, age information of the user, and the like. A category to which the synthesized image generated for the user belongs is determined based on at least one of the user's living area information and the song service device history information used by the user. Thus, referring to FIG. 9, it is easy to publish a website about the synthesized image.

More specifically, the one or more composite images received from the song service device 200 may be based on at least one of song service device identification information of the song service device 200 and information on a place where the song service device 200 is physically located. Can be categorized.

In addition, the control module 130 may generate a user interface for allowing editing of the composite image. In this regard will be described later with reference to FIG.

In addition, the control module 130 determines to assign a score to the synthesized image based at least in part on feedback of other users of the synthesized image, and the feedback may include views, recommendations, and ratios for the synthesized image. It may include at least one of the number of recommendations, the number of sharing and the evaluation scores given from other users. Exemplary descriptions as described above are only examples according to an embodiment of the present invention, and various elements which are not described may be included within the scope of the present invention.

In addition, the control module 130 may determine a point for the user based at least in part on the score for the composite image and the song service usage information of the user. Such a point may be used to perform at least one of an editing operation on a pre-synthesized image, a sharing operation on the synthesized image, and a payment information processing operation generated based at least in part on the song service usage information.

In addition, the control module 130 may perform the synthesis to the user device corresponding to the user in at least one of when feedback of other users on the composite image is received and when the point exceeds a predetermined threshold point. It may be determined to transmit at least one of feedback information of other users on the image and point information including the point. In this way, the user can monitor the feedback of other users on the composite image uploaded by the user.

The control module 130 additionally executes a predetermined algorithm based on the user selection input including the user's song service usage information and confrontation request information received from the song service apparatus 200, thereby executing the song service apparatus ( 200 and a plurality of other users who are using the other song service apparatus connected through the network, may determine a confrontation partner for performing the song confrontation. Further, the control module 130 allows the song confrontation based on whether the confrontation received from the user and the confrontation opponent is approved. Here, the confrontation request information may include gender information, age information, average song score information of the user, region information of the location where the song service device is located, confrontation history information of the user, ranking information of the user, and the region where the user resides. Include at least one of the information and the scope of the present invention is not limited thereto. As described above, gender information, age information, average song score information of the user, region information where the song service device is located, confrontation history information of the user, ranking information of the user, and region information in which the user resides Since the confrontation partner is determined based on the confrontation request information including at least one of the two, the user's interest in using the song service device 200 may be enhanced.

In addition, the network module 140 allows the user apparatus 300 and / or the song service apparatus 200 to access the server 100 to transmit and receive various information.

According to an embodiment of the present invention, the network is a public switched telephone network (PSTN), x Digital Subscriber Line (xDSL), Rate Adaptive DSL (RADSL), Multi Rate DSL (MDSL), and Very High Speed DSL (VDSL). ), Various wired communication systems such as Universal Asymmetric DSL (UDASL), High Bit Rate DSL (HDSL), and Local Area Network (LAN).

In addition, the networks presented herein include Code Division Multi Access (CDMA), Time Division Multi Access (TDMA), Frequency Division Multi Access (FDMA), Orthogonal Frequency Division Multi Access (OFDMA), Single Carrier-FDMA (SC-FDMA), and Various wireless communication systems can be used, such as other systems.

The network according to an aspect of the present invention may be configured regardless of communication modes such as wired and wireless, and may be configured with various communication networks such as a personal area network (PAN) and a wide area network (WAN). Can be. In addition, the network may be a well-known World Wide Web (WWW), or may use a wireless transmission technology used for short-range communication such as infrared (IrDA) or Bluetooth (Bluetooth).

Components included in the system shown in FIG. 8 are exemplary, and only some of the components may constitute the system, or additional component (s) other than the components may be included in the system.

According to a further aspect of the present invention, a computer readable storage medium may be included in the server 100. Such storage media may include any type of storage media on which programs and data are stored such that they can be read by a computer system.

Additionally, the program is a computer program stored on a computer-readable recording medium, for example, comprising a plurality of instructions executed by one or more processors, wherein the first image and at least a portion of a user are photographed using the song service. Receiving a composite image generated based at least in part on a second image generated based at least in part on the information—the song service usage information includes time information, money information, At least one of: number information and selection information; A command for storing the synthesized image based on user identification information, wherein the user identification information includes ID information of the user, gender information of the user, age information of the user, location information of the user, and a song used by the user. At least one of service device history information; And determining a category for the synthesized image based on at least one of the user identification information and the song service use information, and determining the location information to store the synthesized image and the location information to share based on the determined category. It may include.

According to one aspect of the present invention, such a medium may be a ROM (Read Only Memory), a RAM (Random Access Memory), a CD (Compact Disk) -ROM, a DVD (Digital Video Disk) -ROM, a Magnetic Tape, a Floppy Disk, Optical Data Storage, and the like, and may also include those implemented in the form of a carrier wave (eg, transmission over the Internet). In addition, such media may be distributed over systems coupled with network modules to store computer readable codes and / or instructions in a distributed fashion.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments can be implemented by the control module 130 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code may be implemented in software applications written in a suitable programming language. The software code may be stored in the memory module 120 and executed by the control module 130.

9 is a first example of a user interface according to an embodiment of the present invention.

10 is a second example of a user interface according to an embodiment of the present invention.

11 is a third example of a user interface according to an embodiment of the present invention.

12 is a fourth example of a user interface according to an embodiment of the present invention.

9 to 12, and the above-described interfaces may be displayed on the display unit of the user device 300, for example.

According to an embodiment of the present invention as described above, a composite image generated based at least in part on a first image photographed by at least a portion of the user and a second image generated based at least in part on the song service usage information. For example, may be categorized and stored. In addition, a highlight image may be generated based at least in part on user feedback of the composite image. In addition, in order to receive user feedback on the confrontation image, it may be determined to output in any category. Such images may be distributed to any website and / or any application based on input at the song service device 200 and / or input at the user device 300.

9 illustrates any website that distributes images associated with an event generated in accordance with one embodiment of the present invention. Such a website may include at least one of images generated according to an embodiment of the present invention, for example, a song service device identification information, a user identification information of a song service device, song selection information, and region. Can be stored correspondingly. It may also be searched and / or classified according to at least one of the elements described above in any of the above websites.

For example, a composite image / confrontation image related to the same genre may be classified for each country based on region information in which the song service device included in the song service device identification information is located. Alternatively, the composite image / confrontation image may be classified based on the nationality of the user included in the song service user identification information.

FIG. 10 illustrates an interface that may be output from the user device 300 when a selection input for at least one of images posted on any website as shown in FIG. 9 is received. The interface as shown may be delivered to various locations via a network. For example, the SNS service account may share the image included in the interface to other SNS's SNS.

11 is any video editing application that may be provided to a song service device user in accordance with an embodiment of the present invention. As described above, the user may receive a composite image / confrontation image. For example, the image may be received by a user device related to the user. In this case, the user may edit the image according to his or her preference. 11 illustrates an editing layout that may be provided to a user, and the scope of the present invention is not limited thereto.

Also, an image edited and produced based on FIG. 11 may be distributed to any website shown in FIG. 10 and reproduced on the user device shown in FIG.

12 illustrates a point system that may be provided to users using a computer program stored in a server, an apparatus, and a computer readable medium for providing the song service, according to an embodiment of the present invention. As described above, a point for the user may be determined based at least in part on the score for the composite video and the song service usage information of the user.

Referring to the user interface 307 of FIG. 12, Kwon has acquired 8,195 points, and uses these points to at least partially edit the composite video, share the composite video, and use song information. At least one of the payment information processing operations generated based on the above may be performed.

In addition, for easy utilization of the point, at least one of when the feedback of other users on the composite image is received and when the point exceeds a predetermined threshold point, the user corresponding to the user At least one of feedback information of other users and the point information including the point may be transmitted to the apparatus 300.

The interfaces shown and described in FIGS. 9-12 are 109, 111, and 113 only illustrative steps for providing a song service to the user device 300, and the scope of the present invention is not limited thereto. In other words, Elements shown in FIGS. 9-12 and displayed in the above-described interfaces may be omitted, added, or changed by the needs of those skilled in the art and / or user.

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art to which the present invention pertains without departing from the spirit and scope of the present invention as set forth in the claims below It will be appreciated that modifications and variations can be made.

One of ordinary skill in the art will understand that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, instructions, information, signals, bits, symbols, and chips that may be referenced in the above description may include voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields. Or particles, or any combination thereof.

One of ordinary skill in the art would appreciate that the various exemplary logical blocks, modules, processors, means, circuits and algorithm steps described in connection with the embodiments disclosed herein may be implemented in electronic hardware, It will be appreciated that for purposes of the present invention, various forms of program or design code, or combinations thereof, may be implemented. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design constraints imposed on the overall system. Those skilled in the art may implement the described functionality in various ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

It is to be understood that the specific order or hierarchy of steps in the processes presented is an example of exemplary approaches. Based upon design priorities, it is understood that the specific order or hierarchy of steps in the processes may be rearranged within the scope of the present invention. The accompanying method claims present elements of the various steps in a sample order, but are not meant to be limited to the specific order or hierarchy presented.

The description of the presented embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the invention. Thus, the present invention should not be limited to the embodiments set forth herein but should be construed in the broadest scope consistent with the principles and novel features set forth herein.

Claims (1)

A first image in which at least a portion of a user is photographed by a camera module, which is one component of a karaoke service apparatus, selection information that is information about a song selection of the user transmitted from the karaoke service apparatus, and confrontation request information transmitted from the karaoke service apparatus; A receiving module for receiving;
A control module configured to synthesize a second image, which is a virtual image of a singer or a character, generated based on the first image and the music selection information, to generate a composite image in which augmented reality is grafted; And
A memory module configured to store the synthesized image based on user identification information, wherein the user identification information is used by the user's ID information, the user's gender information, the user's age information, the user's residence information, and the user's ID information. At least one of song service device history information;
Including,
The confrontation request information includes gender information, age information, average song score information of the user, region information of the location where the song service device is located, confrontation history information of the user, ranking information of the user, and the region where the user resides. At least one of the information,
The control module,
Determine a category for the synthesized image based on the user identification information and the music selection information, and determine location information to store the synthesized image and location information to share based on the determined category;
Allow a song confrontation for a plurality of other users who are using another song service device connected through the network with the song service device based on the song selection information and the confrontation request information;
Assign a point to the composite image based on feedback of other users to the composite image including at least one of a number of views, recommendation numbers, non-recommendations, sharing counts, and evaluation scores given from other users of the composite image. Determine and transmit at least one of feedback information, which is information about the feedback, to the karaoke service device, and point information, which is information about the point.
Server device for providing a service of song confrontation.

Images