KR101136279B1 - System, server, terminal, method, and recording medium for providing media check-in service - Google Patents

Abstract

PURPOSE: A system for providing a media check in service, a server thereof, a terminal thereof, a method thereof, and a recording media thereof are provided to confirm whether a viewer watches corresponding broadcasting content by using sound pattern recognition technology. CONSTITUTION: A content server(400) combines a sound pattern corresponding to a certain content to the content. The content server generates broadcasting content. A broadcasting terminal(500) transmits the broadcasting content by displaying it visually or in sound. A user terminal(300) recognizes the sound pattern of the transmitted broadcasting content. The user terminal displays service information corresponding to the sound pattern.

Description

System, Server, Terminal, Method, and Recording Medium for Providing Media Check-in Service

The present invention relates to a technology for providing a media check-in service, and more specifically, to watching media for a corresponding broadcast content when watching a broadcast (home shopping, movie, drama, etc.) using a sound pattern recognition technology. System, server, terminal, method, and recording medium for providing a media check-in service, which enables the user to check whether or not to provide detailed viewer information, recommend and pay related products, and execute advertisements and events. It is about.

Recently, more and more cases of viewing and receiving impressions through social network services (SNS) while watching television (TV) are increasing. For example, during the Super Bowl, which was held on February 6, 2011, Twitter users sent more than 4,000 messages per second, breaking the record of the 2010 World Cup football game. It also recorded the highest number of Twitter messages ever.

Dick Costolo, CEO of Twitter, emphasized that "online conversations about TV programs are turning TV viewing into a real-time event."

According to a recent survey conducted by market research firms Nielsen and Yahoo, 86% of mobile Internet users say they use SNS, text messages, and web services through mobile devices while watching TV.

Motorola Mobility, Motorola's mobile phone and TV set-top box division, reported in a media usage survey released late last year that 42% said they shared opinions about what they are watching via email, instant messenger, or social media while watching TV. It turned out.

In addition, 22% of respondents say multitasking via SNS is one of the usual things they do while watching TV.

Based on the survey results, Motorola Mobility also predicted that the expansion of SNS and TV widgets will further strengthen the integration of TV viewing and SNS usage.

"The growth of the Internet has led consumers to consume media in a more interactive way," said Scott Campbell, professor of electronics at Michigan University. "Because Internet users are accustomed to multitasking and looking at information quickly, "I tend not to concentrate on watching TV," he said.

In this context, development of technology for providing TV program based SNS service is required.

The present invention is to meet the above-described needs, the purpose of which is to use the acoustic pattern recognition technology, to check the media viewing for the corresponding broadcast content when watching the broadcast (home shopping, movie, drama, etc.) The system, server, terminal, method, and recording medium for providing a media check-in service for providing viewers with detailed information exposure, related product recommendation and payment, advertisement, and event execution related to the broadcasting content. To provide.

In particular, by implementing a mapping database (DB) between sound patterns and specific codes (products, event recommendation URLs, etc.), content providers can drop the specific codes when requesting sound pattern information for each content (home shopping, movie, drama, etc.). The operator synthesizes the specific code into the inaudible sound and transmits it to the content, and when the customer watching the broadcaster runs the pattern recognition app on the terminal, the user conveniently receives and pays for the product or event information corresponding to the viewing content. To provide a system, a server, a terminal, a method, and a recording medium for providing a media check-in service.

In order to achieve the above object, a system for providing a media check-in service according to an aspect of the present invention receives a pattern code corresponding to an arbitrary content and assigns an acoustic pattern generated according to the received pattern code to the content. A content server for combining to generate broadcast content; A broadcast terminal for visually and / or audibly displaying and transmitting the generated broadcast content; A user terminal that recognizes the sound pattern from the broadcast content, receives service source information corresponding to the recognized sound pattern, and receives and displays corresponding service information based on the received service source information; Media check-in providing the pattern code to the content server according to the content related information received from the content server, and providing the service source information to the user terminal according to the pattern code corresponding to the acoustic pattern received from the user terminal. server; And a service server for providing the corresponding service information to the user terminal according to the service source information received from the user terminal.

The media check-in server generates the pattern code, and the pattern code may include a media check-in code for identifying the corresponding content and a media sequence code sequentially indicating the total playing time of the corresponding content by dividing the unit time.

The media check-in server may register or update service source information corresponding to each media sequence code according to a request from the content server.

The user terminal receives a pattern code corresponding to the recognized sound pattern from the media check-in server, and synchronizes time with the service server based on the media sequence code of the received pattern code to receive the corresponding service information. To help.

The media check-in server may check whether media is checked in for the corresponding content based on the media check-in code of the received sound pattern.

In order to achieve the above object, the media check-in server for providing a media check-in service according to another aspect of the present invention, the pattern code generation unit for generating a pattern code corresponding to a specific sound pattern according to the content-related information for any content ; And a service source provider for receiving a sound pattern from a user terminal and providing service source information corresponding to the pattern code of the received sound pattern to the user terminal.

In order to achieve the above object, a media check-in server for providing a media check-in service according to another aspect of the present invention generates a pattern code for generating a pattern code corresponding to a specific sound pattern according to content-related information about arbitrary content. part; And a service source provider for receiving a pattern code from a user terminal and providing service source information corresponding to the received pattern code to the user terminal, wherein the pattern code is a media check-in code for identifying the corresponding content. And a media sequence code which sequentially divides the total playing time of the corresponding content into unit time, and sequentially registers or updates the service source information according to the content related information with the media sequence code of the pattern code. ; And a media check-in checker configured to check whether media is checked in for the corresponding content based on the media check-in code of the pattern code received from the user terminal.

In order to achieve the above object, a user terminal for providing a media check-in service according to another aspect of the present invention, the sound pattern recognition unit for recognizing a sound pattern in the broadcast content transmitted from the broadcast terminal; A service source receiver configured to receive service source information corresponding to the pattern code of the recognized sound pattern from a media check-in server; And a service information receiver configured to receive and display service information corresponding to the service source information from a service server, wherein the pattern code includes a media check-in code for identifying the corresponding content and a total playing time of the corresponding content in unit time. A service synchronization unit for receiving the service information by synchronizing a time with the service server based on a media sequence code of a pattern code corresponding to the recognized sound pattern; A service synchronizer configured to receive a pattern code corresponding to the recognized sound pattern from the media check-in server, and synchronize the time with the service server based on the media sequence code of the received pattern code to receive the service information; A media check-in performer which transmits a media check-in code of a pattern code corresponding to the recognized sound pattern to the media check-in server to perform media check-in for the corresponding broadcast content; And a media check-in performer which transmits the recognized sound pattern to the media check-in server to perform media check-in for the corresponding broadcast content.

In order to achieve the above object, a method for providing a media check-in service according to another aspect of the present invention is a method performed in a system for providing a media check-in service, (a) in the content server, corresponding to any content; Receiving a pattern code, and combining the acoustic pattern generated according to the received pattern code with the content to generate broadcast content; (b) at the broadcast terminal, transmitting and displaying the generated broadcast content visually and / or audibly; (c) Recognizing the sound pattern in the transmitted broadcast content, receiving service source information corresponding to the recognized sound pattern at the user terminal, and receiving the corresponding service information based on the received service source information. Displaying; (d) in the media check-in server, provide the pattern code to the content server according to the content related information received from the content server, and provide the service source information according to the pattern code corresponding to the acoustic pattern received from the user terminal. Providing to the user terminal; And (e) providing, at the service server, the corresponding service information to the user terminal according to the service source information received from the user terminal. A pattern code may be generated, and the pattern code may include a media check-in code for identifying the corresponding content and a media sequence code sequentially indicating the total playing time of the corresponding content by dividing the unit time.

In the step (d), the media check-in server may register or update service source information corresponding to each media sequence code in response to a request from the content server.

Further, in the step (c), the user terminal receives a pattern code corresponding to the recognized acoustic pattern from the media check-in server, and synchronizes time with the service server based on the media sequence code of the received pattern code. The corresponding service information can be received.

In addition, in step (d), the media check-in server may check whether media is checked in for the corresponding content based on the media check-in code of the received sound pattern.

In order to achieve the above object, a method for providing a media check-in service according to another aspect of the present invention is a method performed in a media check-in server for providing a media check-in service, which includes: (a) content related information about any content; Generating a pattern code corresponding to a specific acoustic pattern according to the method; And (b) receiving a sound pattern from the user terminal and providing service source information corresponding to the pattern code of the received sound pattern to the user terminal.

In order to achieve the above object, a method for providing a media check-in service according to another aspect of the present invention is a method performed in a media check-in server for providing a media check-in service, which includes: (a) content related information about any content; Generating a pattern code corresponding to a specific acoustic pattern according to the method; And (b) receiving a pattern code from a user terminal and providing service source information corresponding to the received pattern code to the user terminal, and (c) service source information according to the content related information. Registering or updating by matching the media sequence code of the pattern code; And checking whether media is checked in for the corresponding content based on the media check-in code of the pattern code received from the user terminal.

The pattern code may include a media check-in code for identifying the corresponding content and a media sequence code sequentially indicating the total playing time of the corresponding content by dividing the unit time.

In order to achieve the above object, a method for providing a media check-in service according to another aspect of the present invention is a method performed in a user terminal for providing a media check-in service, which includes: (a) sound in broadcast content transmitted from a broadcasting terminal; Recognizing a pattern; (b) receiving service source information corresponding to the pattern code of the recognized acoustic pattern from a media check-in server; And (c) receiving and displaying service information corresponding to the service source information from a service server, and (d-1) based on a media sequence code of a pattern code corresponding to the recognized sound pattern. Synchronizing a time with the service server to receive the service information; (d-2) receiving a pattern code corresponding to the recognized sound pattern from the media check-in server, and synchronizing time with the service server based on the media sequence code of the received pattern code to receive the service information Step for; (e-1) performing a media check-in for the corresponding broadcast content by transmitting a media check-in code of a pattern code corresponding to the recognized sound pattern to the media check-in server; And (e-2) transmitting the recognized sound pattern to the media check-in server to perform media check-in for the corresponding broadcast content.

The pattern code may include a media check-in code for identifying the corresponding content and a media sequence code sequentially indicating the total playing time of the corresponding content by dividing the unit time.

According to another aspect of the present invention for achieving the above object, a computer-readable recording program recorded in the system, the media check-in server and the method for providing the media check-in service performed in the user terminal, respectively A medium can be provided.

As described above, according to various aspects of the present invention, when viewing a broadcast (home shopping, movie, drama, etc.) by using a sound pattern recognition technology, it is possible to check whether the media is watched for the corresponding broadcast content and at the same time, The viewer may provide detailed information exposure of the product, recommendation and payment of related products, and execution of advertisements and events.

In addition, a media check-in server implements a mapping database (DB) between sound patterns, pattern codes, and service source codes (products, event recommendation URLs, etc.) so that content providers request sound pattern information for each content (home shopping, movie, drama, etc.). When the user drops the corresponding pattern code, the content provider synthesizes and transmits an acoustic pattern corresponding to the corresponding pattern code to the content as an inaudible sound, and when the customer watching the broadcast drives the pattern recognition app on the terminal, the viewing content You can conveniently receive a variety of information, such as products or events that meet the need to proceed with payment in some cases.

In addition, it is possible to register, modify, and delete time-synchronized information through a media check-in code that recognizes the content (or media) and a media sequence code that is commonly used as a media to check the play time of the content. As a result, an effect of providing the related information in the content corresponding to the time of watching the broadcast content is created.

1 is a block diagram of a system for providing a media check-in service according to an embodiment of the present invention;
2 is a block diagram of a media check-in server for providing a media check-in service according to an embodiment of the present invention;
3 is a block diagram of a user terminal for providing a media check-in service according to an embodiment of the present invention;
4 is a flowchart of a method for providing a media check-in service in a system according to an embodiment of the present invention;
5 is a flowchart of a method for providing a media check-in service in a media check-in server according to an embodiment of the present invention;
6 is a flowchart illustrating an example of a method for registering content information in a method for providing a media check-in service according to an embodiment of the present invention;
7 is a flowchart illustrating an example of a method of updating content information in a method for providing a media check-in service according to an embodiment of the present invention;
8 is a flowchart of a method for providing a media check-in service in a user terminal according to an embodiment of the present invention;
9 is a diagram showing the structure of a pattern code in the method for providing a media check-in service according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described in detail an embodiment of the present invention. In the reference numerals to the elements of each drawing, the same elements are designated by the same reference numerals as much as possible even though they are shown in different drawings. In addition, when it is determined that the detailed description of the known configuration or function related to the description of the embodiments of the present invention may obscure the gist of the present invention, the detailed description thereof will be omitted.

1 is a configuration diagram of a system for providing a media check-in service according to an exemplary embodiment of the present invention. As shown in the figure, the communication network 100, the media check-in server 200, the user terminal 300, and a content server ( 400, a broadcast terminal 500, a service server 600, and a customer relationship management (CRM) server 700.

The communication network 100 according to the present embodiment is wired between the media check-in server 200, the user terminal 300, the content server 400, the broadcast terminal 500, the service server 600, and the CRM server 700. Any network may be used alone or in combination to allow one-way or two-way communication by connecting to a wireless network and / or the Internet.

The media check-in server 200 according to the present embodiment generates the pattern code according to the content related information received from the content server 400 or input from the outside and provides the content code to the content server 400, and receives it from the user terminal 300. The service source information is found in a pre-established database according to the sound pattern or the pattern code corresponding to the sound pattern and provided to the user terminal 300.

For reference, the sound pattern according to the present embodiment uses an inaudible sound pattern, but is not limited thereto and may use an audible sound pattern in some cases.

The pattern code generated by the media check-in server 200 according to the present embodiment may include, for example, a media check-in code for identifying the corresponding content and a media sequence code sequentially indicating the total playing time of the corresponding content by dividing the unit time by unit time. It may include. The frame structure of the pattern code according to the present embodiment will be described later in detail.

The media check-in server 200 according to the present exemplary embodiment may register or update service source information corresponding to each media sequence code in a database according to a request from the content server 400 or an administrator.

Content related information according to the present embodiment may include, for example, a business name for a content, a broadcast channel, a broadcast time (total playback time), a program name (content name), and the like. Or information about a predefined scene number or a narrative structure indicating initiation, development, ending, etc. in the content, and as another example, a device type of a broadcast terminal to which the corresponding content is transmitted (for example, The terminal may further include terminal related information such as a smartphone, an IPTV, a DMB, a general TV, and a location of the device (eg, GPS, Cell, etc.), but the present invention is not limited thereto. .

In the present embodiment, the media check-in server 200 may receive terminal related information on the device type and location of the broadcast terminal to which the corresponding content is to be transmitted as content related information from the broadcast terminal 500 or the outside, and the terminal related information. Can be included in the pattern code.

The database according to the present embodiment may include a mapping table in which content related information, a pattern code, a sound pattern, and a service source information are matched with each other and stored. For example, the database may be built in the media check-in server 200.

The media check-in server 200 according to the present exemplary embodiment may check whether the media is checked in for the corresponding content based on the acoustic pattern received from the user terminal 300 or the media check-in code of the acoustic pattern.

The user terminal 300 according to the present embodiment recognizes a sound pattern in broadcast content transmitted from the broadcast terminal 500, receives service source information corresponding to the recognized sound pattern from the media check-in server, and receives the received sound pattern. A mobile communication terminal for receiving and displaying the corresponding service information from the corresponding service server 600 based on the service source information, for example, capable of at least one of voice / video communication, data communication, Internet communication, SNS, etc .; It may be implemented as a PDA, a smart phone, or a tablet PC.

The user terminal 300 according to the present embodiment may receive corresponding service information by synchronizing time with the service server 600 based on the media sequence code of the pattern code corresponding to the recognized sound pattern.

The user terminal 300 according to the present exemplary embodiment receives a pattern code corresponding to the corresponding acoustic pattern from the media check-in server 200 based on the acoustic pattern recognized in the broadcast content, or recognizes from the broadcast content in another example. The pattern code can be extracted by itself from the acoustic pattern.

The content server 400 according to the present embodiment requests a pattern code while delivering content related information to the media check-in server 200, and in response to the request, the pattern code corresponding to the corresponding content from the media check-in server 200. Next, the broadcast content may be generated by combining the inaudible sound pattern generated according to the received pattern code with the corresponding content.

In addition, the content server 400 may perform a request for registration or update of the corresponding content and content related information for the media check-in service through communication with the media check-in server 200, and as a result, the database of the media check-in server 200. The corresponding content and the content related information may be registered or updated by matching the corresponding pattern code, sound pattern, and service source information. An example thereof will be described later with reference to FIGS. 6 and 7.

The broadcast terminal 500 according to the present embodiment is for displaying and transmitting broadcast content generated by a content server in at least one of visual and auditory manners (hereinafter, visually and / or acoustically), for example, a smartphone. , IPTV, DMB, or general TV.

The service server 600 according to the present embodiment is to provide the corresponding service information to the user terminal 300 according to the service source information received from the user terminal 300, and one if the service provider is different according to the service source information. The service server 600 may be included.

In addition, the service server 600 according to the present embodiment may provide the corresponding service information by synchronizing the service time with the user terminal 300 based on the media sequence code of the pattern code corresponding to the acoustic pattern.

In the present embodiment, the service information may be product recommendation and purchase, price comparison, advertisement / event recommendation, SNS interworking, viewing confirmation, replay, real-time questionnaire / voting, and providing a customized service in connection with a CRM server.

In the present embodiment, the service information may be provided in a manner of providing information according to the type / type / property of the information. For example, in the case of a real-time questionnaire / voting, the service information may be provided between the service server 600 and the user terminal 300. As a result, it may be provided continuously in real time, and in the case of a single advertisement, for example, a single advertisement may be provided to the user terminal 300 from the service server 600.

The CRM server 700 according to the present embodiment collects the service (service information provision) details of the user of the user terminal 300 through communication with the service server 600, and accumulates and processes the collected information to the customer. It can be used for relationship management.

2 is a block diagram of a media check-in server for providing a media check-in service according to an exemplary embodiment of the present invention, which is a detailed configuration diagram of the media check-in server 200 of FIG. 1. 210, the service source provider 220, the service source registerer 230, and the media check-in checker 240 may be included.

The pattern code generation unit 210 according to the present embodiment is to generate a pattern code corresponding to a specific sound pattern according to content related information about arbitrary content, and the content related information is a pattern code request from the content server 400. It can be provided with or input from the administrator.

The pattern code according to the present embodiment may include a media check-in code for identifying the corresponding content and a media sequence code for identifying the corresponding content related information and matching the service source information.

 As shown in FIG. 9, the pattern code according to the present embodiment divides the total play time (n * m) of the corresponding content (or media original audio) by the unit time (n seconds), and 0. The media checkin code and the media sequence code from 0 to m may be sequentially assigned to each unit time interval from to m, respectively, to form a structure of a recorded data frame.

When the data frame of the pattern code is configured as shown in FIG. 9, the media sequence includes the content-related information (for example, identification information about a specific product or person appearing in the content) recorded audiovisually within each unit time section of the corresponding content. You can build a database by matching code and service source information.

The service source information according to the present embodiment is source information for providing a service matching the content related information, and may include, for example, a Uniform Resource Locator (URL) or a Uniform Resource Name (URN).

The service source provider 220 according to the present exemplary embodiment may receive a sound pattern from the user terminal 300 and provide service source information corresponding to the pattern code of the received sound pattern to the user terminal 300, for example. For example, the user may receive a pattern code from the user terminal 300 and provide service source information corresponding to the received pattern code to the user terminal 300.

The service source registration unit 230 according to the present exemplary embodiment is for registering or updating service source information based on content related information with a media sequence code of a pattern code.

The media check-in checker 240 according to the present embodiment is for checking whether the media is checked in for the corresponding content based on the media check-in code of the acoustic pattern or the pattern code received from the user terminal 300.

3 is a configuration diagram of a user terminal for providing a media check-in service according to an exemplary embodiment of the present invention, which is a detailed configuration diagram of the user terminal 300 of FIG. 1, and as shown in FIG. ), A service source receiver 320, a service information receiver 330, a service synchronizer 340, and a media check-in performer 350.

The sound pattern recognition unit 310 according to the present embodiment is for recognizing the sound pattern in the broadcast content transmitted from the broadcast terminal, and may include, for example, a microphone capable of receiving inaudible sound or audible sound. Can be.

The service source receiver 320 according to the present embodiment receives the service source information corresponding to the pattern code of the corresponding acoustic pattern from the media check-in server 200 based on the acoustic pattern recognized through the acoustic pattern recognizer 310. As an example, a sound pattern recognized as an example may be sent to the media check-in server 200 to request service source information, and in response to the request, service source information may be received from the media check-in server 200, or the sound pattern recognized as another example. Extracts the pattern code and sends the extracted pattern code to the media check-in server 200 to request service source information, and receive service source information from the media check-in server 200 in response to the request.

The service information receiver 330 according to the present embodiment requests the service information from the service server 600 based on the service source information received through the service source receiver 320, and in response to the request, the service server 600. To receive and display corresponding service information corresponding to service source information.

When the pattern code corresponding to the acoustic pattern is received from the media check-in server 200, for example, the service synchronizer 340 according to the exemplary embodiment of the present invention synchronizes the service server 600 with the service server 600 based on the media sequence code of the received pattern code. By synchronizing the time to receive the corresponding service information through the service information receiving unit 330, or as another example, based on the media sequence code of the pattern code extracted from the acoustic pattern recognized by the acoustic pattern recognition unit 300 ( 600 may be synchronized with time to receive the corresponding service information through the service information receiver 330.

The media check-in performer 350 according to the present exemplary embodiment transmits the media check-in code of the pattern code extracted from the acoustic pattern recognized through the acoustic pattern recognizer 300 to the media check-in server 200 to broadcast the broadcast. Media check-in for the content may be performed, or as another example, the sound pattern recognized through the sound pattern recognizer 300 may be transmitted to the media check-in server 200 to perform media check-in for the corresponding broadcast content.

4 is a flowchart of a method for providing a media check-in service in a system according to an embodiment of the present invention, which is described in parallel with the operation of the system because it is applied to the system of FIG.

First, the content server 400 requests the media check-in server 200 a pattern code for generating an acoustic pattern corresponding to a specific content, and transmits the content related information to the media check-in server 200 with the request ( S401).

Subsequently, the media check-in server 200 generates a corresponding pattern code in response to the request in step S401 and provides it to the content server 400 (S402).

Subsequently, the content server 400 generates an inaudible sound pattern according to the pattern code received in step S402 and combines the generated inaudible sound pattern with the corresponding content to generate broadcast content, and then generates the broadcast content. Provided to the broadcast terminal 500 (S403).

Subsequently, the broadcast terminal 500 visually displays the broadcast content provided in step S403 (S404), and transmits a sound pattern included in the displayed broadcast content (S405).

Subsequently, the user terminal 300 receives and recognizes the sound pattern transmitted in step S405 (S406), and transmits the recognized sound pattern or the pattern code extracted from the recognized sound pattern to the media check-in server 200. The media check-in request and / or service source information are requested while being transmitted together with the telephone number of 300 (S407).

Subsequently, the media check-in server 200 checks whether the media is checked in according to the request in step S407 (S408), and finds service source information corresponding to the received sound pattern or pattern code from the database and provides it to the user terminal 300. (S409).

Finally, the user terminal 300 requests service information from the corresponding service server 600 based on the service source information received in step S409 (S410), and the corresponding service server 600 based on the received service source information. The corresponding service information is provided to the user terminal 300 (S411), and the user terminal 300 displays the corresponding service information received in operation S411 and provides the user with the audiovisual display (S412).

Meanwhile, the user terminal 300 and the service server 600 may perform the service information request and the service information providing process in both directions interactively by time synchronization with each other based on the media sequence code of the pattern code in steps S410 and S411. Can be.

FIG. 5 is a flowchart illustrating a method for providing a media check-in service in a media check-in server according to an embodiment of the present invention, which is applied to the apparatus of FIG. 2, that is, the media check-in server 200. .

First, the pattern code generator 210 determines whether a pattern code request is received or input together with content related information about arbitrary content from the content server 400 (S501), and in step S501, the pattern code request is determined. If it is determined that the pattern code corresponding to the specific acoustic pattern is generated according to the content-related information and provided to the content server 400 (S502).

In addition, the service source provider 320 and the media check-in checker 240 determine whether there is a media check-in request and a service source information request by receiving a sound pattern (or pattern code) from the user terminal 300, respectively. In operation S503, when it is determined in step S503 that there is a media check-in request, the media check-in checker 340 determines the media from the user terminal 300 for the corresponding content based on the media check-in code of the received acoustic pattern (or pattern code). In operation S504, if it is determined in step S503 that there is a request for service source information, the service source provider 320 may correspond to the corresponding media sequence code based on the media sequence code of the received acoustic pattern (or pattern code). The service source information is found in the database and provided to the user terminal 300 (S505).

Meanwhile, the service source registration unit 230 of the media check-in server 200 transmits the corresponding service source information to the corresponding pattern code of the database according to the content related information received from the content server 400 through communication with the content server 400. Registration or updating may be performed by matching the media sequence code. An example of such a registration and update process will be described in detail with reference to FIGS. 6 and 7.

6 is a flowchart illustrating an example of content information registration method in a method for providing a media check-in service according to an embodiment of the present invention.

First, when the content server 400 transmits a media check-in registration request message including content information to the media check-in server 200 (S601), the media check-in server 200 registers based on the received media check-in registration request message. The media check-in code is checked for the requested content, and whether there is an error in the information of the content from the EPG or VOD guide information (S602). The content information in step S601 may include at least a business name, a channel, a broadcast time, a program name, and the like.

Subsequently, when the media check-in server 200 determines that the content requested for registration is new media as a result of checking in step S602 (S603), the media check-in server 200 generates and registers a pattern code according to the received content-related information (S604). As shown in FIG. 5, a mixing sound in which the media check-in code and the media sequence code of the corresponding pattern code are combined to generate the total play time PlayPlay is generated (S605).

Subsequently, the media check-in server 200 provides media content information including the media sequence code of the pattern code generated in step S604 and the mixing sound generated in step S605 to the content server 400 (S606), and the content server ( 400 is an insertion time (InsertTime) and end time (InsertTime) to which the corresponding content related information should be registered based on the mixing sound received in step S606 based on the content related information (for example, a brand name and a person name) for providing a service. Check and transmit to the media check-in server 200 (S607).

Finally, the media check-in server 200 relates the content to the corresponding media sequence code in the time sequence table of the corresponding media check-in code of the database according to the media check-in code, insertion time, end time, and content related information received in step S607. The registration information is matched with the corresponding service source information (S608), and a registration completion notification message including a media check-in code and a sequence code is transmitted to the content server 400 (S609).

7 is a flowchart illustrating an example of a method of updating content information in a method for providing a media check-in service according to an embodiment of the present invention.

First, when the content server 400 transmits a media check-in code inquiry request message including content information to the media check-in server 200 (S701), the media check-in server 200 based on the received media check-in code inquiry request message. Whether the media check-in code is pre-registered with respect to the corresponding content requested to be registered as is checked, and whether there is an error with respect to the information of the corresponding content from the EPG or VOD guide information (S702). The content information in step S701 may include at least a business name, a channel, a broadcast time, a program name, and the like.

Subsequently, when the media check-in server 200 determines that the media check-in code does not exist, the media check-in server 200 notifies that there is an error (S704). In step S705, it is transmitted.

Subsequently, the content server 400 changes the content (media) related information to be changed from the media check-in code received in step S705 and the content corresponding to the media check-in code, the insertion time (InsertTime) and the end time of the content-related information. While the information is transmitted to the media check-in server 200, a change request of the related information is requested (S706).

The media check-in server 200 determines whether a media sequence code corresponding to the insertion time (InsertTime) and end time (endTime) information of the media check-in code already exists in the database according to the request in step S706 (S707). ), If present, processes duplicate notification of the media sequence code and whether or not to overwrite the content related information to be updated through communication with the content server 400 (S708), and if not present, the media check-in code and insertion time received in step S706. Register and update the media sequence code, the content related information, and the corresponding service source information in the time sequence table of the corresponding media check-in code in the database according to the information on the end time and the content (S709). Media related information including sequence code, updated content related information, etc. The change notification message is transmitted to the content server 400 (S710).

8 is a flowchart illustrating a method for providing a media check-in service in a user terminal according to an exemplary embodiment of the present invention, which is applied to the apparatus of FIG. 3, that is, the user terminal 300, and thus will be described in parallel with the operation of the apparatus.

First, the acoustic pattern recognizer 310 receives and recognizes an acoustic pattern from broadcast content transmitted from the broadcast terminal 500 (S801), and the media check-in performer 350 and the service source receiver 320 recognize the received audio pattern. A media check-in request and a service source information request are performed to the media check-in server 200 based on the sound pattern or the pattern code extracted from the recognized sound pattern (S802).

Subsequently, the service source receiver 320 receives service source information corresponding to the pattern code of the recognized acoustic pattern from the media check-in server 200 according to the request in step S802 (S803), and the service information receiver 330 Requests service information from the corresponding service server 600 based on the service source information received in step S803 (S804), and receives and displays corresponding service information corresponding to the corresponding service source information from the corresponding service server 600. (S805).

On the other hand, the service synchronizer 340 synchronizes the service time with the service server 600 based on the media sequence code of the pattern code in steps S804 and S805 to interactively perform the service information request and the service information provision process. Make it work.

As described above, the method for providing a media check-in service according to an exemplary embodiment of the present invention may be implemented as a computer-readable recording medium including program instructions for performing various computer-implemented operations. The computer readable recording medium may include program instructions, local data files, local data structures, etc. alone or in combination. The recording medium may be those specially designed and constructed for the embodiments of the present invention or may be those known to those skilled in the computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical recording media such as CD-ROMs, DVDs, magnetic-optical media such as floppy disks, and ROM, RAM, flash memory, and the like. Hardware devices specifically configured to store and execute the same program instructions are included. The recording medium may be a transmission medium such as an optical or metal line, a wave guide, or the like, including a carrier wave for transmitting a signal designating a program command, a local data structure, or the like. Examples of program instructions may include high-level language code that can be executed by a computer using an interpreter as well as machine code such as produced by a compiler.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

100: Network
200: media check in server
210: pattern code generation unit
220: service source provider
230: service source register
240: media check-in confirmation
300: user terminal
310; Acoustic pattern recognition unit
320: service source receiver
330: service information receiving unit
340: service synchronization unit
350: media check-in performer
400: content server
500: broadcast terminal
600: service server
700: CRM server

Claims (45)

A content server for generating broadcast content by combining a sound pattern corresponding to arbitrary content with the content;
A broadcast terminal for visually and audibly displaying and transmitting the generated broadcast content; And
And a user terminal that recognizes the sound pattern in the transmitted broadcast content and displays corresponding service information corresponding to the recognized sound pattern. The method of claim 1,
Receiving content-related information from the content server, and further comprising a media check-in server for providing a pattern code according to the received content-related information to the content server,
And the content server generates the sound pattern in accordance with the pattern code provided from the media check-in server. The method of claim 2,
The media check-in server receives the recognized sound pattern from the user terminal, provides service source information according to the pattern code corresponding to the received sound pattern to the user terminal,
And the user terminal provides the corresponding service information based on the service source information provided from the media check-in server. The method of claim 3, wherein
And a service server for receiving the service source information from the user terminal and providing the corresponding service information according to the received service source information to the user terminal. The method of claim 4, wherein
The media check-in server generates the pattern code, and the pattern code includes a media check-in code for identifying the corresponding content and a media sequence code sequentially indicating the total playing time of the corresponding content by dividing the unit time. System for providing media check-in service. The method of claim 5,
And the media check-in server registers or updates service source information corresponding to each media sequence code in response to a request from the content server. The method of claim 5,
The user terminal receives a pattern code corresponding to the recognized sound pattern from the media check-in server, synchronizes time with the service server based on the media sequence code of the received pattern code, and receives the corresponding service information. System for providing a media check-in service, characterized in that. The method of claim 5,
The media check-in server checks whether the media checks in to the corresponding content based on the media check-in code of the received sound pattern. The method of claim 2,
The media check-in server receives terminal-related information about a device type and a location of a broadcast terminal to which the corresponding content is to be transmitted as content-related information from the broadcast terminal, and includes the terminal-related information in a pattern code. System for Service Delivery. The method of claim 4, wherein
The corresponding service information is provided continuously in real time according to mutual communication between the service server and the user terminal, or a system for providing a media check-in service, characterized in that provided in a single step from the service server. The method of claim 1,
And the acoustic pattern is an inaudible acoustic pattern. A pattern code generation unit generating a pattern code corresponding to a specific sound pattern according to content related information about arbitrary content; And
Receiving a sound pattern from a user terminal and providing a service source information corresponding to the pattern code of the received sound pattern to the user terminal,
The pattern code check-in server for providing a media check-in service, characterized in that it comprises a media check-in code for identifying the content and the media sequence code sequentially divided by the total playing time of the content in unit time. A pattern code generation unit generating a pattern code corresponding to a specific sound pattern according to content related information about arbitrary content; And
Receiving a pattern code from a user terminal and providing a service source information corresponding to the received pattern code to the user terminal;
The pattern code check-in server for providing a media check-in service, characterized in that it comprises a media check-in code for identifying the content and the media sequence code sequentially divided by the total playing time of the content in unit time. delete The method according to claim 12 or 13,
And a service source registration unit for registering or updating service source information according to the content related information with a media sequence code of a pattern code. The method according to claim 12 or 13,
The media check-in server for providing a media check-in service, further comprising a media check-in checker for checking whether media is checked in for the corresponding content based on the media check-in code of the pattern code received from the user terminal. An acoustic pattern recognition unit recognizing an acoustic pattern in the broadcast content transmitted from the broadcast terminal;
A service source receiver configured to receive service source information corresponding to the pattern code of the recognized sound pattern from a media check-in server; And
And a service information receiver configured to receive and display service information corresponding to the service source information from a service server. The method of claim 17,
The pattern code is a user terminal for providing a media check-in service, characterized in that it comprises a media check-in code for identifying the content and a media sequence code sequentially indicating the total playback time of the content by unit time. The method of claim 18,
And a service synchronization unit for receiving the service information by synchronizing a time with the service server based on a media sequence code of a pattern code corresponding to the recognized acoustic pattern. . The method of claim 18,
A service synchronization unit for receiving a pattern code corresponding to the recognized sound pattern from the media check-in server, and synchronizing a time with the service server based on the media sequence code of the received pattern code to receive the service information; User terminal for providing a media check-in service, characterized in that it comprises a. The method of claim 18,
A user for providing a media check-in service further comprising a media check-in performing unit for transmitting a media check-in code of a pattern code corresponding to the recognized sound pattern to the media check-in server to perform media check-in for the corresponding broadcast content. Terminal. The method of claim 17,
And a media check-in performer for transmitting the recognized sound pattern to the media check-in server to perform media check-in for the corresponding broadcast content. A method performed in a system for providing a media check-in service,
(a) in the content server, generating a broadcast content by combining a sound pattern corresponding to arbitrary content with the content;
(b) at the broadcast terminal, transmitting and displaying the generated broadcast content visually or audibly; And
(c) at the user terminal, recognizing the sound pattern in the transmitted broadcast content and displaying corresponding service information corresponding to the recognized sound pattern. 24. The method of claim 23,
Receiving a content related information from the content server at a media check-in server, and providing a pattern code according to the received content related information to the content server,
And the content server generates the sound pattern in accordance with the pattern code provided from the media check-in server. 25. The method of claim 24,
Receiving the recognized sound pattern from the user terminal in the media check-in server, and providing service source information according to the pattern code corresponding to the received sound pattern to the user terminal,
And the user terminal provides the corresponding service information based on the service source information provided from the media check-in server. The method of claim 25,
Receiving, at the service server, the service source information from the user terminal, and providing the corresponding service information according to the received service source information to the user terminal. The method of claim 26,
The media check-in server generates the pattern code, and the pattern code includes a media check-in code for identifying the corresponding content and a media sequence code sequentially indicating the total playing time of the corresponding content by dividing the unit time. How to provide media check-in service. The method of claim 27,
And the media check-in server registers or updates service source information corresponding to each media sequence code in response to a request from the content server. The method of claim 27,
In the step (c), the user terminal receives a pattern code corresponding to the recognized sound pattern from the media check-in server, synchronizes time with the service server based on the media sequence code of the received pattern code, and Method for providing a media check-in service, characterized in that receiving the service information. The method of claim 27,
The media check-in server checks whether the media is checked in for the content based on the media check-in code of the received sound pattern. 25. The method of claim 24,
The media check-in server receives the terminal-related information as the content-related information on the device type and location of the broadcast terminal to which the content is to be transmitted, from the broadcasting terminal, and includes the terminal-related information in the pattern code. How to Provide Services. The method of claim 26,
The corresponding service information is provided continuously in real time according to mutual communication between the service server and the user terminal, or a single check-in method for providing a media check-in service. The method of claim 23, wherein
And the acoustic pattern is an inaudible acoustic pattern. A method performed by a media check-in server for providing a media check-in service,
(a) generating a pattern code corresponding to a specific acoustic pattern according to the content related information about any content; And
(b) receiving a sound pattern from a user terminal, and providing service source information corresponding to the pattern code of the received sound pattern to the user terminal,
The pattern code includes a media check-in code for identifying a corresponding content and a media sequence code for sequentially displaying a total playing time of the corresponding content by unit time. A method performed by a media check-in server for providing a media check-in service,
(a) generating a pattern code corresponding to a specific acoustic pattern according to the content related information about any content; And
(b) receiving a pattern code from a user terminal, and providing service source information corresponding to the received pattern code to the user terminal,
The pattern code includes a media check-in code for identifying a corresponding content and a media sequence code for sequentially displaying a total playing time of the corresponding content by unit time. delete The method of claim 34 or 35,
and (c) registering or updating service source information according to the content related information by matching the media sequence code of the pattern code with the media source code. The method of claim 34 or 35,
(d) checking whether the media is checked in for the content based on the media check-in code of the pattern code received from the user terminal. As a method performed in a user terminal for providing a media check-in service,
(a) recognizing a sound pattern in broadcast content transmitted from a broadcast terminal;
(b) receiving service source information corresponding to the pattern code of the recognized acoustic pattern from a media check-in server; And
(c) receiving and displaying service information corresponding to the service source information from a service server. The method of claim 39,
The pattern code includes a media check-in code for identifying a corresponding content and a media sequence code for sequentially displaying a total playing time of the corresponding content by unit time. 41. The method of claim 40,
and (d-1) synchronizing time with the service server based on the media sequence code of the pattern code corresponding to the recognized sound pattern to receive the service information. Way for you. 41. The method of claim 40,
(d-2) receiving a pattern code corresponding to the recognized sound pattern from the media check-in server, and synchronizing time with the service server based on the media sequence code of the received pattern code to receive the service information The method for providing a media check-in service, further comprising the steps for. 41. The method of claim 40,
(e-1) providing a media check-in service for transmitting the media check-in code of the pattern code corresponding to the recognized sound pattern to the media check-in server to perform media check-in for the corresponding broadcast content. Way for you. The method of claim 39,
and (e-2) transmitting the recognized sound pattern to the media check-in server to perform media check-in for the corresponding broadcast content. 45. A computer readable recording medium having a program recorded thereon for the method for providing the media check-in service as claimed in any one of claims 23 to 35 and 39 to 44.

Images