WO2019221511A1 - Information providing method on basis of contents - Google Patents

Abstract

The present invention relates to an information providing method on the basis of contents, the method comprising the steps of: receiving original contents provided by a first user; extracting search information relating to the provided original contents; receiving selecting of reproduction position information or reproduction section information of the provided original contents; and receiving insertion contents input to correspond to the selected reproduction position information or reproduction section information.

Description

How to provide information centered on content

The present invention relates to a method of providing information centered on content, and allows anyone to register an embedded content corresponding to a part or a specific section of the original content so that activities such as promotion and sponsorship of the content can be freely and efficiently provided. It's about how you can do it.

The present invention relates to a method and system for retrieving information centered on content, and when a user consumes content, the user additionally retrieves and displays the inserted content from the received media signal. If there is an embedded content that you want to expose, it will be searched and displayed additionally.

The more young people enter the society, the more often they get a job, but in the case of self-employment or start-ups, they often have to promote their own businesses. These promotional tools are complex and costly, making them difficult to access for small businesses and startups. However, with the arrival of the information and telecommunication convergence era by the 4th Industrial Revolution, the methods and channels of public relations are becoming more diverse and easier to access.

In the era of the digital industrial revolution, which makes it easy for anyone to create content, an enormous amount of digital content is pouring out, and there are also a great variety of channels or content providers that transmit the content.

At this time, representative companies that make money by attaching advertisements in various forms to the streamed contents are YouTube and Facebook. However, if such content is duplicated and streamed in a channel other than the channel, the display of the advertisement may be somewhat complicated or impossible.

In the existing well-known technologies, there has been a method of searching for a signal of a content to be received, but there is no system for searching what related information is included in the signal. Moreover, for some content, the sponsored movie or documentary itself has high quality content. In other words, there was no way to easily support advertisements or sponsorships focused on contents.

Services like YouTube and Facebook are consumption-oriented content platforms. These companies may insert advertisements from other companies in the middle of media content when users who watch the content purchase or view the content. At this point, these companies are not selling content but are paying for their exposure to technical advertising.

In addition, the advertisement content exposed at this time may not be directly selected by the producers producing the media content, and second users who request the advertisement may not directly select the desired media content. In other words, the producer of the media content did not have a right to directly select a sales or licensing channel or a user who wants to advertise a licensing request.

Moreover, the content uploaded by the creator of the content could be part or all of the media content. At this time, it may be difficult to know that the media contents uploaded by the producer as a single independent content, so that such media contents can be divided or licensed separately. Therefore, it was difficult for users who purchase or browse contents to enjoy a little freedom or pleasure.

The present invention enables the insertion of other information or related other content into the original content. The present invention allows users to select a playback position or playback section corresponding to the original content in inserting other content into the original content.

The present invention allows to extract and store the search information that can easily search the original content or embedded content. The present invention enables the provision of a set of contents selected by several or other users.

The present invention is intended to provide a way to more easily use and search for advertisements or promotional materials embedded in the content. The present invention allows to extract and store the search information that can easily search the original content or embedded content.

According to the present invention, when there is a search request for arbitrary content, the content utilization is increased by searching and displaying not only the corresponding content but also content input by another user.

Information providing method centered on the content according to an embodiment of the present invention comprises the steps of receiving the original content from the first user; Extracting search information on the provided original content; Receiving selection of playing position information or playing section information of the provided original content; And receiving an inserted content corresponding to the selected play position information or the play section information.

The present invention further includes the step of extracting at least one nested information from the original content and storing the at least one nested information corresponding to the playback position of the original content. Content according to an embodiment of the present invention A method for searching for information centered on a user may include: extracting and storing at least one or more pieces of first search information from original content provided by a first user; Receiving selection of playback position information or playback section information of the original content; Receiving an inserted content corresponding to the selected play position information or the play section information; Extracting and storing second search information for the inserted content; Receiving a search request signal for any content; Extracting at least one identification information from the arbitrary content, and extracting the embedded content related to the arbitrary content by using the extracted identification information.

According to an embodiment of the present invention, a system for retrieving information based on content includes extracting and storing at least one or more pieces of first search information from original content provided by a first user, and reproducing location information of the original content or A server configured to receive playback section information, receive insertion content corresponding to the selected playback position information or the playback section information, and extract and store second search information for the inserted content; When receiving a search request signal for content, at least one or more identification information is extracted from the arbitrary content, and extracted content related to the arbitrary content is extracted using the extracted identification information, and the network is connected through a user display device. Information centering on the content And color.

According to the present invention, content-oriented promotion becomes possible.

According to the present invention, if an existing movie or music is rented for a fee, the content can be used in exchange for viewing an advertisement instead of paying money. According to the present invention, when a consumer listens to an audio playback device connected to a network, Advertisement and audio content can be used. In addition, according to the present invention, when a consumer listens to a radio device that plays audio through a server that transmits a radio signal, local advertisements and audio contents may be used.

According to the present invention, when a consumer watches through a network terminal, the content can be viewed exclusively and inserted according to the consumed content.

According to the present invention, the exclusive use and maintenance effect of the original content by the second user according to the transaction of the first user and the second user can be maximized.

According to the present invention, if the second user inputs the inserted content into the original content of the first user, even if the first user's content is copied without permission, it can be prevented because it is managed with unique fingerprint information. According to the present invention, the production environment and promotion effect of the content can be improved and talent donation or sales can be smoothed.

According to the present invention, when the first user is a writer, only a part of the input text may be sold or rented. According to the present invention, it is possible to help or induce the promotion of the second user according to the production capacity of the content.

According to the present invention, promotional information can be registered in music, movies, recommended book lists, or a passage of books and the contents of the book itself.

According to the present invention, it may be possible to sponsor based on a specific person included in the original content.

According to the present invention, the inserted content may be stored with respect to information output based on the facial expressions, gestures, and worn products of the person included in the original content. According to the present invention, the embedded content may be stored for information recognized from the contents of the contents such as facial expressions, human sounds, animal sounds, and natural sounds included in the contents.

1 is a diagram illustrating a network configuration for an information providing method centering on the contents of the present invention.

2 is a diagram illustrating an information providing method centered on content according to an embodiment of the present invention.

3 is a flowchart illustrating a method for providing information centered on content according to an embodiment of the present invention.

4 is a diagram illustrating an information retrieval method centered on content according to an embodiment of the present invention.

5 is a flowchart illustrating an information retrieval method centering on contents according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described an embodiment of the present invention in more detail. However, in the following description, when there is a risk of unnecessarily obscuring the gist of the present invention, a detailed description of well-known functions and configurations will be omitted.

1 is a network configuration diagram for a system centered on the contents of the present invention. Referring to FIG. 1, a system centering on the contents of the present invention may be configured of a server 100, a user 120 and 130, and an object related server 150.

The server 100 receives the original content from the first user 120, extracts the search information for the provided original content, and provides the original content for the information providing system based on the contents of the present invention. The play position information or play section information may be selected from the users 120 and 130, and in this case, the inserted content may be further input from the users 120 and 130 to correspond to the selected play position information or the play section information. .

The first user 120 is a user who uploads original content through the server 100 for the first time, and may be a musician, a movie director, a content creator, or the like as a business that produces or distributes content. In addition, the first user 150 may be a consumer who purchased content produced or distributed by another person. The first user 120 may provide the original content to the server 100 of the present invention to allow the server to register and store the original content. In addition, the first user 120 may select the playback position information or the playback section information of the original content, and input the inserted content into the server 100 to correspond to the selected playback position information or the playback section information as the inserted content. You can register and save.

The second user 130 may query the original content input or provided by the first user 120, and may input the inserted content related to the original content to the server 100. At this time, the second user may select the reproduction position information or the reproduction section information of the original content, input the insertion content into the server 100 to correspond to the selected reproduction position information or the reproduction section information, and register as the insertion content, Can be saved.

A detailed method of selecting the play position information or the play section information of the original content and inputting the inserted content to the server 100 to correspond to the selected play position information or the play section information will be described later.

The original content and the inserted content may include at least one of an image, an image, audio, text, and a set of signals transmitted from a user in real time.

On the other hand, the server 100 may be provided with a separate database 110 to store the original content, search information for the original content, embedded content, and the like.

The object related server 150 is a server of a company that produces, distributes, or promotes an object when the inserted content includes an advertisement image or description image, an advertisement image or description image, or text or sentence used in an advertisement. Can be.

The object may be any tangible commodity that is sold and transportable, intangible content, or the like, and may be a unique unique object, such as an art object, cultural property, creative article, or object with personality. In addition, the object may include any property, real estate, or intangibles that users can own, purchase, and experience, regardless of intangible services such as tourism products, restaurants, real estate, shopping malls, and performance venues.

In addition, the system for searching for information centering on the contents of the present invention, extracts and stores at least one or more first search information from the original content provided by the first user 120, and the playback position information of the original content or A server 100 configured to receive playback section information, receive insertion content corresponding to the selected playback position information or the playback section information, and extract and store second search information for the inserted content; When 100) receives a search request signal for arbitrary content, extracts at least one or more identification information from the arbitrary content, extracts an embedded content related to the arbitrary content by using the extracted identification information, and displays a user display. Display via network via device.

In addition, the system of the present invention may be implemented by an application programming interface (API). For example, the present invention may be applied to a case in which music or the like flows from the user display device or audio is output in a public place. In addition, the user display device may be a device that can be installed inside the taxi. The inserted content may be displayed or output according to a preference of the taxi driver uncle. The display device may be installed in a public place such as a restaurant, and content inserted into a ring tone of a mobile phone of a guest of the restaurant may be displayed. In addition, the inserted content may be extracted and output by detecting music flowing out of a coffee shop or the like. Meanwhile, in the case of an audio reproducing apparatus connected to a wireless network, music may be streamed and inserted content may be output together. In addition, the present system may be mounted on an artificial intelligence speaker or the like, and may extract and output the phrase or music inserted into the advertisement as the inserted content.

2A to 2E are diagrams illustrating an information providing method centered on content according to an embodiment of the present invention.

2A is a representative diagram illustrating an information providing method centering on contents of the present invention. Referring to FIG. 2A, a first user 250 may register or register an original content 200 with a system (not shown) by producing or obtaining the original content 200. The server may extract and store search information about the provided original content 200. The search information for the original content 200 may include a fingerprint of the content as information for easier and more accurate search after the content 200 is registered in the system. For example, when the server uploads the original content from the users 250 and 260, the server extracts search information such as query response information from the original content and manages it in the database.

The first user 250 may select playback position information or playback section information of the original content 200, and may designate a certain section or a specific playback position of the playback progressive bar 210. The selected playback section may be one or more, and the playback location may also be one or more. In addition to the first user 250, a second user who wants to consume or purchase content may select at least one play position information or play section information of the original content 200.

2B is a diagram illustrating an example in which the first user and the second user select playback position information or playback section information, respectively. Referring to FIG. 2B, playback position information or playback section information of the original content may be selected from a first user or a second user, and the first user 250 may have a section 211 and the second user 260 may have a section. (213) is selected. In FIG. 2B, although the users 250 and 260 each select one section, one or more playback positions or one or more playback sections may be selected. In addition, the users 250 and 260 may select all of the playback section 210 of the original content in selecting the playback section. For example, when the inserted content includes a text review of the original content, a video review, or a review including an image, the entire content section may be selected and a corresponding review may be input. In addition, as shown in FIG. 2B, when the playback position information or the playback section information of the original content is selected, a separate fingerprint for the original content of the selected section may be further extracted. That is, in the case of one or more sections, all of the original content may be included.

2C is a diagram illustrating an example of receiving an insertion content corresponding to the playback position information or the playback section information selected by the user. Referring to FIG. 2C, the first user 250 inputs the inserted contents 261, 263, and 265 to correspond to the selected playback section information 211. The user 250 may further input a display setting of the inserted content in inputting the inserted content. For example, a position may be set through at least a portion of the beginning and end of the content, and in the case of at least one position, the position may be set to be displayed only for a predetermined time from the corresponding setting point. On the other hand, the start, stop, and stop of playback of the inserted content can also be set. The inserted content 261, 263, and 265 may include a promotional image 261, a content or link information 263 for suggesting a donation, and content or link information 265 for providing a discount. That is, the inserted content 261, 263, and 265 may be configured as at least one of a set of images, an image, audio, text, and a signal transmitted from a user in real time.

Meanwhile, when the inserted content to be input corresponding to the original content is an image, at least some of the corresponding pixel information may be designated or when the inserted content is an image, the pixel information to be selected may be tracked. That is, when the original content is an image, the playback position information or the playback section information of the selected original content may include tracking information of some pixel information of the image.

Meanwhile, the server of the present invention may select the playback position information or the playback section information from the user 250 or, if necessary, based on at least one of the type, display environment, and characteristics of the original content.

For example, when the original content is a live streaming broadcast, most users who watch or consume the content may be interested in the latter part of the content. At this time, advertisers who want to insert an advertisement in the original content will want to enter the advertisement in the second half of the original content. In addition, the server of the present invention may instead select based on the type of the original content and the characteristics of the inserted content when the user does not select the play position information or the play section information that can maximize the effect.

As another example, when the environment in which the original content is displayed is a mobile device, a user who consumes the original content through the mobile device may concentrate on the initial stage, and thus the inserted content may be inserted at the beginning of the original content.

As another example, when the environment in which the original content is played is a public place such as cafe music or street music, users often recognize the middle part of the content, so that the inserted content may be correspondingly input in the middle part.

As another example, when the original content is a video having a long play time, there may be a highlight section of the video, and the section is commonly shared or transmitted through a medium or a network. In this case, users such as advertisers may select a playback section to insert the inserted content in the highlight portion, but if not selected, the playback position or playback section is based on the characteristics of the original content and the nature of the inserted content. Can be determined and set.

Meanwhile, when the insertion content is input from the first user, the insertion content selected by the first user may correspond to the selected play position information or the play section information. That is, since the first user inputs the inserted content with respect to the original content uploaded by the first user, the inserted content is input to the selected position or section without additional determination by the server.

Meanwhile, when the insertion content is input from the second user, the server may further receive a request for registering the insertion content selected by the second user and determine a registration request for the insertion content. If the user of the original content and the inserted content are different, the determination or permission of the first user or the server uploading the original content may be necessary.

Meanwhile, the inserted content may include at least one of a combination of contents input from a first user and a second user, a concatenation of contents, and a list of contents. For example, the inserted content may be simply connected to one or more contents through a content editing tool, or, in the case of a list of contents, an access path of the contents for each item as a corresponding list. In addition, the content may be configured by combining content produced by the first user and the second user.

Figure 2d is a diagram illustrating an example in which a user stores the inserted content input by the user in a database by the server of the present invention. 2D illustrates an example of data storage spaces 230 and 240 for contents. The key value 231 of the original content provided by the user 1 250 may be stored, and the input information may be stored as the storage space 233 of the inserted content at the playback position selected by the user 1 250. In addition, when the user 2 inputs the input information as the inserted content in another reproduction section, the data storage space 240 in which the information 244 is additionally stored may be configured.

In addition, when the playback position information or the playback section information of the original content is selected, the fingerprint for the original content of the selected section is extracted and stored in the storage spaces 233 and 243 of the database so that it can be easily searched later.

The fingerprint extracted from the original content may include one or more frame units of the content. Extracting a fingerprint from the original content may include: a language representing an object extracted by optical character recognition, audio recognition, artificial intelligence based recognition, object recognition, or the like recognized in at least one frame; Word text may be included, and date and time during playback may include color information tracking information. Extraction from the original content may include one or more facial recognition methods, and may include extracting information such as a name. Extraction from the original content may be one or more labels and words representing the mood that are extracted after recognition, including facial expressions, moods, or expressions, or extraction of the digital output as it is perceived, and text, labels for wear products. It may include a brand name, etc., it may include a confidence level (Confidence level) for each label.

Extraction from the original content may include languages, words, sentences, etc. recognized from Langue (or language) and Parole (or speaking) included in the audio of the content. Depending on the content extracted from the noise that can be recorded and output by audio signals, such as onomatopoeia and synonyms, animal sounds, nature sounds, and human voices (laughs, etc.) included in the content audio, And storing it as a key value. The key value stored is the language and words generalized to the label, which may be specific text. For example, a smile label from which a human face is extracted may be stored as a key, and an insertion content may be input to a corresponding value. That is, when someone smiles or smiles are recognized in the original content, the inserted content which is the second content may be input to the corresponding portion. As an example, a celebrity may be extracted and an inserted content may be input from a second user such as a company.

2E is a diagram illustrating another example in which the user stores the inserted content input by the user in a database by the server of the present invention. In FIG. 2E, the intervals 1 and 2 selected by the user 1250 and the user 2 260 are stored in the keys 231 and 241 of the database, respectively, and the information or the inserted content input by each user in the values 233 and 243. Search information such as information or a query for the inserted content may be stored.

2F is a diagram illustrating the extraction of at least one nested information by the server of the present invention 200 from the original content 200. Referring to FIG. 2F, the server extracts at least one nested information 221, 223, 225, 227, and 229 from the original content 200, and extracts the extracted at least one nested information to the playback position 220 of the original content. Correspondingly, it can be stored in the key value tables 230 and 240 of FIGS. 2D and 2E. That is, in addition to the playback position information, the playback section information, and the corresponding inserted content input by the users, semantic information included by the server from the original content, for example, facial expression information, animal voice, text information, location information, and cultural content Etc. may be extracted and stored in the key value table corresponding to the extracted playback position or playback section, and the user may later provide or display at least one nested information extracted by the server in correspondence with the playback location information or playback section information. .

Meanwhile, when the original content is an image, the playback position information or the playback section information of the selected original content may include tracking information of some pixel information of the image. When a part of the content is an image or an image, the content may be part of the pixel information. When the image is an image, the server may extract and store the fingerprint information for tracking the at least some pixel information.

In addition, as shown in FIGS. 2D and 2E, in storing the content and the inserted content, designation information for at least one portion and at least one section of the content selected by at least one of the first and second users may be stored. Fingerprint information on the selected section may also be stored. For example, the inserted content may be registered in the information designated by the first user who uploaded the content. In this case, the inserted content generated from the second user may be registered. The storage information designated by the first user who uploaded the original content may be based on a request from the second user. It may include a display for registering the insertion content in the stored information designated by the first user who uploaded the original content or receiving the insertion content registration request of the second user. The second user may designate one or more sections and one or more sections in the uploaded content and register or request the inserted content. The second user may request a registration by selecting one or more settings among at least one portion and at least one section of the contents previously designated by the first user.

In addition, the present invention may further store value determination information of the original content in storing the original content and the inserted content. If the content's is a social network service, the number of followers, frequency of interest or views, uploads, hit counts, interest set counts, re-consumption or re-views of the content, shared or transmitted Decision information that can indicate the frequency of sharing or transmitting the content, such as the number of times, the number of exposed people, the number of comments can be stored, and the update of the corresponding information can be maintained in real time.

Meanwhile, the registration request of the inserted content by the second user may include a condition or payment information related to the use of the inserted content. The first user may request a search or use fee for a part of the uploaded original content and one or more sections. The payment information may include one or more pieces of information such as a period, a number of times, an amount of money, a sale, a promotion information, a lease information, a finance, a reservation, and an auction. In addition, the condition information may be contract information, and may include exposure related information, exposure time, exposure period, exposure size, exposure timing or shape information, and may include price information.

Meanwhile, the insertion content registration request by the second user may include location information. When the insertion content is received, the location may be set by the second user or the location of interest, and may be range information. It may be useful when transmitting an advertisement that is an embedded content according to the position of the second user.

In addition, the registration request of the inserted content by the second user may include information for searching for the inserted content. That is, the inserted content may include tag information, search cookie information, or search related information for outputting advertisement information.

In addition, the registration request of the inserted content may further include payment information associated with the purchase of the product. When the inserted content is content for sale of a product, it may include link information for purchasing a corresponding product, link information for payment, or code information. Providing a code or link information of the product can increase the convenience of users. In addition, the payment information may include a lump sum, an installment, a lease, a subscription, a deposit, or auction information.

3 is a flowchart illustrating an information providing method centering on contents according to an embodiment of the present invention.

In operation S310, original content is provided from the first user.

In step S320, search information for the provided original content is extracted. The search information may be a fingerprint of the original content.

In step S330, the playback position information or the playback section information of the provided original content is selected. The reproduction position information or the reproduction section information may be selected by both the first user and the second user. If not, the reproduction position information or the reproduction section information may be arbitrarily designated by the server of the present invention in consideration of the characteristics, types, and display environments of the original content and the inserted content.

In step S340, the inserted content is input to correspond to the playback position information or the playback section information selected. The inserted content may include at least one of an image, an image, audio, text, and a set of signals transmitted from a user in real time.

As such, according to the present invention, the first user may register the original content, and the second user may insert the content to be promoted to utilize the original content to be useful for the promotion.

If the original content is text, the second user who wishes to promote may create a copy phrase for the company in the original content, such as "sell everything to the world"-choose Amazon and choose to register the second user's promotional content. .

If the original content is a work such as a book, a part of the book content may be selected to select content of a second user, and some content may be selected and registered.

When the original content is an image or a video, a description or description of a corporate product to be promoted may be requested as an insertion content.

If the original content is audio, the second user may select a part of the audio and request registration.

In addition, the content of the second user determined to be related to the original content created by the first user may be selected and registered. The first user may designate one or more sections of the content, and the second user may request for registration and wait.

In addition, the first user may register his or her contact information such as ID and e-mail information in order to sponsor the original content. The first user may produce content such as music, and the second user may obtain product information and recommend it to the third user. The first user and the second user may register payment information and the like, and may receive an incentive according to the performance.

In other words, existing services that display content uploaded by users and display advertisements received from advertisers were preceded by auction bills from advertisers. In other words, only those who paid more money enjoyed the benefit. However, according to the present invention, content-oriented, content-oriented advertising or promotion is possible, allowing small or startup companies to continue to create new content and use it at a lower cost. In addition, content producers may have a more immediate and dynamic revenue structure than the revenue they receive from their predecessors. If you borrow money from existing movies, music, etc., you can use the contents in exchange for watching advertisements. Direct deals between content producers and advertisers can be induced, and if successful, exclusive advertisement of content becomes possible. In addition, if the content boom during the contract conclusion period, the advertiser can enjoy the maximum effect at a low cost.

4 is a diagram illustrating an information retrieval method centered on content according to an embodiment of the present invention.

Referring to FIG. 4A, when the first user 450 registers the original content 410 with the system server 400, the server 400 extracts and stores the first search information 441 from the original content and the first user. The playback position information or the playback section information of the original content received from the 450 is selected and stored. In addition, when the inserted content, the play position information or the play section information are input from another user 460, the corresponding information is additionally stored in the database (444).

If there is a search request for any content, the search for the information about the arbitrary content may be extracted and the original content 410 may be identified. In this case, not only the original content 410 but also the content 444 of other users inserted together may be output together or only the inserted content may be output.

Referring to FIG. 4B, the server 400 stores only the inserted content, the playback position information, or the playback section information input from another user 460. When only the content and information input from another user are stored, there may be a separate request from another user, and may be separated and stored at the request of the user 450 of the original content. When any content is identified and search information such as a fingerprint of the arbitrary content is extracted, the inserted content 444 of the second user 460 stored in the database may be extracted, and only the inserted content 444 is displayed. Can be.

In the present invention, the content providing form may vary according to the storage form of the original content and the inserted content.

5 is a flowchart illustrating an information retrieval method centering on contents according to an embodiment of the present invention.

In operation S510, at least one or more pieces of first search information are extracted and stored from original content provided by the first user.

In step S520, the playback position information or the playback section information of the original content is selected.

In operation S530, the second search information for the inserted content is extracted and stored.

In operation S540, the second search information for the inserted content is extracted and stored.

In operation S550, a search request signal for any content is received. Receiving a search request signal may be executed by playing content on the user device. It can also be executed by sensing sound through a microphone mounted to a user device.

The arbitrary content may include at least one of an image, a video, live streaming, audio, and text.

In operation S560, at least one or more identification information is extracted from the arbitrary content, and the inserted content related to the arbitrary content is extracted using the extracted identification information. In addition, the present invention may further include displaying the extracted inserted content on the user device.

As an example of extracting the identification information, if any content is an image, it may be fingerprint information extracted from color information such as RGB and CMYK and brightness information graphs thereof. When the arbitrary content is an image, it may be fingerprint information extracted from color information such as RGB, CMYK, brightness information graph thereof, and temporal change information according to reproduction.

If any content is audio, it may be audio fingerprint information extracted from information such as a spectrogram. In addition, it may further include a query extraction through the ultrasound.

In addition, when searching a database, the response query may recognize information about the original content or search for response query related information independent from the original content. For example, the extracted query may respond to the original content and additionally search for the inserted content registered in the searched original content.

For example, when the independent response query responds as the extracted identification information or search information, the inserted content registered in the independent response query may be searched. As another example, when a signal is received from the content and the extracted query is searched for original information, one or more second information registered at one or more points and one or more points in the searched original information are searched.

  As another example, when receiving a signal from the content and searching with the extracted query, when there is an independent query predetermined by the user, one or more second information linked to the independent query is searched.

That is, the original content may be searched, the inserted content may be searched, the response query specified at least partially specified from the original content may be searched, and the inserted content registered in the input response query may be searched.

In addition, the arbitrary content may be identified using the extracted identification information. In addition, arbitrary content and embedded content related to the arbitrary content may be stored. In this case, when at least one of the arbitrary content and the inserted content does not exist in the pre-stored database, the present invention server may additionally store the corresponding arbitrary content and related embedded content.

In addition, if there is audio in the image, it is possible to extract a search query for the one or more.

Meanwhile, the inserted content related to the arbitrary content may include at least one of an image, an image, audio, and text. For example, it may be a text left by a user, a voice, a review and an image review, a banner, an advertisement image, music to be promoted, or audio in an ultrasonic range. In the case of the ultrasound, the system may further include calling the third information registered in the natural ultrasound and displaying the second information.

Also, the embedded content related to the arbitrary content may include at least one of output information, output time, output period, output size, output timing, and output type. For example, when the inserted content is an advertisement, set information such as a play time of the advertisement, an expiration date of the advertisement (if an advertisement contract period exists), and a display timing of the type of advertisement (large banner, small banner, image, video, GIF, etc.) Can be displayed using.

Meanwhile, the inserted content related to the arbitrary content may include at least one of product information, payment information, delivery information, and reservation information, and in this case, arbitrary content may be output. The user consumes the content and can select and use the inserted content or store it for purchase. In addition, the payment information may include one or more of lump sum, installment, lease, subscription, deposit, auction information.

The embedded content related to the arbitrary content may further include user related information and may be provided based on the user related information. That is, when the inserted content includes the user's location information, Accordingly, the inserted content can be provided. For example, the inserted content may be selected and transmitted according to the classification of the consuming user such as the user's age, gender, interest list, cookie, purchase history, search history, and the like.

In addition, the user-related information may be stored by the user who uploaded the arbitrary content. When the user uses the content, the user may set interest in the content. For example, user-related information such as cookie information of users, purchase history, and search history may be stored.

The displaying of the embedded content related to the arbitrary content on the user device may further include displaying value determination information of the arbitrary content. For example, the number of followers of the uploader, the number of favorites, the number of followers of the uploader, the view count of the object, the interest count, the number and percentage of reuse of the object, the number of shares and the number of followers shared by the followers. One or more pieces of information that can be determined as being exposed, number of comments, and the like are presently generated by the exposure of one or more of the corresponding content.

In addition, the display of the inserted content related to the arbitrary content may be set to play, stop or play time adjustment mode according to whether the arbitrary content is played. While the content is in use, the content being played can be stopped and the inserted content can be sent out. For example, when the user uses the content, the inserted content may be sent before or after the content playback. For example, when a user consumes one or more contents, when one or more pieces of inserted content are registered, the one or more pieces of inserted content may be collected and provided together at the same time before or after the start of content, or may be output in the middle of content reproduction. For example, when the user consumes one or more pieces of content, when one or more pieces of second information are registered in one or more points and one or more sections, the content may be output according to the one or more specific points and one or more sections. The display can be included outside or inside the playback pixel, with or without the playback of.

As an example, the deriving numbers may be displayed in a graph. In one example, the displayed numbers and graphs may display an interface for receiving a user's command.

On the other hand, the information retrieval method centering on the contents of the present invention can be executed by an application programming interface, for example, the server executes the steps (S510, S5220, S530, S430), the search request signal Receiving (S550), extracting the embedded content associated with the arbitrary content (S560) and the displaying step may be executed by an API by a user device equipped with a program or application for the method of the present invention have.

The application programming interface may be executed at the user device via the wireless network.

Meanwhile, the scope of the present invention may be applied to a program for an information retrieval method centering on the contents of the present invention, a computer-readable recording medium recording the program, any electronic device capable of executing the program, and the like. The scope of rights may include all of these.

The foregoing description of the preferred embodiments of the present invention has been presented for purposes of illustration and description. The foregoing description is not intended to be exhaustive or to limit the invention, and is not intended to limit the invention to the described embodiments. Many modifications and variations will be apparent to the person skilled in the art. The embodiments herein best explain the principles and practical applications of the invention and thereby enable the skilled person in the art to have various modifications suitable for different embodiments and for the intended use of the invention. It is chosen and explained to help you understand it.

Claims (39)

1. In the information providing method centered on the content,

   Receiving original content from a first user;

   Extracting search information on the provided original content;

   Receiving selection of playing position information or playing section information of the provided original content; And

   And receiving an inserted content corresponding to the selected play position information or the play section information.
2. The method of claim 1,

   An information providing method centering on a content comprising receiving selection of playback position information or playback section information of the original content from a first user or a second user.
3. The method of claim 1,

   The information providing method centering on a content including receiving an insertion content corresponding to the selected playback position information or the playback section information from a first user or a second user.
4. The method of claim 1,

   The step of receiving the inserted content, the information providing method centering on the content comprising receiving a display setting of the inserted content.
5. The method of claim 1,

   The selected playback position information may be at least one, and the selected playback section may be at least one, the information providing method centering on the content that can be the entire playback section of the original content.
6. The method of claim 1,

   And selecting playback position information or playback section information based on at least one of a type, a display environment, and characteristics of the original content.
7. The method of claim 1,

   When the insertion content is received from the first user, the insertion content selected by the first user corresponds to the selected playback position information or the playback section information.

   And receiving the request for registration of the inserted content selected by the second user when receiving the inserted content from the second user.
8. The method of claim 1,

   And the original content and the inserted content are contents, which can be composed of at least one of an image, an image, audio, text, and a set of signals transmitted from a user in real time.
9. The method of claim 1,

   The insertion content is an information providing method centering on a content including at least one of a combination of contents input from a first user and a second user, a connection of contents, and a content list.
10.  The method of claim 1,

    The extracted search information is an information providing method centering on a content including a fingerprint of the original content.
11. The method of claim 10,

    And extracting a fingerprint of the original content of the selected section when the play position information or the play section information of the original content is selected.
12. The method of claim 1,

    And the reproduction position information or the reproduction section information of the selected original content when the original content is an image, wherein the content includes tracking information of some pixel information of the image.
13. The method of claim 1,

    And storing the original content and the inserted content, wherein the content providing method further comprises storing value determination information of the original content.
14. The method of claim 7, wherein

    The request for registration of the inserted content is an information providing method centering on a content including a condition or payment information related to the use of the inserted content.
15. The method of claim 7, wherein

    The request for registration of the inserted content is an information providing method centering on content including location information.
16. The method of claim 7, wherein

    The request for registration of the inserted content is an information providing method centering on a content including information for searching for the inserted content.
17. The method of claim 16,

    The registration request of the inserted content is an information providing method centering on the content further including payment information associated with the product purchase.
18. The method of claim 1,

    The search information is an information providing method centering on content extracted by at least one of optical character recognition, speech recognition, and artificial intelligence based recognition method.
19. The method of claim 1,

    Extracting at least one nested information from the original content; and

    And storing the at least one nested information in correspondence with the playback position of the original content.
20. The method of claim 1,

    If the playback position information or playback section information of the original content is not selected, the server further comprises determining the playback position information or playback section information based on at least one of the type, display environment and characteristics of the original content. Information providing method.
21. In a method for searching for information centered on content,

    Extracting and storing at least one first search information from original content provided by the first user;

    Receiving selection of playback position information or playback section information of the original content;

    Receiving an inserted content corresponding to the selected play position information or the play section information;

    Extracting and storing second search information for the inserted content;

    Receiving a search request signal for any content;

    Extracting at least one identification information from the arbitrary content, and extracting the embedded content related to the arbitrary content by using the extracted identification information.
22. The method of claim 21,

    And displaying the arbitrary content and the embedded content related to the arbitrary content on a user device.
23. The method of claim 22,

    Receiving a search request signal, extracting embedded content associated with the arbitrary content, and displaying the information retrieving information centered on content executed by an application programming interface.
24. The method of claim 23, wherein

    The application programming interface retrieves information centered on content executed on a user device via a wireless network.
25. The method of claim 24,

    The receiving of the search request signal may include reproducing the content on the user device.
26.  The method of claim 24,

    The receiving of the search request signal may include detecting a sound through a microphone mounted on the user device.
27. The method of claim 21,

    Wherein said arbitrary content is at least one of image, video, live streaming, audio, and text.
28. The method of claim 21,

    The at least one identification information extracted from the arbitrary content is a method for searching for information centering on a content including a fingerprint.
29. The method of claim 21,

    And identifying the arbitrary content by using the extracted identification information.
30. The method of claim 29,

    And storing the arbitrary content and embedded content related to the arbitrary content.
31. The method of claim 21,

    And inserting content related to the arbitrary content into information about content including at least one of an image, an image, audio, and text.
32. The method of claim 31, wherein

    And inserting content related to the arbitrary content based on the content including at least one of output information, output time, output period, output size, output timing, and output type.
33. The method of claim 31, wherein

    Inserted content related to the arbitrary content includes at least one of product information, payment information, shipping information, reservation information,

     And outputting the arbitrary content, wherein the information is searched based on the content.
34. The method of claim 21,

    And inserting content related to the arbitrary content further includes user related information, and searching for information based on contents that can be provided based on the user related information.
35. The method of claim 34, wherein

    The user-related information is a method for searching for information centered on the content that can be stored by the user uploaded the arbitrary content.
36. The method of claim 22,

    And displaying the inserted content related to the arbitrary content on a user device further comprises displaying value determination information of the arbitrary content.
37. The method of claim 36,

    And a display of the inserted content related to the arbitrary content centers on a content in which a play, pause, or play time adjustment mode is set according to whether the arbitrary content is played.
38. The method of claim 21,

    And providing the at least one nested information extracted by the server in correspondence with the reproduction position information or the reproduction section information.
39. In a system for searching for information centered on content,

    Extract and store at least one or more pieces of first search information from original content provided by the first user,

    Receiving playback position information or playback section information of the original content,

    Receiving an inserted content corresponding to the selected play position information or the play section information;

    A server which extracts and stores second search information about the inserted content;

    When the server receives a search request signal for any content

    Information on extracting at least one piece of identification information from the content, extracting embedded content related to the content using the extracted identification information, and focusing on content displayed on a network through a user display device System to search.

Images