JP6158875B2 - Information providing apparatus and method corresponding to dialog box input content - Google Patents

Description

  The present invention relates to an apparatus and method for providing information corresponding to content entered or posted in a dialog box. More specifically, the present invention relates to a content correspondence information providing service for extracting a keyword corresponding to content input or posted in a dialog box such as an instant messenger from a related dialogue and providing information (such as an advertisement) related to the keyword.

  Based on the development of the Internet using wired or wireless, the spread of PCs and the use of smart devices, HTML (Hyper Text Markup Language) and mobile languages (for example, Java (registered trademark) or C language) are the bases. Various web applications are developed and appear, and various forms of instant messenger services are provided in cyberspace.

  Through these instant messenger services, smooth real-time communication is possible via instant messenger between desktop computer users, between mobile communication terminals, or between mobile communication terminals and desktop computers, whether wired or wireless. Became.

  Compared to electronic mail, early instant messengers have the advantage of being able to transfer real-time messages to all users online on the Internet using wired and wireless connections. However, the current instant messenger is not only a function of integrated VOIP platform (platform) that provides services such as chat, real-time message transfer, file transfer, voice call, video call among many users, The network community service has been developed to be integrated and gradually expanded to the concept of a portal service.

  However, up to now, a method for providing supplementary information such as advertisements in such an instant messenger usage environment extracts keywords from input sentences or words, and transmits advertisement information corresponding to the extracted keywords. The method has stopped.

Korean Published Patent No. 10-2010-0092787 Korean Published Patent No. 10-2011-0054182 JP 2004-348591 A

  An object of the present invention is to provide a keyword (one or more words) from the contents of dialogue input before and after a content such as an image, a moving image, or an audio file is posted or selected in a dialog box such as an instant messenger. Alternatively, a related concept is extracted so that it can be set as metadata related to the corresponding content.

  Another object of the present invention is to enable a service that provides information related to metadata when the content is input from the corresponding content-related metadata into the same dialog box or another dialog box. There is.

  Another object of the present invention is to extract a word based on a point in time when content is used in extracting the metadata, and extract a keyword or a related concept based on the frequency of use of the extracted word. It is to be able to accurately provide information related to the content.

  Another object of the present invention is to accurately provide information related to the content by updating the metadata to reflect various conversation situations of a large number of users.

  Another object of the present invention is to satisfy various needs of users for one content by setting a plurality of metadata and providing advertisement information related to each of the plurality of metadata. It is to make possible an information providing service.

  When a content is posted in one or more dialog boxes formed by a user terminal, the content correspondence information providing apparatus according to an embodiment of the present invention may include one or more texts input before or after the content is posted. A keyword extracting unit that extracts words from the metadata, a metadata setting unit that sets the word-related information as metadata of the content, and a database that stores the metadata in association with the content. .

  When the content is posted in one or more dialog boxes formed by the user terminal, the content correspondence information providing method according to another embodiment of the present invention includes one or more input before or after the content is posted. Extracting a word from a sentence, setting the word-related information as metadata of the content, and storing the metadata in association with the content.

  When a content is posted in one or more dialog boxes formed by a user terminal, the medium storage program according to another embodiment of the present invention is based on one or more sentences input before or after the content is posted. It may be a computer program stored in a medium for extracting a word, setting the word related information as metadata of the content, and storing the metadata in association with the content.

  According to the present invention, when content such as an image, a moving image, and an audio file is posted or selected in a dialog box such as an instant messenger, a keyword (one or more words) is obtained from the content of the dialogue entered before or after the content. ) Or a related concept can be extracted and used as metadata related to the corresponding content.

  In addition, according to the present invention, when the content is input from the corresponding content-related metadata into the same dialog box or another dialog box, a service that provides information related to such metadata becomes possible. .

  Further, according to the present invention, in extracting the metadata, by extracting a word based on the point in time when the content is used, by extracting a keyword or related concept based on the frequency of use of the extracted word, Information related to the content can be provided accurately.

  Further, according to the present invention, it is possible to accurately provide information related to the content by updating the metadata reflecting the state of various conversations of a large number of users.

  In addition, according to the present invention, by providing a plurality of metadata and providing advertisement information related to each of the plurality of metadata, it is possible to provide information that can satisfy various needs of users for one content Service becomes possible.

It is a figure for demonstrating the content corresponding | compatible information provision system by one Embodiment of this invention. It is a figure for demonstrating the structure of the content corresponding | compatible information provision server by one Embodiment of this invention. It is a figure which shows the extraction process of the content corresponding | compatible keyword which concerns on one Embodiment of this invention. It is a figure for demonstrating the usage frequency used as one reference | standard in selection of the content corresponding | compatible keyword which concerns on one Embodiment of this invention. FIG. 5 is a diagram illustrating a process of generating metadata corresponding to content according to an exemplary embodiment of the present invention. It is a figure for demonstrating the method to provide the content corresponding | compatible information which concerns on one Embodiment of this invention. It is a figure for demonstrating the method to provide the content corresponding | compatible information which concerns on one Embodiment of this invention. It is a figure for demonstrating the method to provide the content corresponding | compatible information which concerns on one Embodiment of this invention. It is a figure for demonstrating the method to provide the content corresponding | compatible information which concerns on one Embodiment of this invention. It is a figure for demonstrating the method to provide the content corresponding | compatible information which concerns on other embodiment of this invention.

  It should be noted that the technical terms used in the present invention are merely used to describe particular embodiments, and are not intended to limit the present invention. In addition, unless otherwise defined in the present invention, technical terms used in the present invention should be interpreted in a meaning generally understood by those having ordinary knowledge in the technical field to which the present invention belongs. Must not be construed in an overly comprehensive sense or in an overly reduced sense. In addition, when technical terms used in the present invention are technical terms that cannot accurately express the idea of the present invention, they are replaced with technical terms that can be understood correctly by ordinary engineers in the field. Should be understood. In addition, general terms used in the present invention should be interpreted based on the definitions in the dictionary or based on the context before and after, and should not be interpreted in an excessively reduced sense. .

  Also, a single expression used in the present invention includes a plurality of expressions unless the context clearly indicates otherwise. In the present invention, the terms “comprising” or “including” should not be construed as necessarily including all the various components or various steps described in the invention. It should be construed that some components or some steps may not be included, or may include additional components or steps.

  In addition, terms including ordinal numbers such as “first” and “second” used in the present invention can be used to describe a component, but the component should not be limited by the term. The terminology is used only for the purpose of distinguishing one component from other components. For example, the first component may be named as the second component without departing from the scope of the present invention, and the second component may be named as the first component as well.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the same or similar components are denoted by the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted.

  Further, in describing the present invention, when it is determined that a specific description of a related known technique may obscure the gist of the present invention, a detailed description thereof will be omitted. It should be noted that the accompanying drawings are only for facilitating understanding of the technical idea of the present invention and should not be construed as limiting the technical idea of the present invention by the accompanying drawings. Should.

  The “information” provided in the present invention is advertisement information, but is not limited to this, and may be information of various types and purposes such as news, life information, and advertisements.

  Further, in the following description of the specific embodiment, the case of instant messenger is described with emphasis, but this is merely for convenience of explanation, and the present invention provides a dialog box. The present invention can also be applied to a chat service, an SNS service, and the like that allow dialogue between participating users.

  FIG. 1 is a diagram for explaining a content correspondence information providing system according to an embodiment of the present invention.

  As shown in FIG. 1, the content correspondence information providing system according to an embodiment of the present invention may include a plurality of user terminals 100 and an information providing server 200. Here, “terminal” and “server” refer to a collection of hardware and software that can be linked for a specific purpose regardless of physical location and specific configuration. Each component can be interconnected via a network.

  The first user terminal 110 and the second user terminal 120 are connected to the information providing server 200 and can send and receive messages between the user terminals 100 via a dialog box provided by an instant messenger or the like. Information such as advertisements to be provided can also be received.

  Although the first user terminal 110 and the second user terminal 120 are illustrated in the present embodiment, the number of user terminals 100 and the number and status of dialog boxes formed by the user terminals are not limited to those illustrated. A plurality of user terminals 100 can be used, a plurality of user terminals can send and receive messages in one dialog box, a message can be sent and received in one or more dialog boxes of one or more user terminals 100, and so on. Various situations are possible.

  Further, the user terminal 100 can transmit and receive content via a dialog box. As the user terminal 100, a personal computer, a mobile communication terminal, a smartphone, a tablet PC, a smart TV, an MP3 player, a PMP, an electronic notebook, or the like capable of reproducing or realizing advertisement information can be used. However, the user terminal of the present invention is not limited to this, and any user terminal that can receive advertisement information provided by the information providing server 200 via an instant messenger program or a chat program can be used. There are no restrictions on the form and type. For convenience, in the following embodiment, a case where the user terminal 100 is a smartphone will be described as an example.

  When the predetermined content is displayed in the dialog box formed by the user terminal 100 by a method such as input or selection, the information providing server 200 uses the content based on the time when the corresponding content is used in the dialog box. Words are extracted from previous and subsequent sentences, keywords are selected according to the frequency of use, the selected keywords are generated as metadata for the corresponding content, stored in correspondence with the corresponding content, Information such as advertisements related to the data can be provided to the user terminal 100.

  When the information provided by the information providing server 200 is an advertisement, this may include at least one of a text advertisement, an image advertisement, an Internet link, a moving image advertisement, and product information.

  The advertisement information related to the corresponding content can be provided to the user terminal 100 that uses the corresponding content, or can be provided to a specified specific user. In addition, information related to the corresponding content may be variable. Specifically, when the metadata corresponding to the content, that is, the keyword is changed, information related to the changed keyword can be provided. It can also be provided by a search or extraction method.

  A process of extracting a keyword from the content of the dialogue related to the content will be described later with reference to FIGS.

  FIG. 2 is a diagram for explaining a configuration of a content correspondence information providing server according to an embodiment of the present invention. The information providing server 200 according to the present embodiment can include a keyword extracting unit 210, a metadata generating unit 220, a database 230, a control unit 240, a communication unit 250, and an information providing unit 260.

  Here, the keyword extraction unit 210 collects one or more used words from the dialog within a predetermined range set in the dialog box. For example, the keyword extraction unit 210 uses the frequency of use of each word as a reference. The top few (for example, 1 to 4) words can be selected as keywords for the corresponding image in descending order.

  The word collection may be performed in a manner in which words are collected from words used in some previous sentences or some later sentences based on the point in time when the content is used. As an example, based on the point in time when specific content is used in multiple dialog boxes, the words used in the previous sentence and the subsequent three sentences are individually extracted and the frequency of use of the words is added up. The top few frequently used words can be extracted as keywords.

  In the process of collecting words and extracting keywords from the collected words, it may be based on only one dialog box, or keywords may be extracted by combining words used in multiple dialog boxes. .

  In the embodiment of the present invention, the case where the content is an image has been described as an example. However, this is merely for convenience of description, and the content may be a moving image, music, audio file, or the like in addition to the image. However, it is not limited to these.

  The words used in the dialog box are collected by confirming whether or not they match through a query of the word database stored in the keyword extraction unit 210.

  The metadata generation unit 220 performs a function of setting the keyword or related concept extracted by the keyword extraction unit 210 as metadata of the corresponding image. Thus, when an image with metadata set is used again later in the same or another dialog box, information such as an advertisement related to the metadata set for the image can be provided. Here, the concept related to the keyword is related to the keyword extracted by the keyword extraction unit (210). For example, when the keyword “puppy” is extracted as a preset keyword, the keyword is related to the keyword. The concept to be applied is “dog” or “pet”.

  The database 230 performs a function of storing images and metadata corresponding to the images. When the keyword associated with the image is changed, the metadata stored in the database 230 is also changed.

  The control unit 240 performs a function of controlling the overall operation of the internal components of the information providing server 200, and the communication unit 250 performs a function of transmitting / receiving data to / from the user terminal 100. The communication unit 250 is a wireless access (Wire access 100) that uses wireless access (Wire) access such as a WLAN (Wireless Local Area Network), WiFi (Wireless Fidelity), or WiMAX (World Wide Interoperability for Wireless Access) 100.

  The information providing unit 260 provides information related to metadata corresponding to the image to the user terminal 100. The configuration according to this will be described in detail with reference to FIGS.

  FIG. 3 is a diagram for explaining a process of extracting words corresponding to content according to an embodiment of the present invention. As shown in FIG. 3, it is understood that the same image 10 is used in a plurality of dialog boxes (dialog box A and dialog box B), and that a plurality of words are used in sentences before and after the image. be able to.

  The words “puppy”, “cute”, “cute” and “maltese” are extracted from dialog box A, and “puppy”, “futon”, “cute”, “money futon” and “heart” are extracted from dialog box B. ”Was extracted.

  For the sake of explanation, the word “cute” is set to a, the word “puppy” is set to b, the word “futon” is set to c, and the word “Maltes” is set to d. Although four words are shown in the drawing, the number of extracted words can be changed and is not limited to the example.

  In dialog box A and dialog box B, words used in one previous sentence and two subsequent sentences are extracted based on the point in time when the image is used, but this can be changed according to the setting. For example, a word used in one previous sentence and a subsequent sentence can be extracted based on the time when the image was used, and the next two sentences or three can be extracted based on the time when the image was used. It is also possible to extract words used in one sentence.

  Alternatively, it is possible to extract a word used in a sentence used within a predetermined time based on a point in time when the image is used. For example, it is possible to extract words used in sentences entered in the dialog box within one minute from the point in time when a specific image is used.

  In addition, a method may be used in which the word is extracted from one or more sentences input within a position range set before or after the content posting position as a reference.

  FIG. 4 is a diagram for explaining a word usage frequency that can be used as a reference in selecting a content-corresponding keyword according to an embodiment of the present invention. Since the words extracted from FIG. 3 may vary depending on the personality according to the nature of the dialog box, in general, a more accurate keyword is selected through the process of selecting keywords based on the most frequently extracted words. Can be determined.

  As shown in FIG. 4, words used for one image are extracted from a plurality of dialog boxes, and the usage frequency of the extracted words is calculated. Specifically, the words “puppy”, “cute”, and “maltese” are extracted from the dialog box A in FIG. 3, and “puppy”, “futon”, and “cute” from the dialog box B in FIG. ”,“ Money duvet ”and“ heart ”were extracted.

  In FIG. 4, the frequency of occurrence of b is the highest at 219, the word “puppy” is used most frequently, and the word “cute” of a is then used most frequently. As the number of dialog boxes that use the same image increases, the usage frequency of the extracted words can be more accurate. For example, the usage frequency of each word can be summed up in descending order of usage frequency. It is also possible to extract the top few words as keywords of the corresponding image.

  The keyword can be changed in the process of extracting the top few words as the keyword of the corresponding image in descending order of frequency of use. In other words, the order of summing up the frequency of use of words extracted for the same image can be changed according to time.

  As mentioned above, by extracting the used words from multiple dialog box boxes, we extract words that are generally related to the image used when the image was used in the dialog box, and take advantage of this As a result, metadata can be generated, and it is possible to extract keywords and provide information with higher reliability.

  FIG. 5 is a diagram for explaining a process of generating content corresponding metadata according to an embodiment of the present invention.

  For example, if the image is shared by one or more dialog boxes in step S110, words used in the sentence are extracted within a predetermined range based on the sharing time point. The process of extracting the word may be performed by querying a word list in a database in which the word included in the sentence is recorded or linked in the keyword extracting unit and checking whether or not it matches.

  Next, the usage frequency is totaled (for example, summed) for each word extracted from one or more dialog boxes (S120), and, for example, the top n words in the order of frequency of use among the extracted words. Can be determined as a keyword (S130).

  Then, metadata is generated by tagging the keyword with the image (S140).

  6 to 9 are diagrams illustrating a method for providing an advertisement corresponding to content according to an exemplary embodiment of the present invention.

  When an image with metadata stored through the process of FIG. 5 is used in the same dialog box or another dialog box in the future, indicating it via an appropriate indicating means such as clicking on the tab or a particular A detailed display layer or menu associated with the image for which metadata is set can be displayed at a position, for example, at the bottom of the image.

  The above-described method for instructing an image and providing predetermined information related to the image can be performed by a dialog box, but is not limited thereto, and can be performed by various methods such as providing a separate window. If the corresponding image is stored in the user terminal 100, related information is provided when the stored corresponding image is indicated even if the corresponding image is not posted in the dialog box. You can also.

  The detail display layer related to the image may include menus such as “save”, “share”, “delete”, “recommend”, etc. of the image. Here, when the “Recommend” menu 30 is selected, the keyword of the corresponding image stored as metadata is presented on the screen, and the user selects a specific keyword for which related information is desired from among the presented keywords. It is also possible to selectively receive information related thereto.

  For example, when the “Recommend” menu 30 is selected in FIG. 6, as shown in FIG. 7, a keyword selection menu 40 of “jeans”, “male underwear”, “shoes”, and “upper” can be presented. When the user selects a specific keyword, related advertisement information can be provided. Here, the keywords shown in the keyword selection menu 40 are keywords extracted by the process of FIG. 5 for the corresponding image.

  When the user selects a specific keyword from the keyword selection menu 40, a similar image menu 51, a related product menu 52, and a related site menu 53 are displayed as an advertisement information menu 50 related to the selected image, as shown in FIG. Can be provided. An advertisement information menu can be provided for each of the keyword selection menus 40 of FIG. Therefore, for example, when “Jeans” is selected from the keyword selection menu 40, the advertisement information menu 50 of FIG. 8 is provided with a similar image menu 51, a related product menu 52 and a related site menu 53 related to “Jeans”. When “male underwear” is selected from the keyword selection menu 40, the advertisement information menu 50 of FIG. 8 includes a similar image menu 51, a related product menu 52, and a related site menu 53 related to “male underwear”. Is provided.

  As an example, when a specific menu is selected from the advertisement information menu 50 of FIG. 8, similar images, related products, and related sites may be provided as shown in FIG.

  Here, the similar image menu 51 refers to providing a predetermined related image by the advertisement providing unit 260. In this case, a plurality of images may be provided. As in 6, the “Recommend” menu 30 can be presented, or it can be immediately connected to a page for selling the product shown in the selected image.

  The related product menu 52 is connected to a page for selling the product shown in the image, and the product can be purchased by setting necessary options.

  The related site menu 53 provides a connection route for one or more Internet sites that sell the product indicated in the image or similar related products, and can receive advertisement information by selecting a desired site. it can.

  The information providing server 200 can accumulate predetermined points for the user terminal 100 when purchasing a product through a designated advertisement.

  In addition, when the first user terminal 110 stores an image and uploads the image to another chat room, when the user terminal 100 in another chat room instructs the corresponding image, the corresponding information is displayed as shown in FIG. A “Recommend” menu may be displayed.

  FIG. 10 is a diagram for explaining a method for providing content correspondence information according to another exemplary embodiment of the present invention. When the image 10 is selected, it can be executed in the form of UX (user experience) that receives the product images 11 and 12 related to the metadata together with the layer. The related product images 11 and 12 may be plural, and when the user selects a specific product image, a “recommend” menu (not shown) is presented or shown in the selected image. It can also be immediately connected to the page selling the product.

  Thus, using the user terminal messenger service, an image is displayed in a dialog box during chatting, and useful information can be provided through selection of the image, and the terminal user can be interested. You will also be able to.

  The embodiments according to the present invention described above are realized in the form of program instructions that can be executed via various computer components, and can be recorded on a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer readable recording medium are either specially designed and configured for the present invention, or can be known and used by those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks (registered trademark) and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical recording media such as floppy disks. And hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like (magneto-optical medium). Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. A hardware device can be changed to one or more software modules and vice versa to perform the processing according to the present invention.

  The particular implementation described in the present invention is an example and is not intended to limit the scope of the invention in any way. For the sake of brevity, the description of the conventional electronic configuration, control system, software, and other functional aspects of the system may be omitted. Also, the illustrated line connections or connection members between components are illustrative of functional connections and / or physical or circuit connections, and may be substituted or added in actual devices. It can be implemented as a functional connection, a physical connection, or a circuit connection. Further, unless there is a specific mention such as “essential” or “importantly”, it may not be an essential component for application of the present invention.

  In the specification of the invention (especially in the claims), the use of the term “above” and similar indicating terms may apply to both the singular and the plural. In addition, when a range is described in the present invention, it includes an invention to which individual values belonging to the range are applied (unless there is a description contrary to this), and the range is described in the detailed description of the invention. It is the same as having described each individual value that constitutes. Finally, the steps can be performed in any suitable order unless explicitly stated or contrary to the steps that make up the method of the present invention. The present invention is not necessarily limited by the description order of the steps. In this specification, the use of all examples or exemplary terms (eg, etc.) is merely for the purpose of describing the present invention in detail and is not intended to be limited by the scope of the claims. The terminology is not intended to limit the scope of the invention. In addition, it can be understood that a normal engineer can be configured according to design conditions and elements within the scope of the claims or their equivalents to which various modifications, combinations and changes are made.

DESCRIPTION OF SYMBOLS 100 User terminal 200 Information provision server 210 Keyword extraction part 220 Metadata production | generation part 230 Database 240 Control part 250 Communication part 260 Information provision part

Claims (13)

When content is posted in one or more dialog boxes formed by the user terminal, a keyword extraction unit that extracts words from one or more sentences input before and after the content posting,
A metadata setting unit that sets word-related information as metadata of the content;
A content-corresponding information providing apparatus comprising a database that stores the metadata in association with the content.   The content correspondence information providing apparatus according to claim 1, wherein the content is any one of an image, a moving image, and an audio file.   The content correspondence information providing apparatus according to claim 1, wherein the word related information is the extracted word itself or a concept related to the word. The keyword extracting unit extracts the word from one or more sentences input within a set time range before and after the reference with respect to a point in time when the content is posted. The content corresponding | compatible information provision apparatus as described in any one of 1-3. The keyword extracting unit extracts the word from one or more sentences input within a set position range before and after the reference based on a posting position of the content. The content corresponding | compatible information provision apparatus as described in any one of thru | or 4. When the frequency at which the word is used in a predetermined range of dialogues input in the one or more dialog boxes is equal to or higher than a set reference, the metadata setting unit may store the word related information as content content. and sets as meta data, content associated information providing apparatus according to any one of claims 1 to 5. If the content or the related content is posted on the dialog box or another dialog box, characterized in that it comprises information providing unit for providing information related to the metadata, any one of the claims 1-6 The content corresponding | compatible information provision apparatus as described in an item. The metadata is plural,
The information providing unit, when the content is posted, provides the plurality of metadata to the user terminal, and provides information related to the metadata selected by the user to the user terminal. The content correspondence information providing apparatus according to claim 7 . The metadata-related information, text ads, image ads, Internet links, characterized in that it comprises at least one of the moving image advertising and product information, content associated information providing apparatus according to claim 7 or 8. When the information providing unit receives a selection for the content from the user terminal, the information providing unit displays a menu that allows the user to request the provision of the information in association with the content. The content correspondence information providing apparatus according to any one of claims 7 to 9 . The information providing unit displays a keyword selection menu indicating the metadata when receiving a selection for the menu from the user terminal, and receives the selection via the keyword selection menu from the user terminal. The content correspondence information providing apparatus according to claim 10 , wherein one or more pieces of information related to a keyword are provided. A method by which a computer provides content correspondence information,
When content is posted in one or more dialog boxes formed by the user terminal, a word is extracted from one or more sentences input before and after the content is posted,
Set word related information as metadata of the content,
A content correspondence information providing method comprising storing the metadata in association with the content. When content is posted in one or more dialog boxes formed by the user terminal, a word is extracted from one or more sentences input before and after the content is posted,
Set word related information as metadata of the content,
A computer program for causing the metadata to be stored in association with the content.

Images