JP2010277363A - Feeling information expression server, feeling information expression system, and feeling expression method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a feeling information expression server, a feeling information expression system, and a feeling information expression method, for easily obtaining a feeling with respect to an obtained image. <P>SOLUTION: The feeling information expression method includes: a step for acquiring text data collected from a Web; a step for generating a feeling dictionary by associating a word of object indicating an object appearing in the acquired text data with a feeling term having a co-occurrence relationship with the word of object according to the degree of co-occurrence; a step for specifying an object associated with the word of object from input image data; a step for determining the feeling term having the co-occurrence relationship with the word of object corresponding to the specified object based on the generated feeling dictionary; and a step for transmitting the determined feeling term and the image data. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a sensory information expression server, a sensory information expression system, and a sensory information expression method that realize expression of sensory information for an image.

  2. Description of the Related Art Conventionally, systems using augmented reality technology that displays a virtual object such as CG (Computer Graphics) and a real space in an overlapping manner are known.

  In such a situation, for example, Patent Document 1 proposes an augmented reality system that can synthesize a large number of types of virtual objects on a photographed image in real space and display it as a synthesized image.

JP 2005-250950 A

  However, even when a composite image is acquired using a system that uses such augmented reality, the composite image can only be acquired by synthesizing a virtual object with the real space. Therefore, the user who acquired the image must imagine the intention and speculation for this image by actually visually recognizing the synthesized image, and cannot easily get a sense for the obtained image. It was.

  Therefore, an object of the present invention is to provide a sensory information expression server, a sensory information expression system, and a sensory information expression method capable of easily obtaining a sense of an obtained image.

  (1) A sensory information expression server that realizes expression of sensory information for an image, the text data acquiring unit acquiring text data collected from the Web, and the text data acquired by the text data acquiring unit A sensory dictionary that generates a sensory dictionary in which an object word representing an appearing object and a sensory term representing a sense felt by humans that are co-occurring with the object word are associated according to the degree of co-occurrence. Based on the generating means, the object specifying means for specifying the object corresponding to the thing word from the image data input at the client terminal, and the sensory dictionary generated by the sensory dictionary generating means, the object specifying Sensory term determining means for determining the sensory term in co-occurrence with the thing word corresponding to the object identified by the means; Sensory information representing the server, characterized in that the said sensory terms as determined by the image data and the sensory terms determining means comprising a transmission means for transmitting to said client terminal.

  According to the sensory information expression server of (1), the object corresponding to the thing word is specified from the image data input at the client terminal. And the thing word corresponding to the specified target object and the sensory term having a co-occurrence relationship are transmitted together with the image data input at the client terminal. That is, sensory terms that are highly relevant to the image input at the client terminal are transmitted to the client terminal together with the image data. As a result, a feeling for the obtained image can be easily obtained via the sensory information expression server.

  In addition, a sensory term currently popular on the Web such as a blog or a news distribution site can be determined from a plurality of sensory terms for an object of an image to be transmitted by a user. As a result, it is possible to easily obtain a sense corresponding to the current fashion, which is strongly related to an object word corresponding to an image to be transmitted by the user and semantically strong.

  In addition, a plurality of sensory terms can be determined according to the degree of co-occurrence with respect to a thing word. As a result, for example, by determining two sensory terms in descending order of co-occurrence for the object of the image to be transmitted by the user, and transmitting the two sensory terms together with the image data, A stronger sense can be easily obtained.

  (2) The image data input at the client terminal relates to map data including an object corresponding to a place name, and positional information for displaying the place name and the sensory term corresponding to the place name at the client terminal. The sensory dictionary generating means is a term co-occurring with the place name appearing in the text data acquired by the text data acquiring means. A sensory dictionary in which sensory terms representing human senses are associated with each other according to a co-occurrence degree is generated, and the target object specifying unit is a target object corresponding to the place name from the map data input in the client terminal. And the sensory term determining means is configured to determine the object specifying hand based on the sensory dictionary generated by the sensory dictionary generating means. The sensory term co-occurring with the place name corresponding to the object specified by the object is determined, and the transmitting unit is configured to determine the sensory term determined by the map data and the sensory term determining unit and the target. The sensory information expression server according to (1), wherein position information corresponding to the place name of the object specified by the object specifying means is transmitted.

  According to the sensory information expression server of (2), the object corresponding to the place name is specified from the map data including the object corresponding to the place name input at the client terminal. Then, sensory terms co-occurring with the place name corresponding to the specified object and the position information corresponding to the place name of the specified object are transmitted together with the map data input at the client terminal. As a result, a sense for the place name can be easily obtained via the sense information expression server.

  (3) The sensory information representation server according to (1) or (2), wherein the sensory term is an adjective representing a mental phenomenon related to olfaction, touch, or taste. According to the sensory information expression server of (3), it is possible to easily obtain an olfactory sense, a tactile sensation, and a taste sense that are particularly difficult to convey only by visual recognition.

  (4) A sensory information expression system that realizes expression of sensory information for an image on a client terminal via a sensory information expression server, wherein the client terminal is imaged by an imaging unit that images a subject, and the imaging unit An image data transmitting means for transmitting image data; a receiving means for receiving image data from the outside; and a display means for displaying the image data received by the receiving means. A text data acquisition means for acquiring the collected text data, an event word representing an event that appears in the text data acquired by the text data acquisition means, and a term co-occurring with the event word. A sensation that generates a sensation dictionary that associates sensation terms that express human sensations with the degree of co-occurrence The object generating unit, the object specifying unit for specifying the object corresponding to the thing word from the image data input at the client terminal, and the object dictionary based on the sensory dictionary generated by the sensory dictionary generating unit. Sensory term determining means for determining the sensory term co-occurring with the thing word corresponding to the object specified by the object specifying means, the image data transmitted from the image data transmitting means, and the Transmitting means for transmitting the sensory term determined by the sensory term determining means to the client terminal, and the receiving means receives the image data and the sensory term transmitted from the transmitting means, The sensory information expression system characterized in that the display means displays the image data and the sensory terms received by the receiving means.

  According to the sensory information expression system of (4), the object corresponding to the thing word is specified from the image data imaged by the imaging means of the client terminal. Then, the sense word having a co-occurrence relationship with the thing word corresponding to the identified target object is transmitted together with the image data imaged by the imaging means. Then, the client terminal displays the transmitted image data and the determined sensory term on the display means. As a result, it is possible to easily obtain a sense for an image obtained by taking an image by the sense information expression system.

  (5) A sensory information expression method that realizes expression of sensory information for an image, the text data acquisition step for acquiring text data collected from the Web, and the text data acquired by the text data acquisition step. Sensory dictionary generation that generates a sensory dictionary that associates an event word representing an appearing thing with a sensory term representing a sense felt by humans that is a term co-occurring with the event word according to the degree of co-occurrence The object specifying step based on the sensory dictionary generated by the sensory dictionary generated by the sensory step generated by the step, the target object specifying the target object corresponding to the thing word from the image data input at the client terminal A sense of determining the sensory term in co-occurrence with the thing word corresponding to the object identified by And terminology determining step, sensory information representing how to a transmission step, comprising the for transmitting said sensory terms determined by the sensory terms determining step and the image data to the client terminal.

  According to the sensory information expression method of (5), the object corresponding to the thing word is specified from the image data input at the client terminal. And the thing word corresponding to the specified target object and the sensory term having a co-occurrence relationship are transmitted together with the image data input at the client terminal. As a result, it is possible to easily obtain a feeling for an image input at the client terminal by the feeling information expression method.

  According to the present invention, a user can easily obtain a feeling for an image input to a client terminal.

It is a figure which shows the structural example of the sensory information expression system for implement | achieving the sensory information expression method of this embodiment. It is a figure which shows the thing word DB of the said embodiment. It is a figure which shows sensory term DB of the said embodiment. It is a figure which shows sensory dictionary DB of the said embodiment. It is a figure which shows image dictionary DB of the said embodiment. It is a figure which shows the hardware constitutions of the blog server which comprises the said sensory information expression system, a sensory information expression server, and a client terminal. It is a flowchart which shows the process of the sensory information expression method of the said embodiment. It is a figure which shows the example of a display of the image in the said embodiment. It is a figure which shows the structural example of the sensory information expression system for implement | achieving the sensory information expression method of another embodiment. It is a figure which shows position information DB of another embodiment. It is a flowchart which shows the process of the sensory information expression method of another embodiment. It is a figure which shows the example of a display of the image in another embodiment.

[First Embodiment]
According to the sensory information expression method of the present invention, image data and sensory terms input from a client terminal can be transmitted to the client terminal, and a user can easily obtain a sensory feeling for an object included in the image data. In the following, a sensory information expression system 1 suitable for realizing the sensory information expression method of the present invention will be described with reference to FIGS.

[Configuration example of sensory information expression system 1]
The sensory information expression system 1 includes a blog server 10, a sensory information expression server 20, and a client terminal 40.

  The blog server 10 includes blog distribution means 11. The sensory information expression server 20 includes a text data acquisition unit 21, a sensory dictionary generation unit 22, an object identification unit 23, a sensory term determination unit 24, a transmission unit 25, a thing word database (DB) 30, and a sensory term database (DB) 31. , A sensory dictionary database (DB) 32 and an image dictionary database (DB) 33. The client terminal 40 includes an imaging unit 41, an image data transmission unit 42, a reception unit 43, and a display unit 44.

  The blog server 10 distributes blog-written articles through the Internet via the blog distribution means 11. Here, the blog post article is an article composed of diary text data operated by an individual or a group of a plurality of people.

  The text data acquisition unit 21 of the sensory information expression server 20 acquires the text data of the blog article distributed from the blog distribution unit 11 of the blog server 10 through the Internet line. Acquisition of text data of a blog article is realized, for example, by executing software called a crawler that automatically circulates each server and collects content. The acquisition of text data is not limited to blog articles distributed by the blog server 10. For example, instead of the blog server 10, content distributed by an SNS server storing articles written by SNS or content of text data distributed by a news server such as a news distribution site may be used. Also, the acquisition of text data is not limited to being acquired through the Internet line. For example, text data may be acquired through a network line such as a PAN (Personal Area Network), a LAN (Local Area Network), or a WAN (Wide Area Network).

  The sensation dictionary generation means 22 is a word that represents an object that appears in the text data acquired by the text data acquisition means 21, and a term that is a co-occurrence term with the event word and represents a sensation felt by humans. That is, the sensory dictionary DB 32 is generated in which sensory terms representing a mental phenomenon experienced when a human sensory organ receives are associated according to the co-occurrence degree. Specifically, the text acquired by the text data acquisition means is subjected to morphological analysis, classified into parts of speech, and the event words stored in the event word DB 30 and the sensory terms stored in the sensory term DB 31 are referred to. Extract thing words and sense words. Then, the co-occurrence hit information between the extracted event word and the sensory term is calculated as the co-occurrence degree, and the association between the event word and the sensory term and the co-occurrence of the event word and each sensory term corresponding thereto are performed. The degree is stored in the sensory dictionary DB 32 and the sensory dictionary DB 32 is generated.

  The imaging means 41 of the client terminal 40 accepts input of image data by the user. That is, the imaging unit 41 has a camera function as an imaging unit provided with an imaging element such as a camera lens or a CCD (Charge Coupled Device). The image data transmission unit 42 transmits the image data input via the imaging unit 41 to the sensory information expression server 20.

  The object specifying means 23 of the sensory information expression server 20 refers to the image dictionary DB 33 and specifies the image of the object corresponding to the thing word from the image data input from the client terminal 40 via the imaging means 41. .

  Specifically, first, feature information is extracted from image data input via the imaging unit 41 in the client terminal 40. The feature information includes the image outline and the number of colors. Such a technique is publicly known (for example, refer to Japanese Patent Application Laid-Open No. 2006-114053). By doing so, it is confirmed that the image in the image data input through the imaging unit 41 is, for example, “apple”. Can be recognized. Then, referring to the image dictionary DB 33, based on a similar image search technique that has already been put into practical use, an image that matches the feature information is specified, and the image data that is input via the imaging unit 41 matches the feature information. Identify the object image. At this time, if there is no feature information that completely matches, the one with the highest similarity is selected. In the similar image search, visual information from the image to be searched is indicated by numerical sequence data (image feature amount) of several hundred dimensions, and the degree of similarity (similarity) between the data is determined between the image feature amount vectors. , That is, the difference between the image feature amounts.

  The sensory term determining unit 24 determines sensory terms having a co-occurrence relationship with an object word corresponding to the object specified by the object specifying unit 23 based on the sensory dictionary DB 32 generated by the sensory dictionary generating unit 22. Do. Specifically, referring to the sensory dictionary DB 32, the sensory term having the highest co-occurrence degree is determined among a plurality of sensory terms corresponding to the thing word corresponding to the specified object. In this case, two or more sensory terms may be determined in descending order of co-occurrence among a plurality of sensory terms corresponding to the thing word.

  The transmission unit 25 transmits the sensory term determined by the sensory term determination unit 24 and the image data input via the imaging unit 41 of the client terminal 40 to the client terminal 40. Specifically, the sensory term determined by the sensory term determining unit 24 is transmitted to the client terminal 40 together with the image data input via the imaging unit 41 of the client terminal 40. In this case, data corresponding to the sensory term determined by the sensory term determining means 24 may be added to the image data input at the client terminal and transmitted to the client terminal 40 together with the image data. When a plurality of sensory terms are determined by the sensory term determining means 24, the determined sensory terms may be transmitted together with image data.

  The receiving means 43 of the client terminal 40 receives the image data transmitted from the sensory information expression server 20 and the determined sensory term through the Internet line. The display means 44 displays an image corresponding to the image data received by the receiving means 43 on the display device 1360 of the client terminal 40, which will be described later with reference to FIG. 7, and displays the determined sensory terms on the display device. Displayed together with the image displayed at 1360. Specifically, on the display screen of the display device 1360 of the client terminal 40, an image input via the imaging means 41 of the client terminal 40 is displayed, and sensory terms corresponding to the displayed image are displayed together. To do.

[Thing word DB]
The thing word DB 30 will be described with reference to FIG. The event word DB 30 stores the event word No. Every time, an event word representing an event is stored. Things word No. Is used to uniquely identify a thing word. A thing word is a word composed of nouns representing things that act as subjects or objects in a sentence.

[Sense term DB]
With reference to FIG. 3, sensory term DB31 is demonstrated. The sensory term DB 31 is a sensory term No. Every time, sensory terms representing human senses are stored. Sensory term No. Is used to uniquely identify sensory terms. Sensory terms are composed of adjectives that are sensed by the five senses of the human body, and in particular, represent the properties, states, and emotions of things such as olfaction, touch, and taste, and are composed of adjectives that modify nouns in the sentence.

[Sense Dictionary DB]
The sensory dictionary DB 32 will be described with reference to FIG. The sensory dictionary DB 32 stores, for each event word, a plurality of sensory terms corresponding to the event word and the co-occurrence degree of each sensory term corresponding to the event word. The co-occurrence degree is information that prescribes the degree of relevance to the meaning of the sense term for the thing word. For example, the degree of co-occurrence is determined according to the number of sensory terms that appear corresponding to the thing word in the text data acquired by the text data acquiring unit 21.

[Image Dictionary DB]
The image dictionary DB 33 will be described with reference to FIG. The image dictionary DB 33 stores a thing word for each image. An image having feature information that matches the feature information of each image input via the imaging means 41 of the client terminal 40 is specified from the image dictionary DB 33. The images stored in the image dictionary DB 33 are stored by JPEG (Joint Photographic Experts Group), but are not limited thereto. For example, BMP, PICT, GIF (Graphics Interchange Format) (registered trademark), and PNG (Portable Network graphics) may be stored.

[Hardware Configuration of Blog Server 10, Sensory Information Representation Server 20, and Client Terminal 40]
FIG. 6 is a diagram illustrating a hardware configuration of the sensory information expression server 20. An apparatus in which the present invention is implemented may be a standard one, and an example of the configuration is shown below. Although not described in detail, the blog server 10 and the client terminal 40 have the same hardware configuration as the sensory information expression server 20.

  The sensory information expression server 20 includes a CPU (Central Processing Unit) 1310 (a plurality of CPUs such as a CPU 1320 may be added in a multiprocessor configuration), a bus line 1200, a communication I / F (I / F). : Interface) 1330, main memory 1340, BIOS (Basic Input Output System) 1350, display device 1360, I / O controller 1370, input device 1380 such as a keyboard and mouse, hard disk 1390, optical disk drive 1400, semiconductor memory 1420, and imaging A device 1440 is provided. The hard disk 1390, the optical disk drive 1400, and the semiconductor memory 1420 are collectively referred to as a storage device 1430.

  The control unit 1300 is a part that controls the sensory information expression server 20 in an integrated manner. By appropriately reading and executing various programs stored in the hard disk 1390 (described later), the control unit 1300 cooperates with the hardware described above. Various functions according to the invention are realized.

  The communication I / F 1330 is a network adapter when the sensory information expression server 20 transmits / receives information to / from the blog server 10 and the client terminal 40 via the network. The communication I / F 1330 may include a modem, a cable modem, and an Ethernet (registered trademark) adapter. Note that the transmission means 25 of the sensory information expression server 20, the image data transmission means 42, and the reception means 43 of the client terminal 40 are realized by the communication I / F 1330.

  The BIOS 1350 records a boot program executed by the CPU 1310 when the sensory information expression server 20 is started, a program depending on the hardware of the sensory information expression server 20, and the like.

  Display device 1360 includes a display device such as a cathode ray tube display device (CRT) or a liquid crystal display device (LCD). The display unit 44 of the client terminal 40 is realized by a display device 1360 formed by a liquid crystal display device.

  A storage device 1430 such as a hard disk 1390, an optical disk drive 1400, and a semiconductor memory 1420 can be connected to the I / O controller 1370.

  The hard disk 1390 stores various programs for causing the hardware to function as the sensory information expression server 20, programs for executing the functions of the invention, and the tables and records described above. The sensory information expression server 20 can also use a hard disk (not shown) separately provided as an external storage device.

  As the optical disk drive 1400, for example, a DVD-ROM drive, a CD-ROM drive, a DVD-RAM drive, or a CD-RAM drive can be used. In this case, the optical disk 1410 corresponding to each drive is used. A program or data may be read from the optical disk 1410 by the optical disk drive 1400 and provided to the main memory 1340 or the hard disk 1390 via the I / O controller 1370.

  The hard disk 1390 stores various programs for causing the hardware to function as the sensory information expression server 20, programs for executing the functions of the invention, and the tables and records described above. The sensory information expression server 20 can also use a hard disk (not shown) separately provided as an external storage device.

  The imaging device 1440 includes an imaging element such as a camera lens and a CCD, and can photograph an object, a person, a landscape, etc. desired by the user and store it as image data. The imaging means 41 of the client terminal 40 is realized by the imaging device 1440. Note that the imaging device 1440 is a function that only the client terminal 40 has, and the blog server 10 and the sensory information expression server 20 may not be provided.

  The computer in the present invention refers to a terminal including a storage device, a control unit, and the like, and the sensory information expression server 20 includes a terminal including a storage device 1430, a control unit 1300, and the like. It is included in the concept of the computer of the present invention.

  Each means of the sensory information expression server 20 is realized by executing a program by the control unit 1300. However, although the data storage unit is mainly mounted on the hard disk 1390, other storage devices may be used as described above.

[Processing flow]
FIG. 7 is a flowchart showing a flow of processing for realizing the sensory information expression method of the present embodiment.

  S1: When a blog is written by an unspecified user, the control unit 1300 (blog distribution unit 11) of the blog server 10 distributes the written article of the written blog via the communication I / F 1330. .

  S2: When the blog server 10 distributes the blog writing article, the control unit 1300 (text data acquisition means 21) of the sensory information expression server 20 acquires the text data of the distributed blog article.

  S3: Subsequently, the control unit 1300 (sensory dictionary generation means 22) of the sensory information expression server 20 refers to the thing word DB 30 and the sensory term DB 31 to associate the thing word with the sensory term, The co-occurrence degree with each corresponding sensory term is stored in the sensory dictionary DB 32 to generate the sensory dictionary DB 32.

  S4: Next, the control unit 1300 (imaging unit 41) of the client terminal 40 images the object via the imaging device 1440 and accepts an input of an image of the acquired imaging data.

  S5: Subsequently, the control unit 1300 (image data transmission unit 42) of the client terminal 40 transmits the imaging data via the communication I / F 1330 of the client terminal 40 when receiving the input of the imaging data.

  S6: Next, the control unit 1300 (the object specifying unit 23) of the sensory information expression server 20 extracts feature information from the input imaging data, refers to the image dictionary DB 33, and inputs an image of the input imaging data. The image of the object whose feature information matches is specified.

  S7: Next, the control unit 1300 (sensory term determining means 24) of the sensory information expression server 20 uses the thing word corresponding to the image of the object specified by the object specifying means 23 based on the generated sensory dictionary DB32. Among the sensory terms that have a co-occurrence relationship, the sensory term having the highest co-occurrence degree is determined.

  S8: Next, the control unit 1300 (transmission means 25) of the sensory information expression server 20 transmits the determined sensory term and the imaging data transmitted from the client terminal 40 to the client terminal 40 through the communication I / F 1330. .

  S9: Subsequently, the control unit 1300 (reception unit 43) of the client terminal 40 receives the imaging data and sensory terms transmitted from the sensory information expression server 20 through the communication I / F 1330.

  S10: Next, the control unit 1300 (display unit 44) of the client terminal 40 displays the text corresponding to the determined sensory term on the display device 1360 of the client terminal 40 together with the transmitted image data.

[Display example on client terminal]
With reference to FIG. 8, a display example in which an image of captured image captured by the client terminal 40 is displayed on a mobile phone as the client terminal 40 will be described.

  In FIG. 8, the “apple” image captured by the user at the client terminal 40 is displayed on the display device 1360 of the client terminal 40 via the sensory information expression server 20.

  Here, when the user shoots an “apple” using the client terminal 40 and transmits imaging data of “apple” to the sensory information expression server 20, the sensory information expression server 20 stores the image data in the sensory dictionary DB 32. Among the sense terms, “sweet” which is the sense term having the highest co-occurrence with respect to the image “apple” of the imaged data is determined.

  Then, the image data and the determined sensory term are transmitted to the client terminal 40, so that an image captured by the user via the imaging device 1440 of the client terminal 40 becomes an image display area of the display device 1360 of the client terminal 40. The sense term “Amai” that is highly relevant to the image data captured by the user is displayed in the sense term display area 56 of the display device 1360.

  When the user transmits new imaging data via the imaging device of the client terminal 40, the sensory terms displayed in the sensory term display area 56 of the client terminal 40 are cleared and new sensory terms are displayed. The

  In this way, sensory terms having a high degree of co-occurrence with respect to the object included in the image data input from the imaging means 41 of the client terminal 40 by the user, that is, highly relevant to the meaning, are determined. Accordingly, it is possible to easily obtain the feeling felt by the user with respect to the image obtained via the imaging means 41.

[Second Embodiment]
Next, a sensory information expression method according to another embodiment of the present invention will be described using a sensory information expression system 1A suitable for realizing this sensory information expression method. The sensory information expression method according to the second embodiment is different from the sensory information expression method according to the first embodiment in that map data transmitted from the map server 500 is transmitted instead of the imaging means of the client terminal.

[Configuration example of sensory information expression system 1A]
Referring to FIG. 9, sensory information expression system 1 </ b> A includes blog server 100, sensory information expression server 200, and client terminal 400.

  The blog server 100 includes blog distribution means 101. The sensory information expression server 200 includes a text data acquisition unit 201, a sensory dictionary generation unit 202, a target object specifying unit 203, a sensory term determination unit 204, a transmission unit 205, a thing word database (DB) 300, and a sensory term database (DB) 301. , Sensory dictionary database (DB) 302 and position information database (DB) 303. The client terminal 400 includes a map database (DB) 401, map data input means 401, map data transmission means 402, reception means 403, and display means 404.

  The blog server 100 distributes blog-written articles via the blog distribution means 101 through the Internet line.

  The text data acquisition unit 201 of the sensory information expression server 200 acquires the text data of the blog article distributed from the blog distribution unit 101 of the blog server 100 through the Internet line. In addition, the acquisition of the text data is not limited to that through the Internet line, and the text data may be acquired through a network line such as PAN, LAN, or WAN.

  The sensory dictionary generation unit 202 is a term having a co-occurrence with a place name appearing in the text data acquired by the text data acquisition unit 201, and is a term representing a sense felt by humans, that is, a human body sense. A sensory dictionary DB 302 is generated that associates sensory terms representing a mental phenomenon experienced when a vessel is received according to the degree of co-occurrence. Specifically, referring to the mark representing the place name stored in the thing word DB 300 and the sensory term stored in the sensory term DB 301, the text acquired by the text data acquisition means is subjected to morphological analysis, and the part of speech is obtained. Classification is performed, and a title representing a place name and a sense word are extracted. Then, the co-occurrence hit information between the extracted title representing the place name and the sensory term is calculated as the co-occurrence degree, the association between the title and the sensory term, and the co-occurrence of the title and each sensory term corresponding thereto. The degree is stored in the sense dictionary DB 302, and the sense dictionary DB 302 is generated.

  In response to a map browsing request from the client terminal 400, the map data input means 401 of the client terminal 400 inputs map data corresponding to the map requested to be browsed from the map data stored in the map server 500. Is to accept.

  The map data transmission unit 402 of the client terminal 400 transmits the map data input via the map data input unit 401 to the sensory information expression server 200. Specifically, map data having map content having position information regarding a plurality of points and position information indicating place names is transmitted.

  The object specifying unit 203 of the sensory information expression server 200 refers to the position information DB 303 and selects the object corresponding to the mark representing the place name from the map data input via the map data input unit 401 of the client terminal 400. Identify.

  Specifically, first, feature information is extracted from the map data input via the map data input unit 401 of the client terminal 400. The feature information includes a contour of a map that is an object represented by the map data. Such a technique is publicly known (see, for example, Japanese Patent Application Laid-Open No. 2006-114053). By doing so, a mark corresponding to a place name in map data input via the map data input unit 401 of the client terminal 400 is used. Can be recognized as, for example, “Kenya”. Then, referring to the position information DB 303, based on a similar image search technique that has already been put into practical use, a mark that matches the feature information is specified, and the map data input by the client terminal 400 matches the target information that matches the feature information. Identify the title. At this time, if there is no feature information that completely matches, the one with the highest similarity is selected. In the similar image search, visual information is indicated by numerical sequence data (image feature amount) of several hundred dimensions from the map data image to be searched, and the degree of similarity (similarity) between the data is indicated by the image feature. The distance between the quantity vectors, that is, the difference between the image feature quantities is evaluated.

  The sensory term determining unit 204 is based on the sensory dictionary DB 302 generated by the sensory dictionary generating unit 202, and the sensory term having a co-occurrence relationship with the mark representing the place name corresponding to the object specified by the object specifying unit 203 is used. Make a decision. Specifically, with reference to the sensory dictionary DB 302, a sensory term having the highest co-occurrence degree is determined among a plurality of sensory terms corresponding to a mark representing a place name corresponding to the identified object.

  The transmission means 205 uses the map data input means 401 to display the sensory terms determined by the sensory term determination means 204, the location information corresponding to the place name specified by the object specifying means 203, and the mark representing the place name corresponding to the object. It is transmitted to the client terminal 400 together with the map data input via the interface. Specifically, together with the map data input at the client terminal 400, the position information corresponding to the place name specified with reference to the position information DB 303 and the data of the determined sense term are transmitted. In this case, the map data is added with the position information corresponding to the place name specified with reference to the position information DB 303 and the data of the determined sense term, and transmitted to the client terminal 400 together with the map data. Also good. When a plurality of sensory terms are determined by the sensory term determining means 204, the determined sensory terms may be transmitted together with the map data. At this time, the mark indicating the place name corresponding to the object is transmitted together with the position information and the sensory term. However, if the mark is not displayed on the display device 1360 of the client terminal 400 described later, it may not be transmitted.

  The receiving means 403 of the client terminal 400 receives the map data, the position information, and the determined sensory terms transmitted from the sensory information expression server 200 through the Internet line. The display unit 404 displays a map corresponding to the map data received by the receiving unit 403 on the display device 1360 of the client terminal 400 described later with reference to FIG. Based on the position information, it is displayed together with the map displayed on the display device 1360. Specifically, on the display device 1360 of the client terminal 400, the map input by the map data input means 401 is displayed, and sensory terms and marks corresponding to the displayed map are displayed together based on the position information. .

[Thing word DB]
The thing word DB 300 will be described with reference to FIG. The event word DB 300 includes an event word No. Every time, an event word representing an event is stored. Things word No. Is used to uniquely identify a thing word. A thing word is a word composed of nouns representing things that act as subjects or objects in a sentence. In the second embodiment, a thing word related to the place name is stored.

[Sense term DB]
With reference to FIG. 3, sensory term DB301 is demonstrated. The sensory term DB 301 is a sensory term No. Every time, sensory terms representing human senses are stored. Sensory term No. Is used to uniquely identify sensory terms. Sensory terms are composed of adjectives that are sensed by the five senses of the human body, and in particular, represent the properties, states, and emotions of things such as olfaction, touch, and taste, and are composed of adjectives that modify nouns in the sentence.

[Sense Dictionary DB]
The sensory dictionary DB 302 will be described with reference to FIG. The sensory dictionary DB 302 stores, for each event word representing a place name, a plurality of sensory terms corresponding to the event word and the co-occurrence degree of each sensory term corresponding to the event word. The co-occurrence degree is information that prescribes the degree of relevance to the meaning of the sense term for the thing word. For example, the co-occurrence degree is determined according to the number of sensory terms that appear corresponding to the thing word in the text data acquired by the text data acquiring unit 201.

[Location information DB]
The position information DB 303 will be described with reference to FIG. The position information DB 303 stores position information and feature information for each mark. The position information is coordinate information when the sensory term is displayed on the display device 1360 of the client terminal 400. The title is information in which only the word corresponding to the place name on the map represented by the map data among the event words stored in the event word DB 300 is described. A mark having feature information that matches the feature information of each map input by the map data input means 401 is specified from the position information DB 303. Note that the position information DB 303 includes a storage device 1430 such as a hard disk 1390, an optical disk 1410, and a semiconductor memory 1420.

[Hardware Configuration of Blog Server 100, Sensory Information Representation Server 200, Client Terminal 400, and Map Server 500]
The hardware configuration of the blog server 100, the sensory information expression server 200, the client terminal 400, and the map server 500 is the same as that of the sensory information expression server 200 of the first embodiment.

[Processing flow]
FIG. 11 is a flowchart showing a flow of processing for realizing the sensory information expression method of the second embodiment.

  S101: When a blog is written by an unspecified user, the control unit 1300 (blog distribution unit 101) of the blog server 100 distributes the written article of the written blog via the communication I / F 1330. .

  S102: When the blog server 100 distributes the blog writing article, the control unit 1300 (text data acquisition unit 201) of the sensory information expression server 200 acquires the text data of the distributed blog article.

  S103: Subsequently, the control unit 1300 (sensory dictionary generating unit 202) of the sensory information expression server 200 refers to the event word DB 300 and the sensory term DB 301, and associates the event word corresponding to the place name with the sensory term, The co-occurrence degree of the thing word corresponding to the place name and each sensory term corresponding thereto is stored in the sensory dictionary DB 32 to generate the sensory dictionary DB 32.

  S104: Next, in response to a map browsing request from the client terminal 400, the control unit 1300 (map data input unit 401) of the client terminal 400 receives a browsing request from the map data stored in the map server 500. Accepts input of map data corresponding to the map.

  S105: Subsequently, the control unit 1300 (map data transmission unit 1330) of the client terminal 400 transmits the input map data through the communication I / F 1330.

  S106: Next, the control unit 1300 (the object specifying unit 203) of the sensory information expression server 200 extracts feature information from the map data input at the client terminal 400, and is input with reference to the position information DB 303. The target object whose feature information and place name of the map data match is specified.

  S107: Next, the control unit 1300 (sensory term determining unit 204) of the sensory information expression server 200 represents a place name corresponding to the target object specified by the target object specifying unit 203 based on the generated sensory dictionary DB 302. The sensory term having the highest degree of co-occurrence is determined from the sensory terms that are co-occurring with each other.

  S108: Next, the control unit 1300 (transmission unit 205) of the sensory information expression server 200 corresponds to the sensory term determined by the communication I / F 1330 and the mark representing the place name specified by the object specifying unit 203. Map data input at the client terminal 400 is transmitted to the client terminal 400 together with the position information.

  S109: Subsequently, the control unit 1300 (receiving unit 403) of the client terminal 400 receives the sensory terms and the map data transmitted from the sensory information expression server 200 through the communication I / F 1330.

  S110: Next, the control unit 1300 (display unit 404) of the client terminal 400 displays the determined sensory terms and marks together with the map of the map data on the display device 1360 of the client terminal 400 based on the position information.

[Display example on client terminal]
With reference to FIG. 12, the sensory information expression method of 2nd Embodiment is demonstrated. FIG. 12 illustrates a display example in which a map of map data transmitted from the map server 500 and input at the client terminal 400 is displayed on a mobile phone as the client terminal 400.

  In FIG. 12, a map of Africa including “Kenya” input at the client terminal 400 is displayed on the display device 1360 of the client terminal 400 via the sensory information expression server 200.

  Here, when the map data including the map of “Kenya” input at the client terminal 400 is transmitted to the sensory information expression server 200, the sensory information expression server 200 senses the sense “Kenya” corresponding to the place name of the map data. The term “hot”, position information corresponding to the title, and the title “Kenya” are transmitted to the client terminal 400 together with the input map data.

  The map transmitted from the sensory information expression server 200 is displayed on the image display area 55A of the display device 1360 of the client terminal 400, and the determined sensory terms “hot” and the title “Kenya” are transmitted together. The sensory term display area 56A of the display device 1360 is displayed based on the coordinate information of the position information. As shown in FIG. 12, not only the target title “Kenya” but also other titles “Ethiopia”, “Somalia”, “Tanzania”, etc. included in the map data may be displayed.

  When the client terminal 400 requests new map data and new map data is transmitted from the client terminal 400, the sensory terms displayed in the sensory term display area 56A of the client terminal 400 are cleared and new Sensory terms are displayed.

  As described above, a sensory term having a high degree of co-occurrence, that is, a highly related sensory term is transmitted with respect to a title representing a place name included in the map data transmitted after the map data is input in response to a request from the client terminal 400. Is done. Therefore, the user who requests the map data can easily obtain the feeling felt for the map data.

  Although the embodiment of the present invention has been described above, the present invention is not limited to the present embodiment, and modifications, improvements, and the like within the scope that can achieve the object of the present invention are included in the present invention. .

  For example, sensory terms are associated with sensed terms with respect to image data captured via the imaging device 1440 of the client terminal 40 and the sensory terms are displayed together with the sensed images on the display means 44 of the client terminal 40. Not limited. For example, the client terminal 40 includes an external memory I / F that can be connected to various memory cards such as CompactFlash (registered trademark), Memory Stick (registered trademark), and SD card (registered trademark). The image input via the terminal may be transmitted to the sensory information expression server by the transmission unit of the client terminal 40.

  The co-occurrence degree stored in the sensory dictionary DB 32 is determined according to the number of sensory terms appearing corresponding to the thing word in the text data acquired by the text data acquiring unit 21. Not limited. That is, the association between the thing word and the sensory term and the co-occurrence degree of the thing word and each sensory term corresponding thereto can be changed by the user using the client terminal 40 according to the individual sense. It may be. As a result, by further increasing the co-occurrence of sensory terms that match the senses of the individual, the user can more clearly communicate the feeling he / she felt to the other user. Further, the transmission means of the sensory information expression server 20 transmits image data together with sensory terms to the client terminal 40, but is not limited thereto. For example, only sensory terms may be transmitted.

DESCRIPTION OF SYMBOLS 1 Sensory information expression system 10 Blog server 11 Blog distribution means 20 Sensory information expression server 21 Text data acquisition means 22 Sensory dictionary generation means 23 Object identification means 24 Sensory term determination means 25 Distribution means 30 Things word DB
31 Sensory term DB
32 Sensory Dictionary DB
33 Image Dictionary DB
40 Client terminal 41 Imaging means 42 Image data transmitting means 43 Receiving means 44 Display means

Claims (5)

A sensory information expression server that realizes the expression of sensory information for images,
Text data acquisition means for acquiring text data collected from the web;
Co-occurrence of an event word representing an event appearing in the text data acquired by the text data acquisition means and a sensory term representing a sense felt by a human being in a co-occurrence relationship with the event word Sensory dictionary generation means for generating a sensory dictionary associated according to the degree;
An object specifying means for specifying an object corresponding to the object word from image data input at a client terminal;
Based on the sensory dictionary generated by the sensory dictionary generator, the sensory term determination for determining the sensory term co-occurring with the thing word corresponding to the object specified by the object specifying unit Means,
Transmitting means for transmitting the image data and the sensory term determined by the sensory term determining means to the client terminal;
A sensory information expression server characterized by comprising: The image data input in the client terminal relates to map data including an object corresponding to a place name,
Position information storage means for storing the place name and position information corresponding to the place name and displaying the sensory term on the client terminal;
With
The sensory dictionary generation unit is configured to share a place name appearing in the text data acquired by the text data acquisition unit and a sensory term representing a sense felt by a human being in a co-occurrence relationship with the place name. Generate a sensory dictionary associated with the degree of occurrence,
The object specifying means specifies an object corresponding to the place name from the map data input at the client terminal,
The sensory term determining unit is configured to select the sensory term having a co-occurrence relationship with the place name corresponding to the target object specified by the target object specifying unit based on the sensory dictionary generated by the sensory dictionary generating unit. Decide
The transmitting means transmits the map data, the sensory terms determined by the sensory term determining means, and position information corresponding to the place name of the object specified by the object specifying means. The sensory information expression server according to claim 1.   The sensory information expression server according to claim 1, wherein the sensory term is an adjective representing a mental phenomenon related to olfaction, touch, or taste. A sensory information expression system that realizes expression of sensory information for an image on a client terminal via a sensory information expression server,
The client terminal is
Imaging means for imaging a subject;
Image data transmitting means for transmitting image data imaged by the imaging means;
Receiving means for receiving image data from outside;
Display means for displaying the image data received by the receiving means,
The sensory information expression server includes:
Text data acquisition means for acquiring text data collected from the web;
Co-occurrence of an event word representing an event appearing in the text data acquired by the text data acquisition means, and a sensory term representing a sense felt by a human being in a co-occurrence relationship with the event word Sensory dictionary generation means for generating a sensory dictionary associated according to the degree;
An object specifying means for specifying an object corresponding to the object word from image data input at the client terminal;
Based on the sensory dictionary generated by the sensory dictionary generating unit, sensory term determination for determining the sensory term co-occurring with the thing word corresponding to the object identified by the object identifying unit Means,
Transmitting means for transmitting the image data transmitted from the image data transmitting means and the sensory term determined by the sensory term determining means to the client terminal,
The receiving means receives the image data and the sensory terms transmitted from the transmitting means,
The sensory information expression system characterized in that the display means displays the image data and the sensory terms received by the receiving means. A sensory information expression method that realizes expression of sensory information for an image,
A text data acquisition step of acquiring text data collected from the web;
A co-occurrence degree includes an event word representing an event appearing in the text data acquired by the text data acquisition step, and a sensory term representing a sense felt by a human being in a co-occurrence relationship with the event word A sensory dictionary generation step for generating a sensory dictionary associated according to
An object specifying step for specifying an object corresponding to the thing word from the image data input at the client terminal;
Based on the sensory dictionary generated in the sensory dictionary generation step, sensory term determination for determining the sensory term co-occurring with the thing word corresponding to the object specified in the object specifying step Steps,
A transmission step of transmitting the image data and the sensory term determined by the sensory term determination step to a client terminal;
Sensory information expression method characterized by comprising

Images