JP2016006571A - Information processing device, communication device, and information providing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device capable of easily acquiring information of an object wanted to be acquired, and to provide a communication device, and an information providing system.SOLUTION: The information processing device includes: information holding means for associating identification information of a sounding device with object information to hold them in a prescribed storage area; acquisition means for receiving the identification information of the sounding device from the information processing device, and acquiring the object information corresponding to the identification information from the information holding means according to the received identification information of the sounding device; and transmission means for transmitting the object information acquired by the acquisition means to the information processing device.

Description

  The present invention relates to an information processing device, a communication device, and an information providing system.

  In facilities equipped with a wide variety of objects such as organisms and exhibits, descriptions of each object are posted. In order for the viewer to see the explanation, it had to go before the explanation that was posted. Before the explanations were often crowded, it took time to see the explanations.

  In order to solve this problem, a technique is known in which information about an object to be obtained can be obtained by taking an image of the object to be obtained into an information terminal.

  For example, the image data of the object whose information is to be acquired is transmitted to the server, the image data registered in advance on the server side is compared with the image data of the object whose information is to be acquired, and matched with the matching image data. A technique for transmitting information on a target object to a communication terminal is already known (see, for example, Patent Document 1).

  The above-described prior art has an effect that information on an object desired to be acquired on the spot can be acquired without going to an explanatory note in which the target information is written. However, since there are many objects to be searched in the facility, there is a problem that it takes time for the user to find the corresponding object and provide information related to the user.

  The present invention has been proposed in view of the above-described conventional problems, and an object of the present invention is to provide an information processing apparatus, a communication apparatus, and an information providing system that can easily acquire information on an object to be acquired. There is to do.

  In order to solve the above problem, for example, the information processing apparatus associates the identification information of the sounding device with the object information and holds the information in the predetermined storage area, and the identification information of the sounding device as information. An acquisition means for receiving the object information corresponding to the identification information from the information holding means according to the identification information of the sounding device received from the processing device, and the object acquired by the acquisition means Transmitting means for transmitting information to the information processing apparatus.

  According to one aspect of the present invention, it is possible to easily acquire information on an object to be searched.

It is a figure which shows an example of the system configuration | structure of the information provision system in this embodiment. It is the figure which showed an example of positional relationship, such as a speaker, a microphone, a camera in the information terminal of this embodiment. It is an image figure of how to hold the information terminal in this embodiment. It is a figure which shows an example of the hardware constitutions of the information terminal in this embodiment. It is a figure which shows an example of the hardware constitutions of the sounding device in this embodiment. It is a figure which shows an example of the hardware constitutions of the server in this embodiment. It is a figure which shows an example of a function structure of each component which comprises the information provision system in this embodiment. It is a figure which shows an example of the data structure of the information which shows the accumulation | storage number of the target object information matched with the identification information of each sounding device in this embodiment. It is a figure which shows an example of the display screen of the target object information in this embodiment. It is a figure which shows an example of a data structure of the registration information preserve | saved at the server in this embodiment. It is a figure which shows an example of a data structure of the location information of the sounding device in this embodiment. It is a sequence diagram which shows the flow until the information terminal in this embodiment acquires target object information using sounding device identification information. It is a figure which shows an example of the procedure of the process in which the information terminal in this embodiment acquires target object information. It is a figure which shows an example of the procedure of the process in which the server in this embodiment transmits target object information to an information terminal. It is a figure which shows an example of a function structure of each component of the information provision system in this modification. It is a sequence diagram which shows the flow until the information terminal in this modification acquires object information using sounding device identification information.

  Hereinafter, preferred embodiments of the present invention will be described.

<System configuration>
≪System Overview≫
FIG. 1 is a diagram illustrating an example of a system configuration of an information providing system 1 according to the present embodiment. The information providing system 1 includes an information terminal 2, a sound generation device 3, and a server 4. The server 4 is connected to the information terminal 2 and the sound generator 3 via a network.

  The information terminal 2 is an information processing terminal, such as a smartphone, a tablet terminal, and a mobile phone. The information terminal 2 acquires the sound emitted from the sounding device 3 and extracts the sounding device identification information (hereinafter referred to as sounding device identification information) from the sound. The information terminal 2 transmits to the server 4 a transmission request for the extracted sounding device identification information and object information. The information terminal 2 receives the object information from the server and displays it. The object is a living creature, a product, or a work of art that is on display. The object information is information related to the object such as the name of the object.

  The sound generation device 3 is a device that emits sound, and is, for example, a speaker. The sound producing device 3 receives the identification information of the sound producing device 3 transmitted from the server 4. The sound generating device 3 emits a sound including the received identification information. The setting of the identification information of the sound generating device 3 is not limited to the method based on reception from the server 4 and may be a method of setting manually.

  The server 4 is, for example, a PC (Personal Computer). The server 4 stores the identification information of the sound generator 3 in a predetermined storage area. Further, the server 4 transmits the identification information of the sounding device 3 to the sounding device 3. For example, a communication protocol such as HTTP (Hypertext Transfer Protocol) is used for communication between the server 4 and the sound generation device 3.

  Further, the server 4 stores the object information in association with the sound generator identification information. The server 4 searches for the corresponding object information based on the identification information of the sounding device 3 transmitted from the information terminal 2 or the identification information of the sounding device 3 and the acquired image data of the object, and transmits it to the information terminal 2 To do.

  In the present embodiment, the functions of the server 4 are integrated into one apparatus, but a configuration in which each function is distributed to one or more apparatuses may be employed.

≪Information terminal structure≫
FIG. 2 is a diagram showing an example of the positional relationship between the speaker, microphone, camera, and the like in the information terminal 2. As shown in FIG. 2, many information terminals 2 including a smartphone are provided with a microphone below the display unit. The camera is provided above the display unit.

  In the information terminal having the structure described above, when shooting with a camera, the user holds the camera up and the microphone down so that the camera is not blocked by hand.

  FIG. 3A is an image diagram of how to hold the camera with the microphone up and the microphone down so as not to block the camera. Further, as shown in FIG. 3B, the user may rotate the information terminal 2 and hold it sideways. At that time, the user holds the camera so as not to be blocked by the hand, and the microphone is positioned sideways. As shown in FIG. 3 (c), the user can also hold the camera with his hand and hold the microphone up. In this case, the user can hold the camera with his hand. Because it is blocked, it becomes impossible to shoot.

≪Location of sound generator≫
The sound generating device 3 is desirably installed at a position where the microphone of the information terminal 2 can acquire the direct sound from the sound generating device 3. By installing the sounding device 3 at a position where the information terminal 2 can collect the direct sound from the sounding device 3, the information terminal 2 can effectively acquire the sound emitted by the sounding device 3. Moreover, by installing the sounding device 3 at a position where the information terminal 2 can acquire the direct sound from the sounding device 3, the sounding device 3 emits more sound than when the information terminal 2 cannot directly acquire the sound from the sounding device 3. The sound volume can be lowered. Thereby, the power consumption of the sound generator 3 can be suppressed. In addition, it is possible to prevent the generated sound from becoming a nuisance to the user. As for harshness, if the sound produced by the sound generator is set to high frequency, it will not be heard by adults and will not feel uncomfortable, but in the case of children and animals, the high frequency is also audible, so it may be noisy. There are some points to consider.

  Considering the structure of the information terminal shown in FIG. 2, the sounding device 3 may be installed at a position lower than the position where the user has the information terminal 2, for example. For example, the position lower than the position where the user holds the information terminal 2 is a position lower than the height when the user extends his hand up.

  Note that, depending on the information terminal 2, the position of the microphone may be provided on the display unit. Therefore, the installation position of the sounding device 3 is not limited to a position lower than the position where the user has the information terminal 2. The position may be higher than the position where the user has the information terminal 2.

  Further, the position of the sounding device 3 may be determined based on statistical information regarding the position of the microphone of the information terminal 2 used by the user.

<Hardware configuration>
≪Information terminal≫
FIG. 4 is a diagram illustrating an example of a hardware configuration of the information terminal 2 in the present embodiment. The information terminal 2 includes an EEPROM (Electrically Erasable Programmable Read-Only Memory) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a CPU (Core Process Unit) 204, a camera 205, an input unit 206, and a display unit 207. , A sound collection unit 208, a sound generation unit 209, a drive 210, a mobile communication unit 212, and a wireless LAN communication unit 213, which are connected by a bus B. A storage medium 211 is connected to the drive 210.

  The EEPROM 201 is used for storing programs executed by the CPU 204 or data. The program is, for example, an OS, middleware, or an application that provides various functions.

  The ROM 202 is used for storing IPL (Initial Program Loader), static data, and the like.

  The RAM 203 reads a program from the EEPROM 201 or the like in response to an activation request from the CPU 204 and stores it in the RAM.

  The CPU 204 executes arithmetic processing according to a program stored in the RAM 203 or the like.

  The camera 205 is used to photograph a subject and generate image data. The camera 205 is composed of, for example, a CMOS (Complementary Metal-Oxide Semiconductor), a CCD (Charge Coupled Device), or the like.

  The input unit 206 receives an operation from the user. The input unit 206 is a touch panel, for example.

  A display unit 207 outputs and displays various data and operation screens. The output unit 207 is, for example, a liquid crystal display.

  The sound collection unit 208 inputs sound. The sound collection unit 208 is, for example, a sound collection microphone. In the information providing system 1 according to the present embodiment, the sound collection unit 208 acquires the sound emitted by the sound producing device 3.

  The sound generator 209 outputs sound. The sound generation unit 209 is, for example, a speaker.

  The drive 210 reads data from the storage medium or writes data to the storage medium 211. As the storage medium 211, various types of storage media such as a semiconductor memory such as a flash memory are used.

  The mobile communication unit 212 performs wireless communication using a mobile phone communication method such as LTE.

  The wireless LAN communication unit 213 performs wireless communication using a communication method compliant with a wireless LAN communication standard such as IEEE 802.11 series.

≪Sound generator≫
FIG. 5 is a diagram illustrating a hardware configuration example of the sounding device 3 in the present embodiment. The sound generation device 3 includes a memory 301, a CPU 302, a network I / F 303, an amplifier 304, a speaker 305, and a drive 306, which are connected by a bus B. A storage medium 307 is connected to the drive 306.

  The memory 301 is used for storing programs and data. The memory 301 stores the identification information of the sound generator 3 acquired from the server via the network I / F.

  The CPU 302 executes arithmetic processing according to a program stored in the memory 301 or the like.

  A network I / F 303 is used to connect to a network and includes a modem, a LAN card, and the like.

  The amplifier 304 is used to amplify the sound stored in the memory 301.

  The speaker 305 is used to output the sound amplified by the amplifier 304.

  The drive 306 is used for reading or writing data from the storage medium 307.

  As the storage medium 307, a CD-ROM (Compact Disk-Read Only Memory), a magneto-optical disk, a semiconductor memory such as a flash memory, and various types of storage media are used.

  Note that the sounding device 3 does not have to have a configuration in which the hardware is integrated into one device, and may have a configuration in which a speaker is connected to the information processing device, for example.

<< Server >>
FIG. 6 is a diagram illustrating an example of a hardware configuration of the server in the present embodiment.

  The server 4 includes an input unit 401, an output unit 402, a drive 403, an interface 405, an auxiliary storage unit 406, a memory 407, and a CPU 408, which are connected by a bus B. A storage medium 404 is connected to the drive 403.

  The input unit 401 is used for inputting various signals, and includes a keyboard, a mouse, and the like.

  The output unit 402 includes a display and is used to display various windows, data, and the like.

  The drive 403 is used for reading or writing data from a storage medium.

  As the storage medium 404, a CD-ROM (Compact Disk Read Only Memory), a magneto-optical disk, a semiconductor memory such as a flash memory, and various types of storage media are used.

  The interface 405 is used to connect to a network, and includes a modem, a LAN card, and the like.

  The auxiliary storage unit 406 is used to store programs, files, data, and the like necessary for execution of processing, and includes a hard disk drive.

  The memory 407 is used for temporarily storing programs and information for executing arithmetic processing, and includes a semiconductor memory or the like.

  The CPU 408 is used for executing various processes in accordance with programs stored in the memory device.

  When the storage medium storing the program is set in the drive 403, the program is installed from the storage medium 404 to the auxiliary storage unit 406 via the drive 403. The program installation is not limited to being performed by reading a storage medium, and may be performed by downloading the program via a network.

  The memory 407 reads the program from the auxiliary storage unit 406 in response to the activation request from the CPU 408 and stores it in the memory 407. The CPU 408 executes various arithmetic processes according to the program stored in the memory 407.

<Functional configuration>
FIG. 7 is a diagram illustrating an example of a functional configuration of each component configuring the information providing system 1 in the present embodiment. Hereinafter, the functional configuration is shown for each component.

≪Information terminal≫
The information terminal 2 includes a sounding device identification information extraction unit 21, an object information transmission request unit 22, an imaging unit 23, an object information accumulation number storage unit 24, a display unit 25, and a communication control unit 26.

  The sound production device identification information extraction unit 21 extracts the identification information of the sound production device 3 from the sound acquired via the sound collection unit 208.

  The object information transmission request unit 22 requests the server 4 to transmit object information. The acquisition request for the object information is made by transmitting the sounding device identification information acquired from the sounding device identification information extracting unit 21 to the server 4. When the object information of a plurality of objects is associated with the identification information of the sounding device 3, the object information transmission request unit 22 is photographed by the photographing unit 23 in addition to the identification information of the sounding device 3. The transmitted image data is transmitted to the server 4. The determination as to whether or not the object information of a plurality of objects is associated with the identification information of the sound producing device 3 is made based on information held in the object information accumulation number storage unit 24 described later.

  The photographing unit 23 photographs an object with the camera 205. The photographing unit 23 stores the photographed image according to a predetermined image format. The image data photographed by the photographing unit 23 is stored in a predetermined storage area such as the EEPROM 201 of the information terminal 2.

  The object information accumulation number storage unit 24 stores information indicating the number of object information of the object associated with each sounding device identification information.

  FIG. 8 is a diagram illustrating an example of a data configuration of information indicating the number of objects associated with identification information of each sounding device in the present embodiment. The number of object information includes information items such as “sounding device identification information” and “number of object information accumulation”.

  “Sound production device identification information” is identification information of the sound production device 3. The sound device identification information is uniquely set for each sound device. As long as the transmission device identification information is unique, it may be a number, a character, a symbol, or a combination thereof. The “number of object information accumulations” is information indicating the number of object information associated with the sounding device identification information. In FIG. 8, it is shown that the information on the four objects is associated with the sounding device identification information “SP000001”.

  In this embodiment, the information terminal 2 includes the object information accumulation number holding unit 24, but the server 4 may include the object information accumulation number holding unit 24.

  The display unit 25 displays the object information received from the server 4.

  FIG. 9 is a diagram illustrating an example of a display screen for object information in the present embodiment. As shown in FIG. 9, an image of the object and various information related to the object are displayed.

  The communication control unit 26 communicates with the server 4 using a predetermined communication protocol.

≪Sound generator≫
The sound generation device 3 includes a sound generation unit 31, a sound generation device identification information management unit 32, and a communication control unit 33.

  The sound generation unit 31 transmits data stored in a storage area included in the sound generation device 3 as a sound. Transmission of sound by the sound generation unit 31 is performed at a higher frequency than an audible region of 15 kHz or higher, for example. By emitting sound at a high frequency, the sound emitted by the sound generator 31 does not touch the user. The sound emitted by the sound generation unit 31 includes at least sound generation device identification information of the own device. When the sound generator 31 transmits sound including other information in addition to the sound generator identification information, the other information may not be emitted at a high frequency.

  The sounding device identification information management unit 32 manages sounding device identification information such as registration, deletion, and update. The sounding device identification information management unit 32 updates the sounding device identification information stored in the memory 301 when the server 4 updates the sounding device identification information or when the sounding device identification information is manually changed. .

  The communication control unit 33 transmits / receives data to / from the server 4 using a predetermined communication protocol.

  The positional relationship between the information terminal 2 and the sounding device 3 is appropriately determined based on the position of the microphone in the information terminal, such as providing the sounding device 3 above or below the position where the user holds the information terminal 2. Adjusted. In this way, the communication accuracy between the information terminal 2 and the sound generator 3 can be maintained. Further, in the case where a guide plate relating to the object and a speaker (sounding device) for broadcasting an audio guide are provided, this speaker can also be used as the sounding device 3 of the present application.

<< Server >>
The server 4 includes an object information management unit 41, an object information storage unit 42, an image collation unit 43, a sounding device identification information management unit 44, a sounding device identification information storage unit 45, and a communication control unit 46.

  The object information management unit 41 manages the object information stored in the object information storage unit 42. When the sound object identification information is received from the information terminal 2, the object information management unit 41 acquires object information associated with the sound generation device identification information from the object information storage unit 42, which will be described later, and sets the communication control unit 46. To the information terminal 2.

  When the object information management unit 41 receives the sounding device identification information and the image data of the photographed object from the information terminal 2, the object information management unit 41 receives the image of the object corresponding to the sounding device identification information, the image data received from the information terminal 2, and Is requested to the image collation unit 43.

  The object information management unit 41 transmits the object information of the corresponding object from the object information corresponding to the sounding device identification information to the information terminal 2 according to the collation result from the image collation unit 43. When it is determined that there is no corresponding object, the object information management unit 41 notifies the information terminal 2 to that effect.

  The object information storage unit 42 holds object information. FIG. 10 is a diagram illustrating an example of the data configuration of the object information stored in the server 4. The object information includes information items such as “sounding device identification information”, “object image”, “name”, and “habitat area”.

  “Sounding device identification information” is identification information of a sounding device associated with object information.

  “Object image” is image data of an object corresponding to the object information. Note that, as the object image, for example, a plurality of image data may be stored for one object such as a front image and a side image of the object.

  “Object information” is information relating to the object, and includes information items such as “name” and “habitation information”.

  The image collation unit 43 collates the image data of the object information corresponding to the sounding device identification information received from the information terminal 2 and the image data received from the information terminal 2. For the image data collation, for example, an arbitrary feature amount is extracted from each image data, and the image collation is performed based on the extracted feature amount. The image collation unit 43 notifies the object information management unit 41 of the closest image data as a collation result. If there is no approximate image, the object information management unit 41 is notified to that effect.

  The sounding device identification information management unit 44 manages sounding device identification information of each sounding device such as registration, deletion, and change of sounding device identification information. When the pronunciation identification information is changed, the pronunciation device identification information management unit 44 transmits the changed pronunciation device identification information to the pronunciation device 3 via the communication control unit 46.

  The sounding device identification information storage unit 45 stores sounding device identification information of each sounding device.

  FIG. 11 is a diagram showing an example of the data configuration of the location information of the sound producing device in the present embodiment. The information stored in the sound device identification information storage unit 45 includes information items such as “sound device identification information”, “aquarium location”, and “aquarium number”, for example.

  “Sound production device identification information” is identification information of the sound production device 3. The “sounding device identification information” can be associated with the location of the aquarium and the tank number.

  “Aquarium Location” is information indicating the location of the aquarium, and the name of the aquarium is indicated as “Aquarium Shin-Yokohama”.

  “Aquarium number” is the identification information of the aquarium set to “Aquarium location”. The “aquarium number” is not necessarily unique among all aquariums, but may be unique among one or more aquariums.

  The communication control unit 46 controls data transmission / reception with the information terminal 2 and the sound generation device 3 using a predetermined communication protocol.

  As described above, in the information providing system 1 according to the present embodiment, the identification information of the sounding device and the object information are associated with each other. The object information is searched based on the sounding device identification information or the sounding device identification information and the image data. As described above, in the information providing system 1, it is possible to perform a search using the identification information of the sound producing device 3 and the image data as necessary.

<Processing operation>
FIG. 12 is a sequence diagram showing a flow until the information terminal 2 in the present embodiment acquires the object information using the sound generator identification information.

  In step S1, the sound producing device 3 emits a sound including the sound producing device identification information.

  In step S2, the information terminal 2 acquires the sound emitted from the sound generator 3 by the sound collecting unit 208, and the information terminal 2 extracts the sound generator identification information from the acquired sound. At this time, if the sounding device identification information cannot be extracted from the acquired sound, the information terminal 2 acquires the sound again.

  In step S3, the information terminal 2 transmits the extracted sounding device identification information to the server 4 and requests the server to transmit object information.

  In step S <b> 4, the server 4 searches the target information storage unit 42 for target information associated with the sounding device identification information received from the information terminal 2 in accordance with the transmission request for the target information received from the information terminal 2. To do.

  In step S <b> 5, the server 4 acquires the corresponding object information from the object information storage unit 42 and transmits it to the information terminal 2.

  In step S6, the information terminal 2 receives the object information transmitted from the server. After reception, the information terminal 2 displays the received object information using a Web browser or the like that the device itself has.

  FIG. 13 is a diagram illustrating an example of a processing procedure in which the information terminal 2 according to the present embodiment acquires target object information.

  In step S10, the information terminal 2 starts the process at the timing when the application capable of acquiring / displaying the object information is activated.

  In step S11, the sound emitted from the sound generator 3 is acquired.

  In step S12, the sound generator identification information of the sound generator 3 is acquired by the sound generator identification information extraction unit 21 from the acquired sound.

  In step S <b> 13, it is determined based on the object information accumulation number information in the object information accumulation number storage unit 24 whether there is a plurality of object information corresponding to the acquired sounding device identification information. At this time, if the determination result is YES, that is, if it is determined that there are a plurality of pieces of object information corresponding to the sounding device identification information, the process proceeds to step S14. If the determination result is NO, that is, if it is determined that there is not a plurality of object information corresponding to the identification information, the process proceeds to step S18.

  In step S <b> 14, a shooting request for an object to be browsed is made to the user.

  In step S <b> 15, the image capturing unit 23 is activated, and the object to be viewed is imaged by the image capturing unit 23.

  In step S16, the sound generator identification information and the image data of the object whose information is to be acquired are transmitted to the server 4.

  In step S17, the sound generator identification information is transmitted to the server 4.

  In step S18, the object information is received from the server 4, and the received object information is displayed by a browser or the like.

  FIG. 14 is a diagram illustrating an example of a processing procedure in which the server according to the present embodiment transmits the object information to the information terminal 2.

  In step S20, processing for transmitting the object information to the information terminal 2 starts.

  In step S <b> 21, a transmission request for object information is received from the information terminal 2.

  In step S <b> 22, the object information management unit 41 determines whether the transmission request received from the information terminal 2 includes image data in addition to the sound generator identification information. If the determination result is YES, that is, if image data is transmitted from the information terminal 2, the process proceeds to step S23. If the determination result is NO, that is, if only the sounding device identification information is transmitted from the information terminal 2, the process proceeds to step S25.

  In step S23, all object information corresponding to the sounding device identification information received from the information terminal 2 is acquired, and the image data included in the acquired object information is collated with the image data received from the information terminal 2 Is requested to the image collation unit 43.

  In step S <b> 24, the image matching unit 43 performs image matching processing between the image data received from the information terminal 2 and the image data acquired based on the sound generator identification information. After the collation process is completed, the collation result is notified to the object information management unit 41.

  In step S25, corresponding target object information is transmitted to the information terminal 2 according to the collation result, and the process ends.

  In step S26, the object information corresponding to the sounding device identification information received from the information terminal 2 is transmitted to the information terminal 2, and the process ends.

  As described above, when a request for acquisition of object information is made, the search range of the object information can be limited by transmitting the sound generator identification information and, if necessary, the image data to the server 4. By performing such processing, it is possible to shorten the time until the corresponding object information is acquired, compared to the processing of searching all images.

<Modification>
A modification of the above-described embodiment will be described. In the modification, the server 4 instead of the information terminal 2 determines whether or not there is a plurality of pieces of object information associated with the sounding device identification information. Note that items different from the embodiment will be described, and the same items are denoted by the same reference numerals, and description thereof will be omitted.

  FIG. 15 is a diagram illustrating an example of a functional configuration of each component of the information providing system 1 in the present modification. As shown in FIG. 15, instead of the information terminal 2, the server 4 has a configuration in which an object information number determination unit 47 is newly provided.

  The object information number determination unit 47 determines whether there are a plurality of object information numbers transmitted from the information terminal 2. Whether or not there is a plurality of pieces of object information is determined based on the number of pieces of object information corresponding to the sounding device identification information stored in the object information storage unit 42.

  When the object information number determination unit 47 determines that there are a plurality of object information numbers, the object information number determination unit 47 requests the information terminal 2 to shoot the object for which the object information is to be browsed.

  FIG. 16 is a sequence diagram showing a flow until the information terminal 2 in the present modification acquires the object information using the sound generator identification information.

  In steps S31 and S32, the information terminal 2 acquires sound from the sounding device 3 and extracts sounding device identification information.

  In step S33, the information terminal 2 transmits the sound generator identification information to the server 4 and makes a transmission request for the object information.

  In step S34, the server 4 determines whether or not there is a plurality of pieces of object information associated with the received sounding device identification information.

  In step S35, when the server 4 determines that there are a plurality of pieces of object information associated with the sounding device identification information, the server 4 requests the information terminal 2 to shoot the object for which the object information is to be browsed.

  In steps S <b> 36 and S <b> 37, the information terminal 2 captures an object for which object information is desired to be browsed and transmits it to the server 4.

  In step S <b> 38, the server 4 executes a collation process between the image data of the object information associated with the sounding device identification information and the image data received from the information terminal 2.

  In step S39, the server 4 transmits the object information of the object that matches the image data to the information terminal 2 from the object information associated with the sounding device identification information as a result of the collation process.

  In step S40, the information terminal 2 displays the received object information.

  All or part of the above-described embodiments can be implemented by a program. This program can be stored in a portable recording medium. A portable recording medium refers to a non-transitory storage medium. Examples of the portable recording medium include a magnetic recording medium, an optical disk, a magneto-optical recording medium, and a nonvolatile memory. All or a part of the embodiments of the present invention can be implemented by reading a program stored in a portable recording medium and executing it by a processor.

<Summary>
The preferred embodiments of the present invention do not limit the scope of the present invention, and various modifications and changes can be made without departing from the broad spirit and scope of the present invention as defined in the claims. It is clear that can be added. In other words, the present invention should not be construed as being limited by the details of the specific examples and the accompanying drawings.

DESCRIPTION OF SYMBOLS 1 Information provision system 2 Information terminal 21 Sounding device identification information extraction part 22 Object information transmission request part 23 Imaging | photography part 24 Object information accumulation number memory | storage part 25 Display part 26 Communication control part 201 EEPROM
202 ROM
203 RAM
204 CPU
205 Camera 206 Input Unit 207 Display Unit 208 Sound Collection Unit 209 Sound Generation Unit 210 Drive 211 Storage Medium 212 Mobile Communication Unit 213 Wireless LAN Communication Unit 3 Sound Generation Device 31 Sound Generation Unit 32 Sound Generation Device Identification Information Management Unit 33 Communication Control Unit 301 Memory 302 CPU
303 Network I / F
304 Amplifier 305 Speaker 4 Server 41 Object Information Management Unit 42 Object Information Storage Unit 43 Image Matching Unit 44 Sounding Device Identification Information Management Unit 45 Sounding Device Identification Information Storage Unit 46 Communication Control Unit 401 Input Unit 402 Output Unit 403 Drive 404 Storage Medium 405 Interface 406 Auxiliary storage unit 407 Memory 408 CPU

JP 2011-60130 A

Claims (8)

Information holding means for associating the identification information of the sounding device with the object information and holding them in a predetermined storage area;
Receiving means for receiving the identification information of the sounding device from a communication device, and acquiring the object information corresponding to the identification information from the information holding means according to the received identification information of the sounding device;
An information processing apparatus comprising: transmission means for transmitting the object information acquired by the acquisition means to the communication apparatus. The information processing apparatus according to claim 1,
If there is a plurality of object information corresponding to the identification information, further comprising request means for requesting the communication device to capture the object for which the object information is to be acquired,
2. The information processing according to claim 1, wherein the acquisition unit acquires corresponding object information from object information corresponding to the identification information based on the identification information received from the communication device and a captured image. apparatus. A communication device that communicates with an information processing device connected via a network,
Sound acquisition means for acquiring sound transmitted from the sound generation device;
Extracting means for extracting identification information of the sounding device from the acquired sound;
Transmitting means for transmitting the extracted identification information to the information processing apparatus;
Receiving means for receiving object information associated with the identification information from the information processing apparatus;
A communication device having display means for displaying received object information. The communication device according to claim 3.
The communication device according to claim 3, wherein the sound acquisition unit acquires a sound having a frequency higher than an audible range, which is emitted from the sound generation device. Sound generating device, communication device that acquires sound transmitted from sound generating device, extracts identification information of sound generating device based on the acquired sound, and information processing device connected to the communication device via a network An information providing system comprising:
The communication device
Sound acquisition means for acquiring sound transmitted from the sound generation device;
Extracting means for extracting identification information of the sounding device from the acquired sound;
Transmitting means for transmitting the extracted identification information to the information processing apparatus;
Receiving means for receiving object information associated with the identification information from the information processing apparatus;
Display means for displaying the received object information,
The information processing apparatus includes:
Information holding means for associating the identification information of the sounding device with the object information and holding them in a predetermined storage area;
Receiving means for receiving the identification information of the sounding device from the communication device, and acquiring the object information corresponding to the identification information from the information holding means according to the received identification information of the sounding device;
An information providing system comprising: transmission means for transmitting the object information acquired by the acquisition means to a communication device. The communication apparatus further includes a photographing unit that photographs the object,
The information processing apparatus further includes an imaging request unit that requests imaging of the object for which the object information is to be acquired from the communication apparatus when there is a plurality of object information corresponding to the identification information.
6. The information provision according to claim 5, wherein the acquisition unit acquires corresponding object information from object information corresponding to the identification information based on the identification information received from the communication device and a captured image. system.   The information providing system according to claim 5, wherein the sound generation device is arranged based on a position of the sound acquisition unit of the communication device.   The information providing system according to claim 7, wherein the sound generation device is disposed below a position of the sound acquisition unit of the communication device.

Images