JP2013005377A - Mobile terminal device and information provision system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mobile terminal device capable of receiving an acoustic ID and appropriately controlling to switch on/off a decode function to decode the acoustic ID into an ID code, in an acoustic communication system for transmitting information using voice.SOLUTION: The mobile terminal device includes: a sound collection unit for collecting the acoustic ID which is identification information composed of a voice signal; and a demodulating unit for demodulating the identification information from the collected acoustic ID; an operation unit operated by a user; and an on/off control unit for switching on the demodulation unit when the operation unit is operated, and for switching off the demodulation unit after the demodulation unit demodulates the identification information.

Description

  The present invention relates to an information providing system that provides information by communication of an ID code using voice, a portable terminal device used in an information providing system, and the like.

  An acoustic communication system that transmits information such as an ID code using voice has been proposed (for example, Patent Document 1). The system is as follows. The transmission device spreads the ID code with a pseudo noise code, shifts the frequency to a sound frequency in a non-audible band, and emits the sound as an acoustic ID. The receiving device is a mobile terminal device such as a smartphone, picks up sound, converts it into a digital signal, extracts the acoustic ID by filtering the digital sound signal, and decodes it to obtain an ID code To do. A smartphone is a multi-function mobile phone having an information terminal function.

  This system is used, for example, to transmit route guidance and sales information in sightseeing spots and shopping malls, and to provide information related to programs being broadcast on television broadcasts. In tourist spots and shopping malls, the user is required to always turn on the decoding function of the mobile terminal device because it is not known where the acoustic ID is transmitted. Further, since it is not known when the sound ID is broadcast even in the television broadcast, the user needs to always turn on the decoding function of the mobile terminal device.

International Publication No. 2010/016589 Pamphlet

  The above-described decoding process, in which sound is collected and converted into a digital signal, the acoustic ID is extracted by filtering the digital sound signal, and the ID is obtained by decoding the sound ID, is for the mobile terminal device. This process consumes a large amount of power. However, since the mobile terminal device is battery-driven, it is necessary to suppress power consumption as much as possible. Therefore, it is not preferable to turn on the decoding function of the mobile terminal device while in a sightseeing spot or a shopping mall or while watching TV.

  The present invention provides a portable terminal device capable of appropriately controlling on / off of a decoding function for receiving an acoustic ID and decoding it into an ID code in an acoustic communication system that transmits information using voice. Objective.

  The information providing system according to the present invention is an information providing system in which a portable terminal device and a sound emitting device are acoustically connected, and the portable terminal device and a content server are connected via an information communication network, the sound emitting device The apparatus emits an acoustic ID, which is identification information converted into an audio signal, and the content server returns a predetermined content to the mobile terminal apparatus in response to an access from the mobile terminal apparatus, and the mobile terminal An apparatus includes: a sound collection unit that collects the sound ID emitted by the sound emission device; a demodulation unit that demodulates the identification information from the collected sound ID; and the content using the demodulated identification information A content acquisition unit for accessing the server and acquiring the content; and an on / off control unit for turning on / off the demodulation unit. The on / off control unit is provided by a user. An operation unit to be operated; when the operation unit is operated, the demodulation unit is turned on; after the demodulation unit demodulates the identification information, the demodulation unit is turned off regardless of whether or not the operation unit is operated It is characterized by doing.

  In addition, an identification information resolution server that receives the identification information from the portable terminal device and returns address information of the content server corresponding to the identification information to the portable terminal device is further provided, and the content acquisition unit includes The identification information may be transmitted to the identification information resolution server to acquire the address information of the content server, and the content server may be accessed using the acquired address information.

  A portal server that receives the identification information from the mobile terminal device and returns address information of the identification information resolution server corresponding to the identification information to the mobile terminal device; and The identification information may be transmitted to the portal server to acquire the address information of the identification information resolution server, and the acquired address information may be used to access the identification information resolution server.

  The demodulator may be turned on when the mobile terminal device is connected to the information communication network, or may be turned off when the mobile terminal device is disconnected from the information communication network.

  In addition, the mobile terminal device further includes a position detection unit that detects the position of the mobile terminal device. It may be turned off.

  The portable terminal device of the present invention is operated by a user, a sound collection unit that collects an acoustic ID that is identification information converted into a voice signal, a demodulation unit that demodulates the identification information from the collected sound ID, and a user. And an on / off control unit that turns on the demodulation unit when the operation unit is operated, and turns off the demodulation unit after the demodulation unit demodulates the identification information. And

  According to the present invention, the demodulation unit that demodulates the acoustic ID into the identification information can be turned on only when necessary, and the demodulation unit can be turned off in other scenes, so that wasteful power consumption can be suppressed. Become.

Configuration diagram of the guidance system of the present invention The figure which shows the contents of contents database Block diagram of guidance device The figure which illustrates the frequency component of the sound emitted from a guidance device Block diagram of a smartphone that is an example of a mobile terminal device Flow chart showing operation of audio signal processing unit of portable terminal device Flow chart showing operation of content server The figure explaining other forms of a guidance system

  A guide system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating the configuration of the guidance system. This guidance system is a system installed in a sightseeing spot, for example, and has a guidance device 1, a portable terminal device 2, and a content server 4. The guide device 1 is provided at each of a plurality of sightseeing spots (points) in a sightseeing spot. The smartphone 2 is possessed by a user 6 who visits this sightseeing spot. The content server 4 is connected to the mobile terminal device 2 via a network 3 such as the Internet. In addition, as the mobile terminal device 2, it is possible to use a smart phone which is a multi-function mobile phone having an information terminal function.

  The guidance device 1 includes a speaker 16 (see FIG. 4), and emits a guide voice explaining the tourist spot from the speaker 16. With this guidance voice, the user 6 who is a tourist can know the details of the tourist spot.

  The acoustic ID 50 is superimposed on the guidance voice, and the guidance device 1 emits a voice obtained by synthesizing the guidance voice and the acoustic ID 50 from the speaker 16. The acoustic ID 50 is composed of an audio signal in a high frequency band of 18 to 20 kHz, and includes information for the mobile terminal device 2 possessed by the user 6 to acquire the predetermined content 52. The mobile terminal device 2 collects and decodes the acoustic ID 50, functions to access the content server 4 using the decoded ID code 51, and route guidance information that is the content 52 corresponding to the ID code 51. Is acquired and displayed on the display unit. The route guidance information is guidance information for moving from the tourist spot where the user 6 is present (the location of the guide device 1) to the next tourist spot, and is displayed on the display unit 25 (see FIG. 5) of the portable terminal device 2. Image and / or sound reproduced by the audio amplifier 27.

  There are a plurality of sightseeing spots in the sightseeing spot, and a guide device 1 is installed in each sightseeing spot. Each guide device 1 emits a guide voice at the point (sightseeing spot) and simultaneously emits an ID code 51 indicating the point as an acoustic ID 50. The content database 40 (see FIG. 2) of the content server 4 stores route guidance information for reaching from the point of the ID code 51 to the next point (tourist spot). When the content server 4 receives the ID code 51 from the mobile terminal device 2, it returns the route guidance information corresponding to the ID code 51.

  In the case of normal route guidance, information indicating the route to the next point may be stored in the content database 40 as route guidance information. In this embodiment, the guidance system includes “treasure hunt” and “orienteering”. In order to have a game characteristic such as “,” the directions to the next point are stored as route guidance information, and the name of the next point (sight spot name) and a hint for determining the point (sight spot) are stored. .

  FIG. 2 is a configuration diagram of the content database 40 provided in the content server 4. The content database 40 stores an ID set for each of a plurality of points (guidance device 1), a name of the point (tourist spot) where the ID is set, a time limit thereof, and a content 52. In FIG. 2, the points A to D are described as the point names, but specifically, the names of the tourist spots. The time zone is a time limit that can effectively pass through this point (orienteering checkpoint). In the example of FIG. 2, the time limit is set so that the point A is started between 11:00 and 12:00, and the points B, C, and D are sequentially set to 13:30, 15:00, and 16:30. Yes. In the route guidance information, which is the content 52, “the route to the point B” is stored at the point A, and if the route is followed according to this guide as in the normal route guidance, the point B is reached. It can be reached. On the other hand, at the point B, “name of the point C” is stored, and an instruction is given to search for a place with the name on a map or the like. In addition, “Hint of point D” is stored at point C, and the point D is determined based on this hint, and an instruction is given to find the place on a map or the like. Since the point D is a goal, the content 52 stores a URL that provides an image indicating the goal. If this image is “treasure”, this orienteering can be used as a treasure hunt game.

  In the case of normal route guidance, the time limit is not necessary, and the route information to the next point may be included in the content 52 at all points. The content 52 may be combined with the route guidance information and image data. In addition, by including the route information to the point A in the content 52 of the last point (point D in FIG. 2), it is possible to go around all the points (tourist spots) regardless of where the points start.

  With reference to FIG. 3, the structure of the guidance apparatus 1 which emits a guide sound is demonstrated. The guidance device 1 includes an ID memory 11, a modulation unit 12, a guide voice reproduction unit 13, a synthesis unit 14, an amplifier 15, and a speaker 16. The ID memory 11 stores an ID code 51 associated with predetermined route guidance information (content 52). The modulation unit 12 is a processing unit that modulates the ID code 51 into a frequency band signal (acoustic ID 50) that can be emitted as a sound wave that is air vibration. The modulation unit 12 phase-modulates the spread code with the ID code 51, shifts the frequency of the phase-modulated spread code to a non-audible band, and emits the sound. This technique is described in detail in an international patent application (WO 2010/016589) by the present applicant. The guide voice reproducing unit 13 reproduces voice, BGM, and the like for announcing the details and highlights of the sightseeing spot where the guide device 1 is installed. The synthesizer 14 adds and synthesizes the acoustic ID 50, which is the ID code 51 subjected to spread modulation, and the guide voice, and outputs the synthesized voice signal to the amplifier 15. The amplifier 15 amplifies the audio signal input from the synthesizing unit 14 to an appropriate power and supplies it to the speaker 16. The speaker 16 emits the sound signal input from the amplifier 15 as sound.

  The acoustic ID 50 is obtained by spreading the ID code 51 with a specific spreading code and shifting the frequency to a frequency band of 18 to 20 kHz. As described above, this technique is described in detail in the international patent application (WO 2010/016589) by the present applicant. The frequency band that can be reproduced by the speaker 16 of the guide device 1 is generally in the range of 100 Hz to 20 kHz. As shown in FIG. 4, the upper limit frequency of the guide voice is about 16 kHz, and the acoustic ID 50 is superimposed on a band of 18 to 20 kHz with respect to this guide voice. Accordingly, the guide voice and the acoustic ID 50 are emitted from the speaker 16 without overlapping the bands. Note that the modulation method of the acoustic ID 50 and the method of superimposing the acoustic ID 50 on the guide voice are not limited to the methods described above.

  FIG. 5 is a functional block diagram showing only a portion related to the present invention of the smartphone 2 which is an example of the mobile terminal device. The smartphone 2 includes a control unit 20, a microphone 21, an A / D converter 22, a network communication unit 23, a map data memory 24, a display unit 25, an operation unit 26, an audio amplifier 27, a GPS positioning unit 28, and a switch 29. .

  The microphone 21 collects the sound emitted from the speaker of the guidance device 1 and converts it into an audio signal that is an electrical signal. The A / D converter 22 converts an analog audio signal input from the microphone 21 into a digital signal. The network communication unit 23 communicates with the content server 4 via the network 3. The map data memory 24 stores map data of a sightseeing spot that is a cover area of the guidance system. The map data memory 24 may be a built-in flash memory or hard disk, or may be a storage medium such as an SD card inserted into the slot. The display unit 25 includes a liquid crystal screen provided on the front surface of the smartphone 2 and displays an image such as a map on the liquid crystal screen. The operation unit 26 is a touch panel formed on the surface of the liquid crystal screen, and detects a position touched by the user 6 and inputs the detected position to the control unit 20. The audio amplifier 27 D / A converts and amplifies the digital audio signal output from the control unit 20 and outputs it. A built-in speaker or an earphone jack is connected to the audio amplifier 27. The GPS positioning unit 28 measures the current position of the smartphone 2 (user 6) using the GPS system.

  The switch 29 is a switch for turning on / off the operation of the audio signal processing unit 200 by the operation of the user 6. The audio signal processing unit 200 includes an acoustic ID processing unit 31 functionally provided in the A / D converter 22 and the control unit 20. Since the A / D converter 22 consumes a large amount of power and the sound ID 50 processing unit 31 consumes a large amount of CPU power, it is turned on when the sound ID 50 is decoded and turned off when the decoding is completed. The audio signal processing unit 200 is turned on / off by the operation of the switch 29 by the user 6 or automatically. In FIG. 5, the switch 29 is provided as hardware separately from the operation unit 26, but may be provided as software using the touch panel of the operation unit 26 and the liquid crystal screen of the display unit 25.

  The control unit 20 includes an acoustic ID processing unit 31, an image reproduction unit 32, an audio reproduction unit 33, and a web browser 34 in cooperation with an application program. The acoustic ID 50 processing unit 31 controls the ID code demodulating unit that demodulates the ID code 51 by passing the audio signal collected by the microphone 21 through the matched filter, and the content acquisition that controls the network communication unit 23 to communicate with the content server 4. It consists of parts. The ID code 51 is demodulated, for example, by passing the acoustic ID 50 through a matching filter in which the spreading code string used for spreading the ID code 51 is set as a filter coefficient. Details of this demodulation processing are described in the above-mentioned pamphlet of International Publication No. 2010/016589. The image reproduction unit 32 reads the map data from the map data memory 24, synthesizes the current position measured by the GPS positioning unit 28, the route guidance information received from the content server 4, and outputs the synthesized information to the display unit 25. The sound reproducing unit 33 reproduces various sounds and outputs them to the audio amplifier 27. When the content 52 acquired from the content server 4 is a URL, the web browser 34 accesses the URL and displays a web page.

  In this embodiment, the switch 29 functions as a switch for turning on the audio signal processing unit 200 as described in the flowchart of FIG. 6. When the audio signal processing unit 200 decodes the acoustic ID 50, power consumption, CPU power Automatically turn off to reduce waste. However, the audio signal processing unit 200 may be manually turned off by operating the switch 29.

  Further, the audio signal processing unit 200 may be automatically turned on by the control unit 20. For example, the control unit 20 turns on the audio signal processing unit 200 when detecting that the control unit 20 has approached the guide device 1 based on the positioning result of the CPU positioning unit 28. Further, the control unit 20 may turn off the audio signal processing unit 200 when it is detected that the user has moved away from the guidance device 1.

  The smartphone 2 is connected to the content server 40 via a network 3 such as the Internet. The control unit 20 may turn on the audio signal processing unit 200 when entering a wireless LAN such as Wi-Fi or when dial-up connected to the Internet through 3G communication. Further, when these network connections are disconnected, the audio signal processing unit 200 may be turned off.

  FIGS. 6A and 6B are flowcharts showing the operation of the control unit 20 of the mobile terminal device 2. FIG. 7 is a flowchart showing the operation of the content server 4.

  FIG. 6A is a flowchart showing the operation detection operation of the switch 29. This operation is repeated every few milliseconds. In step S11 (hereinafter, step Sn is simply referred to as Sn), it is detected whether or not the switch 29 is turned on (whether an on event has occurred). If the switch 29 is not turned on (NO in S11), the operation is terminated. When the switch 29 is turned on (NO in S11), it is determined whether the audio signal processing unit 200 is currently activated (S12). When the audio signal processing unit 200 is activated (YES in S12), the operation is terminated as it is. If the audio signal processing unit 200 is not activated (NO in S12), the audio signal processing unit 200 is activated (S13) and the operation is terminated. If the audio signal processing unit 200 is activated in S12, the audio signal processing unit 200 may be stopped.

  FIG. 6B is a flowchart showing the acoustic ID decoding operation. This operation starts when the audio signal processing unit 200 is activated by the operation of FIG. 6A (or automatically). After the start, the acoustic ID 50 processing unit 31 stands by in S1. When the acoustic ID 50 is detected (YES in S1), it is decoded (S2). Then, the decoded ID code 51 is transmitted to the content server 4 (S3). The content server 4 executes the process of FIG. 7 in response to the received ID code 51 and returns a corresponding message. When receiving this reply, the control unit 20 of the portable terminal device 2 determines the reply content (S4). If the reply content is road guidance information, the road guidance information is displayed on the display unit 25 together with the map data, and if this is accompanied by voice, it is reproduced by the audio amplifier 27 (S5). If the reply content is a URL, the web browser 34 is activated (S7), the received URL is passed to the web browser 34 (S8), and this URL is accessed to display a web page (S10). Also, if the reply content is a message indicating that the ID code 51 is invalid, this indicates that it is an incorrect ID code, or that the arrival at that point is too late and time is up It is displayed on the part 25 (S9). After the process of S5, S8 or S9, the operation of the audio signal processing unit 200 is stopped (S6) and the process is terminated.

  FIG. 7 is a flowchart showing the operation of the content server 4. It waits in S21 until the ID code 51 is received from the portable terminal device 2 which is a terminal device. When the ID code 51 is received (YES in S21), the time at that time is read (S22), and the content database 40 is searched with the combination of this time (reception time) and the received ID code 51 (S23). If the ID code 51 is valid as a result of the search, that is, if the ID code 51 exists in the content database 40 and the reception time is included in the time limit of the ID code 51 (YES in S24), the ID The content 52 corresponding to the code 51 is read and returned to the mobile terminal device 2 (S25). When the ID code 51 is not valid, that is, when the ID code 51 does not exist or when the reception time is out of the time limit (NO in S24), the fact that the ID code 51 is invalid, that is, the ID code 51 Is returned to the portable terminal device 2 (S26).

  In the above embodiment, as shown in FIG. 8A, the URL 53 of the content server 4 is stored in the mobile terminal device 2, and the mobile terminal device 2 collects the acoustic ID 50 and decodes the ID code 51. At this time, the ID code 51 is transmitted to the content server 4 and the content 52 is acquired as a reply. However, the system for acquiring the content 52 from the content server 4 using the acoustic ID 50 can also be realized in a form other than the form shown in FIG. 8A, for example, the form shown in FIGS. 8B and 8C. .

  In the form of FIG. 8B, the URL 54 of the ID resolution server 7 is stored in the mobile terminal device 2. The ID resolution server 7 is a server that receives the ID code 51 from the mobile terminal device 2 and returns the URL 53 of the content server 4 corresponding to the ID code 51 to the mobile terminal device 2. When the mobile terminal device 2 picks up the acoustic ID 50 and decodes the ID code 51, the mobile terminal device 2 transmits the ID code 51 to the ID resolution server 7, and acquires the URL 53 of the corresponding content server 4 as a reply. The mobile terminal device 2 acquires the content 52 by accessing the content server 4 using the URL 53. At this time, the ID code 51 may be transmitted to the content server 4 to acquire the content 52 corresponding thereto.

  In the form of FIG. 8C, the URL 55 of the portal server 8 is stored in the mobile terminal device 2. The portal server 8 is a reception server that manages the content 52 scattered on the network 3 and can be easily acquired by the user 6 in a system (for example, a guidance system) that provides information using the acoustic ID 50. The portal server 8 receives the ID code 51 from the mobile terminal device 2 and returns the URL 54 of the ID resolution server 7 corresponding to the ID code 51 to the mobile terminal device 2. When the mobile terminal device 2 collects the acoustic ID 50 and decodes the ID code 51, the portable terminal device 2 transmits the ID code 51 to the portal server 8 and acquires the URL 54 of the corresponding ID resolution server 7 as a reply. Next, the ID resolution server 7 is accessed using this URL 54, the ID code 51 is transmitted, and the URL 53 of the corresponding content server 4 is acquired as a reply. The mobile terminal device 2 acquires the content 52 by accessing the content server 4 using the URL 53. At this time, the ID code 51 may be transmitted to the content server 4 to acquire the content 52 corresponding thereto.

  8B and 8C, the content server 4 and the ID resolution server 7 may be the same server.

  8B and 8C, a plurality of ID resolution servers 7 may be provided, and the mobile terminal device 2 may sequentially access the plurality of ID resolution servers 7 to reach the content server 4. This form is also included in the technical scope of the present application.

  In addition, in this embodiment, although the smart phone is illustrated as the portable terminal device 2, a portable terminal device is not limited to a smart phone. For example, it may be a PDA (Personal Data Assistance), a tablet terminal, or a general mobile phone. In the above embodiment, the guidance system has been described as an example. However, the mobile terminal device 2 of the present invention can be applied to any system as long as it collects and decodes the acoustic ID 50. Is possible.

  In this embodiment, the control unit 20 performs decoding of the acoustic ID 50 by software. However, hardware such as an LSI for decoding the acoustic ID 50 may be provided separately. The present invention is realized by turning on / off.

1 Guide device 2 Mobile terminal device (smart phone)
3 Network 4 Content Server 6 User 7 ID Resolution Server 8 Portal Server 16 Speaker 29 Switch 40 Content Database 50 Acoustic ID
51 ID code (identification information)
52 Content 200 Audio signal processor

Claims (8)

An information providing system in which a portable terminal device and a sound emitting device are acoustically connected, and the portable terminal device and a content server are connected via an information communication network,
The sound emitting device emits a sound ID which is identification information converted into a sound signal,
The content server returns a predetermined content to the mobile terminal device in response to access from the mobile terminal device,
The portable terminal device uses a sound collecting unit that collects the sound ID emitted by the sound emitting device, a demodulation unit that demodulates the identification information from the collected sound ID, and the demodulated identification information. A content acquisition unit for accessing the content server and acquiring the content, and an on / off control unit for turning on / off the demodulation unit,
The on / off control unit includes an operation unit operated by a user. When the operation unit is operated, the demodulating unit is turned on, and the demodulating unit demodulates the identification information and then turns off the demodulating unit. Information providing system. An identification information resolution server connected to the mobile terminal device via an information network;
The identification information resolution server receives the identification information from the mobile terminal device, and returns address information of the content server corresponding to the identification information to the mobile terminal device,
The information provision according to claim 1, wherein the content acquisition unit acquires the address information of the content server by transmitting the identification information to the identification information resolution server, and accesses the content server using the acquired address information. system. A portal server connected to the portable terminal device via an information network;
The portal server receives the identification information from the portable terminal device, and returns the identification information resolution server address information corresponding to the identification information to the portable terminal device,
The said content acquisition part transmits the said identification information to the said portal server, acquires the address information of the said identification information resolution server, and accesses the said identification information resolution server using the acquired address information. Information provision system.   4. The information providing system according to claim 1, wherein the on / off control unit turns on the demodulation unit when the mobile terminal device is connected to the information communication network. 5.   The information providing system according to claim 4, wherein the on / off control unit turns off the demodulation unit when the mobile terminal device is disconnected from the information communication network. The mobile terminal device further includes a position detection unit that detects its own position,
4. The information providing system according to claim 1, wherein the on / off control unit turns on the demodulation unit when approaching within a predetermined distance from the sound emitting device. 5.   The information providing system according to claim 6, wherein the on / off control unit turns off the demodulating unit when the distance from the sound emitting device exceeds a predetermined distance. A sound collection unit that collects an acoustic ID that is identification information converted into an audio signal;
A demodulator that demodulates the identification information from the collected sound ID;
An operation unit operated by a user;
An on / off control unit that turns on the demodulation unit when the operation unit is operated, and turns off the demodulation unit after the demodulation unit demodulates the identification information;
A mobile terminal device.

Images