JP6891942B2 - Output device, output method, and output system - Google Patents

Description

The present invention relates to an output device , an output method, and an output system .

With the application of various information processing technologies, in recent years, it has been used as an information terminal that outputs a sound wave containing identification information using an inaudible sound wave having a frequency higher than a predetermined frequency and acquires the identification information contained in the output sound wave. , A new attempt using sound waves such as providing information on the place where the identification information is acquired has been born (see, for example, Patent Document 1).

In the provision of information by sound wave communication using such an inaudible sound region, predetermined identification information is notified to an information terminal using sound waves having a frequency of 18 kHz to 20 kHz. On the other hand, this frequency band is often the same as the frequency band of sound waves used in a mouse repellent device or the like. In addition, since the mouse repellent device and the like output sound waves with a strong sound pressure (100 dB or more) from the viewpoint of preventing the invasion of mice, such a device operates in the vicinity of an information providing system using sound waves. In that case, it may have a great influence on the information provision by sound wave communication.

The present invention has been made in view of the above problems, and in an information providing system that provides information using sound waves that are difficult for the user to recognize, even if there is an interfering sound wave in the inaudible sound region. The purpose is to be able to provide information to the terminal.

To solve the above problems, an output device according to the present invention is an output device that outputs a sound wave, a sound wave collecting unit for collecting sound waves near the output device, depending on the sound wave the wave collecting unit collects, A first sound wave containing the first identification information in an inaudible sound region having a frequency higher than a predetermined frequency, or a second sound wave containing a second identification information in an audible sound region having a frequency lower than the predetermined frequency. It has an output unit that outputs sound waves .

According to the present invention, in an information providing system that provides information using sound waves that are difficult for the user to recognize, information can be provided to the terminal even if there is an interfering sound wave in the inaudible sound region. become.

It is a figure which shows the configuration example of the information provision system which concerns on one Embodiment. It is a figure which shows an example of the plurality of regions which concerns on one Embodiment. It is a figure which shows the example of the method of embedding the identification information in the audible sound which concerns on one Embodiment. It is a figure which shows the example of the appearance of the output device which concerns on one Embodiment. It is a figure which shows the example of the hardware composition of the output device which concerns on one Embodiment. It is a figure which shows the hardware configuration example of the management server which concerns on one Embodiment. It is a figure which shows the hardware configuration example of the gateway which concerns on one Embodiment. It is a figure which shows the hardware configuration example of the information terminal which concerns on one Embodiment. It is a functional block diagram of the output device which concerns on 1st Embodiment. It is a functional block diagram of the information provision system which concerns on 1st Embodiment. It is a figure which shows the example of the information managed by the management server which concerns on 1st Embodiment. It is a sequence diagram (1) which shows an example of the output control processing which concerns on 1st Embodiment. It is a sequence diagram (2) which shows an example of the output control processing which concerns on 1st Embodiment. It is a sequence diagram which shows another example of the output control processing which concerns on 1st Embodiment. It is a sequence diagram which shows the example of the information provision processing which concerns on 1st Embodiment. It is a sequence diagram which shows the example of the output control processing which concerns on 2nd Embodiment. It is a functional block diagram of the output device which concerns on the 3rd implementation mobile phone. It is a sequence diagram which shows an example of the output control processing which concerns on 3rd Embodiment. It is a sequence diagram which shows another example of the output control processing which concerns on 3rd Embodiment. It is a figure which shows an example of the use scene of the information provision system which concerns on one Embodiment. It is a figure which shows another example of the use scene of the information provision system which concerns on one Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

<System configuration>
FIG. 1 is a diagram showing a configuration example of an information providing system according to an embodiment. The information providing system 100 includes a plurality of output devices 101-1, 101-2, 101-3, ..., A management server 102, a gateway 103, an information terminal 104, and the like. In the following description, when any output device is shown among the plurality of output devices 101-1, 101-2, 101-3, ..., "Output device 101" is used. The number of output devices 101, gateway 103, information terminal 104, etc. shown in FIG. 1 is an example.

The plurality of output devices 101 are installed at different positions such as the ceiling of the building 107, and a plurality of signals including unique information of the own device (for example, identification information of the own device, position information, etc.) are transmitted to different regions. Output to. Further, the plurality of output devices 101 form a predetermined wireless network with the gateway 103, and can communicate with the management server 102 via the gateway 103.

In the example of FIG. 1, the output device 101-1 has three speakers, and the first speaker receives a sound wave including the first speaker ID “SP0001N” which is the identification information of the first speaker. It is outputting to the area of 1. Further, the second speaker outputs a sound wave including the second speaker ID "SP0001S", which is the identification information of the second speaker, to a second region different from the first region. Further, the third speaker transmits a sound wave including the third speaker ID "SP0001K", which is the identification information of the third speaker, to, for example, a third region including the first region and the second region. Can be output.

Preferably, the first speaker and the second speaker are in an inaudible region (eg, a frequency of 16 kHz to 20 kHz) having a frequency higher than a predetermined frequency, a sound wave containing the first speaker ID, and a second speaker. Sound waves including the speaker ID are output respectively. The higher the frequency, the higher the directivity of the sound wave, and the frequency above 16 kHz is almost inaudible to humans. Therefore, the sound wave in the inaudible region is suitable for transmitting information such as identification information toward a predetermined range. is there.

Further, the third speaker is a sound wave (for example, a guidance voice, a chime, a waterfall) in which a third speaker ID is embedded in an audible sound region (for example, a frequency range of 100 Hz or more and less than 16 kHz) below a predetermined frequency. Sounds, chimes of birds, etc.) can be output.

Preferably, the sound wave in which the third speaker ID is embedded has the third speaker ID embedded in a digital watermark in a guidance voice audible to the human ear or an audible sound such as an environmental sound. In this case, the sound wave in which the third speaker ID is embedded can be heard by the user 105 of the information terminal 104 as a normal guidance voice, an environmental sound, or the like. On the other hand, the information terminal 104 can analyze the sound wave in which the third speaker ID collected by the microphone or the like is embedded and extract the third speaker ID.

FIG. 2 is a diagram showing an example of a plurality of regions according to one embodiment. FIG. 2 shows a state in which the building 107 shown in FIG. 1 is viewed from above. In FIG. 2, the first speaker of the output device 101-1 outputs a sound wave (inaudible sound) including the first speaker ID “SP0001” to the first region 202. Further, the second speaker outputs a sound wave (non-audible sound) including the second speaker ID "SP0001S" to the second region 203. Further, the third speaker of the output device 101-1 has a third speaker ID "SP0001K" in the audible sound region with respect to the third region 201 including the first region 202 and the second region 203. Embedded sound waves (audible sound) can be output.

Further, as shown in FIG. 2, the other output devices 101-2 and 101-3 have a sound wave including the first speaker ID and a sound wave including the second speaker ID in the same manner as the output device 101-1. Is being output. Further, the other output devices 101-2 and 101-3 can output a sound wave in which a third speaker ID is embedded in the same manner as the output device 101-1 as shown in FIG.

Returning to FIG. 1, the description of the system configuration of the information providing system 100 will be continued.

The management server (information processing device) 102 includes, for example, an information processing device such as a PC (Personal Computer) connected to a network 106 such as the Internet or a LAN (Local Area Network), or a plurality of information processing devices. It is a system.

The management server 102 can communicate with a plurality of output devices 101 via the network 106 and the gateway 103, and manages information on the location where the plurality of output devices 101 are installed, a speaker ID, and the like. When the management server 102 receives the request information including the speaker ID output by the output device 101, the management server 102 receives information about the location where the output device 101 is installed (for example, coordinate information, area information, and an image) at the request source of the request information. Information etc.) will be provided. Further, the management server 102 performs output control of sound waves including the first to third speaker IDs output by each output device 101 (for example, control of presence / absence of output, setting of output speaker IDs, etc.).

The gateway 103 is connected to the management server 102 via the network 106, and forms a wireless network together with the plurality of output devices 101. The gateway 103 transfers (relays) data between the plurality of output devices 101 connected to the wireless network provided by the gateway 103 and the management server 102.

The information terminal 104 is an information terminal owned by the user 105, for example, a smartphone, a mobile phone, a tablet terminal, etc., and can be connected to the network 106 and communicate with the management server 102 by wireless communication. Further, the information terminal 104 executes an application program (hereinafter, referred to as an application) for the information terminal 104 corresponding to the information providing system 100.

By executing the application for the information terminal 104, the information terminal 104 acquires the sound wave output by the output device 101 using the built-in microphone or the like, and extracts the speaker ID included in the acquired sound wave.

Further, the application for the information terminal 104 has unique identification information (hereinafter referred to as an application ID) for each application installed on the information terminal 104. When the information terminal 104 executes the application and extracts the speaker ID of the output device 101, the information terminal 104 transmits the request information including the extracted speaker ID of the output device 101 and its own application ID to the management server 102.

The application ID is an example of identification information of a requester that identifies the information terminal 104, the user of the information terminal 104, or the application operating on the information terminal 104. By using the application ID, the information providing system 100 can identify the information terminal 104 or the application without using personal information such as a telephone number or an email address, for example. However, this is only an example, and the information terminal 104 may use the identification information of the information terminal, the identification information of the user, or the like instead of the application ID.

In the above configuration, the management server 102 manages and controls information regarding the location where the plurality of output devices 101 are installed, the speaker ID output by each output device 101, and the like.

For example, the management server 102 causes the output device 101 to output inaudible sound waves (sound waves including the first speaker ID and sound waves including the second speaker ID), and the sound waves in the inaudible sound region around the output device 101. To judge the state of. As a result, when it is determined that the state of the sound wave in the non-audible sound region is bad, that is, when it is determined that it is necessary to output the audible sound (the sound wave in which the third speaker ID is embedded), the output device 101 can be used. Output the listening sound. As a result, for example, even when a mouse intrusion prevention device or the like is activated near the output device 101, the speaker ID can be notified to the information terminal 104 by using the audible sound.

Preferably, the management server 102 stops the output of the audible sound when the mouse intrusion prevention device or the like operating near the output device 101 is stopped.

The sound wave in which the third speaker ID is embedded according to the present embodiment is an audible sound, but since the third speaker ID is embedded in the voice guidance, the environmental sound, etc. by a digital watermark, the user. Has the characteristic of being difficult to recognize.

(About digital watermarking)
The method of transmitting the identification information in the voice band includes a method of transmitting the identification information in a non-audible sound region close to ultrasonic waves (for example, a frequency region higher than 16 kHz) and a method of transmitting the identification information in an audible sound region (for example, a frequency region of 20 Hz to 16 kHz). ), There is a method of embedding identification information (for example, a digital watermark).

The digital watermark used in the present embodiment embeds identification information in the audible sound region of voice information such as guidance voices such as in-house broadcasts and environmental sounds. For example, a technique called steganography or the like is used. Use. As a method of embedding the identification information in the audible sound region of the voice information, for example, there are spread spectrum, echo, modulation method and the like, and the identification information is embedded in a certain frequency range.

A plurality of fixed frequency ranges can be provided in the audible sound region. For example, in the audible sound region of a general person of about 20 Hz to 16 kHz, the sound spreads easily in a general speaker, which is 100 Hz to 12 kHz. , Multiple encoded frequency bands can be created.

The digital watermark according to the present embodiment embeds the identification information by giving a slight change to the voice information itself to the extent that a person cannot identify it, and is simply a technique for transmitting the identification information in the inaudible sound region. Is different.

FIG. 3 is a diagram showing an example of a method of embedding identification information in an audible sound according to an embodiment. FIG. 3A shows an example of a frequency band in which identification information is embedded. A general speaker (for example, a third speaker) has a “voice frequency band” between “extremely low frequency” and “ultrasonic wave” as shown in “speaker reproduction range” in FIG. 3 (a). Can output sound waves.

Of this voice frequency band, the frequency region higher than 12 kHz has high linearity of sound waves, and is therefore unsuitable for reaching a wide range of sound waves using a general speaker (for example, a third speaker). ..

Further, in the voice frequency band, a low frequency region (for example, a frequency region of less than 100 Hz) is affected by, for example, vibration when the user 105 operates the information terminal 104, sound when the user 105 puts it in and out of a pocket, a bag, or the like. Easy to receive.

Therefore, it is desirable that the digital watermark embedded in the voice information is embedded in the frequency region of the voice frequency band of the voice information, for example, between 100 Hz and 12 kHz. However, as shown in FIG. 3A, the frequency range of about 100 Hz to 1 kHz is easily affected by the speaking voice and the like, so consideration is required.

Therefore, for example, as shown in FIG. 3A, it is desirable to divide the frequency region of 100 Hz to 12 kHz of the voice information into a plurality of frequency bands and distribute the identification information in at least two or more frequency bands to embed the identification information. .. In the example of FIG. 3A, an example is shown in which the frequency region of 100 Hz to 12 kHz is divided into four frequency bands f1 to f4, and identification information is embedded in each of the divided frequency bands. As a result, for example, even if the information in the frequency band "f2" is drowned out due to the influence of a loud voice or the like, the information terminal 104 can acquire the identification information included in another frequency band (for example, f4). Will be able to.

FIG. 3B shows an example of the timing of embedding the identification information. In FIG. 3B, the audible sound is assumed to be, for example, a voice guidance in the hall, a chime sound of a school or a workplace, or an environmental sound such as a waterfall sound or a bird chirping. Further, it is assumed that the time for embedding one identification information in the digital watermark is, for example, about 1 second. In this case, a plurality of identification information can be embedded in the audible sound, for example, as shown in FIG. 3 (b).

In the example of FIG. 3B, the audible sound has identification information embedded in the audible sound from time t1, for example, at predetermined time intervals, and identification information is embedded in the audible sound from time t2, for example, at predetermined time intervals. There is. As a result, for example, even if a part of the period of the audible sound or a part of the frequency band is lost due to the influence of noise, the information terminal 104 can extract the identification information from the remaining audible sound. ..

It is desirable that the identification information embedded in different frequency bands is embedded at different positions (at different timings) in time. For example, in the example of FIG. 3B, the time t2 at which the transmission of the identification information is started in the frequency band f2 is after the transmission of the identification information started at the time t1 in the frequency band f4 is completed. As a result, it is possible to prevent the information terminal 104 from processing a plurality of frequency bands at the same time, and reduce the load of voice processing of the information terminal 104.

The method of embedding the identification information shown in FIG. 3 is an example. It is desirable that the third speaker ID is embedded in the sound wave in which the third speaker ID according to the present embodiment is embedded, twice or more, with different start times or frequency bands.

With the above configuration, according to the present embodiment, in an information providing system that provides information using sound waves that are difficult for the user to recognize, information is sent to the terminal even if there is an interfering sound wave in the inaudible sound region. Will be able to provide.

The system configurations shown in FIGS. 1 to 3 are examples, and the information providing system 100 can have various system configurations.

For example, in the above description, the output device 101 has been described as outputting three sound waves, but the number of sound waves output by the output device 101 may be another number. For example, the number of sound waves output by the output device 101 in the inaudible sound region may be one or three or more.

Further, the first to third speaker IDs output by the output device 101 are examples of identification information for identifying the output device 101. The first to third speaker IDs may have different identification information from each other, or may include the same identification information.

Further, in the above description, the non-audible sound and the audible sound are output by different speakers, but when the number of non-audible sounds is one, the non-audible sound and the audible sound are output by one speaker. It may be something to output.

<Hardware configuration>
(Appearance of output device)
FIG. 4 is a diagram showing an example of the appearance of the output device according to the embodiment.

FIG. 4A is a perspective view of the output device 101. In the output device 101, two speaker bases 402a and 402b are attached to the base main body 401. Further, curved speakers 403a and 403b corresponding to the curved surfaces of the speaker bases 402a and 402b are attached to the two speaker bases 402a and 402b, respectively.

The speaker 403a corresponds to the first speaker described with reference to FIGS. 1 to 3, and may be referred to as a “first speaker” in the following description.

The speaker 403b corresponds to the second speaker described with reference to FIGS. 1 to 3, and may be referred to as a “second speaker” in the following description.

In the present embodiment, the sound wave including the first speaker ID and the sound wave including the second speaker ID are output by using the above-mentioned inaudible sound. As the frequency of the sound wave increases, the straightness of the sound wave increases. Therefore, in the output device 101 according to the present embodiment, the output range of the sound wave is adjusted (for example, enlarged) by forming the speakers 403a and 403b into a curved surface. There is. The curved speakers 403a and 403b are suitable examples, and the speakers 403a and 403b may have any shape.

FIG. 4B is a top view of the output device 101. A sound collecting hole 404 for a microphone and a speaker 405 are provided on the upper surface of the base main body 401 of the output device 101. The positions of the sound collecting hole 404 for the microphone and the speaker 405 shown in FIG. 4 are examples.

The speaker 405 corresponds to the third speaker described in FIGS. 1 to 3, and may be referred to as a "third speaker" in the following description. As the speaker 405, for example, a general speaker used for in-house broadcasting, television, and the like can be applied.

FIG. 4C is a side view of the output device 101. The speaker base 402a is attached to the base main body 401 by, for example, two opposing screws 406a. Further, the speaker base 402a can be moved in the direction of arrow 407 or arrow 408 about the two screws 406a by loosening the two screws 406a, and the mounting angle with respect to the base main body 401 can be changed. .. As a result, the output device 101 can change the direction in which the speaker 403a outputs sound waves with respect to the base main body 401, and for example, can adjust the range of the first region 202 in FIG.

Similarly, the speaker base 402b is attached to the base body 401 by, for example, two opposing screws 406b. Further, by loosening the two screws 406b, the speaker base 402b can change the mounting angle with respect to the base main body 401 with the two screws 406a as axes, similarly to the speaker base 402a. As a result, the output device 101 can change the direction in which the speaker 403b outputs sound waves with respect to the base main body 401, and for example, can adjust the range of the second region 203 in FIG.

(Hardware configuration of output device)
FIG. 5 is a diagram showing an example of the hardware configuration of the output device according to the embodiment. The output device 101 includes, for example, a CPU (Central Processing Unit) 501, a RAM (Random Access Memory) 502, a flash ROM (Read Only Memory) 503, a wireless communication unit 504, a sound processing unit 505, a microphone unit 506, and an amplification unit A507-. 1. It has an amplification unit B507-2, a speaker A508-1, a speaker B508-2, an amplification unit C509, a speaker C510, and the like.

The CPU 501 is an arithmetic unit that realizes each function of the output device 101 by executing a program for the output device 101 stored in the flash ROM 503 or the like. The RAM 502 is a volatile memory used as a work area or the like of the CPU 501. The flash ROM 503 is a non-volatile memory that stores various information such as a program for the output device 101, an output device ID which is identification information of the output device 101, and a speaker ID.

The wireless communication unit 504 is a wireless communication device for performing wireless communication with the gateway 103, and includes, for example, a transmission / reception circuit, an antenna, a control circuit, and the like. In the present embodiment, the wireless communication unit 504 uses a wireless unit of various wireless communication methods such as a wireless LAN, Zigbee (registered trademark), or a specific power saving radio (IEEE802.15.4g) in the 920 MHz band. be able to.

The sound wave processing unit 505 performs various sound wave processing such as a process of generating a sound wave including a speaker ID and an analysis of the sound wave acquired by the microphone unit 506 according to the control of the CPU 501. For example, the sound wave processing unit 505 generates sound waves including the speaker ID in a non-audible sound region of, for example, 16 kHz or more in the voice frequency band according to the control of the CPU 501.

In the present embodiment, the specific sound wave data transfer method is not particularly limited, but for example, known modulation such as FSK (Frequency Shift Keying) or PSK (Phase Shift Keying) is performed on a sound wave having a predetermined frequency. Information can be transmitted by multiplying.

Alternatively, the data transfer method using sound waves may represent a digital value of "1" / "0" by turning on / off a sound wave having a predetermined frequency (for example, 19 kHz). In this case, the information terminal 104 that has received the sound wave can acquire the information included in the sound wave by, for example, determining the presence or absence of a predetermined frequency at a predetermined sampling rate.

The sound wave processing unit 505 may be realized by an integrated circuit or the like for voice processing, or may be realized by a DSP (Digital Signal Processor) or the like. Alternatively, the sound wave processing unit 505 may be realized by a program that operates on the CPU 501.

The microphone unit 506 includes a sound collecting element such as a microphone. The microphone unit 506 converts sound waves acquired by a microphone or the like into an electric signal.

The amplification unit A507-1 is a sound wave amplifier that amplifies the sound wave signal output to the speaker A508-1. The amplification unit B507-2 is a sound wave amplifier that amplifies the sound wave signal output to the speaker B508-2. The number of amplification units A507-1 and amplification unit B507-2 is an example, and may be one or more other numbers.

The speaker A508-1 is a speaker that converts a sound wave signal output from the amplification unit A507-1 into a sound wave and outputs the sound wave. The speaker A508-1 corresponds to the first speaker described in FIGS. 1 to 3 and the speaker 403a in FIG. 4, and may be referred to as a “first speaker” in the following description.

The speaker B508-2 is a speaker that converts a sound wave signal output from the amplification unit B507-2 into a sound wave and outputs the sound wave. The speaker B508-2 corresponds to the second speaker described in FIGS. 1 to 3 and the speaker 403b in FIG. 4, and may be referred to as a “second speaker” in the following description.

The amplification unit C509 is a sound wave amplifier that amplifies the sound wave signal output to the speaker C510. The speaker C510 is a speaker that converts a sound wave signal output from the amplification unit C509 into a sound wave and outputs the sound wave. The speaker C510 corresponds to the third speaker described in FIGS. 1 to 3 and the speaker 405 of FIG. 4, and may be referred to as a "third speaker" in the following description.

(Hardware configuration of management server)
FIG. 6 is a diagram showing a hardware configuration example of the management server according to the embodiment. The management server 102 has a general computer configuration, for example, CPU601, RAM602, ROM603, storage unit 604, external I / F (Interface) unit 605, input unit 606, display unit 607, network I /. It has an F section 608, a bus 609, and the like.

The CPU 601 is an arithmetic unit that realizes each function of the management server 102 by reading a program or data stored in a ROM 603, a storage unit 604, or the like on the RAM 602 and executing processing. The RAM 602 is a volatile memory used as a work area or the like of the CPU 601. The ROM 603 is a non-volatile memory that can hold programs and data even when the power is turned off.

The storage unit 604 is, for example, a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores an OS (Operation System), an application program, various data, and the like.

The external I / F 605 is an interface with an external device. The external device includes, for example, a recording medium 610 and the like. The management server 102 can read and / or write to the recording medium 610 via the external I / F 605. The recording medium 610 includes, for example, an optical disk, a magnetic disk, a memory card, a USB (Universal Serial Bus) memory, and the like. Further, the management server 102 executes the predetermined program by storing the predetermined program in the recording medium 610 and installing the program stored in the recording medium 610 on the management server 102 via the external I / F 605. be able to.

The input unit 606 is an input device used for inputting each operation signal to the management server 102 such as a pointing device such as a mouse and a keyboard. The display unit 607 is a display device such as a display that displays a processing result or the like by the management server 102.

The network I / F unit 608 is a communication interface such as a wired / wireless LAN for connecting the management server 102 to the network 106. The management server 102 can perform data communication with other devices via the network 106 via the network I / F unit 608. The bus 609 is connected to each of the above components and transmits an address signal, a data signal, various control signals, and the like.

(Gateway hardware configuration example)
FIG. 7 is a diagram showing a hardware configuration example of the gateway according to the embodiment. The gateway 103 includes, for example, a CPU 701, a RAM 702, a ROM 703, a wireless communication unit 704, a network I / F unit 705, and a bus 706.

The CPU 701 is an arithmetic unit that realizes each function of the gateway 103 by executing a program stored in the ROM 703 or the like. The RAM 702 is a volatile memory used as a work area or the like of the CPU 701. The ROM 703 is a non-volatile memory that stores programs and the like of the gateway 103. The ROM 703 may be, for example, a rewritable non-volatile memory such as a flash ROM or an EEPROM.

The wireless communication unit 704 is, for example, a wireless communication device for performing wireless communication by the same wireless communication method as the wireless communication unit 504 of the output device 101 described above, and includes, for example, a transmission / reception circuit, an antenna, a control circuit, and the like.

The network I / F unit 705 is a communication interface such as a wireless / wired LAN that connects the gateway 103 to the network 106. The bus 706 is connected to each of the above components and transmits an address signal, a data signal, various control signals, and the like.

(Hardware configuration of information terminal)
FIG. 8 is a diagram showing a hardware configuration example of the information terminal according to the embodiment. The information terminal 104 has a general computer configuration, for example, CPU801, RAM802, ROM803, storage unit 804, communication I / F unit 805, microphone unit 806, speaker unit 807, display input unit 808, and It has a bus 809 and the like.

The CPU 801 is an arithmetic unit that realizes each function of the information terminal 104 by reading a program or data stored in a ROM 803, a storage unit 804, or the like on the RAM 802 and executing processing. The RAM 802 is a volatile memory used as a work area or the like of the CPU 801. The ROM 803 is a non-volatile memory that can hold programs and data even when the power is turned off.

The storage unit 804 is, for example, a storage device such as an HDD, SSD, or flash ROM, and stores an OS, an application program, various data, and the like.

The communication I / F unit 805 is a communication interface compatible with mobile communication networks such as 3G (3rd. Generation) and LTE (Long Term Evolution), and communication methods such as wireless LAN. The information terminal 104 connects to the network 106 via the communication I / F unit 805 and performs data communication with the management server 102 and the like.

The microphone unit 806 includes a sound collecting element such as a microphone. The microphone unit 806 converts the sound wave acquired by a microphone or the like into a sound wave signal. Microphones provided in recent smartphones and the like can collect sound waves of up to 20 kHz, more preferably about 24 kHz. Therefore, the microphone unit 806 can preferably acquire inaudible sound having a high frequency of, for example, 16 kHz or more, which is included in the sound wave output from the output device 101.

The speaker unit 807 includes a sound wave output element such as a speaker. The speaker unit 807 converts the sound wave signal into sound waves by a speaker or the like and outputs the sound waves.

The display input unit 808 includes, for example, a display element such as an LCD (Liquid Crystal Display) and an input element such as a touch panel, receives an input operation by a user, and displays by a program executed by the information terminal 104. Display the screen. The bus 809 is connected to each of the above components and transmits an address signal, a data signal, various control signals, and the like.

[First Embodiment]
<Functional configuration>
(Functional configuration of output device)
FIG. 9 is a functional configuration diagram of the output device according to the first embodiment. Each of the plurality of output devices 101-1 to 101-3 shown in FIG. 9 includes a communication unit 901, a sound wave generation unit 902, a non-audible sound output unit 903, an audible sound output unit 904, a storage unit 905, and a sound wave collection unit 906. It has a sound wave analysis unit 907 and the like.

The communication unit 901 connects to the wireless PAN (Personal Area Network) provided by the gateway 103, and communicates with the management server 102 via the gateway 103. The communication unit 901 is realized by, for example, a program that operates on the wireless communication unit 504 of FIG. 5 and the CPU 501 of FIG.

In the example of FIG. 9, a configuration example is shown when the wireless PAN provided by the gateway 103 uses a specific power saving radio (IEEE802.15.4g) in the 920 MHz band. Although this wireless system has a low transmission speed of about 200 Kbps, it can transmit data up to about several hundred meters with a current consumption of about several tens of mA. With this wireless system, data can be transmitted and received in a single hop with low power consumption, whereas wireless communication to the gateway is performed by multi-hop such as Zigbee. If you want to expand the wireless PAN area, you can add a gateway 103.

In the example of FIG. 9, the communication unit 901 of each output device 101 can communicate with the management server 102 via the gateway 103. For example, when the management server 102 simultaneously transmits information to a plurality of output devices 101, the transmitted information is transmitted to each output device 101 via the gateway 103. Further, when the output device 101 transmits information to the management server 102, each output device 101 can transmit the information to the management server 102 via the gateway 103.

The configuration of the wireless PAN provided by the gateway 103 shown in FIG. 9 is an example. The wireless PAN provided by the gateway 103 may perform wireless communication to the gateway by multi-hop such as Zigbee.

The sound wave generation unit 902 is a means for generating sound waves output by the non-audible sound output unit 903, the audible sound output unit 904, and the like. For example, a program that operates in the sound wave processing unit 505 of FIG. 5 and the CPU 501 of FIG. It is realized by such as.

The sound wave generation unit 902 includes, for example, a sound wave (non-audible sound) including a first speaker ID output by the first speaker of the output device 101 shown in FIG. 1, or a second speaker ID output by the second speaker. Generates sound waves (inaudible sounds) including.

Further, the sound wave generation unit 902 may generate a sound wave (audible sound) in which a third speaker ID output by the third speaker of the output device 101 shown in FIG. 1 is embedded. However, since it takes time for the third speaker ID to generate a sound wave embedded with a digital watermark, as another example, the output device 101 is embedded with a plurality of pre-generated third speaker IDs. The sound wave may be stored in the storage unit 905.

The inaudible sound output unit 903 outputs a sound wave including the first identification information of the output device 101 in an inaudible sound region having a frequency higher than a predetermined frequency (for example, 16 kHz). The non-audible sound output unit 903 is, for example, a program that operates on the sound wave processing unit 505 in FIG. 5, the amplification unit A507-1, the amplification unit B507-2, the speaker A508-1, the speaker B508-2, and the CPU 501 in FIG. Realized by.

For example, when the non-audible sound output unit 903 receives the non-audible sound output request from the management server 102, the non-audible sound output unit 903 includes the first speaker ID included in the output request (sound wave including the first identification information). Is output from the first speaker (speaker A508-1). Further, the non-audible sound output unit 903 outputs the non-audible sound including the second speaker ID included in the output request from the second speaker (speaker B508-2). The non-audible sound output unit 903 may output non-audible sound including a larger number of speaker IDs according to the number of speakers included in the output device 101.

As another example, the non-audible sound output unit 903 includes the non-audible sound including the first speaker ID stored in the storage unit 905 and the second speaker ID regardless of the output request from the management server 102. It may output an inaudible sound.

For example, the non-audible sound output unit 903 starts outputting the non-audible sound including the first speaker ID and the non-audible sound including the second speaker ID when the output device 101 is activated. You may.

Alternatively, when the sound wave collecting unit 906 and the sound wave analysis unit 907 detect a predetermined sound, the non-audible sound output unit 903 includes the non-audible sound including the first speaker ID and the second speaker ID. It may start the output of the inaudible sound including. In this case, by outputting a predetermined sound from the information terminal 104, it becomes possible to output an inaudible sound when the information terminal 104 is near the output device 101.

The sound wave collecting unit 906 is a means for collecting sound waves around the output device 101, and is realized by, for example, a program running on the microphone unit 506 of FIG. 5 and the CPU 501 of FIG. The sound wave collecting unit 906 may collect sound waves around the output device 101 by using, for example, an external microphone or the like instead of the microphone unit 506 of FIG.

The sound wave analysis unit 907 is a means for analyzing the state of the sound wave in the non-audible sound region around the output device 101 by using the sound wave collected by the sound wave collection unit 906. Realized by.

For example, the sound wave analysis unit 907 analyzes the state of the sound wave in the inaudible sound wave region around the output device 101 in response to the acquisition request of the sound wave information received from the management server 102, and the analyzed sound wave information is obtained from the management server 102. Notify to.

As an example, the sound wave analysis unit 907 analyzes the noise level in the inaudible sound region around the output device 101 by using the sound waves collected by the sound wave collection unit 906. For example, the sound wave analysis unit 907 analyzes the sound pressure level of the sound wave in the non-audible sound region by FFT (Fast Fourier Transform) during the period when the non-audible sound output unit 903 does not output the non-audible sound, and the analyzed sound. Let the pressure level be the noise level.

In this case, for example, when the noise level in the analyzed inaudible region is higher than the predetermined noise level, the sound wave condition in the inaudible region around the output device 101 is poor, that is, the audible sound is output. It can be determined that it is necessary to make it.

Further, as another example, the sound wave analysis unit 907 includes the first identification information (for example, the first speaker) included in the non-audible sound output by the non-audible sound output unit 903 from the sound wave collected by the sound wave collection unit 906. The ID or the second speaker ID) is extracted.

In this case, for example, the sound wave analysis unit 907 outputs an audible sound when the first identification information included in the non-audible sound output by the non-audible sound output unit 903 cannot be extracted from the sound waves collected by the sound wave collection unit 906. It can be determined that it is necessary to make it.

The audible sound output unit 904 outputs a sound wave in which the second information is embedded in the audible sound region according to the analysis result (hereinafter referred to as sound wave information) of the state of the sound wave analyzed by the sound wave analysis unit 907. The audible sound output unit 904 is realized by, for example, a program that operates on the amplification unit C509 of FIG. 5, the speaker C510, and the CPU 501 of FIG.

The audible sound output unit 904 may have a third speaker ID embedded in the audible sound region, for example, when it is determined that the sound wave condition in the non-audible sound region is poor, that is, it is necessary to output the audible sound. Hearing sound (sound wave in which the second identification information is embedded) is output from the third speaker.

In the first embodiment, the means (sound wave state determination unit 1004) for determining the state of the sound wave in the inaudible sound region around the output device 101 based on the sound wave information analyzed by the sound wave analysis unit 907 is managed. An example of the case where the server 102 is included will be described.

In this case, the audible sound output unit 904 receives, for example, the audible sound in which the third speaker ID is embedded in the audible sound region in response to the output request of the audible sound including the third speaker ID received from the management server 102. Is output from the third speaker (speaker C510).

The output device 101 may have a means for determining the state of the sound wave in the non-audible sound region, as will be described later in the third embodiment.

The storage unit 905 has, for example, an output device ID for identifying the output device 101, first to third speaker IDs, and an audible sound in which a third speaker ID is embedded in an audible sound region output by the audible sound output unit 904. It is a means for storing various information such as the data of the speaker. The storage unit 905 is realized by, for example, a program running on the flash ROM 503 of FIG. 5 and the CPU 501 of FIG.

(Functional configuration of information provision system)
FIG. 10 is a functional configuration diagram of the information providing system according to the first embodiment. The configuration diagram of the information providing system 100 of FIG. 10 shows the minimum configuration of the output device 101, the management server 102, the gateway 103, and the information terminal 104.

(Functional configuration of management server)
The management server (information processing device) 102 includes a communication unit 1001, a non-audible sound output control unit 1002, a sound wave information acquisition unit 1003, a sound wave state determination unit 1004, an audible sound output control unit 1005, an output device management unit 1006, and location information provision. It has a unit 1007, a storage unit 1008, and the like.

The communication unit 1001 connects the management server 102 to the network 106, communicates with a plurality of output devices 101 via the gateway 103, and communicates with the information terminal 104 and the like. The communication unit 1001 is realized by, for example, a program that operates on the network I / F unit 608 of FIG. 6 and the CPU 601 of FIG.

The non-audible sound output control unit (first output control unit) 1002 transmits a sound wave containing the first identification information of the output device 101 to the output device 101, and the non-audible sound having a frequency higher than a predetermined frequency (for example, 16 kHz). Output in the area. The non-audible sound output control unit 1002 is realized by, for example, a program that operates on the CPU 601 of FIG.

For example, the non-audible sound output control unit 1002 transmits an output request for non-audible sound including the first speaker ID and the second speaker ID to the output device 101, and the output device 101 includes the first speaker ID. The inaudible sound (sound wave including the first identification information) and the inaudible sound including the second speaker ID are output.

The sound wave information acquisition unit 1003 is a means for acquiring sound wave information (sound wave information) for determining the state of sound waves in the inaudible sound region around the output device 101 from the output device 101. For example, FIG. It is realized by a program that runs on the CPU 601.

The sound wave information acquisition unit 1003 transmits, for example, a sound wave information acquisition request to the output device 101, and receives the sound wave information transmitted from the output device 101. The sound wave information acquisition unit 1003 may receive sound wave information transmitted from the output device 101 at the discretion of the output device 101.

The sound wave state determination unit 1004 is a means for determining the state of the sound wave in the non-audible sound region around the output device 101 based on the sound wave information acquired by the sound wave information acquisition unit 1003. It is realized by the program to do.

As an example, it is assumed that the sound wave information acquired by the sound wave information acquisition unit 1003 includes information on the noise level in the inaudible sound region around the output device 101. In this case, when the noise level in the non-audible sound region around the output device 101 is higher than the predetermined noise level, the sound wave state determination unit 1004 determines that the sound wave condition in the non-audible sound region is poor and causes the output device 101 to perform the sound wave condition. It can be determined that it is necessary to output an audible sound. As a result, the sound wave state determination unit 1004 can determine that it is necessary for the output device 101 to output an audible sound when, for example, a mouse intrusion prevention device or the like is operating near the output device 101. ..

As another example, the sound wave information acquired by the sound wave information acquisition unit 1003 is information indicating whether or not the output device 101 can acquire the speaker ID included in the inaudible sound output by the output device 101. It may contain. In this case, when the output device 101 cannot acquire the speaker ID included in the non-audible sound, the sound wave state determination unit 1004 outputs the audible sound to the output device 101 because the sound wave state in the non-audible sound region is poor. It can be determined that it is necessary to make it.

Preferably, the sound wave state determination unit 1004 determines the presence / absence of non-audible sound and audible sound output by the output device 101 based on the control information 1013 stored in the storage unit 1008. FIG. 11C shows an example of control information 1013.

In the example of FIG. 11C, the control information 1013 stores the "peripheral noise level" and the "control content" in association with each other.

The “peripheral noise level” is a noise level in the inaudible sound region around the output device 101 acquired by the sound wave information acquisition unit 1003 from the output device 101. In the example of FIG. 11C, the ambient noise level is shown in 10 levels of noise level, and the larger the value, the higher the noise level. The ambient noise level may be expressed using an actual measured value or the like.

The “control content” is information indicating whether or not the corresponding output device 101 is to output the inaudible sound and whether or not to output the audible sound according to the value of the ambient noise level. In the example of FIG. 11C, it is shown that when the peripheral noise level is 1 to 5, the output device 101 outputs the inaudible sound and does not output the audible sound. Further, in the example of FIG. 11C, it is shown that when the peripheral noise level is 6 or more, the output device 101 outputs an audible sound.

Preferably, as shown in FIG. 11 (c), when the peripheral noise level is particularly high (for example, the peripheral noise level is 9 or 10, etc.), the output device 101 stops the output of the inaudible sound. In this case, since it is unlikely that the information terminal 104 can acquire the inaudible sound output by the output device 101, wasteful power consumption can be reduced by stopping the output of the inaudible sound.

Returning to FIG. 10, the description of the functional configuration of the management server 102 will be continued.

The audible sound output control unit (second output control unit) 1005 identifies the audible sound region as a second according to the result of the sound wave condition determination unit 1004 determining the sound wave condition in the non-audible region around the output device. The sound wave in which the information is embedded is output to the output device 101. The audible sound output control unit 1005 is realized by, for example, a program that operates on the CPU 601 of FIG.

The audible sound output control unit 1005 transmits, for example, an audible sound output request including the third speaker ID to the output device 101, so that the audible sound (possible) in which the third speaker ID is embedded in the output device 101. A sound wave in which the second identification information is embedded in the listening area) is output.

The output device management unit 1006 stores the output device information 1011 including the information about the location where the plurality of output devices 101 are installed and the first information and the second information of each of the plurality of output devices 101 in the storage unit 1008. Remember and manage. The output device management unit 1006 is realized by, for example, a program that operates on the CPU 601 of FIG.

An example of the output device information 1011 managed by the output device management unit 1006 is shown in FIG. 11 (a). The output device information 1011 shown in FIG. 11A includes information such as “output device ID”, “speaker ID”, “direction”, “position coordinates”, and “area information”.

The “output device ID” is identification information for identifying the output device 101.

The "speaker ID" includes a first speaker ID included in the inaudible sound output from the first speaker by the output device 101, a second speaker ID included in the inaudible sound output from the second speaker, and the like. This is information on the third speaker ID embedded in the audible sound output by the third speaker. The first speaker ID is identification information for identifying the first speaker, and is an example of the first identification information of the output device 101. Further, the second speaker ID is identification information for identifying the second speaker. Further, the third speaker ID is identification information for identifying the third speaker, and is an example of the second identification information of the output device 101.

The "direction" is information indicating the direction (direction) in which the first speaker and the second speaker output sound waves, and is registered when, for example, the output device 101 is installed. The "direction" information is not essential.

The "position coordinates" are coordinate information of the place where each output device 101 is installed. The information of the "direction" and the "position coordinate" is, for example, information determined and registered by the person in charge of installation who installed the output device 101 when the output device 101 was installed. For example, in the "position coordinate", the position coordinate of the installation location determined in advance is measured by the device, and the measured value is registered. The person in charge of installing the output device 101 installs the output device 101 at a grounding location corresponding to the position coordinates so that, for example, the first speaker faces north.

The "area information" is, for example, information indicating that a place where a plurality of output devices 101 are installed is divided into a plurality of areas and the divided areas are indicated. When the management server 102 causes the output device 101 to output the audible sound, for example, the management server 102 can output the audible sound to a plurality of output devices 101 included in the same area.

The output device information 1011 shown in FIG. 11A is an example. The output device information 1011 may include, for example, various information (for example, a character string, an image, etc.) regarding the place where the output device 101 is installed.

Returning to FIG. 10, the description of the functional configuration of the management server 102 will be continued.

When the position information providing unit 1007 receives the request information including the speaker ID and the application ID acquired by the information terminal 104 from the information terminal 104 that has acquired the speaker ID from the output device 101, the position information providing unit 1007 is the place where the output device 101 is installed. Information about the information is provided to the information terminal 104. The position information providing unit 1007 is realized by, for example, a program running on the CPU 601 of FIG.

When the position information providing unit 1007 receives the request information from the information terminal 104, the position information providing unit 1007 updates the position information 1012 stored in the storage unit 1008 based on the speaker ID included in the received request information.

FIG. 11B shows an example of the position information 1012 of. When the information terminal 104 according to the present embodiment acquires the speaker ID included in the sound wave output from the output device 101, the information terminal 104 transmits the acquired speaker ID and the request information including the application ID of the information terminal 104 to the management server 102. ..

The location information providing unit 1007 of the management server 102 stores and manages the information received from the information terminal 104 in the location information 1012 as shown in FIG. 11B, for example. The position information 1012 shown in FIG. 11B includes information such as "information terminal identification information", "speaker ID", "output device ID", "acquisition date and time", and "position coordinates".

The "information terminal identification information" is identification information (for example, an application ID) that identifies the information terminal 104.

The "speaker ID" is a speaker ID (for example, a first speaker ID, a second speaker ID, or a third speaker ID) included in the sound wave acquired by the information terminal 104.

The “output device ID” is an output device ID of the output device 101 specified by the speaker ID and the output device information 1011 shown in FIG. 11 (a).

The "acquisition date and time" is information indicating the date and time when the information terminal 104 acquired the above-mentioned transmission source information, or the date and time when the management server 102 received the request information from the information terminal.

The "position coordinates" are information (position of the information terminal 104) indicating the location of the output device 101 that outputs the speaker ID, which is specified based on the "speaker ID" and the output device information 1011 shown in FIG. 11 (a). Information indicating).

The position information providing unit 1007 provides, for example, the position coordinates of the information terminal 104 (an example of information regarding the location where the output device 101 is installed) to the requesting information terminal 104 that has transmitted the request information. The information regarding the location where the output device 101 provided by the location information providing unit 1007 is installed is, for example, shop information, weather information, and transportation operation information corresponding to the location where the output device 101 is installed. Etc., various information may be used.

The storage unit 1008 is a means for storing various information including the above-mentioned output device information 1011 and position information 1012, control information 1013, and the like. For example, the storage unit 604 in FIG. 6, the RAM 602, and the CPU 601 in FIG. 6 It is realized by a running program.

(Functional configuration of information terminal)
The information terminal 104 includes a sound wave acquisition unit 1021, an information extraction unit 1022, an identification information transmission unit 1023, a communication unit 1024, a display control unit 1025, an operation reception unit 1026, a storage unit 1027, and the like.

The information terminal 104 realizes each of the above components by, for example, executing a program (for example, the route guidance application 1031) corresponding to the information providing system 100 stored in the storage unit 1027.

The sound wave acquisition unit 1021 is a means for acquiring sound waves (non-audible sound and audible sound) output from the output device 101 by using, for example, the microphone unit 806 of FIG. 8, and operates by, for example, the CPU 801 of FIG. Realized by the program.

The information extraction unit 1022 extracts the speaker ID included in the sound wave acquired by the sound wave acquisition unit 1021. The information extraction unit 1022 is realized by, for example, a program running on the CPU 801 of FIG.

The identification information transmission unit 1023 transmits request information including the speaker ID of the output device 101 extracted by the information extraction unit 1022 and the application ID of the information terminal 104 to the management server 102 via the communication unit 1024. The identification information transmission unit 1023 is realized by, for example, a program running on the CPU 801 of FIG.

The communication unit 1024 is a means for connecting the information terminal 104 to the network 106 to communicate with the management server 102 and the like, and operates by, for example, the communication I / F unit 805 of FIG. 8 and the CPU 801 of FIG. It is realized by a program or the like.

The display control unit 1025 is, for example, a means for displaying the route guidance screen or the like by the route guidance application 1031 on the display input unit 808 or the like in FIG. 8, and is realized by, for example, a program operated by the CPU 801 in FIG.

The operation reception unit 1026 is, for example, a means for receiving an operation of the user 105 (for example, setting a destination) for the route guidance application 1031, and is operated by, for example, the display input unit 808 of FIG. 8 and the CPU 801 of FIG. It is realized by the program etc.

The storage unit 1027 is a means for storing various information including, for example, the route guidance application 1031 described above, the map information 1032 used by the route guidance application 1031, and the like. The storage unit 1027 is realized by, for example, a program running on the storage unit 804 and RAM 802 of FIG. 8 and the CPU 801 of FIG.

<Processing flow>
Subsequently, an example of a sound wave output control method using the output device 101 will be described.

(Example of output control processing)
12 and 13 are sequence diagrams showing an example of the output control process according to the first embodiment. Here, an example of a process in which the management server 102 controls the output of sound waves (non-audible sound and audible sound) by the output device 101 will be described.

In step S1201, the non-audible sound output control unit 1002 of the management server 102 transmits a non-audible sound output request to the output device 101. The output request for the inaudible sound includes, for example, an output device ID for identifying the output device 101, a first speaker ID, a second speaker ID, and the like. As a result, the management server 102 can make each of the output devices 101 included in the information providing system 100 output an arbitrary speaker ID. The number of non-audible sounds requested by the non-audible sound output control unit 1002 to be output is preferably determined according to, for example, the number of non-audible sounds that can be output by the output device 101.

In step S1202, the non-audible sound output unit 903 of the output device 101 that has received the non-audible sound output request from the management server 102 has the first speaker ID and the second speaker ID included in the non-audible sound output request. Starts the output of non-audible sound including.

For example, the non-audible sound output unit 903 outputs the non-audible sound (sound wave including the first identification information) including the first speaker ID from the first speaker (speaker A508-1), and outputs the second speaker (speaker A508-1). The inaudible sound including the second speaker ID is output from the speaker B508-2).

Preferably, the non-audible sound output unit 903 intermittently outputs the non-audible sound, for example, at predetermined time intervals (for example, 1 second intervals). As a result, the sound wave analysis unit 907 can measure the noise level of the inaudible sound in the vicinity of the output device 101 by utilizing the period during which the inaudible sound is not output, and is required for the output of the inaudible sound. Power can be reduced.

In step S1203, when the sound wave information acquisition unit 1003 of the management server 102 satisfies a predetermined condition such as when a predetermined time has come or when a predetermined time (for example, 30 seconds or the like) has elapsed. , Step S1204 is executed. Here, when the sound wave information acquisition unit 1003 detects that the predetermined time has come, it is assumed that the process of step S1204 is executed.

In step S1204, the sound wave information acquisition unit 1003 of the management server 102 transmits a sound wave information acquisition request to the output device 101.

In step S1205, the sound wave collecting unit of the output device 101 that has received the sound wave information acquisition request collects the sound waves around the output device 101, and the sound wave analysis unit 907 acquires the sound waves collected by the sound wave collecting unit 906.

In step S1206, the sound wave analysis unit 907 of the output device 101 analyzes (measures) the noise level in the inaudible sound region around the output device 101 using the acquired sound wave. For example, the sound wave analysis unit 907 analyzes the sound wave level in the non-audible sound region (for example, 16 kHz to 20 kHz) during the period when the non-audible sound output unit 903 does not output the non-audible sound.

In step S1207, the sound wave analysis unit 907 of the output device 101 transmits sound wave information including the noise level analyzed in step S1206 to the management server 102. The noise level notification format included in the sound wave information may be any format, but here, the notification is performed in 10 levels of noise levels as shown in the control information 1013 of FIG. 11 (c).

In step S1208, the sound wave information acquisition unit 1003 of the management server 102 that has received the sound wave information from the output device 101 notifies the sound wave state determination unit 1004 of the noise level (here, level “9”) included in the received sound wave information. To do.

In step S1209, the sound wave state determination unit 1004 determines the state of the sound wave in the inaudible sound region around the output device 101 by using, for example, the control information 1013 shown in FIG. 11 (c). For example, in the example of FIG. 11C, when the noise level is 1 to 5, the sound wave state determination unit 1004 needs to output the audible sound to the output device 101 because the sound wave state in the non-audible sound region is good. Judge that there is no. On the other hand, when the noise level is 6 or more, the sound wave state determination unit 1004 determines that the output device 101 needs to output the audible sound because the sound wave condition in the non-audible sound region is poor.

Preferably, when the noise level is 9 or more, the sound wave state determination unit 1004 determines that the output device 101 outputs the audible sound and does not output the inaudible sound because the sound wave condition in the non-audible sound region is particularly poor. To do.

The above judgment and control are merely examples. For example, when the sound wave state determination unit 1004 determines that the sound wave condition in the non-audible sound region is poor, the management server 102 determines that the output device 101 needs to output the audible sound, and stops the output of the non-audible sound. It may be the one that is judged to be allowed.

In step S1210, in the example of FIG. 12, since the noise level is "9", the sound wave state determination unit 1004 determines that it is necessary to output the audible sound to the output device 101, and causes the audible sound output control unit 1005 to output the audible sound. Output instruction of.

In step S1211, the audible sound output control unit 1005 of the management server 102 transmits an audible sound output request to the output device 101. The audible sound output request includes, for example, an output device ID for identifying the output device 101, a third speaker ID, and the like.

In step S1212, the audible sound output unit 904 of the output device 101 that has received the audible sound output request from the management server 102 has, for example, a third speaker ID embedded in the audible sound region stored in advance in the storage unit 905. Read the sound wave data. Alternatively, the audible sound output unit 904 creates sound wave data in which the third speaker ID is embedded in the audible sound region.

In step S1213, the audible sound output unit 904 starts outputting a sound wave (sound wave in which the second identification information is embedded) in which the third speaker ID is embedded in the audible sound region. For example, the audible sound output unit 904 outputs an audible sound in which a third speaker ID is embedded in a digital watermark in the audible sound region from the third speaker.

In step S1214, the sound wave state determination unit 1004 issues an inaudible sound stop instruction to the inaudible sound output control unit 1002 in parallel with (or before and after) the output instruction in step S1210.

In step S1215, the non-audible sound output control unit 1002 transmits a non-audible sound stop request to the output device 101.

In step S1216, the non-audible sound output unit 903 of the output device 101 that has received the non-audible sound stop request from the management server 102 stops the output of the non-audible sound that started output in step S1202.

By the above processing, the output device 101 outputs the inaudible sound including the first speaker ID and the inaudible sound including the second speaker ID, and when the state of the sound wave in the surrounding audible sound region deteriorates, The audible sound in which the third speaker ID is embedded in the audible sound region is output.

Subsequently, with reference to FIG. 13, processing when the state of the sound wave in the audible sound region around the output device 101 is improved will be described.

Step S1301 of FIG. 13 shows a state in which the audible sound that started output in step S1213 of FIG. 12 is output.

In step S1302, for example, when the sound wave information acquisition unit 1003 of the management server 102 detects that the predetermined time has come, the process of step S1303 is executed.

In step S1303, the sound wave information acquisition unit 1003 of the management server 102 transmits a sound wave information acquisition request to the output device 101.

In step S1304, the sound wave analysis unit 907 of the output device 101 that has received the sound wave information acquisition request acquires the sound waves collected by the sound wave collection unit 906.

In step S1305, the sound wave analysis unit 907 of the output device 101 analyzes (measures) the noise level in the inaudible sound region around the output device 101 using the acquired sound wave.

In step S1306, the sound wave analysis unit 907 of the output device 101 transmits sound wave information including the noise level analyzed in step S1305 to the management server 102. Here, it is assumed that the analyzed noise level is "3".

In step S1307, the sound wave information acquisition unit 1003 of the management server 102 that has received the sound wave information from the output device 101 notifies the sound wave state determination unit 1004 of the noise level included in the received sound wave information.

In step S1308, the sound wave state determination unit 1004 of the management server 102 determines the sound wave state in the non-audible sound region around the output device 101 by using the control information 1013 shown in FIG. 11 (c). Here, since the noise level is "3", it is determined that it is not necessary for the output device 101 to output an audible sound.

In step S1309, the sound wave state determination unit 1004 of the management server 102 issues an inaudible sound output instruction to the inaudible sound output control unit 1002 based on the control information 1013 shown in FIG. 11C.

In step S1310, the non-audible sound output control unit 1002 of the management server 102 transmits a non-audible sound output request to the output device.

In step S1311, the non-audible sound output unit 903 of the output device 101 that has received the non-audible sound output request from the management server 102 has the first speaker ID and the second speaker ID included in the non-audible sound output request. Starts the output of non-audible sound including.

In step S1312, the sound wave state determination unit 1004 of the management server 102 issues an audible sound stop instruction to the audible sound output control unit 1005 based on the control information 1013 shown in FIG. 11C.

In step S1313, the audible sound output control unit 1005 of the management server 102 transmits a stop request for the audible sound to the output device 101.

In step S1314, the audible sound output unit 904 of the output device 101 that has received the audible sound stop request from the management server 102 stops the audible sound output.

When the state of the sound wave in the surrounding audible sound region is improved by the above processing, the output device 101 starts outputting the inaudible sound including the first speaker ID and the inaudible sound including the second speaker ID. Then, the output of the audible sound in which the third speaker ID is embedded in the audible sound region is stopped.

(Another example)
FIG. 14 is a sequence diagram showing another example of the output control process according to the first embodiment. Since the processes of steps S1201 and S1202 in FIG. 14 are the same as the output control processes shown in FIG. 12, the differences will be mainly described here.

In step S1401, for example, when the sound wave information acquisition unit 1003 of the management server 102 detects that a predetermined time (for example, 30 seconds) has elapsed since the last time the sound wave information was acquired, the processing after step S1402 is executed. To do. In addition, this process may execute the process after step S1402 when a predetermined time comes, like the process described above in step S1203 of FIG.

In step S1402, the sound wave information acquisition unit 1003 of the management server 102 transmits a sound wave information acquisition request to the output device 101.

In step S1403, the sound wave analysis unit 907 of the output device 101 that has received the sound wave information acquisition request acquires the sound waves collected by the sound wave collection unit 906.

In step S1404, the sound wave analysis unit 907 of the output device 101 extracts the speaker ID (first speaker ID and second speaker ID) included in the inaudible sound output in step S1202 from the acquired sound wave.

In step S1405, the sound wave analysis unit 907 of the output device 101 transmits the sound wave information including the extraction result of the speaker ID analyzed in step S1404 to the management server 102. Here, the process when the speaker ID cannot be acquired from the acquired sound wave in step S1404 will be described. In this case, the sound wave information transmitted by the sound wave analysis unit 907 includes information indicating that the extraction of the speaker ID has failed.

In step S1406, the sound wave information acquisition unit 1003 of the management server 102 that received the sound wave information from the output device 101 extracts the extraction result of the speaker ID included in the received sound wave information (here, “extraction failure”) into the sound wave state determination unit. Notify 1004.

In step S1407, the sound wave state determination unit 1004 determines the state of the sound wave in the inaudible sound region around the output device 101 according to the extraction result of the speaker ID.

For example, the sound wave state determination unit 1004 determines that it is necessary for the output device 101 to output an audible sound when the extraction result of the speaker ID is “extraction failure”. In this case, the management server 102 causes the output device 101 to output an audible sound, for example.

On the other hand, when the extraction result of the speaker ID is "successful extraction", the sound wave state determination unit 1004 determines that the state of the sound wave in the inaudible sound region around the output device 101 is good. In this case, the management server 102 does not cause the output device 101 to output an audible sound.

In step S1408, in the example of FIG. 14, since the extraction result of the speaker ID is "extraction failure", the sound wave state determination unit 1004 determines that it is necessary to output the audible sound to the output device 101, and the audible sound output control unit. An audible sound output instruction is given to 1005.

In step S1409, the audible sound output control unit 1005 of the management server 102 transmits an audible sound output request to the output device 101. The audible sound output request includes, for example, an output device ID for identifying the output device 101, a third speaker ID, and the like.

In step S1410, the audible sound output unit 904 of the output device 101 that has received the audible sound output request from the management server 102 has, for example, a third speaker ID embedded in the audible sound region stored in advance in the storage unit 905. Read the sound wave data. Alternatively, the audible sound output unit 904 creates sound wave data in which the third speaker ID is embedded in the audible sound region.

In step S1411, the audible sound output unit 904 starts outputting the audible sound in which the third speaker ID is embedded in the audible sound region with a digital watermark.

In this way, the information providing system 100 determines the state of the sound wave in the inaudible sound region around the output device 101 depending on whether or not the speaker ID can be acquired from the sound wave acquired from the periphery of the output device 101. It may be.

(Example of information provision processing)
FIG. 15 is a sequence diagram showing an example of the information providing process according to the first embodiment.

In step S1501, the user 105 of the information terminal 104 activates the application corresponding to the information providing system 100 pre-installed in the information terminal 104. As a result, the sound wave acquisition unit 1021 of the information terminal 104 starts acquiring the surrounding sound waves, and the information extraction unit 1022 starts extracting the speaker ID from the acquired sound waves.

In step S1502, it is assumed that the output device 101 outputs an inaudible sound including the first speaker ID and an inaudible sound including the second speaker ID. However, here, it is assumed that the non-audible sound output from the output device 101 cannot be acquired by the information terminal 104 due to, for example, an interfering sound wave in the non-audible sound region by a mouse intrusion prevention device or the like.

In step S1503, for example, the output control process shown in FIG. 12 (for example, steps S1204 to S1213) is executed, and in step S1504, the output device 101 embeds the third speaker ID in the audible sound region. Output starts.

In step S1505, the sound wave acquisition unit 1021 of the information terminal 104 acquires the sound wave (audible sound) output from the output device 101, and extracts the third speaker ID embedded in the acquired audible sound.

In step S1506, the identification information transmission unit 1023 of the information terminal 104 requests the acquisition of position information (an example of request information) including the third speaker ID extracted in step S1505 and the application ID of the information terminal 104 as a management server. Send to 102.

In step S1507, when the location information providing unit 1007 of the management server 102 receives the location information acquisition request from the information terminal 104, the location information providing unit 1007 uses the acquired application ID and speaker ID to, for example, the position shown in FIG. 11B. Information 1012 is updated.

In step S1508, the position information providing unit 1007 of the management server 102 transmits the position information (for example, position coordinates) of the information terminal 104 to the information terminal 104 based on the position information 1012 updated in step S1507. The position coordinates are an example of information about the place where the output device 101 is installed.

In step S1509, the display control unit 1025 of the information terminal 104 causes the display input unit 808 to display a display screen showing the position information of the information terminal 104 by using the position information of the information terminal 104 received from the management server 102.

As described above, according to the present embodiment, in the information providing system that provides information using sound waves that are difficult for the user to recognize, information is provided to the terminal even if there is an interfering sound wave in the inaudible sound region. You will be able to.

[Second Embodiment]
In the second embodiment, an output control method when the management server 102 controls a plurality of output devices 101 will be described.

The system configuration of the information providing system 100 according to the present embodiment is the same as the system configuration shown in FIG. Further, the functional configuration of the information providing system 100 is the same as the functional configuration of the first embodiment shown in FIGS. 9 and 10.

<Processing flow>
FIG. 16 is a sequence diagram showing an example of the output control process according to the second embodiment. Since the basic processing is the same as the output control processing of the first embodiment shown in FIG. 12, for example, detailed description of the common processing will be omitted here.

In step S1601, the non-audible sound output control unit 1002 of the management server 102 transmits a non-audible sound output request to the output device 101-1. The output request for the inaudible sound includes, for example, the output device ID "ID0001" of the output device 101-1, the first speaker ID "SP0001N", the second speaker ID "SP0001S", and the like.

In step S1602, the non-audible sound output unit 903 of the output device 101-1 that received the non-audible sound output request from the management server 102 has the first speaker ID included in the non-audible sound output request and the second speaker ID. The output of the inaudible sound including the speaker ID is started. Here, as shown in FIG. 1, the output device 101-1 and the information terminal 104 are separated from each other, and the inaudible sound output by the output device 101-1 does not reach the information terminal 104. It shall be.

In step S1603, the non-audible sound output control unit 1002 of the management server 102 transmits a non-audible sound output request to the output device 101-2. The inaudible sound output request includes, for example, the output device ID "ID0002" of the output device 101-2, the first speaker ID "SP0002N", the second speaker ID "SP0002S", and the like.

In step S1604, the non-audible sound output unit 903 of the output device 101-2 that received the non-audible sound output request from the management server 102 has the first speaker ID included in the non-audible sound output request and the second speaker ID. The output of the inaudible sound including the speaker ID is started. It is assumed that the output device 101-2 and the information terminal 104 are separated from each other, and the inaudible sound output by the output device 101-2 does not reach the information terminal 104.

In step S1605, the non-audible sound output control unit 1002 of the management server 102 transmits a non-audible sound output request to the output device 101-3. The inaudible sound output request includes, for example, the output device ID "ID0003" of the output device 101-3, the first speaker ID "SP0003N", the second speaker ID "SP0003S", and the like.

In step S1606, the non-audible sound output unit 903 of the output device 101-3 that received the non-audible sound output request from the management server 102 has the first speaker ID included in the non-audible sound output request and the second speaker ID. The output of the inaudible sound including the speaker ID is started.

It is assumed that the output device 101-2 and the information terminal 104 are close to each other, and the inaudible sound output by the output device 101-3 reaches the information terminal 104. However, here, for example, sound waves from a mouse intrusion prevention device or the like are output to an inaudible sound region of 16 kHz or higher, and the information terminal 104 is a speaker included in the inaudible sound output by the output device 101-3. It is assumed that the ID cannot be obtained.

In step S1607, when the sound wave information acquisition unit 1003 of the management server 102 detects that a predetermined time (for example, 30 seconds) has elapsed since the last time the sound wave information was acquired, the processing after step S1608 is executed. To do. In addition, this process may execute the process after step S1402 when a predetermined time comes, like the process described above in step S1203 of FIG.

In step S1608, the sound wave information acquisition unit 1003 of the management server 102 transmits a sound wave information acquisition request to the output device 101-1.

In step S1609, the sound wave analysis unit 907 of the output device 101-1 that received the sound wave information acquisition request acquires the sound waves collected by the sound wave collection unit 906, and analyzes the noise level in the non-audible sound region from the acquired sound waves. (Measure.

In step S1610, the sound wave analysis unit 907 of the output device 101-1 transmits sound wave information including the noise level analyzed in step S1609 (here, it is assumed to be level “7”) to the management server 102.

In step S1611, the sound wave information acquisition unit 1003 of the management server 102 that has received the sound wave information from the output device 101-1 notifies the sound wave state determination unit 1004 of the noise level (level “7”) included in the received sound wave information. To do.

In step S1612, the sound wave state determination unit 1004 determines the state of the sound wave in the inaudible sound region around the output device 101 by using, for example, the control information 1013 shown in FIG. 11 (c). For example, in the example of FIG. 11C, when the noise level is “7”, the sound wave state determination unit 1004 determines that it is necessary for the output device 101 to output an audible sound.

In the processing of steps S1609 to S1612, for example, as shown in steps S1403 to S1407 of FIG. 14, when the speaker ID cannot be acquired from the sound waves around the output device 101, the output device 101 outputs an audible sound. It may be something to judge.

In step S1613, the sound wave state determination unit 1004 of the management server 102 issues an audible sound output instruction to the audible sound output control unit 1005. In the present embodiment, the sound wave state determination unit 1004 is the other output device 101- installed in the area where the output device 101-1 is installed, for example, the "first area on the first floor" in FIG. 11 (a). It is assumed that an audible sound output instruction is also issued to 2, 101-3.

This is because, for example, in FIG. 1, when the user 105 moves in the direction of the output device 101-1 from the vicinity of the output device 101-3, only the output device 101-1 outputs an audible sound, or This is because there is a sense of incongruity if only the output device 101-2 does not output audible sound. Therefore, in the present embodiment, the sound wave state determination unit 1004 collectively controls, for example, the output of the audible sound of the output devices 101-1 to 101-3 installed in the "first floor first area".

In step S1614, the audible sound output control unit 1005 of the management server 102 transmits an audible sound output request to the output device 101-1. The audible sound output request includes, for example, the output device ID "ID0001" of the output device 101-1 and the third speaker ID "SP0001K".

In step S1615, the audible sound output unit 904 of the output device 101-1 that received the audible sound output request from the management server 102 can have the third speaker ID "SP0001K" embedded in the audible sound region with a digital watermark. The listening sound is output from the third speaker.

In step S1616, the audible sound output control unit 1005 of the management server 102 transmits an audible sound output request to the output device 101-2. The audible sound output request includes, for example, the output device ID "ID0002" of the output device 101-2, the third speaker ID "SP0002K", and the like.

In step S1617, the audible sound output unit 904 of the output device 101-2 that received the audible sound output request from the management server 102 can have the third speaker ID “SP0002K” embedded in the audible sound region with a digital watermark. The listening sound is output from the third speaker.

In step S1618, the audible sound output control unit 1005 of the management server 102 transmits an audible sound output request to the output device 101-3. The audible sound output request includes, for example, the output device ID "ID0003" of the output device 101-3, the third speaker ID "SP0003K", and the like.

In step S1619, the audible sound output unit 904 of the output device 101-3, which received the audible sound output request from the management server 102, has a third speaker ID "SP0003K" embedded in the audible sound region with a digital watermark. The listening sound is output from the third speaker.

As described above, the output device 101 according to the present embodiment has a plurality of output devices 101 installed in the predetermined area when a sound wave that interferes with the inaudible sound region is detected in at least a part of the predetermined area. To output an audible sound with a speaker ID embedded in the audible sound area. This makes it possible to provide information to the information terminal 104 using audible sounds while reducing the sense of discomfort given to the user 105 of the information terminal 104.

(Modification example)
As a modification, the non-audible sound output control unit 1002 is connected to the output devices 101-1 to 101-3 when a predetermined sound is detected by the sound wave collection unit 906 and the sound wave analysis unit 907 of the output device 101-1. It may transmit a non-audible sound output request.

For example, in steps S1609 and S1610 of FIG. 19, when the acquired sound wave includes a predetermined sound wave, the sound wave analysis unit 907 of the output device 101-1 provides information indicating that the predetermined sound wave has been detected. It is included in the information and transmitted to the management server 102.

The management server 102 is installed in a predetermined area (for example, "first area on the first floor") when the sound wave information acquired from the output device 101-1 includes information indicating that a predetermined sound has been detected. The output devices 101-1 to 101-3 are made to output inaudible sound.

By this processing, for example, when the information terminal 104 that outputs a predetermined sound wave enters the predetermined area, the inaudible sound is output from a plurality of output devices 101-1 to 101-3 in the predetermined area. Will be able to.

[Third Embodiment]
In the first and second embodiments, the management server 102 has been described as having the sound wave state determination unit 1004, but the sound wave state determination unit 1004 may be included in the output device 101. In this embodiment, an example of output control processing when the output device 101 has a sound wave state determination unit will be described.

<Functional configuration>
FIG. 17 is a functional configuration diagram of the output device according to the third embodiment. The output device 101 according to the third embodiment has a sound wave state determination unit 1701 in addition to the functional configuration of the output device 101 according to the first embodiment shown in FIG. Since the other functional configurations are the same as the functional configurations of the output device 101 according to the first embodiment, the differences will be mainly described here.

The sound wave state determination unit 1701 needs to determine the state of the sound wave in the inaudible sound wave region around the output device 101 based on the sound wave information analyzed by the sound wave analysis unit 907, and cause the output device 101 to output the audible sound. It is a means to judge whether or not there is. The sound wave state determination unit 1701 is realized by, for example, a program that operates in the CPU 501 of FIG.

The sound wave state determination unit 1701 determines, for example, the state of sound waves in the non-audible sound region around the output device 101 based on the control information 1013 stored in the storage unit 905 as shown in FIG. 11C. It is determined whether or not it is necessary for the output device 101 to output an audible sound.

<Processing flow>
FIG. 18 is a sequence diagram showing an example of the output control process according to the third embodiment. The process shown in FIG. 18 shows an example in which the output device 101 outputs an audible sound from the third speaker at the discretion of the own device.

In step 1801, the inaudible sound output unit 903 of the output device 101 outputs the inaudible sound including the first speaker ID from the first speaker, and the inaudible sound including the second speaker ID from the second speaker. Is output.

In step S1802, when the sound wave state determination unit 1701 of the output device 101 detects that a predetermined time (for example, 30 seconds) has elapsed since the last time the sound wave information was acquired, the process of step S1803 is executed. .. In addition, this process may execute the process of step S1803 when a predetermined time comes, like the process described above in step S1203 of FIG.

In step S1803, the sound wave state determination unit 1701 of the output device 101 requests the sound wave analysis unit 907 to acquire sound wave information.

In step S1804, the sound wave analysis unit 907 of the output device 101 acquires the sound waves collected by the sound wave collection unit 906.

In step S1805, the sound wave analysis unit 907 of the output device 101 analyzes (measures) the noise level in the inaudible sound region using the acquired sound wave.

In step S1806, the sound wave analysis unit 907 of the output device 101 notifies the sound wave state determination unit 1701 of the sound wave information including the noise level analyzed in step S1805.

In step S1807, the sound wave state determination unit 1701 of the output device 101 determines the state of the sound wave in the inaudible sound region around the output device 101 according to the notified noise level. Here, assuming that the notified noise level is the level "7" and the sound wave state determination unit 1701 determines that it is necessary for the output device 101 to output an audible sound, the following description will be given.

In the processing of steps S1804 to S1807, for example, as shown in steps S1403 to S1407 of FIG. 14, when the speaker ID cannot be acquired from the sound waves around the output device 101, the output device 101 outputs an audible sound. It may be something to judge.

In step S1808, the sound wave state determination unit 1701 gives an audible sound output instruction to the audible sound output unit 904 based on the control information 1013 as shown in FIG. 11C, for example.

In step S1809, the audible sound output unit 904 that has received the audible sound output request reads, for example, sound wave data in which the third speaker ID is embedded in the audible sound region, which is stored in advance in the storage unit 905. Alternatively, the audible sound output unit 904 creates sound wave data in which the third speaker ID is embedded in the audible sound region.

In step S1810, the audible sound output unit 904 starts outputting the audible sound in which the third speaker ID is embedded in the audible sound region with a digital watermark.

By the above processing, the output device 101 outputs the inaudible sound including the first speaker ID and the inaudible sound including the second speaker ID, and when the state of the sound wave in the surrounding audible sound region deteriorates, It is possible to output an audible sound in which a third speaker ID is embedded in the audible sound region.

(Another example)
FIG. 19 is a sequence diagram showing another example of the output control process according to the third embodiment. The process shown in FIG. 19 shows an example in which the output device 101 requests the management server 102 to output an audible sound based on the state of the sound wave in the non-audible sound region around the own device. In this case, for example, the management server 102 does not have to periodically request the output device 101 to acquire sound wave information, so that the load on the management server 102 can be reduced.

In step S1901, the non-audible sound output control unit 1002 of the management server 102 transmits a non-audible sound output request to the output device 101-1.

In step S1902, the non-audible sound output unit 903 of the output device 101-1 that received the non-audible sound output request from the management server 102 has the first speaker ID included in the non-audible sound output request and the second speaker ID. The output of the inaudible sound including the speaker ID is started.

In step S1903, the non-audible sound output control unit 1002 of the management server 102 transmits a non-audible sound output request to the output device 101-2.

In step S1904, the non-audible sound output unit 903 of the output device 101-2 that received the non-audible sound output request from the management server 102 has the first speaker ID included in the non-audible sound output request and the second speaker ID. The output of the inaudible sound including the speaker ID is started.

In step S1905, when the sound wave state determination unit 1701 of the output device 101-1 detects that a predetermined time (for example, 30 seconds) has elapsed since the last time the sound wave information was acquired, the process of step S1905 is performed. Execute. Note that this process may execute the process of step S1906 at a predetermined time, similar to the process described in step S1203 of FIG. 12.

In step S1906, the sound wave state determination unit 1701 of the output device 101-1 requests the sound wave analysis unit 907 to acquire sound wave information.

In step S1907, the sound wave analysis unit 907 of the output device 101-1 acquires the sound waves collected by the sound wave collection unit 906.

In step S1908, the sound wave analysis unit 907 of the output device 101-1 analyzes (measures) the noise level in the inaudible sound region from the acquired sound wave.

In step S1909, the sound wave analysis unit 907 of the output device 101-1 notifies the sound wave state determination unit 1701 of the sound wave information including the noise level analyzed in step S1908.

In step S1910, the sound wave state determination unit 1701 of the output device 101-1 determines the state of the sound wave in the inaudible sound region around the output device 101-1 according to the notified noise level. Here, the notified noise level is level "7", and the sound wave state determination unit 1701 determines that it is necessary to output the audible sound to the output device 101 installed in the same area as the output device 101-1. As a matter of fact, the following description will be given.

In the process of steps S1907 to S1910, for example, as shown in steps S1403 to S1407 of FIG. 14, when the speaker ID cannot be acquired from the sound waves around the output device 101, the output device 101 outputs an audible sound. It may be something to judge.

In step S1911, the sound wave state determination unit 1701 of the output device 101-1 determines that it is necessary to output the audible sound to the output device 101 installed in the same area as the output device 101-1, and causes the management server 102 to output the audible sound. Send an audible sound output request.

In step S1912, the audible sound output control unit 1005 of the management server 102 identifies the output device 101 (for example, the output device 101-2) installed in the same area as the output device 101-1.

In step S1913, the audible sound output control unit 1005 of the management server 102 transmits an audible sound output request to the output device 101-1.

In step S1914, the audible sound output unit 904 of the output device 101-1 that received the audible sound output request from the management server 102 has a third speaker ID embedded in the audible sound region with a digital watermark. Output from the speaker of 3.

In step S1915, the audible sound output control unit 1005 of the management server 102 transmits an audible sound output request to the output device 101-2.

In step S1916, the audible sound output unit 904 of the output device 101-2 that received the audible sound output request from the management server 102 has a third speaker ID embedded in the audible sound region with a digital watermark. Output from the speaker of 3.

According to the above processing, the management server 102 may perform output control of the audible sound of the output device 101 only when the state of the sound wave in the audible sound region around the output device 101 deteriorates. The load can be reduced.

[Example of usage scene]
The outline of the usage scene of each of the above embodiments will be described.

(Example of location information provision system)
FIG. 20 is a diagram showing an example of a usage scene of the information providing system according to the embodiment. FIG. 20 shows an example of the layout of the floor 2000 of a department store, a supermarket, or the like. It is assumed that the floor 2000 is divided into 18 areas of areas 1 to 18, and an output device 101 is installed in each area. Further, it is assumed that the floor 2000 is divided and managed into a first area including areas 1 to 6, a second area including areas 7 to 12, and a third area including areas 13 to 18. ..

For example, it is assumed that the user 105 possessing the information terminal 104 enters the floor 2000 from the entrance 4 of FIG. 20 and activates the application corresponding to the information providing system 100 in the area 17. In this case, the information terminal 104 acquires the speaker ID from the output device 101 installed in the area 17, and transmits the request information including the acquired speaker ID and the application ID of the information terminal 104 to the management server 102. In response to this, the management server 102 transmits the coordinate information indicating the position of the area 17 to the information terminal 104. As a result, the information terminal 104 can display the current position of the information terminal 104 on the floor map of the floor 2000 as shown in FIG. 20, for example.

In the information providing system 100 as described above, the mouse intrusion prevention device 2001 is installed in the "□□ sushi" in the area 14, and the sound wave that interferes with the sound wave is output to the inaudible sound wave area within the reach of the sound wave 2002. To do. In this case, in the conventional technique, it becomes impossible to provide the information terminal 104 in the areas 13 to 15 of FIG. 20 with the coordinate information indicating the position of the area.

On the other hand, in the information providing system 100 of the present embodiment, when the intrusion prevention device 2001 outputs a sound wave to the non-audible sound region, the output device 101 installed in the regions 13 to 15 has a speaker ID in the audible sound region and a digital watermark. Outputs the audible sound embedded in. Therefore, the information providing system 100 can provide the information terminal 104 in the areas 13 to 15 of FIG. 20 with the position information indicating the position of the area.

Further, in FIG. 20, it is assumed that the mouse intrusion prevention device 2003 is also installed in the "fast food" of the region 18, and the sound wave that interferes with the sound wave is output to the non-audible sound region within the reachable range of the sound wave 2004. In this case, for example, by applying the information providing system 100 according to the second embodiment, for example, an audible sound in which the speaker ID is embedded in the audible sound region in the entire third area (for example, the sound of a waterfall, Bird chirping, etc.) is output. Therefore, for example, even when the user 105 of the information terminal 104 enters the floor 2000 from the doorway 4 and moves toward the doorway 2, the sound is not interrupted in the area 15 and the discomfort given to the user 105 is reduced. be able to.

(Example of entry / exit / attendance management system)
FIG. 21 is a diagram showing another example of a usage scene of the information providing system according to the embodiment. FIG. 21 shows an example of an information providing system 100 that manages users who enter and leave the workplace such as the food processing area 2101.

For example, it is assumed that the output device 101 is installed at the entrance / exit 2102 of the food processing area 2101 as shown in FIG. As a result, for example, when the user 105 possessing the information terminal 104 enters the food processing area 2101, the information terminal 104 acquires the speaker IDs in the order of the speaker IDs "SP0001N" and "SP0001S".

Further, when the user 105 having the information terminal 104 leaves the food processing area 2101, the information terminal 104 acquires the speaker IDs in the order of the speaker IDs "SP0001S" and "SP0001N". Therefore, the information terminal 104 can manage the entry, exit, etc. of the user 105 by transmitting the time, order, etc. of the two speaker IDs to the management server 102.

A mouse intrusion prevention device 2103 is installed in the food processing area 2101, and the user 105 who leaves the room last operates the intrusion prevention device 2103 and returns home, and the user 105 who first goes to work The intrusion prevention device 2103 shall be stopped.

Further, when the intrusion prevention device 2103 is operated, the information terminal 104 cannot acquire the inaudible sound from the output device 101 included in the sound wave reachable range 2104 of the intrusion prevention device 2103.

In such a case, in the conventional technique, when the user 105 who leaves the room last operates the intrusion prevention device 2103, it becomes impossible to manage the leaving time of the user 105. Similarly, it becomes impossible to manage the entry time of the user 105 who first commute to work the next day.

On the other hand, in the information providing system 100 of the present embodiment, when the intrusion prevention device 2103 is operated, the output device 101 outputs an audible sound in which the speaker ID "SP0001K" is embedded in the audible sound region. Therefore, the information providing system 100 can manage the information of the user 105 who leaves the room last (for example, the application ID) and the information of the user 105 who first commute to work.

In this case, for example, it is not possible to specify the direction of whether the user 105 who leaves the room last enters or leaves the room, but usually, depending on the time, whether the user 105 first enters the room or leaves the room last. It is easy to determine if you did. Further, in this case, since the information terminal 104 of the user 105 who leaves the room last transmits the speaker ID "SP0001K" included in the audible sound to the management server 102, the last person leaving the room on that day can be easily managed. Will be.

100 Information provision system 101 Output device 102 Management server (information processing device)
104 Information terminal 903 Non-audible sound output unit 904 Hearable sound output unit 906 Sound wave collection unit 907 Sound wave analysis unit 1002 Non-audible sound output control unit (first output control unit)
1003 Sound wave information acquisition unit (information acquisition unit)
1004, 1701 Sound wave information judgment unit (judgment unit)
1005 Hearing sound output control unit (second output control unit)
1006 Output device management unit

Japanese Unexamined Patent Publication No. 2012-227909

Claims (10)

An output device that outputs sound waves
A sound wave collecting unit that collects sound waves around the output device,
In the first sound wave containing the first identification information in the inaudible sound region having a frequency higher than the predetermined frequency, or in the audible sound region having a frequency lower than the predetermined frequency, depending on the sound wave collected by the sound wave collecting unit. An output unit that outputs a second sound wave containing the second identification information,
Has an output device. The output device according to claim 1, further comprising a sound wave analysis unit that analyzes sound waves collected by the sound wave collection unit. The output unit outputs the first sound wave or the second sound wave based on the control information for the output device to perform control corresponding to the sound wave collected by the sound wave collecting unit, claim 1 or 2. The output device according to 2. Any of claims 1 to 3, wherein the output unit outputs the second sound wave including the second identification information that is different from each other in each frequency band obtained by dividing the audible sound region into a plurality of frequency bands. The output device according to one item. The output device according to claim 4 , wherein the output unit outputs the second sound wave including the different second identification information at predetermined intervals for each of the frequency bands. The output device according to claim 4 or 5 , wherein the output unit outputs the different second identification information in a different order on the time axis. The output device according to any one of claims 4 to 6 , wherein the output unit outputs the second sound wave by changing the respective frequency bands including the different second identification information. The output device according to any one of claims 1 to 7 , wherein the output unit outputs both the first sound wave and the second sound wave in response to the sound waves collected by the sound wave collecting unit. It is an output method executed by an output device that outputs sound waves.
A sound wave collection procedure for collecting sound waves around the output device and
In the first sound wave containing the first identification information in the inaudible sound region having a frequency higher than the predetermined frequency, or in the audible sound region having a frequency lower than the predetermined frequency, depending on the sound wave collected in the sound wave collecting procedure. The procedure for outputting a second sound wave containing the second identification information, and
Output methods, including. An output system that outputs sound waves
A sound wave collecting unit that collects sound waves around the output system,
In the first sound wave containing the first identification information in the inaudible sound region having a frequency higher than the predetermined frequency, or in the audible sound region having a frequency lower than the predetermined frequency, depending on the sound wave collected by the sound wave collecting unit. An output unit that outputs a second sound wave containing the second identification information,
Has an output system.

Images