JP2016005268A - Information transmission system, information transmission method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately transmit predetermined information even when high-frequency sound indicating the predetermined information is output together with audible range sound.SOLUTION: A content sound reproduction section 74 reproduces the sound signal of multi-media contents as a first sound signal having an audible range component. A high frequency sound reproduction section 78 converts high-frequency information generated from predetermined information into a second sound signal constituted by a component of a predetermined frequency band of a non-audible range, and reproduces the signal. A block section 75 blocks at least the component of a predetermined frequency band within the first sound signal. A mixing section 76 generates a third sound signal by mixing the first sound signal where the component of the predetermined frequency band is blocked with the second sound signal. A speaker 82 outputs sound corresponding to the third sound signal, so as to transmit the predetermined information as the component of the predetermined frequency band within the sound.

Description

  The present invention relates to an information transmission system, an information transmission method, and a program.

Conventionally, there is a technique for converting information into high-frequency sound and transmitting it (see, for example, Patent Documents 1 to 3).
Since high-frequency sound is in an inaudible range, information can be transmitted without being heard by humans. For this reason, it is also possible to transmit information by outputting high-frequency sound from a speaker or the like together with audio in an audible range, such as video incidental sound (such as movie speech) or music.

JP 2012-155706 A JP 2009-27722 A Korean Patent No. 10-1447501

  However, if conventional techniques including Patent Documents 1 to 3 are applied and high-frequency sound indicating predetermined information is output together with audio in the audible range, the predetermined information may not be transmitted properly. In particular, when the predetermined information has a large capacity and high-frequency sound is output continuously in time, the probability that the predetermined information cannot be properly transmitted becomes very high.

  The present invention has been made in view of such a situation, and enables the predetermined information to be appropriately transmitted even when high-frequency sound indicating the predetermined information is output together with the sound in the audible range. With the goal.

In order to achieve the above object, an information transmission system according to an aspect of the present invention includes:
First reproduction means for reproducing a first audio signal having an audible range component;
Second reproduction means for converting predetermined information into a second audio signal composed of a component in a predetermined frequency band in a non-audible range, and reproducing the second audio signal;
A blocking means for blocking at least a component of the predetermined frequency band in the first audio signal;
Mixing means for generating a third audio signal by mixing the first audio signal from which the component of the predetermined frequency band is blocked and the second audio signal;
Voice output means for transmitting the predetermined information as a component of the predetermined frequency band of the voice by outputting a voice corresponding to the third voice signal;
Is provided.

There are multiple types of candidates for the predetermined frequency band,
Band setting means for selecting and setting the predetermined frequency band used in the second reproduction means from among a plurality of types of the predetermined frequency band candidates can be further provided.

The information transmission system includes a first device and a second device including the first reproduction unit to the audio output unit,
The first device includes:
High-frequency information conversion means for converting the predetermined information into the high-frequency information indicating the mapping result by mapping the predetermined information in the predetermined frequency band;
A data stream generating means for generating a data stream by combining the high-frequency information and sound source data corresponding to the first audio signal;
Transmitting means for transmitting the data stream to the second device;
With
The second device includes:
Receiving means for receiving the data stream;
The first reproduction means reproduces the first audio signal based on the sound source data included in the data stream,
The second reproduction means reproduces the second audio signal based on the high-frequency information included in the data stream;
Can be.

  An information transmission method and program according to one aspect of the present invention are a method and program corresponding to the above-described information transmission apparatus according to one aspect of the present invention.

  According to the present invention, even if high frequency sound indicating predetermined information is output together with audio in the audible range, the predetermined information can be appropriately transmitted.

It is a mimetic diagram showing composition of an information processing system concerning one embodiment of the present invention. It is a block diagram which shows the hardware constitutions of a shop apparatus among the information processing systems of FIG. It is a functional block diagram which shows an example of a functional structure of a content delivery server among the information processing systems of FIG. It is a functional block diagram which shows an example of a functional structure of a shop apparatus among the information processing systems of FIG. It is a figure which shows an example of the frequency characteristic for demonstrating the interruption | blocking part of the shop apparatus of FIG. It is a functional block diagram which shows an example of a functional structure of a user terminal among the information processing systems of FIG. It is a flowchart explaining an example of the flow of a process of the information processing system of FIG. It is a flowchart explaining an example of the flow of a process of the information processing system of FIG.

FIG. 1 shows the configuration of an information processing system according to an embodiment of the present invention.
The information processing system shown in FIG. 1 includes n (n is an arbitrary integer value greater than or equal to 1) store apparatuses 1-1 to 1-n arranged in a predetermined store, and m people (m Includes user terminals 2-1 to 2-m, a content distribution server 3, and a store management server 4 used by each of users having an arbitrary integer value of 1 or more.

  Hereinafter, when it is not necessary to individually distinguish each of the store apparatuses 1-1 to 1-n, these are collectively referred to as “store apparatus 1”. Similarly, when it is not necessary to individually distinguish each of the user terminals 2-1 to 2-m, these are collectively referred to as “user terminal 2”.

The store apparatus 1 is configured as a POS terminal, for example, and outputs various multimedia contents such as BGM and movies (including sound). Furthermore, the store apparatus 1 outputs store information as high-frequency sound together with the audio output of the multimedia content.
Here, the store information refers to information transmitted from the store to the user, and the content thereof is information that is not particularly limited. For example, various kinds of information such as information on products, information for explaining how to order and purchase the products, advertisement information, event promotion information, and the like can be used as store information. Further, the advertising information may be advertising information of the store itself, or may be a kind of ticket information for accessing an external advertising server (not shown).
Although details will be described later, the store information output as high-frequency sound from the store apparatus 1 of the present embodiment does not need to be small-capacity data such as a short code as in the past, and also employs large-capacity data. Can do. Furthermore, this large-capacity data can be continuously transmitted from the store apparatus 1 without interruption in time.

  In other words, the information transmission system IS including the store device 1 and the content distribution device 3 is a system capable of transmitting store information to the user terminal 2. That is, an embodiment of the present invention is an information transmission system IS.

  The user terminal 2 is configured by a smartphone or the like, inputs high frequency sound output from the store apparatus 1, restores store information from the high frequency sound, and presents it to the user. The user who has received the store information can perform various operations on the user terminal 2. In this case, the user terminal 2 accepts the operation and transmits the content of the operation to the store management server 4 or the like as necessary.

  The store management server 4 manages store information, and executes various processes according to the content of operations performed on the user terminal 2 corresponding to the store information.

  The content distribution server 3 receives the store information, generates a data stream in which the store information is combined with the multimedia content, and transmits the data stream to the store apparatus 1.

  FIG. 2 is a block diagram showing a hardware configuration of the store apparatus 1 in the information processing system of FIG.

  The store apparatus 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, and an input unit 17. A storage unit 18, a communication unit 19, and a drive 20.

The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 18 to the RAM 13.
The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. An output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15.

The output unit 16 includes a speaker, a display unit, and the like, and outputs various types of information as images and sounds.
The input unit 17 includes a keyboard, a mouse, and the like, and inputs various information.
The storage unit 18 includes a hard disk, a DRAM (Dynamic Random Access Memory), and the like, and stores various data.
The communication unit 19 controls communication performed with another device (the store management server 4 or the like in the example of FIG. 1).

  The drive 20 is provided as necessary. A removable medium 21 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 20. The program read from the removable medium 41 by the drive 20 is installed in the storage unit 29 as necessary. The removable medium 41 can also store various data stored in the storage unit 29 in the same manner as the storage unit 29.

  Although not shown, the hardware configurations of the user terminal 2, the content distribution server 3, and the store management server 4 basically have the configuration shown in FIG.

  Next, an example of a functional configuration of the user terminal 2, the content distribution server 3, and the store management server 4 will be described with reference to FIGS.

FIG. 3 is a functional block diagram illustrating an example of a functional configuration of the content distribution server 3.
As shown in FIG. 3, in the content distribution server 3, the store information acquisition unit 51, the high frequency information conversion unit 52, the data stream generation unit 53, the data stream transmission unit 54, and the sound map setting unit 55 function. To do.
Further, a sound map storage unit 61 and a multimedia content holding unit 62 are provided in one area of the storage unit of the content distribution server 3.

  The store information acquisition unit 51 acquires store information transmitted from the store management server 4.

The high frequency information conversion unit 52 converts the store information into high frequency information using the sound map stored in the sound map storage unit 61.
A sound map is information that defines rules for mapping each value of digital data (store information) to each frequency of high-frequency sound, and includes a high-frequency band in which each value of digital data can be mapped and a signal sequence pattern Etc. including information.
The high-frequency information is information in which each value of digital data (store information) is indicated by each frequency in the high-frequency band, in other words, is necessary for outputting the digital data (store information) from the speaker in the form of high-frequency sound. Information.
In the present embodiment, for example, a band of 18 kHz to 22 kHz is adopted as the high frequency band. This is because the frequency response performance of the speaker 82 to be described later of the store apparatus 1, the performance of the microphone 101 to be described later of the user terminal 2, the characteristics of the human non-audible band, the influence of ambient noise based on the conversation of people in the store, This is in consideration of the sampling frequency of the audio compression technique.
Note that this high-frequency band is merely an example, and a plurality of types of high-frequency bands can be selectively used as will be described later.

The data stream generation unit 53 generates a data stream for distribution by combining high frequency information (store information) with data to be distributed among the multimedia contents held in the multimedia content holding unit 62. .
The method of combining the multimedia content and the high frequency information is not particularly limited, but the following method is adopted in the present embodiment. In other words, a method is adopted in which multimedia content is converted into a data stream (packet stream) format, and high-frequency information is compressed to insert the compressed data as compressed data into the header area of the data stream. Has been.
Note that the data stream employed in the present embodiment is merely an example, and it is sufficient to include at least multimedia content and high-frequency information, and can take various forms. For example, as in the present embodiment, a single data stream in which multimedia content and high-frequency information are integrated may be used, or a data stream including multimedia content and a data stream including high-frequency information are separated. You may make it use for.

  The data stream transmission unit 54 transmits a data stream including at least high-frequency information and multimedia content to the store apparatus 1 via a network (not shown) such as the Internet.

FIG. 4 is a functional block diagram illustrating an example of a functional configuration of the store apparatus 1.
As shown in FIG. 4, in the store apparatus 1, the data stream reception unit 71, the multimedia content acquisition unit 72, the content image playback unit 73, the content audio playback unit 74, the blocking unit 75, and the mixing unit 76. And the high frequency information acquisition part 77, the high frequency sound reproduction | regeneration part 78, and the zone | band setting part 79 function.
In addition, the output unit 16 is provided with a display unit 81 and a speaker 82.

The data stream receiving unit 71 receives the data stream distributed from the content distribution server 3.
The multimedia content acquisition unit 72 acquires multimedia content (data) from the received data stream.
The high frequency information acquisition unit 77 acquires high frequency information from the received data stream. In the present embodiment, the high-frequency information acquisition unit 77 acquires high-frequency information by extracting compressed data from the header area of the received data stream and performing decompression decoding processing on the compressed data.

The content image reproduction unit 73 reproduces an image signal of multimedia content. As a result, an image corresponding to the image signal is displayed on the display unit 81.
The content audio reproduction unit 74 reproduces an audio signal of multimedia content.
The blocking unit 75 blocks components higher than the predetermined frequency Fcut in the audio signal of the multimedia content and allows other components, that is, components less than the frequency Fcut to pass. The technical significance of the blocking unit 75 will be described with reference to FIG.

The high frequency sound reproducing unit 78 reproduces a high frequency sound signal based on the high frequency information indicating the store information. That is, store information is reproduced in the form of a high-frequency sound signal.
The mixing unit 76 mixes a high-frequency sound signal with respect to the audio signal of the multimedia content, and outputs an audio signal obtained as a result. Thereby, a sound corresponding to the audio signal is output from the speaker 82.

Although details will be described later, the user terminal 2 inputs the sound output from the speaker 82 in this way, extracts a high-frequency component from the input sound, and restores store information from the high-frequency component.
Therefore, if the high-frequency component of the sound output from the speaker 82 includes noise other than store information, the user terminal 2 cannot properly restore the store information.
As described above, the sound output from the speaker 82 is a mixture of the high-frequency sound of the store information and the sound of the multimedia content. The frequency band of the audio of the multimedia content is mainly an audible range, but may include a high frequency component in a non-audible range.
In the whole audio of this multimedia content, there may be few high-frequency components, but from the viewpoint of time axis, if high-frequency components exist even for a moment, the high-frequency components become noise and become high-frequency components of store information. It will overlap. As a result, it is difficult to restore the high frequency information (store information).
Here, if the store information has a small capacity and can be transmitted discontinuously in time, the transmission time of the high-frequency sound indicating the store information is extremely short. Therefore, by repeatedly reproducing the high frequency sound, it is possible to output from the speaker 82 while avoiding the timing at which the high frequency component (noise) of the audio of the multimedia content is output.
However, when the store information has a large capacity and needs to be transmitted continuously in time, it is very difficult to repeatedly reproduce the high-frequency sound indicating the store information.
Therefore, in the present embodiment, as shown in FIG. 5, a blocking unit 75 that blocks a component having a frequency equal to or higher than a predetermined frequency Fcut is provided in the audio CM of the multimedia content.
As a result, it is possible to mix the component (solid line portion in FIG. 5) of the multimedia content audio CM that is less than the predetermined frequency Fcut and the high frequency component HM2 (store information) that exceeds the predetermined frequency Fcut. That is, the high frequency component of the audio CM of the multimedia content is not superimposed as noise. As a result, the store information can be properly restored on the user terminal 2 side.

Here, in the present embodiment, it is possible to reproduce the high frequency components HM1 to HM3 that respectively use the three types of high frequency bands.
Therefore, the band setting unit 79 sets a reproduction target by the high frequency sound reproduction unit 78 from among the high frequency components HM1 to HM3. The high frequency sound reproduction unit 78 reproduces high frequency sound in a high frequency band set as a reproduction target.

FIG. 6 is a functional block diagram illustrating an example of a functional configuration of the user terminal 2.
As shown in FIG. 6, in the user terminal 2, a microphone 101, a high frequency component extraction unit 102, a high frequency information restoration unit 103, a store information restoration unit 104, an output unit 105, an operation reception unit 106, an environment, The measurement unit 107 functions.

The microphone 101 inputs the sound output from the speaker 82 (FIG. 4) of the store apparatus 1, converts it into an audio signal, and outputs it.
The high frequency component extraction unit 102 extracts a high frequency component from the audio signal output from the microphone 101.
The high frequency information restoration unit 103 restores high frequency information from the extracted high frequency component signal.
The store information restoration unit 104 restores the store information from the high frequency information.
The output unit 105 outputs the store information in the form of an image or sound.
The operation reception unit 106 receives a user operation. In this case, the output unit 105 transmits (outputs) the operation content of the user to the store management server 4 or the like as necessary.
The environment measurement unit 107 measures the surrounding environment based on the audio signal output from the microphone 101. In this case, the output unit 105 transmits the measurement result to the content distribution server 3. In addition, the usage method of the measurement result of an environment is later mentioned with reference to FIG.

  Next, with reference to FIG.7 and FIG.8, the flow of a process of the user terminal 1 and the store apparatus 1 etc. which have such a functional structure is demonstrated.

In step S1 of FIG. 7, the store management server 4 stores store information.
In step S11, the sound map setting unit 55 (FIG. 3) of the content distribution server 3 stores the sound map in the sound map storage unit 61.
When the store information is transmitted from the store management server 4 to the content distribution server 3, the process proceeds to step S12.
In step S12, the high frequency information conversion unit 52 converts the store information into high frequency information using the sound map stored in the process of step S11.
In step S13, the data stream generation unit 53 generates a data stream by combining the high frequency information converted from the store information in the process of step S12 with the multimedia content to be distributed.
In step S14, the data stream transmission unit 54 distributes the data stream generated in the process of step S13 to the store apparatus 1.

When the data stream receiving unit 71 of the store apparatus 1 receives the data stream distributed from the content distribution server 3, the process proceeds to step S21.
In step S21, the content audio reproducing unit 74 reproduces an audio signal of multimedia content in the received data stream.
In step S22, the blocking unit 75 cuts a high frequency component, that is, a component having a frequency equal to or higher than the predetermined frequency Fcut, from the audio signal of the multimedia content reproduced in the process of step S21.
In step S23, the high frequency sound reproduction unit 78 reproduces a high frequency sound signal based on the high frequency information in the received data stream.
In step S24, the mixing unit 76 mixes the high frequency sound signal reproduced in the process of step S23 with the audio signal of the multimedia content from which the high frequency component has been cut in the process of step S22.
In step S25, the mixing unit 76 outputs an audio signal obtained as a result of the process in step S24. Thereby, a sound corresponding to the audio signal is output from the speaker 82. Then, the following series of processing is executed on the user terminal 2 side.

In step S31, the microphone 101 inputs the sound output from the speaker 82 of the store apparatus 1, converts it into an audio signal, and outputs it.
In step S <b> 32, the high frequency component extraction unit 102 extracts a high frequency component from the audio signal output from the microphone 101. The high frequency information restoration unit 103 recognizes (restores) high frequency information from the extracted high frequency component signal.
In step S33, the store information restoration unit 104 restores the store information from the high frequency information.
In step S34, the output unit 105 outputs the store information in the form of an image or sound.
In step S35, the operation reception unit 106 receives a user operation.
The output unit 105 transmits (outputs) the contents of the operation accepted in the process of step S35 to the store management server 4.
In step S <b> 2, the store management server 4 executes a predetermined process (hereinafter referred to as “user operation process”) corresponding to the operation content of the user.

Here, a specific example of the user operation process will be described.
In this example, when each product in the store is presented as a digital menu to the user terminal 2, the user performs an operation for ordering a predetermined product from the digital menu on the user terminal 2. And the process according to the content (operation content) of an order shall be performed by the shop management server 4 as a user operation process.

Specifically, in step S1, digital menu data of a specific store is stored as store information.
That is, the digital menu of a specific store is mixed with the audio of the multimedia content as a high-frequency sound by the processing of steps S12 to S14 of the content distribution server 3 in FIG. 7 and the processing of steps S21 to S25 of the store apparatus 1. And output from the speaker 82 of the store apparatus 1.
Through the processing of steps S31 to S34 on the user terminal 2, high frequency components are extracted from the sound output from the speaker 82, high frequency information is recognized from the high frequency components, and store information, that is, specific store The digital menu is restored and presented to the user.
The user operates the user terminal 2 to order a predetermined product from the digital menu.
Then, in step S35, the operation reception unit 106 receives the operation. The output unit 105 transmits (outputs) the contents of the operation to the store management server 4.
In step S <b> 2, the store management server 4 receives an order for a predetermined product as a user operation process, and executes various processes so that an appropriate response is made to the order at a specific store.
For example, the store management server 4 notifies the user apparatus 2 or the user who performed the operation (hereinafter referred to as “user information”) to the store apparatus 1 of the specific store. When the store management server 4 receives a notification of completion of order processing from the store apparatus 1, the store management server 4 notifies the user terminal 2 of the completion notification.

Here, when the store management server 4 manages a plurality of stores, it is necessary to specify a store to which an order from the user terminal 2 should be handled.
Therefore, for example, when the user terminal 2 receives an operation for ordering a predetermined product, the user terminal 2 notifies the store management server 4 of its own location information (for example, GPS information) together with the operation content. The store management server 4 can specify a store by comparing the position information with the position information of each store.
Further, for example, when the user terminal 2 receives an operation for ordering a predetermined product, the user terminal 2 notifies the store management server 4 of the identification code of the store that processes the order together with the content of the operation. The store management server 4 can specify the store by the notified identification code.

Here, the user terminal 2, for example, by installing a predetermined application program, tuning for optimizing the high-frequency sound of the store information according to each audio environment of the plurality of stores (hereinafter referred to as “optimization tuning”). Can be realized).
FIG. 8 is a flowchart showing the flow of processing when such optimization tuning is executed.

The noise characteristics differ from each other due to various factors such as the location of each store and the surrounding environment. Therefore, there are also stores where a large amount of noise is included in a part of a band set as a default (for example, 18 kHz to 22 kHz, hereinafter referred to as “standard band”) as a high frequency band used by the high frequency sound.
If the standard band is applied to such a store, the store information may not be properly restored on the user terminal 2 side.
Therefore, for example, when the store owner of the store uses his / her smartphone as the user terminal 2 and executes the above-described application program, a series of processes shown in FIG. 8 is executed. That is, optimization tuning is performed and the frequency band is changed to the optimum for the store.
In the optimization tuning process, when it is determined that the noise environment of the store is not special and the standard band is sufficient, the standard band may be maintained as the frequency band.

When the user terminal 2 starts the predetermined application program described above, the process proceeds to step S51.
In step S <b> 51, the user terminal 2 sets identification information (such as an identification code) of a store for which optimization tuning is performed.
The setting method of the store identification information is not particularly limited. For example, a method of setting a high-frequency sound provided from the store management server 4, a method of setting using an NFC tag connected to the store apparatus 1, Various methods such as a method of setting using one function of the predetermined application program described above (for example, a function that is directly input via a menu) can be employed.
In step S <b> 52, the environment measurement unit 107 measures the surrounding environment based on the input sound to the microphone 101. Specifically, the environment measurement unit 107 analyzes the input sound in the store, measures the noise level for each frequency band, and generates information indicating the measurement result (hereinafter referred to as “environment analysis information”).

The store identification information and the environment analysis information are output from the output unit 105 of the user terminal 2 and transmitted to the content distribution server 3.
Thereby, in the content distribution server 3, a process progresses to step S71.
In step S71, the sound map setting unit 55 (FIG. 3) of the content distribution server 3 stores a sound map based on the standard band (hereinafter referred to as “general-purpose sound map”).

In step S72, the sound map setting unit 55 identifies the store based on the store identification information. In addition, the sound map setting unit 55 checks whether it is appropriate to execute the optimization tuning, that is, performs an optimality check.
The content of the optimality check is not particularly limited.
For example, the sound map setting unit 55 collates the position information (GPS information or the like) of the user terminal 2 with the position information of the store, so that the user terminal 2 can perform the above-described predetermined application for optimization tuning. It is possible to check whether or not the program has been activated at the store.
For example, the sound map setting unit 55 tracks the transmission route (path) of the environmental analysis information in a state in which a restriction is given in advance so that the user terminal 2 can access the content distribution server 3 only via the wireless LAN. Then, it can be checked whether the AP of the wireless LAN belongs to the store.

In step S73, the sound map setting unit 55 selects a region having a low high-frequency noise level in the high-frequency region based on the environmental analysis information provided from the user terminal 2, and is mapped in the selected region. Change the sound map.
In step S74, the sound map setting unit 55 separately manages the sound map after the change by the process of step S73 as an optimized sound map of the store.
That is, the general-purpose sound map and the optimized sound map of the store are stored in the sound map storage unit 61 independently.

In this case, although not shown in FIG. 8, the processing of steps S12 and S13 of FIG. 7 is executed using the optimized sound map of the store, and a data stream (hereinafter, specifically referred to as “test data stream”) is generated. Generated.
In step S75, the data stream transmission unit 54 distributes the test data stream generated using the optimized sound map of the store to the store apparatus 1.

  The store apparatus 1 executes the processing of steps S61 to S65, that is, basically the same processing as steps S21 to S25 of FIG. As a result, a sound obtained by mixing the sound of the multimedia content and the high-frequency sound of the test information (store information test information) included in the test data stream is output from the speaker 82 of the store apparatus 1.

The user terminal 1 verifies whether or not the store information has been properly restored by executing basically the same processes as steps S31 to S34 of FIG. 7 described above as the processes of steps S53 to S56.
When the restoration is properly performed, the user performs a predetermined operation on the user terminal 1 in order to notify the content distribution server 3 to that effect. In step S57, the user terminal 1 accepts a user operation.
The content of the user operation is transmitted to the content distribution server 3. Thereby, the data stream produced | generated using the said sound map is delivered to the store apparatus 1 of the said store after the next time.

Here, when there are a plurality of stores, an optimized sound map may be generated, or an optimized sound map may not be generated.
Therefore, when there are a plurality of optimized sound maps, the content distribution server 3 can generate and sequentially distribute a data stream using each of the plurality of optimized sound maps and the general-purpose sound map.
In this case, the store apparatus 1 for which the optimized sound map has been generated extracts the data stream generated using its own optimized sound map, and executes the processes of steps S21 to S25 in FIG.
On the other hand, the store apparatus 1 for which the optimized sound map has been generated extracts the data stream generated using the general-purpose sound map, and executes the processes of steps S21 to S25 in FIG.

  Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, and the like within a scope that can achieve the object of the present invention are included in the present invention. is there.

For example, in the above-described embodiment, the store information is transmitted as high-frequency sound. However, since the user terminal 2 is a portable terminal that can be freely carried, the information to be transmitted is not particularly limited to the store information.
In other words, in the information transmission system to which the present invention is applied, a speaker capable of outputting high-frequency sound may be installed in a place where a terminal capable of inputting high-frequency sound (the user terminal 2 in the above-described embodiment) may exist. It is sufficient if possible, and it is not particularly necessary to apply to stores as in the above-described embodiment. Therefore, the predetermined information transmitted as high frequency sound may be arbitrary information.

In addition, the functional configurations of FIGS. 3, 4, and 6 are merely examples, and are not particularly limited. That is, it is sufficient that the information transmission system has a function capable of executing the above-described series of processing as a whole, and what functional block is used to realize this function is particularly shown in FIGS. The example is not limited to six. Further, the location of the functional block is not particularly limited to FIGS. 3, 4, and 6, and may be arbitrary.
For example, the functional block of the store apparatus 1 and the functional block of the content distribution apparatus 3 may be integrated into one apparatus. In this case, there is no need to transmit in the form of a data stream. In other words, the multimedia content and the predetermined information may be acquired separately.
In addition, the audio signal mixed with the high-frequency sound signal is not particularly required to be an audio signal of multimedia content, and an audio signal from an arbitrary sound source can be adopted.

  In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When the processing of each functional block is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose smartphone or personal computer other than a server.

  The recording medium including such a program is not only constituted by a removable medium (not shown) distributed separately from the apparatus main body in order to provide the program to the player, but is also provided to the player in a state of being preinstalled in the apparatus main body. It is composed of a provided recording medium or the like.

In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.
Further, in the present specification, the term “system” means an overall apparatus configured by a plurality of devices, a plurality of means, and the like.

In other words, the information transmission system to which the present invention is applied can take various embodiments having the following configurations, including the information transmission system IS as the embodiment of FIG. 1 described above.
That is, an information processing system to which the present invention is applied is
First reproduction means for reproducing a first audio signal having an audible range component (for example, the content audio reproduction unit 74 in FIG. 4);
Second reproduction means (for example, a high frequency sound reproduction unit 78 in FIG. 4) for converting predetermined information into a second audio signal composed of a component in a predetermined frequency band in a non-audible range and reproducing it;
Blocking means for blocking at least the component of the predetermined frequency band in the first audio signal (for example, the blocking unit 75 in FIG. 4);
Mixing means for generating a third audio signal by mixing the first audio signal from which the component of the predetermined frequency is blocked and the second audio signal (for example, the mixing unit 76 in FIG. 4);
Audio output means (for example, the speaker 82 in FIG. 4) for transmitting the predetermined information as a component of the predetermined frequency band of the audio by outputting audio corresponding to the third audio signal;
Is provided.

Thereby, even if the high frequency sound which shows predetermined information (high frequency sound corresponding to a 2nd audio | voice signal) is output with the audio | voice (audio | voice corresponding to a 1st audio | voice signal) of an audible range, the said predetermined information can be transmitted appropriately. It becomes like this.
That is, when an audio signal in an audible range such as video incidental sound (movie speech or the like) or music is adopted as the second audio signal, a high-frequency component in a non-audible range may also be included.
When the high-frequency component of the second audio signal has a component of a frequency within a predetermined frequency band used by the second audio signal, when the first audio signal is mixed as it is into the second audio signal, The high frequency component of one audio signal is superimposed on the high frequency sound as noise.
It is difficult to restore the predetermined information from the high frequency sound on which this noise is superimposed.
Therefore, the above-described blocking means blocks the high frequency component of the first audio signal, so that noise is not superimposed on the high frequency sound.
Therefore, the predetermined information can be appropriately restored from the high frequency sound on which noise is not superimposed.

In other words, in order to properly restore the predetermined information in this way, it is sufficient for the blocking means to cut only the component of the predetermined frequency band used in the second audio signal from the first audio signal. That is, the cutoff unit 75 of the above-described embodiment uniformly cuts the frequency component equal to or higher than the frequency Fcut, but it is not necessary to cut uniformly.
Further, when the predetermined frequency band used in the second audio signal varies, the blocking means may change the frequency band to be blocked accordingly.

Here, a plurality of types of the predetermined frequency band exist,
Band setting means (for example, a band setting unit 79 in FIG. 4) for selecting and setting the predetermined frequency band used by the second reproduction means from among a plurality of types of the predetermined frequency band candidates may be further provided.

In addition, the information transmission system includes a first device (for example, the content distribution device 3 in FIG. 3) and a second device (for example, the store device 2 in FIG. 4) including the first reproduction unit to the audio output unit. Including.
The first device includes:
High-frequency information conversion means (for example, the high-frequency information conversion unit 52 in FIG. 3) for converting the predetermined information into the high-frequency information indicating the mapping result by mapping the predetermined information in the predetermined frequency band;
A data stream generating unit (for example, the data stream generating unit 53 in FIG. 3) that generates a data stream by combining the high-frequency information and sound source data corresponding to the first audio signal;
Transmission means for transmitting the data stream to the second device (for example, the data stream transmission unit 54 in FIG. 3);
Is provided.
The second device includes:
It further comprises receiving means for receiving the data stream (for example, the data stream receiving unit 71 in FIG. 4),
The first reproduction means reproduces the first audio signal based on the sound source data included in the data stream,
The second reproduction means reproduces the second audio signal based on the high-frequency information included in the data stream;
You may do it.

  DESCRIPTION OF SYMBOLS 1, 1-1 thru | or 1-n ... Store apparatus, 2, 2-1 thru | or 2-m ... User terminal, 3 ... Content delivery server, 4 ... Store management server, 11 ... CPU, 51 ... Store information acquisition unit, 52 ... High frequency information conversion unit, 53 ... Data stream generation unit, 54 ... Data stream transmission unit, 55 ... Sound map setting unit, 61 ... Sound map storage unit, 62 ... multimedia content holding unit, 71 ... data stream receiving unit, 72 ... multimedia content acquisition unit, 73 ... content image playback unit, 74 ... content audio Reproduction unit, 75 ... blocking unit, 76 ... mixing unit, 77 ... high frequency information acquisition unit, 78 ... high frequency sound reproduction unit, 79 ... band setting unit, 81 ... display unit, 82 ... Spy DESCRIPTION OF SYMBOLS 101 ... Microphone 102 ... High frequency component extraction part 103 ... High frequency information restoration part 104 ... Store information restoration part 105 ... Output part 106 ... Operation reception part 107 ... Environmental measurement unit

Claims (5)

First reproduction means for reproducing a first audio signal having an audible range component;
Second reproduction means for converting predetermined information into a second audio signal composed of a component in a predetermined frequency band in a non-audible range, and reproducing the second audio signal;
A blocking means for blocking at least a component of the predetermined frequency band in the first audio signal;
Mixing means for generating a third audio signal by mixing the first audio signal from which the component of the predetermined frequency band is blocked and the second audio signal;
Voice output means for transmitting the predetermined information as a component of the predetermined frequency band of the voice by outputting a voice corresponding to the third voice signal;
An information transmission system comprising: There are multiple types of candidates for the predetermined frequency band,
The information transmission system according to claim 1, further comprising: a band setting unit that selects and sets the predetermined frequency band used by the second reproduction unit from among a plurality of types of the predetermined frequency band candidates. The information transmission system includes a first device and a second device including the first reproduction unit to the audio output unit,
The first device includes:
High-frequency information conversion means for converting the predetermined information into the high-frequency information indicating the mapping result by mapping the predetermined information in the predetermined frequency band;
A data stream generating means for generating a data stream by combining the high-frequency information and sound source data corresponding to the first audio signal;
Transmitting means for transmitting the data stream to the second device;
With
The second device includes:
Receiving means for receiving the data stream;
The first reproduction means reproduces the first audio signal based on the sound source data included in the data stream,
The second reproduction means reproduces the second audio signal based on the high-frequency information included in the data stream;
The information transmission system according to claim 1 or 2. In the information transmission method executed by the information transmission system,
A first reproduction step of reproducing a first audio signal having an audible range component;
A second reproduction step of converting the predetermined information into a second audio signal composed of a component of a predetermined frequency band in a non-audible region and reproducing the second audio signal;
A blocking step of blocking at least a component of the predetermined frequency band in the first audio signal;
A mixing step of generating a third audio signal by mixing the first audio signal from which the component of the predetermined frequency band is blocked and the second audio signal;
An audio output step of transmitting the predetermined information as a component of the predetermined frequency band of the audio by outputting an audio corresponding to the third audio signal;
An information transmission method including: To the computer that controls the information transmission system,
A first reproduction step of reproducing a first audio signal having an audible range component;
A second reproduction step of converting the predetermined information into a second audio signal composed of a component of a predetermined frequency band in a non-audible region and reproducing the second audio signal;
A blocking step of blocking at least a component of the predetermined frequency band in the first audio signal;
A mixing step of generating a third audio signal by mixing the first audio signal from which the component of the predetermined frequency band is blocked and the second audio signal;
An audio output step of transmitting the predetermined information as a component of the predetermined frequency band of the audio by outputting an audio corresponding to the third audio signal;
A program that executes control processing including

Images