JP7259435B2 - Terminal device, information processing system, and information processing method - Google Patents

Description

The present invention relates to a terminal device, an information processing system, and an information processing method.

2. Description of the Related Art There is known an information processing system that outputs a sound wave representing identification information and causes a terminal device that has acquired the identification information represented by the acquired sound wave to display predetermined information based on the identification information.

For example, in a facility with objects such as creatures and exhibits, an information terminal acquires sounds emitted from a sounding device, and uses identification information extracted from the sounds to acquire and display object information from a server. An information providing system is known (see Patent Literature 1, for example).

Thus, in an information processing system in which predetermined information is displayed on a terminal device based on identification information represented by acquired sound waves, it is desired to display predetermined information on the terminal device using a plurality of different sound waves. I have a request.

For example, in an exhibition hall or the like, sound waves representing the first identification information are output all at once in an in-house broadcast, and "event information" or the like is displayed on the terminal device, and sound waves representing the second identification information are displayed around the exhibit. to display the "Exhibit Guide" on the terminal device.

In such a case, for example, a first sound wave representing the first identification information is output in a first frequency band, and a second sound wave representing the second identification information is output in a second frequency band different from the first frequency band. By outputting two sound waves, the terminal device can be notified of the first identification information and the second identification information.

However, with this method alone, there is a problem that the information processing system cannot control which of the "event information" and the "exhibition guide" is to be displayed on the terminal device.

Thus, in the conventional technology, in an information processing system that displays predetermined information on a terminal device using sound waves, it is difficult to display predetermined information on the terminal device using a plurality of different sound waves. was accompanied by

An embodiment of the present invention has been made in view of the above problems, and is an information processing system that uses sound waves to display predetermined information on a terminal device. To facilitate display of predetermined information on a terminal device.

In order to solve the above problems, a terminal device according to one embodiment of the present invention is a terminal device that displays predetermined information based on identification information represented by acquired sound waves. a first extraction unit for extracting the first identification information from a first sound wave representing the identification information; and a second frequency band for extracting the second identification information from the second sound wave representing the second identification information. a second extraction unit that extracts; and a determination unit that determines identification information indicating the predetermined information from the extracted first identification information or the second identification information based on the set priority. and, the priority of the first sound wave is set higher than the priority of the second sound wave, and the determination unit determines that the first identification information and the second identification information are When extracted, the first identification information is determined to be identification information indicating the predetermined information, the first identification information includes identification information for changing the priority, and the terminal device has a changing unit that changes the priority of the first sound wave to be lower than the priority of the second sound wave when identification information for changing the priority is extracted.

According to one embodiment of the present invention, in an information processing system for displaying predetermined information on a terminal device using sound waves, it is possible to display predetermined information on the terminal device using a plurality of different sound waves. become easier.

1 is a diagram illustrating an example of a system configuration of an information processing system according to an embodiment; FIG. FIG. 4 is a diagram for explaining frequency bands used by sound waves according to one embodiment; It is a figure which shows an example of the usage scene of the information processing system which concerns on one Embodiment. FIG. 4 is a diagram for explaining extracted IDs and display information according to an embodiment; It is a figure which shows the example of the hardware constitutions of the terminal device which concerns on one Embodiment. It is a figure showing an example of hardware constitutions of a sound wave output device concerning one embodiment. It is a figure showing an example of functional composition of an information processing system concerning one embodiment. It is a figure which shows the image of an example of the process information which concerns on one Embodiment. 6 is a flow chart showing an example of processing of the terminal device according to the first embodiment; 9 is a flowchart showing an example of processing of a terminal device according to the second embodiment; FIG. 11 is a flow chart showing an example of processing of a terminal device according to the third embodiment; FIG. FIG. 16 is a flow chart showing an example of processing of a terminal device according to the fourth embodiment; FIG. FIG. 14 is a flow chart showing an example of processing of a terminal device according to the fifth embodiment; FIG.

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention are described below with reference to the accompanying drawings.

<System configuration>
First, the system configuration of an information processing system 100 according to one embodiment will be described.

FIG. 1 is a diagram illustrating an example of the system configuration of an information processing system according to one embodiment. The information processing system 100 includes, for example, a terminal device 110, a broadcasting device 120, a sound wave beacon 130, a digital signage 140, and the like.

The terminal device 110 is, for example, an information terminal such as a smart phone or a tablet terminal. By executing an application corresponding to the information processing system 100, the terminal device 110 acquires sound waves output from the broadcasting device 120, the sound wave beacon 130, the digital signage 140, etc., and extracts identification information represented by each sound wave. can be done. In addition, the terminal device 110 displays predetermined information based on the identification information represented by the acquired sound waves.

The broadcasting device 120 is, for example, a device that broadcasts audio guidance, music, and the like using a plurality of speakers installed in facilities such as indoor facilities, underground facilities, and event venues. Also, the broadcasting device 120 can display information corresponding to the ID1 on the terminal device 110 that has acquired the ID1 by outputting the sound wave A representing the first identification information (hereinafter referred to as ID1). For example, the broadcasting device 120 causes the terminal device 110 in the facility or venue to display voice guidance being broadcast in multiple languages, to display evacuation routes in the event of a disaster, and to display information on ongoing events. etc. Note that the broadcasting device 120 is an example of a first sound wave output device.

The sonic wave beacon 130 is a sonic wave output device that is installed in the above-described facility, a store included in an event site, or the like, and that outputs a sonic wave B representing second identification information (hereinafter referred to as ID2). Further, by outputting the sound wave B, the sound wave beacon 130 can cause the terminal device 110 that has acquired the sound wave B to display information corresponding to ID2. For example, the acoustic wave beacon 130 can cause the terminal devices 110 around the store to display the layout of the store, information on bargain products, and the like. Note that the sonic beacon 130 is an example of a second sonic output device.

The digital signage 140 is a display device that is installed in the above-described facilities, event venues, and the like, and displays content such as video, text, and audio, for example. In addition, the digital signage 140 uses a speaker included in the digital signage 140 to output a sound wave C representing third identification information (hereinafter referred to as ID3). Information can be displayed accordingly. For example, the digital signage 140 can cause terminal devices 110 in the vicinity of the digital signage to display coupons for advertisements displayed on the digital signage 140, detailed information on products being displayed, and the like. Note that the digital signage 140 is another example of the second sound wave output device.

(Example of frequency band used by each sound wave)
FIG. 2 is a diagram for explaining frequency bands used by each sound wave according to one embodiment. In FIG. 2 , the horizontal axis represents frequency, with a frequency band 201 in which the broadcasting device 120 outputs sound wave A, a frequency band 202 in which sound wave beacon 130 outputs sound wave B, and a frequency band in which digital signage 140 outputs sound wave C. 203 indicate different frequency bands.

As an example, broadcasting device 120 outputs sound wave A representing ID1 in frequency band 201 from 18 kHz to 20 kHz. Also, the sonic beacon 130 outputs a sonic wave B representing ID2 in the frequency band 202 of 15 kHz to 17 kHz. Further, the digital signage 140 outputs a sound wave C representing ID3 in the frequency band 203 of 12 kHz to 14 kHz.

It should be noted that any method may be used for the sound waves A to C to represent the ID. Further, the sound waves A to C may represent IDs in mutually different methods, or may represent IDs in the same method. Furthermore, the frequency bands 201 to 203 shown in FIG. 2 are examples, and other frequency bands may be used.

For example, the broadcasting device 120 may use a frequency band of 10 kHz or less to embed ID1 in broadcast sound waves such as audio broadcasts, music, environmental sounds, and sound effects as an electronic watermark. Also, the sound wave beacon 130, the digital signage 140, and the like may indicate ID2 and ID3 by turning on/off a plurality of predetermined frequencies of 16 kHz or higher.

In this embodiment, the broadcasting device 120 calls a plurality of pieces of identification information represented by the sound wave A ID1. Similarly, a plurality of pieces of identification information represented by sound waves B by the sound wave beacon 130 are called ID2, and a plurality of pieces of identification information represented by sound waves C by the digital signage 140 are called ID3.

In this way, by outputting the sound waves A to C in different frequency bands, the broadcasting device 120, the sound wave beacon 130, and the digital signage 140 can generate IDs 1 to 3 without synchronizing the devices. The terminal device 110 can be notified.

(Example of usage scene)
FIG. 3 is a diagram illustrating an example of a usage scene of the information processing system according to one embodiment. Here, an image of how the information processing system 100 is used will be briefly described. In the example of FIG. 3, it is assumed that a predetermined facility 300 is provided with broadcasting equipment including a broadcasting device 120 and a plurality of speakers 301A, 301B, 301C, . Broadcasting device 120 outputs sound wave A121 representing ID1 into facility 300 using a plurality of speakers 301A, 301B, 301C, . . .

In addition, it is assumed that a sound wave beacon 130 is installed in an area 310 such as a store within the facility 300 and outputs a sound wave B122 representing ID2 within the area 310 . Furthermore, it is assumed that a digital signage 140 is installed in an area 320 such as an aisle or an event space in the facility 300, and a sound wave C123 representing ID3 is output within the area 320. FIG.

FIG. 4 is a diagram showing an image of an extracted ID and an example of display information according to one embodiment.

4 shows an example of an ID extracted by the terminal device 110 when the user 302 carrying the terminal device 110 moves leftward in FIG. there is

The terminal device 110 can acquire surrounding sound waves using a microphone provided in the terminal device 110, and extract an ID represented by the acquired sound waves at predetermined time intervals (for example, every second). In the example of FIG. 4, the IDs extracted by the terminal device 110 are ID1 from time t1 to t2, ID1 and ID2 from time t2 to t3, ID1 from time t3 to t4, ID1 and ID3 from time t4 to t5, and time t5. ˜t6, ID1 is indicated.

It is assumed that times t2 to t3 indicate that the terminal device 110 is in the area 310 in FIG. 3, and that the terminal device 110 is in the area 320 in times t4 to t5.

"Display information example (1)" shown in FIG. 4 shows an example in which, when a plurality of IDs are extracted, the terminal device 110 displays the display information according to the newly extracted IDs. . In this example, from time t1 to t2, the terminal device 110 causes the display unit to display display information (for example, event information) designated by the extracted ID1. Further, from time t2 to t3, the terminal device 110 causes the display unit to display the display information (for example, store information, etc.) indicated by the newly extracted ID2 of the extracted ID1 and ID2. Further, from time t3 to t4, the terminal device 110 causes the display unit to display display information (for example, event information) indicated by the extracted ID1.

In this display method, for example, when the user 302 of the terminal device 110 enters the area 310 while viewing the information of the event of interest, the display information is automatically switched to store information or the like. There is a problem of storage. Furthermore, when the user 302 of the terminal device 110 enters the area 320, the display information is automatically switched to the content information displayed by the digital signage 140, or the like.

Therefore, the information processing system 100 according to the present embodiment sets the priority of each sound wave so that, when a plurality of IDs are extracted, the terminal device 110 can control which ID to display the display information according to the instruction of which ID. has a function to control

For example, when the terminal device 110 displays information having a higher priority than other information, such as evacuation information in the event of a disaster, the broadcasting device 120 outputs a sound wave A having a higher priority than other sound waves. As a result, as shown in "example of display information (2)" in FIG. can be made

Also, the broadcasting device 120 sets the priority of other sound waves higher than that of the sound wave A when displaying on the terminal device 110 information having a lower priority than other information, such as weather information and a calendar. As a result, for example, as shown in "example (1) of display information" in FIG. become. Further, the broadcasting device 120 maintains the display of "store information", "content information" and the like, which are set with high priority, for a predetermined period of time, as shown in "example (3) of display information" in FIG. Then, it may be controlled so as not to be updated by "weather information" or the like having a low priority.

Note that the display information displayed on the terminal device 110 by the information processing system 100 is various and may change with the passage of time. It is difficult to set.

Also, for example, since the acoustic wave beacon 130 and the like are generally different systems from the broadcasting device 120, for example, if the acoustic wave beacon 130 issues an instruction to display "store information" with the highest priority, , it is difficult to control on the broadcasting device 120 side.

On the other hand, according to the information processing system 100 according to the present embodiment, the priority of each sound wave can be controlled by the control from the information processing system 100, so that it becomes easy to cause the terminal device 110 to display predetermined information.

<Hardware configuration>
(Hardware configuration of terminal device)
FIG. 5 is a diagram illustrating an example of a hardware configuration of a terminal device according to one embodiment; The terminal device 110 is, for example, an information terminal having a computer configuration such as a smart phone or a tablet terminal. However, the terminal device 110 is not limited to this, and may be various devices having a computer configuration.

The terminal device 110 includes, for example, a CPU (Central Processing Unit) 501, a memory 502, a storage device 503, a communication I/F (Interface) 504, a display input device 505, a sound input/output I/F 506, a microphone 507, a speaker 508, and It has a bus 509 and the like.

The CPU 501 is an arithmetic unit that implements each function of the terminal device 110 by reading programs and data stored in the storage device 503 or the like onto the memory 502 and executing processing. The memory 502 includes, for example, a RAM (Random Access Memory) that is used as a work area for the CPU 501, a ROM (Read Only Memory) that stores a startup program, and the like.

The storage device 503 is, for example, a nonvolatile mass storage device such as an SSD (Solid State Drive), and stores an OS (Operating System), application programs, various data, and the like. A communication I/F 504 is an interface for connecting the terminal device 110 to a communication network and communicating with other devices.

The display input device 505 is, for example, a device such as a touch panel display in which an input device such as a touch panel and a display device such as a display are integrated. Note that the display/input device 505 may be divided into a display device and an input device.

The sound input/output I/F 506 includes, for example, an amplifier circuit that amplifies sound wave signals, a DAC (Digital to Analog Converter) that converts digital data into sound waves, an ADC (Analog to Digital Converter) that converts sound wave signals into digital data, and the like. include. The microphone 507 is a microphone that converts the acquired sound wave into a sound wave signal and outputs the signal to the sound input/output I/F 506 . The speaker 508 is a speaker, a receiver, or the like that converts a sound wave signal output from the sound input/output I/F 506 into a sound wave and outputs the sound wave. A bus 509 is connected to each component described above, and transmits, for example, address signals, data signals, and various control signals.

(Hardware configuration of sound wave output device)
The broadcasting device 120, the sound wave beacon 130, and the digital signage 140 have, for example, the hardware configuration of the sound wave output device 600 as shown in FIG. Note that when the sound wave output device 600 is the broadcasting device 120 , the sound wave output device 600 does not have to have the speaker 608 . Moreover, when the sound wave output device 600 is the sound wave beacon 130, the sound wave output device 600 may not have the input I/F 606, the display device 610, and the like. Furthermore, when the sound wave output device 600 is the digital signage 140, the sound wave output device 600 does not need to have the input I/F606.

FIG. 6 is a diagram illustrating an example of a hardware configuration of a sound wave output device according to one embodiment; The sound wave output device 600 has a computer configuration, and includes, for example, a CPU 601, a memory 602, a storage device 603, a communication I/F 604, a sound wave processing circuit 605, an input I/F 606, an output I/F 607, a speaker 608, and an input device. 609, a display device 610, a bus 611, and the like.

Note that the CPU 601, the memory 602, the storage device 603, the communication I/F 604, and the bus 611 are the same as the CPU 501, the memory 502, the storage device 503, the communication I/F 504, and the bus 509 described above, and therefore will not be described here. omitted.

A sound wave processing circuit 605 is a circuit for amplifying a sound wave, generating a sound wave representing an ID, etc., according to control from the CPU 601, and includes, for example, a sound wave amplification circuit, DAC, ADC, DSP (Digital Signal Processor), and the like. obtain. An input I/F 606 is an interface for inputting sound wave signals to the sound wave processing circuit 605 . The output I/F 607 is, for example, an interface that outputs sound waves to the speaker 608 or an external speaker.

The input device 609 is an input device that receives input operations to the sound wave output device 600, such as a keyboard, pointing device, operation panel, button, touch panel, or the like. The display device 610 is, for example, a display device such as a display or an LED (Light Emitting Diode).

<Functional configuration>
Next, the functional configuration of the information processing system 100 according to this embodiment will be described. FIG. 7 is a diagram illustrating an example of a functional configuration of an information processing system according to one embodiment; Here, an example in which the information processing system 100 includes a terminal device 110, a broadcasting device (first sound wave output device) 120, and a sound wave beacon (an example of a second sound wave output device) 130 will be described. Note that the digital signage 140, which is another example of the second sound wave output device, has the same functional configuration as the sound wave beacon 130 shown in FIG.

(Functional configuration of terminal device)
The terminal device 110, for example, executes a predetermined program in the CPU 501 of FIG. , a determination unit 703, a change unit 704, a deletion unit 705, a display control unit 706, a communication unit 707, a storage unit 708, and the like. It should be noted that at least part of the functional configurations described above may be realized by hardware.

The sound wave acquisition unit 701 acquires sound waves around the terminal device 110 using, for example, the microphone 507 and the sound input/output I/F 506 in FIG.

Preferably, the sound wave acquisition unit 701 records the acquired sound wave, converts the recorded sound wave into sound wave data, and stores the sound wave data in the storage unit 708 or the like.

The first extraction unit 702A analyzes the sound wave (sound wave data) acquired by the sound wave acquisition unit 701, and extracts the first identification information (ID1) in the first frequency band (for example, the frequency band 201 in FIG. 2). A first identification (ID1) is extracted from the represented first sound wave (sound wave A).

The second extraction unit 702B analyzes the sound wave (sound wave data) acquired by the sound wave acquisition unit 701 and extracts the second identification information (ID2) in the second frequency band (for example, the frequency band 202 in FIG. 2). The second identification information (ID2) is extracted from the represented second sound wave (sound wave B).

The third extraction unit 702C analyzes the sound wave (sound wave data) acquired by the sound wave acquisition unit 701, and extracts the third identification information (ID3) in the third frequency band (for example, the frequency band 203 in FIG. 3). The third identification information (ID3) is extracted from the represented third sound wave (sound wave C123).

Note that the first extraction unit 702A, the second extraction unit 702B, the third extraction unit 702C, . . . Also, in the following description, the first extraction unit 702A, the second extraction unit 702B, the third extraction unit 702C, .

The determining unit 703 determines one ID for instructing the terminal device 110 to display predetermined information from one or more IDs extracted by the extracting unit 702 according to the set priority.

For example, when the priority of sound wave A is set higher than that of sound wave B, and ID11 and ID2 are extracted by the extraction unit 702, the determination unit 703 selects ID1, which has a higher priority, An ID that instructs a predetermined process is determined.

Further, the determination unit 703 stores the determined ID in the identification information 711 of the storage unit 708 . For example, when ID1 is acquired, the determination unit 703 stores the sound wave type of sound wave A for which ID1 is acquired and ID1 in the identification information 711 of the storage unit 708 .

The changing unit 704 changes the setting of the priority when the extracting unit 702 extracts the priority changing ID for instructing the change of the priority. For example, as described above, when the priority of sound wave A is set higher than the priority of sound wave B and an ID for changing the priority is extracted, the changing unit 704 changes the priority of sound wave A to Change the priority of sound wave B to lower. Similarly, when the priority of sound wave B is set higher than that of sound wave A and an ID for priority change is extracted, the changing unit 704 changes the priority of sound wave B to the priority of sound wave A. Change to lower degree.

When the extraction unit 702 extracts an ID for ID deletion that instructs deletion of the identification information 711 stored in the storage unit 708, the deletion unit 705 deletes the identification information 711 stored in the storage unit 708 by the determination unit 703. do.

The display control unit 706 causes the display unit such as the display input device 505 to display predetermined information according to the identification information 711 stored in the storage unit 708 by the determination unit 703 . For example, the display control unit 706 uses the identification information 711 and the processing information 712 stored in the storage unit 708 to determine display information to be displayed on the display unit.

FIG. 8 is a diagram showing an image of an example of processing information according to one embodiment. 8A shows an image of an example of processing information 712A corresponding to sound wave A. FIG. The processing information 712A includes items such as "sound wave type", "ID1", and "processing details".

The "sound wave type" information indicates that the processing information 712A is the processing information 712 corresponding to the sound wave A. FIG. “ID1” is the ID represented by the sound wave A. "Processing content" is information indicating the processing content corresponding to each ID1.

In the example of FIG. 8A, when the identification information 711 stored in the storage unit 708 stores the sound wave type “sound wave A” and the ID1 “101”, the display control unit 706 performs “display event information ( URL 1)” is executed. For example, the display control unit 706 acquires event information from the URL (Uniform Resource Locator) 1 of the content server 730 via the communication unit 707 and displays it on the display unit such as the display input device 505 .

Note that the identification information 711 stored in the storage unit 708 may store an ID in a format such as "ID1=101", for example. As a result, for example, even if the sound wave type “sound wave A” is not stored in the identification information 711, the processing content corresponding to ID1 can be identified from the processing information 712A.

In addition, in the example of FIG. 8A, ID1=001 indicates an ID for priority change, and ID1=002 indicates an ID for ID deletion.

FIG. 8B shows an image of an example of processing information 712B corresponding to sound wave B. FIG. The processing information 712B includes items such as "sound wave type", "ID2", and "processing content". The "sound wave type" information indicates that the processing information 712B is the processing information 712 corresponding to the sound wave B. FIG. “ID2” is an ID represented by sound wave B. "Processing content" is information indicating the processing content corresponding to each ID2.

In the example of FIG. 8B, when the identification information 711 stored in the storage unit 708 stores the sound wave type “sound wave B” and the ID1 “111”, the display control unit 706 outputs the “preset store information 1 display" process. For example, the display control unit 706 acquires store information 1 preset in the application and causes the display unit such as the display input device 505 to display it.

FIG. 8C shows an image of an example of processing information 712C corresponding to sound wave C123. The processing information 712C includes items such as "sound wave type", "ID3", and "processing content". The "sound wave type" information indicates that the processing information 712C is the processing information 712 corresponding to the sound wave C123. "ID3" is an ID represented by sound wave C123. "Processing content" is information indicating the processing content corresponding to each ID3. Note that the “processing content” of each piece of processing information 712 may include processing other than display processing.

Here, returning to FIG. 7, the description of the functional configuration of the information processing system is continued.

The communication unit 707 connects the terminal device 110 to the communication network 740 using, for example, the communication I/F 504 in FIG. 5, and communicates with the content server 730 and the like.

The storage unit 708 is realized by, for example, a program executed by the CPU 501 in FIG. 5, the storage device 503, the memory 502, etc., and stores various information such as identification information 711, processing information 712, and sound wave data. .

(Functional configuration of broadcasting device)
The broadcasting device 120 implements a system control unit 721, a sound wave generation unit 722, a storage unit 723, and the like, for example, by executing a predetermined program in the CPU 601 of FIG. It should be noted that at least part of the functional configurations described above may be realized by hardware.

The system control unit 721 performs control to output the sound wave A representing ID1 into the facility 300 using the plurality of speakers 301A, 301B, 301C, . For example, the system control unit 721 uses the sound wave generation unit 722 to generate sound wave data of sound wave A representing ID1, and uses the sound wave processing circuit 605 and the output I/F 607 in FIG. are output from a plurality of speakers 301A, 301B, 301C, .

Thereby, the system control unit 721 can cause the terminal device 110 that has acquired the sound wave A to display predetermined information corresponding to ID1. In addition, the system control unit 721 outputs a sound wave A including an ID for priority change, an ID for ID deletion, etc. as ID1, thereby controlling the setting of the priority of each sound wave using ID1. be able to.

The sound wave generation unit 722 generates sound wave data of sound waves A representing various values of ID1 under the control of the system control unit 721 .

The storage unit 723 is implemented by, for example, a program executed by the CPU 601 in FIG. 6, the storage device 603, the memory 602, and the like, and stores various information, data, and the like.

(Functional configuration of sound wave beacon)
The sound wave beacon 130 implements a sound wave output unit 731, a sound wave generation unit 732, a storage unit 733, and the like, for example, by executing a predetermined program in the CPU 601 of FIG. It should be noted that at least part of the functional configurations described above may be realized by hardware.

The sound wave output unit 731 performs control for outputting the sound wave B representing ID2 using, for example, the sound wave processing circuit 605, the output I/F 607, the speaker 608, and the like in FIG. For example, the sound wave output unit 731 uses the sound wave generation unit 732 to generate sound wave data of sound wave B representing ID2, and uses the sound wave processing circuit 605, output I/F 607, speaker 608, etc. to generate sound wave data representing ID2. B is output within the area 310 such as a store within the facility 300 . Accordingly, the sound wave output unit 731 can cause the terminal device 110 that has acquired the sound wave B to display predetermined information according to ID2.

The sound wave generation unit 732 generates sound wave data of sound waves B representing various values of ID2 under the control of the sound wave output unit 731 .

The storage unit 733 is implemented by, for example, a program executed by the CPU 601 in FIG. 6, the storage device 603, the memory 602, and the like, and stores various information, data, and the like.

<Process flow>
Subsequently, the flow of processing of the information processing method according to this embodiment will be described by exemplifying a plurality of embodiments.

[First Embodiment]
9 is a flowchart illustrating an example of processing of the terminal device according to the first embodiment; FIG. This processing shows an example of the processing of the terminal device 110 when the priority of sound wave A is set higher than the priority of sound wave B. FIG.

In step S<b>901 , the sound wave acquisition unit 701 of the terminal device 110 acquires sound waves around the terminal device 110 . For example, the sound wave acquisition unit 701 records sound waves collected using the microphone 507, converts the recorded sound waves into sound wave data, and stores the sound wave data in the storage unit 708 or the like.

In step S902, the first extraction unit 702A of the terminal device 110, for example, analyzes the sound wave data stored in the storage unit 708 by the sound wave acquisition unit 701, and extracts ID1 from the sound wave A representing ID1 in the frequency band 201. do.

In step S903, the second extraction unit 702B of the terminal device 110 analyzes, for example, the sound wave data stored in the storage unit 708 by the sound wave acquisition unit 701 in parallel with the processing of step S902, and extracts ID2 data in the frequency band 202. ID2 is extracted from sound wave B representing .

In step S904, the determination unit 703 of the terminal device 110 determines whether or not the first extraction unit 702A has successfully extracted ID1. If ID1 can be extracted, the determining unit 703 causes the process to proceed to step S905. On the other hand, if ID1 could not be extracted, the determination unit 703 causes the process to proceed to step S906.

In step S<b>905 , the determination unit 703 of the terminal device 110 stores the sound wave type “sound wave A” of the sound wave A from which ID1 is extracted and the extracted ID1 in the identification information 711 of the storage unit 708 . Alternatively, the determination unit 703 may store “ID1=101” in the identification information 711 of the storage unit 708 when the extracted ID1 is “101”.

After moving to step S906, the determination unit 703 of the terminal device 110 determines whether or not the second extraction unit 702B has successfully extracted ID2. If ID2 can be extracted, the determining unit 703 causes the process to proceed to step S907. On the other hand, if ID2 could not be extracted, the determination unit 703 terminates the processing in FIG.

In step S<b>907 , the determination unit 703 of the terminal device 110 stores the sound wave type “sound wave B” of the sound wave B from which ID2 is extracted and the extracted ID2 in the identification information 711 of the storage unit 708 . Alternatively, the determination unit 703 may store “ID2=111” in the identification information 711 of the storage unit 708 when the extracted ID2 is “111”.

Through the above process, the determining unit 703 stores the ID with the highest priority among the IDs extracted by the extracting unit 702 in the identification information 711 of the storage unit 708 .

In step S<b>908 , the terminal device 110 displays information corresponding to the ID stored in the identification information 711 of the storage unit 708 . For example, when ID1 “102” is stored in the identification information 711 of the storage unit 708, the display control unit 706 of the terminal device 110 refers to the processing information 712A, and performs the process of “displaying event information (URL2)”. to run.

Through the above processing, the broadcasting device 120 outputs the sound wave A representing ID1, thereby preferentially displaying the display information indicated by ID1, for example, as shown in "Display information example (2)" in FIG. can be displayed on the terminal device 110 .

Further, the broadcasting device 120 can cause the terminal device 110 to display the display information indicated by the ID2 represented by the sound wave B or the ID3 represented by the sound wave C123 by stopping the output of the sound wave A representing the ID1.

[Second embodiment]
FIG. 10 is a flowchart illustrating an example of processing of the terminal device according to the second embodiment. This process shows another example of the process of the terminal device 110 .

In step S1001, the terminal device 110 executes, for example, an ID acquisition process as shown in steps S901 to S903 of FIG.

In step S1002, the determination unit 703 of the terminal device 110 determines whether or not an ID has been extracted from a sound wave having a higher priority than other sound waves (hereinafter referred to as a sound wave of priority 1) in the ID extraction processing of step S1001. determine whether For example, as in the first embodiment, when the priority of sound wave A is higher than the priority of sound wave B, the determination unit 703 determines whether ID1 could be extracted from sound wave A, as in the first embodiment. determine whether

If the ID can be extracted from the sound wave with priority 1, the determining unit 703 causes the process to proceed to step S1007. On the other hand, if the ID cannot be extracted from the sound wave with priority 1, the determination unit 703 causes the process to proceed to step S1003.

In step S1003, the determination unit 703 of the terminal device 110 selects an ID from the sound wave having a lower priority than the sound wave of priority 1 (hereinafter referred to as the sound wave of priority 2) in the ID extraction process of step S1001. Determine whether or not the data has been successfully extracted. For example, as in the first embodiment, when the priority of sound wave B is lower than the priority of sound wave A, the determining unit 703 determines whether ID2 could be extracted from sound wave B, as in the first embodiment. determine whether

If the ID can be extracted from the sound wave with priority 2, the determination unit 703 causes the process to proceed to step S1004. On the other hand, if the ID cannot be extracted from the sound wave with priority 2, the determination unit 703 terminates the processing in FIG.

In step S<b>1004 , the determination unit 703 of the terminal device 110 confirms the sound wave type of the ID stored in the identification information 711 of the storage unit 708 .

In step S<b>1005 , the determination unit 703 of the terminal device 110 determines whether or not the confirmed sound wave type is the sound wave type of the sound wave with priority 1 . If the confirmed sound wave type is not the sound wave type of the sound wave with priority 1, the determination unit 703 causes the process to proceed to step S1007. On the other hand, if the confirmed sound wave type is the sound wave type of the sound wave with priority 1, the determination unit 703 causes the process to proceed to step S1006.

After moving to step S1006, the determination unit 703 of the terminal device 110 discards the extracted ID without storing it in the identification information 711 of the storage unit 708. FIG.

After proceeding to step S<b>1007 , the determination unit 703 of the terminal device 110 stores the sound wave type of the sound wave whose ID is extracted and the extracted ID in the identification information 711 of the storage unit 708 . For example, in step S1002, if the ID can be extracted from the sound wave with priority 1, the determining unit 703 stores the sound wave type of the sound wave with priority 1 and the ID extracted from the sound wave with priority 1 in the storage unit 708 for identification. Store in information 711 . On the other hand, in step S1002, if the ID cannot be extracted from the sound wave with priority 1, the determination unit 703 stores the sound wave type of the sound wave with priority 2 and the ID extracted from the sound wave with priority 2 in the storage unit 708. Stored in the identification information 711 .

In step S<b>1008 , the terminal device 110 displays information corresponding to the ID stored in the identification information 711 of the storage unit 708 . For example, when the identification information 711 of the storage unit 708 stores the sound wave type “sound wave B” and the ID2 “202”, the display control unit 706 of the terminal device 110 refers to the processing information 712B to display “latest "display store information 2 (URL 4)".

By the above processing, when a plurality of IDs are extracted, the terminal device 110 can preferentially display the display information indicated by the ID indicated by the sound wave having the higher priority.

Further, in this embodiment, if an ID with a higher priority extracted from the sound wave with priority 1 is stored in the identification information 711 of the storage unit 708 by the processing of steps S1004 to S1006, the extracted ID is discarded. do. As a result, for example, even when the sound wave with priority 1 is interrupted or stopped, information with higher priority can be continuously displayed on the terminal device 110 .

[Third Embodiment]
FIG. 11 is a flowchart illustrating an example of processing of a terminal device according to the third embodiment; This processing shows an example of processing executed when the terminal device 110 extracts an ID for priority change. In FIG. 11, the processes of steps S1001 to S1006, S1007, and S1008 are the same as those of the second embodiment described with reference to FIG. I do.

When the process proceeds from step S1002 or step S1005 to step S1101, the changing unit 704 of the terminal device 110 determines whether the extracted ID is an ID for changing priority. For example, the changing unit 704 refers to the processing information 712A in FIG. 8A, and when the extracted ID is ID1 "001", determines that the ID is for changing the priority.

If the extracted ID is not the ID for priority change, the changing unit 704 causes the process to proceed to step S1007. On the other hand, if the extracted ID is an ID for changing priority, the changing unit 704 lowers the priority of the sound wave with priority 1 in step S1102. For example, when the priority of sound wave A is set higher than the priority of sound wave B, the changing unit 704 sets the priority of sound wave A lower than the priority of sound wave B.

Through the above processing, the broadcasting device 120 can change the priority of the sound wave B higher than the priority of the sound wave A by outputting the sound wave A representing the priority change ID.

[Fourth embodiment]
FIG. 12 is a flowchart illustrating an example of processing of the terminal device according to the fourth embodiment. This processing shows an example of processing in which the terminal device 110 lowers the priority of the ID stored in the identification information 711 of the storage unit 708 over time. This process is continuously and repeatedly executed by the terminal device 110 .

In step S1201, the determination unit 703 of the terminal device 110 determines whether or not the ID stored in the identification information 711 of the storage unit 708 has been updated. If the ID has been updated, the determination unit 703 starts time counting in step S1202. On the other hand, if the ID has not been updated, the determination unit 703 causes the process to proceed to step S1203.

After moving to step S1203, the determination unit 703 determines whether the priority of the ID stored in the identification information 711 of the storage unit 708 is the lowest. If the ID has the lowest priority, the determination unit 703 terminates the processing of FIG. 12 . On the other hand, if the ID priority is not the lowest, the determination unit 703 causes the process to proceed to step S1204.

After shifting to step S1204, the determination unit 703 determines whether or not a predetermined time has elapsed since the ID stored in the identification information 711 of the storage unit 708 was updated. If the predetermined time has not elapsed, the determination unit 703 terminates the processing of FIG. 12 . On the other hand, if the predetermined time has passed, the determination unit 703 causes the process to proceed to step S1205.

After moving to step S<b>1205 , the determination unit 703 lowers the priority of the ID stored in the identification information 711 of the storage unit 708 .

In step S1206, the determining unit 703 starts counting time.

Through the above process, the information processing system 100 lowers the priority of the ID stored in the identification information 711 of the storage unit 708 over time, and sends information with high priority to the terminal device 110 for a predetermined period of time. Only, it will be possible to display preferentially.

[Fifth Embodiment]
FIG. 13 is a diagram illustrating an example of processing of a terminal device according to the fifth embodiment; This processing shows an example of processing executed when the terminal device 110 extracts an ID for ID deletion. In FIG. 13, the processes of steps S1001 to S1006, S1007, and S1008 are the same as those of the second embodiment described with reference to FIG. I do.

When the process proceeds from step S1002 or step S1005 to step S1301, the deletion unit 705 of the terminal device 110 determines whether the extracted ID is an ID for ID deletion. For example, the deletion unit 705 refers to the processing information 712A in FIG. 8A, and when the extracted ID is ID1 "002", determines that it is an ID for ID deletion.

If the extracted ID is not the ID for ID deletion, the deletion unit 705 shifts the process to step S1007. On the other hand, if the extracted ID is an ID for ID deletion, the deletion unit 705 deletes the sound wave type and the ID stored in the identification information 711 of the storage unit 708 in step S1302.

By the above processing, the broadcasting device 120 outputs the sound wave A representing the ID for deleting the ID, so that, for example, the display of the information preferentially displayed on the terminal device 110 can be terminated at an arbitrary timing. will be able to

As described above, according to each embodiment of the present invention, in the information processing system 100 that displays predetermined information on the terminal device 110 using sound waves, predetermined information is displayed on the terminal device 110 using a plurality of different sound waves. easier to display.

<Supplement>
Each function of the embodiments described above may be implemented by one or more processing circuits. Here, the "processing circuit" in this specification means a processor programmed by software to perform each function, such as a processor implemented by an electronic circuit, or a processor designed to perform each function described above. ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays) and devices such as conventional circuit modules.

100 information processing system 110 terminal device 120 broadcasting device (first sound wave output device)
130 sonic beacon (an example of a second sonic output device)
140 digital signage (another example of the second sound wave output device)
702A first extraction unit 702B second extraction unit 703 determination unit 704 change unit 705 deletion unit 706 display control unit 708 storage unit 721 system control unit

JP 2016-127027 A

Claims (7)

A terminal device that displays predetermined information based on identification information represented by acquired sound waves,
a first extraction unit for extracting the first identification information from a first sound wave representing the first identification information in a first frequency band;
a second extraction unit for extracting the second identification information from a second sound wave representing the second identification information in a second frequency band;
a determination unit that determines identification information indicating the predetermined information from the extracted first identification information or the second identification information based on the set priority;
has
the priority of the first sound wave is set higher than the priority of the second sound wave;
When the first identification information and the second identification information are extracted, the determination unit determines the first identification information as identification information indicating the predetermined information,
The first identification information includes identification information for changing the priority,
The terminal device has a changing unit that changes the priority of the first sound wave to be lower than the priority of the second sound wave when identification information for changing the priority is extracted.
Terminal equipment. A terminal device that displays predetermined information based on identification information represented by acquired sound waves,
a first extraction unit for extracting the first identification information from a first sound wave representing the first identification information in a first frequency band;
a second extraction unit for extracting the second identification information from a second sound wave representing the second identification information in a second frequency band;
a determination unit that determines identification information indicating the predetermined information from the extracted first identification information or the second identification information based on the set priority;
a storage unit that stores identification information indicating the predetermined information determined by the determination unit;
a display control unit that causes a display unit to display the predetermined information in accordance with identification information that indicates the predetermined information stored in the storage unit;
has
If the identification information having a higher priority than the identification information extracted by the first extraction unit and the second extraction unit is stored in the storage unit, the determination unit performs the first extraction unit and A terminal device that discards the identification information extracted by the second extraction unit. 3. The terminal according to claim 2 , wherein said determining unit lowers the priority of the identification information stored in said storage unit when a predetermined time has elapsed since said identification information with high priority was stored in said storage unit. Device. The first identification information includes identification information for deleting the identification information stored in the storage unit,
4. The terminal device according to claim 2, further comprising a deletion unit that deletes the identification information stored in the storage unit when the identification information for deleting the identification information stored in the storage unit is extracted. Terminal equipment. The first sound wave includes a broadcast sound wave broadcast within a predetermined facility or venue,
5. The terminal device according to any one of claims 1 to 4 , wherein said second sound wave includes a sound wave output in a partial area within said predetermined facility or hall. A terminal device for displaying predetermined information based on identification information represented by acquired sound waves, a first sound wave output device for outputting a first sound wave representing the first identification information in a first frequency band, and a second a second sound wave output device that outputs a second sound wave representing the second identification information in the frequency band of
The terminal device
a first extraction unit that extracts the first identification information from the first sound wave;
a second extraction unit that extracts the second identification information from the second sound wave;
a determination unit that determines identification information indicating the predetermined information from the extracted first identification information or the second identification information based on the set priority;
has
The first sound wave output device is
Using the first identification information, having a system control unit that controls the setting of the priority,
Information processing system. A terminal device for displaying predetermined information based on identification information represented by acquired sound waves, a first sound wave output device for outputting a first sound wave representing the first identification information in a first frequency band, and a second and a second sound wave output device that outputs a second sound wave representing the second identification information in the frequency band of
The terminal device
a process of extracting the first identification from a first sound wave representing the first identification in a first frequency band;
a process of extracting the second identification from a second sound wave representing the second identification in a second frequency band;
a process of determining identification information indicating the predetermined information from the extracted first identification information or the second identification information based on the set priority;
and run
The first sound wave output device is
Using the first identification information, executing a process for controlling the setting of the priority;
Information processing methods.

Images