JP2024084062A - Electronic device, provision device and provision system - Google Patents

Abstract

[Problem] To provide an improved technology for providing information to a user. [Solution] An electronic device includes a directional communication unit, a sensor unit that detects the movement of the user's head, and a control unit. When the control unit determines that the user is in a gaze state based on the detection result of the sensor unit, it provides the user with information based on a signal received by the communication unit from an object in the direction the user is gazing at. [Selected Figure] Figure 2

Description

The present disclosure relates to electronic devices, provision devices, and provision systems.

Technologies for providing information to a user are known. For example, Patent Document 1 describes an information processing device that includes a control unit that controls the information sent by other users in the user's vicinity to be presented to the user by voice.

International Publication No. 2018/180024

Conventional techniques leave room for improvement. For example, a user may not want to be provided with information if the content of that information does not interest them.

In light of these circumstances, the objective of this disclosure is to provide improved technology for providing information to users.

An electronic device according to an embodiment of the present disclosure includes:
A communication unit having directionality;
A sensor unit that detects the movement of the user's head;
a control unit that, when it is determined that the user is in a gazing state based on a detection result of the sensor unit, provides the user with information based on a signal received by the communication unit from an object in a direction in which the user is gazing;
Equipped with.

According to one embodiment of the present disclosure, a delivery device includes:
A communication unit having directionality;
a control unit that, when receiving a carrier signal including user identification information by the communication unit, stores the user identification information and transmits a response signal to the carrier signal by the communication unit;
Equipped with.

A provision system according to an embodiment of the present disclosure includes:
an electronic device that, when it is determined that the user is in a gaze state based on a detection result of a movement of the user's head, transmits a carrier signal including identification information of the user by a first communication unit having directionality;
a providing device that, when the carrier signal is received by a second communication unit having directionality, stores identification information of the user and transmits a response signal to the carrier signal by the second communication unit;
including.

According to one embodiment of the present disclosure, an improved technique for providing information to a user can be provided.

FIG. 1 is a diagram illustrating an overview of a provision system according to an embodiment of the present disclosure. FIG. 2 is a block diagram of the provision system shown in FIG. 1 . 3 is a flowchart showing a procedure of an ultrasonic signal receiving process executed by the providing device shown in FIG. 2 . 3 is a flowchart showing a procedure of a carrier signal transmission process executed by the electronic device shown in FIG. 2 . 3 is a flowchart showing a procedure of an ultrasonic signal reception process executed by the electronic device shown in FIG. 2 . 3 is a sequence diagram showing an operation of the provision system shown in FIG. 2.

Embodiments of the present disclosure are described below with reference to the drawings.

(Configuration of the provision system)
1, the provision system 1 includes a provision device 10 and an electronic device 20. In this embodiment, the provision system 1 includes one provision device 10 and one electronic device 20. However, the provision system 1 may include any number of provision devices 10 and electronic devices 20.

The providing device 10 and the electronic device 20 are capable of performing acoustic communication. The acoustic communication according to this embodiment is communication using ultrasonic waves as a transmission medium. The ultrasonic waves are, for example, sounds in a frequency band of 18 kHz or more. In acoustic communication, ultrasonic waves in a frequency band of 18 kHz-22 kHz may be used, or ultrasonic waves in a frequency band of 22 kHz or more may be used. In the transmission protocol for acoustic communication, a digital modulation method such as minimum shift keying (MSK) or phase shift keying (PSK) may be used.

The providing device 10 is, for example, a guide board. However, the providing device 10 may also be a signboard. The providing device 10 is located outdoors. However, the providing device 10 may also be located indoors, such as in a museum. The providing device 10 is, for example, in the shape of a plate. The providing device 10 has two sides. Guidance information is written on one side of the providing device 10. The guidance information is, for example, a map of the surrounding area, information about the surrounding area, or information about exhibits in the surrounding area.

In the following, "forward of the providing device 10" means the direction from the one of the two faces of the providing device 10 on which no guidance information is displayed to the one on which guidance information is displayed.

The providing device 10 can transmit an ultrasonic signal in front of the providing device 10. The providing device 10 can receive an ultrasonic signal from in front of the providing device 10.

The electronic device 20 can be worn on the user's head. The electronic device 20 may be a wearable device that can be worn on the user's head. In this embodiment, the electronic device 20 is a hearable device, which is a type of wearable device. However, as long as the electronic device 20 can be worn on the user's head and can provide information to the user, it is not limited to a hearable device, as described below. The electronic device 20 may be a headphone-type hearable device as shown in FIG. 1, or an earphone-type hearable device.

In the following, "the front of the electronic device 20" means the direction that corresponds to the direction in which the user's face faces when the electronic device 20 is worn on the user's head. The direction in which the user's face faces may correspond to the user's line of sight.

The electronic device 20 can transmit ultrasonic signals to the front of the electronic device 20. The electronic device 20 can receive ultrasonic signals from the front of the electronic device 20.

The electronic device 20 holds information associating the unique ID of each of the multiple providing devices 10 with the sound data of each of the multiple providing devices 10. The unique ID of the providing device 10 is identification information of the providing device 10 that can uniquely identify the providing device 10.

The provision system 1 can provide information about the provision device 10 by voice to a user who is interested in the guidance information of the provision device 10, for example. This process is briefly explained below.

For example, if the user is interested in the guidance information of the providing device 10, the user stops in front of the providing device 10. The user who stops in front of the providing device 10 stares at the guidance information of the providing device 10.

When the electronic device 20 determines that the user is in a gaze state, it transmits a carrier signal including the user's identification information to the front of the electronic device 20. The carrier signal is a signal that carries the user's identification information. Hereinafter, the user's identification information is assumed to be a one-time password.

The providing device 10 may receive a carrier signal from the front of the providing device 10. When the providing device 10 receives the carrier signal, it stores the one-time password contained in the carrier signal. After storing the one-time password, the providing device 10 transmits a response signal to the front of the providing device in response to the carrier signal.

After transmitting the carrier signal, the electronic device 20 may receive a response signal from the front of the electronic device 20. When the electronic device 20 receives the response signal, it notifies the user that information about the providing device 10 can be provided. With this notification, the user may know that it is possible to hear information about the providing device 10 by audio. Furthermore, the electronic device 20 transmits a request signal to the front of the electronic device 20 requesting the unique ID of the providing device 10.

Here, if the user wishes to hear information about the providing device 10 by voice, the user continues to stare at the providing device 10. If the user continues to stare at the providing device 10, the request signal transmitted by the electronic device 20 reaches the providing device 10. On the other hand, if the user is not interested in information about the providing device 10, the user moves away from in front of the providing device 10 or turns his head. If the user moves away from in front of the providing device 10, the request signal transmitted by the electronic device 20 to the front of the electronic device 20 does not reach the providing device 10.

When the providing device 10 receives a request signal from the electronic device 20, it transmits a unique signal including the unique ID as an ultrasonic signal in front of the providing device 10. When the electronic device 20 receives the unique signal, it extracts the unique ID from the unique signal. The electronic device 20 plays back the sound data of the providing device 10 that is associated with the extracted unique ID from the sound data of the providing device 10 that it holds. With this configuration, the user can listen to the sound data of the providing device 10 in front of the user.

(Configuration of the provided device)
2, the providing device 10 includes a communication unit 11, a storage unit 14, and a control unit 15. The communication unit 11 is also referred to as a second communication unit.

The communication unit 11 has directionality. The communication unit 11 has directionality in which the strength of the ultrasonic signal transmitted and received in front of the providing device 10 is stronger than in other directions. The communication unit 11 is configured to include at least one communication module capable of performing acoustic communication. In this embodiment, the communication unit 11 includes a speaker unit 12 and a microphone unit 13.

The speaker unit 12 includes at least one speaker capable of outputting ultrasonic waves. The speaker unit 12 includes, for example, a directional speaker or a parametric speaker.

The speaker unit 12 transmits an ultrasonic signal. The speaker unit 12 is located in a portion of the providing device 10 that is capable of transmitting an ultrasonic signal toward the front of the providing device 10 as shown in FIG. 1. The speaker unit 12 is positioned so as to have a directivity such that the strength of the ultrasonic signal transmitted toward the front of the providing device 10 is stronger than in other directions.

The microphone unit 13 includes at least one microphone capable of collecting ultrasonic waves. The microphone unit 13 includes, for example, a multi-microphone or a directional microphone capable of collecting ultrasonic waves by beamforming. The microphone unit 13 may include a unidirectional microphone or a superdirectional microphone.

The microphone unit 13 receives ultrasonic signals by collecting ultrasonic waves. The microphone unit 13 is located in a portion of the providing device 10 that can receive ultrasonic signals from the front of the providing device 10 as shown in FIG. 1. The microphone unit 13 is positioned so as to have a directivity such that the strength of ultrasonic signals received from the front of the providing device 10 is stronger than in other directions. By configuring the microphone unit 13 to include a multi-microphone or a directional microphone, it is possible to limit the range in front of the providing device 10 in which the microphone unit 13 can receive ultrasonic signals.

The storage unit 14 is configured to include at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The RAM is, for example, an SRAM (Static Random Access Memory) or a DRAM (Dynamic Random Access Memory). The ROM is, for example, an EEPROM (Electrically Erasable Programmable Read Only Memory). The storage unit 14 may function as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 14 stores data used in the operation of the providing device 10 and data obtained by the operation of the providing device 10.

The control unit 15 is configured to include at least one processor, at least one dedicated circuit, or a combination of these. The processor is, for example, a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 15 executes processes related to the operation of the providing device 10 while controlling each part of the providing device 10.

The control unit 15 receives an ultrasonic signal through the microphone unit 13. This ultrasonic signal is either a carrier signal or a request signal from the electronic device 20 located in front of the providing device 10. To determine whether the received ultrasonic signal is either a carrier signal or a request signal, the control unit 15 extracts a one-time password from the ultrasonic signal. The control unit 15 determines whether the extracted one-time password matches any of the one-time passwords stored in the memory unit 14.

When the control unit 15 determines that the extracted one-time password does not match any of the one-time passwords stored in the storage unit 14, it determines that the received ultrasonic signal is a carrier signal. As described above, since the carrier signal is a signal that carries a one-time password, the one-time password contained in the carrier signal is not stored in the storage unit 14 before the carrier signal is received. When the control unit 15 determines that the received ultrasonic signal is a carrier signal, it stores the received ultrasonic signal, i.e., the one-time password extracted from the carrier signal, in the storage unit 14. After storing the one-time password, the control unit 15 generates a response signal in response to the received carrier signal. The control unit 15 includes the one-time password extracted from the received carrier signal in the response signal. The control unit 15 causes the speaker unit 12 to transmit the generated response signal as an ultrasonic signal. The speaker unit 12 transmits the response signal to the front of the providing device 10. The control unit 15 may turn on the power of the speaker unit 12 only when transmitting the response signal. With this configuration, the power consumption of the providing device 10 can be reduced.

When the control unit 15 determines that the extracted one-time password matches any one of the one-time passwords stored in the storage unit 14, it determines whether the received ultrasonic signal is a request signal. For example, when the received ultrasonic signal includes a response signal that has already been transmitted, the control unit 15 determines that the received ultrasonic signal is a request signal. When the control unit 15 determines that the received ultrasonic signal is a request signal, it generates a unique signal including the unique ID of the providing device 10. The control unit 15 may include the one-time password extracted from the request signal in the unique signal. The control unit 15 causes the speaker unit 12 to transmit the generated unique signal as an ultrasonic signal. The speaker unit 12 transmits the unique signal to the front of the providing device 10. The control unit 15 may turn on the power of the speaker unit 12 only when transmitting the unique signal. With this configuration, the power consumption of the providing device 10 can be reduced.

(Configuration of Electronic Device)
2, the electronic device 20 includes a communication unit 21, a communication unit 22, an input unit 25, a speaker unit 26, a positioning unit 27, a sensor unit 28, a vibration unit 29, a storage unit 30, and a control unit 31. The communication unit 22 is also referred to as a first communication unit.

The communication unit 21 includes at least one communication module that can be connected to any network, including a mobile communication network and the Internet. The communication module is, for example, a communication module that supports mobile communication standards such as LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation).

The communication unit 22 has directionality. The communication unit 22 has a directionality in which the strength of the ultrasonic signal transmitted and received in front of the electronic device 20 is stronger than in other directions. When the electronic device 20 is worn on the user's head, the communication unit 22 may have a directionality in which the strength of the ultrasonic signal transmitted and received in the direction in which the user's face is facing, i.e., the user's line of sight, is stronger than in other directions. The communication unit 22 is configured to include at least one communication module capable of performing acoustic communication. In this embodiment, the communication unit 22 includes a speaker unit 23 and a microphone unit 24.

The speaker unit 23 includes at least one speaker capable of outputting ultrasonic waves. The speaker unit 23 includes, for example, a directional speaker or a parametric speaker.

The speaker unit 23 transmits ultrasonic signals. The speaker unit 23 is located in a portion of the electronic device 20 that is capable of transmitting ultrasonic signals toward the front of the electronic device 20 as shown in FIG. 1. The speaker unit 23 is positioned so as to have directivity such that the strength of the ultrasonic signal transmitted to the front of the electronic device 20 is stronger than in other directions.

The microphone unit 24 includes at least one microphone capable of collecting ultrasonic waves. The microphone unit 24 includes, for example, a multi-microphone or a directional microphone capable of collecting ultrasonic waves by beamforming. The microphone unit 24 may include a unidirectional microphone or a superdirectional microphone.

The microphone unit 24 receives ultrasonic signals. The microphone unit 24 is located in a portion of the electronic device 20 that can receive ultrasonic signals from the front of the electronic device 20 as shown in FIG. 1. The microphone unit 24 is arranged to have a directivity such that the strength of the ultrasonic signal received from the front of the electronic device 20 is stronger than in other directions. By configuring the microphone unit 24 to include a multi-microphone or a directional microphone, the range in front of the electronic device 20 in which the microphone unit 24 can receive ultrasonic signals can be limited. Here, when the user moves or the user's head moves, a Doppler effect may occur in the ultrasonic signal received by the microphone unit 24. Therefore, the microphone unit 24 may be configured to allow a frequency change of, for example, ±5% with respect to a preset frequency for the frequency of the ultrasonic signal to be received.

The input unit 25 is capable of accepting input from a user. The input unit 25 is configured to include at least one input interface capable of accepting input from a user. The input interface is, for example, a physical key or a capacitance key.

The speaker unit 26 includes at least one speaker capable of outputting audible sound. The speaker unit 26 includes, for example, a stereo speaker.

The speaker unit 26 is located in a portion of the electronic device 20 that is capable of outputting audible sounds to the user. For example, the stereo speakers of the speaker unit 26 include a left speaker and a right speaker. The left speaker is located in a left ear pad of the electronic device 20. The right speaker is located in a right ear pad of the electronic device 20.

The positioning unit 27 is capable of acquiring position information of the electronic device 20. The positioning unit 27 is configured to include at least one receiving module compatible with a satellite positioning system. The receiving module is, for example, a receiving module compatible with GPS (Global Positioning System). However, the receiving module is not limited to this. The receiving module may be a receiving module compatible with any satellite positioning system.

The sensor unit 28 includes at least one sensor capable of detecting the movement of the electronic device 20. When the electronic device 20 is worn on the user's head, the sensor unit 28 can detect the movement of the user's head as the movement of the electronic device 20. The movement of the user's head detected by the sensor unit 28 is, for example, the orientation of the user's head, the acceleration or speed of the user's head, etc. The sensor unit 28 includes, for example, an inertial sensor.

The vibration unit 29 is capable of vibrating the electronic device 20. The vibration unit 29 is configured to include a vibration element such as a piezoelectric element.

The storage unit 30 is configured to include at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a RAM or a ROM. The RAM is, for example, an SRAM or a DRAM. The ROM is, for example, an EEPROM. The storage unit 30 may function as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 30 stores data used in the operation of the electronic device 20 and data obtained by the operation of the electronic device 20.

The storage unit 30 stores, for example, map information. The map information includes location information of the providing device 10.

The control unit 31 is configured to include at least one processor, at least one dedicated circuit, or a combination of these. The processor is, for example, a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA or ASIC. The control unit 31 executes processes related to the operation of the electronic device 20 while controlling each part of the electronic device 20.

<Acquisition process of sound data from the provided device>
The control unit 31 acquires the position information of the electronic device 20 by the positioning unit 27. Since the user is wearing the electronic device 20, the position information of the electronic device 20 can be regarded as the position information of the user.

When the control unit 31 acquires the location information of the electronic device 20, the control unit 31 receives the unique IDs and sound data of the providing devices 10 that are within a predetermined range from the location of the electronic device 20, i.e., the user's location, from an external server via the network through the communication unit 21. The predetermined range may be set based on the density of the providing devices 10 installed in the area. The predetermined range is, for example, a range of 1 [km]-2 [km]. The control unit 31 associates the received unique IDs of the providing devices 10 with the sound data and stores them in the memory unit 30.

The control unit 31 may update the unique ID and sound data of the providing device 10 in the storage unit 30 by acquiring the location information of the electronic device 20 and receiving the unique ID and sound data of the providing device 10 at predetermined time intervals. The predetermined time may be set based on the walking speed of the user.

<Transmission process of carrier signal>
The control unit 31 acquires the detection result of the sensor unit 28 from the sensor unit 28. The control unit 31 determines whether or not the user is in a gaze state based on the detection result of the sensor unit 28. When the electronic device 20 is worn on the user's head, the detection result of the sensor unit 28 can be the detection result of the movement of the user's head.

As an example, the control unit 31 may determine that the user is in a gazing state when it determines, based on the detection result of the sensor unit 28, that the direction of the user's face is within a predetermined range equal to or greater than the first time threshold. The first time threshold may be set based on an estimated time for which a person gazes at an object. The predetermined range may be set based on an estimated range within which the direction of the person's face changes while the person gazes at an object.

As another example, the control unit 31 may determine that the user is in a gazing state when it determines, based on the detection result of the sensor unit 28, that the user's head is in a stationary state for a period of time equal to or longer than a second time threshold. The second time threshold may be set based on an estimated time for which a person gazes at an object.

When the control unit 31 determines that the user is in the gaze state, it generates a one-time password. The control unit 31 may generate the one-time password based on the current time. For example, the control unit 31 may generate the one-time password by combining information unique to the user with the current time. The control unit 31 may generate the one-time password by converting the current time into ultrasonic band information unique to the user.

When the control unit 31 generates the one-time password, it generates a carrier signal that carries the one-time password. In other words, the carrier signal includes the one-time password.

When the control unit 31 generates the carrier signal, it causes the speaker unit 23 to transmit the carrier signal as an ultrasonic signal. The speaker unit 23 transmits the carrier signal toward the front of the electronic device 20. The carrier signal is transmitted toward the front of the electronic device 20, and when the electronic device 20 is worn on the user's head, the carrier signal is transmitted in the direction of the user's line of sight.

<Ultrasonic signal reception processing>
When the control unit 31 transmits the carrier signal, it starts a process of receiving an ultrasonic signal. The received ultrasonic signal is a response signal or a unique signal from the providing device 10 located in front of the electronic device 20, i.e., in the direction in which the user's face faces.

When the control unit 31 receives an ultrasonic signal within a set time after transmitting a carrier signal, the control unit 31 extracts a one-time password from the received ultrasonic signal. The set time may be set based on the estimated time that a user will continue to gaze at one providing device 10. The set time is, for example, 5 seconds. The control unit 31 determines whether the extracted one-time password matches the one-time password that was generated when the carrier signal was generated. If the extracted one-time password matches the one-time password that was generated, the received ultrasonic signal becomes an ultrasonic signal transmitted by the providing device 10 that received the carrier signal from the electronic device 20. Therefore, when the control unit 31 determines that the extracted one-time password matches the one-time password that was generated, the control unit 31 determines whether the received ultrasonic signal is a response signal or a unique signal. As described below, the control unit 31 executes different processes depending on whether the received ultrasonic signal is a response signal or a unique signal.

<<Processing of response signals>>
When the control unit 31 determines that the received ultrasonic signal is a response signal, it notifies the user that information on the providing device 10 can be provided. As an example, the control unit 31 may notify the user that information on the providing device 10 can be provided by vibrating the electronic device 20 using the vibration unit 29. As another example, the control unit 31 may notify the user that information on the providing device 10 can be provided by outputting a sound effect from the speaker unit 26. With this configuration, the user can know that information on the providing device 10 can be heard by audio. When the user wants to hear information on the providing device 10 by audio, the user continues to stare at the providing device 10. On the other hand, when the user is not interested in information on the providing device 10, the user moves away from the front of the providing device 10 or turns his/her head.

After notifying the user, the control unit 31 generates a request signal. As described above, the request signal is a signal requesting the unique ID of the providing device 10. The control unit 31 may include in the request signal the one-time password that was generated when the conveying signal was generated. The control unit 31 may generate the request signal in response to the response signal. For example, the control unit 31 generates the request signal in response to the response signal by including in the request signal the response signal received from the providing device 10.

The control unit 31 outputs the generated request signal as an ultrasonic signal to the speaker unit 23. The request signal is transmitted by the speaker unit 23 in the direction in which the user's face is facing. Here, if, after notifying the user, the user wants to hear information about the providing device 10 by voice and continues to stare at the providing device 10, the request signal reaches the providing device 10 located in the direction in which the user's face is facing. On the other hand, if the user is not interested in information about the providing device 10 and the user moves away from in front of the providing device 10 or changes the direction of his or her head, the request signal does not reach the providing device 10.

<<Processing of Intrinsic Signals>>
When the control unit 31 determines that the received ultrasonic signal is a unique signal, it extracts a unique ID from the unique signal. After extracting the unique ID, the control unit 31 acquires sound data associated with the unique ID from the storage unit 30. After acquiring the sound data, the control unit 31 causes the speaker unit 26 to output the acquired sound data. With this configuration, the user can hear guidance information corresponding to the providing device 10 as sound.

(Operation of the provided device)
Fig. 3 is a flowchart showing a procedure of an ultrasonic signal receiving process executed by the providing device 10 shown in Fig. 2. When an ultrasonic signal is transmitted from the electronic device 20 to the providing device 10, the control unit 15 starts the process of step S1.

The control unit 15 receives the ultrasonic signal through the microphone unit 13 (step S1).

The control unit 15 extracts the one-time password from the received ultrasonic signal. The control unit 15 determines whether the extracted one-time password matches any one of the one-time passwords already stored in the memory unit 14 (step S2). If the control unit 15 determines that the extracted one-time password does not match any one of the one-time passwords already stored in the memory unit 14 (step S2: NO), the control unit 15 proceeds to processing in step S3. On the other hand, if the control unit 15 determines that the extracted one-time password matches any one of the one-time passwords already stored in the memory unit 14 (step S2: YES), the control unit 15 proceeds to processing in step S6.

In step S3, the control unit 15 stores the one-time password extracted from the ultrasonic signal, i.e., the carrier signal, received in step 1 in the memory unit 14.

In the process of step S4, the control unit 15 generates a response signal in response to the carrier signal. In the process of step S5, the control unit 15 causes the speaker unit 12 to transmit the response signal generated in the process of step S4 as an ultrasonic signal.

In the process of step S6, the control unit 15 determines whether or not the ultrasonic signal received in the process of step S1 is a request signal. If the control unit 15 determines that the received ultrasonic signal is a request signal (step S6: YES), the control unit 15 proceeds to the process of step S7. On the other hand, if the control unit 15 determines that the received ultrasonic signal is not a request signal (step S6: NO), the control unit 15 ends the ultrasonic signal reception process.

In the process of step S7, the control unit 15 generates a unique signal. In the process of step S8, the control unit 15 causes the speaker unit 12 to transmit the unique signal generated in the process of step S7 as an ultrasonic signal.

Here, in the process of step S2, if the control unit 15 determines that the extracted one-time password matches any one of the one-time passwords already stored in the storage unit 14, it may obtain the storage time of the stored one-time password. The storage time of the one-time password is, for example, the time from when the one-time password is stored in the storage unit 14 to when the process of step S2 is executed. The control unit 15 may determine whether the storage time of the acquired stored one-time password is equal to or longer than a specified time. The specified time may be set according to the application of the providing device 10. If the control unit 15 determines that the storage time of the acquired stored one-time password is equal to or longer than the specified time, it may consider that the extracted one-time password does not match any one-time password already stored in the storage unit 14 (step S2: NO). In this case, the control unit 15 proceeds to the process of step S3. On the other hand, if the control unit 15 determines that the storage time of the acquired stored one-time password is shorter than the specified time, it may proceed to the process of step S6.

In the processing of step S3, the control unit 15 may delete one-time passwords stored in the memory unit 14 that have been stored for a specified period of time or longer.

(Operation of electronic devices)
Fig. 4 is a flowchart showing the procedure of the carrier signal transmission process executed by the electronic device shown in Fig. 2. When the control unit 31 receives an input for turning on the power supply of the electronic device 20 via the input unit 25, the control unit 31 starts the process of step S11.

The control unit 31 acquires the detection result of the sensor unit 28 from the sensor unit 28 (step S11). The control unit 31 determines whether the user is in a gaze state based on the detection result of the sensor unit 28 (step S12).

If the control unit 31 determines that the user is in a gazing state (step S12: YES), the control unit 31 proceeds to the process of step S13. If the control unit 31 determines that the user is not in a gazing state (step S12: NO), the control unit 31 returns to the process of step S11.

In step S13, the control unit 31 generates a one-time password.

In step S14, the control unit 31 generates a carrier signal including the one-time password generated in step S13.

In the process of step S15, the control unit 31 causes the speaker unit 23 to output the carrier signal generated in the process of step S14 as an ultrasonic signal.

Figure 5 is a flowchart showing the procedure of the ultrasonic signal reception process executed by the electronic device 20 shown in Figure 2. After processing step S15 as shown in Figure 4, the control unit 31 starts processing step S21.

The control unit 31 determines whether or not an ultrasonic signal has been received by the microphone unit 24 (step S21). If the control unit 31 does not determine that an ultrasonic signal has been received (step S21: NO), the control unit 31 proceeds to processing of step S22. On the other hand, if the control unit 31 determines that an ultrasonic signal has been received (step S21: YES), the control unit 31 proceeds to processing of step S23.

In the process of step S22, the control unit 31 determines whether or not a set time has elapsed since the carrier signal was transmitted in the process of step S15 as shown in FIG. 4. If the control unit 31 determines that the set time has elapsed since the carrier signal was transmitted (step S22: YES), the control unit 31 ends the ultrasonic signal reception process. On the other hand, if the control unit 31 does not determine that the set time has elapsed since the carrier signal was transmitted (step S22: NO), the control unit 31 returns to the process of step S21.

In the process of step S23, the control unit 31 extracts a one-time password from the ultrasonic signal received in the process of step S21. The control unit 31 determines whether the extracted one-time password matches the one-time password already generated in the process of step S13 as shown in FIG. 4.

If the control unit 31 determines that the extracted one-time password matches the one-time password that has already been generated (step S23: YES), the control unit 31 proceeds to the process of step S24. On the other hand, if the control unit 31 determines that the extracted one-time password does not match the one-time password that has already been generated (step S23: NO), the control unit 31 returns to the process of step S21.

In the process of step S24, the control unit 31 determines whether or not the ultrasonic signal received in the process of step S21 is a response signal. If the control unit 31 determines that the ultrasonic signal received in the process of step S21 is a response signal (step S24: YES), the control unit 31 proceeds to the process of step S25. If the control unit 31 determines that the ultrasonic signal received in the process of step S21 is not a response signal, i.e., is a unique signal (step S24: NO), the control unit 31 proceeds to the process of step S28.

In the processing of step S25, the control unit 31 notifies the user that information about the providing device 10 can be provided.

In the process of step S26, the control unit 31 generates a request signal. In the process of step S27, the control unit 31 causes the speaker unit 23 to output the request signal generated in the process of step S26 as an ultrasonic signal. After the process of step S27, the control unit 31 returns to the process of step S21.

After the processing of step S25, if the user wants to listen to the sound data of the providing device 10 and continues to stare at the providing device 10, the request signal transmitted in the processing of step S27 reaches the providing device 10 in front of the user. If the user moves away from in front of the providing device 10 or changes the direction of his or her head after the processing of step S25, the request signal transmitted in the processing of step S27 does not reach the providing device 10.

In the process of step S28, the control unit 31 extracts the unique ID from the unique signal. In the process of step S29, the control unit 31 acquires sound data associated with the unique ID from the storage unit 30. In the process of step S30, the control unit 31 causes the speaker unit 26 to output the sound data acquired in the process of step S29.

The control unit 31 may execute the processes of steps S11 to S15 in parallel with the processes of steps S21 to S30. In this case, while the control unit 31 is causing the speaker unit 26 to output sound data in the process of step S30, the control unit 31 may acquire sound data of a new providing device 10 in step S29. When the control unit 31 acquires sound data of a new providing device 10 in step S29, the control unit 31 may cause the speaker unit 26 to output the sound data of the new providing device 10.

(Operation of the provision system)
FIG. 6 is a sequence diagram showing the operation of the provision system 1 shown in FIG.

When the electronic device 20 determines that the user is in a gaze state, it transmits a carrier signal (step S41). When the providing device 10 receives the carrier signal, it transmits a response signal (step S42). When the electronic device 20 receives the response signal, it transmits a request signal (step S43). When the providing device 10 receives the request signal, it transmits a unique signal (step S44).

In this way, in the electronic device 20 according to the present embodiment, when the control unit 31 determines that the user is in a gazing state based on the detection result of the sensor unit 28, it presents to the user information based on a signal received by the communication unit 22 from an object in the direction of the user's gaze. For example, the control unit 31 provides information to the user by outputting sound data of the providing device 10 as an object to the user based on a unique signal received by the directional microphone unit 24. With this configuration, when the user is gazing at the providing device 10, information about the providing device 10 can be provided to the user. In other words, information about the providing device 10 to which the user is visually paying attention can be provided to the user. With this configuration, it is possible to improve the convenience of the user. In addition, it is possible to reduce the possibility that information about the providing device 10 to which the user is not visually paying attention is provided to the user. As a result, it is possible to reduce the possibility that the user will feel annoyed.

Therefore, according to this embodiment, it is possible to provide an improved technique for providing information to a user.

Furthermore, in the electronic device 20 according to this embodiment, when the control unit 31 determines that the user is in a gazing state based on the detection result of the sensor unit 28, the control unit 31 may transmit a carrier signal including the user's identification information by the communication unit 22. By including the user's identification information in the carrier signal, the providing device 10 and the electronic device 20 can include the user's identification information in the ultrasonic signal they transmit and receive. For example, the providing device 10 can include a one-time password as the user's identification information in the response signal and the unique signal. The electronic device 20 can include a one-time password as the user's identification information in the request signal. With this configuration, when ultrasonic signals are transmitted and received between multiple providing devices 10 and multiple electronic devices 20, the possibility of ultrasonic signals becoming confused can be reduced, as described below.

For example, the provision system 1 includes provision devices 10A and 10B as the multiple provision devices 10, and electronic devices 20A and 20B as the multiple electronic devices 20. Also, it is assumed that a user 2A of the electronic device 20A gazes at the provision device 10A, and a user 2B of the electronic device 20B gazes at the provision device 10B. When the electronic device 20A determines that the user 2A is in a gaze state, it transmits a carrier signal 3A including the identification information of the user 2A. When the electronic device 20B determines that the user 2B is in a gaze state, it transmits a carrier signal 3B including the identification information of the user 2B. When the provision device 10A receives the carrier signal 3A, it stores the identification information of the user 2A and transmits a response signal 4A including the identification information of the user 2A. Also, when the provision device 10B receives the carrier signal 3B, it stores the identification information of the user 2B and transmits a response signal 4B including the identification information of the user 2B. Here, even if the electronic device 20A receives both the response signals 4A and 4B, the response signal 4A includes the identification information of the user 2A, so that the electronic device 20A can transmit the request signal 5A in response to the response signal 4A. Also, even if the electronic device 20B receives both the response signals 4A and 4B, the response signal 4B includes the identification information of the user 2B, so that the electronic device 20B can transmit the request signal 5B in response to the response signal 4B. Even if the providing device 10A receives both the request signal 5A and the request signal 5B, the stored identification information of the user 2A matches the identification information of the user 2A included in the request signal 5A, so that the providing device 10A can transmit the unique signal 6A to the user 2A. Similarly, even if the providing device 10B receives both the request signal 5A and the request signal 5B, the stored identification information of the user 2B matches the identification information of the user 2B included in the request signal 5B, so that the providing device 10B can transmit the unique signal 6B to the user 2B. Even if the electronic device 20A receives both the unique signal 6A including the identification information of the user 2A and the unique signal 6B including the identification information of the user 2B, the unique signal 6A includes the identification information of the user 2A, and therefore the electronic device 20A can extract the unique ID of the providing device 10A included in the unique signal 6A. In other words, the electronic device 20A can provide information about the providing device 10A to the user 2A by voice using the unique ID of the providing device 10A. Similarly, even if the electronic device 20B receives both the unique signal 6A and the unique signal 6B, the electronic device 20B can provide information about the providing device 10B to the user 2B by voice using the unique ID of the providing device 10B included in the unique signal 6B.

In addition, in the electronic device 20 according to this embodiment, when the control unit 31 receives a response signal to the carrier signal by the communication unit 22, the control unit 31 may notify the user that information about the providing device 10 can be provided. Such a notification allows the user to know that information about the providing device 10 can be heard by voice. If the user wants to hear information about the providing device 10 by voice, the user continues to stare at the providing device 10. If the user continues to stare at the providing device 10, communication between the providing device 10 and the electronic device 20 continues, and as a result, the electronic device 20 can provide voice related to the providing device 10. On the other hand, if the user is not interested in information about the providing device 10, the user leaves in front of the providing device 10 or turns his/her head. If the user leaves in front of the providing device 10, communication between the providing device 10 and the electronic device 20 will not continue, and as a result, the electronic device 20 will not provide voice related to the providing device 10. With this configuration, the user can select whether or not to receive voice related to the providing device 10 based on his/her own actions. This improves the user's convenience.

In addition, in the electronic device 20 according to this embodiment, the control unit 31 may notify the user that information related to the providing device 10 can be provided by vibrating the electronic device 20 using the vibration unit 29. Here, some users may feel annoyed if the control unit 31 notifies the user that information related to the providing device 10 can be provided by using a sound effect every time the control unit 31 receives a response signal to the carrier signal. By notifying the user that information related to the providing device 10 can be provided by vibrating the electronic device 20, the possibility that the user will feel annoyed can be reduced.

In addition, in this embodiment, the communication between the providing device 10 and the electronic device 20 may be acoustic communication. Acoustic communication using ultrasonic signals has a narrower communication range than communication using electromagnetic signals. The narrower communication range can reduce the possibility that the carrier signal will reach other providing devices 10 that the user is not gazing at, in addition to the providing device 10 that the user is gazing at. As a result, the possibility that the electronic device 20 will provide information about a providing device 10 that the user is not gazing at by voice can be reduced.

Furthermore, in this embodiment, the user's identification information may be a one-time password. By using a one-time password as the user's identification information, the possibility of ultrasonic signal confusion can be further reduced when ultrasonic signals are transmitted and received between multiple providing devices 10 and multiple electronic devices 20.

In one embodiment, (1) an electronic device includes:
A communication unit having directionality;
A sensor unit that detects the movement of the user's head;
a control unit that, when it is determined that the user is in a gazing state based on a detection result of the sensor unit, provides the user with information based on a signal received by the communication unit from an object in a direction in which the user is gazing;
Equipped with.

(2) In the electronic device described in (1) above,
When the control unit determines that the user is in a gaze state, the control unit may transmit a carrier signal including identification information of the user by the communication unit.

(3) In the electronic device described in (1) or (2),
The control unit may receive a response signal to the carrier signal via the communication unit, and if the response signal includes identification information of the user, notify the user that information regarding a providing device can be provided.

(4) In the electronic device according to any one of (1) to (3),
Further comprising a vibration unit capable of vibrating the electronic device,
The control unit may notify a user that information related to the providing device can be provided by causing the vibration unit to vibrate the electronic device.

(5) In the electronic device according to any one of (1) to (4),
The control unit may transmit, via the communication unit, a request signal requesting identification information of the providing device.

(6) In the electronic device according to any one of (1) to (5),
When a unique signal including identification information of the user and identification information of the providing device is received by the communication unit, the control unit may play a sound associated with the identification information of the providing device.

(7) In the electronic device according to any one of (1) to (6),
The communication between the electronic device and the providing device may be acoustic communication.

(8) In the electronic device according to any one of (1) to (7),
The user identification information may be a one-time password.

(9) In the electronic device according to any one of (1) to (8),
The electronic device may be worn on the user's head.

In one embodiment, the (10) providing device comprises:
A communication unit having directionality;
a control unit that, when receiving a carrier signal including user identification information by the communication unit, stores the user identification information and transmits a response signal to the carrier signal by the communication unit;
Equipped with.

In one embodiment, (11) the providing system comprises:
an electronic device that, when it is determined that the user is in a gaze state based on a detection result of a movement of the user's head, transmits a carrier signal including identification information of the user by a first communication unit having directionality;
a providing device that, when the carrier signal is received by a second communication unit having directionality, stores identification information of the user and transmits a response signal to the carrier signal by the second communication unit;
including.

Although the present disclosure has been described based on the drawings and examples, it should be noted that a person skilled in the art can easily make various modifications or corrections based on the present disclosure. Therefore, it should be noted that these modifications or corrections are included in the scope of the present disclosure. For example, the functions, etc. included in each functional unit can be rearranged so as not to be logically inconsistent. Multiple functional units, etc. may be combined into one or divided. Each embodiment of the present disclosure described above is not limited to being implemented faithfully to each of the embodiments described, and may be implemented by combining each feature as appropriate or omitting some of them. In other words, the contents of the present disclosure can be modified and corrected in various ways by a person skilled in the art based on the present disclosure. Therefore, these modifications and corrections are included in the scope of the present disclosure. For example, in each embodiment, each functional unit, each means, each step, etc. can be added to other embodiments so as not to be logically inconsistent, or replaced with each functional unit, each means, each step, etc. of other embodiments. In addition, in each embodiment, multiple functional units, each means, each step, etc. can be combined into one or divided. Furthermore, each of the above-described embodiments of the present disclosure is not limited to being implemented faithfully according to each of the described embodiments, but may be implemented by combining each feature or omitting some features as appropriate.

For example, in the above-described embodiment, the electronic device 20 has been described as being a hearable device. However, the electronic device 20 is not limited to being a hearable device as long as it can be worn on the user's head and can provide information to the user. As another example, the electronic device 20 may be a glasses-type wearable device. In this case, the electronic device 20 may provide information by displaying text data on the glasses.

For example, the control unit 31 of the electronic device 20 may receive from an external server the unique ID of the providing device 10 and two or more pieces of sound data related to the providing device 10 of the unique ID. In this case, the control unit 31 may store the unique ID of the providing device 10 and the two or more pieces of sound data related to the providing device 10 in association with each other in the storage unit 30. The two or more pieces of sound data related to the providing device 10 may include first sound data for providing summary information and second sound data for providing detailed information. In this case, in the electronic device 20, the control unit 31 may cause the speaker unit 26 to play the first sound data when the unique signal including the unique ID of the providing device 10 is first received. When the user continues to stare at the providing device 10, the control unit 31 may receive a unique signal including the same unique ID again. When the unique signal including the same unique ID is received again, the control unit 31 may cause the speaker unit 26 to play the second sound data. Here, in the electronic device 20, the control unit 31 may receive a one-time password reset instruction through the input unit 25. If the user wishes to listen to the first sound data, the user may input a one-time password reset instruction from the input unit 25. If the control unit 31 determines that the user is in a gaze state when a one-time password reset instruction is received from the input unit 25, the control unit 31 may generate a new one-time password. The control unit 31 may transmit a carrier signal including the new one-time password via the communication unit 22. With this configuration, the user can listen to the first sound data again.

For example, the control unit 31 of the electronic device 20 may perform acoustic communication with two or more providing devices 10 simultaneously. In this case, the control unit 31 may separate acoustic communication with different providing devices 10 by beamforming of the multi-microphone of the microphone unit 24, or by using multiple microphones each having different directivities. For example, the control unit 31 may separate acoustic communication with different providing devices 10 in the left and right directions of the electronic device 20.

For example, the control unit 31 of the electronic device 20 may perform acoustic communication with two or more providing devices 10 at the same time. In this case, the control unit 31 may simultaneously execute notification processing for two or more providing devices 10. When executing notification processing for two or more providing devices 10 at the same time, the control unit 31 may change the sound source localization and the volume of the sound effect output from the speaker unit 26 according to the distance from the electronic device 20 to the providing device 10. The control unit 31 may measure the distance from the electronic device 20 to the providing device 10 based on the intensity of the ultrasonic signal received from the providing device 10. For example, the control unit 31 may make the volume of the sound effect of the providing device 10 that is far from the electronic device 20 smaller than the volume of the sound effect of the providing device 10 that is close to the electronic device 20. The control unit 31 may position the sound source localization of the sound effect of the providing device 10 that is far from the electronic device 20 above the user than the sound source localization of the sound effect of the providing device 10 that is close to the electronic device 20. With this configuration, the user can turn his/her head toward the sound source localization of the sound effect of the providing device 10 from which the user wants to hear audio information. The control unit 31 may identify the sound source localization of the sound effect of the providing device 10 from which the user wants to hear audio information by detecting the orientation of the user's head with the sensor unit 28. The control unit 31 may identify the providing device 10 from which the user wants to hear audio information by identifying the sound source localization. The control unit 31 may generate and transmit a request signal to the identified providing device 10.

For example, in the above-described embodiment, the provision device 10 has been described as being a guide board. However, the provision device 10 may also be a signboard.

For example, in the above-described embodiment, the providing device 10 has been described as being located outdoors. However, the providing device 10 may also be located indoors, such as in a museum. In this case, information about exhibits in the museum or the like may be written on one of the two sides of the providing device 10. A dedicated application program for the museum or the like may be installed in the electronic device 20. The control unit 31 may download sound information in accordance with this application program.

REFERENCE SIGNS LIST 1 Provision system 10, 10A, 10B Provision device 11 Communication unit 12 Speaker unit 13 Microphone unit 14 Memory unit 15 Control unit 20, 20A, 20B Electronic device 21 Communication unit 22 Communication unit 23 Speaker unit 24 Microphone unit 25 Input unit 26 Speaker unit 27 Positioning unit 28 Sensor unit 29 Vibration unit 30 Memory unit 31 Control unit 2A, 2B User 3A, 3B Carrier signal 4A, 4B Response signal 5A, 5B Request signal 6A, 6B Unique signal

Claims (11)

A communication unit having directionality;
A sensor unit that detects the movement of the user's head;
a control unit that, when it is determined that the user is in a gazing state based on a detection result of the sensor unit, provides the user with information based on a signal received by the communication unit from an object in a direction in which the user is gazing;
An electronic device comprising: The electronic device according to claim 1, wherein the control unit transmits a carrier signal including identification information of the user via the communication unit when the control unit determines that the user is in a gaze state. The electronic device according to claim 2, wherein the control unit receives a response signal to the carrier signal by the communication unit, and if the response signal includes the user's identification information, notifies the user that information about the providing device can be provided. Further comprising a vibration unit capable of vibrating the electronic device,
The electronic device according to claim 3 , wherein the control unit notifies the user that the information on the providing device can be provided by causing the vibration unit to vibrate the electronic device. The electronic device according to claim 3, wherein the control unit transmits a request signal requesting identification information of the providing device via the communication unit. The electronic device according to claim 5, wherein the control unit plays a sound associated with the identification information of the providing device when the control unit receives a unique signal including the identification information of the user and the identification information of the providing device via the communication unit. The electronic device according to any one of claims 3 to 6, wherein the communication between the electronic device and the providing device is acoustic communication. The electronic device according to any one of claims 2 to 6, wherein the user identification information is a one-time password. The electronic device according to any one of claims 1 to 6, wherein the electronic device is worn on the head of the user. A communication unit having directionality;
a control unit that, when receiving a carrier signal including user identification information by the communication unit, stores the user identification information and transmits a response signal to the carrier signal by the communication unit;
A providing device comprising: an electronic device that, when it is determined that the user is in a gaze state based on a detection result of a movement of the user's head, transmits a carrier signal including identification information of the user by a first communication unit having directionality;
a providing device that, when the carrier signal is received by a second communication unit having directionality, stores identification information of the user and transmits a response signal to the carrier signal by the second communication unit;
A provision system comprising:

Images