CN115655300A - Method and device for prompting traveling route, earphone equipment and computer medium - Google Patents
Method and device for prompting traveling route, earphone equipment and computer medium Download PDFInfo
- Publication number
- CN115655300A CN115655300A CN202211341816.1A CN202211341816A CN115655300A CN 115655300 A CN115655300 A CN 115655300A CN 202211341816 A CN202211341816 A CN 202211341816A CN 115655300 A CN115655300 A CN 115655300A
- Authority
- CN
- China
- Prior art keywords
- target
- prompt tone
- processed
- prompt
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Navigation (AREA)
Abstract
The invention discloses a method and a device for prompting a traveling route, earphone equipment and a computer readable storage medium, which are applied to the earphone equipment provided with a positioning device and comprise the following steps: calling the positioning device to obtain current position information and destination information of a target wearer, and generating a target traveling route according to the current position information and the destination information; generating a first prompt tone to be processed according to the target travelling route, and processing the first prompt tone to be processed through a preset acoustic transmission database to obtain a target stereo prompt tone; and outputting the target stereo prompt tone so that the target wearer can reach a destination according to the target stereo prompt tone and the target traveling route. The invention can realize the technical effect that the earphone equipment can output the stereo prompt tone with the spatial direction sense, and further assist the wearer to reach the destination according to the correct traveling route through the stereo prompt tone, thereby improving the user experience of the wearer.
Description
Technical Field
The present invention relates to the field of earphone technologies, and in particular, to a method and an apparatus for prompting a travel route, an earphone device, and a computer-readable storage medium.
Background
Blind people have many inconveniences when going out outdoors due to visual loss. At present, many blind people mainly rely on the blind guiding stick to sense some barriers on the blind road and the road when going out outdoors, but the traditional blind guiding stick can only be used as a simple path exploring tool, and along with the gradual change of society, the traditional blind guiding stick can not meet the going requirements of the blind people; similarly, some blind people mainly rely on the guide dog to assist walking, however, the way of relying on the guide dog needs to face the situations that the training period of the guide dog is long, the number of the guide dogs is first, and the price is high, so the guide dog cannot be an auxiliary means which can be adopted by most blind people.
Therefore, how to solve the technical problem that blind people cannot determine a traveling route and obstacle information when traveling outdoors becomes an urgent need to be solved in the industry.
Disclosure of Invention
The embodiment of the invention provides a method and a device for prompting a traveling route, an earphone device and a computer readable storage medium, aiming at enabling the earphone device to output a stereo prompt sound with a spatial direction sense, and further assisting a wearer to reach a destination according to a correct traveling route through the stereo prompt sound, so that the user experience of the wearer is improved.
In order to achieve the above object, the present invention provides a method for prompting a travel route, the method being applied to a headset device equipped with a positioning device, the method comprising the steps of:
calling the positioning device to obtain current position information and destination information of a target wearer, and generating a target traveling route according to the current position information and the destination information;
generating a first prompt tone to be processed according to the target traveling route, and processing the first prompt tone to be processed through a preset acoustic transmission database to obtain a target three-dimensional prompt tone;
and outputting the target stereo prompt tone so that the target wearer can reach a destination according to the target stereo prompt tone and the target traveling route.
Further, the step of generating a first prompt tone to be processed according to the target traveling route includes:
screening each position point on the target traveling route to determine a prompt point on the target traveling route;
and generating a first prompt tone to be processed according to the prompt point and the target traveling route.
Further, the step of processing the first prompt tone to be processed through a preset acoustic transmission database to obtain a target stereo prompt tone includes:
screening a preset acoustic transmission database to determine a first acoustic transmission function corresponding to the prompt point in the acoustic transmission database;
and processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target stereo prompt tone.
Further, the step of processing the first prompt tone to be processed according to the first acoustic transfer function to obtain a target stereo prompt tone includes:
processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target left sound channel prompt tone;
processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target right channel prompt tone;
and integrating the left sound channel prompt tone and the right sound channel prompt tone to obtain a target stereo prompt tone.
Further, the ear speaker device is further provided with a sound wave emitting means and a plurality of sound source receiving means, and after the step of generating a target travel route from the current position information and the destination information, the method further includes:
calling the sound wave transmitting devices to transmit target sound waves, and calling the sound source receiving devices to receive reflected sound waves; the reflected sound wave is formed after the target sound wave collides with a target barrier;
determining reception delay data between the sound source receiving devices, and determining an obstacle position of the target obstacle relative to the target wearer based on the reception delay data and a positional relationship between the sound source receiving devices;
and generating a second prompt tone to be processed according to the position of the obstacle, and processing the second prompt tone to be processed through the acoustic transmission database to obtain a target obstacle prompt tone.
Further, the step of determining reception delay data between the sound source receiving devices and determining the obstacle position of the target obstacle relative to the target wearer based on the reception delay data and the positional relationship between the sound source receiving devices includes:
acquiring receiving time of the reflected sound waves received by each sound source receiving device, and determining receiving delay data among the sound source receiving devices according to the receiving time;
and determining device distance data between the sound source receiving devices according to the position relation between the sound source receiving devices, and calculating the receiving delay data and the device distance data according to a preset sound source calculation formula to obtain the barrier position of the target barrier relative to the target wearer.
Further, the step of processing the second to-be-processed warning tone through the acoustic transmission database to obtain a target obstacle warning tone includes:
inputting the second prompt tone to be processed into the acoustic transmission database to determine a second acoustic transmission function corresponding to the second prompt tone to be processed in the acoustic transmission database;
and processing the second prompt tone to be processed through the second acoustic transfer function to obtain a target obstacle prompt tone.
Further, to achieve the above object, the present invention also provides a travel route prompting apparatus applied to a headphone device provided with a positioning device, the apparatus including:
the route planning module is used for calling the positioning device to acquire the current position information and the destination information of the target wearer and generating a target traveling route according to the current position information and the destination information;
the sound processing module is used for generating a first prompt tone to be processed according to the target advancing route and processing the first prompt tone to be processed through a preset acoustic transmission database to obtain a target stereo prompt tone;
and the sound output module is used for outputting the target stereo prompt sound so that the target wearer can reach a destination according to the target stereo prompt sound according to the target traveling route.
Further, to achieve the above object, the present invention also provides an earphone device including: the prompting method comprises the following steps of storing a memory, a processor and a prompting program of a travel route, wherein the prompting program of the travel route is stored on the memory and can run on the processor, and when the prompting program of the travel route is executed by the processor, the steps of the prompting method of the travel route are realized.
Further, to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a program for prompting a travel route, which when executed by a processor, implements the steps of the method for prompting a travel route as described above.
The method and the device for prompting the travelling route, the earphone equipment and the computer readable storage medium provided by the embodiment of the invention are applied to the earphone equipment provided with a positioning device, the positioning device is called to obtain the current position information and the destination information of a target wearer, and the target travelling route is generated according to the current position information and the destination information; generating a first prompt tone to be processed according to the target traveling route, and processing the first prompt tone to be processed through a preset acoustic transmission database to obtain a target three-dimensional prompt tone; and outputting the target stereo prompt tone so that the target wearer can reach a destination according to the target stereo prompt tone and the target traveling route.
In this embodiment, when the earphone device operates, first, a positioning device configured inside is called to obtain current position information and destination information of a target wearer wearing the earphone device, the earphone device further calls the positioning device to generate a target traveling route according to the current position information and the destination information, then, the earphone device screens each position point on the target traveling route to determine a prompt point in each position point and generate a first prompt tone to be processed corresponding to the prompt point, the earphone device inputs the generated first prompt tone to be processed into a sound signal processing device configured inside the earphone device, the sound signal processing device processes the first prompt tone to be processed according to an acoustic transmission database preset inside the earphone device to obtain a target stereo prompt tone, and finally, the earphone device outputs the target stereo prompt tone through a sound output device configured inside so that the target wearer can reach a destination according to the target traveling route.
Therefore, the method and the device generate the target travelling route according to the current position information and the destination information of the wearer and determine the prompt point on the target travelling route, so as to generate the voice to be processed corresponding to the prompt point, further process the voice to be processed through the preset acoustic transmission database to obtain the target stereo prompt tone, and output the target stereo prompt tone to enable the wearer to determine the travelling route according to the target stereo prompt tone.
Drawings
Fig. 1 is a schematic structural diagram of a headset device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a first embodiment of a method for prompting a travel route according to the present invention;
FIG. 3 is a flowchart illustrating a second embodiment of a method for prompting a travel route according to the present invention;
FIG. 4 is a schematic diagram of a clockwise spherical coordinate system according to an embodiment of the method for prompting a travel route of the present invention;
FIG. 5 is a schematic diagram illustrating an acoustic transfer function measurement process according to an embodiment of a method for prompting a travel route of the present invention;
FIG. 6 is a schematic view of a processing procedure of a target stereo alert tone according to an embodiment of a method for prompting a travel route of the present invention;
FIG. 7 is a schematic view illustrating a principle of sound source calculation according to an embodiment of the method for prompting a travel route of the present invention;
fig. 8 is a schematic diagram of functional modules involved in a method for prompting a travel route according to an embodiment of the present invention.
The implementation, functional features and advantages of the present invention will be further described with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an earphone device in a hardware operating environment according to an embodiment of the present invention.
It should be noted that fig. 1 is a schematic structural diagram of a hardware operating environment of the headset device. The earphone device of the embodiment of the invention can be provided with the GPS positioning device and the micro data processing module, and certainly, the earphone device can also be a Bluetooth earphone, a Bluetooth headset or other mobile earphone devices.
As shown in fig. 1, the earphone device may include: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a WIreless interface (e.g., a WIreless-FIdelity (WI-FI) interface). The Memory 1005 may be a Random Access Memory (RAM) Memory, or may be a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the earphone device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, the memory 1005, which is a kind of storage medium, may include therein an operating system, a data storage module, a network communication module, a user interface module, and a reminder of a travel route.
In the headphone device shown in fig. 1, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the headphone apparatus of the present invention may be provided in the headphone apparatus, and the headphone apparatus calls the prompting program of the travel route stored in the memory 1005 through the processor 1001 and executes the prompting method of the travel route provided by the embodiment of the present invention.
Based on the above-mentioned earphone device, various embodiments of the prompting method for the travel route of the present invention are provided.
Referring to fig. 2, fig. 2 is a flowchart illustrating a method for prompting a travel route according to a first embodiment of the present invention.
It will be appreciated that, although a logical order is illustrated in the flow chart, in some cases, the route prompting method of the present invention may of course perform the steps illustrated or described in a different order than that presented herein.
It is understood that the prompting method of the travel route of the present invention is applied to the earphone device equipped with the positioning device, and when the earphone device includes two earphones, the prompting method of the travel route can be applied to any one of the earphones. In this embodiment, the method for prompting the travel route may include the following steps:
step S10: calling the positioning device to obtain current position information and destination information of a target wearer, and generating a target traveling route according to the current position information and the destination information;
in this embodiment, when the earphone device runs, the positioning device configured inside is first called to obtain the current position information and the destination information of the target wearer wearing the earphone device, and the earphone device further calls the positioning device to generate a target traveling route according to the current position information and the destination information.
Illustratively, for example, when the earphone device is operated, first, a GPS positioning system configured inside the earphone device is called to acquire first position information such as longitude information, latitude information, street information and the like of a current position of a target wearer wearing the earphone device, and each first position information is determined as current position information of the target wearer, meanwhile, the earphone device acquires second position information such as longitude information, latitude information, street information and the like of a destination specified by the target wearer through the GPS positioning system, and each second position information is determined as destination information of the target wearer, and then, the earphone device calls the GPS positioning system to generate a target travel route based on the current position information, the destination information and city map information of a city where the target wearer is located.
Step S20: generating a first prompt tone to be processed according to the target traveling route, and processing the first prompt tone to be processed through a preset acoustic transmission database to obtain a target three-dimensional prompt tone;
the acoustic transmission database is an IOA-PKU near-field database, and each acoustic transmission function stored in the IOA-PKU near-field database is a clockwise spherical coordinate system adopted by technicians, specifically referring to fig. 4, fig. 4 is a schematic diagram of the clockwise spherical coordinate system related to an embodiment of the prompting method for a travel route of the present invention, in this embodiment, the coordinate system uses the center point of the human head as the origin of the coordinate system, the distance variable is represented by r, and the azimuth angle and the horizontal angle are represented by θ and Φ, respectively, it can be understood that, for the azimuth angle θ,0 ° represents the front, 90 ° represents the right, 180 ° represents the rear, and 270 ° represents the left; similarly, for the horizontal angle Φ,90 ° represents below and 90 ° represents above, and then, referring to fig. 5, fig. 5 is a schematic diagram of a measurement process of an acoustic transfer function according to an embodiment of the method for prompting a travel route of the present invention, and a technician may obtain the acoustic transfer function at each position by testing the acoustic signal data emitted from the sound source in 793 directions within 20cm to 1.6m through a clockwise spherical coordinate system based on the contents shown in the table of fig. 5;
it can be understood that there are many ways to compose and construct the acoustic transmission database, and the present invention is not limited to this, and similarly, the IOA-PKU near-field database may be stored in a storage device in the headset device before the headset device leaves the factory, so as to be directly read and used locally when needed, or may be stored in a server by a technician, so as to be remotely downloaded and obtained by the headset device when needed, and the present invention is also not limited to this.
The method comprises the steps that the earphone equipment screens all position points on a target advancing route to determine prompt points in all the position points and generate first prompt tones to be processed corresponding to the prompt points, the earphone equipment inputs the generated first prompt tones to be processed into a sound signal processing device configured in the earphone equipment, and the sound signal processing device processes the first prompt tones to be processed according to an acoustic transmission database preset in the earphone equipment so as to obtain target three-dimensional prompt tones.
For example, after the target travel route is determined, the earphone device determines whether each position point on the target travel route meets a prompt condition preset by a technician, determines a position point meeting the prompt condition as a prompt point in each position point, further generates a first prompt tone to be processed corresponding to the prompt point, then inputs the generated first prompt tone to be processed to a sound signal processing device configured in the earphone device, and the sound signal processing device processes the first prompt tone to be processed according to an IOA-PKU near-field database preset by the technician so as to obtain a target stereo prompt tone consistent with the sound emitted in the target travel direction.
Further, in a possible embodiment, the step of "generating the first prompt tone to be processed according to the target traveling route" in the step S20 may specifically include:
step S201: screening each position point on the target traveling route to determine a prompt point on the target traveling route;
in this embodiment, the earphone device reads a storage device disposed in the earphone device to obtain prompt conditions stored in advance by a technician, and filters each position point on the target travel route according to the prompt conditions to determine a target position point matching the prompt conditions among the position points, and determines the target position as the prompt point.
Step S202: generating a first prompt tone to be processed according to the prompt point and the target traveling route;
in this embodiment, the earphone device determines the position type of the cue point after determining the cue point, and further generates a first prompt tone to be processed according to the position type of the cue point and the target travel route.
Illustratively, for example, the earphone device first reads the storage device to obtain prompt conditions preset by a technician, and determines the prompt conditions to be prompting executed at an intersection, then the earphone device screens position points on the target travel route based on the prompt conditions to determine position of each intersection on the target travel route, and determines the position of each intersection as a prompt point, and then the earphone device generates a first prompt sound to be processed according to the position of each prompt point on the target travel route and the target travel route.
It should be noted that, in this embodiment, in addition to performing prompting at an intersection, a technician may set other positions such as a street corner as a prompting point according to an actual planning situation of a city and modify the prompting condition, which is not limited in the present invention.
Further, in a possible embodiment, the step of processing the first prompt tone to be processed through a preset acoustic transmission database to obtain the target stereo prompt tone in the step S20 may specifically include:
step S203: screening a preset acoustic transmission database to determine a first acoustic transmission function corresponding to the prompt point in the acoustic transmission database;
in this embodiment, the earphone device reads the storage device to obtain the acoustic transmission database, and inputs the obtained first prompt tone to be processed and the acoustic transmission database to the sound signal processing device, and the sound signal processing device screens the acoustic transmission database according to the prompt tone corresponding to the first prompt tone to determine the first acoustic transmission function corresponding to the prompt tone in the acoustic transmission database.
Step S204: processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target stereo prompt tone;
in this embodiment, the sound signal processing apparatus processes the first to-be-processed alert tone according to the acquired first acoustic transfer function, so as to obtain a target stereo alert tone corresponding to the first to-be-processed alert tone.
Illustratively, for example, the earphone device first reads the storage device to obtain the above mentioned IOA-PKU near-field database, and inputs the generated first prompt tone to be processed and the IOA-PKU near-field database to the sound signal processing device, then the sound signal processing device determines the prompt distance and the prompt angle of the prompt point relative to the target wearer, and takes the prompt distance and the prompt angle as spatial parameters, and the sound signal processing device further screens the IOA-PKU near-field database according to the spatial parameters, so as to determine a first acoustic transmission function corresponding to the prompt point, and performs convolution operation on the first prompt tone to be processed through the first acoustic transmission function, so as to obtain the target stereo prompt tone.
Further, in a possible embodiment, the step S204 may specifically include:
step S2041: processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target left channel prompt tone;
step S2042: processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target right channel prompt tone;
step S2043: integrating the left sound channel prompt tone and the right sound channel prompt tone to obtain a target stereo prompt tone;
for example, referring to fig. 6, fig. 6 is a schematic view illustrating a processing process of a target stereo alert sound according to an embodiment of a method for prompting a travel route of the present invention, in which a sound signal processing apparatus first determines to obtain a first acoustic transmission function, and inputs an audio signal corresponding to an obtained first alert sound to be processed and a spatial parameter corresponding to a prompt point to the first acoustic transmission function to generate a target left channel alert sound; similarly, the sound signal processing device inputs the acquired audio signal corresponding to the first prompt tone to be processed and the spatial parameter corresponding to the prompt point into the first acoustic transmission function to generate a target right channel prompt tone; and then, the sound signal processing device integrates the acquired target left channel prompt sound and the target right channel prompt sound to obtain the target stereo prompt sound.
It should be noted that the HRTF (Head Related Transfer Function-Head Related Transfer Function) database shown in fig. 6 is an IOA-PKU near-field database in the present embodiment, and similarly, the HRTF processing shown in fig. 6 indicates that the cue tone to be processed is processed through the first acoustic Transfer Function.
Step S30: outputting the target stereo prompt tone so that the target wearer can reach a destination according to the target travelling route according to the target stereo prompt tone;
in the embodiment, the earphone device outputs the target stereo prompt tone through the internally configured sound output device, so that the target wearer can reach the destination according to the target stereo prompt tone according to the target traveling route.
Illustratively, for example, after acquiring the target stereo prompt tone, the earphone device invokes the GPS system again to acquire the current position information of the target wearer, and when it is determined that the current position information coincides with the prompt point corresponding to the target stereo prompt tone, the earphone device plays the target stereo prompt tone through a built-in sound output device, so that the target wearer determines the target traveling route according to the target stereo prompt tone and reaches the destination according to the target traveling route.
In this embodiment, when the earphone device operates, first, a positioning device configured inside is called to obtain current position information and destination information of a target wearer wearing the earphone device, the earphone device further calls the positioning device to generate a target traveling route according to the current position information and the destination information, then, the earphone device screens each position point on the target traveling route to determine a prompt point in each position point and generate a first prompt tone to be processed corresponding to the prompt point, the earphone device inputs the generated first prompt tone to be processed into a sound signal processing device configured inside the earphone device, the sound signal processing device processes the first prompt tone to be processed according to an acoustic transmission database preset inside the earphone device to obtain a target stereo prompt tone, and then, the earphone device outputs the target stereo prompt tone through a sound output device configured inside so that the target wearer can reach a destination according to the target traveling route.
Therefore, the method and the device generate the target travelling route according to the current position information and the destination information of the wearer and determine the prompt point on the target travelling route, so as to generate the voice to be processed corresponding to the prompt point, further process the voice to be processed through the preset acoustic transmission database to obtain the target stereo prompt tone, and output the target stereo prompt tone to enable the wearer to determine the travelling route according to the target stereo prompt tone.
Further, based on the above-described first embodiment of the method for presenting a route according to the present invention, a second embodiment of the method for presenting a route according to the present invention is presented herein.
Referring to fig. 3, fig. 3 is a flowchart illustrating a method for prompting a travel route according to a second embodiment of the present invention.
After the step S10, the method for prompting a travel route according to the present invention may further include:
step A10: calling the sound wave transmitting devices to transmit target sound waves, and calling the sound source receiving devices to receive reflected sound waves; the reflected sound wave is formed after the target sound wave collides with a target obstacle;
in this embodiment, a plurality of sound source receiving devices should be further configured in the earphone device, where the sound source receiving devices may be capacitive microphones, crystal microphones, carbon microphones, or dynamic microphones, and each microphone may form a microphone array according to an arrangement sequence preset by a technician, and of course, the number and arrangement manner of the microphones forming the microphone array may be various, which is not limited in the present invention. In addition, the arrangement position of each microphone can refer to the deployment position of the microphone in the same type of earphone device, and the invention also does not limit the invention.
When the earphone equipment runs, the sound output device is called to transmit the target sound wave, the target sound wave is further transmitted after contacting with target obstacles around the earphone equipment to form reflected sound waves, and the earphone equipment further calls the sound source receiving devices to receive the reflected sound waves respectively.
Illustratively, for example, during operation of the earphone device, the sound output device in the earphone device is first controlled to continuously emit ultrasonic waves at preset time intervals, and then, when the ultrasonic waves collide with obstacles around the earphone device, the ultrasonic waves are reflected and reflected sound waves are generated, and the earphone device further controls the microphones i and j disposed in the earphone device to respectively receive the reflected sound waves.
Step A20: determining reception delay data between the sound source receiving devices, and determining an obstacle position of the target obstacle relative to the target wearer based on the reception delay data and a positional relationship between the sound source receiving devices;
in this embodiment, the earphone device invokes a detection device configured in the earphone device to detect each sound source receiving device, so as to obtain the receiving time of each sound source receiving device for receiving the reflected sound wave, and calculates each receiving time to obtain receiving delay data, meanwhile, the earphone device reads the storage device to obtain a microphone array stored in advance by a technician, and determines the positional relationship between each sound source receiving device according to the microphone array, the earphone device further inputs the obtained receiving delay data and the positional relationship to a data processing device configured in the earphone device, and the data processing device calculates the obstacle position of the target obstacle relative to the target wearer according to the receiving delay data and the positional relationship.
For example, the earphone device first calls the detection device to detect the microphone i and the microphone j to obtain a receiving time t1 when the microphone i receives the reflected sound wave and a receiving time t2 when the microphone j receives the reflected sound wave, and then calculates to obtain receiving delay data τ according to the receiving time t1 and the receiving time t2, meanwhile, the earphone device reads the storage device to obtain a microphone array and inputs the obtained receiving delay data τ and the microphone array to the data processing device, and then the data processing device determines a position relationship between the microphone i and the microphone j according to the microphone array, and further calculates to obtain an obstacle distance and an obstacle angle of the target obstacle relative to the target wearer according to the receiving delay data τ and the position relationship.
Further, in a possible embodiment, the step a20 may specifically include:
step A201: acquiring receiving time of each sound source receiving device for receiving the reflected sound waves respectively, and determining receiving delay data among the sound source receiving devices according to the receiving time;
in this embodiment, the earphone device invokes an internally configured detection device to detect each sound source receiving device disposed in the earphone device, so as to obtain the receiving time of each sound source receiving device for obtaining the reflected sound wave, and calculate each receiving time to obtain the receiving delay data.
Step A202: determining device distance data among the sound source receiving devices according to the position relation among the sound source receiving devices, and calculating the receiving delay data and the device distance data according to a preset sound source calculation formula to obtain the barrier position of the target barrier relative to the target wearer;
in this embodiment, the earphone device reads the storage device to obtain a microphone array stored in advance by a technician, inputs the microphone array to the data processing device, determines a positional relationship between the sound source receiving devices according to the microphone array by the data processing device, further determines a device distance value between the sound source receiving devices according to the positional relationship, then brings the obtained device distance value and the receiving delay data into a preset sound source calculation formula to obtain a sub-obstacle direction and a sub-obstacle distance between the target obstacle and each sound source receiving device, and the data processing device further determines an obstacle distance and an obstacle angle between the target obstacle and the target wearer according to the sub-obstacle direction and each sub-obstacle distance, and further determines an obstacle position of the target obstacle relative to the target wearer according to the obstacle distance and the obstacle angle.
Illustratively, for example, the earphone device first calls an internally configured detection device to detect a microphone i and a microphone j disposed in the earphone device to obtain a receiving time t1 when the microphone j receives a reflected sound wave and a receiving time t2 when the microphone j receives the reflected sound wave, the earphone device further calculates the receiving time t1 and the receiving time t2 to obtain receiving delay data τ, meanwhile, the earphone device reads a storage device to obtain a microphone array stored in advance by a technician, and inputs the obtained receiving delay data τ and the microphone array to a data processing device, then the data processing device first determines a position relationship between the microphone i and the microphone j according to the microphone array, further determines device distance data d between the microphone i and the microphone j according to the position relationship, and then the data processing device calculates a sub-obstacle direction and a sub-obstacle distance between a target obstacle and the microphone i according to a preset sound source calculation formula Δ L = C, and then the data processing device determines a target obstacle direction and a target obstacle distance between the target obstacle and the target obstacle direction, and a target obstacle direction, and determines a target distance between the target obstacle and a target obstacle direction and a target distance between the target obstacle.
It should be noted that, referring to fig. 7, fig. 7 is a schematic diagram of a sound source calculation principle related to an embodiment of the method for prompting a travel route of the present invention, in which the calculated obstacle distance and obstacle angle are determined by microphones placed according to a certain geometric position, as shown in fig. 7, as for two microphones located at different positions in space, as long as the sound source is not located on a centerline between them, the distances between them and the sound source are different, the data processing device can calculate the distance difference between the sound source and the two microphones according to a preset sound source calculation formula Δ L = C τ, it should be noted that C is a sound velocity in the sound source calculation formula, and in an ideal case, the received signal between the microphone i and the microphone j satisfies a relationship S i ＝S j (t- τ) in which S i And S j Respectively, representing the signal values received by each of microphone i and microphone j.
Step A30: generating a second prompt tone to be processed according to the obstacle distance and the obstacle angle, and processing the second prompt tone to be processed through the acoustic transmission database to obtain a target obstacle prompt tone;
in this embodiment, the earphone device generates a second to-be-processed alert tone corresponding to the distance to the obstacle and the angle to the obstacle, inputs the second to-be-processed alert tone into the sound signal processing apparatus, and processes the second to-be-processed alert tone according to the acoustic transmission database by the sound signal processing apparatus to obtain a target obstacle alert tone.
For example, after determining the obstacle distance and the obstacle angle, the earphone device generates a second to-be-processed alert tone corresponding to the obstacle distance and the obstacle angle, and then inputs the second to-be-processed alert tone into the sound signal processing apparatus, and the sound signal processing apparatus processes the second to-be-processed alert tone according to the IOA-PKU near-field database to obtain a target obstacle alert tone.
Further, in a possible embodiment, the step of processing the second to-be-processed alert sound through the acoustic transmission database to obtain a target obstacle alert sound in the step a30 may specifically include:
step A301: inputting the second prompt tone to be processed into the acoustic transmission database to determine a second acoustic transmission function corresponding to the second prompt tone to be processed in the acoustic transmission database;
in this embodiment, the earphone device reads the storage device to obtain an acoustic transmission database, and inputs the obtained acoustic transmission database and the second to-be-processed prompt tone to the sound signal processing device together, and the sound signal processing device screens the acoustic transmission database according to the obstacle distance and the obstacle angle corresponding to the second to-be-processed prompt tone, so as to determine a second acoustic transmission function corresponding to the second to-be-processed prompt tone in the acoustic transmission database.
Step A302: processing the second prompt tone to be processed through the second acoustic transfer function to obtain a target obstacle prompt tone;
in this embodiment, the sound signal processing apparatus processes the second to-be-processed warning sound according to the obtained second acoustic transfer function, so as to obtain a target obstacle warning sound corresponding to the second to-be-processed warning sound.
For example, the earphone device first reads the storage device to obtain the IOA-PKU near-field database, and inputs the generated second prompt to be processed and the IOA-PKU near-field database to the sound signal processing device, then the sound signal processing device takes the obstacle distance and the obstacle angle corresponding to the second prompt to be processed as spatial parameters, and screens the IOA-PKU near-field database based on the spatial parameters, so as to determine a second acoustic transmission function corresponding to the obstacle distance and the obstacle angle, and then the sound signal processing device inputs the audio signal corresponding to the second prompt to be processed to the second acoustic transmission function to obtain the target obstacle prompt.
In this embodiment, when the earphone device is in operation, first, the sound output device is called to emit a target sound wave, the target sound wave is further emitted and forms a reflected sound wave after contacting with a target obstacle around the earphone device, the earphone device is further called to receive each reflected sound wave by each sound source receiving device, then, the earphone device calls the detection device configured in the earphone device to detect each sound source receiving device so as to obtain the receiving time of each sound source receiving device receiving the reflected sound wave, and calculates each receiving time to obtain receiving delay data, and at the same time, the earphone device reads the storage device so as to obtain a microphone array stored in advance by a technician, and determining the position relation among the sound source receiving devices according to the microphone array, inputting the acquired receiving delay data and the position relation into a data processing device configured in the earphone equipment by the earphone equipment, calculating the barrier distance and the barrier angle of a target barrier relative to a target wearer by the data processing device according to the receiving delay data and the position relation, generating a second prompt tone to be processed by the earphone equipment corresponding to the barrier distance and the barrier angle, inputting the second prompt tone to be processed into a sound signal processing device, and processing the second prompt tone to be processed by the sound signal processing device according to an acoustic transmission database to obtain the target barrier prompt tone.
Therefore, the method and the device adopt the mode of calling the sound output device to emit the target sound wave, controlling the sound receiving device to receive the reflected sound wave formed by the target sound wave after the target sound wave collides with the target barrier, further determining the barrier distance and the barrier angle of the target barrier relative to the target wearer according to the receiving time of the reflected sound wave received by the sound receiving device, and generating the corresponding target barrier prompt sound, solve the problem that blind people cannot determine whether barriers and other pedestrians exist on a travel route when going out outdoors, and achieve the purpose of assisting the blind people to collide with the barriers on the travel route when going out outdoors by outputting the prompt sound.
In addition, the present invention further provides a prompting device of a travel route, the prompting device of the travel route is applied to an earphone device configured with a positioning device, please refer to fig. 8, fig. 8 is a schematic diagram of functional modules related to an embodiment of a prompting method of a travel route of the present invention, as shown in fig. 8, the prompting device of the travel route of the present invention includes:
the route planning module 10 is configured to invoke the positioning device to obtain current location information and destination information of a target wearer, and generate a target travel route according to the current location information and the destination information;
the sound processing module 20 is configured to generate a first to-be-processed prompt sound according to the target traveling route, and process the first to-be-processed prompt sound through a preset acoustic transmission database to obtain a target stereo prompt sound;
and the sound output module 30 is configured to output the target stereo prompt sound, so that the target wearer can reach the destination according to the target travel route according to the target stereo prompt sound.
Further, the sound processing module 20 includes:
the position screening unit is used for screening each position point on the target travelling route to determine a prompt point on the target travelling route;
and the prompt generating unit is used for generating a first prompt tone to be processed according to the prompt point and the target traveling route.
Further, the sound processing module 20 further includes:
the function determining unit is used for screening a preset acoustic transmission database so as to determine a first acoustic transmission function corresponding to the prompt point in the acoustic transmission database;
and the sound processing unit is used for processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target stereo prompt tone.
Further, a sound processing unit comprising:
the left channel processing subunit is configured to process the first to-be-processed prompt tone according to the first acoustic transfer function to obtain a target left channel prompt tone;
the right channel processing subunit is configured to process the first to-be-processed prompt tone according to the first acoustic transfer function to obtain a target right channel prompt tone;
and the double-channel merging subunit is used for integrating the left-channel prompt tone and the right-channel prompt tone to obtain a target stereo prompt tone.
Further, the sound processing module 20 further includes:
the sound wave receiving unit is used for calling the sound wave transmitting devices to transmit target sound waves and calling the sound source receiving devices to receive reflected sound waves; the reflected sound wave is formed after the target sound wave collides with a target obstacle;
a target calculation unit configured to determine reception delay data between the sound source receiving devices, and determine an obstacle position of the target obstacle relative to the target wearer based on the reception delay data and a positional relationship between the sound source receiving devices;
and the obstacle prompt unit is used for generating a second to-be-processed prompt tone according to the position of the obstacle, and processing the second to-be-processed prompt tone through the acoustic transmission database to obtain a target obstacle prompt tone.
Further, a target calculation unit comprising:
the delay calculating subunit is configured to acquire receiving time of the reflected sound waves received by each of the sound source receiving devices, and determine receiving delay data between the sound source receiving devices according to the receiving time;
and the obstacle calculating subunit is configured to determine device distance data between the sound source receiving devices according to a position relationship between the sound source receiving devices, and calculate the receiving delay data and the device distance data according to a preset sound source calculation formula to obtain an obstacle position of the target obstacle relative to the target wearer.
Further, the obstacle presenting unit includes:
a function determining subunit, configured to input the second prompt tone to be processed to the acoustic transmission database, so as to determine a second acoustic transmission function corresponding to the second prompt tone to be processed in the acoustic transmission database;
and the sound processing subunit is used for processing the second to-be-processed prompt sound through the second acoustic transfer function to obtain a target obstacle prompt sound.
In addition, the invention also provides a headset device, which is provided with a prompting method of a travel route running on a processor, and when the headset device executes the prompting method of the travel route, the steps of the prompting method of the travel route are realized.
The specific embodiment of the earphone device of the present invention is basically the same as the above embodiments of the method for prompting a travel route, and will not be described herein again.
Furthermore, the present invention also provides a computer-readable storage medium having stored thereon a method for prompting a travel route, which when executed by a processor implements the steps of the method for prompting a travel route according to any of the above embodiments.
The specific embodiment of the computer-readable storage medium is substantially the same as the embodiments of the method for prompting a travel route, and is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention or the portions contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above and includes several instructions for enabling a terminal device (a headset device that may be configured with GPS positioning device and micro data processing module, and of course, the headset device may also be a bluetooth headset, a bluetooth headset or other mobile headset device, etc.) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A prompting method of a travel route is applied to an earphone device provided with a positioning device, and comprises the following steps:
calling the positioning device to obtain current position information and destination information of a target wearer, and generating a target traveling route according to the current position information and the destination information;
generating a first prompt tone to be processed according to the target traveling route, and processing the first prompt tone to be processed through a preset acoustic transmission database to obtain a target three-dimensional prompt tone;
and outputting the target stereo prompt tone so that the target wearer can reach a destination according to the target stereo prompt tone and the target traveling route.
2. The prompting method for a travel route according to claim 1, wherein the step of generating a first prompt tone to be processed according to the target travel route includes:
screening each position point on the target traveling route to determine a prompt point on the target traveling route;
and generating a first prompt tone to be processed according to the prompt point and the target traveling route.
3. The method for prompting a travel route according to claim 2, wherein the step of processing the first prompt tone to be processed through a preset acoustic transmission database to obtain a target stereo prompt tone comprises:
screening a preset acoustic transmission database to determine a first acoustic transmission function corresponding to the prompt point in the acoustic transmission database;
and processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target stereo prompt tone.
4. The method for prompting route travel according to claim 3, wherein the step of processing the first to-be-processed prompt tone according to the first acoustic transfer function to obtain a target stereo prompt tone comprises:
processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target left channel prompt tone;
processing the first prompt tone to be processed according to the first acoustic transmission function to obtain a target right channel prompt tone;
and integrating the left sound channel prompt tone and the right sound channel prompt tone to obtain a target stereo prompt tone.
5. The prompting method for a travel route according to claim 1, wherein the ear speaker device is further provided with a sound wave emitting device and a plurality of sound source receiving devices, and after the step of generating a target travel route from the current position information and the destination information, the method further comprises:
calling the sound wave transmitting devices to transmit target sound waves, and calling the sound source receiving devices to receive reflected sound waves; the reflected sound wave is formed after the target sound wave collides with a target obstacle;
determining reception delay data between the sound source receiving devices, and determining an obstacle position of the target obstacle relative to the target wearer based on the reception delay data and a positional relationship between the sound source receiving devices;
and generating a second prompt tone to be processed according to the position of the obstacle, and processing the second prompt tone to be processed through the acoustic transmission database to obtain a target obstacle prompt tone.
6. The method for prompting a travel route according to claim 5, wherein the step of determining reception delay data between the sound source receiving devices and determining the obstacle position of the target obstacle with respect to the target wearer based on the reception delay data and the positional relationship between the sound source receiving devices includes:
acquiring receiving time of each sound source receiving device for receiving the reflected sound waves respectively, and determining receiving delay data among the sound source receiving devices according to the receiving time;
and determining device distance data between the sound source receiving devices according to the position relation between the sound source receiving devices, and calculating the receiving delay data and the device distance data according to a preset sound source calculation formula to obtain the barrier position of the target barrier relative to the target wearer.
7. The method for prompting a travel route according to claim 6, wherein the step of processing the second to-be-processed prompt tone by the acoustic transmission database to obtain a target obstacle prompt tone comprises:
inputting the second prompt tone to be processed into the acoustic transmission database to determine a second acoustic transmission function corresponding to the second prompt tone to be processed in the acoustic transmission database;
and processing the second prompt tone to be processed through the second acoustic transfer function to obtain a target obstacle prompt tone.
8. A prompting device for a travel route, characterized in that the prompting device for the travel route is applied to a headphone apparatus provided with a positioning device, the device comprising:
the route planning module is used for calling the positioning device to acquire the current position information and the destination information of the target wearer and generating a target traveling route according to the current position information and the destination information;
the sound processing module is used for generating a first prompt tone to be processed according to the target advancing route and processing the first prompt tone to be processed through a preset acoustic transmission database to obtain a target stereo prompt tone;
and the sound output module is used for outputting the target stereo prompt sound so that the target wearer can reach a destination according to the target stereo prompt sound according to the target traveling route.
9. An earphone device, characterized in that the earphone device comprises: memory, a processor and a program for prompting a travel route stored on the memory and executable on the processor, the program for prompting a travel route realizing the steps of the method for prompting a travel route according to any one of claims 1 to 7 when executed by the processor.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a prompting program of a travel route, which when executed by a processor implements the steps of the prompting method of a travel route according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211341816.1A CN115655300A (en) | 2022-10-28 | 2022-10-28 | Method and device for prompting traveling route, earphone equipment and computer medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211341816.1A CN115655300A (en) | 2022-10-28 | 2022-10-28 | Method and device for prompting traveling route, earphone equipment and computer medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115655300A true CN115655300A (en) | 2023-01-31 |
Family
ID=84993935
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211341816.1A Pending CN115655300A (en) | 2022-10-28 | 2022-10-28 | Method and device for prompting traveling route, earphone equipment and computer medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115655300A (en) |
-
2022
- 2022-10-28 CN CN202211341816.1A patent/CN115655300A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3253078B1 (en) | Wearable electronic device and virtual reality system | |
| US10650798B2 (en) | Electronic device, method and computer program for active noise control inside a vehicle | |
| US9924291B2 (en) | Distributed wireless speaker system | |
| US9508269B2 (en) | Remote guidance system | |
| US20120053826A1 (en) | Assisted guidance navigation | |
| EP2508010B1 (en) | An apparatus for processing audio signals in dependence of motion and orientation of the apparatus | |
| US7970539B2 (en) | Method of direction-guidance using 3D sound and navigation system using the method | |
| JP2016186786A (en) | Wearable smart device for hazard detection and warning based on image and audio data | |
| JP2017536595A (en) | Pedestrian information system | |
| KR101478951B1 (en) | Method and System for Pedestrian Safety using Inaudible Acoustic Proximity Alert Signal | |
| JP2013198065A (en) | Sound presentation device | |
| JPWO2006075606A1 (en) | Sound guide device, sound guide method, and sound guide program | |
| JP2007035043A (en) | Receiver, transmitter, and location recognition system and method | |
| US9826332B2 (en) | Centralized wireless speaker system | |
| CN110597477A (en) | Directional sound modification | |
| US20170238114A1 (en) | Wireless speaker system | |
| US20190353781A1 (en) | System of Tracking Acoustic Signal Receivers | |
| US9924286B1 (en) | Networked speaker system with LED-based wireless communication and personal identifier | |
| US10567872B2 (en) | Locally silenced sound field forming apparatus and method | |
| WO2020035143A1 (en) | Distributed microphones signal server and mobile terminal | |
| US20230116061A1 (en) | System and method of active noise cancellation in open field | |
| CN115655300A (en) | Method and device for prompting traveling route, earphone equipment and computer medium | |
| US20200175959A1 (en) | Apparatus, system, method and computer program | |
| JP5050950B2 (en) | Volume control system and portable terminal device | |
| JP2018078444A (en) | Perceptual support system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |