CN110363991B - Road condition analysis method, road condition analysis device, road condition analysis system and vehicle - Google Patents
Road condition analysis method, road condition analysis device, road condition analysis system and vehicle Download PDFInfo
- Publication number
- CN110363991B CN110363991B CN201910641200.8A CN201910641200A CN110363991B CN 110363991 B CN110363991 B CN 110363991B CN 201910641200 A CN201910641200 A CN 201910641200A CN 110363991 B CN110363991 B CN 110363991B
- Authority
- CN
- China
- Prior art keywords
- vehicle
- sound
- spectrum intensity
- state
- slope
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0125—Traffic data processing
- G08G1/0133—Traffic data processing for classifying traffic situation
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Atmospheric Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Traffic Control Systems (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Abstract
The application relates to a road condition analysis method, a road condition analysis device, a processing device, a road condition state analysis system and a vehicle. The method comprises the following steps: receiving audio data of a vehicle driving direction acquired by sound acquisition equipment; processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction; according to the sound spectrum intensity distribution in the sound spectrum intensity distribution diagram, the road condition state of the vehicle driving direction is determined, and the road condition state is transmitted to the vehicle to prompt the congestion condition of the vehicle driving direction.
Description
Technical Field
The present application relates to the field of intelligent driving technologies, and in particular, to a road condition analysis method, an apparatus, a processing device, a road condition analysis system, and a vehicle.
Background
The vehicle is a common vehicle for people to go out, but as more and more vehicles are on the road, the road is more and more congested, and the road is more and more complex, which causes great inconvenience for the people to go out, therefore, people use an assistant driving tool, such as a navigation map, to observe the state of the road ahead, and plan the road in advance, but the current assistant tool easily distracts the driver's attention, which may cause the driving safety hazard, and cannot be used in the area without network service, and therefore, in the implementation process, the inventor finds that at least the following problems exist in the conventional technology: the conventional driving assistance techniques do not provide assistance to driving well.
Disclosure of Invention
In view of the above, it is necessary to provide a road condition analysis method, a device, a processing device, a road condition analysis system and a vehicle capable of providing good assistance for driving.
A road condition analysis method comprises the following steps:
receiving audio data of a vehicle driving direction acquired by sound acquisition equipment;
processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction;
determining the road condition state of the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map, and transmitting the road condition state to the vehicle to prompt the congestion condition of the vehicle driving direction; the road condition state comprises any one or any combination of the following states: clear status, congested status, transition from clear status to congested status, and transition from congested status to clear status.
In one embodiment, the step of processing the audio data to obtain a distribution map of the intensity of the sound spectrum of the driving direction of the vehicle comprises:
processing the audio data, and acquiring the sound spectrum intensity of the audio data and the position information of a sound source corresponding to the audio data relative to the sound acquisition equipment;
and drawing a sound spectrum intensity distribution diagram according to the sound spectrum intensity and the position information.
In one embodiment, the position information includes a distance from a sound source corresponding to the audio data to the sound collection device;
the sound spectrum intensity distribution graph is a distribution graph of sound spectrum intensity in distance.
In one embodiment, the step of determining the road condition in the driving direction of the vehicle according to the intensity distribution of the sound spectrum in the intensity distribution map of the sound spectrum comprises:
dividing the sound spectrum intensity distribution graph into sections according to a preset distance interval;
acquiring the slope of the sound spectrum intensity distribution diagram in each section;
if the absolute value of the slope is equal to the preset absolute value of the slope, judging that the corresponding section is in a congestion state;
if the slope is greater than zero and the absolute value of the slope is greater than the absolute value of the preset slope, judging that the corresponding section is converted from the unblocked state to the blocked state;
and if the slope is smaller than zero and the absolute value of the slope is larger than the preset absolute value of the slope, judging that the corresponding section is converted from the congestion state to the unblocked state.
In one embodiment, the step of transmitting the road condition status to the vehicle to prompt the congestion condition of the vehicle driving direction comprises:
transmitting the road condition state to a voice system of the vehicle for broadcasting; or
And transmitting the road condition state to a display system of the vehicle for displaying.
A road condition analysis device includes:
the audio acquisition module is used for receiving audio data of the vehicle driving direction acquired by the sound acquisition equipment;
the processing module is used for processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction;
the judging module is used for determining the road condition state of the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map; the road condition state comprises any one or any combination of the following states: the method comprises the following steps of (1) enabling a user to be in an unblocked state, in a congested state, and in a state of being converted from the unblocked state to the congested state;
and the transmission module is used for transmitting the road condition state to the vehicle so as to prompt the congestion condition of the vehicle in the driving direction.
A processing device comprising a memory storing a computer program and a processor implementing the steps of the above method when executing the computer program.
A road condition analysis system comprises the processing equipment; the sound collection device is arranged on a front bumper of the vehicle;
the processing equipment is connected with the sound acquisition equipment and is also used for connecting a voice system and a display system of the vehicle.
A vehicle includes a vehicle body; the road condition analysis system is further included.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.
One of the above technical solutions has the following advantages and beneficial effects:
receiving audio data of a vehicle driving direction acquired by sound acquisition equipment; processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction; determining the road condition state of the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map, and transmitting the road condition state to the vehicle to prompt the congestion condition of the vehicle driving direction; the road condition states comprise an unblocked state, a blocked state, a state converted from the unblocked state to the blocked state and a state converted from the blocked state to the unblocked state, so that the road condition state analysis method judges the road condition state of the vehicle driving direction in real time by analyzing the audio data of the vehicle driving direction, prompts the acquired road condition state by the vehicle, is convenient for a driver to acquire the road condition state of the road ahead in time so as to plan a route, can avoid the driver from concentrating on driving to reduce safety risks, and provides good assistance for driving.
Drawings
Fig. 1 is a flow environment diagram of a traffic analysis method in an embodiment;
FIG. 2 is a schematic flow chart illustrating the steps of obtaining a spectral intensity profile in one embodiment;
FIG. 3 is a graph of spectral intensity distribution in one embodiment;
FIG. 4 is a schematic flow chart illustrating the step of distinguishing sound source types in one embodiment;
fig. 5 is a block diagram of a road condition analysis device in another embodiment;
FIG. 6 is a block diagram of processing modules in one embodiment;
FIG. 7 is a diagram of the internal structure of a processing device in one embodiment;
fig. 8 is a block diagram of a road condition analysis system according to an embodiment;
fig. 9 is a schematic structural view of a vehicle in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
In order to solve the problem that the conventional driving assistance technology cannot provide assistance for driving well, in one embodiment, as shown in fig. 1, a road condition analysis method is provided, which includes the following steps:
and step S110, receiving the audio data of the vehicle driving direction collected by the sound collection equipment.
The sound collection device may be mounted on a vehicle body of the vehicle, for example, on a front bumper of the vehicle, a hood of the vehicle, or a roof of the vehicle, as long as the sound collection device can satisfactorily collect audio in a vehicle traveling direction. The processing equipment receives audio data collected by the sound collection equipment, wherein the audio data comprises audio in a range from a starting point of the sound collection equipment to a final point of the sound collection equipment, and the audio data at least comprises audio emitted by a vehicle engine, audio emitted by a vehicle loudspeaker, audio emitted by a pedestrian and the like. The vehicle running direction refers to the direction that the head of the vehicle is in front, the tail of the vehicle is behind and the head points.
And step S120, processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction.
In an example, after receiving the audio data, the processing device analyzes the sound source of the audio data and the position information of the sound source corresponding to the sound collecting device, and according to the corresponding relationship between the sound source and the position information, draws a sound source density distribution diagram of the sound source changing along with the position information, and determines that the road is more congested at the position where the sound source is more densely distributed, otherwise, the road is more unobstructed. Wherein the position information includes a distance from the sound source to the sound collection device and may further include an orientation of the sound source with respect to the sound collection device. The distance from the sound source to the sound collection device can be obtained from the sound spectrum intensity and the audio phase.
In another example, after receiving the audio data, the processing device obtains a sound source of the audio data, position information of the sound source, and a sound spectrum intensity at the sound source of the audio data, and draws a sound spectrum intensity distribution map with the sound spectrum intensity varying with the position information according to a corresponding relationship between the sound spectrum intensity and the position information, wherein a position with stronger sound spectrum intensity determines that the road is more congested, and otherwise, the road is more unobstructed.
Step S130, determining a road condition state of the vehicle in the driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map, and transmitting the road condition state to the vehicle to prompt the congestion condition of the vehicle in the driving direction; the road condition state comprises any one or any combination of the following states: clear status, congested status, transition from clear status to congested status, and transition from congested status to clear status.
It should be noted that the sound spectrum intensity distribution condition is used to represent the intensity of the audio collected by the sound collection device in the vehicle driving direction. For example, the sound collection device may collect audio data within 500 meters of a vehicle driving direction, and after analyzing the audio data, it is determined that a road within a range of 0 to 100 meters is clear if the sound spectrum intensity is weak, and it is determined that a road within a range of 200 to 500 meters is congested if the sound spectrum intensity is strong. Further, the road condition status may be stored in a form of a graph, for example, in one graph, the distance from the sound source to the sound collecting device is plotted on the abscissa, and the road condition status is plotted on the ordinate; in a table, the distance from the sound source to the sound collecting device is taken as a column, and the road condition state is correspondingly drawn.
The clear state means that the number of pedestrians and vehicles on the road is within the range of the road bearing capacity, and the congestion state means that the number of pedestrians and vehicles on the road exceeds the road bearing capacity.
And the processing equipment transmits the road condition state obtained by analysis to the vehicle, and the vehicle reads the road condition state and prompts the congestion state of the driving direction of the vehicle.
In one example, the step of transmitting the road condition status to the vehicle for prompting the road condition status comprises:
transmitting the road condition state to a voice system of the vehicle for broadcasting; or the road condition state is transmitted to a display system of the vehicle for displaying. The display system can be a central control display screen or an instrument panel.
In each embodiment of the road condition analysis method, audio data of the vehicle driving direction collected by a sound collection device is received; processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction; determining the road condition state of the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map, and transmitting the road condition state to the vehicle to prompt the congestion condition of the vehicle driving direction; the road condition states comprise an unblocked state, a blocked state, a state converted from the unblocked state to the blocked state and a state converted from the blocked state to the unblocked state, so that the road condition state analysis method judges the road condition state of the vehicle driving direction in real time by analyzing the audio data of the vehicle driving direction, prompts the acquired road condition state by the vehicle, is convenient for a driver to acquire the road condition state of the road ahead in time so as to plan a route, can avoid the driver from concentrating on driving to reduce safety risks, and provides good assistance for driving.
In one embodiment, as shown in fig. 2, the step of processing the audio data to obtain the sound spectrum intensity distribution map of the vehicle driving direction includes:
step S210, processing the audio data, and acquiring the sound spectrum intensity of the audio data and the position information of a sound source corresponding to the audio data relative to the sound acquisition equipment;
and step S220, drawing a sound spectrum intensity distribution diagram according to the sound spectrum intensity and the position information.
It should be noted that, the audio data is processed to obtain the position information of the sound source corresponding to the audio data relative to the sound collection device and the sound spectrum intensity of the audio data at the sound source, and if a certain position includes multiple sound sources, the sound spectrum intensity at the position is the result of the superposition of the multiple sound sources.
The corresponding relation exists between the sound spectrum intensity and the position information, and the corresponding relation is drawn into a sound spectrum intensity distribution diagram. The sound spectrum intensity distribution map drawn is different when the position information includes different objects, and in the following two embodiments, a form of sound spectrum intensity distribution map is given respectively:
in one embodiment, the position information includes a distance from a sound source corresponding to the audio data to the sound collection device; the sound spectrum intensity distribution graph is a distribution graph of sound spectrum intensity in distance. The distance is a linear distance from the sound source to the sound collection device. And drawing a sound spectrum intensity distribution diagram by taking the distance from the sound source to the sound acquisition equipment as an abscissa and the sound spectrum intensity as an ordinate.
In the above embodiment, the step of determining the road condition state in the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map includes:
dividing the sound spectrum intensity distribution graph into sections according to a preset distance interval;
acquiring the slope of the sound spectrum intensity distribution diagram in each section;
if the absolute value of the slope is equal to the preset absolute value of the slope, judging that the corresponding section is in a congestion state;
if the slope is greater than zero and the absolute value of the slope is greater than the absolute value of the preset slope, judging that the corresponding section is converted from the unblocked state to the blocked state;
and if the slope is smaller than zero and the absolute value of the slope is larger than the preset absolute value of the slope, judging that the corresponding section is converted from the congestion state to the unblocked state.
It should be noted that the preset distance interval can be set according to the requirement of the analysis accuracy of the road condition, and the smaller the preset distance interval is, the higher the analysis accuracy of the road condition is. And obtaining the slope of the sound spectrum intensity distribution in each section by adopting a fitting method.
The preset slope is obtained in advance according to experiments, vehicles and pedestrians are filled in a road, sound is reasonably emitted, the sound acquisition equipment acquires audio data in the scene and transmits the audio data to the processing equipment, the processing equipment processes the audio data in the scene to obtain a corresponding sound spectrum intensity distribution diagram, and the preset efficiency is obtained by processing and changing the sound spectrum intensity distribution diagram.
To facilitate understanding of the above steps, a specific application of the present embodiment is now described as an example:
and the processing equipment calculates the distance according to the sound spectrum intensity and the phase of the audio data and obtains a sound spectrum intensity distribution diagram through conversion. As shown in fig. 3, the distribution diagram of the sound spectrum intensity in 4 meters to 24 meters, taking a common car as an example, has an average length of about 4 meters and is spaced by a preset distance of 4 meters. Curve 1 as in fig. 3 represents the case where there is a vehicle within 24 meters; as curve 2 in fig. 3 indicates a case where there is no vehicle in the range of 8 meters to 12 meters within 24 meters, a smooth graph is drawn through the processing device, respectively.
Curve 1: and when the vehicle exists within 24 meters, drawing the sound spectrum intensity and the distance into a stable curve according to the sound signal attenuation characteristic, wherein the average slope is less than 0, then carrying out statistics on the average slope of the curve every 4 meters to obtain 5 groups of average slope absolute values which are 5/4, 5/4, 6/4, 6/4 and 5/4 respectively, so that the preset slope absolute value can be 10/4.
Curve 2: if the average slope of the curve is smaller than 0 and the absolute value of the slope is larger than 10/4 in the range of 4-8 m, the congestion state is converted into the smooth state, and the vehicle-free state is determined at the position of 8 m; the slope of the curve in the range of 8 meters to 12 meters is 0, namely the state is unchanged (no vehicle state), and the slope of the curve in the range of 12 meters is in the no vehicle state; and in the range of 12-16 m, if the average slope of the curve is greater than 0 and the absolute value of the average slope is greater than 10/4, the smooth state is converted into the congestion state, and the vehicle is in the vehicle-in state in the range of 16-24 m.
In another embodiment, the position information includes a distance from a sound source corresponding to the audio data to the sound collection device, and an included angle between a direction in which the sound collection device points at the sound source corresponding to the audio data and a preset direction;
the sound spectrum intensity distribution map is a distribution map of a sound source on a space.
It should be noted that, the processing device processes the audio data acquired by the sound acquisition device, obtains a distance (a linear distance between the two) from the sound source corresponding to the audio data to the sound acquisition device, and an included angle between a connection line between the sound acquisition device and the sound source (i.e., a direction in which the sound acquisition device points to the sound source corresponding to the audio data) and a preset direction, and can obtain a sound spectrum intensity distribution map of the sound source along the actual road shape distribution through the distance and the included angle. In one example, whether a road is congested may be determined according to the density of sound source distribution, and the road is congested as the sound source distribution is denser. Wherein, the preset direction can be the geographical north and south, and the processing equipment has the function of identifying the direction.
In the embodiment, the sound spectrum intensity distribution diagram is analyzed, the distribution of sound sources corresponding to the audio data on the space is obtained, and the road type of the vehicle running direction is obtained; the road type is a straight road, a turnout road or a curve. It should be noted that, according to the shape of the sound source distribution, the road type can be determined, so that the driver can make a driving strategy in advance.
In each embodiment of the road condition analysis method, different types of sound spectrum intensity distribution maps are obtained according to different position information obtained by processing audio data, different functions are realized through the acquired audio data, and better assistance is provided for driving.
In one embodiment, as shown in fig. 4, the road condition analyzing method further includes the steps of:
step S410, processing the audio data, and acquiring the sound source type of the audio data; the sound source types comprise a pedestrian sound source and a vehicle sound source;
in step S420, if the number of pedestrian sound sources at any position is greater than the number of vehicle sound sources in the vehicle driving direction, the vehicle is prompted to slow down.
It should be noted that the audio collected by the sound collection device includes audio emitted by various different types of sound sources, and the different types of sound sources are distinguished through processing, and when it is identified that a pedestrian sound source is more than a vehicle sound source, it is determined that the front part may be an urban area or a sidewalk, and the processing is to notify the vehicle, so as to prompt the driver to retrieve the slow-going part.
In each embodiment of the road condition analysis method, the travel safety is ensured by distinguishing the types of the sound sources and reminding the driving safety.
It should be understood that although the various steps in the flowcharts of fig. 1, 2 or 4 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1, 2 or 4 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternatingly with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 5, a traffic analyzing apparatus is provided, which includes:
the audio acquisition module 51 is configured to receive audio data of a vehicle driving direction acquired by the sound acquisition device;
the processing module 53 is configured to process the audio data to obtain a sound spectrum intensity distribution map of the vehicle driving direction;
the judging module 55 is configured to determine a road condition state in the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map; the road condition state comprises any one or any combination of the following states: the method comprises the following steps of (1) enabling a user to be in an unblocked state, in a congested state, and in a state of being converted from the unblocked state to the congested state;
and the transmission module 57 is used for transmitting the road condition state to the vehicle so as to prompt the congestion condition of the vehicle in the driving direction.
In one embodiment, as shown in FIG. 6, the processing module includes:
the processing unit 531 is configured to process the audio data, and obtain a sound spectrum intensity of the audio data and position information of a sound source corresponding to the audio data relative to the sound collection device;
the distribution graph obtaining unit 533 is configured to draw a sound spectrum intensity distribution graph according to the sound spectrum intensity and the position information.
For the specific limitations of the traffic analysis device, reference may be made to the above limitations of the traffic analysis method, which is not described herein again. All modules in the road condition analysis device can be completely or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a processing device is provided, which may be a system on a chip, and its internal structure diagram may be as shown in fig. 7. The processing device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the processing device is configured to provide computing and control capabilities. The memory of the processing device includes a nonvolatile storage medium, an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the processing device is used for storing audio data. The network interface of the processing device is used for communicating with an external terminal through network connection. The computer program is executed by a processor to implement a traffic analysis method.
Those skilled in the art will appreciate that the architecture shown in fig. 7 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, there is provided a processing device comprising a memory and a processor, the memory having stored therein a computer program, the processor implementing the following steps when executing the computer program:
receiving audio data of a vehicle driving direction acquired by sound acquisition equipment;
processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction;
determining the road condition state of the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map, and transmitting the road condition state to the vehicle to prompt the congestion condition of the vehicle driving direction; the road condition state comprises any one or any combination of the following states: clear status, congested status, transition from clear status to congested status, and transition from congested status to clear status.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
processing the audio data, and acquiring the sound spectrum intensity of the audio data and the position information of a sound source corresponding to the audio data relative to the sound acquisition equipment;
and drawing a sound spectrum intensity distribution diagram according to the sound spectrum intensity and the position information.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
dividing the sound spectrum intensity distribution graph into sections according to a preset distance interval;
acquiring the slope of the sound spectrum intensity distribution diagram in each section;
if the absolute value of the slope is equal to the preset absolute value of the slope, judging that the corresponding section is in a congestion state;
if the slope is greater than zero and the absolute value of the slope is greater than the absolute value of the preset slope, judging that the corresponding section is converted from the unblocked state to the blocked state;
and if the slope is smaller than zero and the absolute value of the slope is larger than the preset absolute value of the slope, judging that the corresponding section is converted from the congestion state to the unblocked state.
In an embodiment, as shown in fig. 8, a traffic analysis system is provided, which includes a processing device 83 according to the embodiments of the processing device of the present application; further includes a sound collection device 81 provided at a front bumper of the vehicle;
the processing device 83 is connected with the sound collecting device 81 and is also used for connecting a voice system and a display system of the vehicle.
Note that the sound collection device is mounted on a vehicle front bumper. Further, to save costs, the processing device may be implemented using a device on the vehicle.
In the embodiments of the road condition analysis system, the road condition state of the vehicle driving direction can be analyzed by using the collected audio data, the structure is simple, the implementation is easy, and good information is provided for driving.
In one embodiment, as shown in fig. 9, there is provided a vehicle including a vehicle body 91; the system further comprises a road condition analysis system 93 in each embodiment of the road condition analysis system.
In each embodiment of the vehicle, the vehicle is safer due to the installed road condition analysis system, and the auxiliary driving is more intelligent.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
receiving audio data of a vehicle driving direction acquired by sound acquisition equipment;
processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction;
determining the road condition state of the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map, and transmitting the road condition state to the vehicle to prompt the congestion condition of the vehicle driving direction; the road condition state comprises any one or any combination of the following states: clear status, congested status, transition from clear status to congested status, and transition from congested status to clear status.
In one embodiment, the computer program when executed by the processor further performs the steps of:
processing the audio data, and acquiring the sound spectrum intensity of the audio data and the position information of a sound source corresponding to the audio data relative to the sound acquisition equipment;
and drawing a sound spectrum intensity distribution diagram according to the sound spectrum intensity and the position information.
In one embodiment, the computer program when executed by the processor further performs the steps of:
dividing the sound spectrum intensity distribution graph into sections according to a preset distance interval;
acquiring the slope of the sound spectrum intensity distribution diagram in each section;
if the absolute value of the slope is equal to the preset absolute value of the slope, judging that the corresponding section is in a congestion state;
if the slope is greater than zero and the absolute value of the slope is greater than the absolute value of the preset slope, judging that the corresponding section is converted from the unblocked state to the blocked state;
and if the slope is smaller than zero and the absolute value of the slope is larger than the preset absolute value of the slope, judging that the corresponding section is converted from the congestion state to the unblocked state.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the claims. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A road condition analysis method is characterized by comprising the following steps:
receiving audio data of a vehicle driving direction acquired by sound acquisition equipment, wherein the audio data at least comprises audio emitted by a vehicle engine, audio emitted by a vehicle loudspeaker and audio emitted by a pedestrian;
processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction;
dividing the sound spectrum intensity distribution graph into sections according to a preset distance interval;
acquiring the slope of the sound spectrum intensity distribution diagram in each section;
if the absolute value of the slope is equal to the absolute value of the preset slope, judging that the corresponding section is in a congestion state;
if the slope is larger than zero and the absolute value of the slope is larger than the preset slope absolute value, judging that the corresponding section is converted from an unblocked state to a congested state;
if the slope is smaller than zero and the absolute value of the slope is larger than the preset absolute value of the slope, judging that the corresponding section is converted from a congestion state to an unblocked state;
transmitting the road condition state to the vehicle to prompt the congestion state of the vehicle in the driving direction; the road condition state comprises any one or any combination of the following states: clear status, congested status, transition from clear status to congested status, and transition from congested status to clear status.
2. The traffic analysis method according to claim 1, wherein the step of processing the audio data to obtain the sound spectrum intensity distribution map of the driving direction of the vehicle comprises:
processing the audio data, and acquiring the sound spectrum intensity of the audio data and the position information of a sound source corresponding to the audio data relative to the sound acquisition equipment;
and drawing the sound spectrum intensity distribution graph according to the sound spectrum intensity and the position information.
3. The traffic analysis method according to claim 2, wherein the location information includes a distance from a sound source corresponding to the audio data to the sound collection device;
the sound spectrum intensity distribution graph is a distribution graph of sound spectrum intensity on distance.
4. A traffic analysis method according to any one of claims 1 to 3, wherein the step of transmitting the traffic status to the vehicle to prompt the congestion status of the vehicle in the driving direction comprises:
transmitting the road condition state to a voice system of a vehicle for broadcasting; or
And transmitting the road condition state to a display system of the vehicle for displaying.
5. A road condition analysis device, comprising:
the audio acquisition module is used for receiving audio data of the vehicle driving direction acquired by the sound acquisition equipment, wherein the audio data at least comprises audio emitted by a vehicle engine, audio emitted by a vehicle loudspeaker and audio emitted by pedestrians;
the processing module is used for processing the audio data to obtain a sound spectrum intensity distribution map of the vehicle running direction;
the judging module is used for determining the road condition state of the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map; the road condition state comprises any one or any combination of the following states: the method comprises the following steps of (1) enabling a user to be in an unblocked state, in a congested state, and in a state of being converted from the unblocked state to the congested state;
the determining the road condition state of the vehicle driving direction according to the sound spectrum intensity distribution in the sound spectrum intensity distribution map comprises:
dividing the sound spectrum intensity distribution graph into sections according to a preset distance interval;
acquiring the slope of the sound spectrum intensity distribution diagram in each section;
if the absolute value of the slope is equal to the absolute value of the preset slope, judging that the corresponding section is in a congestion state;
if the slope is larger than zero and the absolute value of the slope is larger than the preset slope absolute value, judging that the corresponding section is converted from an unblocked state to a congested state;
if the slope is smaller than zero and the absolute value of the slope is larger than the preset absolute value of the slope, judging that the corresponding section is converted from a congestion state to an unblocked state;
and the transmission module is used for transmitting the road condition state to the vehicle so as to prompt the congestion condition of the vehicle in the driving direction.
6. The traffic analyzing apparatus of claim 5, wherein the processing module comprises:
the processing unit is used for processing the audio data and acquiring the sound spectrum intensity of the audio data and the position information of a sound source corresponding to the audio data relative to the sound acquisition equipment;
and the distribution diagram acquisition unit is used for drawing the sound spectrum intensity distribution diagram according to the sound spectrum intensity and the position information.
7. A processing device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor realizes the steps of the method of any of claims 1 to 4 when executing the computer program.
8. A traffic analysis system comprising the processing device of claim 7; the sound collection device is arranged on a front bumper of the vehicle;
the processing equipment is connected with the sound collecting equipment and is also used for connecting a voice system and a display system of a vehicle.
9. A vehicle, characterized by comprising a vehicle body; the traffic analysis system of claim 8.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910641200.8A CN110363991B (en) | 2019-07-16 | 2019-07-16 | Road condition analysis method, road condition analysis device, road condition analysis system and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910641200.8A CN110363991B (en) | 2019-07-16 | 2019-07-16 | Road condition analysis method, road condition analysis device, road condition analysis system and vehicle |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110363991A CN110363991A (en) | 2019-10-22 |
| CN110363991B true CN110363991B (en) | 2021-01-08 |
Family
ID=68219588
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910641200.8A Active CN110363991B (en) | 2019-07-16 | 2019-07-16 | Road condition analysis method, road condition analysis device, road condition analysis system and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110363991B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112109715B (en) * | 2020-09-14 | 2022-06-14 | 华人运通(上海)云计算科技有限公司 | Method, device, medium and system for generating vehicle power output strategy |
| CN112634650B (en) * | 2020-12-18 | 2021-10-26 | 中标慧安信息技术股份有限公司 | Parking lot management method and system based on audio and video monitoring |
| CN114885257B (en) * | 2022-07-12 | 2022-11-04 | 北京远特科技股份有限公司 | Audio processing method and device, electronic equipment and storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3285084A2 (en) * | 2016-08-16 | 2018-02-21 | Delphi Technologies, Inc. | Vehicle communication system for cloud-hosting sensor-data |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101877170A (en) * | 2009-12-20 | 2010-11-03 | 西安信唯信息科技有限公司 | Urban traffic video management system based on GPS (Global Positioning System) |
| CN102402864A (en) * | 2010-09-08 | 2012-04-04 | 叶朝晖 | Interactive traffic navigation method based on wireless communication network and system |
| CN102095427A (en) * | 2010-12-09 | 2011-06-15 | 深圳市凯立德欣软件技术有限公司 | Navigation method and device |
| CN102390319A (en) * | 2011-11-11 | 2012-03-28 | 上海电机学院 | Intelligent alarming system and method thereof |
| CN102682765B (en) * | 2012-04-27 | 2013-09-18 | 中咨泰克交通工程集团有限公司 | Expressway audio vehicle detection device and method thereof |
| JP6128423B2 (en) * | 2013-02-19 | 2017-05-17 | いすゞ自動車株式会社 | Driving assistance device |
| CN104123833B (en) * | 2013-04-25 | 2017-07-28 | 北京搜狗信息服务有限公司 | A kind of planning method and device of condition of road surface |
| CN104236577B (en) * | 2014-09-19 | 2017-06-27 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| KR101977090B1 (en) * | 2015-07-22 | 2019-05-10 | 엘지전자 주식회사 | Control device for vehicle and method for controlling vehicle |
| JP6682222B2 (en) * | 2015-09-24 | 2020-04-15 | キヤノン株式会社 | Detecting device, control method thereof, and computer program |
| CN105225508B (en) * | 2015-09-29 | 2017-10-10 | 小米科技有限责任公司 | Road condition advisory method and device |
| CN105261214B (en) * | 2015-10-09 | 2021-02-26 | 深圳市凯立德科技股份有限公司 | Road condition prediction method, device and server |
| CN106023592A (en) * | 2016-07-11 | 2016-10-12 | 南京邮电大学 | Traffic jam detection method based on GPS data |
| DE102017200153A1 (en) * | 2017-01-09 | 2018-07-12 | Ford Global Technologies, Llc | Method for detecting traffic situations |
| CN107660021A (en) * | 2017-09-22 | 2018-02-02 | 南京律智诚专利技术开发有限公司 | A kind of intelligent control device of street lamps |
| CN108010517B (en) * | 2017-12-06 | 2020-09-11 | 英业达科技有限公司 | Road condition information transmission system and method thereof |
| CN109472973B (en) * | 2018-03-19 | 2021-01-19 | 国网浙江桐乡市供电有限公司 | Real-time traffic display method based on voice recognition |
| CN108399778A (en) * | 2018-05-08 | 2018-08-14 | 深圳市易成自动驾驶技术有限公司 | Swarm intelligence congestion reminding method, system and computer readable storage medium |
| CN109186620A (en) * | 2018-08-14 | 2019-01-11 | 奇酷互联网络科技（深圳）有限公司 | A kind of intelligent navigation method, navigation terminal and storage medium |
| CN109591688A (en) * | 2018-11-29 | 2019-04-09 | 上海九山电子科技有限公司 | The optical system of the control system of Vehicular display device, method and display device for mounting on vehicle |
-
2019
- 2019-07-16 CN CN201910641200.8A patent/CN110363991B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3285084A2 (en) * | 2016-08-16 | 2018-02-21 | Delphi Technologies, Inc. | Vehicle communication system for cloud-hosting sensor-data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110363991A (en) | 2019-10-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110363991B (en) | Road condition analysis method, road condition analysis device, road condition analysis system and vehicle | |
| US20190088122A1 (en) | System and method for driving assistance along a path | |
| JP6201102B2 (en) | Automotive and computing systems | |
| DE112016006157B4 (en) | Information providing device, information providing server and information providing method | |
| EP2136345A1 (en) | Travel time calculation server, vehicle travel time calculation device, and travel time calculation system | |
| CN111127949B (en) | Vehicle high-risk road section early warning method and device and storage medium | |
| US11643103B2 (en) | Navigation considering route driving difficulty | |
| US11051146B2 (en) | Information processing apparatus and information processing program | |
| EP2629275A1 (en) | Vehicle information processing system and driving assistance system | |
| CN106062845A (en) | Driving assistance system, method, and program | |
| CN110849382A (en) | Driving duration prediction method and device | |
| CN113706912A (en) | Auxiliary driving method and system for vehicle, terminal device and storage medium | |
| CN107591025A (en) | The method for early warning and system, server, car terminals, memory of vehicle traveling | |
| CN105346541A (en) | Car driving speed-limiting system based on GIS and running method of car driving speed-limiting system based on GIS | |
| CN104575067A (en) | System for automatic calculation, interactive sharing and publishing of real-time vehicle travelling data | |
| CN110969876A (en) | Signal lamp state display system and method | |
| CN105809095A (en) | Method for determining traffic crossing traffic state | |
| DE102010043673A1 (en) | Navigation system installed in vehicle, has traffic disruption detection device to detect traffic disruption by using data corresponding to driving state of vehicle, vehicle position and road class | |
| CN107680396A (en) | The monitoring method and its device of a kind of driving behavior | |
| DE102017105762A1 (en) | SYSTEM AND METHOD FOR VIRTUALLY CONVERTING STANDARD OR NON-ASSOCIATED VEHICLES | |
| CN109278747B (en) | Vehicle monitoring system and method | |
| CN112185157B (en) | Roadside parking space detection method, system, computer equipment and storage medium | |
| CN115649172A (en) | Vehicle traffic intersection information screening method based on Internet of vehicles | |
| JP2009217716A (en) | Traffic information processing system, in-vehicle device, traffic information processing method and traffic information processing program | |
| CN209980481U (en) | ADAS anticollision intelligence early warning monitoring facilities |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 519000 No. 333, Kexing Road, Xiangzhou District, Zhuhai City, Guangdong Province Patentee after: ZHUHAI JIELI TECHNOLOGY Co.,Ltd. Address before: Floor 1-107, building 904, ShiJiHua Road, Zhuhai City, Guangdong Province Patentee before: ZHUHAI JIELI TECHNOLOGY Co.,Ltd. |