CN111666906A - Prompt message generation method and device, electronic equipment and storage medium - Google Patents
Prompt message generation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111666906A CN111666906A CN202010525325.7A CN202010525325A CN111666906A CN 111666906 A CN111666906 A CN 111666906A CN 202010525325 A CN202010525325 A CN 202010525325A CN 111666906 A CN111666906 A CN 111666906A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- pedestrian
- detection
- target
- traffic intersection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/54—Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/017—Detecting movement of traffic to be counted or controlled identifying vehicles
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
The present disclosure provides a method, an apparatus, an electronic device and a storage medium for generating prompt information, wherein the method comprises: continuously acquiring scene images of a traffic intersection, and performing pedestrian detection and vehicle detection on the scene images; generating alarm prompt information under the condition that a pedestrian red light running event is determined to exist according to the result of pedestrian detection and traffic signal light information corresponding to the traffic intersection; and sending the alarm prompt information to the target vehicle under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result.
Description
Technical Field
The present disclosure relates to the field of internet technologies, and in particular, to a method and an apparatus for generating a prompt message, an electronic device, and a storage medium.
Background
At present, in order to maintain road traffic order, prevent and reduce traffic accidents, protect personal safety, pedestrians and drivers need to comply with traffic regulations, that is, pedestrians need to cross roads according to the regulations of the traffic regulations, and drivers need to drive vehicles according to the regulations of the traffic regulations.
However, a red light running behavior exists when some pedestrians cross the road, and due to the irregular road crossing behavior of the pedestrians, when the driver does not react in time, the vehicle may collide with the pedestrians, so that the life safety of the pedestrians is damaged.
Disclosure of Invention
In view of the above, the present disclosure provides at least a method and an apparatus for generating hint information, an electronic device, and a storage medium.
In a first aspect, the present disclosure provides a method for generating a prompt message, including:
continuously acquiring scene images of a traffic intersection, and performing pedestrian detection and vehicle detection on the scene images;
generating alarm prompt information under the condition that a pedestrian red light running event is determined to exist according to the result of pedestrian detection and traffic signal light information corresponding to the traffic intersection;
and sending the alarm prompt information to the target vehicle under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result.
In the method, the pedestrian detection and the vehicle detection are carried out on the scene images of the traffic intersection by continuously acquiring the scene images; generating alarm prompt information under the condition that a pedestrian red light running event is determined to exist according to the result of pedestrian detection and traffic signal light information corresponding to a traffic intersection; sending alarm prompt information to a target vehicle under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result; the target vehicle receiving the alarm prompt information can decelerate and crawl, the collision of the pedestrian is avoided, the collision danger of the pedestrian and the vehicle is reduced, and the driving safety is improved.
In one possible embodiment, the pedestrian detection and the vehicle detection are performed on the scene image, and the method comprises the following steps:
detecting pedestrians and vehicles in the scene image according to a first target detection model and a second target detection model which are trained in advance; the first target detection model is obtained by training based on an image sample marked with pedestrian information, and the second target detection model is obtained by training based on an image sample marked with vehicle information.
In one possible embodiment, determining that there is a target vehicle to pass through the traffic intersection according to a result of the vehicle detection includes:
and under the condition that the vehicle exists in the scene image according to the result of the vehicle detection, determining whether the existing vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future according to the driving direction and the current position of the vehicle.
In one possible embodiment, determining whether the existing vehicle is the target vehicle passing through the traffic intersection within a preset time period in the future according to the driving direction and the current position of the vehicle comprises:
and if the driving direction of the vehicle is the direction towards the pedestrian and the current position of the vehicle is within a set position range, determining that the vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future.
In a possible embodiment, the method further comprises:
and controlling the color of a target traffic light of the traffic intersection to change under the condition that the red light running event of the pedestrian is determined to exist according to the detection result of the pedestrian and the traffic light information corresponding to the traffic intersection.
In one possible implementation, the alarm prompt message comprises a pedestrian alarm prompt message and/or a deceleration crawling prompt message;
sending the warning prompt message to the target vehicle, including:
and sending the alarm prompt information to the target vehicle in a voice format.
The following descriptions of the effects of the apparatus, the electronic device, and the like refer to the description of the above method, and are not repeated here.
In a second aspect, the present disclosure provides a prompt information generating apparatus, including:
the detection module is used for continuously acquiring scene images of a traffic intersection and carrying out pedestrian detection and vehicle detection on the scene images;
the determining module is used for generating alarm prompt information under the condition that a pedestrian red light running event is determined to exist according to the pedestrian detection result and the traffic signal lamp information corresponding to the traffic intersection;
and the prompting module is used for sending the alarm prompting information to the target vehicle under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result.
In one possible embodiment, the detection module, when performing pedestrian detection and vehicle detection on the scene image, is configured to:
detecting pedestrians and vehicles in the scene image according to a first target detection model and a second target detection model which are trained in advance; the first target detection model is obtained by training based on an image sample marked with pedestrian information, and the second target detection model is obtained by training based on an image sample marked with vehicle information.
In one possible embodiment, the prompting module, when determining that there is a target vehicle to pass through the traffic intersection according to a result of the vehicle detection, is configured to:
and under the condition that the vehicle exists in the scene image according to the result of the vehicle detection, determining whether the existing vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future according to the driving direction and the current position of the vehicle.
In one possible embodiment, the prompting module, when determining whether the existing vehicle is the target vehicle passing through the traffic intersection within a preset time period in the future according to the driving direction and the current position of the vehicle, is configured to:
and if the driving direction of the vehicle is the direction towards the pedestrian and the current position of the vehicle is within a set position range, determining that the vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future.
In a possible embodiment, the method further comprises:
and the control module is used for controlling the color of a target traffic light of the traffic intersection to change under the condition that the pedestrian red light running event is determined to exist according to the result of the pedestrian detection and the traffic light information corresponding to the traffic intersection.
In one possible implementation, the alarm prompt message comprises a pedestrian alarm prompt message and/or a deceleration crawling prompt message;
the prompting module is used for sending the alarm prompting information to the target vehicle:
and sending the alarm prompt information to the target vehicle in a voice format.
In a third aspect, the present disclosure provides an electronic device comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, the processor and the memory communicate via the bus when the electronic device is running, and the machine-readable instructions, when executed by the processor, perform the steps of the hint information generation method as described in the first aspect or any one of the embodiments.
In a fourth aspect, the present disclosure provides a computer-readable storage medium, having a computer program stored thereon, where the computer program is executed by a processor to perform the steps of the prompt information generating method according to the first aspect or any one of the embodiments.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.
Fig. 1 is a schematic flowchart illustrating a method for generating a prompt message according to an embodiment of the present disclosure;
FIG. 2 is a diagram illustrating an example of a method for generating hint information provided by an embodiment of the present disclosure;
fig. 3 is a schematic diagram illustrating an architecture of a hint information generation apparatus provided by an embodiment of the present disclosure;
fig. 4 shows a schematic structural diagram of an electronic device 400 provided in an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
At present, pedestrians need to cross roads according to the regulations of traffic rules, and drivers also need to drive vehicles according to the regulations of traffic rules. However, a red light running behavior exists when some pedestrians cross the road, and due to the irregular road crossing behavior of the pedestrians, when the driver does not react in time, accidents that vehicles collide with the pedestrians can be caused, and the life safety of the pedestrians is harmed.
In order to solve the above problem, the embodiments of the present disclosure provide a method for generating prompt information, in which scene images of a traffic intersection are continuously obtained, and pedestrian detection and vehicle detection are performed on the scene images; generating alarm prompt information under the condition that a pedestrian red light running event is determined to exist according to the result of pedestrian detection and traffic signal light information corresponding to a traffic intersection; sending alarm prompt information to a target vehicle under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result; the target vehicle receiving the alarm prompt information can decelerate and crawl, the collision of the pedestrian is avoided, the collision danger of the pedestrian and the vehicle is reduced, and the driving safety is improved.
In order to facilitate understanding of the embodiment of the present disclosure, a detailed description is first given of a prompt information generation method disclosed in the embodiment of the present disclosure.
Referring to fig. 1, a schematic flow diagram of a method for generating a prompt message according to an embodiment of the present disclosure is provided, where an execution subject of the method may be a server, the server may be a local server or a cloud server, and the method includes S101-S103, where:
s101, continuously acquiring scene images of a traffic intersection, and performing pedestrian detection and vehicle detection on the scene images.
And S102, generating alarm prompt information under the condition that the pedestrian red light running event is determined to exist according to the pedestrian detection result and the traffic signal light information corresponding to the traffic intersection.
S103, under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result, the alarm prompt information is sent to the target vehicle.
In the method, the pedestrian detection and the vehicle detection are carried out on the scene images of the traffic intersection by continuously acquiring the scene images; generating alarm prompt information under the condition that a pedestrian red light running event is determined to exist according to the result of pedestrian detection and traffic signal light information corresponding to a traffic intersection; sending alarm prompt information to a target vehicle under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result; the target vehicle receiving the alarm prompt information can decelerate and crawl, the collision of the pedestrian is avoided, the collision danger of the pedestrian and the vehicle is reduced, and the driving safety is improved.
For S101:
here, it is possible to continuously acquire scene images of a traffic intersection using a camera device provided at the traffic intersection, and perform pedestrian detection and vehicle detection with respect to the continuously acquired scene images. For example, the first camera device may be located at a traffic light position indicating straight-ahead movement, and the second camera device may be located at a traffic light position indicating whether pedestrians can pass or not, so that the images respectively acquired by the first camera device and the second camera device are determined as the acquired scene images of the traffic intersection.
In an alternative embodiment, the pedestrian detection and the vehicle detection performed on the scene image may include: detecting pedestrians and vehicles in the scene image according to a first target detection model and a second target detection model which are trained in advance; the first target detection model is obtained by training based on the image sample marked with the pedestrian information, and the second target detection model is obtained by training based on the image sample marked with the vehicle information.
Here, the first target detection model may be trained using the image sample labeled with the pedestrian information until the accuracy of the trained first target detection model is greater than a set threshold, resulting in a pre-trained first target detection model. And training a second target detection model by using the image sample marked with the vehicle information until the accuracy of the trained second target detection model is greater than a set threshold value, so as to obtain a pre-trained second target detection model.
The scene image may be respectively input to the first target detection model and the second target detection model, and a pedestrian detection result and a vehicle detection result corresponding to the scene image are obtained, that is, at least one pedestrian and at least one vehicle included in the scene image are detected. In specific implementation, the contour of each pedestrian and the position information of each pedestrian can be detected, and the contour of each vehicle can be detected.
When the scene image includes multiple frames of images, each frame of image in the scene image may be input into the first target detection model, a pedestrian included in each frame of image is detected, the pedestrian detection results of each frame of image in the scene image are collected, and a result of pedestrian detection corresponding to the scene image is obtained, for example, intersections of pedestrians whose positions are coincident in each frame of image are obtained, and a collected result of pedestrian detection is obtained.
Meanwhile, each frame of image in the scene image may be input into the second target detection model, a vehicle included in each frame of image is detected, vehicle detection results of each frame of image in the scene image are summarized, and a vehicle detection result corresponding to the scene image is obtained, for example, intersection of vehicles with coincident positions in each frame of image is taken, and a summarized vehicle detection result is obtained.
For S102:
if the result of the pedestrian detection indicates that the position information of any pedestrian is positioned on the traffic road and the traffic signal lamp corresponding to the traffic intersection is a red light, determining that a pedestrian red light running event exists; if the result of the pedestrian detection indicates that the position information of the pedestrian is not located on the traffic road (namely the position information of each pedestrian in the scene image is located on two sides of the road), or the traffic signal lamp corresponding to the traffic intersection is a green light, it is determined that the red light running event of the pedestrian does not exist.
In specific implementation, the traffic signal light information corresponding to the traffic intersection can be extracted from the scene image, and can also be determined according to the traffic signal light transformation rule corresponding to the traffic intersection.
In an alternative embodiment, the warning prompt message may include a pedestrian warning prompt message and/or a slowdown and crawl prompt message. And further sending the alarm prompt message to the target vehicle, which may include: and sending the alarm prompt information to the target vehicle in a voice format.
For example, the alert notification may include pedestrian alert notification such as: the pedestrian is present at the intersection ahead, please notice. The alert prompt may also include slowdown and crawl prompt information, such as: please slow down the road ahead. After generating the alert prompt, the alert prompt may be transmitted to the target vehicle in a voice format. For example, alert prompts may be broadcast to the target vehicle.
For S103:
here, the target vehicle may be determined first according to the result of the vehicle detection, and then the warning notice information may be transmitted to the target vehicle.
In an alternative embodiment, determining that there is a target vehicle to pass through the traffic intersection according to the result of the vehicle detection may include: and under the condition that the vehicle exists in the scene image according to the result of the vehicle detection, determining whether the existing vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future according to the driving direction and the current position of the vehicle.
Here, when it is determined that there is a vehicle in the scene image after the scene image is detected, it may be determined whether the vehicle that exists is a target vehicle that passes through the traffic intersection within a preset time period in the future, according to the traveling direction and the current position of the vehicle. The driving direction and the current position of the vehicle may be determined by a Global Positioning System (GPS) provided in the vehicle.
In the embodiment, the target vehicles passing through the traffic intersection within the preset time length in the future can be determined, the early warning prompt information is sent to each target vehicle, and the driving safety of each target vehicle is improved.
In an alternative embodiment, determining whether the existing vehicle is the target vehicle passing through the traffic intersection within a preset time period in the future according to the driving direction and the current position of the vehicle may include: and if the driving direction of the vehicle is the direction towards the pedestrian and the current position of the vehicle is within the set position range, determining that the vehicle is the target vehicle passing through the traffic intersection within the preset time length in the future.
Here, if the driving direction of the vehicle is toward a pedestrian running a red light, and the current position of the vehicle is within the set position range, the vehicle is determined to be a target vehicle passing through the traffic intersection within a preset time period in the future. The position range can be an area which takes the intersection corresponding to the behavior of the pedestrian running the red light as the center and extends 50 meters to two directions of the road.
Referring to fig. 2, the figure includes a plurality of vehicles 21, pedestrians 22, and traffic lights 23, where the traffic light 23 indicates whether a pedestrian can pass through the red light, and when the pedestrian 22 is located in a traffic road, the pedestrian 22 has a red light running behavior, and the 100 m range is a set position range (for example, a dashed range in fig. 2), with an intersection where the pedestrian is located as a center, extends 50 m in a north direction and 50 m in a south direction. The extending distance can be set according to needs, and for example, may also be 30 meters, 100 meters, and the like. And then, determining the vehicle with the current position within the set position range and the running direction facing the pedestrian as a target vehicle, and sending the generated early warning prompt information to the target vehicle. As can be seen from the figure, the vehicles at the position 1 and the position 3 are driving in the direction toward the pedestrian, and the position information is within the set position range, so the vehicles at the position 1 and the position 3 are target vehicles; the vehicles at positions 2 and 4 travel in the direction away from the pedestrian, so the vehicles at positions 2 and 4 are non-target vehicles.
And if the driving direction of the vehicle is away from the pedestrian running the red light, or the current position of the vehicle is out of the set position range, determining that the vehicle is not the target vehicle.
In an alternative embodiment, the method further comprises: and under the condition that the pedestrian red light running event exists according to the pedestrian detection result and the traffic signal light information corresponding to the traffic intersection, controlling the color of the target traffic signal light of the traffic intersection to change.
Here, when it is determined that there is an event that a pedestrian runs a red light at the traffic intersection, the target traffic signal lamp may be determined according to the position of the pedestrian on the road. For example, if the pedestrian is located at a position where the vehicle is driving from north to south (i.e., the pedestrian is located in the position in fig. 2), the color of the traffic light indicating whether the vehicle is drivable from north to south is changed to red (i.e., the color of the traffic light facing the vehicle at position 1 in fig. 2 may be changed to red), so that the vehicle at position 1 stops driving and avoids collision with the pedestrian; and the color of the traffic signal lamp indicating whether the vehicle can run from north to south is not changed (i.e. the color of the traffic signal lamp corresponding to the vehicle at the position 3 in fig. 2 is not changed), so that the vehicle at the position 3 can normally run.
Further, if the pedestrian in fig. 2 walks to the position 5, the color of the traffic signal light faced by the vehicle at the position 3 is controlled to change, for example, to red, so that the vehicle at the position 3 stops running and avoids collision with the pedestrian. And the color of the traffic signal or the like that the vehicle at the position 1 faces is restored to the green light so that the vehicle at the position 1 can normally travel.
In specific implementation, a traffic light indicating whether straight running is possible is selected from the traffic intersection as a target traffic light, the color of the target traffic light is controlled to change so as to attract the attention of a driver in a target vehicle (i.e. the driver is prompted that a pedestrian runs a red light), and for example, the traffic light can be changed into a yellow light and flickered for 5 seconds. Or, a prompt traffic signal lamp can be arranged at the traffic intersection, the prompt traffic signal lamp is the target traffic signal lamp, and the color of the set prompt traffic signal lamp is controlled to change. Wherein, the color change rule of the target traffic signal lamp can be set according to the requirement. Or after the target vehicle receives the early warning prompt information, the target vehicle can also perform operations such as turning on and whistling of the vehicle lamps to prompt pedestrians that the vehicle passes through.
It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.
Based on the same concept, an embodiment of the present disclosure further provides a prompt information generating device, as shown in fig. 3, which is an architecture schematic diagram of the prompt information generating device provided in the embodiment of the present disclosure, and includes a detecting module 301, a determining module 302, a prompting module 303, and a control module 304, specifically:
the detection module 301 is configured to continuously obtain scene images of a traffic intersection, and perform pedestrian detection and vehicle detection on the scene images;
the determining module 302 is configured to generate alarm prompt information when it is determined that a pedestrian red light running event exists according to a pedestrian detection result and traffic light information corresponding to the traffic intersection;
and the prompting module 303 is configured to send the alarm prompting information to the target vehicle when it is determined that the target vehicle to pass through the traffic intersection exists according to a vehicle detection result.
In one possible implementation, the detection module 301, when performing pedestrian detection and vehicle detection on the scene image, is configured to:
detecting pedestrians and vehicles in the scene image according to a first target detection model and a second target detection model which are trained in advance; the first target detection model is obtained by training based on an image sample marked with pedestrian information, and the second target detection model is obtained by training based on an image sample marked with vehicle information.
In one possible embodiment, the prompting module 303, when determining that there is a target vehicle to pass through the traffic intersection according to the result of the vehicle detection, is configured to:
and under the condition that the vehicle exists in the scene image according to the result of the vehicle detection, determining whether the existing vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future according to the driving direction and the current position of the vehicle.
In one possible implementation, the prompting module 303, when determining whether the existing vehicle is the target vehicle passing through the traffic intersection within a preset time period in the future according to the driving direction and the current position of the vehicle, is configured to:
and if the driving direction of the vehicle is the direction towards the pedestrian and the current position of the vehicle is within a set position range, determining that the vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future.
In a possible embodiment, the method further comprises:
the control module 304 is configured to control a color of a target traffic light at the traffic intersection to change when it is determined that a red light running event of a pedestrian exists according to a result of the pedestrian detection and traffic light information corresponding to the traffic intersection.
In one possible implementation, the alarm prompt message comprises a pedestrian alarm prompt message and/or a deceleration crawling prompt message;
the prompt module 303, when sending the alarm prompt message to the target vehicle, is configured to:
and sending the alarm prompt information to the target vehicle in a voice format.
In some embodiments, the functions of the apparatus provided in the embodiments of the present disclosure or the included templates may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, no further description is provided here.
Based on the same technical concept, the embodiment of the disclosure also provides an electronic device. Referring to fig. 4, a schematic structural diagram of an electronic device provided in the embodiment of the present disclosure includes a processor 401, a memory 402, and a bus 403. The memory 402 is used for storing execution instructions and includes a memory 4021 and an external memory 4022; the memory 4021 is also referred to as an internal memory, and is configured to temporarily store operation data in the processor 401 and data exchanged with the external memory 4022 such as a hard disk, the processor 401 exchanges data with the external memory 4022 through the memory 4021, and when the electronic device 400 operates, the processor 401 communicates with the memory 402 through the bus 403, so that the processor 401 executes the following instructions:
continuously acquiring scene images of a traffic intersection, and performing pedestrian detection and vehicle detection on the scene images;
generating alarm prompt information under the condition that a pedestrian red light running event is determined to exist according to the result of pedestrian detection and traffic signal light information corresponding to the traffic intersection;
and sending the alarm prompt information to the target vehicle under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result.
In one possible design, the instructions executed by the processor 401 to perform pedestrian detection and vehicle detection on the scene image include:
detecting pedestrians and vehicles in the scene image according to a first target detection model and a second target detection model which are trained in advance; the first target detection model is obtained by training based on an image sample marked with pedestrian information, and the second target detection model is obtained by training based on an image sample marked with vehicle information.
In one possible design, the processor 401 executes instructions to determine, according to a result of the vehicle detection, that there is a target vehicle to pass through the traffic intersection, including:
and under the condition that the vehicle exists in the scene image according to the result of the vehicle detection, determining whether the existing vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future according to the driving direction and the current position of the vehicle.
In one possible design, the processor 401 executes instructions to determine whether the existing vehicle is a target vehicle passing through the traffic intersection within a preset time period in the future according to the driving direction and the current position of the vehicle, and the method includes:
and if the driving direction of the vehicle is the direction towards the pedestrian and the current position of the vehicle is within a set position range, determining that the vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future.
In one possible design, the instructions executed by the processor 401 further include:
and controlling the color of a target traffic light of the traffic intersection to change under the condition that the red light running event of the pedestrian is determined to exist according to the detection result of the pedestrian and the traffic light information corresponding to the traffic intersection.
In one possible design, the processor 401 executes instructions, where the warning prompt includes pedestrian warning prompt and/or slowdown and crawl prompt;
sending the warning prompt message to the target vehicle, including:
and sending the alarm prompt information to the target vehicle in a voice format.
In addition, the embodiment of the present disclosure further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method for generating prompt information described in the above method embodiment are executed.
The computer program product of the method for generating prompt information provided in the embodiments of the present disclosure includes a computer-readable storage medium storing a program code, where instructions included in the program code may be used to execute the steps of the method for generating prompt information described in the above method embodiments, which may be referred to in the above method embodiments specifically, and are not described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above are only specific embodiments of the present disclosure, but the scope of the present disclosure is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present disclosure, and shall be covered by the scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (10)
1. A method for generating prompt information is characterized by comprising the following steps:
continuously acquiring scene images of a traffic intersection, and performing pedestrian detection and vehicle detection on the scene images;
generating alarm prompt information under the condition that a pedestrian red light running event is determined to exist according to the result of pedestrian detection and traffic signal light information corresponding to the traffic intersection;
and sending the alarm prompt information to the target vehicle under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result.
2. The method of claim 1, wherein performing pedestrian detection and vehicle detection on the scene image comprises:
detecting pedestrians and vehicles in the scene image according to a first target detection model and a second target detection model which are trained in advance; the first target detection model is obtained by training based on an image sample marked with pedestrian information, and the second target detection model is obtained by training based on an image sample marked with vehicle information.
3. The method of claim 1, wherein determining that there is a target vehicle to pass through the traffic intersection based on a result of the vehicle detection comprises:
and under the condition that the vehicle exists in the scene image according to the result of the vehicle detection, determining whether the existing vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future according to the driving direction and the current position of the vehicle.
4. The method of claim 3, wherein determining whether the existing vehicle is the target vehicle for passing through the traffic intersection within a preset time period in the future according to the driving direction and the current position of the vehicle comprises:
and if the driving direction of the vehicle is the direction towards the pedestrian and the current position of the vehicle is within a set position range, determining that the vehicle is a target vehicle passing through the traffic intersection within a preset time length in the future.
5. The method of claim 1, further comprising:
and controlling the color of a target traffic light of the traffic intersection to change under the condition that the red light running event of the pedestrian is determined to exist according to the detection result of the pedestrian and the traffic light information corresponding to the traffic intersection.
6. The method of claim 1, wherein the alert prompt includes a pedestrian alert prompt and/or a slowdown and crawl prompt;
sending the warning prompt message to the target vehicle, including:
and sending the alarm prompt information to the target vehicle in a voice format.
7. A presentation information generating apparatus, comprising:
the detection module is used for continuously acquiring scene images of a traffic intersection and carrying out pedestrian detection and vehicle detection on the scene images;
the determining module is used for generating alarm prompt information under the condition that a pedestrian red light running event is determined to exist according to the pedestrian detection result and the traffic signal lamp information corresponding to the traffic intersection;
and the prompting module is used for sending the alarm prompting information to the target vehicle under the condition that the target vehicle to pass through the traffic intersection is determined according to the vehicle detection result.
8. The apparatus of claim 7, wherein the detection module, when performing pedestrian detection and vehicle detection with respect to the scene image, is configured to:
detecting pedestrians and vehicles in the scene image according to a first target detection model and a second target detection model which are trained in advance; the first target detection model is obtained by training based on an image sample marked with pedestrian information, and the second target detection model is obtained by training based on an image sample marked with vehicle information.
9. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of the hint information generation method as claimed in any one of claims 1 to 6.
10. A computer-readable storage medium, having stored thereon a computer program for executing the steps of the method of generating a reminder message according to any one of claims 1 to 6 when the computer program is executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010525325.7A CN111666906A (en) | 2020-06-10 | 2020-06-10 | Prompt message generation method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010525325.7A CN111666906A (en) | 2020-06-10 | 2020-06-10 | Prompt message generation method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111666906A true CN111666906A (en) | 2020-09-15 |
Family
ID=72386673
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010525325.7A Pending CN111666906A (en) | 2020-06-10 | 2020-06-10 | Prompt message generation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111666906A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114241744A (en) * | 2021-12-13 | 2022-03-25 | 中控智网(北京)能源技术有限公司 | Road traffic control system, method, device, equipment and storage medium |
| CN114435388A (en) * | 2022-02-23 | 2022-05-06 | 一汽解放汽车有限公司 | Safety control system, method, device and equipment of vehicle and vehicle |
| CN115294795A (en) * | 2022-06-10 | 2022-11-04 | 华南师范大学 | Pedestrian crossing supervision method, electronic device and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002166750A (en) * | 2000-12-01 | 2002-06-11 | Matsushita Electric Ind Co Ltd | Vehicle with display function |
| CN106023649A (en) * | 2016-06-23 | 2016-10-12 | 重庆邮电大学 | Pedestrian red light running caution system based on WAVE communication and method |
| CN106971626A (en) * | 2017-05-12 | 2017-07-21 | 南通海鑫信息科技有限公司 | A kind of alarming method for power of pedestrian running red light |
| US20180061230A1 (en) * | 2016-08-29 | 2018-03-01 | Allstate Insurance Company | Electrical Data Processing System for Monitoring or Affecting Movement of a Vehicle Using a Traffic Device |
| CN108877205A (en) * | 2018-07-12 | 2018-11-23 | 苏州旭安交通科技有限公司 | Pedestrian running red light detection method and system |
| CN109389838A (en) * | 2018-11-26 | 2019-02-26 | 爱驰汽车有限公司 | Unmanned crossing paths planning method, system, equipment and storage medium |
| CN110580808A (en) * | 2018-06-08 | 2019-12-17 | 杭州海康威视数字技术股份有限公司 | Information processing method and device, electronic equipment and intelligent traffic system |
| CN110598511A (en) * | 2018-06-13 | 2019-12-20 | 杭州海康威视数字技术股份有限公司 | Method, device, electronic equipment and system for detecting green light running event |
-
2020
- 2020-06-10 CN CN202010525325.7A patent/CN111666906A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002166750A (en) * | 2000-12-01 | 2002-06-11 | Matsushita Electric Ind Co Ltd | Vehicle with display function |
| CN106023649A (en) * | 2016-06-23 | 2016-10-12 | 重庆邮电大学 | Pedestrian red light running caution system based on WAVE communication and method |
| US20180061230A1 (en) * | 2016-08-29 | 2018-03-01 | Allstate Insurance Company | Electrical Data Processing System for Monitoring or Affecting Movement of a Vehicle Using a Traffic Device |
| CN106971626A (en) * | 2017-05-12 | 2017-07-21 | 南通海鑫信息科技有限公司 | A kind of alarming method for power of pedestrian running red light |
| CN110580808A (en) * | 2018-06-08 | 2019-12-17 | 杭州海康威视数字技术股份有限公司 | Information processing method and device, electronic equipment and intelligent traffic system |
| CN110598511A (en) * | 2018-06-13 | 2019-12-20 | 杭州海康威视数字技术股份有限公司 | Method, device, electronic equipment and system for detecting green light running event |
| CN108877205A (en) * | 2018-07-12 | 2018-11-23 | 苏州旭安交通科技有限公司 | Pedestrian running red light detection method and system |
| CN109389838A (en) * | 2018-11-26 | 2019-02-26 | 爱驰汽车有限公司 | Unmanned crossing paths planning method, system, equipment and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114241744A (en) * | 2021-12-13 | 2022-03-25 | 中控智网(北京)能源技术有限公司 | Road traffic control system, method, device, equipment and storage medium |
| CN114435388A (en) * | 2022-02-23 | 2022-05-06 | 一汽解放汽车有限公司 | Safety control system, method, device and equipment of vehicle and vehicle |
| CN114435388B (en) * | 2022-02-23 | 2023-09-12 | 一汽解放汽车有限公司 | Safety control system, method, device and equipment for vehicle and vehicle |
| CN115294795A (en) * | 2022-06-10 | 2022-11-04 | 华南师范大学 | Pedestrian crossing supervision method, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108022450B (en) | Auxiliary driving method based on cellular network and traffic control unit | |
| CN107644197B (en) | Rear camera lane detection | |
| US11493920B2 (en) | Autonomous vehicle integrated user alert and environmental labeling | |
| WO2018135605A1 (en) | Event prediction system, event prediction method, program, and moving body | |
| JP6250180B2 (en) | Vehicle irradiation control system and image irradiation control method | |
| CN111666906A (en) | Prompt message generation method and device, electronic equipment and storage medium | |
| JP4967015B2 (en) | Safe driving support device | |
| JP6238859B2 (en) | Vehicle irradiation control system and light irradiation control method | |
| CN113212454B (en) | Method and device for adjusting running state of vehicle, computer equipment and storage medium | |
| US20200353863A1 (en) | Method and system to avoid vehicle collision | |
| JP2004259069A (en) | Alarm system for outputting alarm signal depending on vehicle hazard level | |
| JP2003081039A (en) | Environment risk arithmetic unit | |
| JP2017207932A (en) | Passage safety device, and traffic accident occurrence prevention method | |
| CN111754813A (en) | Driving assisting method and device | |
| SE1450193A1 (en) | Driver support | |
| JP2017111498A (en) | Driving support device | |
| CN113043955A (en) | Road condition information display device and method and vehicle | |
| JP2021534490A (en) | Matrix detection and response to matrices for autonomous vehicles | |
| JP2018190026A (en) | Automatic driving vehicle control system and control method | |
| CN108423007B (en) | Target display method and device, electronic equipment and automobile | |
| CN111627233A (en) | Method and device for coordinating passing route for vehicle | |
| JP2021144280A (en) | Mobile body control device, mobile body control method, and program | |
| JP2018097479A (en) | Driving support apparatus, driving support method, driving support program, and driving support system | |
| US10614720B2 (en) | Information presentation method and information presentation device | |
| JP7008515B2 (en) | Information processing method and information processing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |