CN110293977A - Method and apparatus for showing augmented reality information warning - Google Patents

Method and apparatus for showing augmented reality information warning Download PDF

Info

Publication number
CN110293977A
CN110293977A CN201910594002.0A CN201910594002A CN110293977A CN 110293977 A CN110293977 A CN 110293977A CN 201910594002 A CN201910594002 A CN 201910594002A CN 110293977 A CN110293977 A CN 110293977A
Authority
CN
China
Prior art keywords
trigger condition
augmented reality
security measures
information warning
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910594002.0A
Other languages
Chinese (zh)
Other versions
CN110293977B (en
Inventor
李黎萍
宁为夷
牛明睿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apollo Intelligent Connectivity Beijing Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201910594002.0A priority Critical patent/CN110293977B/en
Priority to CN202110788672.3A priority patent/CN113386785B/en
Publication of CN110293977A publication Critical patent/CN110293977A/en
Application granted granted Critical
Publication of CN110293977B publication Critical patent/CN110293977B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Embodiment of the disclosure discloses the method and apparatus for showing augmented reality information warning.One specific embodiment of this method includes: to obtain the operation data of vehicle;According to the operation data of vehicle, it is determined whether meet the trigger condition of proactive security measures corresponding with the operation data of vehicle;Meet trigger condition in response to determining, generates the augmented reality information warning of prompt triggering proactive security measures;Finally, showing above-mentioned augmented reality information warning.The embodiment realizes the case where more clearly visible informing user's proactive security measures, facilitates reduction and the inconsistent operation of proactive security measures, and then reduce and drive risk.

Description

Method and apparatus for showing augmented reality information warning
Technical field
Embodiment of the disclosure is related to field of computer technology, and in particular to for showing augmented reality (Augmented Reality, AR) information warning method and apparatus.
Background technique
With the rapid development of computer technology, in order to guarantee driving safety, the advanced driving auxiliary based on automatic Pilot Proactive security measures in system (ADAS, advanced driving assistance system) also achieve increasingly wider General application.When proactive security measures execute, generally require clearly to inform user.
There are two types of relevant mode is usual: one, which is utilized on automobile instrument panel, shows that people's vehicle schematic images and car are alert Show that sound combines;The second is warning red dot is projected on front windshield using HUD (Head Up Display, head-up display) And it flashes.
Summary of the invention
Embodiment of the disclosure proposes the method and apparatus for showing augmented reality information warning.
In a first aspect, embodiment of the disclosure provides a kind of method for showing augmented reality information warning, the party Method includes: to obtain the operation data of vehicle;According to the operation data of vehicle, it is determined whether meet corresponding with the operation data of vehicle Proactive security measures trigger condition;Meet trigger condition in response to determining, generates the increasing of prompt triggering proactive security measures Strong reality information warning;Show augmented reality information warning.
In some embodiments, above-mentioned operation data includes apart from monitoring data;It is above-mentioned to be used to indicate apart from monitoring data The distance between objective body and monitoring device in target area;And the above-mentioned operation data according to vehicle, it is determined whether full The trigger condition of foot proactive security measures corresponding with the operation data of vehicle, comprising: in response to determining apart from monitoring data institute The distance between the objective body of instruction and monitoring device are less than pre-determined distance threshold value, determine and meet the monitoring data at a distance from vehicle The trigger condition of corresponding proactive security measures.
In some embodiments, above-mentioned to meet trigger condition in response to determining, generate prompt triggering proactive security measures Augmented reality information warning, comprising: obtain the video for shooting the met corresponding objective body region of trigger condition;It is based on Video and the trigger condition met generate augmented reality information warning.
In some embodiments, above-mentioned based on video and the trigger condition met, generate augmented reality information warning, packet It includes: determining that the met corresponding objective body of trigger condition shows position in video;According to position, target location is generated Information;By the proactive security measures for characterizing met trigger condition illustrate information display position and target location information into Row association, generates augmented reality information warning.
In some embodiments, above-mentioned display augmented reality information warning, comprising: by proactive security measures illustrate information with The corresponding objective body association display of the trigger condition met.
Second aspect, embodiment of the disclosure provide a kind of for showing the device of augmented reality information warning, the dress Setting includes: acquiring unit, is configured to obtain the operation data of vehicle;Determination unit is configured to the operation number according to vehicle According to, it is determined whether meet the trigger condition of proactive security measures corresponding with the operation data of vehicle;Generation unit is configured to Meet trigger condition in response to determining, generates the augmented reality information warning of prompt triggering proactive security measures;Display unit, quilt It is configured to display augmented reality information warning.
In some embodiments, above-mentioned operation data includes apart from monitoring data;It is above-mentioned to be used to indicate apart from monitoring data The distance between objective body and monitoring device in target area;And above-mentioned determination unit is further configured to: in response to Determine that the distance between objective body and monitoring device indicated by the monitoring data are less than pre-determined distance threshold value, determine meet and The trigger condition apart from the corresponding proactive security measures of monitoring data of vehicle.
In some embodiments, above-mentioned generation unit includes: acquisition module, is configured to obtain the met triggering of shooting The video of the corresponding objective body region of condition;Generation module is configured to based on video and the trigger condition met, raw At augmented reality information warning.
In some embodiments, above-mentioned generation module includes: position determination submodule, is configured to determine met touching The corresponding objective body of clockwork spring part shows position in video;Position generates submodule, is configured to generate target according to position Body position information;Information generates submodule, is configured to the proactive security measures for characterizing met trigger condition illustrating letter The display position of breath is associated with target location information, generates augmented reality information warning.
In some embodiments, above-mentioned display unit is further configured to: proactive security measures are illustrated information and institute The corresponding objective body association display of the trigger condition of satisfaction.
The third aspect, embodiment of the disclosure provide a kind of terminal, which includes: one or more processors;It deposits Storage device is stored thereon with one or more programs;Display screen is display configured to information warning;When one or more programs It is executed by one or more processors, so that one or more processors are realized as described in implementation any in first aspect Method.
Fourth aspect, embodiment of the disclosure provide a kind of computer-readable medium, are stored thereon with computer program, The method as described in implementation any in first aspect is realized when the program is executed by processor.
The method and apparatus for showing augmented reality information warning that embodiment of the disclosure provides, first acquisition vehicle Operation data;Then, according to the operation data of vehicle, it is determined whether meet active safety corresponding with the operation data of vehicle The trigger condition of measure;Next, meeting trigger condition in response to determining, the enhancing for generating prompt triggering proactive security measures is existing Real information warning;Finally, showing above-mentioned augmented reality information warning.To realize more clearly visible informing user's active safety The case where measure, facilitates reduction and the inconsistent operation of proactive security measures, and then reduces and drive risk.
Detailed description of the invention
By reading a detailed description of non-restrictive embodiments in the light of the attached drawings below, the disclosure is other Feature, objects and advantages will become more apparent upon:
Fig. 1 is that one embodiment of the disclosure can be applied to exemplary system architecture figure therein;
Fig. 2 is the flow chart according to one embodiment of the method for showing augmented reality information warning of the disclosure;
Fig. 3 is according to an embodiment of the present disclosure for showing an application scenarios of the method for augmented reality information warning Information flow schematic diagram;
Fig. 4 is the process according to another embodiment of the method for showing augmented reality information warning of the disclosure Figure;
Fig. 5 is the structural representation according to one embodiment of the device for showing augmented reality information warning of the disclosure Figure;
Fig. 6 is adapted for the structural schematic diagram for realizing the electronic equipment of embodiment of the disclosure.
Specific embodiment
The disclosure is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order to Convenient for description, part relevant to related invention is illustrated only in attached drawing.
It should be noted that in the absence of conflict, the feature in embodiment and embodiment in the disclosure can phase Mutually combination.The disclosure is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Fig. 1 is shown can be using the method for being used to show augmented reality information warning of the disclosure or for showing enhancing The exemplary architecture 100 of the device of real information warning.
As shown in Figure 1, system architecture 100 may include terminal device 101,102,103, network 104 and server 105. Network 104 between terminal device 101,102,103 and server 105 to provide the medium of communication link.Network 104 can be with Including various connection types, such as wired, wireless communication link or fiber optic cables etc..
Terminal device 101,102,103 is interacted by network 104 with server 105, to receive or send message etc..Terminal Various telecommunication customer end applications can be installed in equipment 101,102,103, for example, searching class application, instant messaging tools, Figure class application etc..
Terminal device 101,102,103 can be hardware, be also possible to software.When terminal device 101,102,103 is hard When part, the various electronic equipments of communication connection, including but not limited to smart phone, plate are can be with display screen and supported Computer, pocket computer on knee and on-vehicle safety control system (can integrate on vehicle) etc..Wherein, in the present embodiment Above-mentioned smart phone, tablet computer, pocket computer on knee etc. usually use in the car.When terminal device 101,102, 103 when being software, may be mounted in above-mentioned cited electronic equipment.Multiple softwares or software module may be implemented into it (such as providing the software of Distributed Services or software module), also may be implemented into single software or software module.Herein It is not specifically limited.
Server 105 can be to provide the server of various services, for example, show on terminal device 101,102,103 Augmented reality information warning provides the background server supported.Background server can be according to the trigger condition of proactive security measures Various augmented reality information warnings are pre-generated, and augmented reality information warning generated is sent to terminal device.
It, at this time can also be with it should be noted that above-mentioned augmented reality information warning can also be generated directly by terminal device There is no networks 104 and server 105.
It should be noted that server can be hardware, it is also possible to software.When server is hardware, may be implemented At the distributed server cluster that multiple servers form, individual server also may be implemented into.It, can when server is software To be implemented as multiple softwares or software module (such as providing the software of Distributed Services or software module), also may be implemented At single software or software module.It is not specifically limited herein.
It should be noted that for showing that the method for augmented reality information warning is general provided by embodiment of the disclosure It is executed by terminal device 101,102,103, correspondingly, for showing that the device of augmented reality information warning is generally positioned at terminal In equipment 101,102,103.
It should be understood that the number of terminal device, network and server in Fig. 1 is only schematical.According to realization need It wants, can have any number of terminal device, network and server.
With continued reference to Fig. 2, a reality of the method for showing augmented reality information warning according to the disclosure is shown Apply the process 200 of example.This be used for show augmented reality information warning method the following steps are included:
Step 201, the operation data of vehicle is obtained.
In the present embodiment, for showing the executing subject (terminal as shown in Figure 1 of the method for augmented reality information warning Equipment 101,102,103) wired connection mode can be passed through or radio connection obtains the operation data of vehicle.Wherein, The operation data of above-mentioned vehicle may include various data relevant to vehicle driving.It can include but is not limited to it is following at least One: travel speed, lane offset, the distance away from peripheral obstacle.As an example, above-mentioned travel speed can be from automobile speed Sensor is spent to obtain;Above-mentioned lane offset can be obtained according to the matching between vehicle mounted guidance and high-precision map, can also be with It is obtained from the processor for carrying out Lane detection of communication connection;The above-mentioned distance away from peripheral obstacle can be from ultrasonic wave Radar obtains.
In some optional implementations of the present embodiment, above-mentioned operation data may include apart from monitoring data.On State the distance between objective body and the monitoring device that can serve to indicate that in target area apart from monitoring data.Wherein, above-mentioned mesh Mark region can be the region that the distance monitoring equipment installed on vehicle is able to detect that.Above-mentioned detection device can be various vapour Vehicle radar.Such as laser radar, ultrasonic radar, microwave radar etc..Above-mentioned objective body may include static or mobile people Or object.For example, above-mentioned objective body can include but is not limited to it is at least one of following: pedestrian, vehicle, trees, railing, road shoulder.
Step 202, according to the operation data of vehicle, it is determined whether meet active safety corresponding with the operation data of vehicle The trigger condition of measure.
In the present embodiment, the operation data of the vehicle according to acquired in step 201, above-mentioned executing subject can be by each Kind mode determines whether the trigger condition for meeting proactive security measures corresponding with the operation data of vehicle.
As an example, the respective trigger condition of different proactive security measures can be stored in advance in above-mentioned executing subject. For example, it is more than pre-set velocity or distance that the trigger condition for reducing the proactive security measures of throttle or brake, which may include speed,.Again For example, the trigger condition of the proactive security measures of directional trim may include that lane offset is greater than preset threshold and is not detected Turn signal is opened.Above-mentioned executing subject can be by the touching of the operation data of acquired vehicle and the proactive security measures stored Clockwork spring part compares, it is determined whether meets the trigger condition of the corresponding proactive security measures of operation data of vehicle.
As another example, the corresponding active safety of different classes of operation data can be stored in advance in above-mentioned executing subject The execution information of measure.For example, the corresponding characterization of travel speed reduces the execution information of the proactive security measures of throttle or brake.It rings Ying Yu detects that above-mentioned characterization reduces the execution information of the proactive security measures of throttle or brake, and above-mentioned executing subject can determine Meet the trigger condition of proactive security measures corresponding with travel speed.
In some optional implementations of the present embodiment, based in operation data apart from monitoring data, in response to Determine the distance between objective body and monitoring device indicated by the monitoring data less than pre-determined distance threshold value, above-mentioned execution master Body can determine the trigger condition of the corresponding proactive security measures of satisfaction monitoring data at a distance from vehicle.
Step 203, meet trigger condition in response to determining, generate the augmented reality warning of prompt triggering proactive security measures Information.
In the present embodiment, meet trigger condition in response to determining, prompt triggering can be generated actively in above-mentioned executing subject The augmented reality information warning of safety measure.Wherein, above-mentioned augmented reality information warning can be by real-time imaging and information warning It is formed by stacking.Above-mentioned real-time imaging can be video captured by the camera being installed on vehicle.Above-mentioned information warning can be with It is various forms, such as image, text, voice.For example, above-mentioned information warning can be the text of " having triggered proactive security measures " Word.Above-mentioned text can Overlapping display be on a display screen together with real-time imaging.Optionally, it can also be wrapped in above-mentioned information warning Include the trigger condition of triggered proactive security measures.Optionally, above-mentioned information warning can also be that " you have driven over the speed limit, The voice prompting of automatic retarding ".
In some optional implementations of the present embodiment, above-mentioned executing subject can generate prompt in accordance with the following steps Trigger the augmented reality information warning of proactive security measures:
The first step obtains the video for shooting the met corresponding objective body region of trigger condition.
In these implementations, above-mentioned executing subject can obtain what shooting was met by the camera of communication connection The video of the corresponding objective body region of trigger condition.Wherein, the corresponding objective body of above-mentioned met trigger condition can be with It is determined according to trigger condition, such as the distance away from monitoring device is less than people or the object of preset threshold.
Second step generates augmented reality information warning based on video and the trigger condition met.
In these implementations, above-mentioned executing subject can will be prompted to the text or image letter of triggering proactive security measures Breath is superimposed in above-mentioned video, generates augmented reality information warning.
Step 204, augmented reality information warning is shown.
In the present embodiment, above-mentioned executing subject can be carried out according to step 203 augmented reality information warning generated Display.As an example, above-mentioned executing subject can show the augmented reality information warning of text or image format on a display screen. As another example, above-mentioned executing subject can also broadcast the information warning of speech form, while show and casting The corresponding text of information warning or image.
It is the method according to an embodiment of the present disclosure for showing augmented reality information warning with continued reference to Fig. 3, Fig. 3 One information flow schematic diagram of application scenarios.In the application scenarios of Fig. 3, warning system can be installed on vehicle 301 3011, velocity sensor 3012, onboard navigation system 3013 and Vehicular display device 3014.Warning system 3011 can be passed from speed The travel speed " 75km/h " 3015 of the acquisition vehicle 301 of sensor 3012.Later, warning system 3011 can also pass through vehicle mounted guidance The speed-limiting messages that system 3013 obtains this section are " being no more than 70km/h " 3016.Next, warning system 3011 can basis Acquired travel speed 3015 is more than speed indicated by speed-limiting messages 3016, determines that satisfaction is corresponding with the travel speed of vehicle Deceleration measure trigger condition.Then, meet above-mentioned trigger condition in response to determining, warning system 3011 can be generated by The augmented reality warning that the information warning and real-time imaging of the written form of " you have exceeded the speed limit, and have been turned on automatic retarding " are formed by stacking Information 3017.Finally, augmented reality information warning 3017 generated can be sent to Vehicular display device by warning system 3011 3014, so that Vehicular display device 3014 shows above-mentioned augmented reality information warning 3017.
Currently, one of prior art is usually to be led in conjunction with interior caution sound to driver using instrument board image The informing of dynamic safety measure, can only often embody to the prompt for driving risk and not to proactive security measures trigger condition into Row explanation.So as to cause user (such as driver) because distrust or it is inconvenient for use due to close proactive security measures or take with it is main The inconsistent operation of dynamic safety measure, causes and drives risk.And the method provided by the above embodiment of the disclosure, it is mentioned by generating The augmented reality information warning for showing triggering proactive security measures, can more clearly visible inform the feelings of user's proactive security measures Condition facilitates reduction and the inconsistent operation of proactive security measures, to reduce driving risk.
With further reference to Fig. 4, it illustrates another embodiments for showing the method for augmented reality information warning Process 400.This is used to show the process 400 of the method for augmented reality information warning, comprising the following steps:
Step 401, the operation data of vehicle is obtained.
In the present embodiment, above-mentioned operation data may include apart from monitoring data.It is above-mentioned to be used apart from monitoring data In objective body and the distance between monitoring device in instruction target area.
Step 402, in response to determining that the distance between objective body and monitoring device indicated by the monitoring data are less than Pre-determined distance threshold value determines the trigger condition for meeting the corresponding proactive security measures of monitoring data at a distance from vehicle.
Step 403, the video for shooting the met corresponding objective body region of trigger condition is obtained.
Above-mentioned steps 401, step 402, step 403 respectively with step 201, step 202, the step in previous embodiment The description of corresponding part is consistent in 203, and the description above with respect to corresponding part in step 201, step 202 and step 203 is also fitted For step 401, step 402 and step 403, details are not described herein again.
Step 404, determine that the met corresponding objective body of trigger condition shows position in video.
In the present embodiment, for showing executing subject (such as end shown in FIG. 1 of the method for augmented reality information warning End equipment 101,102,103) can determine that the corresponding objective body of above-mentioned met trigger condition is aobvious by image recognition technology Show position in video.Wherein, the corresponding objective body of above-mentioned met trigger condition can be distance monitoring equipment and be less than The people of pre-determined distance threshold value or object.In general, above-mentioned objective body can by above-mentioned monitoring device (such as various trailer-mounted radars) into Row coarse localization.Later, above-mentioned executing subject can be positioned by various targets and target detection technique determines above-mentioned objective body The position of display in video.
Step 405, according to position, target location information is generated.
In the present embodiment, target position can be generated in the position according to determined by above-mentioned steps 404, above-mentioned executing subject Confidence breath, the position in video frame to indicate above-mentioned objective body place video.In general, above-mentioned target location information can wrap Include coordinate.For example, it may be coordinate and side by the center of frame (bounding box) determined by Technology for Target Location The length and width of frame indicates.
Step 406, the proactive security measures for characterizing met trigger condition are illustrated to display position and the target of information Body position information is associated, and generates augmented reality information warning.
In the present embodiment, above-mentioned executing subject can will characterize the proactive security measures explanation of met trigger condition The display position of information determines near the position indicated by the target location information generated of above-mentioned steps 405, thus raw At augmented reality information warning.Wherein, it is at least one of following to illustrate that information can include but is not limited to for above-mentioned proactive security measures: Proactive security measures trigger condition (such as " distance is less than 2 meters "), proactive security measures executive condition (such as " automatic brake Vehicle "), triggering object instruction icon (such as being directed toward the arrow apart from nearest pedestrian).
Step 407, augmented reality information warning is shown.
Step 204 in above-mentioned steps 407 and previous embodiment is consistent, and the description above with respect to step 204 is also applied for Step 407, details are not described herein again.
In some optional implementations of the present embodiment, proactive security measures can be illustrated letter by above-mentioned executing subject Cease objective body association display corresponding with above-mentioned met trigger condition.That is, above-mentioned safety measure illustrates that information can be shown Near above-mentioned objective body.
Figure 4, it is seen that 400 body of process of the method for showing augmented reality information warning in the present embodiment The proactive security measures for having showed the met trigger condition of generation characterization illustrate information and the associated augmented reality of target location Information warning and the step of be associated with display.The scheme of the present embodiment description can illustrate to trigger in conjunction with real-video image as a result, The risk subjects of proactive security measures, without pre-establishing the image library of various objects, so that memory space is saved, but also Object shows more accurate.Also by the way that proactive security measures are illustrated that information is associated with display with objective body, it is more clear, intuitively Prompt drives risk and is illustrated to proactive security measures.And then helps to reduce and drive risk.
With further reference to Fig. 5, as the realization to method shown in above-mentioned each figure, present disclose provides for showing that enhancing is existing One embodiment of the device of real information warning, the Installation practice is corresponding with embodiment of the method shown in Fig. 2, device tool Body can be applied in various electronic equipments.
As shown in figure 5, the device 500 provided in this embodiment for showing augmented reality information warning includes acquiring unit 501, determination unit 502, generation unit 503 and display unit 504.Wherein, acquiring unit 501 are configured to obtain vehicle Operation data;Determination unit 502 is configured to the operation data according to vehicle, it is determined whether meets the operation data with vehicle The trigger condition of corresponding proactive security measures;Generation unit 503 is configured in response to determination and meets trigger condition, generates The augmented reality information warning of prompt triggering proactive security measures;Display unit 504 is display configured to augmented reality warning letter Breath.
In the present embodiment, in the device 500 for showing augmented reality information warning: acquiring unit 501, determination unit 502, the specific processing of generation unit 503 and display unit 504 and its brought technical effect can be corresponding real with reference to Fig. 2 respectively Step 201, step 202, the related description of step 203 and step 204 in example are applied, details are not described herein.
In some optional implementations of the present embodiment, above-mentioned operation data may include apart from monitoring data.On State the distance between objective body and the monitoring device that can serve to indicate that in target area apart from monitoring data.Above-mentioned determination unit 502 can be further configured to: in response to determine indicated by the monitoring data between objective body and monitoring device away from From pre-determined distance threshold value is less than, the trigger condition for meeting the corresponding proactive security measures of monitoring data at a distance from vehicle is determined.
In some optional implementations of the present embodiment, above-mentioned generation unit 503 may include: to obtain module (figure In be not shown), generation module (not shown).Wherein, above-mentioned acquisition module, which can be configured to obtain, shoots met touching The video of the corresponding objective body region of clockwork spring part.The touching that above-mentioned generation module is configured to video and is met Clockwork spring part generates augmented reality information warning.
In some optional implementations of the present embodiment, above-mentioned generation module may include: position determination submodule (not shown), position generate submodule (not shown), information generates submodule (not shown).Wherein, above-mentioned Position determination submodule may be configured to determine the position that the met corresponding objective body of trigger condition is shown in video. Above-mentioned position generates submodule and may be configured to generate target location information according to position.Above- mentioned information generate submodule It may be configured to display position and target position that the proactive security measures for characterizing met trigger condition are illustrated to information Confidence breath is associated, and generates augmented reality information warning.
In some optional implementations of the present embodiment, above-mentioned display unit 504 can be further configured to: will Proactive security measures illustrate that information can objective body association display corresponding with the trigger condition met.
The device provided by the above embodiment of the disclosure obtains the operation data of vehicle by acquiring unit 501;Then, According to the operation data of vehicle, determination unit 502 determines whether to meet proactive security measures corresponding with the operation data of vehicle Trigger condition;Later, meet trigger condition in response to determining, generation unit 503 generates prompt triggering proactive security measures Augmented reality information warning;Finally, display unit 504 shows augmented reality information warning.It is more clearly visible accused to realize The case where knowing user's proactive security measures facilitates reduction and the inconsistent operation of proactive security measures, and then reduces and drive wind Danger.
Below with reference to Fig. 6, it illustrates the electronic equipment that is suitable for being used to realize embodiment of the disclosure, (example is as shown in figure 1 Terminal device) 600 structural schematic diagram.Terminal device in embodiment of the disclosure can include but is not limited to such as move electricity The mobile terminal of words, laptop, PAD (tablet computer), car-mounted terminal (such as vehicle mounted guidance terminal) etc..Fig. 6 is shown Terminal device be only an example, should not function to embodiment of the disclosure and use scope bring any restrictions.
As shown in fig. 6, electronic equipment 600 may include processing unit (such as central processing unit, graphics processor etc.) 601, random access can be loaded into according to the program being stored in read-only memory (ROM) 602 or from storage device 608 Program in memory (RAM) 603 and execute various movements appropriate and processing.In RAM 603, it is also stored with electronic equipment Various programs and data needed for 600 operations.Processing unit 601, ROM 602 and RAM 603 pass through the phase each other of bus 604 Even.Input/output (I/O) interface 605 is also connected to bus 604.
In general, following device can connect to I/O interface 605: including such as touch screen, touch tablet, camera, acceleration The input unit 606 of meter, gyroscope etc.;Including such as liquid crystal display (LCD, Liquid Crystal Display), loudspeaking The output device 607 of device, vibrator etc.;Storage device 608 including such as flash memory (Flash Card) etc.;And communication device 609.Communication device 609 can permit electronic equipment 600 and wirelessly or non-wirelessly be communicated with other equipment to exchange data.Although Fig. 6 shows the electronic equipment 600 with various devices, it should be understood that being not required for implementing or having all show Device.It can alternatively implement or have more or fewer devices.Each box shown in Fig. 6 can represent a dress It sets, also can according to need and represent multiple devices.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium On computer program, which includes the program code for method shown in execution flow chart.In such reality It applies in example, which can be downloaded and installed from network by communication device 609, or from storage device 608 It is mounted, or is mounted from ROM 602.When the computer program is executed by processing unit 601, the implementation of the disclosure is executed The above-mentioned function of being limited in the method for example.
It is situated between it should be noted that computer-readable medium described in embodiment of the disclosure can be computer-readable signal Matter or computer readable storage medium either the two any combination.Computer readable storage medium for example can be with System, device or the device of --- but being not limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, or it is any more than Combination.The more specific example of computer readable storage medium can include but is not limited to: have one or more conducting wires Electrical connection, portable computer diskette, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type are programmable Read-only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic are deposited Memory device or above-mentioned any appropriate combination.In embodiment of the disclosure, computer readable storage medium, which can be, appoints What include or the tangible medium of storage program that the program can be commanded execution system, device or device use or and its It is used in combination.And in embodiment of the disclosure, computer-readable signal media may include in a base band or as carrier wave The data-signal that a part is propagated, wherein carrying computer-readable program code.The data-signal of this propagation can be adopted With diversified forms, including but not limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal is situated between Matter can also be any computer-readable medium other than computer readable storage medium, which can be with It sends, propagate or transmits for by the use of instruction execution system, device or device or program in connection.Meter The program code for including on calculation machine readable medium can transmit with any suitable medium, including but not limited to: electric wire, optical cable, RF (Radio Frequency, radio frequency) etc. or above-mentioned any appropriate combination.
Above-mentioned computer-readable medium can be included in above-mentioned terminal device;It is also possible to individualism, and not It is fitted into the terminal device.Above-mentioned computer-readable medium carries one or more program, when said one or more When a program is executed by the terminal device, so that the terminal device: obtaining the operation data of vehicle;According to the operation number of vehicle According to, it is determined whether meet the trigger condition of proactive security measures corresponding with the operation data of vehicle;Meet touching in response to determining Clockwork spring part generates the augmented reality information warning of prompt triggering proactive security measures;Show augmented reality information warning.
The behaviour for executing embodiment of the disclosure can be write with one or more programming languages or combinations thereof The computer program code of work, described program design language include object oriented program language-such as Java, Smalltalk, C++ further include conventional procedural programming language-such as " C " language or similar program design language Speech.Program code can be executed fully on the user computer, partly be executed on the user computer, as an independence Software package execute, part on the user computer part execute on the remote computer or completely in remote computer or It is executed on server.In situations involving remote computers, remote computer can pass through the network of any kind --- packet It includes local area network (LAN) or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as benefit It is connected with ISP by internet).
Flow chart and block diagram in attached drawing illustrate system, method and the computer of the various embodiments according to the disclosure The architecture, function and operation in the cards of program product.In this regard, each box in flowchart or block diagram can be with A part of a module, program segment or code is represented, a part of the module, program segment or code includes one or more Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants It is noted that the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, Ke Yiyong The dedicated hardware based system of defined functions or operations is executed to realize, or can be referred to specialized hardware and computer The combination of order is realized.
Being described in unit involved in embodiment of the disclosure can be realized by way of software, can also be passed through The mode of hardware is realized.Described unit also can be set in the processor, for example, can be described as: a kind of processor, Including acquiring unit, determination unit, generation unit, display unit.Wherein, the title of these units not structure under certain conditions The restriction of the pairs of unit itself, for example, acquiring unit is also described as " obtaining the unit of the operation data of vehicle ".
Above description is only the preferred embodiment of the disclosure and the explanation to institute's application technology principle.Those skilled in the art Member it should be appreciated that embodiment of the disclosure involved in invention scope, however it is not limited to the specific combination of above-mentioned technical characteristic and At technical solution, while should also cover do not depart from foregoing invention design in the case where, by above-mentioned technical characteristic or its be equal Feature carries out any combination and other technical solutions for being formed.Such as disclosed in features described above and embodiment of the disclosure (but It is not limited to) technical characteristic with similar functions is replaced mutually and the technical solution that is formed.

Claims (12)

1. a kind of method for showing augmented reality information warning, comprising:
Obtain the operation data of vehicle;
According to the operation data of the vehicle, it is determined whether meet proactive security measures corresponding with the operation data of the vehicle Trigger condition;
Meet the trigger condition in response to determining, generates the augmented reality warning letter that prompt triggers the proactive security measures Breath;
Show the augmented reality information warning.
2. according to the method described in claim 1, wherein, the operation data includes the distance monitoring apart from monitoring data Data are used to indicate the distance between objective body and monitoring device in target area;And
The operation data according to the vehicle, it is determined whether meet active safety corresponding with the operation data of the vehicle The trigger condition of measure, comprising:
It is less than in response to determination the distance between the objective body and the monitoring device indicated by the monitoring data default Distance threshold determines the trigger condition for meeting the corresponding proactive security measures of monitoring data at a distance from the vehicle.
3. according to the method described in claim 2, wherein, described to meet the trigger condition in response to determining, generation prompt is touched The augmented reality information warning for sending out proactive security measures described, comprising:
Obtain the video for shooting the met corresponding objective body region of trigger condition;
Based on the video and the trigger condition met, the augmented reality information warning is generated.
4. it is described based on the video and the trigger condition met according to the method described in claim 3, wherein, generate institute State augmented reality information warning, comprising:
Determine that the met corresponding objective body of trigger condition is shown in the position in the video;
According to the position, target location information is generated;
The proactive security measures for characterizing met trigger condition are illustrated that the display position of information and the target location are believed Breath is associated, and generates the augmented reality information warning.
5. according to the method described in claim 4, wherein, the display augmented reality information warning, comprising:
The proactive security measures are illustrated into information objective body association display corresponding with the met trigger condition.
6. a kind of for showing the device of augmented reality information warning, comprising:
Acquiring unit is configured to obtain the operation data of vehicle;
Determination unit is configured to the operation data according to the vehicle, it is determined whether meets the operation data with the vehicle The trigger condition of corresponding proactive security measures;
Generation unit is configured in response to determination and meets the trigger condition, generates prompt and triggers the proactive security measures Augmented reality information warning;
Display unit is display configured to the augmented reality information warning.
7. device according to claim 6, wherein the operation data includes the distance monitoring apart from monitoring data Data are used to indicate the distance between objective body and monitoring device in target area;And the determination unit is further matched It is set to:
It is less than in response to determination the distance between the objective body and the monitoring device indicated by the monitoring data default Distance threshold determines the trigger condition for meeting the corresponding proactive security measures of monitoring data at a distance from the vehicle.
8. device according to claim 7, wherein the generation unit includes:
Module is obtained, is configured to obtain the video for shooting the met corresponding objective body region of trigger condition;
Generation module is configured to generate the augmented reality information warning based on the video and the trigger condition met.
9. device according to claim 8, wherein the generation module includes:
Position determination submodule is configured to determine the corresponding objective body of met trigger condition and is shown in the video Position;
Position generates submodule, is configured to generate target location information according to the position;
Information generates submodule, is configured to illustrate the proactive security measures for characterizing met trigger condition the display of information Position is associated with the target location information, generates the augmented reality information warning.
10. device according to claim 9, wherein the display unit is further configured to:
Proactive security measures are illustrated into information objective body association display corresponding with the met trigger condition.
11. a kind of terminal, comprising:
One or more processors;
Storage device is stored thereon with one or more programs;
Display screen is display configured to information warning;
When one or more of programs are executed by one or more of processors, so that one or more of processors are real Now such as method as claimed in any one of claims 1 to 5.
12. a kind of computer-readable medium, is stored thereon with computer program, wherein the realization when program is executed by processor Such as method as claimed in any one of claims 1 to 5.
CN201910594002.0A 2019-07-03 2019-07-03 Method and apparatus for displaying augmented reality alert information Active CN110293977B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910594002.0A CN110293977B (en) 2019-07-03 2019-07-03 Method and apparatus for displaying augmented reality alert information
CN202110788672.3A CN113386785B (en) 2019-07-03 2019-07-03 Method and device for displaying augmented reality warning information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910594002.0A CN110293977B (en) 2019-07-03 2019-07-03 Method and apparatus for displaying augmented reality alert information

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202110788672.3A Division CN113386785B (en) 2019-07-03 2019-07-03 Method and device for displaying augmented reality warning information

Publications (2)

Publication Number Publication Date
CN110293977A true CN110293977A (en) 2019-10-01
CN110293977B CN110293977B (en) 2021-08-17

Family

ID=68030027

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202110788672.3A Active CN113386785B (en) 2019-07-03 2019-07-03 Method and device for displaying augmented reality warning information
CN201910594002.0A Active CN110293977B (en) 2019-07-03 2019-07-03 Method and apparatus for displaying augmented reality alert information

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202110788672.3A Active CN113386785B (en) 2019-07-03 2019-07-03 Method and device for displaying augmented reality warning information

Country Status (1)

Country Link
CN (2) CN113386785B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110949404A (en) * 2019-11-19 2020-04-03 中国第一汽车股份有限公司 Warning method and device, central control equipment, storage medium and system
CN112100445A (en) * 2020-09-11 2020-12-18 上海商汤临港智能科技有限公司 Image information processing method and device, electronic device and storage medium
CN113589924A (en) * 2021-07-05 2021-11-02 浙江商汤科技开发有限公司 Augmented reality display method and related device, vehicle and storage medium
CN114125695A (en) * 2020-08-31 2022-03-01 奥迪股份公司 Method, device and equipment for warning of vehicle driving on slope road and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103921790A (en) * 2014-05-12 2014-07-16 李质勇 Vehicle active safety intelligent system and control method
CN205396080U (en) * 2016-01-14 2016-07-27 南京航空航天大学 Car initiative collision avoidance system
CN106095075A (en) * 2016-05-31 2016-11-09 深圳市元征科技股份有限公司 A kind of information processing method and augmented reality equipment
CN206171447U (en) * 2016-11-14 2017-05-17 重庆锐速科技有限公司 Discernment of vehicle driving environment and early warning anticollision initiative safety coefficient
EP3211616A2 (en) * 2016-02-23 2017-08-30 LG Electronics Inc. Driver assistance apparatus
CN107757479A (en) * 2016-08-22 2018-03-06 何长伟 A kind of drive assist system and method based on augmented reality Display Technique
US20180354509A1 (en) * 2017-06-08 2018-12-13 Daqri, Llc Augmented reality (ar) visualization of advanced driver-assistance system
CN109050405A (en) * 2018-08-23 2018-12-21 毕则乾 A kind of multi-functional augmented reality head-up-display system and method
CN208452935U (en) * 2018-06-08 2019-02-01 江西精骏电控技术有限公司 A kind of electric car automatic Pilot display system
KR20190038088A (en) * 2017-09-29 2019-04-08 엘지전자 주식회사 Vehicle control device mounted on vehicle
CN109669534A (en) * 2018-11-13 2019-04-23 北京灵犀微光科技有限公司 Augmented reality display methods and device
CN109677399A (en) * 2017-10-18 2019-04-26 江苏卡威汽车工业集团股份有限公司 A kind of electric car active security system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102774349B (en) * 2012-07-27 2015-06-03 浙江吉利汽车研究院有限公司杭州分公司 Auxiliary device and auxiliary method for pre-tightening motor type safety belt
CN103105174B (en) * 2013-01-29 2016-06-15 四川长虹佳华信息产品有限责任公司 A kind of vehicle-mounted outdoor scene safety navigation method based on AR augmented reality
CN103697900A (en) * 2013-12-10 2014-04-02 郭海锋 Method for early warning on danger through augmented reality by vehicle-mounted emotional robot
CN104290745B (en) * 2014-10-28 2017-02-01 奇瑞汽车股份有限公司 Driving method of semi-automatic driving system for vehicle
CN108875460B (en) * 2017-05-15 2023-06-20 腾讯科技(深圳)有限公司 Augmented reality processing method and device, display terminal and computer storage medium
DE102017216100A1 (en) * 2017-09-12 2019-03-14 Volkswagen Aktiengesellschaft A method, apparatus and computer readable storage medium having instructions for controlling a display of an augmented reality display device for a motor vehicle
CN109017813A (en) * 2018-06-14 2018-12-18 安徽江淮汽车集团股份有限公司 A kind of deviation alarm method and device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103921790A (en) * 2014-05-12 2014-07-16 李质勇 Vehicle active safety intelligent system and control method
CN205396080U (en) * 2016-01-14 2016-07-27 南京航空航天大学 Car initiative collision avoidance system
EP3211616A2 (en) * 2016-02-23 2017-08-30 LG Electronics Inc. Driver assistance apparatus
CN106095075A (en) * 2016-05-31 2016-11-09 深圳市元征科技股份有限公司 A kind of information processing method and augmented reality equipment
CN107757479A (en) * 2016-08-22 2018-03-06 何长伟 A kind of drive assist system and method based on augmented reality Display Technique
CN206171447U (en) * 2016-11-14 2017-05-17 重庆锐速科技有限公司 Discernment of vehicle driving environment and early warning anticollision initiative safety coefficient
US20180354509A1 (en) * 2017-06-08 2018-12-13 Daqri, Llc Augmented reality (ar) visualization of advanced driver-assistance system
KR20190038088A (en) * 2017-09-29 2019-04-08 엘지전자 주식회사 Vehicle control device mounted on vehicle
CN109677399A (en) * 2017-10-18 2019-04-26 江苏卡威汽车工业集团股份有限公司 A kind of electric car active security system
CN208452935U (en) * 2018-06-08 2019-02-01 江西精骏电控技术有限公司 A kind of electric car automatic Pilot display system
CN109050405A (en) * 2018-08-23 2018-12-21 毕则乾 A kind of multi-functional augmented reality head-up-display system and method
CN109669534A (en) * 2018-11-13 2019-04-23 北京灵犀微光科技有限公司 Augmented reality display methods and device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110949404A (en) * 2019-11-19 2020-04-03 中国第一汽车股份有限公司 Warning method and device, central control equipment, storage medium and system
CN110949404B (en) * 2019-11-19 2021-06-29 中国第一汽车股份有限公司 Warning method and device, central control equipment, storage medium and system
CN114125695A (en) * 2020-08-31 2022-03-01 奥迪股份公司 Method, device and equipment for warning of vehicle driving on slope road and storage medium
CN114125695B (en) * 2020-08-31 2024-05-31 奥迪股份公司 Slope driving warning method, device and equipment of vehicle and storage medium
CN112100445A (en) * 2020-09-11 2020-12-18 上海商汤临港智能科技有限公司 Image information processing method and device, electronic device and storage medium
WO2022052451A1 (en) * 2020-09-11 2022-03-17 上海商汤临港智能科技有限公司 Image information processing method and apparatus, electronic device and storage medium
CN113589924A (en) * 2021-07-05 2021-11-02 浙江商汤科技开发有限公司 Augmented reality display method and related device, vehicle and storage medium

Also Published As

Publication number Publication date
CN113386785B (en) 2022-11-22
CN113386785A (en) 2021-09-14
CN110293977B (en) 2021-08-17

Similar Documents

Publication Publication Date Title
CN112141119B (en) Intelligent driving control method and device, vehicle, electronic equipment and storage medium
CN110293977A (en) Method and apparatus for showing augmented reality information warning
US11127373B2 (en) Augmented reality wearable system for vehicle occupants
JP7003660B2 (en) Information processing equipment, information processing methods and programs
RU2656933C2 (en) Method and device for early warning during meeting at curves
US10607485B2 (en) System and method for communicating a message to a vehicle
CN109739236A (en) Processing method, device, computer-readable medium and the electronic equipment of information of vehicles
CN106104653B (en) For providing the method and system of traffic congestion warning
US11180082B2 (en) Warning output device, warning output method, and warning output system
CN110962596B (en) Vehicle speed control method and device of automobile and storage medium
US11999371B2 (en) Driving assistance processing method and apparatus, computer-readable medium, and electronic device
CN110979332B (en) Control method, device and storage medium for smart car
US20230294684A1 (en) Method of controlling autonomous vehicle, electronic device, and storage medium
KR20170053903A (en) Apparatus and method for transmission of message between vehicle to vehicle
JP2016224477A (en) On-vehicle device, operation mode control system, and operation mode control method
CN113581195B (en) Special vehicle identification method, electronic device and computer readable medium
US10922976B2 (en) Display control device configured to control projection device, display control method for controlling projection device, and vehicle
WO2019117459A1 (en) Device and method for displaying content
JP6933065B2 (en) Information processing equipment, information provision system, information provision method, and program
CN109910885A (en) Method and apparatus based on electronic map control vehicle driving
CN112542052A (en) Method for warning unprotected traffic participants
US11455800B2 (en) Roadway alert system using video stream from a smart mirror
CN112590798A (en) Method, apparatus, electronic device, and medium for detecting driver state
CN111071151A (en) Anti-collision method and device for automobile and storage medium
JP2021033944A (en) Communication device, communication method and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20211021

Address after: 100176 Room 101, 1st floor, building 1, yard 7, Ruihe West 2nd Road, economic and Technological Development Zone, Daxing District, Beijing

Patentee after: Apollo Intelligent Connectivity (Beijing) Technology Co., Ltd.

Address before: 2 / F, baidu building, 10 Shangdi 10th Street, Haidian District, Beijing 100085

Patentee before: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd.